| user_id,prompt_id,topic,prompt_text,label,p_cloud,pred_choice |
| U0240,P0220,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.5900247798249949,cloud |
| U0238,P0258,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.5074178095467987,cloud |
| U0390,P0288,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.4939615436434187,local |
| U0246,P0203,image_generation,"Produce a logo mockup for product spec, transparent background",0,0.7910155292895898,cloud |
| U0037,P0505,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.33986360726406784,local |
| U0329,P0549,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.2583964297212446,local |
| U0223,P0181,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",0,0.34077615849704396,local |
| U0095,P0126,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,0,0.4849784780909869,local |
| U0136,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,0,0.4899352174629159,local |
| U0137,P0133,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.4006658968579231,local |
| U0209,P0422,simple_qa,Explain tokenization in one sentence,0,0.257288661250981,local |
| U0248,P0364,creative_writing,Compose a short story opening about a sleepy cat,1,0.47533614013023273,local |
| U0008,P0178,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.6329612900776582,cloud |
| U0236,P0392,simple_qa,Explain topological sorting in one sentence,1,0.5648411558735648,cloud |
| U0149,P0509,latency_sensitive,Give an instant short answer: garbage collection?,0,0.29968582138578476,local |
| U0318,P0319,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.5743498193382314,cloud |
| U0147,P0404,simple_qa,Explain topological sorting in one sentence,0,0.5065190819789395,cloud |
| U0112,P0521,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.21465488799902452,local |
| U0371,P0012,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.8203488109644332,cloud |
| U0095,P0155,image_generation,Create a 4k illustration of a sleepy cat with dramatic rim lighting,0,0.47396925039967674,local |
| U0398,P0065,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.49593631274495475,local |
| U0180,P0443,simple_qa,Convert 150 miles to kilometers,0,0.39287673839694276,local |
| U0061,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,0,0.35784247865853047,local |
| U0124,P0429,simple_qa,Convert 150 miles to kilometers,0,0.5998005838122857,cloud |
| U0232,P0409,simple_qa,What is the capital of clinical trial protocol?,1,0.5745194980857945,cloud |
| U0232,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,1,0.6041135810441954,cloud |
| U0071,P0416,simple_qa,Convert 150 miles to kilometers,0,0.34897729554604917,local |
| U0005,P0576,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,1,0.23658962463758035,local |
| U0067,P0083,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.36105939334284287,local |
| U0040,P0475,latency_sensitive,Give an instant short answer: tokenization?,0,0.3494486007060946,local |
| U0350,P0497,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.29987153380738224,local |
| U0085,P0499,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.1957154651095475,local |
| U0398,P0500,latency_sensitive,Rephrase this snippet while I type: quantum error correction,0,0.16669742868343165,local |
| U0316,P0408,simple_qa,What is the capital of franchise lore wiki?,1,0.5236247113108693,cloud |
| U0029,P0275,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,0,0.42872662101589226,local |
| U0372,P0120,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.7888978057202106,cloud |
| U0223,P0127,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.5286816608229572,cloud |
| U0211,P0589,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.45742980953645945,local |
| U0122,P0396,simple_qa,Convert 150 miles to kilometers,0,0.23586465473956916,local |
| U0134,P0194,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.5363583119272419,cloud |
| U0244,P0238,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.5830265212961077,cloud |
| U0103,P0394,simple_qa,Convert 150 miles to kilometers,0,0.48800698222989114,local |
| U0055,P0593,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.4001070947363062,local |
| U0292,P0492,latency_sensitive,Rephrase this snippet while I type: a flamenco guitarist,0,0.5155812307724127,cloud |
| U0215,P0382,simple_qa,What is the capital of Q4 earnings report?,1,0.5125199137577184,cloud |
| U0008,P0591,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,0,0.3751174733229473,local |
| U0171,P0300,creative_writing,Compose a short story opening about a sleepy cat,1,0.5190356253226713,cloud |
| U0048,P0098,long_context,Track every character and plot thread across the product spec saga,0,0.8040900723528415,cloud |
| U0037,P0361,creative_writing,Write a haiku about quantum error correction,0,0.4646519669643608,local |
| U0067,P0257,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.3367914564234042,local |
| U0197,P0445,simple_qa,What is the capital of product spec?,0,0.3686509504475391,local |
| U0193,P0441,simple_qa,Convert 150 miles to kilometers,0,0.38096604184746236,local |
| U0318,P0503,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,1,0.4951382773865779,local |
| U0269,P0363,creative_writing,Write a haiku about a flamenco guitarist,0,0.26508003074185893,local |
| U0213,P0518,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.3932796179871163,local |
| U0194,P0256,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.5242862384369376,cloud |
| U0058,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,0,0.6627347312042235,cloud |
| U0110,P0596,privacy_sensitive,Summarize my medical records regarding garbage collection,0,0.30797004388166815,local |
| U0399,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.396748286836355,local |
| U0226,P0134,long_context,Track every character and plot thread across the Q4 earnings report saga,0,0.6209134411154645,cloud |
| U0085,P0113,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.44421088950222287,local |
| U0221,P0196,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,0,0.8297322355526083,cloud |
| U0237,P0372,creative_writing,Write a haiku about a sleepy cat,1,0.5514870425706021,cloud |
| U0275,P0280,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.7136301209741256,cloud |
| U0034,P0503,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,1,0.5686929480193459,cloud |
| U0362,P0362,creative_writing,Compose a short story opening about quantum error correction,1,0.5379553850756243,cloud |
| U0061,P0256,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.6411060643053276,cloud |
| U0317,P0547,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.1841755129380414,local |
| U0173,P0413,simple_qa,What is the capital of clinical trial protocol?,0,0.5794399604652418,cloud |
| U0161,P0167,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.612111208249942,cloud |
| U0297,P0347,creative_writing,Compose a short story opening about a thunderstorm,0,0.47506690259701034,local |
| U0110,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6507178647578878,cloud |
| U0026,P0375,simple_qa,Convert 150 miles to kilometers,0,0.5860641267351623,cloud |
| U0045,P0554,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.30895652617933994,local |
| U0179,P0592,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.3319968956497139,local |
| U0083,P0222,image_generation,Generate a photorealistic image of a flamenco guitarist at golden hour,0,0.5780045959844293,cloud |
| U0349,P0411,simple_qa,What is the capital of franchise lore wiki?,0,0.294619202183574,local |
| U0384,P0167,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.7487215289454152,cloud |
| U0227,P0198,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.7589207796196443,cloud |
| U0144,P0117,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.32677798747998715,local |
| U0283,P0515,latency_sensitive,Rephrase this snippet while I type: a sleepy cat,1,0.5358045167313625,cloud |
| U0261,P0356,creative_writing,Write a haiku about a chess endgame,0,0.28580926692260233,local |
| U0138,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.4490265540512202,local |
| U0219,P0591,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,0,0.185207827278156,local |
| U0318,P0480,latency_sensitive,Give an instant short answer: tokenization?,0,0.40866376957101364,local |
| U0164,P0176,image_generation,Generate a photorealistic image of a sleepy cat at golden hour,1,0.6169525603117026,cloud |
| U0043,P0529,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.2012378376465405,local |
| U0129,P0336,creative_writing,Write a haiku about a thunderstorm,0,0.3645900409090712,local |
| U0310,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,0,0.6601605196541763,cloud |
| U0367,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7625729176026493,cloud |
| U0153,P0512,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,1,0.2945464169423312,local |
| U0215,P0530,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.4843741631159421,local |
| U0284,P0035,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.5064525420792706,cloud |
| U0365,P0107,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.6646879022415764,cloud |
| U0247,P0423,simple_qa,Convert 150 miles to kilometers,1,0.590759145235503,cloud |
| U0012,P0465,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.15124537931810098,local |
| U0072,P0114,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.6040128874456069,cloud |
| U0211,P0482,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.2960883627960355,local |
| U0260,P0566,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.24292061654444916,local |
| U0223,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.18220491578928852,local |
| U0144,P0507,latency_sensitive,Give an instant short answer: backpropagation?,0,0.1285768950694415,local |
| U0009,P0452,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.32579163143791784,local |
| U0046,P0362,creative_writing,Compose a short story opening about quantum error correction,1,0.47511822127590686,local |
| U0087,P0093,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.6842229285123889,cloud |
| U0164,P0230,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.44853326311539804,local |
| U0160,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,1,0.2646076217565222,local |
| U0119,P0548,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.3933192013164829,local |
| U0292,P0442,simple_qa,What is the capital of migration guide?,1,0.6812525689796733,cloud |
| U0159,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.4550169001207854,local |
| U0213,P0237,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.5433318841696894,cloud |
| U0065,P0457,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.4154781168031528,local |
| U0309,P0379,simple_qa,Convert 150 miles to kilometers,0,0.24287311953825608,local |
| U0062,P0101,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.5533003623005333,cloud |
| U0252,P0349,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.7482998505944862,cloud |
| U0176,P0432,simple_qa,Convert 150 miles to kilometers,0,0.412017780127681,local |
| U0193,P0369,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.5671726002852284,cloud |
| U0177,P0502,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,1,0.4701239217441223,local |
| U0206,P0487,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.24941073256572868,local |
| U0129,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,0,0.4899582089121915,local |
| U0262,P0356,creative_writing,Write a haiku about a chess endgame,0,0.48320887726493855,local |
| U0304,P0131,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.5171864744520894,cloud |
| U0397,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.681063520433066,cloud |
| U0289,P0372,creative_writing,Write a haiku about a sleepy cat,0,0.5449233617237402,cloud |
| U0091,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.23692766865044299,local |
| U0121,P0562,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.4110535209820098,local |
| U0019,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,1,0.6453875841485571,cloud |
| U0050,P0598,privacy_sensitive,Draft an email discussing my salary at franchise lore wiki,0,0.11108518177212699,local |
| U0102,P0325,creative_writing,Compose a short story opening about sourdough bread,1,0.3655598472404453,local |
| U0092,P0340,creative_writing,Write a haiku about quantum error correction,1,0.49920621038937985,local |
| U0189,P0319,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.43959968172259967,local |
| U0090,P0432,simple_qa,Convert 150 miles to kilometers,0,0.2867545958725223,local |
| U0329,P0303,creative_writing,Draft a two-paragraph product blurb for Q4 earnings report,0,0.3707624869971763,local |
| U0200,P0571,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.3448097071839904,local |
| U0099,P0097,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.35794566529797534,local |
| U0381,P0571,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.28115685473342117,local |
| U0161,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,0,0.5714686244255359,cloud |
| U0394,P0205,image_generation,Generate a photorealistic image of a rusting cargo ship at golden hour,1,0.715668100573146,cloud |
| U0369,P0029,complex_reasoning,Prove or refute: every quantum error correction admits a canonical Bayesian inference decomposition,0,0.7308996481925788,cloud |
| U0273,P0386,simple_qa,What is the capital of product spec?,0,0.2471908733582127,local |
| U0197,P0508,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.3584406142739382,local |
| U0332,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5372913235987136,cloud |
| U0097,P0453,latency_sensitive,Rephrase this snippet while I type: a sleepy cat,0,0.39591916567310514,local |
| U0207,P0066,complex_reasoning,Derive the closed form for a rusting cargo ship and verify each step,1,0.7492971577680932,cloud |
| U0098,P0309,creative_writing,Write a haiku about quantum error correction,1,0.5632761562043652,cloud |
| U0357,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,0,0.2955715654157075,local |
| U0236,P0469,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.31211283886677754,local |
| U0395,P0260,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.4272785919176845,local |
| U0001,P0042,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.7284168743706282,cloud |
| U0313,P0205,image_generation,Generate a photorealistic image of a rusting cargo ship at golden hour,1,0.4228539961755796,local |
| U0141,P0103,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.5747147275096353,cloud |
| U0284,P0516,latency_sensitive,Give an instant short answer: tokenization?,1,0.22131841427535617,local |
| U0289,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6600021404797007,cloud |
| U0166,P0429,simple_qa,Convert 150 miles to kilometers,0,0.20342751456850142,local |
| U0045,P0595,privacy_sensitive,Summarize my medical records regarding garbage collection,0,0.3225700996188321,local |
| U0309,P0172,image_generation,Create a 4k illustration of a chess endgame with dramatic rim lighting,1,0.4749445305527254,local |
| U0049,P0212,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.633784448655428,cloud |
| U0227,P0462,latency_sensitive,Give an instant short answer: topological sorting?,0,0.49866471030169846,local |
| U0131,P0231,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.6383755700292038,cloud |
| U0192,P0441,simple_qa,Convert 150 miles to kilometers,0,0.42269216546636823,local |
| U0316,P0453,latency_sensitive,Rephrase this snippet while I type: a sleepy cat,0,0.4268140255619703,local |
| U0191,P0303,creative_writing,Draft a two-paragraph product blurb for Q4 earnings report,0,0.5822378718631133,cloud |
| U0130,P0035,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.6736933632356183,cloud |
| U0201,P0421,simple_qa,Convert 150 miles to kilometers,0,0.4791491771041355,local |
| U0120,P0247,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,1,0.3850951755762195,local |
| U0264,P0578,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.26235053510468226,local |
| U0014,P0310,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.4899606618598758,local |
| U0257,P0110,long_context,Answer strictly from the full 2-hour meeting transcript on migration guide,1,0.7789865154950669,cloud |
| U0236,P0265,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.7984829237395751,cloud |
| U0346,P0116,long_context,Summarize the key arguments across all 200 pages of franchise lore wiki,0,0.4808250424735976,local |
| U0159,P0427,simple_qa,What is the capital of migration guide?,0,0.39695909398462237,local |
| U0073,P0125,long_context,Summarize the key arguments across all 200 pages of product spec,0,0.8573456501139727,cloud |
| U0136,P0204,image_generation,Generate a photorealistic image of quantum error correction at golden hour,0,0.5869981359799278,cloud |
| U0379,P0211,image_generation,Generate a photorealistic image of quantum error correction at golden hour,1,0.5486368380775815,cloud |
| U0243,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.4927455426340401,local |
| U0090,P0588,privacy_sensitive,Redact PII from this legal document about migration guide,0,0.16179876717532496,local |
| U0102,P0340,creative_writing,Write a haiku about quantum error correction,1,0.31707190436945104,local |
| U0348,P0236,code_generation,Write a production-ready implementation of garbage collection in Python,1,0.6984187315943694,cloud |
| U0219,P0478,latency_sensitive,Autocomplete this sentence in real time: a chess endgame,0,0.25722942224003204,local |
| U0285,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.5763097676323211,cloud |
| U0274,P0411,simple_qa,What is the capital of franchise lore wiki?,0,0.4834642088706172,local |
| U0246,P0328,creative_writing,Compose a short story opening about a chess endgame,0,0.5154409704312369,cloud |
| U0191,P0040,complex_reasoning,Derive the closed form for a rusting cargo ship and verify each step,1,0.8194057749357724,cloud |
| U0026,P0033,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical tokenization decomposition,1,0.8188160012479022,cloud |
| U0094,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,0,0.41988016173961,local |
| U0308,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.4192432701088991,local |
| U0257,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.8491395375218422,cloud |
| U0138,P0585,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.32319687042285394,local |
| U0050,P0265,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.439146847211013,local |
| U0114,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.6266852752971341,cloud |
| U0194,P0029,complex_reasoning,Prove or refute: every quantum error correction admits a canonical Bayesian inference decomposition,1,0.719707850651986,cloud |
| U0301,P0468,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.5201756099918338,cloud |
| U0348,P0449,simple_qa,Explain backpropagation in one sentence,0,0.47261851286385664,local |
| U0310,P0181,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.46746160812716236,local |
| U0142,P0429,simple_qa,Convert 150 miles to kilometers,0,0.26074110053768573,local |
| U0238,P0050,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,0,0.5474625728171466,cloud |
| U0189,P0177,image_generation,Create a 4k illustration of a sleepy cat with dramatic rim lighting,1,0.5909209806059149,cloud |
| U0181,P0065,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.7447470371559669,cloud |
| U0298,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.28090881982775784,local |
| U0000,P0324,creative_writing,Write a haiku about a rusting cargo ship,1,0.20437100696271027,local |
| U0072,P0113,long_context,Track every character and plot thread across the franchise lore wiki saga,0,0.6605797797708073,cloud |
| U0372,P0209,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.698240561006046,cloud |
| U0081,P0043,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.6629984676491372,cloud |
| U0292,P0156,image_generation,Create a 4k illustration of a flamenco guitarist with dramatic rim lighting,1,0.8304419048820397,cloud |
| U0056,P0376,simple_qa,Convert 150 miles to kilometers,0,0.40509382318899834,local |
| U0283,P0257,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.6571126330754351,cloud |
| U0142,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.46152684895297547,local |
| U0345,P0174,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",0,0.7221246085770919,cloud |
| U0237,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5535726931700047,cloud |
| U0069,P0197,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.5189168602870691,cloud |
| U0007,P0499,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.18590512975131437,local |
| U0279,P0238,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.8199190855991968,cloud |
| U0114,P0229,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.6447833014961268,cloud |
| U0168,P0558,privacy_sensitive,Redact PII from this legal document about board meeting minutes,1,0.5859940583978371,cloud |
| U0240,P0412,simple_qa,Explain Bayesian inference in one sentence,0,0.3270683995707863,local |
| U0342,P0083,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.3229188137293215,local |
| U0112,P0448,simple_qa,Convert 150 miles to kilometers,1,0.38889354551340477,local |
| U0308,P0350,creative_writing,Compose a short story opening about a flamenco guitarist,0,0.37974351367204484,local |
| U0170,P0490,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.3679823133523715,local |
| U0388,P0486,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.3996327376309862,local |
| U0209,P0207,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.48397098141384326,local |
| U0024,P0049,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.8214568495458768,cloud |
| U0221,P0048,complex_reasoning,Find the flaw in this 40-step proof about garbage collection and repair it,1,0.7862530375199025,cloud |
| U0390,P0258,code_generation,Generate unit tests and API docs for the topological sorting library,0,0.3679196337392846,local |
| U0008,P0041,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,0,0.7831727169709701,cloud |
| U0319,P0512,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.22452193757454053,local |
| U0368,P0230,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.609116583907634,cloud |
| U0047,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,1,0.2185953010843932,local |
| U0134,P0584,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.27088761784569676,local |
| U0146,P0570,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.25161427747327036,local |
| U0213,P0286,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.6144072053293808,cloud |
| U0199,P0380,simple_qa,Explain Bayesian inference in one sentence,0,0.46575667879986976,local |
| U0344,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,1,0.43958685760549754,local |
| U0304,P0397,simple_qa,Explain tokenization in one sentence,0,0.3578817050860276,local |
| U0072,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.4144398064996152,local |
| U0268,P0201,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.439181112374698,local |
| U0343,P0081,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,0,0.5763395998243346,cloud |
| U0306,P0173,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.8120541610499923,cloud |
| U0146,P0298,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.521226839886762,cloud |
| U0060,P0157,image_generation,Create a 4k illustration of sourdough bread with dramatic rim lighting,0,0.5622910369620615,cloud |
| U0291,P0202,image_generation,Create a 4k illustration of a thunderstorm with dramatic rim lighting,0,0.48371248633208297,local |
| U0328,P0518,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.3530250126738159,local |
| U0273,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.4758588564334134,local |
| U0116,P0049,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.8224515986116397,cloud |
| U0255,P0186,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.4662795768324839,local |
| U0257,P0449,simple_qa,Explain backpropagation in one sentence,1,0.4820123041867697,local |
| U0264,P0134,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.6698995564848284,cloud |
| U0387,P0207,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.6806718416395304,cloud |
| U0276,P0276,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.5632166163907149,cloud |
| U0104,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6770480514678111,cloud |
| U0002,P0188,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.7216374186123419,cloud |
| U0357,P0522,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,0,0.15062517555505814,local |
| U0325,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,0,0.5715740807345284,cloud |
| U0045,P0096,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.7178323217091653,cloud |
| U0324,P0272,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.7862199676208317,cloud |
| U0155,P0165,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.7429589824487389,cloud |
| U0211,P0370,creative_writing,Write a haiku about quantum error correction,1,0.6563391898443176,cloud |
| U0199,P0489,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.46299162670474514,local |
| U0228,P0196,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,0,0.7681986953605345,cloud |
| U0191,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7854233345812708,cloud |
| U0067,P0098,long_context,Track every character and plot thread across the product spec saga,0,0.5299161541442138,cloud |
| U0177,P0252,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.7763814410669366,cloud |
| U0068,P0127,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.4889963943034396,local |
| U0332,P0563,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.26967336552515575,local |
| U0283,P0163,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.7981746737398048,cloud |
| U0041,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6132508124009575,cloud |
| U0053,P0483,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.24340773415219613,local |
| U0111,P0465,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.3085011542859822,local |
| U0392,P0312,creative_writing,Write a haiku about a thunderstorm,1,0.5019939894033104,cloud |
| U0265,P0433,simple_qa,Explain garbage collection in one sentence,0,0.5232030781088215,cloud |
| U0330,P0085,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.45020315994647353,local |
| U0114,P0153,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.5562347272044332,cloud |
| U0323,P0548,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.25145717323288486,local |
| U0393,P0403,simple_qa,Explain topological sorting in one sentence,1,0.46163558500941665,local |
| U0257,P0008,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical garbage collection decomposition,1,0.7488213389906023,cloud |
| U0113,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.5193170910542848,cloud |
| U0090,P0232,code_generation,Refactor this legacy module into modern C++20: board meeting minutes,0,0.36817930997352444,local |
| U0004,P0599,privacy_sensitive,Redact PII from this legal document about board meeting minutes,1,0.2558667027969496,local |
| U0013,P0059,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,0,0.6124973924755748,cloud |
| U0384,P0505,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.5642091531223178,cloud |
| U0131,P0571,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.43509728755663235,local |
| U0357,P0224,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.4059574167874508,local |
| U0173,P0421,simple_qa,Convert 150 miles to kilometers,0,0.6039426169391987,cloud |
| U0273,P0466,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.24790109914688188,local |
| U0310,P0510,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,1,0.3139622042717476,local |
| U0390,P0074,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,1,0.5873746655367107,cloud |
| U0128,P0123,long_context,Answer strictly from the full 2-hour meeting transcript on migration guide,1,0.5142732718867866,cloud |
| U0340,P0163,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.66291647204605,cloud |
| U0265,P0187,image_generation,Generate a photorealistic image of a flamenco guitarist at golden hour,0,0.6117112975236789,cloud |
| U0367,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.7443709677612786,cloud |
| U0284,P0208,image_generation,Create a 4k illustration of a flamenco guitarist with dramatic rim lighting,1,0.5802682705782,cloud |
| U0105,P0385,simple_qa,Convert 150 miles to kilometers,0,0.2852012544396806,local |
| U0278,P0526,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,1,0.22089669007215437,local |
| U0014,P0073,complex_reasoning,Derive the closed form for sourdough bread and verify each step,1,0.7560362417866511,cloud |
| U0266,P0383,simple_qa,Explain tokenization in one sentence,0,0.3199532449791077,local |
| U0350,P0310,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.38203943216336195,local |
| U0219,P0351,creative_writing,Write a haiku about a flamenco guitarist,0,0.3180479928205724,local |
| U0318,P0315,creative_writing,Write a haiku about a thunderstorm,1,0.571835721352301,cloud |
| U0254,P0189,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.6998134283339711,cloud |
| U0223,P0114,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.4631418349965748,local |
| U0372,P0431,simple_qa,Convert 150 miles to kilometers,1,0.3899882343896256,local |
| U0188,P0389,simple_qa,Explain garbage collection in one sentence,0,0.22367701495096798,local |
| U0301,P0024,complex_reasoning,Prove or refute: every a rusting cargo ship admits a canonical deadlock avoidance decomposition,1,0.7947746251592438,cloud |
| U0178,P0296,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.6209610019455647,cloud |
| U0338,P0068,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical memory-mapped I/O decomposition,1,0.8371259376949903,cloud |
| U0080,P0341,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.6225154907038943,cloud |
| U0221,P0213,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.8018660684858051,cloud |
| U0292,P0094,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.8331613671514358,cloud |
| U0040,P0258,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.5240053696166607,cloud |
| U0305,P0070,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical deadlock avoidance decomposition,1,0.3507750949514141,local |
| U0188,P0363,creative_writing,Write a haiku about a flamenco guitarist,0,0.2393941270960898,local |
| U0376,P0292,code_generation,Generate unit tests and API docs for the deadlock avoidance library,0,0.38659968393731275,local |
| U0012,P0014,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.5471122602730981,cloud |
| U0366,P0136,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,0,0.8335829677715528,cloud |
| U0121,P0232,code_generation,Refactor this legacy module into modern C++20: board meeting minutes,1,0.6550969258493485,cloud |
| U0384,P0312,creative_writing,Write a haiku about a thunderstorm,1,0.6636370006170355,cloud |
| U0044,P0365,creative_writing,Compose a short story opening about sourdough bread,1,0.7802879061021835,cloud |
| U0357,P0068,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical memory-mapped I/O decomposition,0,0.4653783375769503,local |
| U0182,P0269,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.7783012355311673,cloud |
| U0006,P0449,simple_qa,Explain backpropagation in one sentence,0,0.21685033509625432,local |
| U0094,P0083,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.6419777116226258,cloud |
| U0155,P0318,creative_writing,Compose a short story opening about a rusting cargo ship,0,0.6336704827263833,cloud |
| U0035,P0274,code_generation,Generate unit tests and API docs for the topological sorting library,0,0.500698036567552,cloud |
| U0047,P0463,latency_sensitive,Give an instant short answer: topological sorting?,0,0.35104709058417227,local |
| U0316,P0365,creative_writing,Compose a short story opening about sourdough bread,0,0.6089781793833912,cloud |
| U0051,P0259,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.4192615738105765,local |
| U0040,P0547,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.2164520465911534,local |
| U0386,P0472,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.1556792846723783,local |
| U0124,P0106,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.7752752450793186,cloud |
| U0042,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.3248133032712417,local |
| U0261,P0095,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.5652520731865137,cloud |
| U0140,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6346276422959011,cloud |
| U0039,P0276,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.7422060864627426,cloud |
| U0165,P0064,complex_reasoning,Derive the closed form for quantum error correction and verify each step,0,0.6589994734007517,cloud |
| U0211,P0499,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.44700263649683447,local |
| U0392,P0082,long_context,Summarize the key arguments across all 200 pages of migration guide,0,0.5507052699728557,cloud |
| U0149,P0254,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.7089724663182687,cloud |
| U0274,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.4012758951158657,local |
| U0097,P0380,simple_qa,Explain Bayesian inference in one sentence,0,0.29451389416653884,local |
| U0373,P0340,creative_writing,Write a haiku about quantum error correction,0,0.24923405714021601,local |
| U0375,P0011,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical backpropagation decomposition,1,0.6776491564333598,cloud |
| U0219,P0021,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.5267288780315484,cloud |
| U0088,P0017,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical tokenization decomposition,1,0.5122686762620157,cloud |
| U0050,P0596,privacy_sensitive,Summarize my medical records regarding garbage collection,0,0.1843962474255669,local |
| U0117,P0067,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.618355183679694,cloud |
| U0164,P0455,latency_sensitive,Autocomplete this sentence in real time: a chess endgame,0,0.2877314110552864,local |
| U0350,P0513,latency_sensitive,Give an instant short answer: tokenization?,0,0.2444548050852598,local |
| U0187,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6012747836509713,cloud |
| U0159,P0597,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,1,0.23528129265227532,local |
| U0115,P0135,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.6465193216617304,cloud |
| U0144,P0355,creative_writing,Compose a short story opening about a thunderstorm,0,0.2105800972332094,local |
| U0140,P0139,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.5187036840480397,cloud |
| U0170,P0277,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.6307611296177317,cloud |
| U0373,P0452,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.2692673371564931,local |
| U0298,P0535,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.1463140504020605,local |
| U0160,P0293,code_generation,Refactor this legacy module into modern C++20: migration guide,0,0.6189219758208188,cloud |
| U0309,P0498,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.19107698071196053,local |
| U0374,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.22039420786843686,local |
| U0215,P0283,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.7755038122301952,cloud |
| U0068,P0595,privacy_sensitive,Summarize my medical records regarding garbage collection,0,0.16001741394041508,local |
| U0190,P0546,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,1,0.39653028553716846,local |
| U0047,P0416,simple_qa,Convert 150 miles to kilometers,0,0.3846950190305376,local |
| U0346,P0150,image_generation,Create a 4k illustration of a chess endgame with dramatic rim lighting,1,0.5096169095653611,cloud |
| U0390,P0468,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.3031152796876451,local |
| U0289,P0167,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.6269692236646623,cloud |
| U0383,P0207,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.5557623303519381,cloud |
| U0316,P0464,latency_sensitive,Give an instant short answer: backpropagation?,0,0.4420959437531958,local |
| U0038,P0100,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.5623955889404737,cloud |
| U0243,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.49378877590735815,local |
| U0348,P0342,creative_writing,Compose a short story opening about a rusting cargo ship,0,0.5632007980726411,cloud |
| U0229,P0383,simple_qa,Explain tokenization in one sentence,1,0.3123099434346877,local |
| U0219,P0149,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.5229601799977528,cloud |
| U0148,P0500,latency_sensitive,Rephrase this snippet while I type: quantum error correction,0,0.20061763022234533,local |
| U0064,P0131,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.6739669292368405,cloud |
| U0342,P0304,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.33898428346796156,local |
| U0200,P0206,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.5591815296986208,cloud |
| U0295,P0508,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.3094594771045089,local |
| U0282,P0258,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.7128680050302022,cloud |
| U0361,P0592,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.5306513312971876,cloud |
| U0242,P0544,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.33719415740713177,local |
| U0063,P0018,complex_reasoning,Find the flaw in this 40-step proof about deadlock avoidance and repair it,1,0.5797065092933172,cloud |
| U0293,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.5646132053029921,cloud |
| U0060,P0269,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.7699424643471454,cloud |
| U0080,P0576,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,0,0.3823478480149438,local |
| U0157,P0472,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,1,0.3766209007236129,local |
| U0047,P0487,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.313513883405252,local |
| U0017,P0195,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.7777823614901794,cloud |
| U0260,P0408,simple_qa,What is the capital of franchise lore wiki?,0,0.4830565866300119,local |
| U0120,P0470,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.3164369645690393,local |
| U0366,P0129,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,1,0.8366478134261468,cloud |
| U0110,P0063,complex_reasoning,Prove or refute: every sourdough bread admits a canonical deadlock avoidance decomposition,1,0.6040258340553142,cloud |
| U0120,P0324,creative_writing,Write a haiku about a rusting cargo ship,1,0.33677869559674095,local |
| U0333,P0041,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.6184014025333483,cloud |
| U0207,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.45800273372641825,local |
| U0053,P0070,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical deadlock avoidance decomposition,0,0.44172773655858144,local |
| U0386,P0052,complex_reasoning,Prove or refute: every a chess endgame admits a canonical Bayesian inference decomposition,1,0.4312676772350067,local |
| U0387,P0404,simple_qa,Explain topological sorting in one sentence,0,0.40806038988894017,local |
| U0170,P0524,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.2647593354440976,local |
| U0392,P0380,simple_qa,Explain Bayesian inference in one sentence,0,0.33202081997270083,local |
| U0181,P0283,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.7530298046464959,cloud |
| U0140,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.3138068464963985,local |
| U0396,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.2992647494017527,local |
| U0392,P0072,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.8050139773671412,cloud |
| U0147,P0346,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.4791990619745939,local |
| U0262,P0440,simple_qa,Convert 150 miles to kilometers,0,0.48897870916378827,local |
| U0179,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.5029880656800687,cloud |
| U0342,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.34770190312197125,local |
| U0241,P0276,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.7610599587055973,cloud |
| U0266,P0087,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.6016533193669868,cloud |
| U0200,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.3776769023387761,local |
| U0322,P0547,privacy_sensitive,Draft an email discussing my salary at migration guide,1,0.3575869476863212,local |
| U0033,P0567,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.3152717738831339,local |
| U0180,P0279,code_generation,Generate unit tests and API docs for the tokenization library,1,0.5987524131664806,cloud |
| U0173,P0489,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.444573853382153,local |
| U0223,P0169,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.48331264672916613,local |
| U0203,P0493,latency_sensitive,Rephrase this snippet while I type: sourdough bread,1,0.2650753703324007,local |
| U0363,P0124,long_context,Summarize the key arguments across all 200 pages of migration guide,0,0.6008629615654271,cloud |
| U0239,P0304,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.43058980743759473,local |
| U0294,P0226,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.8234544697035995,cloud |
| U0145,P0225,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.38651414133611,local |
| U0083,P0343,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.28614453527955597,local |
| U0029,P0509,latency_sensitive,Give an instant short answer: garbage collection?,1,0.26830478986317724,local |
| U0292,P0575,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.4572815957697717,local |
| U0074,P0342,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.5603059198728683,cloud |
| U0189,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.44207126511205125,local |
| U0117,P0165,image_generation,Generate a photorealistic image of a chess endgame at golden hour,0,0.4510504885115211,local |
| U0293,P0466,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.43335122098730755,local |
| U0079,P0443,simple_qa,Convert 150 miles to kilometers,0,0.28693525696772554,local |
| U0035,P0594,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.1671831481458736,local |
| U0057,P0165,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.6417802771507428,cloud |
| U0197,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.4261896911133764,local |
| U0332,P0325,creative_writing,Compose a short story opening about sourdough bread,0,0.4911619136594723,local |
| U0151,P0583,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.36342407024376083,local |
| U0289,P0454,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,0,0.37045713130623703,local |
| U0360,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.26774307591536556,local |
| U0090,P0354,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.36233059831540715,local |
| U0227,P0587,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.42552421486060993,local |
| U0079,P0127,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.5332705215952872,cloud |
| U0304,P0383,simple_qa,Explain tokenization in one sentence,0,0.24243864154124894,local |
| U0120,P0150,image_generation,Create a 4k illustration of a chess endgame with dramatic rim lighting,0,0.5490058972095031,cloud |
| U0238,P0355,creative_writing,Compose a short story opening about a thunderstorm,0,0.4769290878922732,local |
| U0006,P0019,complex_reasoning,Prove or refute: every a flamenco guitarist admits a canonical backpropagation decomposition,1,0.6165466146057321,cloud |
| U0233,P0344,creative_writing,Compose a short story opening about a chess endgame,0,0.5625875061132494,cloud |
| U0285,P0336,creative_writing,Write a haiku about a thunderstorm,0,0.47154437503000696,local |
| U0309,P0299,code_generation,Generate unit tests and API docs for the tokenization library,0,0.36198435022596537,local |
| U0343,P0594,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.2927207672932871,local |
| U0284,P0460,latency_sensitive,Give an instant short answer: tokenization?,0,0.22511564676322526,local |
| U0127,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,0,0.5021697764635792,cloud |
| U0320,P0182,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,1,0.786028833038978,cloud |
| U0001,P0368,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,0,0.6017723864592471,cloud |
| U0197,P0264,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.6734339201794836,cloud |
| U0064,P0008,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical garbage collection decomposition,0,0.5881225653471565,cloud |
| U0371,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.4355745653042522,local |
| U0100,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.7369951837000335,cloud |
| U0299,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6696362997515685,cloud |
| U0139,P0034,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.722154318031329,cloud |
| U0218,P0188,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.6077198339387648,cloud |
| U0116,P0010,complex_reasoning,Prove or refute: every a chess endgame admits a canonical deadlock avoidance decomposition,1,0.7387951617140776,cloud |
| U0346,P0367,creative_writing,Compose a short story opening about quantum error correction,1,0.3152340814212702,local |
| U0275,P0465,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.42279543836391165,local |
| U0398,P0168,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.41496840106120075,local |
| U0015,P0186,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.44196774462765115,local |
| U0206,P0544,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.22002574780105508,local |
| U0185,P0442,simple_qa,What is the capital of migration guide?,0,0.48592099377691506,local |
| U0140,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,0,0.5483878283633911,cloud |
| U0195,P0220,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.5745132296093128,cloud |
| U0246,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.385855429897026,local |
| U0023,P0167,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.6209166145518332,cloud |
| U0373,P0135,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,0,0.40976463855758966,local |
| U0222,P0358,creative_writing,Write a haiku about a sleepy cat,0,0.613959653230933,cloud |
| U0270,P0326,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,0,0.45345166779035184,local |
| U0291,P0073,complex_reasoning,Derive the closed form for sourdough bread and verify each step,1,0.47784797608486673,local |
| U0009,P0410,simple_qa,Explain backpropagation in one sentence,0,0.3063114763694492,local |
| U0167,P0265,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.5547270901830432,cloud |
| U0024,P0418,simple_qa,What is the capital of product spec?,0,0.6627071493924632,cloud |
| U0080,P0220,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.7362384416633195,cloud |
| U0389,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.28779691062333085,local |
| U0101,P0225,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.4358198367329311,local |
| U0293,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.570450740681937,cloud |
| U0220,P0369,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.39048621342251444,local |
| U0151,P0541,privacy_sensitive,Redact PII from this legal document about product spec,0,0.42257288629809703,local |
| U0114,P0019,complex_reasoning,Prove or refute: every a flamenco guitarist admits a canonical backpropagation decomposition,1,0.6955461917756133,cloud |
| U0288,P0478,latency_sensitive,Autocomplete this sentence in real time: a chess endgame,0,0.3649561724070061,local |
| U0368,P0306,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.5420855740694193,cloud |
| U0134,P0036,complex_reasoning,Derive the closed form for a chess endgame and verify each step,0,0.46764409627247505,local |
| U0021,P0267,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.27020209529448885,local |
| U0356,P0230,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.48288587894308865,local |
| U0012,P0552,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.16087053052909825,local |
| U0200,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.6731104182791325,cloud |
| U0112,P0247,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,0,0.3368621961024918,local |
| U0264,P0533,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.2946208487509992,local |
| U0290,P0438,simple_qa,Convert 150 miles to kilometers,1,0.6888299780916493,cloud |
| U0055,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.4901562972739102,local |
| U0045,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.5135508187619017,cloud |
| U0221,P0023,complex_reasoning,Derive the closed form for sourdough bread and verify each step,1,0.8050621388498084,cloud |
| U0266,P0456,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.3656305981620586,local |
| U0157,P0526,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,0,0.37687842840924224,local |
| U0252,P0415,simple_qa,Convert 150 miles to kilometers,1,0.7292808360140968,cloud |
| U0060,P0098,long_context,Track every character and plot thread across the product spec saga,0,0.712231718854051,cloud |
| U0392,P0107,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.6842719280562963,cloud |
| U0311,P0366,creative_writing,Compose a short story opening about quantum error correction,0,0.49302498708389964,local |
| U0152,P0310,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.3580207623241909,local |
| U0238,P0366,creative_writing,Compose a short story opening about quantum error correction,1,0.5096524185736332,cloud |
| U0147,P0292,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.6847178436580444,cloud |
| U0215,P0487,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.488292152872783,local |
| U0384,P0346,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,0,0.5748557611110903,cloud |
| U0135,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,0,0.15996886956129988,local |
| U0353,P0430,simple_qa,What is the capital of board meeting minutes?,0,0.5254383834195636,cloud |
| U0220,P0019,complex_reasoning,Prove or refute: every a flamenco guitarist admits a canonical backpropagation decomposition,1,0.5717057997888352,cloud |
| U0124,P0157,image_generation,Create a 4k illustration of sourdough bread with dramatic rim lighting,1,0.7446238917606943,cloud |
| U0103,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,0,0.5861331107398133,cloud |
| U0234,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7053412650860654,cloud |
| U0192,P0357,creative_writing,Write a haiku about a chess endgame,0,0.5651680823804505,cloud |
| U0303,P0361,creative_writing,Write a haiku about quantum error correction,1,0.4255838082907803,local |
| U0372,P0325,creative_writing,Compose a short story opening about sourdough bread,0,0.5767431711345699,cloud |
| U0067,P0587,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.19040754663045684,local |
| U0213,P0584,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.39911124774358697,local |
| U0092,P0181,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",0,0.5701688748560406,cloud |
| U0315,P0342,creative_writing,Compose a short story opening about a rusting cargo ship,0,0.6122936396888402,cloud |
| U0056,P0405,simple_qa,What is the capital of Q4 earnings report?,0,0.4063315209303294,local |
| U0327,P0449,simple_qa,Explain backpropagation in one sentence,0,0.20558368857371295,local |
| U0059,P0524,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,1,0.3118595319796929,local |
| U0080,P0427,simple_qa,What is the capital of migration guide?,1,0.483470914409084,local |
| U0180,P0134,long_context,Track every character and plot thread across the Q4 earnings report saga,0,0.5963612774449134,cloud |
| U0389,P0395,simple_qa,What is the capital of migration guide?,0,0.4472531247171695,local |
| U0195,P0357,creative_writing,Write a haiku about a chess endgame,1,0.3979290010455516,local |
| U0288,P0141,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.5103685217364029,cloud |
| U0162,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,1,0.46288675054646217,local |
| U0350,P0108,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.6172327333343595,cloud |
| U0366,P0217,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.7087988719692468,cloud |
| U0252,P0554,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.5548251583116363,cloud |
| U0207,P0349,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,0,0.5881171822055865,cloud |
| U0006,P0570,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.2535095673438078,local |
| U0148,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.4731731448528113,local |
| U0108,P0023,complex_reasoning,Derive the closed form for sourdough bread and verify each step,0,0.6040506855434747,cloud |
| U0082,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.5734701586180803,cloud |
| U0362,P0293,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.7075049210518961,cloud |
| U0123,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.6073353502934749,cloud |
| U0177,P0113,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.7198228050619341,cloud |
| U0039,P0155,image_generation,Create a 4k illustration of a sleepy cat with dramatic rim lighting,0,0.6400050059355931,cloud |
| U0120,P0066,complex_reasoning,Derive the closed form for a rusting cargo ship and verify each step,0,0.5787335079845448,cloud |
| U0153,P0084,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.501501047309248,cloud |
| U0120,P0010,complex_reasoning,Prove or refute: every a chess endgame admits a canonical deadlock avoidance decomposition,1,0.5763820266068131,cloud |
| U0257,P0102,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.8111664508875112,cloud |
| U0124,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.49553451085105077,local |
| U0355,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.41923730750489874,local |
| U0001,P0356,creative_writing,Write a haiku about a chess endgame,1,0.4256812705180244,local |
| U0072,P0445,simple_qa,What is the capital of product spec?,0,0.3739574809222105,local |
| U0111,P0560,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.3510754308427989,local |
| U0347,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.7322177944615648,cloud |
| U0218,P0545,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.24920628587838758,local |
| U0115,P0387,simple_qa,Convert 150 miles to kilometers,0,0.4929652735935694,local |
| U0314,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.5674413948711758,cloud |
| U0170,P0449,simple_qa,Explain backpropagation in one sentence,0,0.31745945952469584,local |
| U0158,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.6140124415091486,cloud |
| U0231,P0133,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.8290588502455583,cloud |
| U0189,P0352,creative_writing,Write a haiku about a flamenco guitarist,0,0.5179427951930389,cloud |
| U0357,P0418,simple_qa,What is the capital of product spec?,0,0.31492589494382234,local |
| U0339,P0451,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,0,0.3846274916365512,local |
| U0367,P0259,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5932784845833193,cloud |
| U0111,P0496,latency_sensitive,Give an instant short answer: tokenization?,0,0.3754135048284157,local |
| U0133,P0061,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.6201746404381864,cloud |
| U0278,P0388,simple_qa,Convert 150 miles to kilometers,0,0.35455089841076,local |
| U0281,P0204,image_generation,Generate a photorealistic image of quantum error correction at golden hour,1,0.6791618801127556,cloud |
| U0168,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.868699824065833,cloud |
| U0347,P0507,latency_sensitive,Give an instant short answer: backpropagation?,1,0.3836673943226261,local |
| U0214,P0102,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.6809074235858046,cloud |
| U0355,P0551,privacy_sensitive,Draft an email discussing my salary at product spec,0,0.21785265334776144,local |
| U0328,P0133,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.5960388213317767,cloud |
| U0396,P0008,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical garbage collection decomposition,1,0.3991195852490119,local |
| U0302,P0055,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical deadlock avoidance decomposition,1,0.5794556207493132,cloud |
| U0246,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,0,0.806094570303941,cloud |
| U0181,P0203,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.7988065026208809,cloud |
| U0341,P0328,creative_writing,Compose a short story opening about a chess endgame,0,0.39212559631841026,local |
| U0280,P0401,simple_qa,What is the capital of franchise lore wiki?,1,0.2811792116438503,local |
| U0034,P0474,latency_sensitive,Give an instant short answer: tokenization?,1,0.5509992032605769,cloud |
| U0077,P0395,simple_qa,What is the capital of migration guide?,0,0.44104563295889865,local |
| U0264,P0492,latency_sensitive,Rephrase this snippet while I type: a flamenco guitarist,0,0.40564780751266866,local |
| U0013,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.45196769075665966,local |
| U0211,P0168,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.6428277470118741,cloud |
| U0346,P0238,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.5056705460216142,cloud |
| U0044,P0558,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.5262968605920696,cloud |
| U0215,P0518,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.49844440755664127,local |
| U0359,P0519,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.39726150216954936,local |
| U0307,P0394,simple_qa,Convert 150 miles to kilometers,0,0.48121551665386053,local |
| U0318,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.4754201523291777,local |
| U0225,P0385,simple_qa,Convert 150 miles to kilometers,0,0.27337371269254096,local |
| U0335,P0047,complex_reasoning,Prove or refute: every sourdough bread admits a canonical deadlock avoidance decomposition,1,0.5727014460762643,cloud |
| U0177,P0471,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.28507485311105785,local |
| U0385,P0095,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.7088201383884051,cloud |
| U0154,P0558,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.25698403173494083,local |
| U0127,P0460,latency_sensitive,Give an instant short answer: tokenization?,0,0.2698436698485767,local |
| U0186,P0235,code_generation,Generate unit tests and API docs for the garbage collection library,1,0.6459687931845535,cloud |
| U0354,P0131,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.47398760716880556,local |
| U0084,P0057,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.5734096151429611,cloud |
| U0156,P0016,complex_reasoning,Find the flaw in this 40-step proof about garbage collection and repair it,1,0.667344732820797,cloud |
| U0165,P0316,creative_writing,Write a haiku about quantum error correction,1,0.5567656192855224,cloud |
| U0281,P0397,simple_qa,Explain tokenization in one sentence,0,0.5953542690216725,cloud |
| U0205,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.8042874407313066,cloud |
| U0301,P0054,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,1,0.6945767102304929,cloud |
| U0089,P0577,privacy_sensitive,Summarize my medical records regarding Bayesian inference,1,0.29316147522245695,local |
| U0226,P0230,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5345493439988183,cloud |
| U0143,P0379,simple_qa,Convert 150 miles to kilometers,1,0.5478642331986884,cloud |
| U0184,P0035,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.7646844658863938,cloud |
| U0008,P0286,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6677430062618704,cloud |
| U0183,P0158,image_generation,Create a 4k illustration of sourdough bread with dramatic rim lighting,1,0.6255307822974062,cloud |
| U0090,P0472,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.21068273077247995,local |
| U0181,P0092,long_context,Summarize the key arguments across all 200 pages of franchise lore wiki,1,0.7324279703261766,cloud |
| U0236,P0416,simple_qa,Convert 150 miles to kilometers,0,0.5815076249764008,cloud |
| U0338,P0431,simple_qa,Convert 150 miles to kilometers,1,0.4827618866255821,local |
| U0312,P0564,privacy_sensitive,Redact PII from this legal document about product spec,0,0.5263804098498441,cloud |
| U0202,P0532,privacy_sensitive,Summarize my medical records regarding tokenization,0,0.29647757599813723,local |
| U0367,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.5089635655281123,cloud |
| U0394,P0569,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.3582113192787117,local |
| U0298,P0190,image_generation,Generate a photorealistic image of a sleepy cat at golden hour,0,0.401676728132477,local |
| U0129,P0563,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.2029976106284447,local |
| U0293,P0053,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,1,0.6314025420965054,cloud |
| U0365,P0087,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.6359609438560717,cloud |
| U0084,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,0,0.587870373575675,cloud |
| U0259,P0426,simple_qa,Explain garbage collection in one sentence,0,0.7583117126831063,cloud |
| U0038,P0460,latency_sensitive,Give an instant short answer: tokenization?,0,0.3707797778010009,local |
| U0129,P0066,complex_reasoning,Derive the closed form for a rusting cargo ship and verify each step,1,0.5471859965278323,cloud |
| U0107,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,0,0.4883148034474555,local |
| U0190,P0254,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.7381642393899571,cloud |
| U0192,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.4243681835894901,local |
| U0192,P0405,simple_qa,What is the capital of Q4 earnings report?,0,0.5018990398186538,cloud |
| U0024,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.46221011335689227,local |
| U0284,P0300,creative_writing,Compose a short story opening about a sleepy cat,1,0.33576127146204293,local |
| U0116,P0549,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.3958337345965825,local |
| U0166,P0302,creative_writing,Write a haiku about a thunderstorm,1,0.39672060387474883,local |
| U0371,P0446,simple_qa,Explain Bayesian inference in one sentence,0,0.46055447423434104,local |
| U0146,P0530,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.24194177804473227,local |
| U0044,P0254,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.7982571523305418,cloud |
| U0260,P0026,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.6743460923516061,cloud |
| U0077,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.49903040641874813,local |
| U0178,P0266,code_generation,Generate unit tests and API docs for the garbage collection library,1,0.5835586967484987,cloud |
| U0235,P0122,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.47786771789887356,local |
| U0175,P0395,simple_qa,What is the capital of migration guide?,1,0.40181168411983503,local |
| U0070,P0154,image_generation,Generate a photorealistic image of a flamenco guitarist at golden hour,0,0.5100976811728647,cloud |
| U0236,P0037,complex_reasoning,Derive the closed form for quantum error correction and verify each step,1,0.854100173263532,cloud |
| U0126,P0094,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.7075032965975327,cloud |
| U0342,P0023,complex_reasoning,Derive the closed form for sourdough bread and verify each step,0,0.5423029320589805,cloud |
| U0192,P0071,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7455383100506219,cloud |
| U0185,P0538,privacy_sensitive,Redact PII from this legal document about migration guide,1,0.25923981375565247,local |
| U0121,P0059,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.7133855333790499,cloud |
| U0385,P0521,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,1,0.366198606628909,local |
| U0370,P0561,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,1,0.5163623567194714,cloud |
| U0003,P0112,long_context,Track every character and plot thread across the product spec saga,1,0.7363860351339475,cloud |
| U0186,P0160,image_generation,"Produce a logo mockup for migration guide, transparent background",1,0.5894257392453994,cloud |
| U0163,P0036,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.3970857043534665,local |
| U0060,P0346,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.42586225041884157,local |
| U0081,P0249,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.49907714764030825,local |
| U0029,P0407,simple_qa,Convert 150 miles to kilometers,1,0.5353727145397006,cloud |
| U0056,P0412,simple_qa,Explain Bayesian inference in one sentence,0,0.35294053592764274,local |
| U0006,P0505,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,1,0.2911618942318787,local |
| U0151,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,1,0.4582448929118521,local |
| U0174,P0476,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,0,0.4571129074291763,local |
| U0169,P0032,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.7224175316988958,cloud |
| U0324,P0120,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.8175202776436239,cloud |
| U0042,P0585,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.26430984968673954,local |
| U0119,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.30428251262942774,local |
| U0156,P0215,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",0,0.4791894112467348,local |
| U0013,P0366,creative_writing,Compose a short story opening about quantum error correction,0,0.5047138881494714,cloud |
| U0379,P0350,creative_writing,Compose a short story opening about a flamenco guitarist,0,0.39871923116116864,local |
| U0104,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.4964027998998909,local |
| U0174,P0500,latency_sensitive,Rephrase this snippet while I type: quantum error correction,1,0.42383127074723215,local |
| U0105,P0302,creative_writing,Write a haiku about a thunderstorm,1,0.45231694068512146,local |
| U0364,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,0,0.20507320069798,local |
| U0052,P0502,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.2872550788901535,local |
| U0365,P0165,image_generation,Generate a photorealistic image of a chess endgame at golden hour,0,0.5315448672561044,cloud |
| U0165,P0583,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.27063449484858043,local |
| U0229,P0540,privacy_sensitive,Redact PII from this legal document about product spec,1,0.2124933798243997,local |
| U0359,P0263,code_generation,Refactor this legacy module into modern C++20: product spec,1,0.43097546926280256,local |
| U0020,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.5032862820147652,cloud |
| U0135,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.3720374851466754,local |
| U0041,P0201,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.4866219833043206,local |
| U0177,P0436,simple_qa,What is the capital of migration guide?,0,0.46643534146059223,local |
| U0012,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.25866446082031436,local |
| U0172,P0050,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,0,0.6478592332601837,cloud |
| U0345,P0395,simple_qa,What is the capital of migration guide?,1,0.5055496885035304,cloud |
| U0046,P0379,simple_qa,Convert 150 miles to kilometers,1,0.4660091403730118,local |
| U0280,P0475,latency_sensitive,Give an instant short answer: tokenization?,0,0.2218149082065742,local |
| U0265,P0330,creative_writing,Write a haiku about a flamenco guitarist,0,0.6769302112168919,cloud |
| U0162,P0368,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.41988368856803593,local |
| U0296,P0559,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.36512822042437987,local |
| U0338,P0227,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.6823621456833566,cloud |
| U0245,P0459,latency_sensitive,Rephrase this snippet while I type: sourdough bread,1,0.3731540056130901,local |
| U0382,P0255,code_generation,Write a production-ready implementation of garbage collection in Python,1,0.4403675835542168,local |
| U0366,P0319,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.6686317329149781,cloud |
| U0149,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.6378387312744148,cloud |
| U0186,P0289,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,0,0.4989026694982545,local |
| U0145,P0130,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.6539090965848804,cloud |
| U0099,P0174,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.46337320978198543,local |
| U0295,P0148,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.675160084023645,cloud |
| U0067,P0389,simple_qa,Explain garbage collection in one sentence,0,0.22377061597894957,local |
| U0183,P0297,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.4871597794095377,local |
| U0287,P0140,long_context,Track every character and plot thread across the clinical trial protocol saga,1,0.7642256873512303,cloud |
| U0015,P0315,creative_writing,Write a haiku about a thunderstorm,1,0.4745570142430322,local |
| U0323,P0250,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5437471196938104,cloud |
| U0237,P0002,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,1,0.5920740828861254,cloud |
| U0388,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.5567257906522557,cloud |
| U0277,P0461,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.3078652537210032,local |
| U0021,P0539,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.12411575701228647,local |
| U0354,P0548,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.18727389656249935,local |
| U0158,P0236,code_generation,Write a production-ready implementation of garbage collection in Python,1,0.5261519550992364,cloud |
| U0299,P0390,simple_qa,What is the capital of product spec?,1,0.3486330500641959,local |
| U0049,P0028,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6317567891746114,cloud |
| U0016,P0267,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.4688369936599381,local |
| U0000,P0251,code_generation,Write a production-ready implementation of tokenization in Python,0,0.27624525142339845,local |
| U0048,P0375,simple_qa,Convert 150 miles to kilometers,1,0.5421348493481617,cloud |
| U0359,P0456,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.3882396647940751,local |
| U0041,P0244,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,0,0.34349251477172466,local |
| U0081,P0440,simple_qa,Convert 150 miles to kilometers,1,0.3212544613022534,local |
| U0160,P0536,privacy_sensitive,Draft an email discussing my salary at product spec,0,0.32023712849785163,local |
| U0169,P0383,simple_qa,Explain tokenization in one sentence,0,0.35422086145012344,local |
| U0257,P0087,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.802322586724737,cloud |
| U0034,P0026,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.8513110320528152,cloud |
| U0003,P0397,simple_qa,Explain tokenization in one sentence,0,0.5547631334019516,cloud |
| U0087,P0103,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.8390249966145796,cloud |
| U0312,P0569,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.6293257641037041,cloud |
| U0289,P0365,creative_writing,Compose a short story opening about sourdough bread,1,0.6236132072122239,cloud |
| U0240,P0563,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.22762392199825357,local |
| U0200,P0168,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.6080713923110739,cloud |
| U0312,P0159,image_generation,Generate a photorealistic image of sourdough bread at golden hour,0,0.862624072388016,cloud |
| U0103,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7606297840496239,cloud |
| U0172,P0103,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.7928283330515618,cloud |
| U0073,P0065,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.759796483822576,cloud |
| U0162,P0116,long_context,Summarize the key arguments across all 200 pages of franchise lore wiki,0,0.44612168152968,local |
| U0164,P0182,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,1,0.6483403519655377,cloud |
| U0154,P0043,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.642133523256538,cloud |
| U0173,P0118,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.7715254286557646,cloud |
| U0000,P0341,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.3056953703584688,local |
| U0029,P0415,simple_qa,Convert 150 miles to kilometers,0,0.5157788039223355,cloud |
| U0081,P0407,simple_qa,Convert 150 miles to kilometers,1,0.4055617200117119,local |
| U0279,P0362,creative_writing,Compose a short story opening about quantum error correction,1,0.6932677356484441,cloud |
| U0144,P0363,creative_writing,Write a haiku about a flamenco guitarist,0,0.13337094219819234,local |
| U0038,P0290,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.5531122004152473,cloud |
| U0183,P0186,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.324544604363647,local |
| U0065,P0533,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.34007786842270216,local |
| U0062,P0578,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,1,0.15713195290776147,local |
| U0248,P0194,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.4867400093525386,local |
| U0321,P0560,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.21511870680492118,local |
| U0384,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.6355760352535973,cloud |
| U0205,P0220,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.7981388915041306,cloud |
| U0324,P0447,simple_qa,Convert 150 miles to kilometers,0,0.634661656678522,cloud |
| U0245,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.6554147650741285,cloud |
| U0390,P0338,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.5067668223573807,cloud |
| U0038,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.4912286533890555,local |
| U0085,P0283,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.4489802482361676,local |
| U0292,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.7294651279571434,cloud |
| U0289,P0493,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.25117826051395287,local |
| U0219,P0338,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.5290966928242233,cloud |
| U0136,P0306,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.4184901236124746,local |
| U0123,P0311,creative_writing,Compose a short story opening about a thunderstorm,0,0.39456802617982856,local |
| U0027,P0477,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.4245768232924945,local |
| U0152,P0188,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5658334931829407,cloud |
| U0171,P0229,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.6914240305317764,cloud |
| U0040,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,0,0.5401533933368093,cloud |
| U0394,P0020,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,1,0.732837244258712,cloud |
| U0296,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,0,0.5624197284651573,cloud |
| U0307,P0275,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.419920938908718,local |
| U0217,P0146,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.4403129221483703,local |
| U0165,P0391,simple_qa,Convert 150 miles to kilometers,0,0.39856059790087756,local |
| U0077,P0147,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.610765988884841,cloud |
| U0324,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.4636661780747964,local |
| U0136,P0378,simple_qa,Explain Bayesian inference in one sentence,0,0.25629833622063564,local |
| U0095,P0125,long_context,Summarize the key arguments across all 200 pages of product spec,0,0.7160753986264049,cloud |
| U0214,P0472,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.34693654779130806,local |
| U0283,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.6651008747883628,cloud |
| U0214,P0136,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,1,0.6786194182910076,cloud |
| U0051,P0320,creative_writing,Compose a short story opening about a chess endgame,0,0.30626509120233586,local |
| U0128,P0231,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.33597923395825946,local |
| U0396,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.5455575288656955,cloud |
| U0257,P0569,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.48571202195400404,local |
| U0380,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.6570714523424565,cloud |
| U0129,P0221,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.6136422802713652,cloud |
| U0063,P0082,long_context,Summarize the key arguments across all 200 pages of migration guide,0,0.4274412891111308,local |
| U0254,P0236,code_generation,Write a production-ready implementation of garbage collection in Python,1,0.5496379015556412,cloud |
| U0026,P0545,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,1,0.48442846179424376,local |
| U0345,P0511,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,1,0.33408871010380764,local |
| U0253,P0583,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.20644606957506398,local |
| U0150,P0399,simple_qa,Convert 150 miles to kilometers,0,0.3203123843784147,local |
| U0283,P0425,simple_qa,What is the capital of clinical trial protocol?,1,0.5444089999020608,cloud |
| U0055,P0579,privacy_sensitive,Summarize my medical records regarding tokenization,1,0.3413738389291951,local |
| U0116,P0587,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.4211559548785412,local |
| U0083,P0427,simple_qa,What is the capital of migration guide?,1,0.2473106383770737,local |
| U0138,P0216,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.5792011508303863,cloud |
| U0157,P0282,code_generation,Refactor this legacy module into modern C++20: board meeting minutes,1,0.709627591530398,cloud |
| U0290,P0221,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.831002247100136,cloud |
| U0330,P0501,latency_sensitive,Rephrase this snippet while I type: quantum error correction,1,0.3412643574709174,local |
| U0329,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.45320557735299494,local |
| U0037,P0136,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,0,0.6081480615734892,cloud |
| U0305,P0387,simple_qa,Convert 150 miles to kilometers,0,0.25826392249748187,local |
| U0317,P0206,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.4797362131409096,local |
| U0247,P0206,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.7035595475621705,cloud |
| U0050,P0435,simple_qa,Convert 150 miles to kilometers,0,0.3637547763867283,local |
| U0198,P0248,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.4624591011109399,local |
| U0104,P0410,simple_qa,Explain backpropagation in one sentence,0,0.5074128572317829,cloud |
| U0317,P0449,simple_qa,Explain backpropagation in one sentence,0,0.2754212421673309,local |
| U0237,P0113,long_context,Track every character and plot thread across the franchise lore wiki saga,0,0.6775885652425507,cloud |
| U0317,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,0,0.6735035931242521,cloud |
| U0378,P0490,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.4290668334507427,local |
| U0072,P0420,simple_qa,Explain topological sorting in one sentence,0,0.4360711019789094,local |
| U0192,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.3953967969041988,local |
| U0187,P0300,creative_writing,Compose a short story opening about a sleepy cat,1,0.42517593494121286,local |
| U0373,P0264,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.460346038886637,local |
| U0085,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.3322404897264642,local |
| U0367,P0358,creative_writing,Write a haiku about a sleepy cat,1,0.4838791989687985,local |
| U0251,P0375,simple_qa,Convert 150 miles to kilometers,1,0.363614731657818,local |
| U0189,P0138,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,0,0.6061018345907685,cloud |
| U0048,P0387,simple_qa,Convert 150 miles to kilometers,1,0.646859280559147,cloud |
| U0024,P0404,simple_qa,Explain topological sorting in one sentence,0,0.5313216794530581,cloud |
| U0065,P0278,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.6170276111472417,cloud |
| U0033,P0007,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6757993872609847,cloud |
| U0103,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.30562405107315405,local |
| U0308,P0358,creative_writing,Write a haiku about a sleepy cat,1,0.4437664602392202,local |
| U0140,P0002,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,1,0.5432625522613055,cloud |
| U0003,P0075,long_context,Track every character and plot thread across the product spec saga,1,0.7952987318483753,cloud |
| U0283,P0478,latency_sensitive,Autocomplete this sentence in real time: a chess endgame,0,0.5489470702907185,cloud |
| U0124,P0140,long_context,Track every character and plot thread across the clinical trial protocol saga,1,0.8767709212832595,cloud |
| U0390,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.49270613878405806,local |
| U0115,P0558,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.33168297846140726,local |
| U0346,P0058,complex_reasoning,Prove or refute: every a chess endgame admits a canonical backpropagation decomposition,1,0.5512316590643447,cloud |
| U0227,P0494,latency_sensitive,Rephrase this snippet while I type: sourdough bread,1,0.46995568152701156,local |
| U0332,P0379,simple_qa,Convert 150 miles to kilometers,1,0.43219957243799023,local |
| U0245,P0567,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.43187046740328583,local |
| U0137,P0440,simple_qa,Convert 150 miles to kilometers,0,0.19607578919608545,local |
| U0274,P0345,creative_writing,Compose a short story opening about a flamenco guitarist,0,0.42259856594906653,local |
| U0042,P0446,simple_qa,Explain Bayesian inference in one sentence,0,0.34225533872233443,local |
| U0061,P0129,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,0,0.7366860401455553,cloud |
| U0144,P0534,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.14958709514348323,local |
| U0294,P0016,complex_reasoning,Find the flaw in this 40-step proof about garbage collection and repair it,1,0.8778983740910872,cloud |
| U0088,P0141,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,0,0.45050574356288753,local |
| U0256,P0017,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical tokenization decomposition,1,0.5727181294192142,cloud |
| U0033,P0582,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.26863959852626174,local |
| U0108,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.19919270846142617,local |
| U0104,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.5895768514030179,cloud |
| U0134,P0064,complex_reasoning,Derive the closed form for quantum error correction and verify each step,1,0.5096720138712544,cloud |
| U0032,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.3664545525464096,local |
| U0269,P0415,simple_qa,Convert 150 miles to kilometers,0,0.3505183255934345,local |
| U0342,P0212,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.5375041670287127,cloud |
| U0119,P0264,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.7260925861204719,cloud |
| U0116,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,1,0.46448807076068643,local |
| U0073,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.8209208340521711,cloud |
| U0135,P0139,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.37435883103524875,local |
| U0130,P0057,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6931178610565489,cloud |
| U0186,P0299,code_generation,Generate unit tests and API docs for the tokenization library,0,0.5863333476676249,cloud |
| U0220,P0054,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,0,0.48372636295215743,local |
| U0296,P0579,privacy_sensitive,Summarize my medical records regarding tokenization,1,0.26110683896345455,local |
| U0017,P0410,simple_qa,Explain backpropagation in one sentence,1,0.5911874719024134,cloud |
| U0022,P0454,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,0,0.33901365438004794,local |
| U0133,P0457,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.3068165373988685,local |
| U0341,P0176,image_generation,Generate a photorealistic image of a sleepy cat at golden hour,0,0.6409084676693134,cloud |
| U0047,P0449,simple_qa,Explain backpropagation in one sentence,0,0.25597918579430495,local |
| U0225,P0565,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.16264571755996665,local |
| U0354,P0340,creative_writing,Write a haiku about quantum error correction,0,0.2635577722837922,local |
| U0196,P0027,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7787969275143265,cloud |
| U0380,P0289,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,0,0.6769677317658058,cloud |
| U0078,P0563,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.5216560007098442,cloud |
| U0073,P0269,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.8213894876132436,cloud |
| U0071,P0209,image_generation,"Produce a logo mockup for product spec, transparent background",0,0.5200046103292008,cloud |
| U0083,P0547,privacy_sensitive,Draft an email discussing my salary at migration guide,1,0.11174370394125287,local |
| U0126,P0050,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.570953085235061,cloud |
| U0134,P0076,long_context,Track every character and plot thread across the franchise lore wiki saga,0,0.5765870516934878,cloud |
| U0105,P0440,simple_qa,Convert 150 miles to kilometers,0,0.2765480498541817,local |
| U0307,P0584,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.4094168920726163,local |
| U0128,P0098,long_context,Track every character and plot thread across the product spec saga,1,0.4925691382762644,local |
| U0252,P0435,simple_qa,Convert 150 miles to kilometers,1,0.8295160349854972,cloud |
| U0119,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,1,0.33282002963060847,local |
| U0212,P0183,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.7142280281488429,cloud |
| U0010,P0585,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.4440974338992279,local |
| U0317,P0003,complex_reasoning,Derive the closed form for a chess endgame and verify each step,0,0.6349839499531805,cloud |
| U0242,P0257,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.4987070882226129,local |
| U0120,P0057,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6232738033509262,cloud |
| U0147,P0510,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.42720985103853254,local |
| U0255,P0320,creative_writing,Compose a short story opening about a chess endgame,0,0.47239588322784815,local |
| U0316,P0184,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.5739775692523206,cloud |
| U0357,P0291,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.22590524499427717,local |
| U0196,P0022,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.6914955166973931,cloud |
| U0068,P0447,simple_qa,Convert 150 miles to kilometers,1,0.3249906991740741,local |
| U0154,P0249,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.5055401391574035,cloud |
| U0147,P0001,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.8121596806839876,cloud |
| U0259,P0226,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.8413973469143348,cloud |
| U0377,P0241,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.6372897774229963,cloud |
| U0039,P0498,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.4710516819315406,local |
| U0091,P0027,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6958973444595956,cloud |
| U0023,P0028,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.7144628526302006,cloud |
| U0286,P0102,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.6704220874015646,cloud |
| U0239,P0009,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.6184775933238487,cloud |
| U0159,P0578,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.241530693195681,local |
| U0102,P0199,image_generation,"Produce a logo mockup for migration guide, transparent background",1,0.4081016856192027,local |
| U0250,P0178,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.5972971932391091,cloud |
| U0267,P0370,creative_writing,Write a haiku about quantum error correction,0,0.45601264432324745,local |
| U0256,P0057,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6564798655414958,cloud |
| U0214,P0053,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,0,0.6280630557088,cloud |
| U0258,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.4950171366855312,local |
| U0337,P0247,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,1,0.39059960475772026,local |
| U0233,P0025,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.5853568433883777,cloud |
| U0396,P0362,creative_writing,Compose a short story opening about quantum error correction,0,0.2823303932877628,local |
| U0095,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.4045676278937564,local |
| U0093,P0421,simple_qa,Convert 150 miles to kilometers,1,0.3908680207784127,local |
| U0236,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.756479832902312,cloud |
| U0308,P0185,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.6115175839845131,cloud |
| U0338,P0436,simple_qa,What is the capital of migration guide?,1,0.5762445275259123,cloud |
| U0384,P0080,long_context,Summarize the key arguments across all 200 pages of product spec,1,0.7937955933015812,cloud |
| U0118,P0186,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.20730591027175357,local |
| U0337,P0150,image_generation,Create a 4k illustration of a chess endgame with dramatic rim lighting,0,0.5613600276111194,cloud |
| U0305,P0489,latency_sensitive,Give an instant short answer: deadlock avoidance?,1,0.15267638729482197,local |
| U0094,P0401,simple_qa,What is the capital of franchise lore wiki?,0,0.5705457391280891,cloud |
| U0101,P0011,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical backpropagation decomposition,0,0.5707118547337805,cloud |
| U0125,P0115,long_context,Answer strictly from the full 2-hour meeting transcript on migration guide,1,0.7491762551572156,cloud |
| U0337,P0072,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.7761774646081093,cloud |
| U0152,P0490,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.3149217833349664,local |
| U0055,P0358,creative_writing,Write a haiku about a sleepy cat,1,0.48354076496083526,local |
| U0352,P0094,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.6821222277067265,cloud |
| U0267,P0189,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.5820514399414219,cloud |
| U0097,P0045,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.574370254803649,cloud |
| U0174,P0541,privacy_sensitive,Redact PII from this legal document about product spec,1,0.44295918062024175,local |
| U0167,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,1,0.46491250332984474,local |
| U0286,P0179,image_generation,Create a 4k illustration of a sleepy cat with dramatic rim lighting,0,0.6674666643505902,cloud |
| U0132,P0574,privacy_sensitive,Summarize my medical records regarding Bayesian inference,0,0.2602335186051424,local |
| U0339,P0567,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.4896967846423243,local |
| U0196,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5716274139858469,cloud |
| U0239,P0422,simple_qa,Explain tokenization in one sentence,0,0.36018211139223183,local |
| U0196,P0369,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.5448402838306337,cloud |
| U0263,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.8265579115588859,cloud |
| U0392,P0322,creative_writing,Write a haiku about a rusting cargo ship,0,0.545415646218455,cloud |
| U0325,P0030,complex_reasoning,Find the flaw in this 40-step proof about deadlock avoidance and repair it,1,0.6126275115312849,cloud |
| U0196,P0280,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.590550116867982,cloud |
| U0046,P0093,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.5437775603489375,cloud |
| U0126,P0203,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.729168418839075,cloud |
| U0010,P0406,simple_qa,Convert 150 miles to kilometers,0,0.49320899329074747,local |
| U0360,P0492,latency_sensitive,Rephrase this snippet while I type: a flamenco guitarist,0,0.29772988627851993,local |
| U0183,P0408,simple_qa,What is the capital of franchise lore wiki?,1,0.43409511770366016,local |
| U0073,P0537,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,0,0.49238950187388686,local |
| U0336,P0160,image_generation,"Produce a logo mockup for migration guide, transparent background",1,0.4363358274831462,local |
| U0351,P0067,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.742955925960209,cloud |
| U0368,P0565,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.34619615114721924,local |
| U0286,P0512,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.35024841751199,local |
| U0242,P0526,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,0,0.33868352337481034,local |
| U0027,P0565,privacy_sensitive,Summarize my medical records regarding topological sorting,1,0.33151536729273845,local |
| U0369,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.30321301744189016,local |
| U0231,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.598913089090766,cloud |
| U0007,P0171,image_generation,Generate a photorealistic image of a chess endgame at golden hour,0,0.37200645890659234,local |
| U0202,P0438,simple_qa,Convert 150 miles to kilometers,1,0.4908990506292421,local |
| U0144,P0512,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.13358917297895911,local |
| U0380,P0506,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.4999977643412306,local |
| U0373,P0117,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.3916509262421292,local |
| U0165,P0441,simple_qa,Convert 150 miles to kilometers,0,0.4261616891116934,local |
| U0110,P0031,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,1,0.6895475286668103,cloud |
| U0287,P0444,simple_qa,What is the capital of board meeting minutes?,1,0.5194959045384404,cloud |
| U0323,P0379,simple_qa,Convert 150 miles to kilometers,0,0.354144722157985,local |
| U0390,P0044,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.6319204937456073,cloud |
| U0089,P0373,creative_writing,Write a haiku about sourdough bread,0,0.572925623827536,cloud |
| U0363,P0128,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.5841928864337007,cloud |
| U0359,P0213,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.715753705938283,cloud |
| U0118,P0185,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.34541481627557186,local |
| U0055,P0153,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.6374316836859769,cloud |
| U0182,P0221,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.7451009905035654,cloud |
| U0021,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.5310501020633634,cloud |
| U0368,P0391,simple_qa,Convert 150 miles to kilometers,0,0.438317989594586,local |
| U0329,P0398,simple_qa,Convert 150 miles to kilometers,1,0.2590568631326191,local |
| U0112,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6252704239670334,cloud |
| U0087,P0118,long_context,Track every character and plot thread across the board meeting minutes saga,0,0.810788547114656,cloud |
| U0380,P0099,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.8441131085873083,cloud |
| U0250,P0541,privacy_sensitive,Redact PII from this legal document about product spec,0,0.3262695159191001,local |
| U0275,P0440,simple_qa,Convert 150 miles to kilometers,1,0.5276811498056979,cloud |
| U0308,P0281,code_generation,Generate unit tests and API docs for the tokenization library,1,0.44948050349709334,local |
| U0356,P0159,image_generation,Generate a photorealistic image of sourdough bread at golden hour,0,0.6002732565257521,cloud |
| U0233,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.3905242454011628,local |
| U0107,P0277,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.7980744470842481,cloud |
| U0348,P0386,simple_qa,What is the capital of product spec?,1,0.5685480818152129,cloud |
| U0138,P0545,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.29630834039578563,local |
| U0390,P0470,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.23724744201285247,local |
| U0194,P0238,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.5278292908632344,cloud |
| U0224,P0423,simple_qa,Convert 150 miles to kilometers,0,0.28787093631981336,local |
| U0211,P0280,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.6678794029921031,cloud |
| U0014,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.5297644360391539,cloud |
| U0311,P0449,simple_qa,Explain backpropagation in one sentence,1,0.3213768784243011,local |
| U0083,P0308,creative_writing,Compose a short story opening about a chess endgame,1,0.25641577355078937,local |
| U0319,P0432,simple_qa,Convert 150 miles to kilometers,1,0.2742244960577655,local |
| U0150,P0063,complex_reasoning,Prove or refute: every sourdough bread admits a canonical deadlock avoidance decomposition,1,0.6662937853353145,cloud |
| U0297,P0188,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5161342071503938,cloud |
| U0335,P0370,creative_writing,Write a haiku about quantum error correction,0,0.37078339394600723,local |
| U0335,P0011,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical backpropagation decomposition,0,0.3969241977954288,local |
| U0198,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.2829770248176558,local |
| U0135,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.2563233683919061,local |
| U0292,P0200,image_generation,Generate a photorealistic image of sourdough bread at golden hour,1,0.7869580161127904,cloud |
| U0055,P0130,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.7656795582169166,cloud |
| U0085,P0358,creative_writing,Write a haiku about a sleepy cat,0,0.23095390031710547,local |
| U0125,P0338,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.7760166129321052,cloud |
| U0372,P0349,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.5618749980623055,cloud |
| U0263,P0084,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.7232804543160497,cloud |
| U0045,P0317,creative_writing,Compose a short story opening about quantum error correction,0,0.4271752280213063,local |
| U0232,P0099,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.7346159760913181,cloud |
| U0351,P0519,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.4639013356042244,local |
| U0182,P0331,creative_writing,Compose a short story opening about a flamenco guitarist,1,0.4871357845602104,local |
| U0139,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.5731636235956097,cloud |
| U0280,P0081,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.3975372660371783,local |
| U0100,P0036,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.5671307973049156,cloud |
| U0334,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.7106144474075239,cloud |
| U0358,P0485,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,0,0.39919653804558336,local |
| U0351,P0552,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.3507757907567503,local |
| U0256,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.3976890280272864,local |
| U0005,P0422,simple_qa,Explain tokenization in one sentence,0,0.40140934817234714,local |
| U0132,P0340,creative_writing,Write a haiku about quantum error correction,1,0.37076904709629943,local |
| U0159,P0388,simple_qa,Convert 150 miles to kilometers,0,0.5091262800751154,cloud |
| U0091,P0107,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.602547771899757,cloud |
| U0174,P0475,latency_sensitive,Give an instant short answer: tokenization?,1,0.5374468881938821,cloud |
| U0362,P0202,image_generation,Create a 4k illustration of a thunderstorm with dramatic rim lighting,1,0.7616550873428943,cloud |
| U0206,P0345,creative_writing,Compose a short story opening about a flamenco guitarist,0,0.3426212551639802,local |
| U0243,P0117,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.6523134899355243,cloud |
| U0358,P0540,privacy_sensitive,Redact PII from this legal document about product spec,0,0.28078054040543154,local |
| U0240,P0447,simple_qa,Convert 150 miles to kilometers,1,0.44072066198690724,local |
| U0152,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5043094615705304,cloud |
| U0053,P0048,complex_reasoning,Find the flaw in this 40-step proof about garbage collection and repair it,1,0.5455758656330901,cloud |
| U0090,P0014,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.6041133952186185,cloud |
| U0341,P0519,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.40768412820683925,local |
| U0099,P0501,latency_sensitive,Rephrase this snippet while I type: quantum error correction,0,0.20418175376222245,local |
| U0092,P0149,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.7115088662173871,cloud |
| U0168,P0084,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.7762117121383854,cloud |
| U0389,P0426,simple_qa,Explain garbage collection in one sentence,0,0.48993293143579747,local |
| U0060,P0353,creative_writing,Write a haiku about a chess endgame,0,0.6179025585470933,cloud |
| U0154,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.5660494594969183,cloud |
| U0366,P0283,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.817721822388303,cloud |
| U0250,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5940040560045576,cloud |
| U0153,P0440,simple_qa,Convert 150 miles to kilometers,1,0.35244878839582916,local |
| U0387,P0599,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.30583159496040596,local |
| U0015,P0277,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.6549115922073928,cloud |
| U0339,P0589,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.5440798794301817,cloud |
| U0164,P0288,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.61316599832079,cloud |
| U0250,P0032,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.778909097349785,cloud |
| U0393,P0495,latency_sensitive,Give an instant short answer: topological sorting?,0,0.2932624422340143,local |
| U0237,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6811555296565215,cloud |
| U0320,P0419,simple_qa,What is the capital of franchise lore wiki?,1,0.5232325894320435,cloud |
| U0325,P0241,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.5475771851872527,cloud |
| U0181,P0441,simple_qa,Convert 150 miles to kilometers,1,0.45181642149005335,local |
| U0086,P0015,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.8490194407024316,cloud |
| U0280,P0460,latency_sensitive,Give an instant short answer: tokenization?,0,0.22534267630328364,local |
| U0266,P0443,simple_qa,Convert 150 miles to kilometers,0,0.3457322686363835,local |
| U0020,P0293,code_generation,Refactor this legacy module into modern C++20: migration guide,0,0.6593214784879734,cloud |
| U0116,P0571,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.418408374417526,local |
| U0031,P0088,long_context,Summarize the key arguments across all 200 pages of product spec,1,0.8987903713233015,cloud |
| U0251,P0412,simple_qa,Explain Bayesian inference in one sentence,0,0.37864091166382363,local |
| U0388,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.7028446916718623,cloud |
| U0196,P0207,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.679143067140434,cloud |
| U0077,P0276,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.62556290732291,cloud |
| U0045,P0226,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.7018221446247933,cloud |
| U0399,P0459,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.18907836145066195,local |
| U0236,P0337,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.7054960738904614,cloud |
| U0303,P0355,creative_writing,Compose a short story opening about a thunderstorm,0,0.37757458954894446,local |
| U0257,P0195,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.8130670422061556,cloud |
| U0230,P0346,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.1855961532050737,local |
| U0136,P0468,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.46886194549914123,local |
| U0398,P0311,creative_writing,Compose a short story opening about a thunderstorm,0,0.39512928910865286,local |
| U0005,P0086,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.6117826532890935,cloud |
| U0098,P0311,creative_writing,Compose a short story opening about a thunderstorm,0,0.6266517730459881,cloud |
| U0321,P0532,privacy_sensitive,Summarize my medical records regarding tokenization,0,0.2066095733966315,local |
| U0328,P0032,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.7127834893459702,cloud |
| U0156,P0280,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.5084678504955076,cloud |
| U0377,P0480,latency_sensitive,Give an instant short answer: tokenization?,0,0.35988623729086655,local |
| U0012,P0218,image_generation,Generate a photorealistic image of quantum error correction at golden hour,0,0.33144813365593045,local |
| U0213,P0554,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.30291420426417315,local |
| U0223,P0268,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.4467047795684953,local |
| U0361,P0248,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.7723292737292374,cloud |
| U0279,P0254,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.8311490464573685,cloud |
| U0052,P0533,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.16728968621879844,local |
| U0070,P0332,creative_writing,Compose a short story opening about sourdough bread,1,0.35065813742451046,local |
| U0307,P0421,simple_qa,Convert 150 miles to kilometers,0,0.5247184127647558,cloud |
| U0256,P0263,code_generation,Refactor this legacy module into modern C++20: product spec,1,0.42218800764078085,local |
| U0205,P0457,latency_sensitive,Give an instant short answer: memory-mapped I/O?,1,0.49006283036520226,local |
| U0140,P0163,image_generation,Generate a photorealistic image of a chess endgame at golden hour,0,0.6377645261036698,cloud |
| U0326,P0214,image_generation,Generate a photorealistic image of quantum error correction at golden hour,0,0.5811961444416897,cloud |
| U0103,P0451,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,1,0.2967819953505693,local |
| U0232,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.3147816835448779,local |
| U0160,P0168,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.567765781794064,cloud |
| U0384,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,0,0.707818290715411,cloud |
| U0032,P0010,complex_reasoning,Prove or refute: every a chess endgame admits a canonical deadlock avoidance decomposition,0,0.48942062819262333,local |
| U0210,P0266,code_generation,Generate unit tests and API docs for the garbage collection library,1,0.6090771818983164,cloud |
| U0364,P0330,creative_writing,Write a haiku about a flamenco guitarist,1,0.35238991901789724,local |
| U0216,P0575,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.39249649825113153,local |
| U0232,P0035,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.6804606771496978,cloud |
| U0034,P0432,simple_qa,Convert 150 miles to kilometers,1,0.62014188277175,cloud |
| U0331,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.2655430913106453,local |
| U0316,P0072,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.7969364051512722,cloud |
| U0039,P0445,simple_qa,What is the capital of product spec?,0,0.48626395862231986,local |
| U0219,P0522,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,0,0.19647539137664477,local |
| U0203,P0128,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.7131765382216119,cloud |
| U0277,P0022,complex_reasoning,Derive the closed form for a chess endgame and verify each step,0,0.655661486070919,cloud |
| U0382,P0401,simple_qa,What is the capital of franchise lore wiki?,0,0.25387434629950845,local |
| U0037,P0500,latency_sensitive,Rephrase this snippet while I type: quantum error correction,0,0.2122878873708307,local |
| U0184,P0399,simple_qa,Convert 150 miles to kilometers,0,0.500380155023481,cloud |
| U0311,P0579,privacy_sensitive,Summarize my medical records regarding tokenization,0,0.2826233307026573,local |
| U0194,P0127,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.6034242724336302,cloud |
| U0177,P0237,code_generation,Generate unit tests and API docs for the topological sorting library,0,0.5931810153082364,cloud |
| U0234,P0083,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.4953692129110842,local |
| U0319,P0454,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,1,0.2204570231235,local |
| U0258,P0440,simple_qa,Convert 150 miles to kilometers,0,0.35234025257893714,local |
| U0352,P0564,privacy_sensitive,Redact PII from this legal document about product spec,0,0.2237827944628965,local |
| U0309,P0481,latency_sensitive,Give an instant short answer: memory-mapped I/O?,1,0.20200011096831066,local |
| U0187,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.4863464920034536,local |
| U0212,P0330,creative_writing,Write a haiku about a flamenco guitarist,0,0.6955636069551541,cloud |
| U0248,P0421,simple_qa,Convert 150 miles to kilometers,0,0.3278481955331191,local |
| U0267,P0019,complex_reasoning,Prove or refute: every a flamenco guitarist admits a canonical backpropagation decomposition,0,0.5982854044186116,cloud |
| U0024,P0570,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.4830748589865529,local |
| U0202,P0598,privacy_sensitive,Draft an email discussing my salary at franchise lore wiki,0,0.23625680387922487,local |
| U0212,P0327,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.6420456102046387,cloud |
| U0312,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.7505331726336765,cloud |
| U0142,P0458,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.3300276640772627,local |
| U0047,P0572,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,0,0.27397180087532175,local |
| U0286,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.336372963598504,local |
| U0361,P0095,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.8113145381255332,cloud |
| U0365,P0515,latency_sensitive,Rephrase this snippet while I type: a sleepy cat,1,0.35208742446593255,local |
| U0301,P0070,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical deadlock avoidance decomposition,1,0.6687484825052553,cloud |
| U0203,P0522,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,1,0.3659589835724377,local |
| U0232,P0067,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.7323952171431594,cloud |
| U0378,P0099,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.7669211400366962,cloud |
| U0078,P0118,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.8545966686002602,cloud |
| U0184,P0343,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.5615426318002408,cloud |
| U0277,P0395,simple_qa,What is the capital of migration guide?,0,0.4509096752788121,local |
| U0071,P0140,long_context,Track every character and plot thread across the clinical trial protocol saga,0,0.641935178341166,cloud |
| U0250,P0138,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,1,0.6398894742743809,cloud |
| U0250,P0163,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.707262689823664,cloud |
| U0227,P0406,simple_qa,Convert 150 miles to kilometers,1,0.4660769461841239,local |
| U0331,P0579,privacy_sensitive,Summarize my medical records regarding tokenization,0,0.15935210254777724,local |
| U0008,P0480,latency_sensitive,Give an instant short answer: tokenization?,1,0.37795106595168615,local |
| U0306,P0328,creative_writing,Compose a short story opening about a chess endgame,0,0.49026835386689144,local |
| U0265,P0239,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.5719561895054907,cloud |
| U0000,P0436,simple_qa,What is the capital of migration guide?,1,0.20886184863777119,local |
| U0284,P0058,complex_reasoning,Prove or refute: every a chess endgame admits a canonical backpropagation decomposition,1,0.4921833519530814,local |
| U0228,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.35607548631406477,local |
| U0168,P0285,code_generation,Generate unit tests and API docs for the garbage collection library,0,0.7717320749484565,cloud |
| U0267,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.39054647019073063,local |
| U0357,P0202,image_generation,Create a 4k illustration of a thunderstorm with dramatic rim lighting,1,0.46725193453815367,local |
| U0172,P0578,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.30255594672390634,local |
| U0145,P0397,simple_qa,Explain tokenization in one sentence,0,0.4143805459277002,local |
| U0081,P0551,privacy_sensitive,Draft an email discussing my salary at product spec,1,0.21517220816686125,local |
| U0376,P0237,code_generation,Generate unit tests and API docs for the topological sorting library,0,0.294605138521025,local |
| U0215,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.7556582898214517,cloud |
| U0178,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.43560812355293704,local |
| U0236,P0297,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.71412345554251,cloud |
| U0342,P0464,latency_sensitive,Give an instant short answer: backpropagation?,0,0.27057615091724213,local |
| U0340,P0293,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.603670215074346,cloud |
| U0102,P0387,simple_qa,Convert 150 miles to kilometers,0,0.35770771969699416,local |
| U0124,P0595,privacy_sensitive,Summarize my medical records regarding garbage collection,1,0.5120841751302236,cloud |
| U0153,P0098,long_context,Track every character and plot thread across the product spec saga,1,0.6196257657785931,cloud |
| U0293,P0196,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,1,0.7701691375078931,cloud |
| U0094,P0068,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical memory-mapped I/O decomposition,1,0.8107335251525362,cloud |
| U0170,P0024,complex_reasoning,Prove or refute: every a rusting cargo ship admits a canonical deadlock avoidance decomposition,0,0.7385937292816215,cloud |
| U0316,P0118,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.6570494021274375,cloud |
| U0379,P0582,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.31585006804059085,local |
| U0309,P0278,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.30054501541239076,local |
| U0194,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.5817841071015868,cloud |
| U0259,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,0,0.7986679834965134,cloud |
| U0223,P0530,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.21226835209632372,local |
| U0036,P0139,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.3553234841434297,local |
| U0106,P0390,simple_qa,What is the capital of product spec?,1,0.5824770601427736,cloud |
| U0366,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.8430079811615755,cloud |
| U0397,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.5337081117873532,cloud |
| U0268,P0308,creative_writing,Compose a short story opening about a chess endgame,0,0.2503495363774702,local |
| U0292,P0552,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.4881116658960393,local |
| U0379,P0162,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.6255179822791602,cloud |
| U0216,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.3993565726568515,local |
| U0250,P0465,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.3101827067164017,local |
| U0285,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,0,0.48310463793224795,local |
| U0213,P0042,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.6915176477344003,cloud |
| U0032,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,0,0.6035325533713929,cloud |
| U0029,P0101,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.7118680758171662,cloud |
| U0259,P0397,simple_qa,Explain tokenization in one sentence,1,0.7317962437899065,cloud |
| U0113,P0523,latency_sensitive,Rephrase this snippet while I type: a flamenco guitarist,1,0.3705048194672485,local |
| U0386,P0438,simple_qa,Convert 150 miles to kilometers,0,0.2822589740486807,local |
| U0217,P0397,simple_qa,Explain tokenization in one sentence,0,0.22648175797578668,local |
| U0009,P0056,complex_reasoning,Derive the closed form for sourdough bread and verify each step,1,0.6155040379626157,cloud |
| U0036,P0257,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.31384395384707575,local |
| U0004,P0316,creative_writing,Write a haiku about quantum error correction,0,0.44711827428182344,local |
| U0321,P0408,simple_qa,What is the capital of franchise lore wiki?,0,0.4156563588805824,local |
| U0139,P0022,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.697548527397034,cloud |
| U0362,P0195,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.7546921321617538,cloud |
| U0264,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6932703594755043,cloud |
| U0118,P0507,latency_sensitive,Give an instant short answer: backpropagation?,0,0.15029682152066537,local |
| U0074,P0435,simple_qa,Convert 150 miles to kilometers,0,0.737875480793207,cloud |
| U0186,P0570,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.35264612505049453,local |
| U0190,P0184,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.6896828763052796,cloud |
| U0365,P0115,long_context,Answer strictly from the full 2-hour meeting transcript on migration guide,1,0.6119629510796006,cloud |
| U0389,P0394,simple_qa,Convert 150 miles to kilometers,0,0.39070522718881323,local |
| U0326,P0050,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.5238540200720755,cloud |
| U0226,P0223,image_generation,Create a 4k illustration of a thunderstorm with dramatic rim lighting,1,0.5285969173929933,cloud |
| U0046,P0430,simple_qa,What is the capital of board meeting minutes?,1,0.42304456228188486,local |
| U0324,P0033,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical tokenization decomposition,1,0.7752198575349444,cloud |
| U0034,P0265,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.8249604419306465,cloud |
| U0132,P0347,creative_writing,Compose a short story opening about a thunderstorm,0,0.5208292374235348,cloud |
| U0087,P0054,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,1,0.7764916354305367,cloud |
| U0385,P0505,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,1,0.4945231305960096,local |
| U0112,P0585,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.2119474922322785,local |
| U0113,P0097,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.5873361954071372,cloud |
| U0013,P0450,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,1,0.27709640698538235,local |
| U0173,P0231,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6379587836287877,cloud |
| U0299,P0352,creative_writing,Write a haiku about a flamenco guitarist,1,0.47842121452222125,local |
| U0318,P0029,complex_reasoning,Prove or refute: every quantum error correction admits a canonical Bayesian inference decomposition,1,0.8373792500280733,cloud |
| U0394,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.40136654398748156,local |
| U0260,P0506,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.2739489391925527,local |
|
|
