test_predictions.csv

user_id,prompt_id,topic,prompt_text,label,p_cloud,pred_choice
U0240,P0220,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.5900247798249949,cloud
U0238,P0258,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.5074178095467987,cloud
U0390,P0288,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.4939615436434187,local
U0246,P0203,image_generation,"Produce a logo mockup for product spec, transparent background",0,0.7910155292895898,cloud
U0037,P0505,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.33986360726406784,local
U0329,P0549,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.2583964297212446,local
U0223,P0181,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",0,0.34077615849704396,local
U0095,P0126,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,0,0.4849784780909869,local
U0136,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,0,0.4899352174629159,local
U0137,P0133,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.4006658968579231,local
U0209,P0422,simple_qa,Explain tokenization in one sentence,0,0.257288661250981,local
U0248,P0364,creative_writing,Compose a short story opening about a sleepy cat,1,0.47533614013023273,local
U0008,P0178,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.6329612900776582,cloud
U0236,P0392,simple_qa,Explain topological sorting in one sentence,1,0.5648411558735648,cloud
U0149,P0509,latency_sensitive,Give an instant short answer: garbage collection?,0,0.29968582138578476,local
U0318,P0319,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.5743498193382314,cloud
U0147,P0404,simple_qa,Explain topological sorting in one sentence,0,0.5065190819789395,cloud
U0112,P0521,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.21465488799902452,local
U0371,P0012,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.8203488109644332,cloud
U0095,P0155,image_generation,Create a 4k illustration of a sleepy cat with dramatic rim lighting,0,0.47396925039967674,local
U0398,P0065,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.49593631274495475,local
U0180,P0443,simple_qa,Convert 150 miles to kilometers,0,0.39287673839694276,local
U0061,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,0,0.35784247865853047,local
U0124,P0429,simple_qa,Convert 150 miles to kilometers,0,0.5998005838122857,cloud
U0232,P0409,simple_qa,What is the capital of clinical trial protocol?,1,0.5745194980857945,cloud
U0232,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,1,0.6041135810441954,cloud
U0071,P0416,simple_qa,Convert 150 miles to kilometers,0,0.34897729554604917,local
U0005,P0576,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,1,0.23658962463758035,local
U0067,P0083,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.36105939334284287,local
U0040,P0475,latency_sensitive,Give an instant short answer: tokenization?,0,0.3494486007060946,local
U0350,P0497,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.29987153380738224,local
U0085,P0499,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.1957154651095475,local
U0398,P0500,latency_sensitive,Rephrase this snippet while I type: quantum error correction,0,0.16669742868343165,local
U0316,P0408,simple_qa,What is the capital of franchise lore wiki?,1,0.5236247113108693,cloud
U0029,P0275,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,0,0.42872662101589226,local
U0372,P0120,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.7888978057202106,cloud
U0223,P0127,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.5286816608229572,cloud
U0211,P0589,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.45742980953645945,local
U0122,P0396,simple_qa,Convert 150 miles to kilometers,0,0.23586465473956916,local
U0134,P0194,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.5363583119272419,cloud
U0244,P0238,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.5830265212961077,cloud
U0103,P0394,simple_qa,Convert 150 miles to kilometers,0,0.48800698222989114,local
U0055,P0593,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.4001070947363062,local
U0292,P0492,latency_sensitive,Rephrase this snippet while I type: a flamenco guitarist,0,0.5155812307724127,cloud
U0215,P0382,simple_qa,What is the capital of Q4 earnings report?,1,0.5125199137577184,cloud
U0008,P0591,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,0,0.3751174733229473,local
U0171,P0300,creative_writing,Compose a short story opening about a sleepy cat,1,0.5190356253226713,cloud
U0048,P0098,long_context,Track every character and plot thread across the product spec saga,0,0.8040900723528415,cloud
U0037,P0361,creative_writing,Write a haiku about quantum error correction,0,0.4646519669643608,local
U0067,P0257,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.3367914564234042,local
U0197,P0445,simple_qa,What is the capital of product spec?,0,0.3686509504475391,local
U0193,P0441,simple_qa,Convert 150 miles to kilometers,0,0.38096604184746236,local
U0318,P0503,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,1,0.4951382773865779,local
U0269,P0363,creative_writing,Write a haiku about a flamenco guitarist,0,0.26508003074185893,local
U0213,P0518,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.3932796179871163,local
U0194,P0256,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.5242862384369376,cloud
U0058,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,0,0.6627347312042235,cloud
U0110,P0596,privacy_sensitive,Summarize my medical records regarding garbage collection,0,0.30797004388166815,local
U0399,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.396748286836355,local
U0226,P0134,long_context,Track every character and plot thread across the Q4 earnings report saga,0,0.6209134411154645,cloud
U0085,P0113,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.44421088950222287,local
U0221,P0196,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,0,0.8297322355526083,cloud
U0237,P0372,creative_writing,Write a haiku about a sleepy cat,1,0.5514870425706021,cloud
U0275,P0280,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.7136301209741256,cloud
U0034,P0503,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,1,0.5686929480193459,cloud
U0362,P0362,creative_writing,Compose a short story opening about quantum error correction,1,0.5379553850756243,cloud
U0061,P0256,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.6411060643053276,cloud
U0317,P0547,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.1841755129380414,local
U0173,P0413,simple_qa,What is the capital of clinical trial protocol?,0,0.5794399604652418,cloud
U0161,P0167,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.612111208249942,cloud
U0297,P0347,creative_writing,Compose a short story opening about a thunderstorm,0,0.47506690259701034,local
U0110,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6507178647578878,cloud
U0026,P0375,simple_qa,Convert 150 miles to kilometers,0,0.5860641267351623,cloud
U0045,P0554,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.30895652617933994,local
U0179,P0592,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.3319968956497139,local
U0083,P0222,image_generation,Generate a photorealistic image of a flamenco guitarist at golden hour,0,0.5780045959844293,cloud
U0349,P0411,simple_qa,What is the capital of franchise lore wiki?,0,0.294619202183574,local
U0384,P0167,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.7487215289454152,cloud
U0227,P0198,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.7589207796196443,cloud
U0144,P0117,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.32677798747998715,local
U0283,P0515,latency_sensitive,Rephrase this snippet while I type: a sleepy cat,1,0.5358045167313625,cloud
U0261,P0356,creative_writing,Write a haiku about a chess endgame,0,0.28580926692260233,local
U0138,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.4490265540512202,local
U0219,P0591,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,0,0.185207827278156,local
U0318,P0480,latency_sensitive,Give an instant short answer: tokenization?,0,0.40866376957101364,local
U0164,P0176,image_generation,Generate a photorealistic image of a sleepy cat at golden hour,1,0.6169525603117026,cloud
U0043,P0529,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.2012378376465405,local
U0129,P0336,creative_writing,Write a haiku about a thunderstorm,0,0.3645900409090712,local
U0310,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,0,0.6601605196541763,cloud
U0367,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7625729176026493,cloud
U0153,P0512,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,1,0.2945464169423312,local
U0215,P0530,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.4843741631159421,local
U0284,P0035,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.5064525420792706,cloud
U0365,P0107,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.6646879022415764,cloud
U0247,P0423,simple_qa,Convert 150 miles to kilometers,1,0.590759145235503,cloud
U0012,P0465,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.15124537931810098,local
U0072,P0114,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.6040128874456069,cloud
U0211,P0482,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.2960883627960355,local
U0260,P0566,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.24292061654444916,local
U0223,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.18220491578928852,local
U0144,P0507,latency_sensitive,Give an instant short answer: backpropagation?,0,0.1285768950694415,local
U0009,P0452,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.32579163143791784,local
U0046,P0362,creative_writing,Compose a short story opening about quantum error correction,1,0.47511822127590686,local
U0087,P0093,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.6842229285123889,cloud
U0164,P0230,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.44853326311539804,local
U0160,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,1,0.2646076217565222,local
U0119,P0548,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.3933192013164829,local
U0292,P0442,simple_qa,What is the capital of migration guide?,1,0.6812525689796733,cloud
U0159,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.4550169001207854,local
U0213,P0237,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.5433318841696894,cloud
U0065,P0457,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.4154781168031528,local
U0309,P0379,simple_qa,Convert 150 miles to kilometers,0,0.24287311953825608,local
U0062,P0101,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.5533003623005333,cloud
U0252,P0349,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.7482998505944862,cloud
U0176,P0432,simple_qa,Convert 150 miles to kilometers,0,0.412017780127681,local
U0193,P0369,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.5671726002852284,cloud
U0177,P0502,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,1,0.4701239217441223,local
U0206,P0487,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.24941073256572868,local
U0129,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,0,0.4899582089121915,local
U0262,P0356,creative_writing,Write a haiku about a chess endgame,0,0.48320887726493855,local
U0304,P0131,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.5171864744520894,cloud
U0397,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.681063520433066,cloud
U0289,P0372,creative_writing,Write a haiku about a sleepy cat,0,0.5449233617237402,cloud
U0091,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.23692766865044299,local
U0121,P0562,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.4110535209820098,local
U0019,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,1,0.6453875841485571,cloud
U0050,P0598,privacy_sensitive,Draft an email discussing my salary at franchise lore wiki,0,0.11108518177212699,local
U0102,P0325,creative_writing,Compose a short story opening about sourdough bread,1,0.3655598472404453,local
U0092,P0340,creative_writing,Write a haiku about quantum error correction,1,0.49920621038937985,local
U0189,P0319,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.43959968172259967,local
U0090,P0432,simple_qa,Convert 150 miles to kilometers,0,0.2867545958725223,local
U0329,P0303,creative_writing,Draft a two-paragraph product blurb for Q4 earnings report,0,0.3707624869971763,local
U0200,P0571,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.3448097071839904,local
U0099,P0097,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.35794566529797534,local
U0381,P0571,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.28115685473342117,local
U0161,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,0,0.5714686244255359,cloud
U0394,P0205,image_generation,Generate a photorealistic image of a rusting cargo ship at golden hour,1,0.715668100573146,cloud
U0369,P0029,complex_reasoning,Prove or refute: every quantum error correction admits a canonical Bayesian inference decomposition,0,0.7308996481925788,cloud
U0273,P0386,simple_qa,What is the capital of product spec?,0,0.2471908733582127,local
U0197,P0508,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.3584406142739382,local
U0332,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5372913235987136,cloud
U0097,P0453,latency_sensitive,Rephrase this snippet while I type: a sleepy cat,0,0.39591916567310514,local
U0207,P0066,complex_reasoning,Derive the closed form for a rusting cargo ship and verify each step,1,0.7492971577680932,cloud
U0098,P0309,creative_writing,Write a haiku about quantum error correction,1,0.5632761562043652,cloud
U0357,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,0,0.2955715654157075,local
U0236,P0469,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.31211283886677754,local
U0395,P0260,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.4272785919176845,local
U0001,P0042,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.7284168743706282,cloud
U0313,P0205,image_generation,Generate a photorealistic image of a rusting cargo ship at golden hour,1,0.4228539961755796,local
U0141,P0103,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.5747147275096353,cloud
U0284,P0516,latency_sensitive,Give an instant short answer: tokenization?,1,0.22131841427535617,local
U0289,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6600021404797007,cloud
U0166,P0429,simple_qa,Convert 150 miles to kilometers,0,0.20342751456850142,local
U0045,P0595,privacy_sensitive,Summarize my medical records regarding garbage collection,0,0.3225700996188321,local
U0309,P0172,image_generation,Create a 4k illustration of a chess endgame with dramatic rim lighting,1,0.4749445305527254,local
U0049,P0212,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.633784448655428,cloud
U0227,P0462,latency_sensitive,Give an instant short answer: topological sorting?,0,0.49866471030169846,local
U0131,P0231,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.6383755700292038,cloud
U0192,P0441,simple_qa,Convert 150 miles to kilometers,0,0.42269216546636823,local
U0316,P0453,latency_sensitive,Rephrase this snippet while I type: a sleepy cat,0,0.4268140255619703,local
U0191,P0303,creative_writing,Draft a two-paragraph product blurb for Q4 earnings report,0,0.5822378718631133,cloud
U0130,P0035,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.6736933632356183,cloud
U0201,P0421,simple_qa,Convert 150 miles to kilometers,0,0.4791491771041355,local
U0120,P0247,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,1,0.3850951755762195,local
U0264,P0578,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.26235053510468226,local
U0014,P0310,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.4899606618598758,local
U0257,P0110,long_context,Answer strictly from the full 2-hour meeting transcript on migration guide,1,0.7789865154950669,cloud
U0236,P0265,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.7984829237395751,cloud
U0346,P0116,long_context,Summarize the key arguments across all 200 pages of franchise lore wiki,0,0.4808250424735976,local
U0159,P0427,simple_qa,What is the capital of migration guide?,0,0.39695909398462237,local
U0073,P0125,long_context,Summarize the key arguments across all 200 pages of product spec,0,0.8573456501139727,cloud
U0136,P0204,image_generation,Generate a photorealistic image of quantum error correction at golden hour,0,0.5869981359799278,cloud
U0379,P0211,image_generation,Generate a photorealistic image of quantum error correction at golden hour,1,0.5486368380775815,cloud
U0243,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.4927455426340401,local
U0090,P0588,privacy_sensitive,Redact PII from this legal document about migration guide,0,0.16179876717532496,local
U0102,P0340,creative_writing,Write a haiku about quantum error correction,1,0.31707190436945104,local
U0348,P0236,code_generation,Write a production-ready implementation of garbage collection in Python,1,0.6984187315943694,cloud
U0219,P0478,latency_sensitive,Autocomplete this sentence in real time: a chess endgame,0,0.25722942224003204,local
U0285,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.5763097676323211,cloud
U0274,P0411,simple_qa,What is the capital of franchise lore wiki?,0,0.4834642088706172,local
U0246,P0328,creative_writing,Compose a short story opening about a chess endgame,0,0.5154409704312369,cloud
U0191,P0040,complex_reasoning,Derive the closed form for a rusting cargo ship and verify each step,1,0.8194057749357724,cloud
U0026,P0033,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical tokenization decomposition,1,0.8188160012479022,cloud
U0094,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,0,0.41988016173961,local
U0308,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.4192432701088991,local
U0257,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.8491395375218422,cloud
U0138,P0585,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.32319687042285394,local
U0050,P0265,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.439146847211013,local
U0114,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.6266852752971341,cloud
U0194,P0029,complex_reasoning,Prove or refute: every quantum error correction admits a canonical Bayesian inference decomposition,1,0.719707850651986,cloud
U0301,P0468,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.5201756099918338,cloud
U0348,P0449,simple_qa,Explain backpropagation in one sentence,0,0.47261851286385664,local
U0310,P0181,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.46746160812716236,local
U0142,P0429,simple_qa,Convert 150 miles to kilometers,0,0.26074110053768573,local
U0238,P0050,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,0,0.5474625728171466,cloud
U0189,P0177,image_generation,Create a 4k illustration of a sleepy cat with dramatic rim lighting,1,0.5909209806059149,cloud
U0181,P0065,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.7447470371559669,cloud
U0298,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.28090881982775784,local
U0000,P0324,creative_writing,Write a haiku about a rusting cargo ship,1,0.20437100696271027,local
U0072,P0113,long_context,Track every character and plot thread across the franchise lore wiki saga,0,0.6605797797708073,cloud
U0372,P0209,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.698240561006046,cloud
U0081,P0043,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.6629984676491372,cloud
U0292,P0156,image_generation,Create a 4k illustration of a flamenco guitarist with dramatic rim lighting,1,0.8304419048820397,cloud
U0056,P0376,simple_qa,Convert 150 miles to kilometers,0,0.40509382318899834,local
U0283,P0257,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.6571126330754351,cloud
U0142,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.46152684895297547,local
U0345,P0174,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",0,0.7221246085770919,cloud
U0237,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5535726931700047,cloud
U0069,P0197,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.5189168602870691,cloud
U0007,P0499,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.18590512975131437,local
U0279,P0238,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.8199190855991968,cloud
U0114,P0229,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.6447833014961268,cloud
U0168,P0558,privacy_sensitive,Redact PII from this legal document about board meeting minutes,1,0.5859940583978371,cloud
U0240,P0412,simple_qa,Explain Bayesian inference in one sentence,0,0.3270683995707863,local
U0342,P0083,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.3229188137293215,local
U0112,P0448,simple_qa,Convert 150 miles to kilometers,1,0.38889354551340477,local
U0308,P0350,creative_writing,Compose a short story opening about a flamenco guitarist,0,0.37974351367204484,local
U0170,P0490,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.3679823133523715,local
U0388,P0486,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.3996327376309862,local
U0209,P0207,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.48397098141384326,local
U0024,P0049,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.8214568495458768,cloud
U0221,P0048,complex_reasoning,Find the flaw in this 40-step proof about garbage collection and repair it,1,0.7862530375199025,cloud
U0390,P0258,code_generation,Generate unit tests and API docs for the topological sorting library,0,0.3679196337392846,local
U0008,P0041,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,0,0.7831727169709701,cloud
U0319,P0512,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.22452193757454053,local
U0368,P0230,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.609116583907634,cloud
U0047,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,1,0.2185953010843932,local
U0134,P0584,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.27088761784569676,local
U0146,P0570,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.25161427747327036,local
U0213,P0286,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.6144072053293808,cloud
U0199,P0380,simple_qa,Explain Bayesian inference in one sentence,0,0.46575667879986976,local
U0344,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,1,0.43958685760549754,local
U0304,P0397,simple_qa,Explain tokenization in one sentence,0,0.3578817050860276,local
U0072,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.4144398064996152,local
U0268,P0201,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.439181112374698,local
U0343,P0081,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,0,0.5763395998243346,cloud
U0306,P0173,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.8120541610499923,cloud
U0146,P0298,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.521226839886762,cloud
U0060,P0157,image_generation,Create a 4k illustration of sourdough bread with dramatic rim lighting,0,0.5622910369620615,cloud
U0291,P0202,image_generation,Create a 4k illustration of a thunderstorm with dramatic rim lighting,0,0.48371248633208297,local
U0328,P0518,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.3530250126738159,local
U0273,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.4758588564334134,local
U0116,P0049,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.8224515986116397,cloud
U0255,P0186,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.4662795768324839,local
U0257,P0449,simple_qa,Explain backpropagation in one sentence,1,0.4820123041867697,local
U0264,P0134,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.6698995564848284,cloud
U0387,P0207,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.6806718416395304,cloud
U0276,P0276,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.5632166163907149,cloud
U0104,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6770480514678111,cloud
U0002,P0188,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.7216374186123419,cloud
U0357,P0522,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,0,0.15062517555505814,local
U0325,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,0,0.5715740807345284,cloud
U0045,P0096,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.7178323217091653,cloud
U0324,P0272,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.7862199676208317,cloud
U0155,P0165,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.7429589824487389,cloud
U0211,P0370,creative_writing,Write a haiku about quantum error correction,1,0.6563391898443176,cloud
U0199,P0489,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.46299162670474514,local
U0228,P0196,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,0,0.7681986953605345,cloud
U0191,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7854233345812708,cloud
U0067,P0098,long_context,Track every character and plot thread across the product spec saga,0,0.5299161541442138,cloud
U0177,P0252,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.7763814410669366,cloud
U0068,P0127,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.4889963943034396,local
U0332,P0563,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.26967336552515575,local
U0283,P0163,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.7981746737398048,cloud
U0041,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6132508124009575,cloud
U0053,P0483,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.24340773415219613,local
U0111,P0465,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.3085011542859822,local
U0392,P0312,creative_writing,Write a haiku about a thunderstorm,1,0.5019939894033104,cloud
U0265,P0433,simple_qa,Explain garbage collection in one sentence,0,0.5232030781088215,cloud
U0330,P0085,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.45020315994647353,local
U0114,P0153,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.5562347272044332,cloud
U0323,P0548,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.25145717323288486,local
U0393,P0403,simple_qa,Explain topological sorting in one sentence,1,0.46163558500941665,local
U0257,P0008,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical garbage collection decomposition,1,0.7488213389906023,cloud
U0113,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.5193170910542848,cloud
U0090,P0232,code_generation,Refactor this legacy module into modern C++20: board meeting minutes,0,0.36817930997352444,local
U0004,P0599,privacy_sensitive,Redact PII from this legal document about board meeting minutes,1,0.2558667027969496,local
U0013,P0059,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,0,0.6124973924755748,cloud
U0384,P0505,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.5642091531223178,cloud
U0131,P0571,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.43509728755663235,local
U0357,P0224,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.4059574167874508,local
U0173,P0421,simple_qa,Convert 150 miles to kilometers,0,0.6039426169391987,cloud
U0273,P0466,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.24790109914688188,local
U0310,P0510,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,1,0.3139622042717476,local
U0390,P0074,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,1,0.5873746655367107,cloud
U0128,P0123,long_context,Answer strictly from the full 2-hour meeting transcript on migration guide,1,0.5142732718867866,cloud
U0340,P0163,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.66291647204605,cloud
U0265,P0187,image_generation,Generate a photorealistic image of a flamenco guitarist at golden hour,0,0.6117112975236789,cloud
U0367,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.7443709677612786,cloud
U0284,P0208,image_generation,Create a 4k illustration of a flamenco guitarist with dramatic rim lighting,1,0.5802682705782,cloud
U0105,P0385,simple_qa,Convert 150 miles to kilometers,0,0.2852012544396806,local
U0278,P0526,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,1,0.22089669007215437,local
U0014,P0073,complex_reasoning,Derive the closed form for sourdough bread and verify each step,1,0.7560362417866511,cloud
U0266,P0383,simple_qa,Explain tokenization in one sentence,0,0.3199532449791077,local
U0350,P0310,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.38203943216336195,local
U0219,P0351,creative_writing,Write a haiku about a flamenco guitarist,0,0.3180479928205724,local
U0318,P0315,creative_writing,Write a haiku about a thunderstorm,1,0.571835721352301,cloud
U0254,P0189,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.6998134283339711,cloud
U0223,P0114,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.4631418349965748,local
U0372,P0431,simple_qa,Convert 150 miles to kilometers,1,0.3899882343896256,local
U0188,P0389,simple_qa,Explain garbage collection in one sentence,0,0.22367701495096798,local
U0301,P0024,complex_reasoning,Prove or refute: every a rusting cargo ship admits a canonical deadlock avoidance decomposition,1,0.7947746251592438,cloud
U0178,P0296,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.6209610019455647,cloud
U0338,P0068,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical memory-mapped I/O decomposition,1,0.8371259376949903,cloud
U0080,P0341,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.6225154907038943,cloud
U0221,P0213,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.8018660684858051,cloud
U0292,P0094,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.8331613671514358,cloud
U0040,P0258,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.5240053696166607,cloud
U0305,P0070,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical deadlock avoidance decomposition,1,0.3507750949514141,local
U0188,P0363,creative_writing,Write a haiku about a flamenco guitarist,0,0.2393941270960898,local
U0376,P0292,code_generation,Generate unit tests and API docs for the deadlock avoidance library,0,0.38659968393731275,local
U0012,P0014,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.5471122602730981,cloud
U0366,P0136,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,0,0.8335829677715528,cloud
U0121,P0232,code_generation,Refactor this legacy module into modern C++20: board meeting minutes,1,0.6550969258493485,cloud
U0384,P0312,creative_writing,Write a haiku about a thunderstorm,1,0.6636370006170355,cloud
U0044,P0365,creative_writing,Compose a short story opening about sourdough bread,1,0.7802879061021835,cloud
U0357,P0068,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical memory-mapped I/O decomposition,0,0.4653783375769503,local
U0182,P0269,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.7783012355311673,cloud
U0006,P0449,simple_qa,Explain backpropagation in one sentence,0,0.21685033509625432,local
U0094,P0083,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.6419777116226258,cloud
U0155,P0318,creative_writing,Compose a short story opening about a rusting cargo ship,0,0.6336704827263833,cloud
U0035,P0274,code_generation,Generate unit tests and API docs for the topological sorting library,0,0.500698036567552,cloud
U0047,P0463,latency_sensitive,Give an instant short answer: topological sorting?,0,0.35104709058417227,local
U0316,P0365,creative_writing,Compose a short story opening about sourdough bread,0,0.6089781793833912,cloud
U0051,P0259,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.4192615738105765,local
U0040,P0547,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.2164520465911534,local
U0386,P0472,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.1556792846723783,local
U0124,P0106,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.7752752450793186,cloud
U0042,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.3248133032712417,local
U0261,P0095,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.5652520731865137,cloud
U0140,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6346276422959011,cloud
U0039,P0276,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.7422060864627426,cloud
U0165,P0064,complex_reasoning,Derive the closed form for quantum error correction and verify each step,0,0.6589994734007517,cloud
U0211,P0499,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.44700263649683447,local
U0392,P0082,long_context,Summarize the key arguments across all 200 pages of migration guide,0,0.5507052699728557,cloud
U0149,P0254,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.7089724663182687,cloud
U0274,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.4012758951158657,local
U0097,P0380,simple_qa,Explain Bayesian inference in one sentence,0,0.29451389416653884,local
U0373,P0340,creative_writing,Write a haiku about quantum error correction,0,0.24923405714021601,local
U0375,P0011,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical backpropagation decomposition,1,0.6776491564333598,cloud
U0219,P0021,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.5267288780315484,cloud
U0088,P0017,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical tokenization decomposition,1,0.5122686762620157,cloud
U0050,P0596,privacy_sensitive,Summarize my medical records regarding garbage collection,0,0.1843962474255669,local
U0117,P0067,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.618355183679694,cloud
U0164,P0455,latency_sensitive,Autocomplete this sentence in real time: a chess endgame,0,0.2877314110552864,local
U0350,P0513,latency_sensitive,Give an instant short answer: tokenization?,0,0.2444548050852598,local
U0187,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6012747836509713,cloud
U0159,P0597,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,1,0.23528129265227532,local
U0115,P0135,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.6465193216617304,cloud
U0144,P0355,creative_writing,Compose a short story opening about a thunderstorm,0,0.2105800972332094,local
U0140,P0139,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.5187036840480397,cloud
U0170,P0277,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.6307611296177317,cloud
U0373,P0452,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.2692673371564931,local
U0298,P0535,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.1463140504020605,local
U0160,P0293,code_generation,Refactor this legacy module into modern C++20: migration guide,0,0.6189219758208188,cloud
U0309,P0498,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.19107698071196053,local
U0374,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.22039420786843686,local
U0215,P0283,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.7755038122301952,cloud
U0068,P0595,privacy_sensitive,Summarize my medical records regarding garbage collection,0,0.16001741394041508,local
U0190,P0546,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,1,0.39653028553716846,local
U0047,P0416,simple_qa,Convert 150 miles to kilometers,0,0.3846950190305376,local
U0346,P0150,image_generation,Create a 4k illustration of a chess endgame with dramatic rim lighting,1,0.5096169095653611,cloud
U0390,P0468,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.3031152796876451,local
U0289,P0167,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.6269692236646623,cloud
U0383,P0207,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.5557623303519381,cloud
U0316,P0464,latency_sensitive,Give an instant short answer: backpropagation?,0,0.4420959437531958,local
U0038,P0100,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.5623955889404737,cloud
U0243,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.49378877590735815,local
U0348,P0342,creative_writing,Compose a short story opening about a rusting cargo ship,0,0.5632007980726411,cloud
U0229,P0383,simple_qa,Explain tokenization in one sentence,1,0.3123099434346877,local
U0219,P0149,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.5229601799977528,cloud
U0148,P0500,latency_sensitive,Rephrase this snippet while I type: quantum error correction,0,0.20061763022234533,local
U0064,P0131,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.6739669292368405,cloud
U0342,P0304,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.33898428346796156,local
U0200,P0206,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.5591815296986208,cloud
U0295,P0508,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.3094594771045089,local
U0282,P0258,code_generation,Generate unit tests and API docs for the topological sorting library,1,0.7128680050302022,cloud
U0361,P0592,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.5306513312971876,cloud
U0242,P0544,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.33719415740713177,local
U0063,P0018,complex_reasoning,Find the flaw in this 40-step proof about deadlock avoidance and repair it,1,0.5797065092933172,cloud
U0293,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.5646132053029921,cloud
U0060,P0269,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.7699424643471454,cloud
U0080,P0576,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,0,0.3823478480149438,local
U0157,P0472,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,1,0.3766209007236129,local
U0047,P0487,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.313513883405252,local
U0017,P0195,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.7777823614901794,cloud
U0260,P0408,simple_qa,What is the capital of franchise lore wiki?,0,0.4830565866300119,local
U0120,P0470,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.3164369645690393,local
U0366,P0129,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,1,0.8366478134261468,cloud
U0110,P0063,complex_reasoning,Prove or refute: every sourdough bread admits a canonical deadlock avoidance decomposition,1,0.6040258340553142,cloud
U0120,P0324,creative_writing,Write a haiku about a rusting cargo ship,1,0.33677869559674095,local
U0333,P0041,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.6184014025333483,cloud
U0207,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.45800273372641825,local
U0053,P0070,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical deadlock avoidance decomposition,0,0.44172773655858144,local
U0386,P0052,complex_reasoning,Prove or refute: every a chess endgame admits a canonical Bayesian inference decomposition,1,0.4312676772350067,local
U0387,P0404,simple_qa,Explain topological sorting in one sentence,0,0.40806038988894017,local
U0170,P0524,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.2647593354440976,local
U0392,P0380,simple_qa,Explain Bayesian inference in one sentence,0,0.33202081997270083,local
U0181,P0283,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.7530298046464959,cloud
U0140,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.3138068464963985,local
U0396,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.2992647494017527,local
U0392,P0072,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.8050139773671412,cloud
U0147,P0346,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.4791990619745939,local
U0262,P0440,simple_qa,Convert 150 miles to kilometers,0,0.48897870916378827,local
U0179,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.5029880656800687,cloud
U0342,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.34770190312197125,local
U0241,P0276,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.7610599587055973,cloud
U0266,P0087,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.6016533193669868,cloud
U0200,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.3776769023387761,local
U0322,P0547,privacy_sensitive,Draft an email discussing my salary at migration guide,1,0.3575869476863212,local
U0033,P0567,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.3152717738831339,local
U0180,P0279,code_generation,Generate unit tests and API docs for the tokenization library,1,0.5987524131664806,cloud
U0173,P0489,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.444573853382153,local
U0223,P0169,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.48331264672916613,local
U0203,P0493,latency_sensitive,Rephrase this snippet while I type: sourdough bread,1,0.2650753703324007,local
U0363,P0124,long_context,Summarize the key arguments across all 200 pages of migration guide,0,0.6008629615654271,cloud
U0239,P0304,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.43058980743759473,local
U0294,P0226,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.8234544697035995,cloud
U0145,P0225,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.38651414133611,local
U0083,P0343,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.28614453527955597,local
U0029,P0509,latency_sensitive,Give an instant short answer: garbage collection?,1,0.26830478986317724,local
U0292,P0575,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.4572815957697717,local
U0074,P0342,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.5603059198728683,cloud
U0189,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.44207126511205125,local
U0117,P0165,image_generation,Generate a photorealistic image of a chess endgame at golden hour,0,0.4510504885115211,local
U0293,P0466,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.43335122098730755,local
U0079,P0443,simple_qa,Convert 150 miles to kilometers,0,0.28693525696772554,local
U0035,P0594,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.1671831481458736,local
U0057,P0165,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.6417802771507428,cloud
U0197,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.4261896911133764,local
U0332,P0325,creative_writing,Compose a short story opening about sourdough bread,0,0.4911619136594723,local
U0151,P0583,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.36342407024376083,local
U0289,P0454,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,0,0.37045713130623703,local
U0360,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.26774307591536556,local
U0090,P0354,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.36233059831540715,local
U0227,P0587,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.42552421486060993,local
U0079,P0127,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.5332705215952872,cloud
U0304,P0383,simple_qa,Explain tokenization in one sentence,0,0.24243864154124894,local
U0120,P0150,image_generation,Create a 4k illustration of a chess endgame with dramatic rim lighting,0,0.5490058972095031,cloud
U0238,P0355,creative_writing,Compose a short story opening about a thunderstorm,0,0.4769290878922732,local
U0006,P0019,complex_reasoning,Prove or refute: every a flamenco guitarist admits a canonical backpropagation decomposition,1,0.6165466146057321,cloud
U0233,P0344,creative_writing,Compose a short story opening about a chess endgame,0,0.5625875061132494,cloud
U0285,P0336,creative_writing,Write a haiku about a thunderstorm,0,0.47154437503000696,local
U0309,P0299,code_generation,Generate unit tests and API docs for the tokenization library,0,0.36198435022596537,local
U0343,P0594,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.2927207672932871,local
U0284,P0460,latency_sensitive,Give an instant short answer: tokenization?,0,0.22511564676322526,local
U0127,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,0,0.5021697764635792,cloud
U0320,P0182,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,1,0.786028833038978,cloud
U0001,P0368,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,0,0.6017723864592471,cloud
U0197,P0264,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.6734339201794836,cloud
U0064,P0008,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical garbage collection decomposition,0,0.5881225653471565,cloud
U0371,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.4355745653042522,local
U0100,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.7369951837000335,cloud
U0299,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6696362997515685,cloud
U0139,P0034,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.722154318031329,cloud
U0218,P0188,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.6077198339387648,cloud
U0116,P0010,complex_reasoning,Prove or refute: every a chess endgame admits a canonical deadlock avoidance decomposition,1,0.7387951617140776,cloud
U0346,P0367,creative_writing,Compose a short story opening about quantum error correction,1,0.3152340814212702,local
U0275,P0465,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.42279543836391165,local
U0398,P0168,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.41496840106120075,local
U0015,P0186,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.44196774462765115,local
U0206,P0544,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.22002574780105508,local
U0185,P0442,simple_qa,What is the capital of migration guide?,0,0.48592099377691506,local
U0140,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,0,0.5483878283633911,cloud
U0195,P0220,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.5745132296093128,cloud
U0246,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.385855429897026,local
U0023,P0167,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.6209166145518332,cloud
U0373,P0135,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,0,0.40976463855758966,local
U0222,P0358,creative_writing,Write a haiku about a sleepy cat,0,0.613959653230933,cloud
U0270,P0326,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,0,0.45345166779035184,local
U0291,P0073,complex_reasoning,Derive the closed form for sourdough bread and verify each step,1,0.47784797608486673,local
U0009,P0410,simple_qa,Explain backpropagation in one sentence,0,0.3063114763694492,local
U0167,P0265,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.5547270901830432,cloud
U0024,P0418,simple_qa,What is the capital of product spec?,0,0.6627071493924632,cloud
U0080,P0220,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.7362384416633195,cloud
U0389,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.28779691062333085,local
U0101,P0225,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.4358198367329311,local
U0293,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.570450740681937,cloud
U0220,P0369,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.39048621342251444,local
U0151,P0541,privacy_sensitive,Redact PII from this legal document about product spec,0,0.42257288629809703,local
U0114,P0019,complex_reasoning,Prove or refute: every a flamenco guitarist admits a canonical backpropagation decomposition,1,0.6955461917756133,cloud
U0288,P0478,latency_sensitive,Autocomplete this sentence in real time: a chess endgame,0,0.3649561724070061,local
U0368,P0306,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.5420855740694193,cloud
U0134,P0036,complex_reasoning,Derive the closed form for a chess endgame and verify each step,0,0.46764409627247505,local
U0021,P0267,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.27020209529448885,local
U0356,P0230,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.48288587894308865,local
U0012,P0552,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.16087053052909825,local
U0200,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.6731104182791325,cloud
U0112,P0247,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,0,0.3368621961024918,local
U0264,P0533,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.2946208487509992,local
U0290,P0438,simple_qa,Convert 150 miles to kilometers,1,0.6888299780916493,cloud
U0055,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.4901562972739102,local
U0045,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.5135508187619017,cloud
U0221,P0023,complex_reasoning,Derive the closed form for sourdough bread and verify each step,1,0.8050621388498084,cloud
U0266,P0456,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.3656305981620586,local
U0157,P0526,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,0,0.37687842840924224,local
U0252,P0415,simple_qa,Convert 150 miles to kilometers,1,0.7292808360140968,cloud
U0060,P0098,long_context,Track every character and plot thread across the product spec saga,0,0.712231718854051,cloud
U0392,P0107,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.6842719280562963,cloud
U0311,P0366,creative_writing,Compose a short story opening about quantum error correction,0,0.49302498708389964,local
U0152,P0310,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.3580207623241909,local
U0238,P0366,creative_writing,Compose a short story opening about quantum error correction,1,0.5096524185736332,cloud
U0147,P0292,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.6847178436580444,cloud
U0215,P0487,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,0,0.488292152872783,local
U0384,P0346,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,0,0.5748557611110903,cloud
U0135,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,0,0.15996886956129988,local
U0353,P0430,simple_qa,What is the capital of board meeting minutes?,0,0.5254383834195636,cloud
U0220,P0019,complex_reasoning,Prove or refute: every a flamenco guitarist admits a canonical backpropagation decomposition,1,0.5717057997888352,cloud
U0124,P0157,image_generation,Create a 4k illustration of sourdough bread with dramatic rim lighting,1,0.7446238917606943,cloud
U0103,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,0,0.5861331107398133,cloud
U0234,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7053412650860654,cloud
U0192,P0357,creative_writing,Write a haiku about a chess endgame,0,0.5651680823804505,cloud
U0303,P0361,creative_writing,Write a haiku about quantum error correction,1,0.4255838082907803,local
U0372,P0325,creative_writing,Compose a short story opening about sourdough bread,0,0.5767431711345699,cloud
U0067,P0587,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.19040754663045684,local
U0213,P0584,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.39911124774358697,local
U0092,P0181,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",0,0.5701688748560406,cloud
U0315,P0342,creative_writing,Compose a short story opening about a rusting cargo ship,0,0.6122936396888402,cloud
U0056,P0405,simple_qa,What is the capital of Q4 earnings report?,0,0.4063315209303294,local
U0327,P0449,simple_qa,Explain backpropagation in one sentence,0,0.20558368857371295,local
U0059,P0524,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,1,0.3118595319796929,local
U0080,P0427,simple_qa,What is the capital of migration guide?,1,0.483470914409084,local
U0180,P0134,long_context,Track every character and plot thread across the Q4 earnings report saga,0,0.5963612774449134,cloud
U0389,P0395,simple_qa,What is the capital of migration guide?,0,0.4472531247171695,local
U0195,P0357,creative_writing,Write a haiku about a chess endgame,1,0.3979290010455516,local
U0288,P0141,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.5103685217364029,cloud
U0162,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,1,0.46288675054646217,local
U0350,P0108,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.6172327333343595,cloud
U0366,P0217,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.7087988719692468,cloud
U0252,P0554,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.5548251583116363,cloud
U0207,P0349,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,0,0.5881171822055865,cloud
U0006,P0570,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.2535095673438078,local
U0148,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.4731731448528113,local
U0108,P0023,complex_reasoning,Derive the closed form for sourdough bread and verify each step,0,0.6040506855434747,cloud
U0082,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.5734701586180803,cloud
U0362,P0293,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.7075049210518961,cloud
U0123,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.6073353502934749,cloud
U0177,P0113,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.7198228050619341,cloud
U0039,P0155,image_generation,Create a 4k illustration of a sleepy cat with dramatic rim lighting,0,0.6400050059355931,cloud
U0120,P0066,complex_reasoning,Derive the closed form for a rusting cargo ship and verify each step,0,0.5787335079845448,cloud
U0153,P0084,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.501501047309248,cloud
U0120,P0010,complex_reasoning,Prove or refute: every a chess endgame admits a canonical deadlock avoidance decomposition,1,0.5763820266068131,cloud
U0257,P0102,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.8111664508875112,cloud
U0124,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.49553451085105077,local
U0355,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.41923730750489874,local
U0001,P0356,creative_writing,Write a haiku about a chess endgame,1,0.4256812705180244,local
U0072,P0445,simple_qa,What is the capital of product spec?,0,0.3739574809222105,local
U0111,P0560,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.3510754308427989,local
U0347,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.7322177944615648,cloud
U0218,P0545,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.24920628587838758,local
U0115,P0387,simple_qa,Convert 150 miles to kilometers,0,0.4929652735935694,local
U0314,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.5674413948711758,cloud
U0170,P0449,simple_qa,Explain backpropagation in one sentence,0,0.31745945952469584,local
U0158,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.6140124415091486,cloud
U0231,P0133,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.8290588502455583,cloud
U0189,P0352,creative_writing,Write a haiku about a flamenco guitarist,0,0.5179427951930389,cloud
U0357,P0418,simple_qa,What is the capital of product spec?,0,0.31492589494382234,local
U0339,P0451,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,0,0.3846274916365512,local
U0367,P0259,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5932784845833193,cloud
U0111,P0496,latency_sensitive,Give an instant short answer: tokenization?,0,0.3754135048284157,local
U0133,P0061,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.6201746404381864,cloud
U0278,P0388,simple_qa,Convert 150 miles to kilometers,0,0.35455089841076,local
U0281,P0204,image_generation,Generate a photorealistic image of quantum error correction at golden hour,1,0.6791618801127556,cloud
U0168,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.868699824065833,cloud
U0347,P0507,latency_sensitive,Give an instant short answer: backpropagation?,1,0.3836673943226261,local
U0214,P0102,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.6809074235858046,cloud
U0355,P0551,privacy_sensitive,Draft an email discussing my salary at product spec,0,0.21785265334776144,local
U0328,P0133,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.5960388213317767,cloud
U0396,P0008,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical garbage collection decomposition,1,0.3991195852490119,local
U0302,P0055,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical deadlock avoidance decomposition,1,0.5794556207493132,cloud
U0246,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,0,0.806094570303941,cloud
U0181,P0203,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.7988065026208809,cloud
U0341,P0328,creative_writing,Compose a short story opening about a chess endgame,0,0.39212559631841026,local
U0280,P0401,simple_qa,What is the capital of franchise lore wiki?,1,0.2811792116438503,local
U0034,P0474,latency_sensitive,Give an instant short answer: tokenization?,1,0.5509992032605769,cloud
U0077,P0395,simple_qa,What is the capital of migration guide?,0,0.44104563295889865,local
U0264,P0492,latency_sensitive,Rephrase this snippet while I type: a flamenco guitarist,0,0.40564780751266866,local
U0013,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.45196769075665966,local
U0211,P0168,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.6428277470118741,cloud
U0346,P0238,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.5056705460216142,cloud
U0044,P0558,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.5262968605920696,cloud
U0215,P0518,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.49844440755664127,local
U0359,P0519,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.39726150216954936,local
U0307,P0394,simple_qa,Convert 150 miles to kilometers,0,0.48121551665386053,local
U0318,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.4754201523291777,local
U0225,P0385,simple_qa,Convert 150 miles to kilometers,0,0.27337371269254096,local
U0335,P0047,complex_reasoning,Prove or refute: every sourdough bread admits a canonical deadlock avoidance decomposition,1,0.5727014460762643,cloud
U0177,P0471,latency_sensitive,Give an instant short answer: deadlock avoidance?,0,0.28507485311105785,local
U0385,P0095,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.7088201383884051,cloud
U0154,P0558,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.25698403173494083,local
U0127,P0460,latency_sensitive,Give an instant short answer: tokenization?,0,0.2698436698485767,local
U0186,P0235,code_generation,Generate unit tests and API docs for the garbage collection library,1,0.6459687931845535,cloud
U0354,P0131,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.47398760716880556,local
U0084,P0057,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.5734096151429611,cloud
U0156,P0016,complex_reasoning,Find the flaw in this 40-step proof about garbage collection and repair it,1,0.667344732820797,cloud
U0165,P0316,creative_writing,Write a haiku about quantum error correction,1,0.5567656192855224,cloud
U0281,P0397,simple_qa,Explain tokenization in one sentence,0,0.5953542690216725,cloud
U0205,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.8042874407313066,cloud
U0301,P0054,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,1,0.6945767102304929,cloud
U0089,P0577,privacy_sensitive,Summarize my medical records regarding Bayesian inference,1,0.29316147522245695,local
U0226,P0230,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5345493439988183,cloud
U0143,P0379,simple_qa,Convert 150 miles to kilometers,1,0.5478642331986884,cloud
U0184,P0035,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.7646844658863938,cloud
U0008,P0286,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6677430062618704,cloud
U0183,P0158,image_generation,Create a 4k illustration of sourdough bread with dramatic rim lighting,1,0.6255307822974062,cloud
U0090,P0472,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.21068273077247995,local
U0181,P0092,long_context,Summarize the key arguments across all 200 pages of franchise lore wiki,1,0.7324279703261766,cloud
U0236,P0416,simple_qa,Convert 150 miles to kilometers,0,0.5815076249764008,cloud
U0338,P0431,simple_qa,Convert 150 miles to kilometers,1,0.4827618866255821,local
U0312,P0564,privacy_sensitive,Redact PII from this legal document about product spec,0,0.5263804098498441,cloud
U0202,P0532,privacy_sensitive,Summarize my medical records regarding tokenization,0,0.29647757599813723,local
U0367,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.5089635655281123,cloud
U0394,P0569,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.3582113192787117,local
U0298,P0190,image_generation,Generate a photorealistic image of a sleepy cat at golden hour,0,0.401676728132477,local
U0129,P0563,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.2029976106284447,local
U0293,P0053,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,1,0.6314025420965054,cloud
U0365,P0087,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,0,0.6359609438560717,cloud
U0084,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,0,0.587870373575675,cloud
U0259,P0426,simple_qa,Explain garbage collection in one sentence,0,0.7583117126831063,cloud
U0038,P0460,latency_sensitive,Give an instant short answer: tokenization?,0,0.3707797778010009,local
U0129,P0066,complex_reasoning,Derive the closed form for a rusting cargo ship and verify each step,1,0.5471859965278323,cloud
U0107,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,0,0.4883148034474555,local
U0190,P0254,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.7381642393899571,cloud
U0192,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.4243681835894901,local
U0192,P0405,simple_qa,What is the capital of Q4 earnings report?,0,0.5018990398186538,cloud
U0024,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.46221011335689227,local
U0284,P0300,creative_writing,Compose a short story opening about a sleepy cat,1,0.33576127146204293,local
U0116,P0549,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.3958337345965825,local
U0166,P0302,creative_writing,Write a haiku about a thunderstorm,1,0.39672060387474883,local
U0371,P0446,simple_qa,Explain Bayesian inference in one sentence,0,0.46055447423434104,local
U0146,P0530,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.24194177804473227,local
U0044,P0254,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.7982571523305418,cloud
U0260,P0026,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.6743460923516061,cloud
U0077,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.49903040641874813,local
U0178,P0266,code_generation,Generate unit tests and API docs for the garbage collection library,1,0.5835586967484987,cloud
U0235,P0122,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.47786771789887356,local
U0175,P0395,simple_qa,What is the capital of migration guide?,1,0.40181168411983503,local
U0070,P0154,image_generation,Generate a photorealistic image of a flamenco guitarist at golden hour,0,0.5100976811728647,cloud
U0236,P0037,complex_reasoning,Derive the closed form for quantum error correction and verify each step,1,0.854100173263532,cloud
U0126,P0094,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.7075032965975327,cloud
U0342,P0023,complex_reasoning,Derive the closed form for sourdough bread and verify each step,0,0.5423029320589805,cloud
U0192,P0071,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7455383100506219,cloud
U0185,P0538,privacy_sensitive,Redact PII from this legal document about migration guide,1,0.25923981375565247,local
U0121,P0059,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.7133855333790499,cloud
U0385,P0521,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,1,0.366198606628909,local
U0370,P0561,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,1,0.5163623567194714,cloud
U0003,P0112,long_context,Track every character and plot thread across the product spec saga,1,0.7363860351339475,cloud
U0186,P0160,image_generation,"Produce a logo mockup for migration guide, transparent background",1,0.5894257392453994,cloud
U0163,P0036,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.3970857043534665,local
U0060,P0346,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.42586225041884157,local
U0081,P0249,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.49907714764030825,local
U0029,P0407,simple_qa,Convert 150 miles to kilometers,1,0.5353727145397006,cloud
U0056,P0412,simple_qa,Explain Bayesian inference in one sentence,0,0.35294053592764274,local
U0006,P0505,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,1,0.2911618942318787,local
U0151,P0517,latency_sensitive,Autocomplete this sentence in real time: sourdough bread,1,0.4582448929118521,local
U0174,P0476,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,0,0.4571129074291763,local
U0169,P0032,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.7224175316988958,cloud
U0324,P0120,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.8175202776436239,cloud
U0042,P0585,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.26430984968673954,local
U0119,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.30428251262942774,local
U0156,P0215,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",0,0.4791894112467348,local
U0013,P0366,creative_writing,Compose a short story opening about quantum error correction,0,0.5047138881494714,cloud
U0379,P0350,creative_writing,Compose a short story opening about a flamenco guitarist,0,0.39871923116116864,local
U0104,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.4964027998998909,local
U0174,P0500,latency_sensitive,Rephrase this snippet while I type: quantum error correction,1,0.42383127074723215,local
U0105,P0302,creative_writing,Write a haiku about a thunderstorm,1,0.45231694068512146,local
U0364,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,0,0.20507320069798,local
U0052,P0502,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.2872550788901535,local
U0365,P0165,image_generation,Generate a photorealistic image of a chess endgame at golden hour,0,0.5315448672561044,cloud
U0165,P0583,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.27063449484858043,local
U0229,P0540,privacy_sensitive,Redact PII from this legal document about product spec,1,0.2124933798243997,local
U0359,P0263,code_generation,Refactor this legacy module into modern C++20: product spec,1,0.43097546926280256,local
U0020,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.5032862820147652,cloud
U0135,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.3720374851466754,local
U0041,P0201,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.4866219833043206,local
U0177,P0436,simple_qa,What is the capital of migration guide?,0,0.46643534146059223,local
U0012,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.25866446082031436,local
U0172,P0050,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,0,0.6478592332601837,cloud
U0345,P0395,simple_qa,What is the capital of migration guide?,1,0.5055496885035304,cloud
U0046,P0379,simple_qa,Convert 150 miles to kilometers,1,0.4660091403730118,local
U0280,P0475,latency_sensitive,Give an instant short answer: tokenization?,0,0.2218149082065742,local
U0265,P0330,creative_writing,Write a haiku about a flamenco guitarist,0,0.6769302112168919,cloud
U0162,P0368,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.41988368856803593,local
U0296,P0559,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.36512822042437987,local
U0338,P0227,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.6823621456833566,cloud
U0245,P0459,latency_sensitive,Rephrase this snippet while I type: sourdough bread,1,0.3731540056130901,local
U0382,P0255,code_generation,Write a production-ready implementation of garbage collection in Python,1,0.4403675835542168,local
U0366,P0319,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.6686317329149781,cloud
U0149,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.6378387312744148,cloud
U0186,P0289,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,0,0.4989026694982545,local
U0145,P0130,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.6539090965848804,cloud
U0099,P0174,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.46337320978198543,local
U0295,P0148,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.675160084023645,cloud
U0067,P0389,simple_qa,Explain garbage collection in one sentence,0,0.22377061597894957,local
U0183,P0297,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.4871597794095377,local
U0287,P0140,long_context,Track every character and plot thread across the clinical trial protocol saga,1,0.7642256873512303,cloud
U0015,P0315,creative_writing,Write a haiku about a thunderstorm,1,0.4745570142430322,local
U0323,P0250,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5437471196938104,cloud
U0237,P0002,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,1,0.5920740828861254,cloud
U0388,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.5567257906522557,cloud
U0277,P0461,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.3078652537210032,local
U0021,P0539,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.12411575701228647,local
U0354,P0548,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.18727389656249935,local
U0158,P0236,code_generation,Write a production-ready implementation of garbage collection in Python,1,0.5261519550992364,cloud
U0299,P0390,simple_qa,What is the capital of product spec?,1,0.3486330500641959,local
U0049,P0028,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6317567891746114,cloud
U0016,P0267,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.4688369936599381,local
U0000,P0251,code_generation,Write a production-ready implementation of tokenization in Python,0,0.27624525142339845,local
U0048,P0375,simple_qa,Convert 150 miles to kilometers,1,0.5421348493481617,cloud
U0359,P0456,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.3882396647940751,local
U0041,P0244,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,0,0.34349251477172466,local
U0081,P0440,simple_qa,Convert 150 miles to kilometers,1,0.3212544613022534,local
U0160,P0536,privacy_sensitive,Draft an email discussing my salary at product spec,0,0.32023712849785163,local
U0169,P0383,simple_qa,Explain tokenization in one sentence,0,0.35422086145012344,local
U0257,P0087,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.802322586724737,cloud
U0034,P0026,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.8513110320528152,cloud
U0003,P0397,simple_qa,Explain tokenization in one sentence,0,0.5547631334019516,cloud
U0087,P0103,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.8390249966145796,cloud
U0312,P0569,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.6293257641037041,cloud
U0289,P0365,creative_writing,Compose a short story opening about sourdough bread,1,0.6236132072122239,cloud
U0240,P0563,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.22762392199825357,local
U0200,P0168,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.6080713923110739,cloud
U0312,P0159,image_generation,Generate a photorealistic image of sourdough bread at golden hour,0,0.862624072388016,cloud
U0103,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7606297840496239,cloud
U0172,P0103,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.7928283330515618,cloud
U0073,P0065,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.759796483822576,cloud
U0162,P0116,long_context,Summarize the key arguments across all 200 pages of franchise lore wiki,0,0.44612168152968,local
U0164,P0182,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,1,0.6483403519655377,cloud
U0154,P0043,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.642133523256538,cloud
U0173,P0118,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.7715254286557646,cloud
U0000,P0341,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.3056953703584688,local
U0029,P0415,simple_qa,Convert 150 miles to kilometers,0,0.5157788039223355,cloud
U0081,P0407,simple_qa,Convert 150 miles to kilometers,1,0.4055617200117119,local
U0279,P0362,creative_writing,Compose a short story opening about quantum error correction,1,0.6932677356484441,cloud
U0144,P0363,creative_writing,Write a haiku about a flamenco guitarist,0,0.13337094219819234,local
U0038,P0290,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.5531122004152473,cloud
U0183,P0186,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.324544604363647,local
U0065,P0533,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.34007786842270216,local
U0062,P0578,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,1,0.15713195290776147,local
U0248,P0194,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,0,0.4867400093525386,local
U0321,P0560,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.21511870680492118,local
U0384,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.6355760352535973,cloud
U0205,P0220,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.7981388915041306,cloud
U0324,P0447,simple_qa,Convert 150 miles to kilometers,0,0.634661656678522,cloud
U0245,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.6554147650741285,cloud
U0390,P0338,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.5067668223573807,cloud
U0038,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.4912286533890555,local
U0085,P0283,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.4489802482361676,local
U0292,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.7294651279571434,cloud
U0289,P0493,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.25117826051395287,local
U0219,P0338,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.5290966928242233,cloud
U0136,P0306,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.4184901236124746,local
U0123,P0311,creative_writing,Compose a short story opening about a thunderstorm,0,0.39456802617982856,local
U0027,P0477,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.4245768232924945,local
U0152,P0188,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5658334931829407,cloud
U0171,P0229,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.6914240305317764,cloud
U0040,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,0,0.5401533933368093,cloud
U0394,P0020,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,1,0.732837244258712,cloud
U0296,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,0,0.5624197284651573,cloud
U0307,P0275,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.419920938908718,local
U0217,P0146,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.4403129221483703,local
U0165,P0391,simple_qa,Convert 150 miles to kilometers,0,0.39856059790087756,local
U0077,P0147,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.610765988884841,cloud
U0324,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.4636661780747964,local
U0136,P0378,simple_qa,Explain Bayesian inference in one sentence,0,0.25629833622063564,local
U0095,P0125,long_context,Summarize the key arguments across all 200 pages of product spec,0,0.7160753986264049,cloud
U0214,P0472,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.34693654779130806,local
U0283,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.6651008747883628,cloud
U0214,P0136,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,1,0.6786194182910076,cloud
U0051,P0320,creative_writing,Compose a short story opening about a chess endgame,0,0.30626509120233586,local
U0128,P0231,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.33597923395825946,local
U0396,P0145,long_context,Summarize the key arguments across all 200 pages of Q4 earnings report,1,0.5455575288656955,cloud
U0257,P0569,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.48571202195400404,local
U0380,P0323,creative_writing,Draft a two-paragraph product blurb for franchise lore wiki,0,0.6570714523424565,cloud
U0129,P0221,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.6136422802713652,cloud
U0063,P0082,long_context,Summarize the key arguments across all 200 pages of migration guide,0,0.4274412891111308,local
U0254,P0236,code_generation,Write a production-ready implementation of garbage collection in Python,1,0.5496379015556412,cloud
U0026,P0545,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,1,0.48442846179424376,local
U0345,P0511,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,1,0.33408871010380764,local
U0253,P0583,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.20644606957506398,local
U0150,P0399,simple_qa,Convert 150 miles to kilometers,0,0.3203123843784147,local
U0283,P0425,simple_qa,What is the capital of clinical trial protocol?,1,0.5444089999020608,cloud
U0055,P0579,privacy_sensitive,Summarize my medical records regarding tokenization,1,0.3413738389291951,local
U0116,P0587,privacy_sensitive,Summarize my medical records regarding backpropagation,1,0.4211559548785412,local
U0083,P0427,simple_qa,What is the capital of migration guide?,1,0.2473106383770737,local
U0138,P0216,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.5792011508303863,cloud
U0157,P0282,code_generation,Refactor this legacy module into modern C++20: board meeting minutes,1,0.709627591530398,cloud
U0290,P0221,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.831002247100136,cloud
U0330,P0501,latency_sensitive,Rephrase this snippet while I type: quantum error correction,1,0.3412643574709174,local
U0329,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.45320557735299494,local
U0037,P0136,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,0,0.6081480615734892,cloud
U0305,P0387,simple_qa,Convert 150 miles to kilometers,0,0.25826392249748187,local
U0317,P0206,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.4797362131409096,local
U0247,P0206,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.7035595475621705,cloud
U0050,P0435,simple_qa,Convert 150 miles to kilometers,0,0.3637547763867283,local
U0198,P0248,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.4624591011109399,local
U0104,P0410,simple_qa,Explain backpropagation in one sentence,0,0.5074128572317829,cloud
U0317,P0449,simple_qa,Explain backpropagation in one sentence,0,0.2754212421673309,local
U0237,P0113,long_context,Track every character and plot thread across the franchise lore wiki saga,0,0.6775885652425507,cloud
U0317,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,0,0.6735035931242521,cloud
U0378,P0490,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.4290668334507427,local
U0072,P0420,simple_qa,Explain topological sorting in one sentence,0,0.4360711019789094,local
U0192,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.3953967969041988,local
U0187,P0300,creative_writing,Compose a short story opening about a sleepy cat,1,0.42517593494121286,local
U0373,P0264,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.460346038886637,local
U0085,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.3322404897264642,local
U0367,P0358,creative_writing,Write a haiku about a sleepy cat,1,0.4838791989687985,local
U0251,P0375,simple_qa,Convert 150 miles to kilometers,1,0.363614731657818,local
U0189,P0138,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,0,0.6061018345907685,cloud
U0048,P0387,simple_qa,Convert 150 miles to kilometers,1,0.646859280559147,cloud
U0024,P0404,simple_qa,Explain topological sorting in one sentence,0,0.5313216794530581,cloud
U0065,P0278,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.6170276111472417,cloud
U0033,P0007,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6757993872609847,cloud
U0103,P0557,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.30562405107315405,local
U0308,P0358,creative_writing,Write a haiku about a sleepy cat,1,0.4437664602392202,local
U0140,P0002,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,1,0.5432625522613055,cloud
U0003,P0075,long_context,Track every character and plot thread across the product spec saga,1,0.7952987318483753,cloud
U0283,P0478,latency_sensitive,Autocomplete this sentence in real time: a chess endgame,0,0.5489470702907185,cloud
U0124,P0140,long_context,Track every character and plot thread across the clinical trial protocol saga,1,0.8767709212832595,cloud
U0390,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.49270613878405806,local
U0115,P0558,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.33168297846140726,local
U0346,P0058,complex_reasoning,Prove or refute: every a chess endgame admits a canonical backpropagation decomposition,1,0.5512316590643447,cloud
U0227,P0494,latency_sensitive,Rephrase this snippet while I type: sourdough bread,1,0.46995568152701156,local
U0332,P0379,simple_qa,Convert 150 miles to kilometers,1,0.43219957243799023,local
U0245,P0567,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.43187046740328583,local
U0137,P0440,simple_qa,Convert 150 miles to kilometers,0,0.19607578919608545,local
U0274,P0345,creative_writing,Compose a short story opening about a flamenco guitarist,0,0.42259856594906653,local
U0042,P0446,simple_qa,Explain Bayesian inference in one sentence,0,0.34225533872233443,local
U0061,P0129,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,0,0.7366860401455553,cloud
U0144,P0534,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.14958709514348323,local
U0294,P0016,complex_reasoning,Find the flaw in this 40-step proof about garbage collection and repair it,1,0.8778983740910872,cloud
U0088,P0141,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,0,0.45050574356288753,local
U0256,P0017,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical tokenization decomposition,1,0.5727181294192142,cloud
U0033,P0582,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.26863959852626174,local
U0108,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.19919270846142617,local
U0104,P0151,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",0,0.5895768514030179,cloud
U0134,P0064,complex_reasoning,Derive the closed form for quantum error correction and verify each step,1,0.5096720138712544,cloud
U0032,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.3664545525464096,local
U0269,P0415,simple_qa,Convert 150 miles to kilometers,0,0.3505183255934345,local
U0342,P0212,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.5375041670287127,cloud
U0119,P0264,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.7260925861204719,cloud
U0116,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,1,0.46448807076068643,local
U0073,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.8209208340521711,cloud
U0135,P0139,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.37435883103524875,local
U0130,P0057,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6931178610565489,cloud
U0186,P0299,code_generation,Generate unit tests and API docs for the tokenization library,0,0.5863333476676249,cloud
U0220,P0054,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,0,0.48372636295215743,local
U0296,P0579,privacy_sensitive,Summarize my medical records regarding tokenization,1,0.26110683896345455,local
U0017,P0410,simple_qa,Explain backpropagation in one sentence,1,0.5911874719024134,cloud
U0022,P0454,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,0,0.33901365438004794,local
U0133,P0457,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.3068165373988685,local
U0341,P0176,image_generation,Generate a photorealistic image of a sleepy cat at golden hour,0,0.6409084676693134,cloud
U0047,P0449,simple_qa,Explain backpropagation in one sentence,0,0.25597918579430495,local
U0225,P0565,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.16264571755996665,local
U0354,P0340,creative_writing,Write a haiku about quantum error correction,0,0.2635577722837922,local
U0196,P0027,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.7787969275143265,cloud
U0380,P0289,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,0,0.6769677317658058,cloud
U0078,P0563,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.5216560007098442,cloud
U0073,P0269,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,1,0.8213894876132436,cloud
U0071,P0209,image_generation,"Produce a logo mockup for product spec, transparent background",0,0.5200046103292008,cloud
U0083,P0547,privacy_sensitive,Draft an email discussing my salary at migration guide,1,0.11174370394125287,local
U0126,P0050,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.570953085235061,cloud
U0134,P0076,long_context,Track every character and plot thread across the franchise lore wiki saga,0,0.5765870516934878,cloud
U0105,P0440,simple_qa,Convert 150 miles to kilometers,0,0.2765480498541817,local
U0307,P0584,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.4094168920726163,local
U0128,P0098,long_context,Track every character and plot thread across the product spec saga,1,0.4925691382762644,local
U0252,P0435,simple_qa,Convert 150 miles to kilometers,1,0.8295160349854972,cloud
U0119,P0514,latency_sensitive,Rephrase this snippet while I type: a chess endgame,1,0.33282002963060847,local
U0212,P0183,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.7142280281488429,cloud
U0010,P0585,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.4440974338992279,local
U0317,P0003,complex_reasoning,Derive the closed form for a chess endgame and verify each step,0,0.6349839499531805,cloud
U0242,P0257,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.4987070882226129,local
U0120,P0057,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6232738033509262,cloud
U0147,P0510,latency_sensitive,Autocomplete this sentence in real time: a thunderstorm,0,0.42720985103853254,local
U0255,P0320,creative_writing,Compose a short story opening about a chess endgame,0,0.47239588322784815,local
U0316,P0184,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.5739775692523206,cloud
U0357,P0291,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.22590524499427717,local
U0196,P0022,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.6914955166973931,cloud
U0068,P0447,simple_qa,Convert 150 miles to kilometers,1,0.3249906991740741,local
U0154,P0249,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.5055401391574035,cloud
U0147,P0001,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.8121596806839876,cloud
U0259,P0226,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.8413973469143348,cloud
U0377,P0241,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.6372897774229963,cloud
U0039,P0498,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,0,0.4710516819315406,local
U0091,P0027,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6958973444595956,cloud
U0023,P0028,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.7144628526302006,cloud
U0286,P0102,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.6704220874015646,cloud
U0239,P0009,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.6184775933238487,cloud
U0159,P0578,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.241530693195681,local
U0102,P0199,image_generation,"Produce a logo mockup for migration guide, transparent background",1,0.4081016856192027,local
U0250,P0178,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.5972971932391091,cloud
U0267,P0370,creative_writing,Write a haiku about quantum error correction,0,0.45601264432324745,local
U0256,P0057,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.6564798655414958,cloud
U0214,P0053,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,0,0.6280630557088,cloud
U0258,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.4950171366855312,local
U0337,P0247,code_generation,Write a production-ready implementation of memory-mapped I/O in Python,1,0.39059960475772026,local
U0233,P0025,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.5853568433883777,cloud
U0396,P0362,creative_writing,Compose a short story opening about quantum error correction,0,0.2823303932877628,local
U0095,P0234,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.4045676278937564,local
U0093,P0421,simple_qa,Convert 150 miles to kilometers,1,0.3908680207784127,local
U0236,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.756479832902312,cloud
U0308,P0185,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.6115175839845131,cloud
U0338,P0436,simple_qa,What is the capital of migration guide?,1,0.5762445275259123,cloud
U0384,P0080,long_context,Summarize the key arguments across all 200 pages of product spec,1,0.7937955933015812,cloud
U0118,P0186,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.20730591027175357,local
U0337,P0150,image_generation,Create a 4k illustration of a chess endgame with dramatic rim lighting,0,0.5613600276111194,cloud
U0305,P0489,latency_sensitive,Give an instant short answer: deadlock avoidance?,1,0.15267638729482197,local
U0094,P0401,simple_qa,What is the capital of franchise lore wiki?,0,0.5705457391280891,cloud
U0101,P0011,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical backpropagation decomposition,0,0.5707118547337805,cloud
U0125,P0115,long_context,Answer strictly from the full 2-hour meeting transcript on migration guide,1,0.7491762551572156,cloud
U0337,P0072,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.7761774646081093,cloud
U0152,P0490,latency_sensitive,Rephrase this snippet while I type: a thunderstorm,0,0.3149217833349664,local
U0055,P0358,creative_writing,Write a haiku about a sleepy cat,1,0.48354076496083526,local
U0352,P0094,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.6821222277067265,cloud
U0267,P0189,image_generation,"Produce a logo mockup for board meeting minutes, transparent background",1,0.5820514399414219,cloud
U0097,P0045,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.574370254803649,cloud
U0174,P0541,privacy_sensitive,Redact PII from this legal document about product spec,1,0.44295918062024175,local
U0167,P0039,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical backpropagation decomposition,1,0.46491250332984474,local
U0286,P0179,image_generation,Create a 4k illustration of a sleepy cat with dramatic rim lighting,0,0.6674666643505902,cloud
U0132,P0574,privacy_sensitive,Summarize my medical records regarding Bayesian inference,0,0.2602335186051424,local
U0339,P0567,privacy_sensitive,Summarize my medical records regarding memory-mapped I/O,0,0.4896967846423243,local
U0196,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5716274139858469,cloud
U0239,P0422,simple_qa,Explain tokenization in one sentence,0,0.36018211139223183,local
U0196,P0369,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.5448402838306337,cloud
U0263,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.8265579115588859,cloud
U0392,P0322,creative_writing,Write a haiku about a rusting cargo ship,0,0.545415646218455,cloud
U0325,P0030,complex_reasoning,Find the flaw in this 40-step proof about deadlock avoidance and repair it,1,0.6126275115312849,cloud
U0196,P0280,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.590550116867982,cloud
U0046,P0093,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.5437775603489375,cloud
U0126,P0203,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.729168418839075,cloud
U0010,P0406,simple_qa,Convert 150 miles to kilometers,0,0.49320899329074747,local
U0360,P0492,latency_sensitive,Rephrase this snippet while I type: a flamenco guitarist,0,0.29772988627851993,local
U0183,P0408,simple_qa,What is the capital of franchise lore wiki?,1,0.43409511770366016,local
U0073,P0537,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,0,0.49238950187388686,local
U0336,P0160,image_generation,"Produce a logo mockup for migration guide, transparent background",1,0.4363358274831462,local
U0351,P0067,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.742955925960209,cloud
U0368,P0565,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.34619615114721924,local
U0286,P0512,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.35024841751199,local
U0242,P0526,privacy_sensitive,Redact PII from this legal document about Q4 earnings report,0,0.33868352337481034,local
U0027,P0565,privacy_sensitive,Summarize my medical records regarding topological sorting,1,0.33151536729273845,local
U0369,P0516,latency_sensitive,Give an instant short answer: tokenization?,0,0.30321301744189016,local
U0231,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.598913089090766,cloud
U0007,P0171,image_generation,Generate a photorealistic image of a chess endgame at golden hour,0,0.37200645890659234,local
U0202,P0438,simple_qa,Convert 150 miles to kilometers,1,0.4908990506292421,local
U0144,P0512,latency_sensitive,Rephrase this snippet while I type: a rusting cargo ship,0,0.13358917297895911,local
U0380,P0506,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.4999977643412306,local
U0373,P0117,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.3916509262421292,local
U0165,P0441,simple_qa,Convert 150 miles to kilometers,0,0.4261616891116934,local
U0110,P0031,complex_reasoning,Derive the closed form for a sleepy cat and verify each step,1,0.6895475286668103,cloud
U0287,P0444,simple_qa,What is the capital of board meeting minutes?,1,0.5194959045384404,cloud
U0323,P0379,simple_qa,Convert 150 miles to kilometers,0,0.354144722157985,local
U0390,P0044,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.6319204937456073,cloud
U0089,P0373,creative_writing,Write a haiku about sourdough bread,0,0.572925623827536,cloud
U0363,P0128,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.5841928864337007,cloud
U0359,P0213,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.715753705938283,cloud
U0118,P0185,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.34541481627557186,local
U0055,P0153,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.6374316836859769,cloud
U0182,P0221,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",0,0.7451009905035654,cloud
U0021,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.5310501020633634,cloud
U0368,P0391,simple_qa,Convert 150 miles to kilometers,0,0.438317989594586,local
U0329,P0398,simple_qa,Convert 150 miles to kilometers,1,0.2590568631326191,local
U0112,P0046,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6252704239670334,cloud
U0087,P0118,long_context,Track every character and plot thread across the board meeting minutes saga,0,0.810788547114656,cloud
U0380,P0099,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.8441131085873083,cloud
U0250,P0541,privacy_sensitive,Redact PII from this legal document about product spec,0,0.3262695159191001,local
U0275,P0440,simple_qa,Convert 150 miles to kilometers,1,0.5276811498056979,cloud
U0308,P0281,code_generation,Generate unit tests and API docs for the tokenization library,1,0.44948050349709334,local
U0356,P0159,image_generation,Generate a photorealistic image of sourdough bread at golden hour,0,0.6002732565257521,cloud
U0233,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.3905242454011628,local
U0107,P0277,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.7980744470842481,cloud
U0348,P0386,simple_qa,What is the capital of product spec?,1,0.5685480818152129,cloud
U0138,P0545,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.29630834039578563,local
U0390,P0470,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.23724744201285247,local
U0194,P0238,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,1,0.5278292908632344,cloud
U0224,P0423,simple_qa,Convert 150 miles to kilometers,0,0.28787093631981336,local
U0211,P0280,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.6678794029921031,cloud
U0014,P0315,creative_writing,Write a haiku about a thunderstorm,0,0.5297644360391539,cloud
U0311,P0449,simple_qa,Explain backpropagation in one sentence,1,0.3213768784243011,local
U0083,P0308,creative_writing,Compose a short story opening about a chess endgame,1,0.25641577355078937,local
U0319,P0432,simple_qa,Convert 150 miles to kilometers,1,0.2742244960577655,local
U0150,P0063,complex_reasoning,Prove or refute: every sourdough bread admits a canonical deadlock avoidance decomposition,1,0.6662937853353145,cloud
U0297,P0188,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5161342071503938,cloud
U0335,P0370,creative_writing,Write a haiku about quantum error correction,0,0.37078339394600723,local
U0335,P0011,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical backpropagation decomposition,0,0.3969241977954288,local
U0198,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.2829770248176558,local
U0135,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.2563233683919061,local
U0292,P0200,image_generation,Generate a photorealistic image of sourdough bread at golden hour,1,0.7869580161127904,cloud
U0055,P0130,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.7656795582169166,cloud
U0085,P0358,creative_writing,Write a haiku about a sleepy cat,0,0.23095390031710547,local
U0125,P0338,creative_writing,Draft a two-paragraph product blurb for migration guide,1,0.7760166129321052,cloud
U0372,P0349,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.5618749980623055,cloud
U0263,P0084,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.7232804543160497,cloud
U0045,P0317,creative_writing,Compose a short story opening about quantum error correction,0,0.4271752280213063,local
U0232,P0099,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.7346159760913181,cloud
U0351,P0519,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.4639013356042244,local
U0182,P0331,creative_writing,Compose a short story opening about a flamenco guitarist,1,0.4871357845602104,local
U0139,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.5731636235956097,cloud
U0280,P0081,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.3975372660371783,local
U0100,P0036,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.5671307973049156,cloud
U0334,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.7106144474075239,cloud
U0358,P0485,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,0,0.39919653804558336,local
U0351,P0552,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.3507757907567503,local
U0256,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.3976890280272864,local
U0005,P0422,simple_qa,Explain tokenization in one sentence,0,0.40140934817234714,local
U0132,P0340,creative_writing,Write a haiku about quantum error correction,1,0.37076904709629943,local
U0159,P0388,simple_qa,Convert 150 miles to kilometers,0,0.5091262800751154,cloud
U0091,P0107,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.602547771899757,cloud
U0174,P0475,latency_sensitive,Give an instant short answer: tokenization?,1,0.5374468881938821,cloud
U0362,P0202,image_generation,Create a 4k illustration of a thunderstorm with dramatic rim lighting,1,0.7616550873428943,cloud
U0206,P0345,creative_writing,Compose a short story opening about a flamenco guitarist,0,0.3426212551639802,local
U0243,P0117,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.6523134899355243,cloud
U0358,P0540,privacy_sensitive,Redact PII from this legal document about product spec,0,0.28078054040543154,local
U0240,P0447,simple_qa,Convert 150 miles to kilometers,1,0.44072066198690724,local
U0152,P0262,code_generation,Generate unit tests and API docs for the backpropagation library,1,0.5043094615705304,cloud
U0053,P0048,complex_reasoning,Find the flaw in this 40-step proof about garbage collection and repair it,1,0.5455758656330901,cloud
U0090,P0014,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.6041133952186185,cloud
U0341,P0519,latency_sensitive,Give an instant short answer: Bayesian inference?,0,0.40768412820683925,local
U0099,P0501,latency_sensitive,Rephrase this snippet while I type: quantum error correction,0,0.20418175376222245,local
U0092,P0149,long_context,Track every character and plot thread across the franchise lore wiki saga,1,0.7115088662173871,cloud
U0168,P0084,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.7762117121383854,cloud
U0389,P0426,simple_qa,Explain garbage collection in one sentence,0,0.48993293143579747,local
U0060,P0353,creative_writing,Write a haiku about a chess endgame,0,0.6179025585470933,cloud
U0154,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.5660494594969183,cloud
U0366,P0283,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.817721822388303,cloud
U0250,P0180,image_generation,Generate a photorealistic image of a thunderstorm at golden hour,1,0.5940040560045576,cloud
U0153,P0440,simple_qa,Convert 150 miles to kilometers,1,0.35244878839582916,local
U0387,P0599,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.30583159496040596,local
U0015,P0277,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.6549115922073928,cloud
U0339,P0589,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.5440798794301817,cloud
U0164,P0288,code_generation,Refactor this legacy module into modern C++20: franchise lore wiki,0,0.61316599832079,cloud
U0250,P0032,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.778909097349785,cloud
U0393,P0495,latency_sensitive,Give an instant short answer: topological sorting?,0,0.2932624422340143,local
U0237,P0005,complex_reasoning,Find the flaw in this 40-step proof about Bayesian inference and repair it,1,0.6811555296565215,cloud
U0320,P0419,simple_qa,What is the capital of franchise lore wiki?,1,0.5232325894320435,cloud
U0325,P0241,code_generation,Generate unit tests and API docs for the deadlock avoidance library,1,0.5475771851872527,cloud
U0181,P0441,simple_qa,Convert 150 miles to kilometers,1,0.45181642149005335,local
U0086,P0015,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.8490194407024316,cloud
U0280,P0460,latency_sensitive,Give an instant short answer: tokenization?,0,0.22534267630328364,local
U0266,P0443,simple_qa,Convert 150 miles to kilometers,0,0.3457322686363835,local
U0020,P0293,code_generation,Refactor this legacy module into modern C++20: migration guide,0,0.6593214784879734,cloud
U0116,P0571,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.418408374417526,local
U0031,P0088,long_context,Summarize the key arguments across all 200 pages of product spec,1,0.8987903713233015,cloud
U0251,P0412,simple_qa,Explain Bayesian inference in one sentence,0,0.37864091166382363,local
U0388,P0142,long_context,Track every character and plot thread across the migration guide saga,1,0.7028446916718623,cloud
U0196,P0207,image_generation,"Produce a logo mockup for clinical trial protocol, transparent background",1,0.679143067140434,cloud
U0077,P0276,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.62556290732291,cloud
U0045,P0226,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.7018221446247933,cloud
U0399,P0459,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.18907836145066195,local
U0236,P0337,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.7054960738904614,cloud
U0303,P0355,creative_writing,Compose a short story opening about a thunderstorm,0,0.37757458954894446,local
U0257,P0195,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.8130670422061556,cloud
U0230,P0346,creative_writing,Draft a two-paragraph product blurb for clinical trial protocol,1,0.1855961532050737,local
U0136,P0468,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.46886194549914123,local
U0398,P0311,creative_writing,Compose a short story opening about a thunderstorm,0,0.39512928910865286,local
U0005,P0086,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.6117826532890935,cloud
U0098,P0311,creative_writing,Compose a short story opening about a thunderstorm,0,0.6266517730459881,cloud
U0321,P0532,privacy_sensitive,Summarize my medical records regarding tokenization,0,0.2066095733966315,local
U0328,P0032,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.7127834893459702,cloud
U0156,P0280,code_generation,Write a production-ready implementation of Bayesian inference in Python,0,0.5084678504955076,cloud
U0377,P0480,latency_sensitive,Give an instant short answer: tokenization?,0,0.35988623729086655,local
U0012,P0218,image_generation,Generate a photorealistic image of quantum error correction at golden hour,0,0.33144813365593045,local
U0213,P0554,privacy_sensitive,Draft an email discussing my salary at clinical trial protocol,0,0.30291420426417315,local
U0223,P0268,code_generation,Generate unit tests and API docs for the backpropagation library,0,0.4467047795684953,local
U0361,P0248,code_generation,Write a production-ready implementation of backpropagation in Python,0,0.7723292737292374,cloud
U0279,P0254,code_generation,Refactor this legacy module into modern C++20: Q4 earnings report,1,0.8311490464573685,cloud
U0052,P0533,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.16728968621879844,local
U0070,P0332,creative_writing,Compose a short story opening about sourdough bread,1,0.35065813742451046,local
U0307,P0421,simple_qa,Convert 150 miles to kilometers,0,0.5247184127647558,cloud
U0256,P0263,code_generation,Refactor this legacy module into modern C++20: product spec,1,0.42218800764078085,local
U0205,P0457,latency_sensitive,Give an instant short answer: memory-mapped I/O?,1,0.49006283036520226,local
U0140,P0163,image_generation,Generate a photorealistic image of a chess endgame at golden hour,0,0.6377645261036698,cloud
U0326,P0214,image_generation,Generate a photorealistic image of quantum error correction at golden hour,0,0.5811961444416897,cloud
U0103,P0451,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,1,0.2967819953505693,local
U0232,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.3147816835448779,local
U0160,P0168,image_generation,Create a 4k illustration of quantum error correction with dramatic rim lighting,1,0.567765781794064,cloud
U0384,P0242,code_generation,Generate unit tests and API docs for the memory-mapped I/O library,0,0.707818290715411,cloud
U0032,P0010,complex_reasoning,Prove or refute: every a chess endgame admits a canonical deadlock avoidance decomposition,0,0.48942062819262333,local
U0210,P0266,code_generation,Generate unit tests and API docs for the garbage collection library,1,0.6090771818983164,cloud
U0364,P0330,creative_writing,Write a haiku about a flamenco guitarist,1,0.35238991901789724,local
U0216,P0575,privacy_sensitive,Summarize my medical records regarding backpropagation,0,0.39249649825113153,local
U0232,P0035,complex_reasoning,Derive the closed form for a flamenco guitarist and verify each step,1,0.6804606771496978,cloud
U0034,P0432,simple_qa,Convert 150 miles to kilometers,1,0.62014188277175,cloud
U0331,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,1,0.2655430913106453,local
U0316,P0072,complex_reasoning,Find the flaw in this 40-step proof about tokenization and repair it,1,0.7969364051512722,cloud
U0039,P0445,simple_qa,What is the capital of product spec?,0,0.48626395862231986,local
U0219,P0522,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,0,0.19647539137664477,local
U0203,P0128,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,1,0.7131765382216119,cloud
U0277,P0022,complex_reasoning,Derive the closed form for a chess endgame and verify each step,0,0.655661486070919,cloud
U0382,P0401,simple_qa,What is the capital of franchise lore wiki?,0,0.25387434629950845,local
U0037,P0500,latency_sensitive,Rephrase this snippet while I type: quantum error correction,0,0.2122878873708307,local
U0184,P0399,simple_qa,Convert 150 miles to kilometers,0,0.500380155023481,cloud
U0311,P0579,privacy_sensitive,Summarize my medical records regarding tokenization,0,0.2826233307026573,local
U0194,P0127,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.6034242724336302,cloud
U0177,P0237,code_generation,Generate unit tests and API docs for the topological sorting library,0,0.5931810153082364,cloud
U0234,P0083,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,1,0.4953692129110842,local
U0319,P0454,latency_sensitive,Autocomplete this sentence in real time: a flamenco guitarist,1,0.2204570231235,local
U0258,P0440,simple_qa,Convert 150 miles to kilometers,0,0.35234025257893714,local
U0352,P0564,privacy_sensitive,Redact PII from this legal document about product spec,0,0.2237827944628965,local
U0309,P0481,latency_sensitive,Give an instant short answer: memory-mapped I/O?,1,0.20200011096831066,local
U0187,P0329,creative_writing,Compose a short story opening about a rusting cargo ship,1,0.4863464920034536,local
U0212,P0330,creative_writing,Write a haiku about a flamenco guitarist,0,0.6955636069551541,cloud
U0248,P0421,simple_qa,Convert 150 miles to kilometers,0,0.3278481955331191,local
U0267,P0019,complex_reasoning,Prove or refute: every a flamenco guitarist admits a canonical backpropagation decomposition,0,0.5982854044186116,cloud
U0024,P0570,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.4830748589865529,local
U0202,P0598,privacy_sensitive,Draft an email discussing my salary at franchise lore wiki,0,0.23625680387922487,local
U0212,P0327,creative_writing,Draft a two-paragraph product blurb for migration guide,0,0.6420456102046387,cloud
U0312,P0359,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.7505331726336765,cloud
U0142,P0458,latency_sensitive,Give an instant short answer: memory-mapped I/O?,0,0.3300276640772627,local
U0047,P0572,privacy_sensitive,Redact PII from this legal document about clinical trial protocol,0,0.27397180087532175,local
U0286,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.336372963598504,local
U0361,P0095,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.8113145381255332,cloud
U0365,P0515,latency_sensitive,Rephrase this snippet while I type: a sleepy cat,1,0.35208742446593255,local
U0301,P0070,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical deadlock avoidance decomposition,1,0.6687484825052553,cloud
U0203,P0522,latency_sensitive,Autocomplete this sentence in real time: quantum error correction,1,0.3659589835724377,local
U0232,P0067,complex_reasoning,Find the flaw in this 40-step proof about memory-mapped I/O and repair it,1,0.7323952171431594,cloud
U0378,P0099,long_context,Summarize the key arguments across all 200 pages of clinical trial protocol,1,0.7669211400366962,cloud
U0078,P0118,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.8545966686002602,cloud
U0184,P0343,creative_writing,Draft a two-paragraph product blurb for product spec,0,0.5615426318002408,cloud
U0277,P0395,simple_qa,What is the capital of migration guide?,0,0.4509096752788121,local
U0071,P0140,long_context,Track every character and plot thread across the clinical trial protocol saga,0,0.641935178341166,cloud
U0250,P0138,long_context,Answer strictly from the full 2-hour meeting transcript on franchise lore wiki,1,0.6398894742743809,cloud
U0250,P0163,image_generation,Generate a photorealistic image of a chess endgame at golden hour,1,0.707262689823664,cloud
U0227,P0406,simple_qa,Convert 150 miles to kilometers,1,0.4660769461841239,local
U0331,P0579,privacy_sensitive,Summarize my medical records regarding tokenization,0,0.15935210254777724,local
U0008,P0480,latency_sensitive,Give an instant short answer: tokenization?,1,0.37795106595168615,local
U0306,P0328,creative_writing,Compose a short story opening about a chess endgame,0,0.49026835386689144,local
U0265,P0239,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.5719561895054907,cloud
U0000,P0436,simple_qa,What is the capital of migration guide?,1,0.20886184863777119,local
U0284,P0058,complex_reasoning,Prove or refute: every a chess endgame admits a canonical backpropagation decomposition,1,0.4921833519530814,local
U0228,P0553,privacy_sensitive,Draft an email discussing my salary at migration guide,0,0.35607548631406477,local
U0168,P0285,code_generation,Generate unit tests and API docs for the garbage collection library,0,0.7717320749484565,cloud
U0267,P0228,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.39054647019073063,local
U0357,P0202,image_generation,Create a 4k illustration of a thunderstorm with dramatic rim lighting,1,0.46725193453815367,local
U0172,P0578,privacy_sensitive,Draft an email discussing my salary at Q4 earnings report,0,0.30255594672390634,local
U0145,P0397,simple_qa,Explain tokenization in one sentence,0,0.4143805459277002,local
U0081,P0551,privacy_sensitive,Draft an email discussing my salary at product spec,1,0.21517220816686125,local
U0376,P0237,code_generation,Generate unit tests and API docs for the topological sorting library,0,0.294605138521025,local
U0215,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.7556582898214517,cloud
U0178,P0261,code_generation,Generate unit tests and API docs for the Bayesian inference library,0,0.43560812355293704,local
U0236,P0297,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,1,0.71412345554251,cloud
U0342,P0464,latency_sensitive,Give an instant short answer: backpropagation?,0,0.27057615091724213,local
U0340,P0293,code_generation,Refactor this legacy module into modern C++20: migration guide,1,0.603670215074346,cloud
U0102,P0387,simple_qa,Convert 150 miles to kilometers,0,0.35770771969699416,local
U0124,P0595,privacy_sensitive,Summarize my medical records regarding garbage collection,1,0.5120841751302236,cloud
U0153,P0098,long_context,Track every character and plot thread across the product spec saga,1,0.6196257657785931,cloud
U0293,P0196,image_generation,Create a 4k illustration of a rusting cargo ship with dramatic rim lighting,1,0.7701691375078931,cloud
U0094,P0068,complex_reasoning,Prove or refute: every a thunderstorm admits a canonical memory-mapped I/O decomposition,1,0.8107335251525362,cloud
U0170,P0024,complex_reasoning,Prove or refute: every a rusting cargo ship admits a canonical deadlock avoidance decomposition,0,0.7385937292816215,cloud
U0316,P0118,long_context,Track every character and plot thread across the board meeting minutes saga,1,0.6570494021274375,cloud
U0379,P0582,privacy_sensitive,Summarize my medical records regarding topological sorting,0,0.31585006804059085,local
U0309,P0278,code_generation,Write a production-ready implementation of Bayesian inference in Python,1,0.30054501541239076,local
U0194,P0090,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,0,0.5817841071015868,cloud
U0259,P0301,creative_writing,Draft a two-paragraph product blurb for board meeting minutes,0,0.7986679834965134,cloud
U0223,P0530,privacy_sensitive,Redact PII from this legal document about franchise lore wiki,0,0.21226835209632372,local
U0036,P0139,long_context,Answer strictly from the full 2-hour meeting transcript on product spec,1,0.3553234841434297,local
U0106,P0390,simple_qa,What is the capital of product spec?,1,0.5824770601427736,cloud
U0366,P0069,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.8430079811615755,cloud
U0397,P0089,long_context,Summarize the key arguments across all 200 pages of board meeting minutes,0,0.5337081117873532,cloud
U0268,P0308,creative_writing,Compose a short story opening about a chess endgame,0,0.2503495363774702,local
U0292,P0552,privacy_sensitive,Summarize my medical records regarding deadlock avoidance,0,0.4881116658960393,local
U0379,P0162,image_generation,"Produce a logo mockup for franchise lore wiki, transparent background",1,0.6255179822791602,cloud
U0216,P0479,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.3993565726568515,local
U0250,P0465,latency_sensitive,Rephrase this snippet while I type: sourdough bread,0,0.3101827067164017,local
U0285,P0132,long_context,Answer strictly from the full 2-hour meeting transcript on Q4 earnings report,0,0.48310463793224795,local
U0213,P0042,complex_reasoning,Find the flaw in this 40-step proof about topological sorting and repair it,1,0.6915176477344003,cloud
U0032,P0013,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,0,0.6035325533713929,cloud
U0029,P0101,long_context,Track every character and plot thread across the Q4 earnings report saga,1,0.7118680758171662,cloud
U0259,P0397,simple_qa,Explain tokenization in one sentence,1,0.7317962437899065,cloud
U0113,P0523,latency_sensitive,Rephrase this snippet while I type: a flamenco guitarist,1,0.3705048194672485,local
U0386,P0438,simple_qa,Convert 150 miles to kilometers,0,0.2822589740486807,local
U0217,P0397,simple_qa,Explain tokenization in one sentence,0,0.22648175797578668,local
U0009,P0056,complex_reasoning,Derive the closed form for sourdough bread and verify each step,1,0.6155040379626157,cloud
U0036,P0257,code_generation,Refactor this legacy module into modern C++20: clinical trial protocol,0,0.31384395384707575,local
U0004,P0316,creative_writing,Write a haiku about quantum error correction,0,0.44711827428182344,local
U0321,P0408,simple_qa,What is the capital of franchise lore wiki?,0,0.4156563588805824,local
U0139,P0022,complex_reasoning,Derive the closed form for a chess endgame and verify each step,1,0.697548527397034,cloud
U0362,P0195,image_generation,"Produce a logo mockup for Q4 earnings report, transparent background",1,0.7546921321617538,cloud
U0264,P0253,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6932703594755043,cloud
U0118,P0507,latency_sensitive,Give an instant short answer: backpropagation?,0,0.15029682152066537,local
U0074,P0435,simple_qa,Convert 150 miles to kilometers,0,0.737875480793207,cloud
U0186,P0570,privacy_sensitive,Redact PII from this legal document about board meeting minutes,0,0.35264612505049453,local
U0190,P0184,image_generation,"Produce a logo mockup for product spec, transparent background",1,0.6896828763052796,cloud
U0365,P0115,long_context,Answer strictly from the full 2-hour meeting transcript on migration guide,1,0.6119629510796006,cloud
U0389,P0394,simple_qa,Convert 150 miles to kilometers,0,0.39070522718881323,local
U0326,P0050,complex_reasoning,Find the flaw in this 40-step proof about backpropagation and repair it,1,0.5238540200720755,cloud
U0226,P0223,image_generation,Create a 4k illustration of a thunderstorm with dramatic rim lighting,1,0.5285969173929933,cloud
U0046,P0430,simple_qa,What is the capital of board meeting minutes?,1,0.42304456228188486,local
U0324,P0033,complex_reasoning,Prove or refute: every a sleepy cat admits a canonical tokenization decomposition,1,0.7752198575349444,cloud
U0034,P0265,code_generation,Generate unit tests and API docs for the Bayesian inference library,1,0.8249604419306465,cloud
U0132,P0347,creative_writing,Compose a short story opening about a thunderstorm,0,0.5208292374235348,cloud
U0087,P0054,complex_reasoning,Prove or refute: every quantum error correction admits a canonical backpropagation decomposition,1,0.7764916354305367,cloud
U0385,P0505,latency_sensitive,Autocomplete this sentence in real time: a rusting cargo ship,1,0.4945231305960096,local
U0112,P0585,privacy_sensitive,Draft an email discussing my salary at board meeting minutes,0,0.2119474922322785,local
U0113,P0097,long_context,Answer strictly from the full 2-hour meeting transcript on clinical trial protocol,1,0.5873361954071372,cloud
U0013,P0450,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,1,0.27709640698538235,local
U0173,P0231,code_generation,Write a production-ready implementation of backpropagation in Python,1,0.6379587836287877,cloud
U0299,P0352,creative_writing,Write a haiku about a flamenco guitarist,1,0.47842121452222125,local
U0318,P0029,complex_reasoning,Prove or refute: every quantum error correction admits a canonical Bayesian inference decomposition,1,0.8373792500280733,cloud
U0394,P0393,simple_qa,Explain Bayesian inference in one sentence,0,0.40136654398748156,local
U0260,P0506,latency_sensitive,Autocomplete this sentence in real time: a sleepy cat,0,0.2739489391925527,local