[ { "text": "---\ntitle: \"ECDP '24 Poster\"\nid: \"poster\"\ncategory: \"conference\"\ntags: [\"poster\", \"ner\", \"pathology\"]\nrelated: [\"devfest\", \"python\"]\ndate: \"2024-06-05\"\ndescription: \"Poster in 20th European Congress on Digital Pathology 2024\"\n---\n\nI'm excited to share that [our poster](https://lnkd.in/dJ2WKKRF) is in 20th European Congress on Digital Pathology 2024 | \nECDP2024! ✨\n\nFirst and foremost, I owe my heartfelt thanks to hashtag#MemorialPathology Memorial Healthcare Group and Dr. Serdar \nBalcı for involving me in this project and for all their invaluable support and assistance throughout this journey.", "source": "2024-06-05-ecdp_24_poster.md", "type": "markdown", "chunk_id": "2024-06-05-ecdp_24_poster.md_0", "embedding": [ -0.03604152426123619, 0.059543345123529434, 0.0005150044453330338, -0.05798415094614029, 0.0871465802192688, -0.07231532782316208, -0.026594234630465508, 0.025365078821778297, -0.048039134591817856, -0.04166267439723015, 0.036507636308670044, -0.021544979885220528, -0.004745099227875471, 0.04240136966109276, -0.09767354279756546, 0.015226056799292564, -0.06800424307584763, -0.017339587211608887, 0.00563303055241704, -0.01090178731828928, -0.1332966685295105, 0.08272594213485718, 0.09170348942279816, -0.013351033441722393, 0.0015645874664187431, -0.018058843910694122, -0.05752817541360855, -0.04412514716386795, -0.02887239120900631, -0.05922969803214073, 0.06956944614648819, 0.007427625358104706, -0.05142912641167641, -0.006959841586649418, 0.08849475532770157, 0.002790614031255245, -0.03807605430483818, -0.01816525310277939, -0.06303577125072479, 0.03433319181203842, 0.041002266108989716, -0.07116726785898209, -0.04910269007086754, 0.029973607510328293, -0.003977954853326082, -0.006059625651687384, -0.06955625861883163, -0.001968607772141695, 0.03353545442223549, 0.021263064816594124, 0.005321086384356022, -0.12731818854808807, 0.0036801628302782774, 0.06948431581258774, 0.018224701285362244, -0.025080891326069832, -0.051337830722332, -0.05029754713177681, -0.067842036485672, -0.07255038619041443, -0.01463754940778017, -0.021059762686491013, 0.018625836819410324, 0.035742539912462234, 0.02056153677403927, -0.004925991408526897, 0.03640930727124214, -0.00032302530598826706, -0.01431287918239832, 0.06099529191851616, -0.0014036610955372453, -0.01650749146938324, 0.05460672080516815, 0.11450877040624619, 0.056750841438770294, 0.028623754158616066, -0.033433325588703156, -0.09796544909477234, 0.0596899539232254, 0.0005254392162896693, 0.033791638910770416, 0.05540141835808754, 0.006405950989574194, 0.010146411135792732, -0.028140105307102203, -0.03155278414487839, 0.0077814748510718346, 0.04105813428759575, -0.09202007204294205, -0.014270615763962269, 0.008367499336600304, 0.03894887864589691, -0.010283250361680984, -0.005420552100986242, -0.08564738184213638, -0.014959990978240967, 0.03507369011640549, 0.025119824334979057, -0.04093648120760918, 0.08250980079174042, -0.07673033326864243, -0.0036101185251027346, -0.004263369366526604, -0.0322762168943882, -0.05096189305186272, -0.08293014764785767, -0.0348263680934906, 0.00579766696318984, 0.003975639119744301, 0.03317169100046158, 0.019425353035330772, -0.005752098746597767, 0.007520249113440514, -0.06176222115755081, 0.05665464326739311, 0.033653613179922104, -0.011973660439252853, 0.01904314011335373, 0.05862433835864067, -0.048914216458797455, -0.017229972407221794, -0.015224374830722809, -0.027015985921025276, -0.03531700000166893, 0.0368243046104908, 0.012291759252548218, -0.11149077862501144, 4.5347475361793405e-33, 0.05850188434123993, 0.016946742311120033, 0.08000978827476501, 0.061549119651317596, 0.009104355238378048, 0.006236904300749302, -0.07598107308149338, -0.034118250012397766, -0.051596395671367645, -0.06105272099375725, 0.018004421144723892, -0.0008765877573750913, 0.07380795478820801, 0.07273641228675842, -0.08875436335802078, -0.016383415088057518, 0.0017039756057783961, 0.06250807642936707, -0.09211653470993042, 0.019625727087259293, 0.007125543430447578, -0.01583310030400753, -0.026936694979667664, -0.009321085177361965, 0.024851297959685326, 0.02862956002354622, -0.10265201330184937, 0.02319229394197464, 0.12727440893650055, 0.056674543768167496, -0.08699750155210495, 0.025530129671096802, -0.014566605910658836, -0.002479843096807599, -0.07563085108995438, -0.0015701716765761375, -0.01837264932692051, -0.11947351694107056, -0.04077470302581787, -0.0052344948053359985, 0.049819476902484894, 0.03740357980132103, -0.014769773930311203, -0.025403160601854324, 0.0449228510260582, 0.03859619423747063, 0.045761749148368835, -0.00810766126960516, 0.04964284971356392, -0.014675220474600792, 0.004317872691899538, 0.009654674679040909, -0.016949063166975975, -0.055972617119550705, 0.0510827973484993, -0.05694681406021118, -0.08924455940723419, -0.03165857493877411, -0.0027376499492675066, -0.03655540198087692, 0.12447592616081238, 0.08100490272045135, -0.005106354597955942, -0.010919875465333462, 0.04548007249832153, -0.07278143614530563, -0.0336882509291172, 0.027964381501078606, -0.046592820435762405, 0.010840898379683495, -0.0402458980679512, 0.05881712585687637, -0.002966591389849782, -0.03226696699857712, -0.01319817267358303, 0.09105837345123291, 0.0001407384843332693, -0.034255873411893845, -0.05008234828710556, 0.0237105805426836, -0.07985680550336838, 0.01593421772122383, -0.06776393949985504, -0.032613858580589294, 0.0613115020096302, -0.014696531929075718, 0.02415846660733223, 0.06463984400033951, -0.11300188302993774, 0.0061351228505373, -0.01044456847012043, 0.061896130442619324, -0.06453736126422882, 0.011235611513257027, -0.09037414938211441, -7.293992405362204e-33, 0.023333251476287842, 0.014243858866393566, -0.030052730813622475, -0.023503350093960762, 0.05107961967587471, -0.07593203336000443, -0.028895217925310135, 0.11279049515724182, 0.11728149652481079, 0.02777685411274433, 0.06372352689504623, -0.00645810691639781, -0.07016459852457047, -0.025354014709591866, 0.006343449000269175, 0.00019537174375727773, -0.043052177876234055, 0.05812685936689377, -0.08106205612421036, -0.009805242531001568, -0.05350706726312637, 0.18142002820968628, -0.027470525354146957, 0.004838217981159687, -0.00844635907560587, 0.045643098652362823, 0.10776151716709137, 0.00986145157366991, -0.004212145693600178, -0.0526912547647953, -0.06991563737392426, 0.04280199855566025, -0.05306609347462654, 0.019072899594902992, 0.035612136125564575, 0.041583575308322906, 0.036778904497623444, -0.11270713806152344, -0.01610337570309639, -0.019954606890678406, 0.030287811532616615, 0.04112095385789871, -0.05100228264927864, 0.04983513429760933, 0.029310008510947227, -0.06157581880688667, 0.0007821406470611691, 0.04352758452296257, 0.10175972431898117, 0.004648106172680855, -0.05810977891087532, -0.030946500599384308, 0.01414729654788971, -0.03515110909938812, -0.018083006143569946, 0.009837456978857517, 0.002228532452136278, -0.002312912605702877, 0.0038761983159929514, 0.019871309399604797, -0.030832532793283463, -0.0035683130845427513, -0.05637000501155853, 0.031445588916540146, -0.0027196144219487906, -0.01091421116143465, -0.03360503166913986, 0.012467197142541409, -0.1033337339758873, 0.029693223536014557, 0.04376418888568878, 0.02584146521985531, -0.1264035850763321, -0.01785028912127018, -0.017297757789492607, -0.02417011931538582, 0.0433897003531456, 0.10275354236364365, -0.00250439066439867, 0.026061300188302994, -0.044577453285455704, -0.06325439363718033, 0.0302426815032959, 0.06325242668390274, 0.06669340282678604, -0.002806697506457567, -0.05845827981829643, -0.079429991543293, -0.04628752917051315, 0.002939256140962243, -0.011358687654137611, 0.0031370134092867374, 0.017156917601823807, 0.045357514172792435, -0.05086453631520271, -5.376368505949358e-08, 0.0688941702246666, -0.00947145838290453, -0.047125525772571564, -0.045330870896577835, 0.0645759180188179, -0.022295543923974037, -0.005414252169430256, 0.012822837568819523, -0.006968148052692413, 0.11708146333694458, -0.022302495315670967, 0.08967548608779907, -0.02101765386760235, -0.023741839453577995, 0.07900158315896988, -0.01841295324265957, -0.07618281245231628, 0.08679185062646866, -0.08146096020936966, -0.1184534877538681, -0.0006096186698414385, -0.05165790766477585, 0.026115721091628075, -0.0021305393893271685, -0.04204931482672691, 0.0051788343116641045, 0.08086210489273071, -0.007239172235131264, -0.07371113449335098, -0.06369376927614212, 0.01818385347723961, 0.03858025372028351, -0.06956760585308075, 0.019310185685753822, 0.016358105465769768, -0.015188956633210182, 0.016438618302345276, -0.061924804002046585, -0.0008274639840237796, 0.13422679901123047, 0.0283756572753191, -0.05771162733435631, 0.0013557197526097298, 0.02039533108472824, 0.03696460276842117, -0.04861748591065407, 0.05241883918642998, 0.006652344949543476, -0.028799593448638916, -0.08400166779756546, 0.047895725816488266, -0.0714222639799118, 0.02011808194220066, 0.06292945146560669, -0.019745349884033203, 0.03393486142158508, 0.04934447631239891, 0.028030402958393097, 0.035222865641117096, 0.0845976397395134, 0.1004972830414772, 0.027638671919703484, 0.0933532565832138, 0.02602631226181984 ] }, { "text": "Our study highlights the importance of extracting information from pathology reports using Named Entity Recognition \n(NER). We conducted extensive tests utilizing various models (BERT Models and GPT) to ensure robust results.\n\nYou can try our GPTs: \"PathText\" [here](https://lnkd.in/dzyC6PJm). ✨ And you may find a [video](https://www.linkedin.com/posts/activity-7204810402281512960-_w5D?utm_source=share&utm_medium=member_desktop) \nabout that. It is currently in the beta testing phase, and we aim to develop it into a more comprehensive product.", "source": "2024-06-05-ecdp_24_poster.md", "type": "markdown", "chunk_id": "2024-06-05-ecdp_24_poster.md_1", "embedding": [ -0.06434664875268936, -0.020566334947943687, -0.01562163420021534, -0.007162022404372692, 0.03538023680448532, -0.009869552217423916, 0.002967807464301586, 0.05057369917631149, 0.01671852171421051, -0.02312457375228405, -0.032247550785541534, 0.0366695374250412, 0.01434537023305893, 0.12588419020175934, -0.06667207181453705, 0.035355862230062485, 0.023430755361914635, 0.03489501029253006, 0.016813747584819794, -0.0753081738948822, -0.014725088141858578, 0.14183799922466278, 0.07238082587718964, -0.060536693781614304, -0.0006435925024561584, -0.06068412587046623, -0.07152988016605377, -0.07370226085186005, 0.0029554313514381647, 0.014641227200627327, 0.0426817424595356, -0.007230932824313641, 0.019701389595866203, 0.11396298557519913, 0.026316793635487556, -0.005433303769677877, -0.012023941613733768, 0.050625696778297424, -0.05587027966976166, 0.036409080028533936, 0.009974393993616104, -0.10074412077665329, 0.012114819139242172, 0.021446257829666138, 0.09407065808773041, -0.0580022856593132, -0.11755100637674332, -0.003188139759004116, 0.021039167419075966, 0.02528848685324192, -0.11880297213792801, -0.06859752535820007, -0.00041320506716147065, 0.06236095353960991, -0.0491991750895977, 0.011087365448474884, 0.016122974455356598, -0.07852329313755035, -0.14320626854896545, -0.008969646878540516, -0.027498776093125343, -0.07770323008298874, -0.0175213310867548, 0.012458723969757557, 0.06062943860888481, 0.05382797494530678, 0.013522866182029247, 0.013240063562989235, 0.004826467018574476, 0.011435317806899548, -0.04010118544101715, 0.04817463830113411, -0.0220959335565567, 0.04044868052005768, -0.040895868092775345, 0.038261063396930695, -0.025885771960020065, 0.05103709176182747, 0.013661538250744343, -0.06260408461093903, 0.0018394958460703492, 0.08338490128517151, 0.12299775332212448, 0.06042031571269035, 0.03981626033782959, 0.040982477366924286, 0.06493533402681351, 0.012238559313118458, -0.1258646696805954, 0.019771616905927658, 0.015026864595711231, -0.07667301595211029, 0.10818925499916077, -0.04335033521056175, -0.005232071969658136, 0.026012087240815163, -0.02721051499247551, -0.08250541239976883, 0.07414913922548294, 0.015332486480474472, -0.11692476272583008, 0.03597145900130272, 0.014190924353897572, -0.047552842646837234, -0.08501527458429337, 0.005425290670245886, 0.013360642828047276, -0.0662575215101242, 0.06299422681331635, 0.024360373616218567, 0.027202989906072617, 0.054428327828645706, -0.03854212537407875, -0.08962266147136688, 0.05695795267820358, -0.10296053439378738, -0.04642375931143761, 0.0028516901656985283, 0.028075428679585457, 0.039390407502651215, -0.04810287430882454, -0.005744400899857283, -0.025792278349399567, 0.012620051391422749, 0.036953020840883255, 0.09011231362819672, -0.029847033321857452, 9.64911150028198e-34, 0.050882961601018906, 0.07718107104301453, 0.09361980855464935, 0.004316695500165224, -0.01183322723954916, 0.04543815553188324, -0.08660411834716797, 0.0005665935459546745, -0.009831798262894154, -0.03241180628538132, -0.018129093572497368, 0.005028869956731796, 0.01749997027218342, -0.024608923122286797, -0.01139177568256855, 0.06160132959485054, -0.0446629635989666, 0.12480897456407547, -0.04328763857483864, 0.06152619048953056, -0.011943405494093895, -0.03448709845542908, -0.011424177326261997, -0.061897967010736465, 0.015146520920097828, -0.029923424124717712, -0.05397804453969002, -0.0233527310192585, 0.011287795379757881, -0.010681278072297573, -0.10178817808628082, -0.028928160667419434, 0.03447670862078667, 0.0648781806230545, 0.023032134398818016, 0.021058635786175728, 0.02404741942882538, -0.02966085448861122, 0.02264602854847908, 0.01916448399424553, 0.02496233955025673, -0.0065167490392923355, 0.02383090928196907, -0.013605593703687191, -0.018171165138483047, 0.01645018346607685, -0.03168036416172981, -0.031495582312345505, -0.013740970753133297, -0.009027383290231228, 0.03807980567216873, 0.04764457792043686, -0.041167233139276505, -0.029837895184755325, 0.014105742797255516, 0.022957835346460342, -0.004296393599361181, -0.0289731714874506, -0.00204281322658062, 0.004542612936347723, 0.10610169917345047, 0.02536235749721527, 0.012074138969182968, -0.020219720900058746, -0.015640966594219208, -0.05215219408273697, -0.033047426491975784, -0.06555075198411942, 0.010475123301148415, 0.031938984990119934, -0.02336369827389717, 0.06397167593240738, 0.010927231051027775, -0.024452542886137962, 0.06685473769903183, 0.006345120258629322, 0.003959408029913902, -0.09591563791036606, -0.049339137971401215, 0.04990561679005623, -0.0016638818196952343, -0.06481955200433731, -0.0027113095857203007, -0.03366105630993843, -0.010718053206801414, 0.007998531684279442, 0.012248250655829906, -0.07472042739391327, -0.07727862149477005, -0.04695515334606171, 0.034200288355350494, 0.05625145137310028, -0.09807617217302322, 0.09800703823566437, 0.014887223951518536, -2.189804916259823e-33, 0.020719844847917557, 0.024755842983722687, 0.06786440312862396, -0.03727639839053154, -0.03173188865184784, -0.0787041187286377, -0.019354254007339478, 0.02909175120294094, 0.05334370210766792, 0.046977173537015915, 0.07155506312847137, -0.02292870543897152, -0.04274936765432358, -0.09466052055358887, -0.00032034749165177345, -0.030479485169053078, -0.023747170343995094, 0.030997633934020996, -0.003201860236003995, 0.05420691892504692, -0.00022856272698845714, 0.0894370749592781, -0.1381823569536209, -0.0010333792306482792, -0.026058735325932503, 0.08306118845939636, 0.0728117972612381, 0.029458070173859596, -0.02006809413433075, -0.047544214874506, -0.018747204914689064, 0.08641367405653, -0.07683604955673218, -0.06227049231529236, -0.013168422505259514, -0.016050033271312714, -0.004192541819065809, -0.08369441330432892, 0.045326340943574905, -0.05078898370265961, 0.06059323251247406, 0.0779586061835289, -0.09382645785808563, -0.016239531338214874, 0.00973589438945055, -0.01756027713418007, -0.046641889959573746, 0.08160272240638733, 0.09293611347675323, 0.011964861303567886, 0.022072171792387962, -0.03569789230823517, -0.0752204954624176, -0.0023451903834939003, -0.02504417859017849, -0.024703599512577057, -0.03927235305309296, -0.08594919741153717, -0.07832149416208267, 0.028001051396131516, -0.07573018968105316, 0.09412343800067902, -0.03171141818165779, 0.11308137327432632, 0.046632591634988785, -0.034091148525476456, 0.027844524011015892, 0.036683280020952225, -0.055992722511291504, -0.026693224906921387, -0.03561820089817047, -0.012233702465891838, -0.004159125965088606, 0.02939077466726303, 0.022399988025426865, 0.0034596684854477644, -0.022069254890084267, -0.07864394783973694, -0.08416669815778732, 0.04055420681834221, 0.0006451848312281072, -0.083252914249897, 0.04280616715550423, 0.07751407474279404, 0.04761749505996704, 0.04845314472913742, 0.018708204850554466, 0.006494944915175438, 0.004226265009492636, 0.009175421670079231, 0.014659101143479347, 0.009034981019794941, -0.06588861346244812, 0.017666243016719818, -0.05284082889556885, -5.417745185809508e-08, 0.02618219144642353, -0.039116330444812775, -0.02531980536878109, -0.03364285081624985, 0.0026548844762146473, -0.06616824865341187, -0.06288320571184158, 0.1216873824596405, 0.007828897796571255, 0.09369325637817383, -0.05785699561238289, 0.008206482045352459, -0.14746703207492828, -0.0065115368925035, 0.10023019462823868, 0.03963036462664604, 0.016370117664337158, 0.05221346765756607, -0.020834214985370636, -0.05071552097797394, -0.002106581348925829, -0.009098435752093792, 0.06330360472202301, 0.017667753621935844, 0.01782393269240856, -0.05000702664256096, 0.0373324453830719, 0.06125820055603981, 0.015016508288681507, -0.00554274395108223, 0.001907991711050272, 0.058541882783174515, -0.04712881147861481, 0.04745098575949669, 0.04509001597762108, 0.0466541163623333, 0.07677890360355377, -0.03507668897509575, 0.0021930651273578405, 0.0664304569363594, 0.05834406986832619, 0.010342039167881012, -0.04136698693037033, 0.01859886944293976, -0.021698692813515663, -0.032103992998600006, -0.0019576039630919695, -0.04440062493085861, 0.017521880567073822, -0.08841285109519958, 0.014148303307592869, -0.018788814544677734, -0.039910174906253815, 0.06473492085933685, -0.06955430656671524, 0.046212080866098404, 0.06095827370882034, 0.019871922209858894, -0.020126884803175926, 0.01736837811768055, 0.04625488072633743, 0.009722552262246609, 0.08133906871080399, 0.027299899607896805 ] }, { "text": "---\ntitle: \"Optimization Algorithms in Neural Networks\"\nid: \"optimization\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"backpropagation\", \"cs231n\"]\nrelated: [\"dl\"]\ndate: \"2020-10-14\"\ndescription: \"Optimization Algorithms in Neural Network will be explained\"\n---\n\nIn this post, Optimization Algorithms in Neural Network will be explained. Thanks to Stanford University, the lecture \nvideos of cs231n can be found in YouTube and all materials are freely available (see the references). \n\n# First Order Optimization Algorithms\n\n- SGD\n- SGD with Momentum\n- SGD with Nesterov Momentum\n- AdaGrad\n- RMSProp\n- Adam", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_0", "embedding": [ -0.1287633776664734, -0.06567893177270889, 0.014150084927678108, -0.036419544368982315, -0.011976876296103, -0.0016299167182296515, -0.023562699556350708, -0.016639908775687218, -0.09849874675273895, -0.08136378228664398, -0.04133744165301323, 0.06747813522815704, -0.00614369148388505, -0.06687343120574951, -0.06252157688140869, 0.022031284868717194, 0.0543435662984848, 0.1041250228881836, -0.05196438729763031, -0.0500655472278595, 0.03200738504528999, 0.026019182056188583, -0.013642294332385063, -0.058672092854976654, 0.06793991476297379, 0.049624934792518616, -0.024284088984131813, -0.04043656215071678, 0.04233003780245781, -0.003203638829290867, 0.10339168459177017, -0.0797913670539856, 0.04823068156838417, 0.08778968453407288, -0.06702153384685516, 0.05361037701368332, -0.041215747594833374, -0.012067603878676891, 0.017230894416570663, 0.01789698749780655, -0.026983829215168953, 0.021249407902359962, -0.016963468864560127, -0.07800225168466568, 0.11253146827220917, -0.023691656067967415, -0.04363136366009712, -0.02085251919925213, -0.03445795178413391, -0.01759529486298561, -0.059591375291347504, -0.06605590134859085, -0.023970510810613632, 0.028345735743641853, 0.03365077078342438, 0.006366662215441465, -0.03025612235069275, 0.011718502268195152, 0.028573643416166306, -0.011519779451191425, 0.11543368548154831, -0.13425351679325104, 0.0048197191208601, -0.038142163306474686, 0.0512353740632534, 0.005799867678433657, 0.03836663067340851, 0.007565794046968222, 0.054054319858551025, 0.018858375027775764, 0.01898398995399475, 0.09098348021507263, -0.056500524282455444, -0.005259650759398937, 0.013167607598006725, 0.029809575527906418, 0.13894076645374298, -0.024279717355966568, 0.018275121226906776, -0.08470669388771057, 0.050180237740278244, 0.03537771478295326, -0.007645855192095041, 0.005804380867630243, 0.054464519023895264, -0.011215785518288612, 4.54969413112849e-05, 0.0319049097597599, -0.03187716379761696, 0.007676802109926939, -0.026425017043948174, -0.03909654542803764, -0.093857541680336, -0.008694540709257126, 0.004296861123293638, -0.024060051888227463, -0.06115122511982918, -0.11346369981765747, -0.04743257910013199, 0.031495630741119385, -0.00855719018727541, 0.008181351236999035, 0.08334912359714508, -0.021919991821050644, -0.02286914363503456, -0.011889874935150146, 0.0025192422326654196, 0.01121804490685463, 0.05225790664553642, -0.029854539781808853, 0.012303957715630531, 0.0437127910554409, -0.0037642966490238905, -0.06392491608858109, -0.006459598895162344, 0.02286479063332081, -0.02309187687933445, 0.018487872555851936, 0.07771438360214233, 0.05015384405851364, -0.10085876286029816, -0.02031964436173439, -0.10427325963973999, -0.030881160870194435, 0.004782864358276129, -0.0011595272226259112, -0.10182327777147293, 3.50601953252897e-33, -0.07440285384654999, 0.003060041693970561, 0.009968138299882412, -0.05793651565909386, 0.04417475685477257, -0.013545479625463486, 0.030153868719935417, -0.019088631495833397, -0.03309441730380058, 0.006058729253709316, -0.02990417554974556, -0.07479067891836166, -0.06448642164468765, 0.07651405036449432, -0.006924814078956842, -0.12051653861999512, -0.0042713540606200695, -0.0548107773065567, 0.06617369502782822, -0.09044469892978668, 0.040296245366334915, 0.009146364405751228, -0.011925019323825836, -0.009766032919287682, 0.0008454017224721611, -0.022511746734380722, 0.09194592386484146, 0.0020887525752186775, 0.0078034782782197, 0.024354899302124977, -0.06101560220122337, 0.007964543998241425, -0.04038390889763832, 0.009651873260736465, 0.0783764198422432, 0.04945807531476021, 0.024094637483358383, -0.019301142543554306, 0.04646088182926178, -0.012501994147896767, -0.02145593799650669, 0.03677152469754219, -0.01990089751780033, -0.04573901370167732, -0.09009639173746109, -0.11084461957216263, -0.006536636035889387, 0.03322814032435417, 0.15016108751296997, -0.054793696850538254, -0.04602750018239021, 0.01934930682182312, -0.02927032858133316, -0.04462851583957672, 0.010900174267590046, 0.0021961615420877934, 0.02106674388051033, 0.0536310076713562, -0.05794690549373627, 0.03874152526259422, 0.09668624401092529, -0.08406409621238708, 0.01975293830037117, -0.0532894991338253, -0.034715596586465836, -0.016962524503469467, 0.0118613475933671, 0.04983771592378616, 0.024836614727973938, -0.029066000133752823, -0.07152564823627472, 0.046729568392038345, 0.04959828406572342, -0.03997160121798515, 0.05059494078159332, 0.05965520814061165, 0.01658044382929802, 0.011379915289580822, 0.011979833245277405, 0.03879733011126518, -0.12375322729349136, 0.14492030441761017, -0.048559099435806274, 0.013130738399922848, -0.06070532277226448, 0.014537336304783821, -0.03231661766767502, -0.060552243143320084, 0.01331774890422821, -0.008997372351586819, -0.07484154403209686, 0.025998638942837715, 0.04517726972699165, 0.08349723368883133, -0.049766506999731064, -4.400492122320019e-33, -0.059827838093042374, 0.060121938586235046, -0.018330877646803856, 0.043482426553964615, 0.011136071756482124, 0.01629001833498478, -0.0855274647474289, -0.021887723356485367, -0.08681508898735046, -0.029848217964172363, 0.04232778772711754, -0.007916250266134739, 0.0003955744032282382, -0.04502011463046074, 0.031005367636680603, -0.013744519092142582, -0.022214410826563835, -0.014218580909073353, 0.01938912458717823, 0.0063642216846346855, 0.0792231336236, 0.09855480492115021, -0.030665578320622444, 0.06695546209812164, 0.020372996106743813, -0.07596104592084885, 0.05758776143193245, 0.05473797023296356, 0.05805712565779686, -0.001883199205622077, -0.02514919452369213, 0.06984034925699234, -0.09009449183940887, 0.08335437625646591, -0.05896184965968132, 0.04782142862677574, 0.008053104393184185, -0.02173009142279625, 0.04230496287345886, 0.028558854013681412, 0.0436655730009079, 0.05115603655576706, 0.051409073173999786, -0.00770861841738224, 0.03476861119270325, 0.027253687381744385, 0.021794073283672333, -0.049761660397052765, -0.0466109998524189, 0.029930273070931435, 0.05788956955075264, -0.015056776814162731, -0.04858211427927017, -0.017171379178762436, -0.0006966045475564897, 0.0012572224950417876, 0.030207401141524315, 0.01742045022547245, 0.0893646627664566, 0.019197117537260056, -0.0852886214852333, -0.0456145778298378, -0.031959302723407745, 0.008364473469555378, -0.08256025612354279, 0.021433694288134575, -0.047019172459840775, 0.039154164493083954, 0.043298833072185516, 0.0016653453931212425, 0.002870831871405244, 0.0572134293615818, 0.053241945803165436, 0.10152079910039902, -0.10088957101106644, -0.07008999586105347, 0.02805526927113533, 0.02130916900932789, 0.022012576460838318, -0.09028341621160507, 0.09706608206033707, 0.04654721915721893, -0.04788082838058472, 0.08706889301538467, 0.07179410010576248, 0.09602105617523193, 0.06415066123008728, 0.058929648250341415, -0.0010633039055392146, 0.003700018161907792, -0.0814812108874321, -0.02535279467701912, 0.049779877066612244, -0.01664523221552372, -0.08591966331005096, -4.752924809281467e-08, -0.039059292525053024, -0.035836733877658844, 0.03962356224656105, -0.007434575352817774, 0.048194948583841324, -0.040440283715724945, 0.04834682121872902, 0.05712234601378441, -0.019424980506300926, -0.03656340390443802, 0.018275350332260132, 0.04865051805973053, -0.03713272511959076, -0.059449076652526855, -0.03214524686336517, 0.0566546767950058, -0.023667484521865845, 0.013807336799800396, 0.037023454904556274, -0.05307862162590027, 0.008847860619425774, 0.054969705641269684, 0.010709179565310478, 0.018345938995480537, 0.12605465948581696, -0.08929724246263504, 0.015994412824511528, 0.04807789623737335, 0.0614309199154377, 0.0159437395632267, -0.056809451431035995, 0.028127377852797508, 0.01784961298108101, -0.07141207158565521, 0.056217923760414124, 0.09883107244968414, 0.013773676939308643, 0.031240418553352356, -0.00536586856469512, 0.0009980526519939303, 0.015862369909882545, 0.05268082395195961, -0.005057765170931816, -0.06012642756104469, -0.06371662765741348, 0.029512649402022362, -0.01332041434943676, 0.0008823130046948791, -0.03823290392756462, 0.015628132969141006, 0.07293270528316498, -0.0031873080879449844, -0.026909105479717255, 0.026373328641057014, -0.016583384945988655, 0.04716649651527405, -0.006318387109786272, -0.07554320991039276, 0.04300490766763687, 0.07721897214651108, 0.015266843140125275, 0.05630125477910042, -0.05805593356490135, 0.020555343478918076 ] }, { "text": "## SGD\n\n w = w - learningrate * gradient\n \n- Vanilla update. \n- The simplest form of update is to change the parameters along the negative gradient direction \n- Since the gradient indicates the direction of increase, but we usually wish to minimize a loss function\n \n## SGD with Momentum\n\n velocity = 0\n velocity = momentum * velocity - learningrate * gradient\n w = w + velocity\n\n- With Momentum update, the parameter vector will build up velocity in any direction that has consistent gradient.\n\n
\n \n
Figure 1: SGD vs SGD with Momentum
\n
", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_1", "embedding": [ -0.03640493378043175, -0.01875689998269081, 0.01654033735394478, 0.040048614144325256, 0.033982545137405396, 0.0021748857107013464, -0.06036851927638054, -0.032064829021692276, 0.02356990985572338, 0.02437073364853859, 0.072635218501091, 0.06276927143335342, 0.009528226219117641, -0.018737632781267166, 0.024372311308979988, 0.05786660313606262, -0.0150597607716918, 0.12440042197704315, -0.07126744091510773, -0.010299598798155785, -0.05028773471713066, -0.08403562754392624, 0.08599557727575302, 0.007218786049634218, 0.025894969701766968, 0.024068333208560944, 0.0016944712260738015, 0.043847888708114624, 0.04064580798149109, -0.07877206057310104, 0.07188088446855545, -0.07539327442646027, -0.06246655434370041, -0.0022492175921797752, -0.044632695615291595, 0.0600915402173996, -0.007787426933646202, 0.05493393540382385, -0.015308194793760777, 0.04325717315077782, -0.028070921078324318, -0.032592933624982834, -0.03020290657877922, -0.01942167431116104, 0.02984805218875408, 0.08187145739793777, -0.040711790323257446, 0.029640967026352882, -0.006243662443011999, -0.03486493602395058, -0.050574664026498795, -0.14978623390197754, -0.07357064634561539, -0.021042972803115845, -0.009683019481599331, 0.06192506104707718, 0.0839119553565979, -0.002089489484205842, 0.060108207166194916, -0.08514571189880371, 0.04413728043437004, -0.10691794753074646, 0.07359696924686432, -0.033593423664569855, 0.04225773364305496, -0.05344413220882416, -0.02798086404800415, -0.012472237460315228, 0.038740769028663635, 0.06779525429010391, 0.008724812418222427, 0.019551847130060196, 0.00898060668259859, -0.030061189085245132, -0.017629671841859818, -0.004130750894546509, 0.05502273514866829, 0.05318199098110199, 0.028455371037125587, -0.023493852466344833, 0.06751136481761932, -0.009503183886408806, 0.0011964984005317092, -0.0027714287862181664, 0.09696456044912338, 0.02842159941792488, -0.001803223742172122, -0.02787887491285801, 0.014825616963207722, -0.00489584868773818, -0.08617501705884933, -0.00924193486571312, -0.08631046861410141, 0.007459579035639763, -0.026924578472971916, 0.01561779621988535, -0.038951899856328964, -0.08757054060697556, -0.09947725385427475, 0.05410434305667877, 0.009076902642846107, -0.06522344052791595, 0.01872585341334343, 0.06391049921512604, 0.031547944992780685, 0.0032280609011650085, -0.0037733877543359995, 0.09970135986804962, 0.029237238690257072, 0.015721727162599564, 0.010337243787944317, 0.08740108460187912, -0.08582089841365814, -0.011112715117633343, -0.07542376965284348, 0.05731974542140961, 0.029490254819393158, -0.0002698329626582563, -0.04640619829297066, 0.013162041082978249, 0.012306258082389832, 0.007694093976169825, -0.07830462604761124, 0.005370250903069973, -0.026431351900100708, -0.08654293417930603, -0.010814931243658066, 6.0421111255456225e-33, -0.0016066825482994318, -0.029974667355418205, -0.029662204906344414, -0.05173325538635254, 0.022403523325920105, 0.02602965012192726, -0.01581251621246338, -0.0441524013876915, -0.08036530762910843, -0.08611316233873367, -0.03052734024822712, -0.03856879100203514, -0.13772551715373993, 0.06734170764684677, 0.005483022425323725, -0.13363789021968842, -0.032781608402729034, 0.03423188999295235, 0.06416747719049454, -0.04671338573098183, -0.022494211792945862, -0.07663280516862869, -0.08833055198192596, -0.04421071708202362, -0.04946959763765335, 0.04952532798051834, 0.07098737359046936, 0.04244460165500641, -0.022256916388869286, 0.004002242814749479, 0.0342760793864727, -0.007024012506008148, -0.05028313398361206, -0.047806937247514725, 0.016980819404125214, 0.03532861918210983, -0.04822729900479317, -0.01429770328104496, 0.05387965217232704, -0.005995099898427725, -0.03447778522968292, 0.04133664816617966, -0.07510054856538773, 0.016407648101449013, -0.058398641645908356, -0.00949840061366558, 0.016139082610607147, 0.0648423582315445, 0.024174392223358154, -0.05155167356133461, -0.019782572984695435, -0.0017719012685120106, -0.07536957412958145, -0.006492285057902336, 0.015239057131111622, -1.5157200323301367e-05, 0.023409884423017502, 0.01518053188920021, -0.051834236830472946, -0.05629163235425949, 0.15813955664634705, 0.0018742384854704142, 0.014057332649827003, 0.0002738498733378947, -0.012289169244468212, 0.036974452435970306, -0.009867616929113865, 0.07085981965065002, -0.017765600234270096, -0.006567814387381077, -0.046503473073244095, 0.06136998161673546, 0.03642723709344864, -0.007558648474514484, 0.026352843269705772, 0.026613453403115273, 0.03486908599734306, 0.00825856439769268, 0.01785455457866192, 0.04490337148308754, -0.007152295671403408, 0.059073418378829956, -0.026438094675540924, -0.005039562936872244, -0.033257219940423965, 0.016447164118289948, -0.019791150465607643, -0.0736788958311081, -0.05221289396286011, -0.04056769609451294, -0.05027015507221222, 0.028726652264595032, -0.04967672750353813, 0.06282524019479752, -0.025536658242344856, -6.21623967512682e-33, -0.04079989343881607, 0.11849476397037506, -0.00433145510032773, 0.12035869807004929, -0.06132907420396805, 0.08424683660268784, 0.034696128219366074, -0.048818252980709076, -0.0517258457839489, -0.039719901978969574, -0.03312794119119644, -0.01980907842516899, -0.15220586955547333, -0.05249080806970596, -0.025097260251641273, 0.023483529686927795, 0.009538277052342892, -0.00752992695197463, -0.0502166748046875, 0.0024497015401721, -0.0046869260258972645, 0.11475387960672379, -0.03044293448328972, 0.0931326374411583, 0.023281054571270943, -0.008590741083025932, 0.05940070375800133, 0.10345112532377243, -0.04546331986784935, 0.005210374016314745, -0.011619745753705502, 0.05174458399415016, -0.00999690406024456, 0.02130315639078617, -0.04272393509745598, 0.0023948790039867163, -0.012061633169651031, -0.061153192073106766, 0.0047699143178761005, 0.06710847467184067, 0.04071693867444992, 0.022866910323500633, 0.03439617156982422, -0.05934804305434227, 0.024121614173054695, 0.011854766868054867, 0.06496868282556534, -0.009397699497640133, 0.04901966452598572, 0.027189156040549278, -0.004567142575979233, -0.03467714414000511, -0.05336889252066612, 0.06841839849948883, -0.018186431378126144, 0.0200355127453804, -0.0423055998980999, 0.016725067049264908, 0.09054762870073318, 0.02269250713288784, -0.04981570318341255, 0.02849947102367878, -0.02269366942346096, -0.013411988504230976, -0.0495121069252491, 0.013544108718633652, -0.004229276906698942, -0.0484444685280323, 0.038989633321762085, 0.02921542525291443, 0.055933427065610886, 0.09740635007619858, 0.10104971379041672, -0.003082545707002282, 0.055352162569761276, -0.07561475783586502, 0.021444467827677727, 0.06051018461585045, -0.03305891528725624, -0.0880516767501831, 0.035255055874586105, -0.0027407140005379915, 0.026374610140919685, 0.046050071716308594, -0.033452633768320084, 0.085346519947052, -0.07593128085136414, 0.07004362344741821, 0.059935301542282104, -0.03150535747408867, -0.0302526094019413, 0.02893233485519886, 0.06285928934812546, -0.08031759411096573, 0.003352119354531169, -4.802701170092405e-08, -0.07826223224401474, -0.027434691786766052, -0.010710412636399269, 0.007751198951154947, 0.011993742547929287, 0.032538820058107376, -0.0034322154242545366, 0.006777515169233084, -0.001443766406737268, -0.09169559925794601, 0.05255195498466492, 0.08154460787773132, -0.00826429482549429, -0.004700528923422098, -0.06621075421571732, 0.06741034239530563, -0.00843098759651184, 0.08717010170221329, 0.06578312069177628, -0.008336366154253483, 0.0009633686859160662, 0.006056365557014942, 0.06446453928947449, 0.019180839881300926, 0.018260039389133453, -0.07180262356996536, -0.013766039162874222, 0.08620807528495789, 0.06712964177131653, -0.08927223086357117, 0.04818815365433693, -0.04312223568558693, 0.03858528658747673, 0.010317609645426273, -0.029593324288725853, 0.06786898523569107, -0.10190095752477646, 0.06545325368642807, 0.003325329627841711, 0.10065636783838272, -0.05843942612409592, 0.013131117448210716, 0.0552220344543457, 0.0011152122169733047, -0.07746874541044235, 0.06855444610118866, -0.02008877694606781, -0.12837167084217072, -0.07899803668260574, -0.014284024946391582, 0.09064005315303802, -0.00289660575799644, -0.01221955381333828, 0.0747184157371521, 0.04853669926524162, -0.06539661437273026, 0.0358680821955204, -0.06476045399904251, -0.08565694093704224, -0.02125074341893196, 0.020037902519106865, -0.05411040782928467, -0.03850506618618965, 0.003022038144990802 ] }, { "text": "## SGD with Nesterov Momentum\n\n old_velocity = velocity\n velocity = momentum * velocity - learningrate * gradient\n w = w + (-momentum) * old_velocity + (1- (-momentum)) * velocity\n\n- https://arxiv.org/pdf/1212.0901v2.pdf : ADVANCES IN OPTIMIZING RECURRENT NETWORKS\n- http://www.cs.utoronto.ca/~ilya/pubs/ilya_sutskever_phd_thesis.pdf : RNN", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_2", "embedding": [ -0.06072520464658737, -0.05372241884469986, 0.04881221055984497, 0.0071623739786446095, 0.02237013727426529, 0.055235449224710464, -0.045831985771656036, -0.012248034588992596, -0.017513049766421318, -0.08249185979366302, 0.006158764008432627, 0.009276986122131348, -0.09986630082130432, 0.00888946931809187, -0.01530448254197836, 0.05755529925227165, -0.0019984529353678226, 0.1447678804397583, 0.010942497290670872, -0.06417597830295563, -0.0657901018857956, 0.03820401430130005, 0.05834303796291351, 0.004256546031683683, 0.05724893510341644, 0.014737130142748356, -0.035932376980781555, 0.02409854158759117, 0.08114268630743027, -0.02406785637140274, 0.14036376774311066, -0.008345868438482285, 0.027690572664141655, 0.06816612184047699, -0.03819181025028229, 0.08169345557689667, -0.10855114459991455, -0.014583799988031387, -0.033136431127786636, 0.028649108484387398, 0.029512351378798485, 0.0361299030482769, 0.00018498851568438113, -0.01579327881336212, 0.10489735752344131, 0.02129642479121685, -0.04498378559947014, 0.016693703830242157, 0.024938395246863365, 0.010429196991026402, -0.06569041311740875, -0.08083834499120712, -0.004980531986802816, 0.02351604960858822, 0.0037744164001196623, 0.02412250079214573, -0.0037772993091493845, 0.03839145973324776, -0.009513339959084988, -0.11635182797908783, 0.05306190997362137, -0.10664251446723938, -0.017699692398309708, -0.06254967302083969, -0.07081083208322525, -0.0036094062961637974, 0.027907926589250565, 0.10001309961080551, 0.01170302927494049, 0.1316552758216858, 0.07370295375585556, 0.06008295714855194, -0.02819841355085373, 0.04124894365668297, 0.026282940059900284, -0.016580352559685707, 0.10204337537288666, -0.0698893815279007, 0.028389832004904747, -0.0723334550857544, 0.06215769052505493, -0.04501228779554367, -0.022903062403202057, -0.09590240567922592, 0.02853628247976303, -0.0033827279694378376, -0.011052520014345646, 0.041801001876592636, 0.0035943309776484966, -0.051772914826869965, -0.029443761333823204, -0.07556372880935669, 0.024902962148189545, -0.07284655421972275, 0.008004973642528057, 0.06837020814418793, -0.04530305415391922, -0.07354748994112015, -0.06337399780750275, 0.03727381303906441, -0.0017679405864328146, -0.013828492723405361, -0.03640028461813927, 0.06746065616607666, -0.023185236379504204, 0.04205765575170517, 0.05316115915775299, 0.06056886166334152, 0.02719866670668125, 0.054794374853372574, 0.012770487926900387, 0.06729362905025482, -0.007074207998812199, -0.041217364370822906, -0.02642897516489029, -0.03922627493739128, -0.05445900931954384, -0.011890539899468422, -0.012954728677868843, 0.09619337320327759, -0.0523284375667572, -0.0513029471039772, -0.12654754519462585, -0.0025669527240097523, -0.03140833228826523, -0.08183488249778748, 0.016568945720791817, 3.89321019845205e-34, -0.03898157924413681, 0.00425691157579422, 0.03580905869603157, -0.05787622556090355, 0.04218953847885132, 0.06854751706123352, 0.027471229434013367, -0.04422350972890854, -0.04790041595697403, -0.0906597301363945, -0.09729738533496857, -0.07454928010702133, -0.1195809468626976, 0.03631054610013962, -0.02247394621372223, -0.11227093636989594, -0.05732792988419533, -0.007183657959103584, 0.05540009215474129, -0.04444591701030731, 0.03194188326597214, -0.026523912325501442, -0.07263986021280289, -0.07565756887197495, -0.016363181173801422, -0.03224160522222519, 0.12902532517910004, -0.03243373706936836, -0.012907699681818485, 0.02801855280995369, -0.06954009085893631, 0.009423283860087395, -0.09774179756641388, 0.025233527645468712, 0.057281315326690674, 0.05059048533439636, 0.0437900684773922, -0.02939344197511673, 0.06832002103328705, -0.020223326981067657, -0.009296935983002186, 0.030389951542019844, -0.05986102297902107, 0.03215678408741951, -0.10389389842748642, -0.08535756915807724, 0.06637109071016312, 0.05041735619306564, 0.010616213083267212, -0.04915967211127281, -0.01678701676428318, -0.03188618645071983, -0.08091064542531967, -0.028765449300408363, -0.014915505424141884, -0.03301002085208893, 0.0404423289000988, 0.08353759348392487, -0.0181435514241457, 0.027958940714597702, 0.128498375415802, 0.003389561315998435, 0.07901345938444138, -0.023126406595110893, 0.033427394926548004, 0.02082706242799759, -0.09352630376815796, 0.032534074038267136, 0.05758943408727646, -0.023405035957694054, 0.016242126002907753, 0.029322559013962746, 0.010161022655665874, -0.06022176891565323, 0.06618327647447586, 0.034092240035533905, 0.09660501778125763, -0.038162510842084885, 0.015247540548443794, 0.047066107392311096, -0.01848190277814865, 0.02545744739472866, -0.014340931549668312, 0.02674599178135395, -0.007428162265568972, -0.024162346497178078, 0.06851069629192352, -0.09323988109827042, -0.026985792443156242, -0.014747224748134613, -0.014949936419725418, -0.01817280240356922, 0.05477626994252205, 0.0620247907936573, -0.040670428425073624, -1.7508145305643242e-33, -0.025849688798189163, 0.0794137492775917, -0.006574005354195833, 0.07203489542007446, -0.017179833725094795, 0.004380007274448872, -0.055832285434007645, -0.025493530556559563, -0.08842013031244278, -0.04755721986293793, -0.004933835472911596, -0.06479445844888687, 0.01625099405646324, -0.04318726807832718, 0.053779616951942444, -0.000761109113227576, 0.07514363527297974, -0.057724934071302414, 0.029347965493798256, -0.0039107175543904305, 0.02476603537797928, 0.05093870684504509, -0.06669505685567856, 0.06204352527856827, 0.02219187654554844, -0.03990153595805168, 0.06849467009305954, 0.06177976727485657, -0.016076553612947464, -0.008227931335568428, -0.015451368875801563, 0.05804085358977318, -0.0018600225448608398, 0.03001216985285282, -0.0549604706466198, 0.06101064011454582, 0.039283256977796555, -0.04353795945644379, 0.01628965139389038, 0.0026591841597110033, 0.07273044437170029, 0.010970213450491428, 0.04491230472922325, -0.013699809089303017, 9.048036736203358e-05, 0.015024888329207897, 0.016227103769779205, 0.015695448964834213, 0.03508404269814491, 0.024584850296378136, 0.013316954486072063, -0.05276128277182579, -0.08596419543027878, -0.008836708031594753, -0.050336603075265884, 0.021778447553515434, 0.009480872191488743, -0.011750150471925735, 0.07187214493751526, -0.042669497430324554, -0.08764692395925522, -0.020057786256074905, -0.048188332468271255, 0.0026914284098893404, -0.008251347579061985, -0.031641729176044464, 0.019773384556174278, -0.02638735994696617, 0.04032665118575096, -0.05809734761714935, 0.01753402315080166, 0.10554637759923935, 0.007796300575137138, 0.05939331278204918, -0.06141219660639763, -0.05385025590658188, -0.0053805215284228325, 0.007177453488111496, -0.04582573100924492, -0.07725220918655396, 0.0013527559349313378, 0.026490524411201477, -0.0022729155607521534, 0.05195643752813339, 0.017236962914466858, 0.04535653069615364, 0.014744257554411888, 0.06101703643798828, 0.044968489557504654, -0.02082989178597927, -0.018302151933312416, -0.02352095954120159, 0.02138199843466282, -0.054679520428180695, -0.05056106671690941, -4.519596430441197e-08, -0.059820692986249924, -0.02342313900589943, 0.023822331801056862, 0.0198138989508152, 0.06714890152215958, -0.030944490805268288, -0.02278544008731842, 0.020734116435050964, 0.041324764490127563, -0.06035042554140091, 0.08204005658626556, -0.0008940480183809996, -0.051483698189258575, -0.020217183977365494, -0.008490918204188347, 0.07098084688186646, -0.03851258382201195, 0.0379757434129715, 0.012381739914417267, 0.01427282951772213, 0.07725612819194794, 0.07976721227169037, 0.007350989151746035, -0.012094990350306034, 0.009128107689321041, -0.020308254286646843, -0.0014393460005521774, 0.019483434036374092, 0.07139043509960175, -0.10773994028568268, -0.0023852086160331964, 0.03774229437112808, 0.0052722725085914135, 0.0018834149232134223, -0.0503438375890255, 0.0761919766664505, 0.014901005662977695, 0.10877939313650131, -0.030999422073364258, 0.026160595938563347, -0.010938611812889576, 0.06089336425065994, -0.0016810046508908272, -0.018173163756728172, -0.11075418442487717, 0.03335084766149521, -0.04095804691314697, -0.10566150397062302, -0.0016035764710977674, -0.06409629434347153, 0.10396656394004822, 0.021141961216926575, 0.007619612850248814, 0.0649615004658699, 0.07785611599683762, 0.033926915377378464, -0.021753843873739243, -0.07593351602554321, 0.010239819064736366, 0.01054377667605877, 0.0018813094357028604, 0.056218139827251434, -0.048168811947107315, 0.04269891604781151 ] }, { "text": "## AdaGrad\n\nRef: https://jmlr.org/papers/volume12/duchi11a/duchi11a.pdf (-)\nRef: https://arxiv.org/pdf/1212.5701.pdf *\n\n gradient_squared = 0 \n gradient_squared += gradient**2\n w += - learning_rate * gradient / (np.sqrt(gradient_squared) + eps)\n\n**Pros:** *\n\nWhile there is the hand tuned global learning rate, each dimension has its own dynamic rate. \n\nSince this dynamic rate grows with the inverse of the gradient magnitudes:\n - large gradients have smaller learning rates\n - small gradients have large learning rates. \n\nThis is very beneficial for training deep neural networks since the scale of the gradients in each layer is often \ndifferent by several orders of magnitude, so the optimal learning rate should take that into account.", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_3", "embedding": [ -0.0470171757042408, -0.10511717200279236, 0.03211367130279541, 0.04611613228917122, 0.03054046258330345, -0.04060745611786842, -0.09597320109605789, 0.0195304024964571, 0.042987704277038574, -0.02409292757511139, -0.003779155667871237, 0.09751547873020172, -0.03418925777077675, 0.03929927572607994, -0.06943283975124359, 0.021768653765320778, 0.049144405871629715, 0.046618446707725525, -0.08699214458465576, -0.03440682962536812, -0.009695706889033318, -0.04857231676578522, 0.06722505390644073, -0.021333785727620125, 0.04214214161038399, -0.07356414198875427, -0.0022462878841906786, 0.003204493084922433, 0.04780935123562813, 0.03295736759901047, 0.0576314702630043, 0.022534271702170372, 0.026478799059987068, 0.020724046975374222, -0.1336415559053421, 0.05556005239486694, -0.03967776149511337, 0.014313342981040478, 0.010415654629468918, 0.05506276711821556, 0.040430691093206406, 0.06848138570785522, 0.016917988657951355, -0.013547404669225216, 0.044881630688905716, -0.0007779898005537689, 0.007655083667486906, -0.04461332783102989, -0.06534386426210403, 0.022733857855200768, 3.386313983355649e-05, -0.05949120596051216, -0.02963736094534397, -0.041748590767383575, -0.024089790880680084, 0.006294546648859978, 0.0007010505069047213, 0.021053096279501915, -0.045804280787706375, 0.06257349997758865, -0.00566000584512949, -0.11101168394088745, -0.0037021986208856106, -0.07241420447826385, -0.007232076022773981, -0.046018701046705246, 0.06296560168266296, -0.03881699964404106, -0.03423628956079483, 0.061653804033994675, 0.01447464432567358, 0.08636151999235153, -0.021217307075858116, -0.02176707051694393, 0.03143147751688957, -0.07397083938121796, 0.03849874809384346, 0.030209025368094444, 0.08624804019927979, -0.042074818164110184, 0.08200012147426605, 0.05718334764242172, 0.0024865553714334965, -0.08351581543684006, 0.03371148928999901, -0.07047154009342194, 0.04905565083026886, -0.03921777755022049, -0.014258673414587975, -0.015173451043665409, 0.0635371133685112, -0.019118094816803932, -0.17203906178474426, -0.026635851711034775, -0.019226228818297386, -0.016150809824466705, 0.024355709552764893, -0.018578559160232544, -0.05938577651977539, -0.010149099864065647, 0.006979957688599825, -0.06992802023887634, 0.03595658764243126, 0.08962810039520264, 0.02012796141207218, 0.022597622126340866, 0.0760604664683342, 0.10441038757562637, 0.04377717897295952, 0.01706886664032936, 0.036231186240911484, 0.06683354824781418, -0.032575663179159164, -0.014489937573671341, 0.006141759920865297, -0.01058901846408844, 0.010238044895231724, -0.01914459466934204, 0.03891001269221306, 0.11030209809541702, -0.09640205651521683, -0.005438120570033789, -0.041793469339609146, -0.03684716671705246, -0.04202888906002045, 0.039728689938783646, -0.06467396020889282, 5.7072230705719225e-33, -0.020420119166374207, 0.048706717789173126, -0.011868635192513466, -0.07385863363742828, -0.014467776753008366, -0.030924823135137558, -0.006513237487524748, 0.010930835269391537, 0.05706656351685524, -0.0206979401409626, -0.1099635660648346, 0.002824648516252637, -0.007111651822924614, 0.1467180699110031, 0.04251876845955849, -0.03602566570043564, -0.011454150080680847, 0.040195681154727936, 0.04922572523355484, -0.0036362591199576855, 0.09148044139146805, -0.043042946606874466, 0.013225466012954712, -0.03434816002845764, -0.03677961230278015, -0.034624163061380386, 0.09565635770559311, 0.07197056710720062, -0.059173405170440674, 0.020393580198287964, 0.021814638748764992, -0.05269017443060875, -0.11607526987791061, -0.004591604229062796, 0.05187046155333519, 0.042006541043519974, 0.00024937273701652884, 0.015779295936226845, 0.024463118985295296, -0.12902188301086426, -0.0024710302241146564, 0.058274950832128525, 0.017525527626276016, 0.007890207692980766, -0.02032354101538658, -0.0115578081458807, 0.0009621672215871513, -0.012063216418027878, -0.10113020986318588, -0.03885634243488312, -0.020488210022449493, 0.05208207294344902, -0.08786670863628387, 0.014869147911667824, 0.11844538897275925, 0.036721304059028625, 0.06090366467833519, 0.028958195820450783, 0.01696479506790638, 0.09231297671794891, 0.02985883504152298, -0.01828913763165474, 0.007003661245107651, 0.01505861897021532, 0.010271027684211731, 0.03455441817641258, 0.008600160479545593, 0.050456199795007706, 0.02760804072022438, 0.0017128093168139458, 0.0473487563431263, 0.06561052054166794, 0.017903093248605728, -0.07841041684150696, 0.06281331926584244, -0.03543027117848396, 0.12178042531013489, -0.052302129566669464, 0.013757151551544666, 0.08008206635713577, -0.10554086416959763, 0.09418614208698273, -0.029823292046785355, -0.07291066646575928, -0.07876382768154144, -0.03098226524889469, 0.031462524086236954, -0.05854303762316704, -0.0024905442260205746, 0.07464663684368134, -0.06865081936120987, -0.04176035150885582, -0.0338682159781456, -0.002649319591000676, -0.07172323018312454, -6.225606161050966e-33, -0.002845544135197997, 0.0339551717042923, -0.05967126414179802, 0.08233489096164703, -0.03790334612131119, -0.023193757981061935, -0.06284800171852112, 0.09909947961568832, -0.06820274889469147, -0.08849668502807617, 0.017672542482614517, 0.0445609875023365, -0.002854536520317197, 0.019992005079984665, 0.052989888936281204, 0.011691348627209663, -0.05840672180056572, 0.006948265712708235, 0.05130595341324806, -0.05873718485236168, 0.09626223146915436, 0.08178570121526718, -0.026897860690951347, 0.05887024477124214, -0.030919231474399567, -0.0642336905002594, -0.04808010905981064, 0.05832596495747566, -0.046839576214551926, 0.06728141009807587, 0.009692281484603882, 0.040341414511203766, -0.07911562919616699, 0.045800983905792236, -0.05917090177536011, 0.01855403743684292, -0.01251003984361887, -0.025739187374711037, -0.04201287031173706, 0.06663881987333298, 0.029581431299448013, -0.007674942724406719, -0.019704235717654228, -0.0468100868165493, 0.0026548830792307854, 0.014801210723817348, -0.0446816086769104, 0.004633679986000061, 0.0474667102098465, 0.033854398876428604, 0.011246020905673504, -0.04696330055594444, -0.060261283069849014, 0.011601691134274006, -0.04384208470582962, -0.049145009368658066, 0.0016647032462060452, -0.007872156798839569, 0.07802323997020721, 0.046611860394477844, -0.0007717642583884299, -0.005009732209146023, -0.05545312538743019, 0.00044254102976992726, -0.07207903265953064, -0.007397984620183706, 0.031065108254551888, 0.010801269672811031, 0.0984945148229599, 0.08276300877332687, -0.004442497156560421, 0.016725856810808182, -0.014933870173990726, 0.06153065711259842, -0.09890308231115341, 0.06737033277750015, 0.048176079988479614, -0.004219278693199158, -0.06771522015333176, -0.05566632002592087, 0.04346884414553642, -0.002077852375805378, 0.013413766399025917, 0.03731939196586609, 0.005922685377299786, 0.00014017381181474775, 0.07150238007307053, 0.017522472888231277, -0.003924425225704908, -0.0024429229088127613, 0.03514794632792473, -0.06863295286893845, -0.04194289445877075, -0.09845324605703354, -0.08059365302324295, -5.613392062286948e-08, -0.047145918011665344, 0.050788696855306625, 0.021929606795310974, -0.05492076277732849, 0.01929088868200779, -0.0264541357755661, -0.011888624168932438, 0.11470744758844376, -0.026045555248856544, 0.059586476534605026, 0.10535825043916702, 0.03637320548295975, -0.058304641395807266, -0.004394104238599539, 0.03926981985569, 0.0966586321592331, -0.01926596648991108, 0.007399486377835274, 0.01114504411816597, -0.025586143136024475, -0.018695702776312828, 0.0362405963242054, 0.029063796624541283, -0.048778511583805084, 0.01147797703742981, -0.0916210263967514, 0.03540662303566933, 0.06911167502403259, -0.04454568773508072, -0.04465251415967941, -0.06230401620268822, 0.05809623748064041, 0.011247490532696247, 0.015424966812133789, 0.04165060818195343, 0.06979487091302872, -0.02913900837302208, 0.0009594780276529491, 0.025665752589702606, 0.04016648977994919, -0.06656315177679062, -0.012626342475414276, 0.012031045742332935, -0.061493124812841415, 0.01789330504834652, 0.015117892995476723, -0.04389094561338425, 0.007679124362766743, -0.04612937569618225, 0.023105593398213387, 0.057332467287778854, -0.0014480268582701683, -0.03130318224430084, 0.03316817060112953, 0.06192366033792496, -0.04349185526371002, -0.0645330548286438, -0.12288568913936615, -0.007953221909701824, 0.043972477316856384, -0.04276168718934059, 0.003166929120197892, -0.04041401669383049, -0.02363276109099388 ] }, { "text": "Accumulation of gradient in the denominator has the same effects as annealing, reducing the learning rate over time. \n\n**Cons:** *", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_4", "embedding": [ 0.018956897780299187, -0.02204984985291958, 0.03079679235816002, 0.041160572320222855, 0.03119797632098198, -0.030062507838010788, -0.0318073034286499, -0.03727457672357559, 0.0037121169734746218, 0.029142288491129875, -0.022702982649207115, 0.0848982110619545, 0.05787020921707153, -0.0022029378451406956, -0.04253324866294861, 0.06764648109674454, 0.023097192868590355, 0.0523124597966671, -0.04374299943447113, -0.03420887887477875, -0.04203212261199951, -0.09594862163066864, 0.013378901407122612, 0.030756447464227676, -0.01081131212413311, 0.018960710614919662, 0.02927340194582939, 0.07107871025800705, 0.004878859035670757, -0.025156522169709206, 0.02545241266489029, 0.06075311079621315, 0.05773913860321045, -0.03249962627887726, -0.06500700861215591, 0.03777902573347092, -0.08719690889120102, 0.00034461022005416453, -0.01783790998160839, 0.03358424827456474, -0.016170866787433624, 0.0364629290997982, -0.006192291155457497, 0.045577313750982285, 0.02710096724331379, 0.0164825189858675, 0.019194170832633972, -0.040632277727127075, -0.0784045159816742, -0.042074721306562424, -0.03577899932861328, -0.05253146216273308, -0.07291565090417862, 0.004291024059057236, -0.00892914179712534, 0.08039204776287079, -0.0409749373793602, 0.03741377592086792, -0.040507663041353226, 0.022052982822060585, 0.008941092528402805, -0.07934663444757462, 0.018500346690416336, -0.008109073154628277, 0.06504470109939575, -0.03689786046743393, 0.04425230622291565, -0.03635689988732338, 0.033324696123600006, 0.060140833258628845, 0.05131014809012413, 0.1002044826745987, -0.05951657518744469, -0.04645209014415741, 0.09315269440412521, -0.00891109835356474, 0.08268216252326965, -0.008586553856730461, 0.03749024122953415, -0.039586517959833145, -0.053338855504989624, 0.03388718143105507, 0.026809781789779663, -0.061068061739206314, 0.01452082023024559, -0.09706301987171173, -0.008242668583989143, -0.12250988185405731, 0.035278256982564926, -0.03307793289422989, 0.10335958749055862, -0.026293596252799034, -0.14388830959796906, -0.07280442863702774, -0.01998986303806305, 0.008653996512293816, -0.03590739890933037, -0.004067295230925083, 0.0005744957597926259, 0.00923173688352108, 0.0011678438168019056, 0.005388697609305382, -0.06650501489639282, 0.06942841410636902, -0.03688895329833031, 0.007789023220539093, 0.11422525346279144, 0.05456029996275902, 0.0015772795304656029, -0.0011287200031802058, 0.03440340235829353, 0.05173203721642494, 0.042332056909799576, 0.042814143002033234, -0.0735645592212677, 0.0011974151711910963, 0.05734356492757797, -0.03687668219208717, 0.017120199277997017, 0.09168535470962524, -0.04548604413866997, -0.09735604375600815, -0.05178731307387352, 0.02440449222922325, -0.05420426279306412, -0.020248552784323692, -0.09022586047649384, 1.0820031525040639e-33, -0.04423224553465843, 0.03497592359781265, 0.0011669070227071643, -0.06285550445318222, 0.049700915813446045, -0.006951409857720137, 0.025491196662187576, -0.03940780088305473, 0.025409391149878502, -0.05954943597316742, -0.1026611477136612, -0.023509478196501732, -0.023121261969208717, 0.027782918885350227, 0.06446409970521927, -0.0887213870882988, -0.05377153679728508, 0.10302934050559998, -0.017738264054059982, -0.0490507110953331, 0.02197905071079731, -0.08687074482440948, -0.0077566346153616905, -0.01589491032063961, -0.043688949197530746, -0.0020943477284163237, 0.0772041454911232, 0.039309434592723846, -0.06410394608974457, 0.0026804970111697912, 0.009063232690095901, -0.042133502662181854, -0.08237623423337936, 0.02673315443098545, 0.04593268781900406, 0.09432723373174667, 0.028794899582862854, 0.028702571988105774, 0.03044510819017887, -0.03557814657688141, 0.025727014988660812, 0.04782203957438469, 0.10248667746782303, -0.007578789722174406, -0.06605767458677292, -0.014024639502167702, 0.045254603028297424, -0.012451766058802605, -0.047280918806791306, -0.008456886745989323, -0.05916288495063782, -0.005766382906585932, -0.04094008728861809, -0.032172441482543945, 0.13278670608997345, 0.09981320798397064, 0.0424068346619606, -0.0156722329556942, 0.010761228390038013, 0.0451032891869545, -0.019522545859217644, -0.02431420609354973, 0.037293076515197754, 0.01012357696890831, 0.04594254493713379, 0.0858929231762886, -0.005521751474589109, 0.0803544744849205, 0.0447380468249321, -0.012179753743112087, 0.058158989995718, 0.030236946418881416, -0.0044905878603458405, -0.03953832760453224, 0.07161477953195572, 0.003909855615347624, 0.049823883920907974, -0.04393881931900978, 0.022794993594288826, -0.07634419947862625, -0.038381338119506836, 0.008187780156731606, -0.07602567225694656, -0.08851566910743713, -0.08566001802682877, -0.02243928611278534, 0.04508526995778084, -0.0495186410844326, 0.02461070753633976, 0.06905721127986908, -0.0029925424605607986, -0.008054024539887905, 0.0011886607389897108, 0.06766829639673233, -0.06682244688272476, -1.9774678411601082e-33, -0.0942995473742485, -0.05673215165734291, -0.010962292551994324, 0.03402474895119667, -0.02579783834517002, 0.003371619852259755, -0.04325868561863899, -0.023809440433979034, -0.014346923679113388, -0.08007929474115372, 0.026702089235186577, 0.08074738830327988, -0.08256999403238297, -0.051813844591379166, -0.024600695818662643, 0.057977497577667236, -0.012199318036437035, 0.031207939609885216, 0.08840550482273102, 0.012269123457372189, -0.031959325075149536, 0.06033189594745636, -0.05306199938058853, -0.015599808655679226, -0.03420664742588997, -0.002100107492879033, -0.08733244985342026, 0.14138489961624146, -0.0025645974092185497, 0.08870983868837357, -0.03194518759846687, 0.009752913378179073, -0.07969092577695847, 0.024854019284248352, 0.004772390238940716, 0.05164644494652748, -0.01740712672472, 0.007661797106266022, 0.010484852828085423, 0.06979725509881973, -0.009609666652977467, -0.01997228153049946, -0.060972489416599274, -0.019217897206544876, 0.07350621372461319, -0.046434853225946426, 0.010708390735089779, -0.03323688358068466, 0.05190078914165497, 0.07071990519762039, 0.00970308668911457, -0.04779406636953354, -0.03521276265382767, -0.024409553036093712, -0.05801650136709213, 0.0516115240752697, -0.00250225025229156, 0.0598653219640255, 0.023983167484402657, 0.03414040431380272, -0.06491603702306747, 0.03382314369082451, -0.07204346358776093, -0.05876699462532997, -0.06686174869537354, -0.006526478100568056, 0.021542586386203766, 0.07906878739595413, 0.06888256222009659, -0.004284283146262169, 0.02846965752542019, 0.044576384127140045, 0.023962808772921562, 0.005548515357077122, -0.05154196172952652, -0.04927454888820648, 0.06458093971014023, 0.04874132573604584, -0.09212303906679153, -0.03751325607299805, -0.08236929774284363, 0.029487119987607002, 0.022353602573275566, -0.01296660304069519, -0.041969701647758484, 0.02494111657142639, 0.011936351656913757, -0.03361319750547409, -0.03625022992491722, -0.06610975414514542, 0.048752859234809875, -0.039708759635686874, 0.044791173189878464, -0.10264640301465988, -0.0810738280415535, -2.9744493090788637e-08, -0.036904219537973404, -0.05080876126885414, 0.03923466429114342, -0.06876504421234131, 0.12233162671327591, -0.045817531645298004, -0.011969661340117455, 0.12627679109573364, -0.0257638618350029, -0.07409743219614029, 0.09722965210676193, 0.03371958062052727, 0.0011346343671903014, 0.0017685540951788425, 0.06296199560165405, 0.0715106800198555, 0.04418180510401726, 0.011451128870248795, -0.041080739349126816, -0.00743454322218895, 0.017980409786105156, 0.014093542471528053, 0.06875266879796982, -0.03176700696349144, 0.011454648338258266, -0.07040480524301529, 0.028623303398489952, 0.0286799855530262, 0.001327185658738017, -0.05955488607287407, -0.043714489787817, 0.04148643836379051, 0.07082372903823853, 0.07172577828168869, 0.11425751447677612, 0.062371693551540375, 0.025519879534840584, -0.01725243590772152, -0.09811628609895706, 0.025858841836452484, -0.06300381571054459, -0.028911899775266647, 0.08730301260948181, -0.020187200978398323, 0.022577689960598946, 0.0016556800110265613, -0.055017419159412384, -0.04901887848973274, 0.058662258088588715, 0.0017431428423151374, 0.014962645247578621, 0.05022174492478371, 0.00018862562137655914, 0.01644890569150448, 0.09420223534107208, -0.04938691109418869, -0.017315344884991646, -0.04117235913872719, -0.03250863030552864, 0.059016406536102295, 0.0019807207863777876, 0.04741461202502251, -0.0045514595694839954, -0.08632857352495193 ] }, { "text": "**Cons:** * \n\n- This method can be sensitive to initial conditions of the parameters and the corresponding gradients. \n- If the initial gradients are large, the learning rates will be low for the remainder of training. \n- This can be combatted by increasing the global learning rate, making the ADAGRAD method sensitive to the choice of \nlearning rate. \n- Due to the continual accumulation of squared gradients in the denominator, the learning rate will continue to decrease \nthroughout training, eventually decreasing to zero and stopping training completely.\n- Another exp: A downside of Adagrad is that in case of Deep Learning, the monotonic learning rate usually proves too \naggressive and stops learning too early. **", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_5", "embedding": [ -0.06273876875638962, -0.03968340903520584, -0.005331698805093765, 0.02746834047138691, 0.020400654524564743, -0.00018561635806690902, -0.059673137962818146, 0.052301548421382904, -0.015979863703250885, 0.014471090398728848, 0.004380372352898121, 0.15348418056964874, -0.04130927845835686, 0.042438410222530365, -0.07700793445110321, 0.03927556797862053, 0.0781232938170433, 0.04784270375967026, -0.036091532558202744, 0.008944795466959476, -0.0066751595586538315, -0.0973040834069252, -0.011301943100988865, 0.06313708424568176, 0.028855539858341217, -0.028977826237678528, -0.013412990607321262, -0.03962830826640129, 0.021033387631177902, -0.039706844836473465, 0.05480525270104408, -0.027402574196457863, 0.08201631158590317, -0.020911023020744324, -0.13443522155284882, -0.019718175753951073, 0.01943788304924965, 0.055303897708654404, 0.004605424124747515, 0.00865897536277771, -0.03221717104315758, 0.02081332728266716, -0.03626095876097679, 0.011325070634484291, 0.07614804059267044, -0.061244066804647446, 0.0439169779419899, -0.09596032649278641, 0.010870063677430153, -0.021264823153614998, 0.027245311066508293, 0.014947064220905304, -0.018347060307860374, -0.009028955362737179, -0.010622760280966759, -0.002405158942565322, 0.009857128374278545, -0.020015841349959373, -0.0487029142677784, 0.009258776903152466, 0.02121693454682827, -0.11462093889713287, -0.03865797817707062, -0.07298851758241653, 0.009643927216529846, -0.05391562357544899, 0.07003192603588104, -0.06205065920948982, 0.0770837739109993, 0.10512732714414597, 0.015425354242324829, 0.06543708592653275, -0.04027196019887924, -0.0187226552516222, 0.01951247826218605, -0.03371910750865936, 0.05203540623188019, 0.007746607530862093, 0.043343354016542435, -0.053230881690979004, 0.11413270980119705, 0.05011015757918358, 0.050391923636198044, -0.053360387682914734, 0.037380050867795944, -0.04083918035030365, 0.012859934940934181, -0.10379515588283539, -0.044620074331760406, -0.05872511863708496, 0.11238785833120346, 0.031081579625606537, -0.06755544990301132, 0.021705977618694305, -0.006815134081989527, 0.010991601273417473, -0.043348528444767, -0.025428909808397293, -0.03871526941657066, 0.01646229438483715, -0.0032960986718535423, -0.025707198306918144, -0.07801666110754013, 0.01813608594238758, 0.00030029978370293975, -0.06317701190710068, 0.04255161061882973, 0.011868172325193882, 0.10079982876777649, 0.002757613779976964, 0.05812293291091919, 0.04833177104592323, 0.012323684990406036, 0.0009093272383324802, -0.038838136941194534, 0.018190644681453705, -0.025620173662900925, -0.048210252076387405, 0.008373700082302094, 0.11815076321363449, -0.06716343760490417, -0.01330544613301754, -0.01715726964175701, 0.06897231191396713, -0.03944699466228485, -0.04272157698869705, -0.046160925179719925, 3.3572603550904245e-33, -0.03531990572810173, -0.018091730773448944, -0.049868132919073105, -0.08972162008285522, 0.010189530439674854, -0.009955259039998055, -0.005833017639815807, 0.003984945826232433, 0.009172508493065834, -0.014309965074062347, -0.00912678986787796, -0.0789351761341095, -0.0066216797567903996, 0.08724911510944366, 0.06739211082458496, -0.012676991522312164, -0.05132611468434334, 0.01187844481319189, -0.026108497753739357, -0.023443926125764847, 0.09260302782058716, -0.08600812405347824, -0.033123861998319626, 0.034130290150642395, -0.04823487624526024, -0.0419042743742466, 0.07200394570827484, 0.08925837278366089, 0.0002825857372954488, 0.027759680524468422, -0.06674986332654953, -0.11350724846124649, -0.12839950621128082, 0.02055881731212139, 0.0037559133488684893, 0.04492367058992386, 0.01569746434688568, 0.014034085907042027, -0.029680714011192322, -0.09222088754177094, -0.04774634540081024, 0.1073864996433258, 0.03883639723062515, 0.039240993559360504, 0.06918436288833618, -0.01340281032025814, 0.05764736980199814, -0.011643070727586746, -0.10340451449155807, -0.04127182438969612, -0.0554058775305748, 0.03150307014584541, -0.08832884579896927, -0.015104024671018124, 0.030658287927508354, 0.09208039194345474, 0.04850870370864868, -0.025631792843341827, -0.006011127028614283, 0.03257429972290993, 0.03801482915878296, -0.07721276581287384, 0.001062415074557066, 0.0208355113863945, -0.04360847920179367, 0.09506461024284363, 0.03878289833664894, 0.04085305705666542, 0.04645724967122078, -0.030159462243318558, 0.020296750590205193, -0.014782226644456387, -0.032774463295936584, -0.002306796843186021, 0.03030846081674099, -0.01425112597644329, 0.11058660596609116, 0.01660771481692791, 0.04219156131148338, -0.03923254460096359, -0.02387033775448799, 0.10128045827150345, -0.00684319157153368, 0.029949087649583817, -0.04982229694724083, 0.013033389113843441, 0.007580205798149109, -0.03519078716635704, 0.024100923910737038, 0.10676226019859314, -0.064458467066288, 0.018775878474116325, -0.07273636013269424, 0.07997804135084152, -0.012677174992859364, -4.013794888517796e-33, -0.0062834518030285835, 0.053192708641290665, -0.0690518319606781, -0.016896001994609833, -0.0617217943072319, 0.04983938857913017, -0.07300011068582535, 0.031791411340236664, 0.0021716756746172905, -0.0646253302693367, 0.05386842414736748, 0.05379568412899971, -0.079365074634552, 0.017664020881056786, 0.008709922432899475, -0.053346045315265656, -0.038508400321006775, 0.010232428088784218, -0.011448589153587818, 0.01512461993843317, -0.0036588176153600216, 0.08338205516338348, -0.08582949638366699, -0.004277192987501621, -0.028505057096481323, -0.05505216866731644, -0.10088292509317398, 0.10366378724575043, -0.0068445042707026005, 0.019242463633418083, 0.05791598558425903, 0.07122159749269485, -0.04317932948470116, -0.047259822487831116, -0.036814168095588684, 0.11936396360397339, 0.014309502206742764, -0.013851695694029331, -0.04135318100452423, 0.04151138663291931, 0.05596853792667389, 0.050674647092819214, 0.015400265343487263, -0.059499066323041916, 0.061356525868177414, -0.010253249667584896, -0.03388987481594086, -0.014035546220839024, 0.027090560644865036, 0.04022394120693207, -0.016967808827757835, -0.08134323358535767, 0.004680568818002939, 0.006517402362078428, -0.026671774685382843, -0.06844506412744522, -0.0003898518916685134, 0.001980796456336975, -0.011134817264974117, 0.048978205770254135, -0.049819350242614746, 0.049262456595897675, 0.012278411537408829, -0.054693982005119324, -0.1097254604101181, 0.009805118665099144, 0.038390010595321655, 0.0752614438533783, 0.03227834403514862, 0.05531839281320572, 0.04569954425096512, 0.015396656468510628, -0.030525121837854385, 0.10424653440713882, -0.05557817965745926, 0.007365490309894085, 0.06324166059494019, 0.018064046278595924, -0.057679664343595505, -0.06586965173482895, -0.046106673777103424, -0.017551517114043236, 0.012681418098509312, 0.06101842224597931, -0.033354904502630234, -0.0021034751553088427, 0.014338330365717411, -0.008785898797214031, 0.016159340739250183, 0.011757912114262581, -0.011612173169851303, -0.07790493965148926, -0.018377788364887238, -0.08013796806335449, -0.04788900539278984, -4.508657269752803e-08, -0.015284253284335136, 0.051513832062482834, 0.059282492846250534, -0.010736066848039627, -0.02387738786637783, 0.021746067330241203, -0.080292709171772, 0.11386208236217499, -0.060105469077825546, 0.01934324949979782, 0.06421840935945511, 0.04642176628112793, -0.06326519697904587, 0.013835280202329159, -0.032373178750276566, 0.14727681875228882, 0.11319131404161453, -0.03712533786892891, 0.02278014086186886, -0.010363421402871609, -0.02835524082183838, 0.017549024894833565, 0.03073575533926487, -0.03461878374218941, 0.02006167732179165, -0.07440803945064545, 0.1026090681552887, 0.08151429891586304, 0.007483299355953932, -0.07018715888261795, -0.0385652557015419, 0.08387720584869385, 0.033977679908275604, 0.10698360949754715, 0.05095257610082626, 0.05000241845846176, -0.0016924465307965875, -0.011149272322654724, -0.02465875819325447, 0.027150770649313927, 0.018708590418100357, -0.0428307019174099, 0.043975770473480225, -0.04845033586025238, 0.0020636506378650665, 0.010513185523450375, -0.01602216437458992, -0.022845478728413582, -0.006118778605014086, 0.014022225514054298, 0.00019663713464979082, 0.015830475836992264, -0.012263721786439419, 0.04261267930269241, 0.04527965560555458, 0.002620627172291279, -0.04713549092411995, -0.11494214832782745, -0.03906029462814331, 0.03813192993402481, -0.028843866661190987, -0.0032120579853653908, -0.05079468712210655, 0.01908417046070099 ] }, { "text": "## RMS Prop\n\n gradient_squared = 0 \n gradient_squared = decay_rate * gradient_squared + (1 - decay_rate) * gradient**2\n w += - learning_rate * gradient / (np.sqrt(gradient_squared) + eps)\n\n- The RMSProp update adjusts the Adagrad method in a very simple way in an attempt to reduce its aggressive, monotonically \ndecreasing learning rate. \n- In particular, it uses a moving average of squared gradients.\n- decay_rate is a hyperparameter and typical values are [0.9, 0.99, 0.999].", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_6", "embedding": [ -0.056707609444856644, -0.0702618658542633, -0.052941467612981796, 0.05297181010246277, 0.012854468077421188, -0.04877028241753578, -0.10594858229160309, 0.05811765789985657, -0.042967043817043304, 0.041054993867874146, -0.011118286289274693, 0.052977554500103, -0.03389584645628929, -0.023430369794368744, -0.08112317323684692, 0.10402197390794754, 0.01158148329705, 0.05080566927790642, -0.013824324123561382, 0.007813997566699982, 0.029402446001768112, 0.0011006058193743229, -0.006949362810701132, 0.05953577905893326, 0.09971814602613449, -0.014983725734055042, -0.028950441628694534, 0.01671367511153221, 0.030888594686985016, 0.0163376834243536, 0.04559209942817688, -0.08299312740564346, 0.06757012009620667, -0.029742391780018806, -0.08256137371063232, -0.0003370815538801253, 0.0271371528506279, 0.0243715550750494, -0.0017957849195227027, 0.017746135592460632, -0.004308477509766817, 0.06441357731819153, -0.062181029468774796, -0.0011725248768925667, 0.07905407249927521, -0.0021784668788313866, -0.07036513090133667, 0.001070667407475412, -0.0123481135815382, 0.0028118814807385206, 0.022757932543754578, -0.07208560407161713, -0.045176710933446884, -0.023869335651397705, -0.05802696570754051, 0.033796247094869614, 0.07507126033306122, 0.004720261320471764, 0.01136473286896944, -0.015543459914624691, 0.06323538720607758, -0.10680191963911057, -0.004808662459254265, -0.04754830151796341, -0.04601356387138367, -0.007221950683742762, 0.031194675713777542, -0.038848113268613815, 0.02623625099658966, 0.08918771892786026, -0.05437859520316124, 0.03535136207938194, 0.027852151542901993, -0.00550305237993598, 0.06498422473669052, -0.08299382030963898, 0.008086872287094593, 0.025670886039733887, 0.12305129319429398, -0.09150725603103638, 0.08262805640697479, -0.02312646433711052, -0.029191935434937477, -0.03839913010597229, 0.01342303678393364, -0.0403359979391098, 0.07854090631008148, -0.045403797179460526, -0.03859478607773781, -0.02306617610156536, 0.02449895814061165, -0.03407099470496178, -0.0942874550819397, -0.007175681181252003, -0.04276444762945175, 0.03130745515227318, -0.009094341658055782, -0.003896332113072276, -0.049198441207408905, 0.01823957823216915, -0.05694834142923355, -0.03241927549242973, -0.06969411671161652, -0.020138034597039223, -0.009180120192468166, -0.003750730073079467, 0.029724588617682457, 0.10730117559432983, 0.036728497594594955, 0.0843886062502861, 0.016166966408491135, 0.0395016111433506, -0.06709662824869156, 0.02870863862335682, 0.06911060214042664, 0.07695522159337997, -0.028679322451353073, -0.0033042472787201405, -0.090834841132164, 0.050959933549165726, -0.039360541850328445, -0.031251806765794754, -0.05305834859609604, 0.017377573996782303, -0.03498803451657295, 0.0020471771713346243, 0.00275157461874187, 3.8336933582664825e-33, 0.007736602332442999, 0.039787910878658295, -0.003303265431895852, -0.12067650258541107, 0.005888508632779121, -0.020070631057024002, -0.014282174408435822, -0.017354413866996765, 0.03457481786608696, 0.005043006036430597, -0.008286627009510994, -0.03414306789636612, -0.09430655092000961, 0.04665527492761612, -0.0016535327304154634, -0.06625810265541077, -0.04563632234930992, 0.07233908027410507, 0.025877047330141068, -0.031042344868183136, 0.0325913205742836, -0.01010157074779272, -0.08332641422748566, -0.05193879455327988, -0.009797348640859127, 0.05279557406902313, 0.052359141409397125, 0.1367999166250229, -0.0009171164711005986, 0.008132287301123142, 0.042502544820308685, -0.0196260716766119, -0.13450390100479126, -0.035278137773275375, 0.05704328045248985, -0.05649736523628235, 0.026061784476041794, -0.007838266901671886, 0.04589785262942314, -0.025121718645095825, -0.01807231828570366, 0.0475848987698555, 0.00441604433581233, 0.027901485562324524, -0.012322834692895412, -0.01842745952308178, 0.0016198032535612583, 0.05822880566120148, 0.02076636254787445, -0.014789937064051628, -0.024881895631551743, 0.034900546073913574, -0.09004350006580353, 0.032208189368247986, -0.013396772556006908, -0.001910872757434845, 0.03827771171927452, 0.03672991693019867, 0.0331917367875576, -0.03548947349190712, 0.13360708951950073, -0.076444610953331, 0.061146389693021774, -0.0675579160451889, -0.07393103837966919, 0.0592811293900013, 0.0031368527561426163, 0.005129263270646334, 0.03740060701966286, 0.011839733459055424, -0.006148884072899818, 0.05763322860002518, -0.032538432627916336, -0.010445251129567623, -0.027135005220770836, -0.04292565584182739, 0.10510176420211792, 0.06317400932312012, 0.022465625777840614, -0.012384354136884212, -0.1222132220864296, 0.039655741304159164, -0.03686909005045891, -0.02205648645758629, -0.03124871663749218, -0.011904239654541016, -0.05162809416651726, -0.01969563215970993, -0.07134924829006195, -0.009241978637874126, -0.05340644717216492, 0.0058609964326024055, -0.11027901619672775, 0.08086150139570236, -0.03812500461935997, -4.177998959700192e-33, -0.01106177270412445, 0.06290332973003387, 0.00513335969299078, 0.0854785367846489, -0.08569294214248657, 0.05338279902935028, -0.10264144092798233, 0.05341637507081032, 0.026461012661457062, -0.020663268864154816, 0.08978967368602753, -0.0006297742365859449, -0.08225825428962708, 0.01807388849556446, 0.05411605164408684, 0.0226215161383152, 0.0007973372703418136, 0.025598259642720222, -0.03457406535744667, 0.01241656206548214, 0.03915097936987877, 0.0604141540825367, -0.027124425396323204, 0.03436368703842163, -0.01771566830575466, -0.031467266380786896, 0.005299413111060858, 0.06811727583408356, 0.021515479311347008, -0.040516939014196396, 0.041359469294548035, 0.061743661761283875, -0.09193859249353409, -0.028087204322218895, -0.043630827218294144, 0.016157250851392746, 0.023119274526834488, -0.08289788663387299, -0.0741017758846283, 0.04089213162660599, 0.10329904407262802, 0.0638740137219429, -0.02335745096206665, -0.031252965331077576, 0.08436410129070282, 0.015802942216396332, 0.03683359920978546, -0.05364932492375374, 0.04957786947488785, -0.015097169205546379, 0.04707420617341995, -0.11567089706659317, -0.018146000802516937, 0.09942734986543655, -0.07783880829811096, -0.01687413826584816, -0.02395172044634819, 0.08072814345359802, 0.035334475338459015, 0.00516846776008606, -0.014316272921860218, 0.06954238563776016, -0.043966144323349, -0.005066847428679466, -0.08110863715410233, 0.040192730724811554, 0.026446349918842316, -0.00529563007876277, 0.020499447360634804, 0.06346777826547623, 0.043185409158468246, 0.03850850835442543, 0.028801752254366875, 0.06087688356637955, -0.02758517675101757, -0.05116608366370201, -0.0025201463140547276, -0.023370319977402687, -0.041092876344919205, -0.053722139447927475, 0.020777788013219833, 0.053308598697185516, 0.0709327980875969, 0.056088242679834366, -0.022260528057813644, -0.014338902197778225, 0.0007055079913698137, 0.1343088448047638, 0.037384361028671265, 0.0548182837665081, -0.04263058304786682, -0.008399566635489464, -0.03583191707730293, -0.10931167006492615, -0.06669507175683975, -4.8114834783064e-08, -0.019403379410505295, 0.07214078307151794, 0.04051395133137703, 0.015613147988915443, 0.009666558355093002, 0.014069183729588985, -0.05418061837553978, 0.05821062996983528, -0.08098018914461136, -0.052752796560525894, 0.010182905942201614, 0.04129355773329735, -0.06846528500318527, -0.0547298826277256, -0.007941238582134247, 0.03937222808599472, -0.008473783731460571, 0.06737319380044937, 0.03456123545765877, -0.059888824820518494, -0.029113836586475372, -0.03866805508732796, 0.11583856493234634, -0.002971480367705226, 0.029685128480196, -0.05287691950798035, 0.06448175758123398, 0.0370548851788044, 0.060523636639118195, -0.03259437903761864, 0.03150814771652222, 0.04168735817074776, 0.043642815202474594, 0.024615366011857986, 0.030344892293214798, 0.12103024125099182, 0.01354004256427288, 0.060318175703287125, 0.02181754633784294, 0.10725288838148117, -0.08614818751811981, -0.02496814914047718, -0.041698142886161804, -0.02801593206822872, 0.02718951180577278, 0.06616855412721634, 0.009003814309835434, -0.03292383626103401, -0.03391796350479126, -0.038573529571294785, 0.10561522841453552, -0.043262626975774765, -0.06667445600032806, -0.012573577463626862, 0.0016369824297726154, -0.0648682564496994, -0.0848536342382431, -0.07688434422016144, -0.04761793464422226, 0.019542383030056953, -0.017667219042778015, -0.044088173657655716, 0.0031813341192901134, 0.004638944752514362 ] }, { "text": "- Notice that the w+= update is identical to Adagrad.\n- But the gradient_squared variable is a “leaky”. (has decay rate)\n- Hence, RMSProp still modulates the learning rate of each weight based on the magnitudes of its gradients. \nIt has a beneficial equalizing effect.\n - But unlike Adagrad, the updates do not get monotonically smaller.\n\n\n# Adam\n\nRef: https://arxiv.org/pdf/1412.6980.pdf", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_7", "embedding": [ -0.10854887962341309, -0.08423978835344315, -0.01332674641162157, 0.07951482385396957, 0.03253116458654404, -0.007447480224072933, -0.0546443872153759, 0.026098083704710007, 0.006158242002129555, 0.06633786857128143, -0.013429085724055767, 0.07989491522312164, -0.006144749000668526, -0.013878747820854187, -0.06951134651899338, 0.07880309969186783, 0.01897604577243328, 0.0522887296974659, -0.03579936549067497, -0.022638164460659027, 0.014283563010394573, -0.04442159831523895, -0.004618153907358646, 0.06846939772367477, 0.08533503115177155, 0.01982509158551693, -0.047678425908088684, 0.04318046197295189, 0.07839569449424744, 0.0024196563754230738, 0.0407138392329216, -0.08319991081953049, 0.08619243651628494, -0.07177243381738663, -0.13535510003566742, 0.009290826506912708, 0.03640355169773102, -0.009726064279675484, -0.015985872596502304, 0.0006585203809663653, -0.03405873849987984, 0.06514099985361099, -0.01295209676027298, 0.036616574972867966, 0.03698861226439476, -0.025137770920991898, -0.05916253849864006, 0.007151714526116848, -0.033946096897125244, -0.020329387858510017, 0.05611557513475418, -0.06860695034265518, -0.029756974428892136, -0.02122965082526207, -0.038151755928993225, 0.04668137803673744, 0.09022163599729538, -0.0008063755230978131, -0.012067054398357868, 0.003541603684425354, 0.0031610196456313133, -0.11489014327526093, 0.014849592000246048, -0.0239571500569582, -0.01991921477019787, -0.013872675597667694, 0.01339857280254364, -0.0417918898165226, 0.017511099576950073, 0.029896819964051247, -0.0023114073555916548, 0.03657006099820137, 0.0071161058731377125, -0.0005893647903576493, 0.09889287501573563, -0.03600399196147919, 0.009282330982387066, 0.056799180805683136, 0.08814705908298492, -0.012406498193740845, 0.04570615664124489, 0.03273026645183563, -0.003782032523304224, -0.06813178956508636, 0.047287601977586746, -0.08457693457603455, 0.04567449912428856, -0.0680108368396759, -0.03885670751333237, -0.03752219304442406, 0.016711002215743065, -0.043255358934402466, -0.12210440635681152, 0.0324210524559021, -0.07181310653686523, -0.0077621471136808395, -0.07401653379201889, 0.017102980986237526, -0.07969199120998383, 0.01009190920740366, -0.033405713737010956, -0.012143731117248535, -0.013879336416721344, 0.036310888826847076, 0.016421185806393623, -0.02809232659637928, 0.0333624891936779, 0.05547914654016495, 0.016596056520938873, 0.021623151376843452, 0.05224016308784485, 0.03630140796303749, -0.018627380952239037, 0.08533115684986115, 0.02027890458703041, 0.046888090670108795, 0.00739976717159152, -0.012109984643757343, -0.13687652349472046, 0.003998446278274059, -0.06173727661371231, -0.06788691133260727, -0.012918355874717236, 0.008905122987926006, -0.02135368250310421, -0.017336884513497353, -0.010855307802557945, 8.579334499216926e-34, 0.0155482804402709, 0.011462876573204994, -0.018653791397809982, -0.11129899322986603, 0.02558247186243534, -0.04045925289392471, -0.018915187567472458, -0.020401546731591225, 0.03395628184080124, -0.03958789259195328, -0.06911110877990723, -0.004573027603328228, -0.06336761265993118, 0.06926664710044861, 0.03728971257805824, -0.06121924892067909, -0.06420591473579407, 0.08789998292922974, 0.02339506708085537, -0.031812284141778946, 0.039761222898960114, -0.030967557802796364, -0.03605106472969055, -0.0533633716404438, -0.008339572697877884, 0.003960589878261089, 0.054930321872234344, 0.09758126735687256, 0.02925793267786503, 0.006411944516003132, 0.01675444468855858, -0.018910981714725494, -0.07571008056402206, -0.01135820709168911, 0.039232008159160614, -0.02399991825222969, 0.014013242907822132, -0.05008025839924812, 0.03771820664405823, -0.030505992472171783, 0.02301681786775589, 0.03974039480090141, 0.028755618259310722, -0.0012045541079714894, -0.013877542689442635, -0.01462429016828537, -0.03880348801612854, 0.05233210325241089, -0.021651053801178932, -0.044236257672309875, -0.015826167538762093, 0.0574149452149868, -0.09000426530838013, 0.02484409511089325, 0.026266882196068764, -0.001983923139050603, 0.03599274158477783, 0.050120383501052856, 0.03592121601104736, -0.0052517070434987545, 0.06710858643054962, -0.07489252835512161, 0.043247055262327194, -0.053018707782030106, -0.057531122118234634, 0.07847527414560318, 0.06872214376926422, 0.001144006964750588, 0.035608332604169846, 0.040318913757801056, 0.017517004162073135, 0.057598985731601715, -0.06946590542793274, 0.053254853934049606, 0.026712782680988312, -0.03301868587732315, 0.07958097755908966, 0.045214805752038956, 0.006034994497895241, 0.028061315417289734, -0.09609442949295044, 0.08176961541175842, -0.01768886111676693, -0.014765742234885693, -0.08514851331710815, -0.016299273818731308, -0.017028961330652237, -0.07210098206996918, -0.02468528226017952, 0.016217168420553207, -0.0023087256122380495, 0.03925570100545883, -0.08876029402017593, 0.09295827150344849, -0.03969484195113182, -1.8295928558785722e-33, -0.02336561307311058, -0.01511901244521141, -0.011544168926775455, 0.029496166855096817, -0.042122263461351395, 0.04450181871652603, -0.09575419127941132, 0.008534448221325874, 0.006106319837272167, -0.04266918823122978, 0.10208291560411453, -0.029823224991559982, -0.1478312611579895, 0.016843412071466446, 0.08066053688526154, 0.013222896493971348, 0.015075964853167534, 0.030630648136138916, -0.04187565669417381, -0.04117868095636368, 0.07406503707170486, 0.06888370960950851, -0.021335724741220474, 0.03970904275774956, -0.024821005761623383, -0.037862710654735565, -0.028932860121130943, 0.09723591804504395, 0.010833890177309513, 0.0013895806623622775, 0.04659596458077431, 0.023690521717071533, -0.14195989072322845, -0.03879119083285332, -0.027991797775030136, 0.023565655574202538, 0.009084285236895084, -0.018827661871910095, -0.055620647966861725, 0.1029387041926384, 0.07383298873901367, 0.03490413725376129, -0.01662568747997284, -0.0069171045906841755, 0.07780878990888596, -0.00031408763607032597, 0.01212918758392334, -0.08342532068490982, 0.04005982354283333, -0.05820171907544136, 0.08396368473768234, -0.0985412523150444, -0.007227839902043343, 0.06611154973506927, -0.05958998203277588, -0.036040082573890686, -0.01681605540215969, 0.05646909400820732, 0.010230996645987034, 0.005887424573302269, -0.07004490494728088, 0.06461072713136673, -0.06477881222963333, -0.013975370675325394, -0.1002996638417244, 0.05115832760930061, 0.07011379301548004, -0.049615323543548584, 0.0531977042555809, 0.06135701388120651, 0.014429038390517235, -0.010671612806618214, 0.013879885897040367, 0.06371116638183594, -0.03229280561208725, -0.031230561435222626, 0.04040364921092987, 0.0032125653233379126, -0.07663004100322723, -0.04889540374279022, 0.004249435383826494, 0.02874881774187088, 0.10659696161746979, 0.027211232110857964, -0.016894012689590454, 0.03961074352264404, 0.019923679530620575, 0.08544792234897614, 0.02125147543847561, 0.07340959459543228, -0.021562935784459114, 0.026289768517017365, -0.04815934598445892, -0.07909979671239853, -0.04454520717263222, -4.441485756956354e-08, -0.021384960040450096, 0.08760108798742294, -0.02714363858103752, 0.006936906836926937, -0.054233018308877945, -0.01949823461472988, -0.08322480320930481, 0.05388355627655983, -0.10077448189258575, -0.02255886420607567, 0.014774031937122345, 0.0402669832110405, -0.05745634809136391, -0.035974957048892975, -0.03588642552495003, 0.051132459193468094, -0.04236667603254318, 0.046901386231184006, 0.0503455325961113, -0.06236062943935394, -0.0032589714974164963, -0.007459506392478943, 0.10926684737205505, 0.00803646631538868, 0.013027996756136417, -0.08320669829845428, 0.05771666020154953, 0.0015449924394488335, 0.06498405337333679, -0.022986479103565216, 0.057160645723342896, 0.06567806750535965, 0.028730422258377075, 0.06543523073196411, 0.09933742880821228, 0.08826804906129837, 0.032174430787563324, 0.03156256303191185, -0.014669821597635746, 0.118995301425457, -0.03377952799201012, -0.007384576369076967, 0.017714018002152443, -0.021833177655935287, 0.06991948932409286, 0.08756265789270401, -0.036561932414770126, -0.008649551309645176, -0.04026767238974571, -0.047085028141736984, 0.08563175797462463, -0.0012040681904181838, -0.03472629189491272, -0.03356624394655228, 0.021890340372920036, -0.053763892501592636, -0.05300993472337723, -0.13383989036083221, 0.010080438107252121, -0.0004593761404976249, -0.02565324679017067, -0.0980040431022644, 0.0038797545712441206, 0.007286266423761845 ] }, { "text": "# Adam\n\nRef: https://arxiv.org/pdf/1412.6980.pdf\n\n # t is your iteration counter going from 1 to infinity\n first_moment, second_moment = 0, 0\n for t in range(iterations):\n first_moment = beta1 * first_moment + (1-beta1) * gradient\n first_unbias = first_moment / (1-beta1**t)\n \n second_moment = beta2 * second_moment + (1-beta2)*(gradient**2)\n second_unbias = second_moment / (1-beta2**t)\n \n w += - learning_rate * first_unbias / (np.sqrt(second_unbias) + eps)\n \nThe method computes individual adaptive learning rates for different parameters from estimates of first and second \nmoments of the gradients; the name Adam is derived from adaptive moment estimation.\n\nWithout bias:", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_8", "embedding": [ -0.11413451284170151, -0.09821827709674835, -0.04308590292930603, 0.0730094164609909, 0.04492861405014992, -0.04369254782795906, 0.011304411105811596, 0.0016848549712449312, 0.03940851241350174, -0.01305046770721674, 0.005193091928958893, 0.04173245280981064, 0.024886479601264, -0.07802531868219376, -0.11210694909095764, 0.028278326615691185, -0.04092765972018242, 0.03743022307753563, 0.02843448519706726, -0.036808665841817856, -0.005682758521288633, 0.059672992676496506, 0.04884059727191925, -0.028189826756715775, 0.09808730334043503, -0.017589464783668518, -0.042922262102365494, 0.02108573727309704, 0.05950099229812622, -0.045417021960020065, 0.16470015048980713, -0.04598749428987503, 0.012843340635299683, -0.02754085883498192, -0.07620353996753693, -0.015691017732024193, -0.02099418267607689, 0.029429372400045395, -0.06668470799922943, 0.0779377669095993, -0.0037823666352778673, 0.0065820966847240925, -0.07331764698028564, -0.09354852885007858, 0.14452198147773743, 0.04016776382923126, -0.030106818303465843, -0.01898753084242344, 0.026981404051184654, 0.044830821454524994, 0.019021743908524513, -0.07032626867294312, -0.05297937989234924, -0.034877754747867584, 0.040297362953424454, -0.022189268842339516, -0.03755275532603264, 0.0061013041995465755, 0.03031507506966591, 0.009263373911380768, 0.06022359058260918, -0.11083890497684479, -0.006814394611865282, 0.011644323356449604, -0.022189104929566383, -0.041095294058322906, -0.027457261458039284, -0.005299672484397888, -0.011258121579885483, -0.002531948499381542, -0.01959829032421112, 0.06874492764472961, -0.06428200006484985, 0.0010864675277844071, 0.05438806489109993, -0.05461980029940605, 0.09237387776374817, 0.03727889806032181, 0.07120534777641296, -0.08217614889144897, 0.031206348910927773, 0.006099608726799488, 0.07319482415914536, -0.09712599217891693, 0.014344213530421257, 0.022253764793276787, 0.034219469875097275, 0.04183301702141762, 0.044756919145584106, 0.01773003675043583, 0.0038872594013810158, -0.02088792622089386, -0.15511323511600494, -0.004488010425120592, 0.07171741127967834, -0.007925664074718952, -0.01870892383158207, 0.004858136642724276, -0.07301738858222961, 0.05839507281780243, 0.004117504693567753, -0.04847114160656929, -0.0171015914529562, 0.02745578996837139, -0.006888721603900194, -0.001511772396042943, 0.06015286222100258, 0.02448958344757557, 0.029956143349409103, -0.004534468054771423, 0.0050023202784359455, 0.024469302967190742, -0.05750430002808571, 0.04940398409962654, 0.06503637880086899, -0.09929005801677704, 0.01923658885061741, 0.015101770870387554, 0.02745169587433338, 0.035288505256175995, -0.03316102549433708, -0.008916914463043213, -0.05629734322428703, 0.030289482325315475, -0.04974013566970825, -0.004026944283396006, -0.02817644365131855, 4.8555333323630193e-33, -0.030993402004241943, 0.09589174389839172, 0.01766657829284668, -0.07665493339300156, 0.0027921348810195923, 0.006499177776277065, -0.024722913280129433, -0.0062385015189647675, -0.007218858227133751, 0.018884334713220596, -0.08863505721092224, -0.008381705731153488, -0.040949828922748566, -0.009386293590068817, 2.8572356313816272e-05, -0.06042022630572319, -0.033010948449373245, 0.005488279275596142, 0.14456750452518463, -0.0073026446625590324, 0.045787911862134933, -0.031625885516405106, -0.00953355897217989, -0.06362041085958481, -0.11104601621627808, 0.060414571315050125, 0.08100607246160507, 0.057731881737709045, -0.030249841511249542, 0.004361097235232592, 0.02697485126554966, -0.03961256146430969, -0.08437191694974899, -0.028420936316251755, -0.009695381857454777, -0.05616416409611702, 0.05474228411912918, 0.04660603404045105, -0.04414760693907738, 0.02758137509226799, -0.02858838625252247, 0.09242015331983566, 0.07379742711782455, -0.011647036299109459, -0.14299818873405457, -0.09403406828641891, 0.04671570658683777, 0.01133495382964611, 0.12293685972690582, 0.03011278063058853, -0.04975132271647453, 0.007831917144358158, -0.024615146219730377, -0.07370071113109589, -0.005716697778552771, 0.09926089644432068, 0.003940185531973839, 0.09926409274339676, 0.021747631952166557, -0.004239997360855341, 0.03094233013689518, -0.008206496946513653, 0.027114663273096085, -0.017592350021004677, 0.006772532593458891, 0.030064024031162262, -0.01653430052101612, 0.02433548867702484, 0.05073057860136032, 0.0006783539429306984, 0.02382460981607437, -0.008029513992369175, 0.013528035953640938, -0.04288210719823837, 0.029982436448335648, 0.0012468378990888596, 0.025749918073415756, -0.047805964946746826, -0.00857959408313036, -0.006901316810399294, -0.11884978413581848, 0.05970679596066475, -0.038675472140312195, -0.03334386274218559, -0.13248267769813538, 0.005329531617462635, 0.03774428367614746, -0.0435580350458622, -0.0038911723531782627, 0.03753224387764931, -0.01265991572290659, -0.026646941900253296, -0.03043600171804428, 0.04795138165354729, -0.07874680310487747, -5.771680201273309e-33, 0.0163638424128294, 0.023472217842936516, 0.040599483996629715, 0.001588580315001309, 0.017027778550982475, 0.002725526923313737, -0.01646255888044834, 0.008362125605344772, 0.013389860279858112, -0.04933188855648041, 0.017902448773384094, 0.0009265479166060686, -0.00937673356384039, 0.013407984748482704, 0.12721560895442963, -0.09573531895875931, -0.019689111039042473, 0.0042185247875750065, 0.032043568789958954, -0.003411847399547696, 0.060045674443244934, 0.07491259276866913, -0.015188283286988735, -0.03268064931035042, -0.03901810571551323, -0.0065896231681108475, 0.014203262515366077, 0.11209463328123093, 0.04100244864821434, -0.041163090616464615, -0.03838255628943443, -0.011151954531669617, -0.03271422162652016, 0.07295481860637665, -0.0012006815522909164, 0.07722795009613037, -0.01584787853062153, -0.014657498337328434, 0.01111262571066618, 0.03490329906344414, 0.09047294408082962, 0.032452479004859924, -0.04325966164469719, -0.01138434000313282, 0.07726244628429413, 0.025537975132465363, 0.01613771542906761, 0.05930299684405327, 0.005791982635855675, -0.03379657864570618, -0.02146165445446968, -0.008903028443455696, -0.10655291378498077, 0.05773311108350754, -0.056352466344833374, -0.03917317092418671, -0.04226987808942795, -0.01781732589006424, 0.09401167184114456, -0.00023477396462112665, -0.050490666180849075, -0.032217469066381454, -0.04185553640127182, -0.00875180121511221, -0.04276243969798088, 0.07059536129236221, -0.01945997029542923, -0.030244169756770134, 0.01902473345398903, 0.08474376797676086, 0.024577422067523003, 0.020315492525696754, -0.0064830295741558075, -0.013514149002730846, 0.02808072790503502, -0.06525895744562149, -0.015259825624525547, -0.08001556992530823, -0.06564921140670776, -0.1802995800971985, -0.06793152540922165, 0.0003572329005692154, -0.019929077476263046, 0.020422382280230522, 0.022143850103020668, 0.030499285086989403, 0.061127081513404846, 0.038680464029312134, 0.028750715777277946, -0.02241704799234867, 0.056175488978624344, 0.08068449050188065, -0.00026440672809258103, -0.024768736213445663, -0.06432735174894333, -4.955818866392292e-08, -0.0433814637362957, -0.04138730838894844, 0.02884487621486187, 0.026147890836000443, 0.0819309651851654, -0.0030095370020717382, -0.02684706635773182, -0.06787480413913727, -0.017276989296078682, -0.09202634543180466, 0.05999313294887543, 0.007376930210739374, 0.04510558769106865, -0.04866304248571396, 0.015966316685080528, 0.09222623705863953, 0.008489303290843964, 0.052341364324092865, 0.045722004026174545, -0.022548140957951546, 0.016711609438061714, 0.03906429558992386, 0.03467492759227753, -0.11636979877948761, 0.03933069482445717, -0.07481962442398071, -0.021860620006918907, 0.023542460054159164, 6.586811650777236e-05, -0.0454048253595829, 0.0005834422772750258, 0.06294269859790802, -0.01372517179697752, -0.007822285406291485, 0.06609894335269928, 0.06249209865927696, 0.01867355778813362, 0.09029316902160645, 0.013355023227632046, 0.010643511079251766, -0.06860332190990448, 0.014646269381046295, 0.02794557996094227, -0.0036588385701179504, -0.023468488827347755, 0.06298144161701202, -0.08543048053979874, -0.035767629742622375, 0.008170001208782196, -0.04824760556221008, 0.0821838527917862, -0.021203042939305305, -0.01063774898648262, 0.014240876771509647, 0.026053540408611298, -0.07197733223438263, -0.021402204409241676, -0.12034373730421066, 0.003639836795628071, 0.04302675649523735, 0.00927194207906723, 0.009438193403184414, -0.08797736465930939, -0.05031251162290573 ] }, { "text": "Without bias: \n\nAt very first time step, second moment is zero. After one update teh second moment will still close to zero. When we\ndivide by second moment, we make a very large step at the beginning. But this big step is not related with the geometry of the \nloss function, it is the nature of the formula. \n\nBias correction term help to aviod the very large step at the beginning. \n\nYou can start with these parameters:\n\n beta1 = 0.9\n beta2 = 0.999\n lr = 1e-3 or 1e-5 \n \n \nRMSProp with momentum generates its parameter updates using a momentum on the rescaled gradient, whereas Adam updates are\ndirectly estimated using a running average of first and second moment of the gradient.", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_9", "embedding": [ -0.04033089056611061, -0.03516017273068428, 0.08720191568136215, -0.024879051372408867, 0.07396622747182846, -0.020963091403245926, 0.007972346618771553, 0.010410485789179802, 0.11358271539211273, 0.04995645582675934, -0.03979126736521721, 0.02204248122870922, -0.006268647965043783, -0.08378048241138458, -0.031243979930877686, 0.017899617552757263, -0.04694272205233574, 0.09512325376272202, -0.107329361140728, -0.012084033340215683, -0.0059194923378527164, 0.022509315982460976, 0.0033496881369501352, -0.01177717000246048, 0.11970468610525131, -0.005322248674929142, -0.007562974467873573, -0.022228065878152847, 0.06724339723587036, -0.06399264931678772, 0.13600659370422363, -0.03345242142677307, 0.0324469693005085, -0.0336381271481514, -0.10516136139631271, -0.0007799175218679011, -0.012678348459303379, 0.014986210502684116, -0.05312926322221756, 0.029776647686958313, 0.008232257328927517, 0.044789720326662064, -0.02354838140308857, -0.012801830656826496, 0.09258861094713211, 0.05839872732758522, -0.030032185837626457, 0.02593190036714077, 0.045657236129045486, -0.014154019765555859, 0.01606856845319271, -0.08515559881925583, -0.034828070551157, -0.035250093787908554, 0.024749843403697014, 0.025649838149547577, -0.02281300723552704, 0.06618345528841019, 0.020490119233727455, 0.0680965930223465, 0.10551844537258148, -0.08960798382759094, 0.008810758590698242, -0.014553437009453773, -0.0007424403447657824, -0.03140715882182121, 0.026028212159872055, -0.09657996892929077, -0.022963913157582283, 0.024322787299752235, 0.03577319532632828, 0.07638947665691376, -0.08398723602294922, -0.03187407925724983, 0.0377780944108963, -0.021579554304480553, 0.10698629170656204, 0.09566110372543335, 0.0013009915128350258, -0.03307377174496651, 0.03697502985596657, -0.025894062593579292, 0.02162013202905655, -0.08006136119365692, 0.013358687050640583, 0.009121518582105637, 0.02001534216105938, 0.03911542147397995, -0.02967788279056549, 0.019757667556405067, -0.04225028306245804, -0.0369030125439167, -0.06542282551527023, -0.007247576490044594, 0.0515504814684391, 0.0310727059841156, -0.05793178081512451, -0.022947760298848152, -0.05406660959124565, 0.0564260259270668, -0.008093686774373055, -0.012737641111016273, -0.031803347170352936, -0.013715583831071854, 0.015126519836485386, 0.005125365685671568, 0.045554328709840775, 0.001211106893606484, 0.03470168635249138, 0.01607203483581543, 0.004099227953702211, 0.038096994161605835, -0.03220898658037186, 0.07542034983634949, 0.02798052504658699, -0.051876895129680634, -0.027671977877616882, 0.08219669759273529, 0.008770337328314781, 0.035573117434978485, -0.06666810810565948, 0.00706895999610424, -0.05047650635242462, 0.041977912187576294, -0.07820428907871246, 0.004881568253040314, -0.03899934142827988, 5.517609586970549e-33, -0.049901653081178665, 0.08556973934173584, -0.013844751752912998, -0.0751379206776619, 0.007382597774267197, 0.025001827627420425, -0.026010295376181602, -0.01921413466334343, 0.07752208411693573, -0.041182126849889755, -0.10981695353984833, -0.06600780040025711, -0.03306218236684799, -4.821566108148545e-05, -0.017549997195601463, -0.05454469844698906, -0.023753810673952103, 0.053752124309539795, 0.10777637362480164, 0.03959733620285988, -0.012693574652075768, -0.04643243923783302, -0.034373894333839417, -0.008833321742713451, -0.11692330986261368, 0.05921434983611107, 0.034858979284763336, 0.05882902815937996, -0.05723482370376587, -0.0075313434936106205, -0.03767232969403267, -0.04657239839434624, -0.0649917796254158, -0.0793587788939476, 0.01369011215865612, -0.05745526775717735, 0.03118853084743023, 0.03166469186544418, -0.01050950400531292, -0.03408757969737053, -0.031925130635499954, 0.13550399243831635, 0.008693618699908257, -0.02468159794807434, -0.09988141804933548, -0.13244037330150604, 0.015799809247255325, 0.017634961754083633, 0.14436867833137512, -0.009470485150814056, 0.042696986347436905, 0.011485198512673378, 0.005713874939829111, -0.05825495347380638, 0.021444140002131462, 0.06633751839399338, 0.044153906404972076, 0.06860009580850601, -0.0010783898178488016, 0.005130940582603216, 0.0565798357129097, 0.02561180293560028, 0.02507300116121769, -0.02516319416463375, -0.06992868334054947, 0.06684347242116928, 0.02971910871565342, -0.007558061741292477, -0.001361045753583312, 0.013646982610225677, 0.0163078922778368, 0.043928906321525574, -0.010419512167572975, -0.017385339364409447, 0.012646608054637909, -0.0008758848416619003, -0.016844766214489937, -0.05077868327498436, 0.04967525973916054, 0.03193928301334381, -0.04782496765255928, 0.06738270074129105, -0.07641162723302841, -0.03732116147875786, -0.11064303666353226, -0.038398806005716324, 0.04036035016179085, 0.001792261260561645, -0.014515970833599567, 0.08417227119207382, 0.00908630434423685, -0.035413287580013275, -0.013020754791796207, 0.06775910407304764, -0.01388439442962408, -6.549654688742146e-33, -0.03970903158187866, 0.011753397062420845, -0.021328141912817955, -0.0008702977211214602, -0.01487591490149498, 0.016545386984944344, -0.03896930441260338, 0.03607790172100067, -0.025641515851020813, -0.03307647630572319, -0.012589939869940281, -0.014240500517189503, -0.10093297064304352, -0.020547112450003624, 0.04634341597557068, -0.08220905065536499, 0.0531512014567852, -0.02062445878982544, 0.024658899754285812, -0.07666782289743423, 0.11756575107574463, 0.10474173724651337, -0.0438377670943737, -0.003091648453846574, 0.0266190804541111, -0.05107433348894119, -0.028945283964276314, 0.13964007794857025, 0.005788235459476709, -0.056897904723882675, -0.06860954314470291, 0.0022555063478648663, -0.11305858939886093, 0.04709899425506592, 0.014425026252865791, 0.045385442674160004, -0.03842596709728241, 0.04526757076382637, 0.0024884548038244247, -0.0055920942686498165, 0.045872822403907776, 0.06074858084321022, 0.010404817759990692, 0.01103605329990387, 0.0491926446557045, -0.0014842681121081114, 0.034418728202581406, 0.05063209310173988, -0.024146100506186485, 0.03736044839024544, -0.016579337418079376, 0.01504236925393343, -0.08488181233406067, 0.037010230123996735, -0.0012565174838528037, 0.034094300121068954, -0.04460219293832779, 0.017041487619280815, 0.042118582874536514, 0.04082988202571869, -0.11490602791309357, -0.0671427771449089, -0.039981771260499954, 0.005911774933338165, -0.0653558224439621, 0.13629736006259918, -0.03130495175719261, -0.03223244473338127, 0.06139511615037918, 0.04990416020154953, 0.03633086010813713, 0.012833072803914547, 0.020308619365096092, 0.051779646426439285, -0.028843622654676437, -0.09827694296836853, 0.0004205697914585471, -0.06809833645820618, -0.012035747058689594, -0.12056044489145279, -0.04937652871012688, 0.025523453950881958, 0.006991296540945768, 0.022265810519456863, 0.012488148175179958, 0.06612764298915863, 0.012060788460075855, 0.028765862807631493, 0.0653601884841919, -0.030966246500611305, 0.019027678295969963, 0.07235517352819443, -0.0005441929679363966, -0.036306243389844894, -0.020803634077310562, -5.440048056470914e-08, -0.04508281499147415, 0.010111887939274311, 0.029963161796331406, 0.0918903648853302, 0.038792554289102554, -0.07245664298534393, -0.05405786260962486, -0.01730363257229328, -0.027124673128128052, -0.08385694772005081, 0.004007101058959961, 0.014273988083004951, -0.03825974464416504, -0.030746761709451675, 0.014214188791811466, 0.04479028657078743, -0.007332420442253351, 0.00926445983350277, 0.04677311331033707, -0.028931189328432083, 0.037023793905973434, 0.008765768259763718, 0.017874017357826233, -0.09715639054775238, 0.02629944123327732, -0.10986530035734177, 0.04060175642371178, 0.039010509848594666, -0.013027726672589779, -0.044752396643161774, 0.02550625614821911, 0.0063627492636442184, -0.03226657211780548, 0.007767661940306425, 0.03511025011539459, 0.014463279396295547, 0.041172150522470474, 0.1020553857088089, 0.05624137818813324, 0.053964123129844666, -0.05249815434217453, -0.0029113832861185074, 0.06708932667970657, -0.01978781260550022, -0.052070602774620056, 0.04202192276716232, -0.0018151074182242155, -0.006958102807402611, -0.004248573444783688, -0.08418293297290802, 0.11866801232099533, -0.03873356431722641, -0.06075315922498703, 0.03336586430668831, 0.0064229099079966545, -0.08448918163776398, -0.04086260497570038, -0.11003024131059647, 0.04938729107379913, 0.04679103568196297, -0.050581712275743484, -0.003419557586312294, -0.1040993481874466, -0.04310385510325432 ] }, { "text": "RMSProp also lacks a bias-correction term; this matters most in case of a value of beta2 close to 1 (required in\ncase of sparse gradients), since in that case not correcting the bias leads to very large stepsizes and\noften divergence. \n\nDifferent Models comparison: {'sgd': 5e-3, 'sgd_momentum': 5e-3, 'rmsprop': 1e-4, 'adam': 1e-3}\n\n
\n \n
Figure 2: Different models
\n
\n\nDifferent Models comparison: {'sgd': 1e-3, 'sgd_momentum': 1e-3, 'rmsprop': 1e-3, 'adam': 1e-3}", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_10", "embedding": [ -0.025683490559458733, -0.08347344398498535, 0.03963494673371315, 0.03257695585489273, 0.09816458076238632, -0.01454180758446455, -0.06808865815401077, 0.06932946294546127, 0.061662450432777405, 0.04023701325058937, -0.006119925063103437, 0.022454380989074707, 0.009871300309896469, 0.026866868138313293, 0.014904570765793324, -0.0194868016988039, -0.012029299512505531, -0.008468886837363243, -0.06123846396803856, -0.017574239522218704, 0.011611172929406166, -0.05801062285900116, 0.015450911596417427, -0.023467762395739555, 0.08105066418647766, -0.015908258035779, -0.023218980059027672, 0.052172157913446426, 0.033600326627492905, -0.07844187319278717, 0.052189841866493225, -0.060427941381931305, -0.036069370806217194, -0.0026342771016061306, -0.039204780012369156, 0.07581949979066849, 0.013329806737601757, -0.06450290977954865, 0.005316183436661959, -0.007170269265770912, 0.02703830972313881, 0.041629500687122345, -0.023171473294496536, -0.07576467096805573, 0.15392065048217773, -0.01310404110699892, -0.014171346090734005, 0.008331774733960629, 0.04666329175233841, -0.053176894783973694, -0.02990701235830784, -0.09941014647483826, -0.040295980870723724, -0.05264542996883392, -0.07074189186096191, 0.06859994679689407, 0.07296975702047348, -0.028078610077500343, 0.09283977746963501, 0.005078830290585756, 0.015058253891766071, -0.0671161636710167, 0.005731008015573025, -0.015082010999321938, 0.04273813217878342, -0.0014595231041312218, -0.05035628378391266, -0.04968780651688576, -0.03641480207443237, 0.0924341082572937, -0.009566978551447392, 0.022774336859583855, -0.002781324088573456, -0.0008215978741645813, 0.023272447288036346, -0.04678117483854294, 0.01788811944425106, 0.045160531997680664, 0.0781741589307785, -0.0809897854924202, 0.027156107127666473, -0.05131165683269501, -0.008827459998428822, -0.05091327428817749, 0.07170667499303818, 0.0017231192905455828, 0.04895739629864693, -0.02510734461247921, -0.04041500762104988, -0.06786029040813446, -0.05341459438204765, -0.031058425083756447, -0.0822894498705864, 0.14445778727531433, -0.03234793618321419, 0.010107637383043766, -0.029577413573861122, -0.015814252197742462, -0.06236628070473671, 0.08764250576496124, -0.028032740578055382, -0.029798055067658424, 0.051737140864133835, 0.018505603075027466, 0.01965024136006832, 0.003542722901329398, 0.08686523139476776, 0.05407169833779335, -0.0009841015562415123, 0.015286868438124657, 0.023623012006282806, 0.046871013939380646, -0.07356558740139008, 0.08555009961128235, 0.02746015414595604, 0.036014288663864136, -0.02958386205136776, -0.01834074780344963, -0.022892510518431664, 0.027084292843937874, 0.021042024716734886, -0.03992125764489174, 0.01171964779496193, 0.048332564532756805, -0.02633742056787014, -0.016820939257740974, -0.10208137333393097, 8.046557113070079e-33, -0.013125191442668438, 0.018970932811498642, 0.02500777319073677, -0.0769835114479065, 0.045760929584503174, 0.019010493531823158, -0.07753165066242218, -0.02167058177292347, -0.031224748119711876, -0.02976696752011776, -0.08167946338653564, 0.006470024585723877, -0.09445767849683762, 0.01247193943709135, 0.05797026306390762, 0.0033708096016198397, -0.013547085225582123, 0.09494016319513321, 0.046687569469213486, -0.004776007495820522, -0.015209522098302841, -0.03886730596423149, -0.048029012978076935, 0.007338865660130978, -0.02197325974702835, 0.045005425810813904, 0.04535994306206703, 0.08993372321128845, -0.015231362544000149, 0.016854051500558853, 0.012793540954589844, 0.01381286233663559, 0.030334368348121643, -0.016577735543251038, 0.007237663026899099, -0.011300342157483101, 0.02475348487496376, -0.010761585086584091, -0.03591125085949898, 0.0038857534527778625, 0.014531640335917473, 0.05772578716278076, -0.008277294225990772, -0.005321453791111708, -0.07030672580003738, -0.03130510076880455, 0.01572464406490326, 0.043951477855443954, 0.04463991895318031, -0.023278234526515007, -0.00788412056863308, 0.04434295743703842, -0.04647902771830559, 0.002821417525410652, -0.016438033431768417, -0.0014174722600728273, -0.004415969830006361, 0.006118858233094215, 0.010823512449860573, -0.07199662923812866, 0.1031222715973854, -0.038011178374290466, 0.019225899130105972, -0.05721166357398033, -0.051416464149951935, 0.1146504282951355, 0.022851204499602318, 0.0461074560880661, -0.014417276717722416, 0.018589356914162636, -0.05074552446603775, 0.07498142123222351, 0.011270331218838692, -0.023334339261054993, 0.04790407419204712, -0.0478254072368145, 0.06437217444181442, 0.08135340362787247, -0.0049748970195651054, 0.0680258646607399, -0.10965397953987122, 0.06056569516658783, -0.07397019863128662, -0.08824453502893448, -0.11134321987628937, -0.007710928563028574, 0.033191829919815063, -0.03171633556485176, -0.03097604028880596, 0.007707084529101849, 0.027182307094335556, 0.08133919537067413, -0.038036197423934937, 0.04680950194597244, -0.05856754258275032, -6.942125069174845e-33, -0.016822243109345436, 0.052919235080480576, 0.054179590195417404, 0.07919340580701828, 0.010604191571474075, -0.013901985250413418, 0.05403174087405205, -0.04870948567986488, 0.01170313823968172, -0.059294506907463074, 0.06991175562143326, -0.08482395112514496, -0.09666264802217484, -0.1220007911324501, 0.02973897196352482, -0.01574530266225338, 0.022067386656999588, -0.037456538528203964, 0.014205914922058582, 0.003391377395018935, 0.11670679599046707, 0.1086134985089302, 0.013057246804237366, 0.048574671149253845, -0.06614524126052856, 0.06552992761135101, -0.013324195519089699, 0.026537327095866203, -0.010093404911458492, -0.0434025414288044, 0.029878173023462296, 0.056805916130542755, -0.11901244521141052, -0.030227158218622208, -0.05867703631520271, 0.025037690997123718, -0.08631227910518646, -0.014757332392036915, -0.008432544767856598, 0.08180887252092361, 0.04233451187610626, 0.07237640023231506, -0.06767261773347855, -0.011265234090387821, 0.02342601679265499, -0.01215173490345478, 0.10613198578357697, -0.07217469066381454, 0.08292841911315918, -0.026237428188323975, 0.015716807916760445, -0.035629719495773315, -0.05448909103870392, 0.092095747590065, -0.07914108037948608, -0.04621177911758423, -0.11126567423343658, 0.06957270950078964, 0.046366773545742035, 0.02005729079246521, -0.01180807501077652, -0.02128218114376068, -0.1302696317434311, -0.008881499990820885, -0.059690993279218674, 0.018766961991786957, -0.04317111894488335, -0.03912288323044777, 0.0990045964717865, 0.09763333201408386, -0.018679408356547356, -0.018283363431692123, 0.07655733078718185, 0.023006165400147438, -0.042029786854982376, 0.006155629642307758, -0.04111636057496071, 0.018475499004125595, -0.005987927317619324, -0.06961128115653992, -0.016650928184390068, 0.09659790992736816, -0.013216783292591572, 0.04637308418750763, -0.03857998922467232, 0.0759788528084755, -0.015650132670998573, 0.08664019405841827, 0.05297280475497246, 0.03396792709827423, 0.004535621497780085, 0.0268776286393404, 0.07725637406110764, -0.01219737809151411, 0.013939577154815197, -6.160689736134373e-08, 0.02396564930677414, 0.054254595190286636, 0.02086615562438965, 0.0008163269958458841, -0.055265191942453384, -0.07919126749038696, -0.043259087949991226, 0.012618775479495525, 0.023692751303315163, -0.03787783533334732, -0.0250884760171175, 0.07441849261522293, -0.08860999345779419, -0.03682158142328262, -0.03397601842880249, 0.001389209763146937, -0.04758504033088684, 0.08393478393554688, 0.028344841673970222, -0.041167471557855606, -0.024883687496185303, -0.004133694805204868, 0.032160356640815735, -0.019686590880155563, -0.014299844391644001, -0.05824572965502739, -0.05343318730592728, 0.013515504077076912, 0.023432686924934387, -0.02970094233751297, 0.02690786123275757, 0.020797817036509514, 0.010220611467957497, -0.06239791959524155, 0.04673977568745613, 0.0390128418803215, 0.001651702681556344, 0.062300264835357666, -0.0012112166732549667, 0.09453245997428894, -0.0052822851575911045, -0.026394078508019447, 0.013748470693826675, 0.0035618916153907776, -0.0366906113922596, 0.05523111671209335, 0.058472905308008194, -0.01355508342385292, 0.0029212955851107836, -0.027394575998187065, 0.07026463001966476, -0.03546882048249245, -0.12393038719892502, 0.010107994079589844, -0.004225539974868298, -0.0996609479188919, 0.009513108991086483, -0.042968958616256714, -0.03220105916261673, 0.029263459146022797, 0.06834816187620163, -0.1484384834766388, -0.05752527713775635, -0.008362681604921818 ] }, { "text": "Different Models comparison: {'sgd': 1e-3, 'sgd_momentum': 1e-3, 'rmsprop': 1e-3, 'adam': 1e-3}\n\n
\n \n
Figure 3: Different models with the same learning rate
\n
", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_11", "embedding": [ 0.01645044982433319, -0.08448999375104904, 0.013217991217970848, 0.030377615243196487, 0.10867003351449966, -0.04371848329901695, -0.10775143653154373, 0.0397905558347702, 0.09881573170423508, 0.015238447114825249, 0.05754970759153366, 0.037770092487335205, -0.004111690912395716, 0.05176312476396561, 0.04186255484819412, -0.06549198180437088, 0.011814572848379612, 0.015329454094171524, -0.0885201245546341, 0.010803477838635445, 0.03775310888886452, -0.0995977446436882, 0.04752642661333084, -0.028713665902614594, 0.08395983278751373, 0.00277349422685802, 0.005936469417065382, 0.06555714458227158, 0.051229327917099, -0.1006808802485466, 0.038497477769851685, -0.04358929768204689, -0.0630434975028038, -0.02860938385128975, -0.059933315962553024, 0.05321458727121353, 0.014322159811854362, -0.05273740366101265, 0.03690454363822937, -0.015029756352305412, -0.021410251036286354, 0.010005934163928032, 0.036940786987543106, -0.10441381484270096, 0.09050003439188004, 0.0286041721701622, -0.07753637433052063, -0.009680094197392464, 0.027152763679623604, -0.058551348745822906, -0.06413983553647995, -0.11567677557468414, -0.06281565129756927, -0.08446525782346725, -0.02261922135949135, 0.06193456053733826, 0.02247794158756733, -0.04480009898543358, 0.06032674014568329, -0.041081126779317856, -0.025571005418896675, -0.02811439521610737, 0.0011669202940538526, 0.020718205720186234, 0.09092136472463608, -0.023908987641334534, -0.035041067749261856, -0.03779202699661255, -0.051375873386859894, 0.04766495153307915, 0.027000876143574715, 0.016991596668958664, 0.015912415459752083, -0.039853159338235855, 0.0298579353839159, -0.009889991953969002, 0.03169507533311844, 0.031807802617549896, 0.03287171944975853, -0.06598466634750366, -0.017184868454933167, -0.04137040674686432, -0.01049185823649168, -0.05486590042710304, 0.06843537837266922, 0.013223336078226566, 0.0462307408452034, -0.020895976573228836, -0.0376308299601078, -0.09105038642883301, -0.04741216078400612, 0.0149518558755517, -0.06834306567907333, 0.11317179352045059, -0.05676042661070824, 0.06014695018529892, -0.015922700986266136, 0.004305003676563501, -0.07345321029424667, 0.06745989620685577, 0.010001513175666332, -0.028332656249403954, 0.08242446184158325, 0.037902239710092545, 0.05790412425994873, 0.030969591811299324, 0.0424196720123291, 0.016028182581067085, 0.04069232568144798, -0.006703842431306839, 0.014776775613427162, 0.07198021560907364, -0.11288321018218994, 0.05635572969913483, -0.019567741081118584, 0.010782696306705475, -0.04337378963828087, -0.029490770772099495, 0.041289910674095154, 0.04899267852306366, 0.014440943486988544, 0.014915799722075462, 0.032281544059515, 0.01565975323319435, 0.00298951449804008, -0.04864271357655525, -0.09737502038478851, 6.271584887899411e-33, -0.01924108900129795, -0.056051772087812424, 8.259735477622598e-05, -0.10473155230283737, 0.08690482378005981, 0.044204678386449814, -0.09307093173265457, 0.01058637909591198, -0.043921489268541336, -0.07030840218067169, -0.09581935405731201, 0.03244287148118019, -0.06012677028775215, 0.032971616834402084, 0.03933415934443474, -0.007464716210961342, -0.042689114809036255, 0.04780035838484764, 0.008726678788661957, -0.020242683589458466, 0.006048666778951883, -0.05884536728262901, -0.01945253275334835, 0.04999863728880882, 0.006547919008880854, 0.047558508813381195, 0.03404916822910309, 0.08272135257720947, -0.08105449378490448, -0.002644292078912258, 0.03537873923778534, 0.02539212256669998, 0.04257606342434883, -0.023372724652290344, -0.029495831578969955, -0.0059404317289590836, 0.024041282013058662, 0.023050582036376, -0.03732835873961449, -0.06386091560125351, 0.024614622816443443, 0.034371960908174515, -0.022434595972299576, -0.009426538832485676, -0.08002617955207825, 0.010046418756246567, 0.02462901547551155, -0.029062220826745033, -0.0018415605882182717, 0.006121030542999506, -0.0002489596081431955, 0.004245941527187824, -0.0890149474143982, -0.014971848577260971, 0.01710861548781395, -0.01965370401740074, 0.013854186981916428, 0.031259436160326004, -0.007231906056404114, -0.04725877568125725, 0.10515441000461578, 0.023902101442217827, 0.03854671120643616, -0.03454754129052162, -0.00425207894295454, 0.10202591121196747, 0.022937985137104988, 0.06747668236494064, 0.037122126668691635, 0.020307578146457672, -0.04962340369820595, 0.013786674477159977, 0.0013946242397651076, 0.006669365800917149, 0.05625225976109505, -0.07343069463968277, 0.015138453803956509, 0.025943787768483162, -9.637993207434192e-05, 0.06841831654310226, -0.07897143065929413, 0.0478256456553936, -0.07450694590806961, -0.09608856588602066, -0.1426776498556137, 0.005679937079548836, 0.0027507932391017675, -0.030740467831492424, 0.03859609365463257, 0.027232907712459564, 0.0223403237760067, 0.05142686143517494, -0.017833778634667397, 0.014773382805287838, -0.039579764008522034, -6.598774189559194e-33, -0.03939270228147507, 0.07391615957021713, 0.020332349464297295, 0.12590058147907257, 0.013011245988309383, 0.01022457517683506, 0.04581679031252861, -0.04886219650506973, -0.02377634309232235, -0.05574251711368561, 0.07535811513662338, -0.039260465651750565, -0.11196515709161758, -0.12447397410869598, 0.04316021129488945, 0.005117724649608135, 0.030639594420790672, -0.058968305587768555, 0.011277388781309128, 0.022504033520817757, 0.05428342893719673, 0.11810268461704254, -0.008176443167030811, 0.021671637892723083, -0.032945018261671066, 0.024844815954566002, -0.02122851461172104, 0.020305274054408073, -0.045874375849962234, -0.05528579279780388, 0.03214238956570625, 0.044469449669122696, -0.049927644431591034, 1.191544288303703e-05, -0.04102007672190666, 0.030333375558257103, -0.07460996508598328, -0.036514364182949066, 0.028482962399721146, 0.09794262051582336, 0.056593187153339386, 0.04246372729539871, -0.030765347182750702, 0.02759745717048645, -0.01401511114090681, 0.014460144564509392, 0.06919167190790176, -0.06384152173995972, 0.08891892433166504, -0.013798560947179794, 0.0003691552556119859, -0.0159479808062315, -0.022930357605218887, 0.017121771350502968, -0.05373340845108032, -0.0387544110417366, -0.03695555776357651, 0.020845377817749977, 0.022204946726560593, 0.08782805502414703, 0.01186417043209076, -0.03170642629265785, -0.08927261084318161, 0.011323679238557816, -0.06206323206424713, 0.02026248723268509, -0.07397063821554184, -0.01982145570218563, 0.06814239919185638, 0.07713805884122849, -0.0018125752685591578, -0.018099097535014153, 0.08458013087511063, 0.01919465884566307, -0.06706865131855011, -0.03046027012169361, 0.009151741862297058, 0.10541939735412598, -0.013203565962612629, -0.09839754551649094, -0.026387017220258713, 0.04367997497320175, -0.059364259243011475, 0.04454604163765907, -0.07944431155920029, 0.11594387143850327, -0.032978884875774384, 0.01822901889681816, 0.027223963290452957, 0.005419835448265076, 0.007486536633223295, 0.038099322468042374, 0.035139989107847214, -0.0006637384067289531, 0.03026539459824562, -5.018022264380306e-08, -0.014874397777020931, 0.0027689472772181034, 0.050967227667570114, -0.013539974577724934, -0.004632269963622093, 0.005093011539429426, -0.06700956076383591, 0.05160987749695778, -0.012207310646772385, 0.03405801206827164, 0.04627488926053047, 0.058171410113573074, -0.08339350670576096, -0.006150033790618181, -0.017086245119571686, 0.016683921217918396, -0.03641276806592941, 0.09623043239116669, 0.04207959771156311, -0.005316676571965218, 0.00015520845772698522, -0.006024928297847509, 0.035061657428741455, -0.03493543714284897, -0.01419212855398655, -0.010332692414522171, -0.08726253360509872, 0.08564318716526031, -0.01225114893168211, -0.01290377601981163, 0.06268476694822311, 0.01675248332321644, 0.00805592443794012, -0.07377319037914276, 0.047421302646398544, -0.02514713630080223, -0.05506982281804085, 0.039100129157304764, 0.0021200603805482388, 0.1056092232465744, 0.018755413591861725, -0.045419637113809586, -0.0033482268918305635, 0.0038778861053287983, -0.02102201245725155, 0.051310427486896515, 0.04995943605899811, -0.12541291117668152, 0.013339083641767502, 0.010562941431999207, 0.02575847879052162, -0.04685945436358452, -0.09363719075918198, 0.012489133514463902, 0.0053438423201441765, -0.09419338405132294, 0.034482646733522415, -0.03187510743737221, -0.04490254074335098, 0.050299737602472305, 0.10287059098482132, -0.14952540397644043, -0.045287519693374634, 0.05456596985459328 ] }, { "text": "## Change LR\n\nyou can change learning rate during the training:\n\n- Step Decay\n- Exponential Decay\n- 1/t decay\n\nStart with no decay. Select the best learning rate. Check the loss plot and decide where you need decay. \n\n#### 'sgd' : \n\n
\n \n
Figure 4: SGD, learning rates: [1e-4, 5e-3, 3e-3, 1e-3, 1e-2]
\n
\n\n\n#### 'sgd_momentum':\n\n
\n \n
Figure 5: SGD with Momentum, learning rates: [1e-4, 5e-3, 3e-3, 1e-3, 1e-2]
\n
\n\n#### 'rmsprop':", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_12", "embedding": [ -0.017939269542694092, -0.0502890907227993, 0.004791043233126402, 0.019417304545640945, 0.09940014034509659, -0.031340934336185455, -0.07875729352235794, 0.03140097111463547, 0.052025310695171356, 0.010476624593138695, 0.04888293892145157, 0.03675916790962219, -0.0067695314064621925, 0.014683772809803486, 0.0034680862445384264, 0.020774491131305695, -0.05937198922038078, 0.0739680603146553, -0.0843789353966713, -0.015791021287441254, 0.014232906512916088, -0.09644784033298492, 0.0742974579334259, 0.00368289090692997, 0.07129627466201782, -0.022028181701898575, -0.0016958402702584863, -0.001989061012864113, 0.025307388976216316, -0.08953310549259186, 0.07949334383010864, -0.03142280504107475, -0.0521368682384491, -0.03134162351489067, -0.026872234418988228, 0.08368870615959167, -0.02365420199930668, 0.005630661267787218, 0.03168367221951485, 0.002114445436745882, -0.03488776832818985, -0.01134978886693716, -0.0006096756551414728, -0.10064898431301117, 0.09284665435552597, 0.027349069714546204, -0.044422585517168045, -0.05372372642159462, 0.021947143599390984, -0.008633189834654331, -0.029933754354715347, -0.0787787139415741, -0.056091662496328354, -0.04479045420885086, -0.05059758573770523, 0.0464489609003067, 0.06851774454116821, -0.054095957428216934, 0.03430279344320297, -0.04633548483252525, 0.002849181881174445, -0.04812491312623024, 0.02791431173682213, -0.06571850925683975, 0.0285841953009367, -0.011235431768000126, 0.03139398992061615, -0.03880249336361885, 0.0038641353603452444, 0.09577365219593048, -0.04352010414004326, 0.004304319620132446, -0.023975757881999016, -0.019809115678071976, -0.028969310224056244, -0.013296007178723812, 0.025237973779439926, -0.009581680409610271, 0.02076561376452446, -0.06887797266244888, 0.046067751944065094, -0.016706939786672592, 0.031075235456228256, -0.023201344534754753, 0.06032046303153038, 0.0006605052039958537, 0.09211272746324539, 0.02977803908288479, 0.04648000746965408, -0.03715861216187477, -0.03890683874487877, 0.013981864787638187, -0.12719349563121796, 0.09893837571144104, -0.015090128406882286, 0.03426911309361458, -0.01781492866575718, -0.046449728310108185, -0.051109571009874344, 0.055914320051670074, -0.0025203339755535126, -0.06025480851531029, 0.036873701959848404, 0.04354928061366081, -0.003932013176381588, -0.003079046495258808, 0.05692925304174423, 0.08163443207740784, 0.06635600328445435, 0.013299604877829552, 0.054015882313251495, 0.04351382702589035, -0.08998635411262512, 0.03701607510447502, 0.011921358294785023, 0.09253770858049393, 0.004784016869962215, -0.0363825261592865, -0.027016127482056618, 0.049760110676288605, 0.04690949618816376, 0.0326712429523468, -0.04895787313580513, -0.0023866475094109774, 0.022661592811346054, -0.032861921936273575, -0.038421496748924255, 7.706585779713042e-33, -0.030496330931782722, -0.043806567788124084, -0.021249843761324883, -0.10836677998304367, 0.017347728833556175, 0.020398469641804695, -0.05756852775812149, -0.013558480888605118, -0.046565793454647064, -0.040943220257759094, -0.022237101569771767, -0.04393366724252701, -0.09495998173952103, 0.003616873174905777, -0.0030841240659356117, -0.08524815738201141, -0.019731614738702774, 0.01819181628525257, 0.08907469362020493, -0.09900962561368942, -0.031603049486875534, -0.09480573982000351, -0.060489822179079056, -0.020700454711914062, 0.0034418755676597357, 0.08663276582956314, 0.0340859591960907, 0.05342046171426773, -0.04181646183133125, -0.004818449728190899, 0.051612552255392075, 0.03530722111463547, -0.038702838122844696, -0.056999459862709045, 0.031133269891142845, -0.06367715448141098, -0.0036555312108248472, 0.07775650918483734, 0.0656285285949707, -0.021511346101760864, -0.006922862492501736, 0.05598905682563782, -0.003312773536890745, -0.006503449287265539, -0.0856383815407753, -0.03731285780668259, 0.07865501195192337, 0.01971241645514965, -0.030384257435798645, -0.016391070559620857, -0.0021977247670292854, -0.07719653099775314, -0.12770169973373413, -0.009190288372337818, 0.010271621868014336, 0.04017510637640953, 0.01575133390724659, -0.004653829615563154, -0.030702684074640274, -0.0426328219473362, 0.13332635164260864, 9.317159128841013e-05, 0.0419604517519474, 0.036249201744794846, 0.0069917719811201096, 0.04384664446115494, -0.02157779224216938, 0.05142699554562569, -0.012531652115285397, 0.0037891827523708344, -0.07663464546203613, 0.0013419262832030654, 0.10705497860908508, -0.06507521122694016, 0.06471983343362808, -0.033172301948070526, 0.05170828849077225, 0.06860493123531342, -0.04431106895208359, 0.047800008207559586, -0.04590699076652527, 0.004577692598104477, -0.04843321442604065, -0.07977525144815445, -0.0384114608168602, -0.008751945570111275, 0.023855965584516525, -0.1023348718881607, -0.01815144158899784, -0.014660750515758991, -0.058810602873563766, -3.2321844628313556e-05, -0.006191945169121027, 0.025768432766199112, -0.07518991082906723, -6.905844170720685e-33, -0.019734468311071396, 0.1382157802581787, 0.0444195419549942, 0.13438716530799866, -0.02649909257888794, 0.039974331855773926, 0.041130535304546356, -0.007519577629864216, -0.004563756287097931, -0.037012387067079544, 0.03264247998595238, -0.004085262771695852, -0.16808313131332397, -0.10045648366212845, 0.011008774861693382, 0.004503840580582619, 0.03431408852338791, 0.0042178877629339695, -0.023603832349181175, 0.03601819649338722, -0.0076121180318295956, 0.10636050999164581, -0.029913822188973427, 0.04600810632109642, 0.036227498203516006, 0.042677875608205795, 0.03173636272549629, 0.05063358321785927, 0.012528639286756516, -0.05448691546916962, -0.044073473662137985, 0.021942364051938057, -0.016850411891937256, 0.01957908645272255, -0.04339370131492615, -0.0034031537361443043, 0.0018039641436189413, -0.03749410808086395, -0.018999582156538963, 0.08911322802305222, 0.10156168788671494, 0.04032567888498306, -0.031067244708538055, -0.015775006264448166, 0.016512032598257065, -0.006719792261719704, 0.06324557960033417, 0.009999735280871391, 0.052233416587114334, 0.026759590953588486, 4.952763265464455e-05, -0.02178913541138172, -0.04739402234554291, 0.01783761754631996, -0.021987993270158768, 0.010340236127376556, -0.019342152401804924, 0.012646215036511421, 0.009559639729559422, 0.029574163258075714, -0.016856171190738678, 0.00015093588444869965, -0.022317642346024513, -0.010521944612264633, -0.004443488549441099, 0.0020476696081459522, -0.062449146062135696, 0.012675432488322258, 0.04068420082330704, 0.09159165620803833, 0.023182230070233345, 0.05819477513432503, 0.08060698956251144, 0.0004825537616852671, 0.01854361779987812, -0.0420723594725132, -0.019196977838873863, 0.027166856452822685, 0.012079888954758644, -0.09784175455570221, -0.027895985171198845, 0.04273547977209091, -0.05544479563832283, 0.018130281940102577, -0.013100693933665752, 0.1116570234298706, -0.11018762737512589, 0.07625477015972137, 0.12094921618700027, -0.06304308772087097, -0.03238847479224205, -0.005063085351139307, 0.0940021350979805, -0.03467392921447754, -0.007901184260845184, -4.934472386253219e-08, -0.04288138449192047, -0.02448992431163788, 0.009903871454298496, -0.017567241564393044, 0.0711066946387291, 0.0038395537994802, -0.014543846249580383, 0.0801854059100151, -0.027788665145635605, -0.030956072732806206, 0.13384085893630981, 0.066639743745327, -0.03998218849301338, -0.04233822599053383, -0.07650094479322433, 0.03238918259739876, -0.0002938183315563947, 0.07742469757795334, 0.031349800527095795, -0.03009854443371296, -0.0396224744617939, -0.03724951297044754, 0.060554251074790955, -0.02130282297730446, -0.02612333372235298, -0.07290203124284744, -0.006920160725712776, 0.071538046002388, 0.022256113588809967, -0.05518321320414543, 0.06824151426553726, -0.025708334520459175, 0.07427064329385757, -0.0023975272197276354, 0.018260370939970016, 0.016030488535761833, -0.05062589794397354, 0.023602936416864395, 0.01037144660949707, 0.14994104206562042, -0.026752864941954613, -0.008586229756474495, 0.025170424953103065, -0.016957096755504608, -0.07595175504684448, 0.040268752723932266, 0.03035133332014084, -0.1272171288728714, -0.01196390762925148, -0.0011419069487601519, 0.07356280833482742, -0.04789428040385246, -0.06892335414886475, 0.03110126405954361, 0.04672134295105934, -0.08575206995010376, 0.053962960839271545, -0.0216826219111681, -0.08690965175628662, 0.04830622300505638, 0.045573633164167404, -0.0857517421245575, -0.05886169895529747, -0.00017657534044701606 ] }, { "text": "#### 'rmsprop': \n\n
\n \n
Figure 6: RMSProp, learning rates: [1e-4, 5e-4, 5e-3, 1e-3, 1e-2]
\n
\n\n\nRMS Prop needs smaller lr: [1e-5, 5e-5, 5e-4, 1e-4]\n- running with 5e-05: (Epoch 5 / 5) train acc: 0.591000; val_acc: 0.359000\n- running with 0.0001: (Epoch 5 / 5) train acc: 0.557000; val_acc: 0.376000\n\n
\n \n
RMSProp, smaller learning rates
\n
\n\n####'adam':", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_13", "embedding": [ 0.0024091224186122417, -0.0009228228009305894, 0.028892021626234055, 0.04144468903541565, 0.08328881859779358, -0.008565115742385387, -0.08928927034139633, 0.08156248927116394, 0.015621837228536606, 0.028033997863531113, 0.012674347497522831, -0.025116462260484695, 0.028236934915184975, 0.04624156653881073, -0.005407065153121948, 0.042783889919519424, -0.04711872339248657, -0.01474931463599205, -0.04429418593645096, -0.017135605216026306, 0.04673393443226814, -0.10500537604093552, 0.0459066666662693, -0.010688383132219315, 0.04429168626666069, 0.033335503190755844, -0.027795489877462387, 0.06548816710710526, -0.009997582994401455, -0.09207408130168915, 0.009392284788191319, -0.054087188094854355, -0.009531958028674126, -0.038927383720874786, -0.059809599071741104, 0.10805769264698029, -0.00386742758564651, -0.046277109533548355, 0.02838842384517193, 0.018817266449332237, -0.020781440660357475, 0.0025519556365907192, 0.047457050532102585, -0.09006790816783905, 0.07421521097421646, 0.02402237243950367, -0.030041160061955452, -0.04973582550883293, 0.02310509793460369, -0.032925963401794434, -0.05672179535031319, -0.06640689074993134, 0.002800130983814597, -0.0386737585067749, -0.04337571561336517, 0.04064573720097542, 0.06814469397068024, -0.03487033769488335, 0.11403509229421616, -0.03544135391712189, -0.01555890403687954, -0.0077668740414083, 0.02109881304204464, -0.06516819447278976, 0.0004623190325219184, -0.03610645607113838, -0.04082317277789116, 0.014657263644039631, -0.06244874745607376, 0.03631480783224106, -0.023873938247561455, 0.0011434616753831506, 0.016951803117990494, -0.03583931550383568, 0.03671466186642647, -0.05345692113041878, -0.04594539850950241, -0.011589490808546543, 0.05642012879252434, -0.04509107396006584, 0.008972549811005592, -0.024797922000288963, -0.053278304636478424, -0.02782079577445984, 0.07130958139896393, 0.037886448204517365, 0.09605061262845993, -0.032895054668188095, -0.017891516909003258, -0.08722902834415436, -0.038103070110082626, -0.01683148555457592, -0.10529875010251999, 0.1728413999080658, 0.018776025623083115, 0.030062861740589142, -0.051433343440294266, -0.015735648572444916, -0.07988984137773514, 0.06396552175283432, 0.044304512441158295, -0.03982202336192131, 0.022041501477360725, 0.06552460789680481, -0.010454307310283184, 0.04305432736873627, 0.05382703244686127, 0.10522923618555069, -0.009218488819897175, -0.03201108053326607, 0.055913373827934265, 0.029954327270388603, -0.11519981920719147, 0.02713007479906082, 0.0018003425793722272, 0.08205787092447281, -0.06467338651418686, -0.050661832094192505, -0.04097970947623253, 0.006927925627678633, 0.022741122171282768, 0.03397424891591072, -0.00873912125825882, 0.07399553060531616, 0.052733588963747025, -0.08336719870567322, -0.051858726888895035, 1.0101533561974555e-32, -0.025932390242815018, -0.006856517866253853, -0.015135437250137329, -0.0655333399772644, 0.04507327079772949, -0.028201837092638016, -0.0806012898683548, -0.02085254155099392, -0.029386252164840698, -0.026003999635577202, -0.02612552046775818, 0.03922249749302864, -0.11532265692949295, -0.022177422419190407, 0.06883919984102249, -0.07713824510574341, -0.000879611587151885, 0.0708075687289238, -0.041227493435144424, -0.048464272171258926, -0.039041969925165176, -0.057967424392700195, -0.07292259484529495, 0.013174991123378277, -0.02450866997241974, 0.08514941483736038, 0.03161285072565079, 0.07045899331569672, -0.0407533273100853, 0.009075972251594067, 0.06868930160999298, 0.012243339791893959, 0.025149686262011528, -0.015556558035314083, 0.00015857603284530342, -0.05762076377868652, -0.0013186730211600661, 0.06713230907917023, -0.04431597888469696, 0.03888936713337898, -0.01030173059552908, 0.035300564020872116, 0.00734520610421896, 0.012765004299581051, -0.048170484602451324, -0.024708572775125504, 0.03499818593263626, 0.05745250731706619, -0.03208744525909424, 0.04257306456565857, -0.05363019183278084, -0.029189296066761017, -0.0668049156665802, -0.02678469382226467, 0.022528590634465218, -0.00520278001204133, 5.119471097714268e-05, 0.03336978703737259, -0.003888300620019436, -0.060703665018081665, 0.0813148096203804, -0.03294835984706879, 0.01711965538561344, 0.00106222671456635, -0.027700336650013924, 0.07811564952135086, 0.07474242895841599, 0.008368432521820068, -0.01099035982042551, 0.005535324104130268, -0.05822533741593361, 0.011116866022348404, 0.0745941624045372, -0.0024898063857108355, 0.08204533159732819, -0.04264765605330467, 0.04156643524765968, 0.08796203136444092, -0.11059359461069107, 0.05368892848491669, -0.08631062507629395, 0.0484950952231884, -0.055279579013586044, -0.06674031913280487, -0.012709051370620728, -0.007541291415691376, 0.04138555750250816, -0.02500840276479721, -0.004036611411720514, 0.006845835130661726, -0.04521843045949936, 0.036566171795129776, -0.07700829207897186, 0.001419111038558185, -0.07439865171909332, -7.676123578295452e-33, 0.10039155930280685, 0.10644952207803726, 0.0737399309873581, 0.09324779361486435, -0.0026527803856879473, 0.020697958767414093, 0.12899050116539001, -0.02298676036298275, 0.018305739387869835, 0.01317463256418705, 0.03005051799118519, -0.056402284651994705, -0.1068846732378006, -0.12423849105834961, -0.043420303612947464, 0.03487992286682129, 0.03283711150288582, -0.0005803484818898141, -0.00485348142683506, -0.0006928194197826087, 0.03666473925113678, 0.11569348722696304, 0.042796291410923004, 0.016486190259456635, -0.00700951274484396, 0.06855715066194534, 0.02485974133014679, 0.019858410581946373, -0.06631489098072052, -0.0664048120379448, 0.0033666901290416718, 0.005022650584578514, -0.06374167650938034, -0.013246981427073479, -0.02189340814948082, 0.02937806397676468, 0.00828640442341566, -0.01932056061923504, -0.053006064146757126, 0.10747306793928146, 0.047082167118787766, 0.03257909417152405, -0.049907151609659195, -0.010340001434087753, -0.0369243249297142, -0.07184559106826782, 0.1274411827325821, -0.05726670101284981, 0.0688038021326065, 0.02180221863090992, 0.04761628434062004, -0.07874000072479248, -0.022739659994840622, 0.040586404502391815, -0.012724468484520912, -0.021605541929602623, -0.04646242409944534, 0.05682707577943802, 0.00900427345186472, 0.03056245669722557, 0.05866822972893715, 0.00018429661577101797, -0.10529949516057968, -0.01799737848341465, -0.03393443673849106, 0.0013386764330789447, -0.08731860667467117, -0.02172091230750084, 0.05673574283719063, 0.09030783176422119, 0.008096943609416485, -0.0033514208626002073, 0.1176270917057991, -0.01940746046602726, -0.02695704996585846, -0.0024400330148637295, -0.017426157370209694, 0.1045452132821083, 0.04508565366268158, -0.02706347592175007, -0.026872053742408752, 0.021691173315048218, -0.016143694519996643, 0.011400006711483002, -0.021609799936413765, 0.07246126979589462, -0.028367163613438606, 0.06180551275610924, 0.08234831690788269, -0.024864334613084793, -0.014230389147996902, 0.05096575990319252, 0.10564956068992615, 0.007425674702972174, -0.011985251680016518, -5.8731409069423535e-08, -0.023922087624669075, 0.014295279048383236, -0.018505793064832687, 0.012469709850847721, -0.017443915829062462, -0.00040633275057189167, -0.011013323441147804, 0.016965268179774284, -0.05341559275984764, -0.008897013030946255, 0.09101813286542892, 0.061666619032621384, -0.053567953407764435, 0.00236544874496758, -0.032475683838129044, -0.060340557247400284, -0.035312533378601074, 0.13643881678581238, 0.026510324329137802, -0.024140458554029465, -0.012664820067584515, -0.04881613329052925, 0.045665305107831955, -0.013674757443368435, -0.013379105366766453, -0.053756002336740494, -0.06038832291960716, 0.030330950394272804, 0.014609052799642086, -0.027582088485360146, 0.07267285883426666, 0.016623038798570633, 0.018950456753373146, -0.06947141140699387, 0.019002756103873253, 0.006115465424954891, -0.05544926971197128, 0.07079640030860901, -0.022059278562664986, 0.08788221329450607, -0.03635869920253754, -0.005928677041083574, -0.006480273324996233, -0.005432912614196539, 0.03479698672890663, 0.035523392260074615, 0.003477074671536684, -0.0685434490442276, 0.004563527647405863, 0.0027849546167999506, 0.04023120924830437, -0.049431633204221725, -0.07401777058839798, 0.015080147422850132, 0.058880820870399475, -0.10613718628883362, 0.07459714263677597, 0.0016146383713930845, -0.11946078389883041, 0.015837354585528374, 0.0040649352595210075, -0.09257682412862778, -0.04086775705218315, -0.009500671178102493 ] }, { "text": "####'adam':\n\n
\n \n
Figure 7: Adam, learning rates: [1e-4, 5e-4, 5e-3, 1e-3, 1e-2]
\n
", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_14", "embedding": [ 0.05444752424955368, 0.03140152618288994, 0.05513959005475044, 0.02492869272828102, 0.11898931860923767, 0.00048145174514502287, 0.0017958974931389093, 0.004969686735421419, 0.037176258862018585, 0.05665501207113266, 0.0005333487642928958, 0.03188028559088707, -0.019891252741217613, 0.07519134134054184, 4.983783946954645e-05, 0.00230863387696445, -0.0878073126077652, 0.044105663895606995, -0.04837571457028389, -0.055971961468458176, 0.006734826136380434, -0.0860433280467987, 0.07236894220113754, -0.044137679040431976, 0.10029822587966919, 0.012458689510822296, 0.003469513962045312, 0.03292522951960564, 0.01128403376787901, -0.08590259402990341, 0.03581611067056656, -0.051060259342193604, 0.02658282220363617, -0.055368855595588684, -0.08722058683633804, 0.06075988709926605, 0.014965184964239597, -0.03864656388759613, 0.03658759593963623, -0.005812886171042919, -0.009003475308418274, -0.01109083741903305, 0.026949353516101837, -0.08707426488399506, 0.04291883856058121, 0.0602484866976738, -0.06973911076784134, -0.031886592507362366, 0.07207353413105011, -0.0030483987648040056, -0.06448155641555786, -0.09132514894008636, 0.011991938576102257, -0.04748556762933731, 0.0173768512904644, 0.004221796989440918, 0.06301294267177582, -0.11886340379714966, 0.1042996495962143, -0.06381484121084213, 0.02130204811692238, -0.04035405442118645, 0.05472825840115547, 0.00688623683527112, 0.048709671944379807, -0.04184994474053383, -0.06074340268969536, 0.002785848220810294, -0.08923622965812683, 0.0383979007601738, 0.02315419726073742, 0.0013901053462177515, 0.02761051617562771, -0.05192553251981735, 0.030181121081113815, -0.030295494943857193, -0.023920511826872826, 0.032720696181058884, 0.04686146602034569, -0.018387842923402786, 0.0016676672967150807, -0.03751339018344879, 0.052679091691970825, 0.009616903960704803, 0.062464404851198196, 0.06974263489246368, 0.05622358247637749, -0.0423266664147377, -0.02705301158130169, -0.06220555305480957, -0.10237468034029007, 0.035458754748106, -0.04703899100422859, 0.10940174013376236, -0.007594300899654627, 0.022311560809612274, -0.053775954991579056, -0.08608711510896683, -0.14025439321994781, 0.07818332314491272, 0.016838619485497475, -0.044586166739463806, 0.031045343726873398, 0.010423892177641392, -0.031349990516901016, 0.0511530265212059, 0.058717772364616394, 0.050916001200675964, 0.07708867639303207, -0.018670249730348587, 0.023710448294878006, 0.018144767731428146, -0.13026027381420135, 0.036822762340307236, -0.026220224797725677, -0.014354915358126163, 0.005130106117576361, -0.06807143986225128, 0.08371488004922867, 0.009624895639717579, 0.06323669105768204, 0.11503919214010239, -0.03136926516890526, 0.03824545815587044, 0.027829699218273163, -0.07430344820022583, -0.024205652996897697, 7.4365570949139e-33, -0.007064553909003735, -0.045356545597314835, -0.03208983689546585, -0.04589409753680229, 0.06954871863126755, -0.015889853239059448, -0.11898796260356903, 0.0031192039605230093, -0.06437944620847702, -0.07801134884357452, -0.09433123469352722, 0.012909061275422573, -0.04441734775900841, 0.04497356712818146, 0.006428258027881384, -0.050078149884939194, 0.030849292874336243, 0.059000685811042786, 0.06338629126548767, -0.035944607108831406, -0.08488070219755173, -0.08895693719387054, -0.024905789643526077, 0.07104390859603882, -0.04370990768074989, 0.06386702507734299, 0.011002674698829651, 0.02294064685702324, 0.022887174040079117, -0.02201954647898674, 0.028972292318940163, 0.036590490490198135, 0.02409706823527813, -0.040839243680238724, -0.020716020837426186, -0.03660592809319496, 0.001549995387904346, 0.11219316720962524, -0.017863623797893524, 0.04168754816055298, 0.013307411223649979, -0.006814955733716488, 0.007469627540558577, -0.01107252761721611, -0.07624601572751999, 0.013442426919937134, 0.08079542219638824, -0.005147898569703102, 0.021759243682026863, 0.019542966037988663, -0.04066760092973709, 0.017025817185640335, -0.06804752349853516, -0.07040264457464218, 0.006387272384017706, 0.019204851239919662, -0.016712460666894913, 0.031096847727894783, -0.0011574359377846122, -0.05071097984910011, 0.11451436579227448, 0.01592533476650715, 0.025073323398828506, -0.02757406234741211, -0.030916765332221985, 0.051911961287260056, 0.04483875632286072, 0.021234164014458656, 0.021627729758620262, 0.02940135821700096, -0.053748637437820435, -0.008267277851700783, 0.07961619645357132, -0.014034963212907314, 0.025313107296824455, -0.003575736889615655, 0.02110634185373783, -0.01019788347184658, -0.02649126946926117, 0.06375536322593689, -0.05733278766274452, -0.05143817141652107, -0.054598115384578705, -0.07676976174116135, -0.07372487336397171, -0.027095526456832886, 0.021148156374692917, -0.02452663518488407, 0.05990482494235039, 0.04958435148000717, 0.021159812808036804, -0.013791164383292198, -0.1091613695025444, -0.021274223923683167, -0.053387198597192764, -6.690456871451578e-33, 0.0263212863355875, 0.10014597326517105, -0.03588452935218811, 0.050781168043613434, -0.003128794953227043, 0.050050877034664154, 0.02959897182881832, -0.0624394454061985, 0.020587094128131866, -0.023851916193962097, 0.016795342788100243, -0.025734398514032364, -0.07610831409692764, -0.14065414667129517, 0.012143834494054317, -0.005704037379473448, -0.003645331133157015, 0.011822137981653214, -0.01619143784046173, 0.02255118079483509, 0.009256962686777115, 0.07559245079755783, 0.018419962376356125, -0.014847208745777607, -0.00989986676722765, 0.018686983734369278, 0.04481750726699829, 0.06748384237289429, -0.04086480662226677, -0.04185899719595909, -0.0646672397851944, -0.02416037954390049, -0.027667680755257607, 0.04814468324184418, 0.022347012534737587, 0.05975634604692459, -0.026560161262750626, -0.0616501048207283, 0.005839868448674679, 0.02704673260450363, 0.09667282551527023, 0.00603017071262002, -0.06790594756603241, -0.022263526916503906, -0.009076370857656002, -0.01715824194252491, 0.0201436597853899, 0.014410387724637985, 0.02659723162651062, 0.07059959322214127, -0.022652026265859604, -0.023046065121889114, -0.035280223935842514, -0.032730672508478165, -0.04027995467185974, -0.0032634944655001163, 0.0009612840367481112, 0.056689683347940445, 0.07205483317375183, 0.11588425934314728, -0.007685327436774969, -0.05158443748950958, -0.024329321458935738, 0.049570757895708084, -0.07343779504299164, 0.018399862572550774, -0.08664269745349884, -0.010395617224276066, 0.0016655346844345331, 0.07179483026266098, 0.04602557420730591, 0.014794220216572285, 0.11378253251314163, -0.007280590478330851, -0.07138241827487946, -0.043762028217315674, 0.010614857077598572, 0.07379509508609772, -0.007085718680173159, -0.1070561408996582, -0.01588628441095352, 0.0026891017332673073, -0.09258551895618439, -0.018343040719628334, -0.013574734330177307, 0.07207567244768143, 0.009478883817791939, 0.03319275379180908, 0.04708458483219147, -0.056284788995981216, 0.003202911000698805, -0.0026515505742281675, 0.02083314023911953, -0.03238298371434212, -0.0430632010102272, -4.826318544814967e-08, -0.0479222871363163, -0.031128117814660072, 0.03748948499560356, -0.013015019707381725, 0.08310307562351227, 0.08563022315502167, 0.02107820101082325, 0.05876534432172775, -0.04870821163058281, 0.028164338320493698, 0.10273388773202896, 0.07942881435155869, 0.007583425380289555, 0.01325282920151949, -0.027851741760969162, 0.04113501310348511, -0.04135054349899292, 0.1093190386891365, 0.05582632124423981, -0.01807563193142414, 0.0010582306422293186, -0.007699067238718271, 0.008885950781404972, -0.0051425122655928135, -0.03211904689669609, -0.021533692255616188, -0.06610569357872009, 0.08800350874662399, -0.01621992327272892, -0.047523610293865204, 0.09154429286718369, 0.05012994259595871, 0.02887050248682499, -0.09635677188634872, 0.009541100822389126, -0.028843214735388756, -0.08502279222011566, 0.059759896248579025, -0.06067997217178345, 0.04543716087937355, -0.027421029284596443, -0.016965704038739204, 0.021642528474330902, -0.022463416680693626, -0.028532063588500023, 0.05456787347793579, -0.006893799174576998, -0.08096924424171448, 0.0031792139634490013, 0.005315408576279879, 0.07678122818470001, -0.014121883548796177, -0.055118706077337265, 0.04603198543190956, 0.024821119382977486, -0.14436005055904388, 0.04881470277905464, -0.04852525517344475, -0.09538964182138443, 0.0682380348443985, 0.034327756613492966, -0.03885246068239212, -0.020940067246556282, -0.04238513112068176 ] }, { "text": "## Model Ensembles\n\nRef: https://www.youtube.com/watch?v=EK61htlw8hY&ab_channel=TTIC\n\nOne disadvantage of model ensembles is that they take longer to evaluate on test example. \nAn interested reader may find the recent work from Geoff Hinton on “Dark Knowledge” inspiring, where the idea is to \n“distill” a good ensemble back to a single model by incorporating the ensemble log likelihoods into a modified objective.\n\nRef: https://www.youtube.com/watch?v=_JB0AO7QxSA&list=PL3FW7Lu3i5JvHM8ljYj-zLfQRF3EO8sYv&index=7&ab_channel=StanfordUniversitySchoolofEngineering\n\n1. Train multiple independent models \n2. At test time average their results \n\n# Second Order Optimization Algorithms", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_15", "embedding": [ -0.058785565197467804, -0.07461239397525787, 0.05783022195100784, 0.13530966639518738, 0.10254450142383575, -0.022715318948030472, -0.1073705404996872, -0.0036984202452003956, 0.03759637847542763, -0.0355316698551178, -0.027763841673731804, 0.008718895725905895, 0.019260261207818985, -0.06513556092977524, -0.06292606145143509, 0.0023321430198848248, 0.047291453927755356, 0.0041137696243822575, -0.05154459923505783, 0.00987672246992588, -0.049020953476428986, 0.023460322991013527, 0.008376744575798512, 0.0458894781768322, 0.04836840555071831, -0.06965691596269608, -0.026148799806833267, 0.06180490553379059, 0.035778045654296875, -0.044080477207899094, -0.02180631458759308, -0.013302188366651535, 0.0245438814163208, 0.01754794642329216, -0.06447926163673401, -0.039244987070560455, 0.010378262028098106, 0.017408758401870728, 0.01686045713722706, 0.021593021228909492, -0.002507659373804927, 0.0152151333168149, 0.03598185256123543, -0.046673957258462906, 0.009555418975651264, -0.05189187452197075, 0.000674926268402487, -0.03192296624183655, 0.010551156476140022, -0.08985814452171326, -0.03461594134569168, -0.022952858358621597, -0.07280948758125305, -0.06834463030099869, -0.0866333395242691, 0.037813667207956314, -0.007886016741394997, -0.026561744511127472, 0.0015786713920533657, -0.02319059520959854, -0.02378230355679989, -0.03043007291853428, -0.0514364093542099, -0.02176542580127716, 0.14570260047912598, -0.04418778419494629, 0.02950064092874527, 0.054522693157196045, 0.06229570135474205, 0.03898918256163597, -0.016711007803678513, 0.02557419054210186, -0.008335967548191547, -0.05781438574194908, 0.08390967547893524, 0.04095296934247017, 0.10343398153781891, -0.012607306241989136, -0.005434497259557247, -0.06264942139387131, -0.0629444494843483, 0.03066742606461048, 0.04452089965343475, -0.038543131202459335, 0.04335882142186165, -0.0529760867357254, -0.03498341888189316, -0.0025596790947020054, 0.03682977706193924, -0.06288308650255203, 0.03511244058609009, -0.004152874927967787, -0.007878831587731838, -0.024355828762054443, 0.06764764338731766, 0.07692644745111465, 0.06680067628622055, 0.001984808361157775, 0.02348651923239231, 0.04110553488135338, -0.027385473251342773, 0.053063374012708664, 0.06501355022192001, -0.025545187294483185, -0.02897714637219906, -0.13369961082935333, 0.09553425759077072, -0.05840093642473221, 0.020101796835660934, -0.04316261038184166, 0.09670396894216537, 0.07292935997247696, 0.026020847260951996, 0.05131874606013298, -0.0058114430867135525, 0.09764998406171799, -0.03794233873486519, 0.010650642216205597, 0.038508545607328415, 0.11187823116779327, -0.08939994126558304, -0.07117664068937302, 0.06016865745186806, 0.024565204977989197, 0.027163468301296234, 0.05498117208480835, -0.042541537433862686, 1.0030100239643023e-32, 0.016265669837594032, 0.015577483922243118, -0.02867920882999897, -0.025695448741316795, 0.044775690883398056, 0.010658237151801586, 0.006493955384939909, -0.03925887122750282, -0.035197656601667404, 0.03581146523356438, -0.05601731315255165, 0.06531847268342972, 0.011616764590144157, 0.034405000507831573, 0.06356603652238846, -0.012835991568863392, -0.025352388620376587, 0.09476171433925629, -0.06604935973882675, 0.03332405909895897, 0.1342642903327942, -0.030715761706233025, 0.029942994937300682, -0.09926299005746841, -0.02582099661231041, -0.010449439287185669, 0.06357839703559875, 0.03389083966612816, -0.07589985430240631, 0.05691531300544739, -0.07065030187368393, 0.02892381325364113, -0.07285182178020477, 0.09794323891401291, 0.03652285039424896, -0.012285456992685795, 0.02751973085105419, -0.0005657729925587773, -0.001148819806985557, -0.02277405560016632, -0.03003334067761898, 0.018939241766929626, 0.037678346037864685, -0.018245870247483253, -0.10147040337324142, -0.02794048562645912, -0.07369234412908554, 0.007353716529905796, 0.005533731076866388, -0.0430649109184742, -0.008816531859338284, 0.026003891602158546, -0.011457719840109348, -0.06866434961557388, -0.004834101535379887, 0.02288108691573143, 0.014191368594765663, -0.05327802896499634, 0.03153020516037941, 0.02039385214447975, -0.08052349090576172, 0.06893816590309143, 0.012928018346428871, 0.02280980907380581, 0.0677194595336914, 0.05051014944911003, -0.02806985192000866, 0.01414304319769144, 0.0495496541261673, 0.006034777965396643, 0.004516879096627235, -0.04087401181459427, -0.02329627051949501, -0.09631042182445526, 0.08851224929094315, -0.09154552221298218, 0.10609028488397598, 0.008974392898380756, 0.037794940173625946, -0.013277741149067879, 0.028612133115530014, 0.0623021237552166, -0.0390399694442749, -0.0541425384581089, 0.06841015070676804, -0.04905737563967705, 0.006956062745302916, -0.028605710715055466, -0.041175976395606995, -0.027198897674679756, -0.08683910965919495, 0.04037212207913399, -0.007860311307013035, -0.005761736072599888, 0.012844887562096119, -9.760867217582594e-33, -0.030162064358592033, -0.036541059613227844, -0.0046367887407541275, 0.04705337807536125, 0.0463782474398613, -0.058757565915584564, -0.0786701887845993, 0.01052882056683302, -0.03825875744223595, -0.05033392831683159, 0.0566382072865963, -0.02821941487491131, 0.015123974531888962, 0.009129934012889862, 0.0371619276702404, -0.028272174298763275, -0.002084695268422365, -0.04959466680884361, 0.10510832816362381, -0.05694196745753288, 0.07212293893098831, 0.01330956257879734, -0.01695798709988594, -0.06803293526172638, -0.09324304014444351, -0.0341157391667366, -0.05769406259059906, 0.11543107777833939, -0.05626150220632553, -0.06461860239505768, 0.0020124390721321106, 0.08540733903646469, -0.04469775781035423, -0.007134802173823118, -0.04748234897851944, 0.12445412576198578, -0.036556176841259, 0.01566942408680916, -0.020854433998465538, 0.12553507089614868, -0.013210101053118706, 0.036919914186000824, -0.04184587299823761, -0.04065680503845215, -0.005860964767634869, 0.027807604521512985, -0.03264809027314186, -0.08577317744493484, 0.08590830117464066, 0.025185056030750275, 0.07023382931947708, -0.036023665219545364, -0.06997812539339066, 0.028125086799263954, -0.07220681756734848, -0.05711016058921814, 0.015666993334889412, 0.00476585328578949, 0.023079780861735344, 0.02033943496644497, -0.04766220971941948, 0.031161386519670486, -0.026967192068696022, -0.010787269100546837, -0.003472218057140708, -0.03359543904662132, 0.055279746651649475, 0.013668784871697426, 0.06252198666334152, 0.06858618557453156, -0.056458622217178345, -0.06717827171087265, 0.01365472748875618, 0.08139438927173615, -0.016372034326195717, 0.02746701054275036, 0.013772059231996536, 0.02946266159415245, -0.028567414730787277, -0.07145855575799942, -0.014941755682229996, -0.023544276133179665, -0.035333774983882904, 0.01003591250628233, 0.07087042182683945, 0.06235121935606003, 0.0762549415230751, 0.1078779473900795, -0.00556210707873106, 0.026434985920786858, 0.07607796788215637, -0.006390250287950039, 0.07965441793203354, 0.06750717759132385, -0.02113265171647072, -6.417540276970612e-08, 0.015761790797114372, 0.0008173899841494858, -0.0018766592256724834, 0.04521041736006737, -0.026367397978901863, -0.055480338633060455, -0.10292733460664749, 0.06684114784002304, -0.024928322061896324, -0.05577549338340759, 0.09943979233503342, 0.015715790912508965, -0.010856912471354008, 0.032786447554826736, 0.016845934092998505, 0.022537384182214737, -0.010413809679448605, -0.014410436153411865, -0.06693829596042633, -0.0920097678899765, 0.07146529853343964, -0.008941404521465302, 0.058076001703739166, -0.049687087535858154, 0.03368431329727173, 0.012518128380179405, 0.002779334085062146, -0.02554125152528286, -0.011700881645083427, 0.01661788299679756, -0.0493316650390625, 0.09812888503074646, -0.08087171614170074, 0.021435663104057312, 0.012552916072309017, 0.08017000555992126, -1.810704361560056e-06, -0.03740870952606201, -0.07782142609357834, 0.008523049764335155, -0.0063397870399057865, -0.0405648909509182, -0.10586326569318771, -0.02504604682326317, 0.06695795059204102, -0.05736609920859337, -0.03626345098018646, -0.06441988050937653, 0.0608430877327919, 0.025257103145122528, -0.005552035756409168, -0.01100609079003334, -0.023751575499773026, 0.03878342732787132, 0.051202647387981415, 0.05264381691813469, 0.02999855950474739, -0.08794929832220078, -0.00038612468051724136, -0.0015800968976691365, 0.044980697333812714, -0.09040722250938416, -0.07689517736434937, -0.02513071522116661 ] }, { "text": "1. Train multiple independent models \n2. At test time average their results \n\n# Second Order Optimization Algorithms\n\n- https://arxiv.org/pdf/1311.2115.pdf (Quasi Newton)\n- https://research.google/pubs/pub40565/ (Large Scale Distributed Deep Networks)\n- https://en.wikipedia.org/wiki/Limited-memory_BFGS (LBFGS)\n\n# References\n\n- https://www.youtube.com/watch?v=_JB0AO7QxSA&list=PL3FW7Lu3i5JvHM8ljYj-zLfQRF3EO8sYv&index=7&ab_channel=StanfordUniversitySchoolofEngineering\n- https://cs231n.github.io/\n\n# Key Words\nSGD, Momentum, Learning Rates, RMSProp, ADam, Optimization, Neural Networks", "source": "2020-10-14-optimization_algorithms.md", "type": "markdown", "chunk_id": "2020-10-14-optimization_algorithms.md_16", "embedding": [ -0.0601019561290741, -0.12096692621707916, -0.0004861338820774108, 0.03803016617894173, 0.0636996254324913, 0.043882064521312714, -0.0870208740234375, 0.04420078545808792, -0.006151298992335796, -0.05770204961299896, -0.03507751226425171, 0.08832232654094696, 0.014950915239751339, -0.057987112551927567, -0.0184501763433218, -0.006784731987863779, 0.0481618195772171, 0.09185585379600525, -0.12948213517665863, -0.06369747966527939, 0.07978455722332001, 0.004959892015904188, 0.020085083320736885, -0.036451708525419235, 0.05437454953789711, -0.013063853606581688, -0.037183359265327454, 0.0034530600532889366, 0.026568451896309853, -0.00396664347499609, 0.13430309295654297, -0.07847023010253906, -0.008879906497895718, 0.06334586441516876, -0.08934936672449112, 0.0540461465716362, -0.05742448940873146, -0.03394245728850365, 0.011308257468044758, 0.031324245035648346, -0.019978566095232964, 0.018593741580843925, 0.04039791226387024, -0.04356522113084793, 0.1833461970090866, 0.011145356111228466, -0.039439693093299866, -0.011577939614653587, -0.006114953197538853, -0.03123600035905838, -0.07078796625137329, -0.07249753922224045, -0.06943074613809586, 0.01714681275188923, -0.012265640310943127, -0.0037456569261848927, 0.04055967554450035, -0.05667005106806755, -0.028597503900527954, 0.001325917663052678, 0.0063505698926746845, -0.17513416707515717, -0.018967684358358383, 0.005603912752121687, 0.008570055477321148, 0.024370871484279633, 0.03832070901989937, 0.043407537043094635, 0.01607176847755909, 0.07595320045948029, 0.028453819453716278, 0.05091938003897667, -0.05079399049282074, -0.007780525833368301, 0.06641688942909241, -0.05702189728617668, 0.10338461399078369, 0.016110878437757492, 0.01918027363717556, -0.09126473218202591, 0.008349854499101639, 0.011811617761850357, 0.006158166565001011, -0.07144420593976974, 0.02470417320728302, -0.05823883041739464, 0.04223095253109932, 0.04435206204652786, 0.01269807294011116, -0.01999606005847454, -0.029531355947256088, -0.02381281554698944, -0.10892518609762192, 0.014163396321237087, 0.05105124041438103, 0.010272550396621227, 0.012267585843801498, -0.09389626979827881, -0.07777944952249527, 0.017897913232445717, 0.04961533844470978, 0.06647373735904694, 0.07126399129629135, 0.0027869325131177902, 0.043419018387794495, 0.027222568169236183, 0.027584606781601906, 0.025826377794146538, 0.056150130927562714, -0.05312253162264824, 0.044491562992334366, 0.10971402376890182, -0.04348884895443916, 0.004870884120464325, 0.009015110321342945, -0.04166267812252045, 0.012508455663919449, -0.04449395835399628, 0.03127823397517204, 0.08676367253065109, -0.08304598927497864, -0.012698806822299957, 0.050962090492248535, -0.008510971441864967, -0.04822297394275665, 0.060933347791433334, -0.0646369606256485, 5.8803054301808885e-33, -0.07415775209665298, -0.004660883452743292, 0.014625205658376217, -0.09442389011383057, 0.0366663783788681, -0.016757432371377945, 0.026198340579867363, 0.01608205959200859, -0.034430697560310364, -0.014813168905675411, -0.05652915686368942, -0.02200123481452465, -0.03458062559366226, 0.05101834982633591, 0.071912981569767, -0.10451842099428177, -0.016967101022601128, 0.03228074312210083, 0.10828182101249695, -0.01596960611641407, 0.06985429674386978, 0.004263501614332199, -0.01916324533522129, -0.02262914925813675, 0.010240408591926098, -0.05351875349879265, 0.06763749569654465, 0.013942199759185314, -0.03858422487974167, 0.03757672756910324, -0.04531225562095642, 0.04277205094695091, -0.07122165709733963, 0.0913335457444191, 0.06671737879514694, 0.016973594203591347, -0.004636790603399277, -6.801374638598645e-06, 0.008268035016953945, -0.05030335485935211, -0.009527296759188175, 0.021551867946982384, 0.03856981545686722, -0.052848104387521744, -0.11469076573848724, -0.12127043306827545, -0.020593343302607536, -0.009483669884502888, 0.057788509875535965, -0.0838569849729538, -0.04211724177002907, 0.00020140493870712817, -0.07201036810874939, -0.027633095160126686, 0.025562943890690804, 0.005675513297319412, -0.0025850380770862103, 0.023697588592767715, -0.010417005978524685, 0.07142399996519089, 0.006884238217025995, -0.014294127002358437, 0.04367092624306679, 0.01878654770553112, -0.005799015052616596, 0.04689527675509453, -0.08332706242799759, 0.02285139076411724, 0.0472162663936615, 0.011533102951943874, 0.03652074933052063, 0.026663763448596, -0.02271849289536476, -0.08667974174022675, 0.08234402537345886, -0.011893676593899727, 0.08598164469003677, -0.04160059243440628, -0.02660449594259262, 0.04984249547123909, -0.07359140366315842, 0.0771937221288681, -0.03276998922228813, -0.02171202003955841, -0.0678754597902298, 0.020446447655558586, 0.012297382578253746, -0.057781487703323364, -0.015713300555944443, -0.04700559377670288, -0.10046174377202988, 0.04621826112270355, 0.04061773791909218, 0.0012524134945124388, -0.06288023293018341, -6.072440716506761e-33, -0.06004009023308754, 0.05639700964093208, -0.005466433707624674, 0.1374608278274536, 0.043106794357299805, -0.029672620818018913, -0.10133527964353561, -0.026951031759381294, -0.05630053952336311, -0.05775604769587517, -0.02986062504351139, -0.01118507981300354, 0.04642381891608238, -0.05286317318677902, 0.017425868660211563, -0.0468849278986454, 0.03000899963080883, 0.001172258285805583, 0.06431431323289871, 0.0062038479372859, 0.030061129480600357, 0.07075084745883942, -0.014237113296985626, 0.01422167383134365, 0.03948317468166351, -0.02108689956367016, -0.06561258435249329, 0.0747019350528717, -0.014483874663710594, -0.05501800402998924, -0.009413966909050941, 0.062042348086833954, -0.08200586587190628, 0.053908832371234894, -0.023181021213531494, 0.07298383116722107, 0.004073888994753361, 0.009031140245497227, -0.0021181411575526, 0.07596132904291153, 0.05223957821726799, 0.07573001086711884, -0.01436680369079113, 0.025040317326784134, 0.03764256462454796, 0.06406262516975403, -0.08037888258695602, -0.01121913455426693, -0.030292153358459473, 0.045646846294403076, -0.02217821776866913, -0.016413375735282898, -0.09188990294933319, 0.030302826315164566, -0.09147898852825165, -0.05016713589429855, 0.0023770704865455627, -0.005584308411926031, 0.07184469699859619, 0.019810963422060013, -0.04333920404314995, -0.025134993717074394, -0.06813838332891464, 0.016994033008813858, -0.01316744927316904, -0.005585761740803719, -0.02418459951877594, 0.026236962527036667, 0.02877502515912056, 0.0636105090379715, -0.04843924939632416, 0.06730719655752182, 0.034601788967847824, 0.10651709884405136, -0.03322325646877289, -0.0022980659268796444, 0.02049177885055542, 0.013041309081017971, -0.044930148869752884, -0.05088399350643158, 0.07555822283029556, 0.08376140892505646, 0.00941896066069603, 0.08341364562511444, -0.007251949515193701, 0.04200161248445511, 0.04696613922715187, 0.06801515072584152, 0.015515075996518135, -0.06842117011547089, -0.009717203676700592, 0.026022914797067642, 0.007984437979757786, -0.028405355289578438, -0.036184169352054596, -5.947563508357234e-08, -0.025549978017807007, -0.01832105591893196, 0.07222668826580048, -0.0107422461733222, 0.05926022306084633, -0.05486953258514404, -0.03706862032413483, 0.024444667622447014, 0.0030727083794772625, -0.03873414173722267, 0.040374334901571274, 0.03409537300467491, -0.07003238052129745, -0.03581816703081131, -0.024977432563900948, 0.04714426398277283, -0.02036137692630291, 0.011086340993642807, 0.020024187862873077, -0.05868726968765259, 0.02658478356897831, 0.04016096144914627, 0.07145163416862488, 0.008345184847712517, 0.09533614665269852, -0.04520893841981888, 0.03974761441349983, -0.005421365145593882, 0.03677189350128174, 0.06384619325399399, -0.0514216348528862, 0.025140972808003426, -0.043473467230796814, -0.034356605261564255, 0.05383093282580376, 0.10652993619441986, 0.06514899432659149, 0.02496044524013996, 0.006840465124696493, 0.027509771287441254, -0.002913964446634054, 0.047914206981658936, -0.022228648886084557, -0.005776749923825264, 0.04703909903764725, -0.02828408032655716, -0.03807118535041809, -0.058947328478097916, 0.01405406929552555, -0.037865687161684036, 0.048420216888189316, 0.04852152243256569, -0.03204377368092537, 0.06697048991918564, 0.02405022270977497, 0.031703975051641464, -0.017479265108704567, -0.0949147492647171, -0.0031138798221945763, 0.06443583965301514, 0.009973742999136448, 0.02014284022152424, -0.0987231582403183, 0.036547303199768066 ] }, { "text": "---\ntitle: \"Python Programming Basics\"\nid: \"python\"\ncategory: \"machine-learning\"\ntags: [\"python\", \"programming\", \"basics\", \"tutorial\", \"ai-generated\"]\nrelated: [\"ml\"] # Added your trial note\ndate: \"2025-11-08\"\ndescription: \"Essential Python programming concepts for beginners\"\n---\n\n# Python Programming Basics\n\n**This article is generated by Claude Opus 4.5**\n\n## Overview\n\nPython is a high-level, interpreted programming language known for its simplicity and readability. It's one of the most popular languages for data science, machine learning, web development, and automation.", "source": "python.md", "type": "markdown", "chunk_id": "python.md_0", "embedding": [ -0.05589010566473007, -0.031500473618507385, -0.02302262745797634, 0.02113841474056244, -0.004306328948587179, -0.11704947054386139, 0.03810695931315422, 0.012944669462740421, -0.17104944586753845, -0.024427708238363266, -0.06371629983186722, 0.0009174062870442867, 0.0893290638923645, -0.02839656174182892, 0.006370323710143566, 0.06209460645914078, -0.023519471287727356, -0.014534354209899902, -0.035378701984882355, -0.0971519947052002, -0.028021790087223053, 0.04088933765888214, -0.039558809250593185, 0.02568628080189228, 0.01619180664420128, 0.024971013888716698, 0.028149602934718132, 0.004827829077839851, 0.006180450785905123, 0.003402694361284375, -0.009955153800547123, -0.012936520390212536, 0.036546505987644196, 0.041454482823610306, 0.011331734247505665, 0.02366572618484497, -0.0069519635289907455, -0.07976169139146805, 0.015584820881485939, 0.020047897472977638, -0.05032634362578392, -0.022660503163933754, -0.05681588873267174, -0.06521779298782349, -0.0049622077494859695, 0.09425584226846695, -0.07318159937858582, -0.08390171825885773, -0.005963599309325218, -0.025745928287506104, -0.13421137630939484, -0.049215152859687805, -0.0442628376185894, -0.016001321375370026, -0.045343298465013504, 0.005751724820584059, 0.0451246052980423, -0.01595922000706196, 0.038735244423151016, -0.08648557960987091, -0.06764115393161774, -0.028005298227071762, 0.04402470961213112, 0.04540123790502548, -0.041873760521411896, -0.05187581852078438, -0.04890305921435356, 0.013759634457528591, 0.0831235721707344, -0.030656326562166214, -0.11131958663463593, 0.026603609323501587, -0.0388910211622715, 0.13308148086071014, 0.01071877684444189, -0.08675853163003922, 0.03155584633350372, -0.019598960876464844, 0.03639461100101471, 0.010996048338711262, -0.06127311289310455, 0.006457953248172998, -0.056267958134412766, 0.08150114864110947, -0.0008937594247981906, -0.06236742436885834, 0.013417846523225307, 0.07103891670703888, 0.007600500714033842, 0.014963704161345959, 0.019190365448594093, -0.04072766378521919, 0.035112690180540085, 0.003948171157389879, 0.011161060072481632, 0.11510371416807175, -0.005828727036714554, -0.13567298650741577, -0.046764157712459564, 0.02640490047633648, -0.05716834217309952, -0.03210167959332466, 0.026356400921940804, -0.020265767350792885, 0.01590142212808132, 0.004123513121157885, 0.05940808728337288, -0.035459551960229874, 0.07731755822896957, -0.062307339161634445, -0.016561344265937805, -0.02045724168419838, -0.0346037894487381, -0.09215068072080612, 0.014496530406177044, 0.03090832568705082, -0.013404108583927155, 0.044219084084033966, 0.03136806935071945, 0.08567415177822113, 0.007862173020839691, 0.02611660026013851, -0.025593755766749382, 0.01635902374982834, -0.00990622490644455, -0.08898599445819855, -0.0557311475276947, -3.4408434676459106e-34, -0.0055085294879972935, -0.04964350908994675, -0.0043090879917144775, 0.051640935242176056, 0.10847431421279907, -0.04081344977021217, 0.06698402762413025, -0.0064658052287995815, -0.046208418905735016, 0.002379375509917736, -0.01333937980234623, 0.04656672477722168, -0.04344678297638893, 0.10736186802387238, -0.023622164502739906, -0.007154778111726046, 0.06337892264127731, 0.03081011399626732, 0.0017415155889466405, -0.023916464298963547, 0.06471377611160278, 0.048583824187517166, 0.05087168142199516, 0.03700939938426018, 0.00784824788570404, 0.03747278451919556, 0.0005561959696933627, -0.012263995595276356, 0.038587287068367004, 0.028241828083992004, -0.08018270879983902, -0.02565474808216095, -0.04542669281363487, 0.0008119756821542978, 0.0017994202207773924, -0.016111189499497414, -0.0160980261862278, -0.02529282309114933, -0.000860443979036063, 0.0021979445591568947, -0.05486413091421127, 0.00646365387365222, 0.03025159426033497, -0.06247676536440849, -0.031023472547531128, 0.020622847601771355, -0.010201488621532917, -0.027522120624780655, 0.021446989849209785, -0.001481744460761547, -0.045996006578207016, -0.07837899029254913, 0.05790933594107628, 0.010568004101514816, -0.03484964370727539, 0.08017098903656006, -0.0030141419265419245, 0.04772132635116577, -0.03017893061041832, -0.052506934851408005, 0.009181455709040165, 0.04171315208077431, 0.06385490298271179, 0.008020435459911823, 0.03222692385315895, 0.020757339894771576, 0.08951730281114578, 0.11561854928731918, 0.07704265415668488, 0.018484823405742645, -0.04680810868740082, 0.04566323384642601, -0.027410367503762245, 0.01706888899207115, 0.0064431107603013515, 0.00954087171703577, 0.059478774666786194, -0.13372816145420074, 0.04089770093560219, 0.05084150284528732, -0.012564086355268955, -0.019200000911951065, 0.004336279351264238, -0.060214001685380936, -0.027182331308722496, -0.044893331825733185, -0.004208953585475683, -0.001440764288417995, -0.038175635039806366, -0.04625236243009567, -0.07791034132242203, -0.05296843498945236, -0.00449021253734827, 0.025090055540204048, -0.031486477702856064, -4.130252583221699e-33, 0.06106901168823242, 0.02548372931778431, -0.06387276202440262, 0.05998924747109413, -0.03933831676840782, -0.03022017516195774, 0.0031014385167509317, 0.03915981575846672, -0.011636207811534405, 0.05531160533428192, -0.025137929245829582, -0.06026821210980415, 0.037689391523599625, 0.03461512550711632, 0.020220717415213585, 0.05350998044013977, -0.09583251178264618, -0.01746363937854767, -0.011571615003049374, 0.04434598237276077, -0.0867958590388298, 0.07273121178150177, -0.08770973980426788, -0.06298214197158813, 0.028273094445466995, -0.031239453703165054, -0.03794858604669571, 0.034894756972789764, 0.022263729944825172, 0.05601847544312477, -0.04552675783634186, 0.04405040666460991, -0.020812662318348885, 0.0018618025351315737, 0.05171883851289749, 0.005182582885026932, 0.07216574251651764, -0.08035869151353836, 0.017596205696463585, 0.037649139761924744, 0.15251876413822174, 0.037905726581811905, 0.015833238139748573, -0.022769838571548462, 0.011108513921499252, 0.003248007735237479, -0.030832746997475624, 0.08499263226985931, -0.00290885241702199, -0.07177761942148209, -0.012792348861694336, 0.0009763442212715745, -0.03009931743144989, -0.04996320605278015, -0.03998315706849098, -0.007249023299664259, 0.051020264625549316, 0.051779478788375854, -0.032830215990543365, -0.00414526741951704, -0.11292549967765808, -0.07900848239660263, 0.0467250756919384, 0.045551639050245285, -0.08332474529743195, 0.027050210162997246, -0.10467426478862762, -0.005309038795530796, -0.08839846402406693, -0.10382862389087677, 0.0762380063533783, 0.02450578287243843, -0.017735376954078674, -0.0005166529444977641, -0.07805977761745453, -0.002322596265003085, -0.02450750023126602, -0.01702982746064663, -0.03961585834622383, 0.052757564932107925, 0.09171686321496964, -0.016088230535387993, -0.030310148373246193, 0.07714270055294037, -0.01809200458228588, 0.02454718016088009, 0.003291240194812417, 0.029291333630681038, 0.006027550436556339, -0.009868623688817024, -0.03661562502384186, 0.06340490281581879, 0.015085369348526001, 0.08831227570772171, -0.07837984710931778, -5.0268333495750994e-08, -0.04306042566895485, 0.01532499399036169, 0.05158277973532677, 0.056050125509500504, 0.0745866671204567, 0.1023641973733902, -0.02968640811741352, -0.019225580617785454, -0.034779831767082214, 0.011160878464579582, 0.04047083109617233, -0.03257543966174126, -0.053195010870695114, -0.03699788078665733, -0.011300578713417053, 0.13038025796413422, -0.034904081374406815, -0.04150138422846794, 0.06230292096734047, 0.018378213047981262, 0.11937705427408218, -0.04842342436313629, -0.018167441710829735, 0.010130765847861767, 0.006536174565553665, -0.09965643286705017, -0.010573855601251125, 0.06691393256187439, -0.03940587118268013, -0.060560714453458786, -0.018038492649793625, -0.02271844632923603, 0.005353598389774561, 0.014248091727495193, 0.05328327789902687, 0.07508403807878494, 0.012783683836460114, -0.13283254206180573, -0.06016102805733681, -0.019319234415888786, -0.009168367832899094, 0.06973196566104889, -0.011530830524861813, -0.035686176270246506, 0.02940688654780388, 0.030229203402996063, -0.004543643444776535, -0.07325877249240875, -0.017108790576457977, -0.0402996763586998, -0.0028938325121998787, -0.031379375606775284, 0.011219240725040436, 0.010173676535487175, 0.08550269156694412, 0.08871782571077347, -0.05099447816610336, -0.02442079409956932, 0.0476902574300766, 0.06117164343595505, 0.035061828792095184, 0.15036435425281525, 0.07831954210996628, 0.012488189153373241 ] }, { "text": "## Why Python?\n\n- **Easy to Learn**: Clean, readable syntax\n- **Versatile**: Web dev, data science, automation, AI\n- **Large Community**: Extensive libraries and support\n- **Cross-platform**: Works on Windows, Mac, Linux\n- **Free and Open Source**: No licensing costs\n\n## Getting Started\n\n### Installation\n\nVisit [python.org](https://www.python.org/downloads/) to download Python.\n\n```bash\n# Check if Python is installed\npython --version\n\n# Or\npython3 --version\n```\n\n### Your First Program\n\n```python\n# hello.py\nprint(\"Hello, World!\")\n```\n\nRun it:\n```bash\npython hello.py\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_1", "embedding": [ -0.031426094472408295, -0.007250645663589239, 0.004459846764802933, 0.021161099895834923, 0.029499392956495285, -0.14634980261325836, -0.020997460931539536, 0.046270523220300674, -0.10448893159627914, 0.013912166468799114, 0.005995851941406727, 0.017147470265626907, 0.06641058623790741, 0.00737235601991415, 0.08907614648342133, -0.017000138759613037, -0.043600693345069885, -0.003861470380797982, 0.000908262562006712, -0.08035053312778473, -0.0411006361246109, 0.0629509761929512, 0.05095177888870239, -0.002112695248797536, -0.012881233356893063, 0.008110219612717628, 0.04684385284781456, 0.01621330715715885, -0.028205251321196556, -0.00018199636542703956, -0.03617675602436066, 0.007004979066550732, 0.05279829725623131, -0.018218474462628365, 0.056793924421072006, 0.031022118404507637, 0.018038321286439896, -0.05655702203512192, -0.060185037553310394, -0.02727578394114971, 0.034461610019207, 0.0005091794300824404, -0.068234384059906, -0.03650307655334473, -0.03891119360923767, 0.020113831385970116, -0.11855016648769379, -0.002717277966439724, -0.005032971501350403, 0.0029158543329685926, -0.08063317090272903, -0.03312807157635689, -0.004569055512547493, -0.048202238976955414, 0.03458857536315918, 0.02382454089820385, 0.0023240044247359037, -0.01646619848906994, 0.013089369982481003, -0.06765782088041306, -0.0660686120390892, 0.05242801085114479, -0.001098150503821671, 0.05355791375041008, 0.01084139198064804, -0.05728507041931152, -0.04117989167571068, 0.035251304507255554, 0.0897500216960907, -0.018029669299721718, -0.11631757766008377, -0.03208480775356293, -0.04141097888350487, 0.04934243857860565, -0.058524239808321, -0.0912829115986824, 0.070778027176857, -0.007936435751616955, -0.04699923098087311, 0.037391554564237595, -0.06529279053211212, -0.04791092500090599, -0.060054462403059006, 0.07212835550308228, -0.008604926988482475, -0.02731218934059143, -0.0003083796473219991, 0.07587242871522903, -0.0071885474026203156, -0.033688273280858994, 0.03548988327383995, -0.07900665700435638, -0.004259573761373758, 0.0028605274856090546, -0.012672674842178822, 0.09452600032091141, 0.04119841754436493, -0.011409877799451351, -0.09055216610431671, 0.05609426274895668, -0.018967989832162857, -0.0790201798081398, 0.037613604217767715, 0.021117830649018288, 0.06470228731632233, 0.03355161473155022, 0.02337195910513401, -0.03378624841570854, 0.09272816777229309, -0.0027680043131113052, -0.032712697982788086, -0.09847662597894669, 0.007411001715809107, -0.06721767038106918, 0.06515759974718094, 0.011518646962940693, -0.02515227347612381, 0.10386844724416733, 0.04351068288087845, 0.02799171209335327, 0.03814796730875969, 0.0016665071016177535, -0.019748087972402573, -0.007489814423024654, -0.0019771100487560034, -0.018408911302685738, 0.02762194350361824, -1.2919221071544426e-33, 0.045863159000873566, -0.0850890502333641, 0.05179990455508232, 0.07698853313922882, 0.08975888788700104, -0.015398259274661541, 0.027963001281023026, -0.008441942743957043, -0.08961892127990723, 0.03198741003870964, 0.05993824452161789, 0.07776285707950592, -0.014918186701834202, 0.11381936073303223, -0.00036225817166268826, -0.03149004653096199, 0.024389587342739105, 0.008343596011400223, 0.012794917449355125, 0.07652480155229568, 0.03591132536530495, -0.004456499591469765, 0.04376234486699104, 0.05604138597846031, -0.0397946760058403, -0.07172848284244537, 0.0036583789624273777, -0.02965681441128254, 0.0363733172416687, 0.011149588041007519, -0.07457228004932404, -0.08940837532281876, -0.03388974443078041, -0.008330121636390686, -0.061220332980155945, -0.05419295281171799, -0.0831180289387703, -0.07228587567806244, -0.06591347604990005, -0.004112625028938055, -0.06895522773265839, 0.011616994626820087, 0.013622923754155636, -0.06269825994968414, 0.029397916048765182, -0.013210536912083626, -0.06992840021848679, 0.03614209592342377, -0.008794713765382767, 0.0476171039044857, 0.01778361015021801, -0.044428326189517975, 0.025547785684466362, 0.04013392701745033, -0.025118855759501457, 0.03185230493545532, 0.035047199577093124, -0.015813300386071205, 0.0019025664078071713, -0.07167933881282806, 0.016169294714927673, 0.023710070177912712, 0.06280133128166199, 0.019237499684095383, 0.0398981012403965, 0.01068130973726511, 0.025227047502994537, 0.11410268396139145, 0.011889520101249218, 0.09477803856134415, -0.06392339617013931, 0.018015457317233086, -0.035937532782554626, 0.032594602555036545, 0.049347225576639175, 0.0639381930232048, 0.07635169476270676, -0.12271866202354431, 0.04962887987494469, 0.013187588192522526, 0.018759071826934814, 0.00033823458943516016, -0.009067430160939693, -0.0173066146671772, 0.06332983076572418, -0.0403352752327919, -0.028691254556179047, 0.03305407986044884, 0.008805864490568638, 0.03103126958012581, -0.03848470747470856, -0.03464827314019203, 0.006975335534662008, 0.0392625667154789, -0.05707500874996185, -3.4418786832763515e-33, 0.07420855015516281, 0.05298676714301109, -0.059249915182590485, -0.019874975085258484, -0.07568022608757019, -0.08179674297571182, -0.0019106309628114104, 0.046557649970054626, -0.013488451950252056, -0.05953213572502136, -0.08420637249946594, 0.00034323203726671636, 0.12638318538665771, 0.011514071375131607, 0.06431705504655838, 0.0636046901345253, -0.0390283577144146, 0.029216375201940536, 0.026625730097293854, -0.0019978187046945095, -0.05405450984835625, -0.003788985079154372, -0.02828478440642357, -0.03910079970955849, -0.04168660193681717, -0.07548244297504425, 0.04240604117512703, -0.007456885650753975, -0.01993311382830143, 0.05798209086060524, -0.03642547130584717, 0.08491525799036026, -0.029838191345334053, 0.06326956301927567, 0.047528304159641266, 0.02138945460319519, -0.0077212220057845116, -0.04699607938528061, 0.04902895167469978, -0.04396246373653412, 0.10539085417985916, 0.04369695857167244, 0.020032284781336784, -0.002759763039648533, -0.011701387353241444, 0.016614746302366257, -0.05513409897685051, 0.05028252676129341, -0.034073635935783386, -0.007367243990302086, -0.0009358088718727231, -0.024988586083054543, -0.009010843001306057, -0.045585427433252335, -0.062442705035209656, -0.06377394497394562, 0.039346978068351746, 0.061569977551698685, -0.08686432242393494, -0.023626865819096565, -0.08590404689311981, -0.042349930852651596, -0.035433944314718246, 0.049403201788663864, -0.12992875277996063, -0.01705704815685749, -0.12449387460947037, 0.010121339000761509, -0.0261355210095644, -0.1152707189321518, 0.04656202346086502, 0.005293009337037802, -0.022154932841658592, 0.0012158058816567063, -0.031762801110744476, 0.09997929632663727, -0.0077494182623922825, -0.009381931275129318, -0.036317285150289536, 0.09167759865522385, 0.06830214709043503, 0.03845713287591934, -0.011070385575294495, -0.05562399700284004, -0.0681506022810936, 0.029346013441681862, -0.03626786917448044, 0.03209374472498894, 0.020567404106259346, -0.021031677722930908, 0.03729752451181412, 0.05374051630496979, 0.05260074883699417, 0.012519888579845428, -0.016047341749072075, -4.9727205464478175e-08, 0.015332140028476715, -0.02411942556500435, 0.06927882134914398, 0.04928065836429596, -0.00441732257604599, 0.046443644911050797, 0.05757240951061249, -0.11275463551282883, -0.03378543630242348, 0.03432827442884445, 0.009748844429850578, -0.060606569051742554, -0.09606263786554337, -0.0335182324051857, 0.007304183207452297, 0.1497618407011032, -0.029800085350871086, 0.01745801605284214, 0.022970154881477356, 0.027809208258986473, 0.05764926224946976, -0.018498709425330162, -0.035523414611816406, 0.047752898186445236, -0.05353687331080437, -0.042708203196525574, -0.007745733484625816, -0.005853631999343634, -0.11613087356090546, -0.12104450166225433, 0.04473124071955681, -0.057118892669677734, -0.030709410086274147, 0.042513102293014526, 0.023737803101539612, -0.03217010572552681, -0.03627380356192589, -0.06651869416236877, 0.008002053014934063, -0.025142528116703033, -0.023153208196163177, 0.05040571838617325, -0.012197894975543022, -0.0636986494064331, -0.02904503606259823, 0.004371264483779669, 0.02511303685605526, -0.05569550395011902, -0.035566382110118866, -0.02769218385219574, 0.03169960156083107, -0.03336514160037041, 0.03278570622205734, -0.04903307184576988, 0.11018632352352142, 0.15833424031734467, -0.05853117257356644, -0.013549841940402985, 0.020123550668358803, 0.018123893067240715, 0.029635783284902573, 0.07365623861551285, 0.0983913242816925, 0.0018956898711621761 ] }, { "text": "## Basic Syntax\n\n### Variables\n\n```python\n# Variables (no declaration needed)\nname = \"Alice\"\nage = 25\nheight = 5.6\nis_student = True\n\n# Multiple assignment\nx, y, z = 1, 2, 3\n```\n\n### Data Types\n\n```python\n# Integers\ncount = 10\n\n# Floats\nprice = 19.99\n\n# Strings\nmessage = \"Hello, Python!\"\n\n# Booleans\nis_active = True\n\n# Lists\nfruits = [\"apple\", \"banana\", \"cherry\"]\n\n# Tuples (immutable)\ncoordinates = (10, 20)\n\n# Dictionaries\nperson = {\n \"name\": \"Alice\",\n \"age\": 25,\n \"city\": \"New York\"\n}\n\n# Sets (unique elements)\nunique_numbers = {1, 2, 3, 4}\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_2", "embedding": [ 0.036457985639572144, 0.055071186274290085, 0.0326097346842289, -0.01912892609834671, -0.015720827504992485, -0.016453886404633522, 0.11803936213254929, -0.04896898940205574, -0.09784545749425888, 0.0002634773263707757, 0.07309076189994812, 0.007890942506492138, 0.08842004835605621, -0.0021876306273043156, 0.021380573511123657, 0.10036113113164902, -0.033010631799697876, 0.00226006330922246, -0.02780545875430107, -0.15279878675937653, -0.003987741190940142, -0.011067049577832222, -0.0016339378198608756, 0.06602626293897629, 0.02704733796417713, 0.00850900262594223, 0.0375271774828434, 0.016041941940784454, -0.07870803028345108, -0.0024453510995954275, -0.051150280982255936, 0.0035692888777703047, 0.0707182064652443, 0.062299150973558426, 0.008825588040053844, 0.027567895129323006, -0.07587111741304398, 0.005120251327753067, 0.0036947419866919518, 0.060993742197752, -0.04309048131108284, -0.04037969186902046, -0.003486118745058775, -0.07331680506467819, -0.06466814130544662, 0.06690804660320282, -0.05531522259116173, 0.04711411893367767, 0.0513172447681427, -0.01147948857396841, -0.051457542926073074, 0.014345756731927395, -0.03381877392530441, -0.03812067583203316, -0.002264619804918766, -0.032907016575336456, -0.03524034842848778, -0.059223443269729614, 0.05309932678937912, -0.0875159427523613, -0.006859678775072098, 0.00041648995829746127, 0.04405798017978668, -0.00029152477509342134, -0.027323320508003235, -0.06430727988481522, -0.04941761866211891, 0.0548945814371109, 0.05419892445206642, 0.038644202053546906, 0.04165942221879959, 0.07677445560693741, -0.0031699021346867085, 0.03864634782075882, 0.018714021891355515, -0.06809120625257492, 0.06312014907598495, -0.09382414072751999, -0.024951033294200897, 0.08119823783636093, -0.13933157920837402, -0.04590165987610817, -0.016481798142194748, 0.02235987037420273, 0.015315033495426178, -0.10992354154586792, 0.013052652589976788, 0.025520235300064087, -0.042581818997859955, -0.027717046439647675, -0.06099459528923035, -0.006509588565677404, 0.07603363692760468, 0.03846774622797966, 0.03941820561885834, 0.05855444446206093, 0.04233665019273758, -0.05901903659105301, -0.0009468711214140058, 0.033643513917922974, -0.02190227061510086, -4.8279987822752446e-05, 0.07510311156511307, 0.04215016961097717, -0.009108043275773525, -0.0011400490766391158, 0.10909990966320038, -0.1371319591999054, -0.003679179586470127, -0.035457346588373184, 0.009523413144052029, -0.0839715525507927, -0.07654748857021332, 0.05735558271408081, -0.020015986636281013, -0.009661086834967136, -0.013706781901419163, 0.05902013182640076, -0.007764708716422319, -0.049299243837594986, 0.06611358374357224, -0.02302851527929306, 0.04196234792470932, -0.017051436007022858, -0.046574417501688004, -0.035866349935531616, 0.030219392850995064, 5.5504988168806025e-33, -0.08649403601884842, 0.00045544098247773945, -0.018183453008532524, 0.07301060110330582, 0.02461220882833004, -0.053864751011133194, -0.01798054203391075, 0.04044940695166588, -0.02846348099410534, 0.018890362232923508, -0.04969141259789467, 0.06739754974842072, 0.016232594847679138, 0.06935729086399078, -0.010020950809121132, -0.01529687363654375, 0.0723249539732933, 0.03135834261775017, 0.00850340910255909, 0.06643609702587128, 0.07019820064306259, -0.06483637541532516, -0.023946180939674377, -0.023122718557715416, -0.06910042464733124, -0.03792223706841469, -0.022750329226255417, -0.01888306997716427, 0.08380569517612457, -0.03245541453361511, -0.00030075779068283737, 0.02047749236226082, 0.05144718661904335, 0.02333439700305462, -0.03547696769237518, -0.0011929899919778109, 0.0431620255112648, 0.0008813750464469194, 0.014106185175478458, -0.02968708425760269, 0.005841514095664024, 0.013066468760371208, 0.07159602642059326, 0.06873096525669098, -0.04594637453556061, 0.11783434450626373, -0.021860497072339058, 0.03545531630516052, 0.028271880000829697, 0.0822904035449028, -0.09674808382987976, -0.019108518958091736, -0.04858087748289108, 0.006369250360876322, -0.04945122078061104, -0.049192316830158234, -0.001165320398285985, 0.0158835519105196, -0.00014085089787840843, -0.013714222237467766, 0.004886029753834009, 0.03337309509515762, 0.06240307539701462, 0.034825246781110764, 0.051889754831790924, 0.0014352633152157068, 0.05598410218954086, 0.00039935336099006236, 0.12428781390190125, 0.06441425532102585, -0.029879720881581306, 0.01941114477813244, -0.018619155511260033, -0.007886589504778385, -0.04676191136240959, 0.01004373375326395, 0.04604724794626236, -0.04319509118795395, -0.0033421649131923914, -0.024034343659877777, 0.050348229706287384, -0.06472694128751755, -0.05455397814512253, -0.014905151911079884, -0.047954536974430084, 0.005755873862653971, -0.031960271298885345, -0.03845704346895218, -0.0018555134302005172, 0.0419626384973526, -0.0380672961473465, 0.03776123747229576, -0.07147012650966644, -0.039024718105793, -0.007362681441009045, -7.64001386120613e-33, -0.016931850463151932, 0.03599948808550835, 0.0451490581035614, -0.01694292202591896, 0.07432443648576736, -0.007318023592233658, 0.015930308029055595, 0.008647473528981209, 0.08254091441631317, -0.06417243182659149, -0.10359429568052292, -0.051661454141139984, 0.07056789100170135, -0.02526923269033432, -0.0030633832793682814, 0.07364756613969803, -0.1222933977842331, 0.06227349117398262, -0.03267573192715645, -0.00019323726883158088, -0.10234121978282928, 0.11747393012046814, -0.09580285847187042, -0.01188496220856905, -0.03534906357526779, 0.027109865099191666, 0.022812820971012115, -0.12187130749225616, -0.00600100914016366, -0.004752656910568476, -0.040662892162799835, -0.001117793726734817, -0.0502808652818203, -0.013605836778879166, -0.021635927259922028, -0.03925265744328499, 0.01225439552217722, -0.035865023732185364, -0.1267520785331726, 0.052491363137960434, 0.1170639768242836, 0.062113046646118164, -0.02412867732346058, 0.005213368218392134, 0.062650665640831, 0.05112385377287865, -0.01032972801476717, 0.006241537164896727, 0.03310801088809967, 0.009075663052499294, 0.0010195955401286483, 0.03407168760895729, -0.09017989039421082, -0.004663773346692324, 0.031731680035591125, 0.022973109036684036, -0.027773628011345863, 0.007514973171055317, 0.015887470915913582, -0.08101790398359299, -0.08001325279474258, -0.0873592272400856, 0.013971525244414806, 0.10697002708911896, -0.05610233545303345, -0.059811703860759735, -0.04515913873910904, -0.04969843477010727, -0.03840525075793266, -0.011554940603673458, 0.0029734349809587, -0.027477316558361053, 0.013628622516989708, -0.15069198608398438, -0.07429447770118713, 0.009983383119106293, 0.0028540214989334345, 0.0015425318852066994, -0.03708184137940407, 0.06046448275446892, 0.009032822214066982, 0.020910384133458138, 0.03495495766401291, 0.09307468682527542, -0.060550618916749954, -0.009075918234884739, 0.057708289474248886, 0.06174606829881668, -0.023076733574271202, 0.06533307582139969, -0.01474926620721817, 0.02139132097363472, -0.004253909923136234, 0.009644030593335629, -0.0827597975730896, -5.246502610134485e-08, -0.0388922356069088, -0.0002616017300169915, -0.09287641942501068, 0.06329488009214401, -0.039950571954250336, 0.03592168539762497, 0.01981501653790474, -0.00853453204035759, -0.012286754325032234, 0.05993330851197243, 0.030100861564278603, 0.05219775810837746, 0.010474884882569313, 0.027659865096211433, -0.004042112268507481, 0.07278131693601608, 0.00563872279599309, 0.037584491074085236, 0.005172012373805046, 0.037244509905576706, 0.08621731400489807, -0.012312102131545544, -0.024056412279605865, 0.06830368936061859, -0.03435267135500908, 0.013868960551917553, 0.004670572467148304, 0.017152832821011543, -0.031019046902656555, 0.01866806298494339, 0.003042028984054923, -0.05867781862616539, 0.0391969159245491, -0.010440071113407612, 0.07557520270347595, -0.07462526857852936, -0.08049434423446655, -0.007901795208454132, -0.056370388716459274, -0.047937072813510895, -0.07642296701669693, -0.050377778708934784, -0.14218862354755402, 0.036385759711265564, 0.07506313920021057, 0.005941116251051426, -0.07955145835876465, -0.03470102697610855, 0.023504916578531265, 0.05169950798153877, -0.1065719947218895, -0.008856415748596191, 0.03736618906259537, -0.08773411065340042, 0.06109166145324707, 0.02056286297738552, 0.018758902326226234, 0.04978170990943909, 0.06301507353782654, -0.03523411229252815, 0.018519286066293716, -0.028320780023932457, 0.03464869409799576, -0.04797958955168724 ] }, { "text": "## Control Flow\n\n### Conditionals\n\n```python\n# if-elif-else\nage = 18\n\nif age < 18:\n print(\"Minor\")\nelif age == 18:\n print(\"Just became an adult\")\nelse:\n print(\"Adult\")\n```\n\n### Loops\n\n```python\n# for loop\nfruits = [\"apple\", \"banana\", \"cherry\"]\nfor fruit in fruits:\n print(fruit)\n\n# range()\nfor i in range(5): # 0 to 4\n print(i)\n\n# while loop\ncount = 0\nwhile count < 5:\n print(count)\n count += 1\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_3", "embedding": [ 0.04324047639966011, 0.09525658935308456, 0.019825154915452003, -0.003183393506333232, -0.0054470328614115715, 0.020180607214570045, 0.026001594960689545, -0.013820097781717777, -0.06489793956279755, -0.017696328461170197, 0.12218081206083298, -0.05470343306660652, 0.053011275827884674, -0.0347890742123127, 0.029419107362627983, 0.08575903624296188, -0.050438184291124344, 0.03690968081355095, -0.03375592082738876, -0.17514535784721375, 0.03613057732582092, 0.011040964163839817, 0.0029869768768548965, -0.029827892780303955, -0.027625780552625656, 0.012301919981837273, -0.08844864368438721, 0.000710542022716254, -0.005616127513349056, 0.045285046100616455, 0.001133836223743856, 0.07954154163599014, 0.06545516103506088, 0.028424296528100967, -0.019673338159918785, -0.080197773873806, -0.02279459871351719, -0.023394232615828514, 0.017730722203850746, 0.05671760067343712, 0.00032398596522398293, -0.04070776700973511, -0.04833025485277176, -0.059092141687870026, 0.011064151301980019, 0.04366806149482727, -0.12642119824886322, 0.03149998560547829, 0.016868548467755318, -0.014838921837508678, -0.04492771252989769, -0.027269430458545685, -0.00672524468973279, -0.031248338520526886, 0.07144526392221451, -0.06683162599802017, 0.01601564511656761, -0.056576285511255264, 0.06557226926088333, -0.03260020166635513, -0.0003966729564126581, -0.06756625324487686, 0.01384849101305008, -0.06143610179424286, 0.0057628825306892395, -0.057588931173086166, -0.020995207130908966, 0.02893894724547863, 0.05484194681048393, 0.06008506938815117, -0.0416363850235939, 0.04722902551293373, -0.03437141701579094, 0.04789837822318077, -0.007552589755505323, -0.06927955895662308, 0.059807926416397095, -0.04393531754612923, -0.01996128261089325, -0.007666578982025385, -0.1244334727525711, -0.027427440509200096, -0.023475324735045433, -0.02270182967185974, -0.033323876559734344, -0.09006041288375854, 0.02032444253563881, 0.02256614714860916, -0.020997801795601845, 0.06350063532590866, -0.05051500350236893, 0.0021238725166767836, 0.0750146433711052, -0.02980419620871544, 0.041603460907936096, 0.004824290983378887, -0.0006502600153908134, -0.13794831931591034, -0.07787555456161499, 0.0003706487768795341, -0.013998019509017467, -0.016796763986349106, 0.09341466426849365, -0.004414041992276907, -0.019058234989643097, 0.006503663957118988, 0.02044159360229969, -0.037941236048936844, 0.054786358028650284, 0.0022539584897458553, 0.04781036451458931, -0.0037616966292262077, 0.06779134273529053, 0.050385136157274246, -0.023411769419908524, -0.03086351789534092, -0.0013697852846235037, 0.07997097074985504, 0.04539284482598305, 0.036592185497283936, 0.05155998468399048, 0.08504979312419891, 0.0026615874376147985, 0.03280497342348099, -0.07063470035791397, -0.06853906810283661, 0.0174221433699131, 2.807340036875765e-33, -0.07790903002023697, -0.05687238276004791, -0.022099465131759644, 0.08548231422901154, 0.03475617244839668, 0.031697195023298264, 0.012210703454911709, -0.06920696794986725, 0.024197349324822426, -0.02150123566389084, -0.025722330436110497, 0.03858455270528793, -0.08269136399030685, 0.02211231179535389, 0.02929949387907982, 0.0218577329069376, 0.04026777297258377, -0.03595903143286705, 0.013047881424427032, 0.03591729328036308, -0.043580375611782074, -0.06480800360441208, 0.023020625114440918, -0.03596312925219536, -0.012170846574008465, -0.06278981268405914, 0.016288433223962784, -0.04821491986513138, 0.05494186282157898, -0.026082847267389297, -0.0185286533087492, -0.030224652960896492, -0.012783670797944069, -0.06962078809738159, 0.006904612760990858, -0.018142355605959892, 0.08678527176380157, 0.0354418121278286, 0.024507245048880577, 0.009774264879524708, -0.12042178213596344, -0.03249983862042427, 0.05123842880129814, 0.13136908411979675, -0.056062426418066025, -0.03024616278707981, -0.027420563623309135, 0.004209423903375864, -0.022971946746110916, 0.08582223206758499, -0.05521645024418831, -0.024818679317831993, 0.007776585873216391, -0.012527603656053543, -0.042363300919532776, 0.022921012714505196, -0.07269659638404846, 0.05193100497126579, -0.08049913495779037, -0.010265236720442772, 0.15150783956050873, 0.013223584741353989, 0.021993720903992653, 0.02724643424153328, -0.019059227779507637, 0.04216540604829788, 0.06570866703987122, 0.03911691531538963, 0.041667889803647995, 0.04561460390686989, -0.08510134369134903, -0.01107145193964243, -0.00863864365965128, -0.04857282340526581, -0.05547310784459114, -0.06929808855056763, 0.06367477774620056, -0.05701259896159172, -0.035658709704875946, -0.03624657914042473, 0.06936467438936234, 0.02699667401611805, -0.017194198444485664, -0.009098472073674202, 0.003264379221946001, -0.0025515444576740265, -0.058777809143066406, 0.002648258348926902, 0.028299113735556602, 0.01072789542376995, -0.025937369093298912, -0.04583638906478882, 0.07181932777166367, -0.04540049657225609, 0.06945227831602097, -6.301773786880435e-33, 0.007074168883264065, 0.04192141070961952, 0.0721319317817688, -0.07179383188486099, 0.07853516191244125, -0.03500748053193092, 0.025488847866654396, -0.009406973607838154, 0.008224801160395145, -0.12013817578554153, -0.04986176639795303, -0.014927083626389503, 0.004835778847336769, -0.0017239836743101478, 0.05537328124046326, 0.08427108079195023, -0.05919128656387329, 0.09985419362783432, -0.025214381515979767, -0.009256858378648758, -0.08357164263725281, 0.05202291160821915, -0.05119822546839714, 0.048891596496105194, -0.04359936714172363, 0.00564190000295639, 0.012523881159722805, -0.06313624233007431, -0.022738546133041382, 0.011702628806233406, 0.059895217418670654, -0.04333755746483803, 0.03473568335175514, 0.0653265044093132, 0.03546774759888649, -0.07165972143411636, -0.028816256672143936, -0.07132257521152496, -0.0334450900554657, 0.03237452730536461, 0.0439143106341362, 0.03314121067523956, 0.03644414246082306, 0.07140134274959564, -0.03861076012253761, 0.025859370827674866, 0.01570763997733593, 0.03291497379541397, -0.024327266961336136, -0.024010971188545227, -0.019579119980335236, 0.03615634888410568, -0.08883479982614517, -0.038225963711738586, -0.10138111561536789, -0.02946271188557148, -0.024348335340619087, 0.01744980178773403, -0.05066540837287903, -0.00041871893336065114, -0.1166396513581276, -0.09286018460988998, -0.024021653458476067, -0.005174706224352121, -0.09766188263893127, -0.027824698016047478, -0.02579580806195736, -0.03174971416592598, -0.11217669397592545, 0.0576193705201149, 0.09791857749223709, 0.025189461186528206, -0.08190889656543732, -0.08167882263660431, -0.0398842915892601, -0.0011707734083756804, -0.04712324216961861, -0.021869605407118797, -0.07291360944509506, -0.009591280482709408, -0.03888125345110893, 0.031130852177739143, 0.0007813422125764191, 0.03657911345362663, -0.08080478757619858, -0.047138165682554245, 0.05722411349415779, -0.010814104229211807, -0.0006817857502028346, 0.0637262761592865, 0.016113942489027977, -0.0742320865392685, 0.024778390303254128, 0.018209220841526985, -0.03207219019532204, -3.9591018463625005e-08, 0.07744547724723816, -0.027810780331492424, -0.06646513938903809, 0.0342397540807724, -0.0036998114082962275, 0.06944644451141357, -0.04246709495782852, -0.04182174801826477, 0.03788083419203758, -1.608747879799921e-05, 0.010334555990993977, 0.06967142224311829, 0.005327889695763588, -0.0158272385597229, 0.029845379292964935, 0.05057162791490555, 0.06135447323322296, 0.0622834637761116, 0.06263792514801025, 0.05508049204945564, 0.0669499933719635, 0.002508448204025626, -0.03985244408249855, 0.06284233927726746, -0.062221281230449677, -0.04964876547455788, 0.05704621225595474, 0.022722698748111725, -0.05116257444024086, -0.029285164549946785, 0.11757859587669373, -0.006926790811121464, -0.010106544941663742, 0.054163169115781784, 0.0495029017329216, -0.047569215297698975, -0.02428142912685871, 0.01839441992342472, -0.04632414132356644, -0.004846897907555103, -0.011082873679697514, -0.06030726060271263, -0.09869346022605896, -0.015450501814484596, -0.022602705284953117, 0.021545475348830223, 0.019313322380185127, -0.05063750594854355, -0.007514449302107096, 0.07349887490272522, -0.07140720635652542, 0.00226409500464797, 0.09652236104011536, -0.029418153688311577, 0.0923498123884201, 0.021864905953407288, 0.07802140712738037, 0.03633665293455124, 0.013116401620209217, 0.08542856574058533, 0.05258256942033768, 0.01572512835264206, 0.11912275105714798, -0.05853047966957092 ] }, { "text": "## Functions\n\n```python\n# Basic function\ndef greet(name):\n return f\"Hello, {name}!\"\n\nmessage = greet(\"Alice\")\nprint(message) # Hello, Alice!\n\n# Default parameters\ndef power(base, exponent=2):\n return base ** exponent\n\nprint(power(3)) # 9 (3^2)\nprint(power(3, 3)) # 27 (3^3)\n\n# Multiple return values\ndef get_stats(numbers):\n return min(numbers), max(numbers), sum(numbers)\n\nminimum, maximum, total = get_stats([1, 2, 3, 4, 5])\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_4", "embedding": [ -0.013245378620922565, 0.08501962572336197, -0.06442516297101974, 0.02245997078716755, -0.09810224175453186, -0.07547448575496674, 0.05445389449596405, 0.019804364070296288, 0.01951408013701439, -0.02141190692782402, -0.006126068066805601, -0.02427416853606701, 0.06361782550811768, -0.0010145591804757714, 0.08590749651193619, 0.05661432817578316, -0.030293181538581848, 0.08326403051614761, -0.03336787223815918, -0.09007631242275238, 0.09379297494888306, 0.0782383382320404, 0.01927555352449417, 0.028287231922149658, 0.040964704006910324, -0.06791981309652328, -0.08659440279006958, 0.04988839477300644, 0.0010242955759167671, -0.043255168944597244, -0.025554921478033066, 0.054506801068782806, 0.06378064304590225, 0.04186644405126572, -0.01839500293135643, 0.04654369503259659, -0.06520156562328339, 0.0192152950912714, 0.03278644010424614, 0.08815044164657593, -0.07512495666742325, -0.043125178664922714, 0.0007069437997415662, -0.015602156519889832, -0.03718981519341469, 0.034547049552202225, -0.04418449103832245, 0.0579206682741642, 0.06297188997268677, -0.03672425448894501, -0.019485583528876305, 0.0847925990819931, -0.03820645436644554, 0.02535337768495083, 0.08983156830072403, -0.07982197403907776, 0.016812840476632118, -0.09393030405044556, 0.007384392898529768, -0.003453231882303953, -0.06328818202018738, -0.03279900178313255, 0.013844890519976616, -0.01656872034072876, 0.07231150567531586, -0.039679013192653656, -0.016845446079969406, 0.016893817111849785, -0.05887993797659874, 0.10328943282365799, -0.08570023626089096, 0.004712898749858141, -0.026518169790506363, -0.040780045092105865, 0.013760572299361229, -0.014050107449293137, -0.05462177097797394, -0.053543586283922195, -0.037506140768527985, 0.005307910498231649, -0.03796219080686569, -0.056362397968769073, -0.007438391447067261, 0.09013485908508301, 0.051483988761901855, -0.04527627304196358, 0.0029789055697619915, 0.06910514831542969, 0.023269372060894966, -0.027844928205013275, -0.08622703701257706, 0.016569262370467186, -0.0281235259026289, 0.06426996737718582, -0.10681424289941788, 0.015127107501029968, 0.010282236151397228, -0.11277236044406891, -0.02723011001944542, 0.06654518842697144, -0.03926851227879524, 0.05282106250524521, 0.09621692448854446, -0.06745188683271408, -0.013418038375675678, -0.022442977875471115, -0.014281651936471462, -0.016720030456781387, -0.007940915413200855, -0.02690086141228676, 0.014593463391065598, -0.06792612373828888, -0.04920090734958649, 0.033764079213142395, 0.08424562215805054, 0.008114938624203205, -0.035727258771657944, 0.020020773634314537, 0.020715884864330292, 0.02069302462041378, 0.1677110344171524, 0.014410914853215218, 0.08389773964881897, 0.06530258059501648, 0.0017543729627504945, 0.024630581960082054, 0.01223499421030283, 4.177600026304882e-33, -0.050681620836257935, 0.011225558817386627, 0.04888011887669563, 0.09229892492294312, -0.0030067958869040012, 0.08159387856721878, -0.034193772822618484, -0.0461115688085556, 0.015411781147122383, 0.061256926506757736, -0.03226899355649948, 0.12554359436035156, 0.09859083592891693, -0.005193679593503475, 0.014112098142504692, 0.052491795271635056, 0.02086639404296875, 0.05294042453169823, -0.039572104811668396, 0.04746390879154205, 0.07507240027189255, 0.02418914996087551, 0.05108339712023735, 0.03132246434688568, 0.046927258372306824, 0.018050093203783035, 0.006428949534893036, -0.0019227490993216634, -0.03656022623181343, -0.013458700850605965, 0.024597933515906334, 0.007921548560261726, 0.041403088718652725, -0.027596430853009224, 0.06165120005607605, -0.02988077513873577, 0.09677159041166306, -0.020098650828003883, -0.04051929712295532, 0.006746930535882711, -0.07091819494962692, 0.006585130002349615, 0.06503687798976898, -0.018311219289898872, -0.0690302699804306, -0.0051923408173024654, -0.026020191609859467, 0.035600826144218445, 0.05918172001838684, 0.009104504249989986, -0.10616173595190048, -0.04479818791151047, 0.03799864649772644, 0.04210658743977547, -0.052574753761291504, -0.034738991409540176, -0.03502282872796059, 0.009885042905807495, -0.037636373192071915, -0.00710637541487813, -0.057316891849040985, -0.018493574112653732, 0.018197743222117424, -0.05628608912229538, -0.010815148241817951, -0.002804145682603121, 0.025589309632778168, 0.0740661546587944, 0.06997055560350418, 0.0939890444278717, 0.04268687590956688, 0.03889453038573265, -0.037961382418870926, 0.014240728691220284, -0.009031356312334538, 0.04332013428211212, 0.06494981795549393, -0.028488416224718094, -0.0458303727209568, -0.021888909861445427, 0.01745695248246193, 0.040304262191057205, -0.006752080749720335, 0.012684914283454418, 0.05351106822490692, -0.03985413536429405, -0.016977347433567047, -0.020012756809592247, -0.09415679425001144, 0.0011076661758124828, -0.14585956931114197, -0.013477935455739498, -0.0063018579967319965, -0.03657408431172371, -0.10259639471769333, -6.379898610804023e-33, -0.04002298042178154, 0.11521808058023453, -0.012744632549583912, -0.03270266205072403, 0.03761021047830582, 0.03832535818219185, -0.01334780640900135, -0.03722049295902252, 0.042110566049814224, -0.0044072517193853855, -0.012606700882315636, -0.05813082307577133, 0.01680118404328823, -0.07859671115875244, 0.1157074123620987, 0.04494398459792137, -0.06449969112873077, 0.03029966726899147, -0.020352769643068314, -3.024029138032347e-05, -0.045410457998514175, 0.04955516755580902, -0.0885440781712532, -0.01574014686048031, -0.05177083984017372, 0.0370292142033577, -0.0019711449276655912, -0.11157339811325073, 0.04218731075525284, -0.013575145974755287, -0.06959772855043411, -0.0028982986696064472, -0.02863936871290207, 0.07436482608318329, -0.04778999090194702, -0.04681835323572159, 0.05404716357588768, -0.0130999144166708, 0.009378264658153057, 0.05355236679315567, 0.1041422039270401, 0.07211945950984955, 0.0533142127096653, -0.029534753412008286, 0.049794360995292664, 0.015552102588117123, -0.029828915372490883, -0.051968272775411606, -0.008896359242498875, -0.027925720438361168, 0.020414788275957108, -0.046964436769485474, -0.08930925279855728, 0.013362112455070019, -0.13009858131408691, -0.0430976040661335, -0.0244336798787117, -0.0035790016409009695, 0.01104162447154522, -0.029917489737272263, -0.02958252653479576, -0.06276828795671463, 0.01693877764046192, 0.05920007452368736, -0.12066979706287384, -0.05605281516909599, -0.06108921021223068, -0.06413459032773972, -0.04143240302801132, -0.0293565820902586, -0.028209665790200233, -0.007872003130614758, 0.021133724600076675, -0.00785470474511385, -0.10528036206960678, 0.0676569864153862, -0.09376203268766403, -0.07225187122821808, -0.059381626546382904, 0.03483499959111214, 0.008877929300069809, -0.008684803731739521, 0.025388075038790703, -0.03328751027584076, -0.07160285115242004, -0.04123537242412567, 0.13758191466331482, 0.08090659976005554, 0.08320102840662003, -0.08185993134975433, -0.023283516988158226, 0.08922883868217468, 0.05643739178776741, 0.02078540436923504, -0.055407993495464325, -4.864359581802091e-08, 0.016383830457925797, -0.06212519854307175, 0.03975602984428406, 0.004186882171779871, -0.005773951765149832, 0.08265062421560287, 0.010612286627292633, 0.0021493607200682163, -0.023811286315321922, -0.02397618256509304, 0.03741640970110893, -0.019115371629595757, 0.010812394320964813, -0.06586087495088577, 0.02676885388791561, 0.03716661408543587, 0.010573017410933971, 0.05235271900892258, -0.00612662872299552, -0.08277878165245056, -0.020796384662389755, -0.02880171500146389, -0.01582508347928524, -0.006437711883336306, -0.04085559397935867, 0.0029412826988846064, 0.024643534794449806, -0.009080734103918076, -0.028037836775183678, -0.03393367677927017, 0.04745678976178169, 0.014274940825998783, 0.009645679034292698, 0.010668125003576279, -0.09513476490974426, -0.000769851147197187, -0.006700984667986631, -0.02132364735007286, 0.03305764123797417, 0.04891032353043556, -0.0730704739689827, -0.041731998324394226, -0.0989832878112793, 0.029001733288168907, 0.017305800691246986, -0.07147416472434998, 0.008060527965426445, -0.10004133731126785, 0.022665824741125107, -7.918922347016633e-05, 0.02156541682779789, -0.01712479069828987, 0.006341615691781044, -0.0669894888997078, -0.005566175561398268, 0.03569389879703522, -0.0395200289785862, 0.0031775045208632946, -0.03518566116690636, 0.007104420103132725, -0.01031082309782505, 0.009795639663934708, 0.06054631993174553, -0.037378888577222824 ] }, { "text": "## Lists and List Comprehensions\n\n```python\n# List operations\nnumbers = [1, 2, 3, 4, 5]\n\nnumbers.append(6) # Add to end\nnumbers.insert(0, 0) # Insert at position\nnumbers.remove(3) # Remove value\nnumbers.pop() # Remove last item\n\n# Slicing\nfirst_three = numbers[:3]\nlast_two = numbers[-2:]\n\n# List comprehension\nsquares = [x**2 for x in range(10)]\n# [0, 1, 4, 9, 16, 25, 36, 49, 64, 81]\n\nevens = [x for x in range(20) if x % 2 == 0]\n# [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_5", "embedding": [ 0.005698461085557938, 0.031090043485164642, 0.02074803225696087, -0.018305690959095955, 0.013098306953907013, -0.04266945272684097, 0.017312269657850266, -0.012220904231071472, -0.055029578506946564, -0.000639180070720613, 0.01757793501019478, 0.1157398447394371, 0.006422256585210562, -0.0038279194850474596, -0.050097573548555374, -0.003818933619186282, 0.0005178088904358447, 0.0281869824975729, 0.029467392712831497, -0.10486850142478943, 0.06860310584306717, 0.06397336721420288, -0.09636325389146805, -0.008239265531301498, 0.05549557879567146, -0.016160232946276665, -0.044351976364851, 0.016598014160990715, 0.034510537981987, 0.003108985023573041, 0.007134416606277227, -0.025043657049536705, 0.05809229984879494, -0.019391167908906937, 0.045553550124168396, 0.01700322888791561, -0.04476460814476013, 0.008408625610172749, 0.007090636063367128, 0.059622276574373245, -0.014124982990324497, -0.09858722984790802, -0.0060227238573133945, -0.03916464000940323, 0.02472393587231636, 0.07144852727651596, 0.03161095455288887, -0.019526619464159012, -0.005185498856008053, -0.033292606472969055, -0.06240169331431389, 0.014531624503433704, -0.03306793421506882, -0.0462384894490242, -0.0017970132175832987, -0.06911330670118332, 0.07742021232843399, -0.07057442516088486, 0.04901089519262314, -0.07471078634262085, 0.0006633253069594502, 0.025905923917889595, 0.04583071172237396, -0.06577679514884949, -0.02711423486471176, 0.008035913109779358, -0.03587207943201065, 0.03176729008555412, -0.050747089087963104, 0.07062949985265732, -0.023128103464841843, 0.09737930446863174, 0.0042274766601622105, 0.01590590551495552, 0.07633093744516373, -0.0328255370259285, 0.08409707993268967, -0.1140524297952652, -0.07467269897460938, 0.03735613450407982, 0.010370193049311638, -0.06954134255647659, 0.0510905459523201, 0.05067543685436249, -0.11015137284994125, -0.1426365077495575, 0.011832412332296371, 0.06767403334379196, 0.03782758116722107, 0.051644161343574524, -0.025381142273545265, 0.012872734107077122, 0.04510020092129707, -0.07196707278490067, 0.05089429020881653, 0.07182653993368149, 0.0790562853217125, -0.005149994511157274, -0.04025789350271225, -0.026801614090800285, 0.0017131308559328318, -0.04077603667974472, 0.005255053285509348, -0.05425186827778816, 0.1198556199669838, 0.047279875725507736, 0.0024386108852922916, -0.08538752794265747, 0.034328341484069824, -0.0870249792933464, 0.02615055814385414, -0.08352483063936234, 0.0014651718083769083, -0.009299907833337784, 0.06393841654062271, -0.021631982177495956, -0.007251803297549486, 0.011429289355874062, -0.007858159951865673, -0.015030933544039726, 0.05945804715156555, 0.026741057634353638, 0.04851188883185387, 0.04947759211063385, -0.006464149337261915, -0.012325522489845753, -0.04095857962965965, 2.5745284215786185e-33, -0.12723402678966522, -0.05254392698407173, -0.018980301916599274, 0.04466690495610237, 0.030700918287038803, -0.03928900510072708, 0.008210808970034122, -0.1051444262266159, 0.02539771795272827, 0.0560460202395916, -0.011160731315612793, 0.04085277393460274, -0.04339279606938362, 0.057659924030303955, 0.03315954655408859, -0.03089011274278164, 0.09110835939645767, -0.015191426500678062, 0.05021332576870918, -0.024992700666189194, -0.0007594099151901901, -0.07045185565948486, -0.03966206684708595, 0.0016561778029426932, 0.021669728681445122, 0.016028553247451782, -0.033056747168302536, -0.09698802977800369, -0.00018386958981864154, 0.006371514406055212, -0.03064674325287342, 0.11237102746963501, -0.045337118208408356, -0.03973633050918579, 0.13537080585956573, 0.02704869769513607, 0.08402900397777557, -0.0343502052128315, 0.04823911935091019, 0.00981040671467781, 0.0004877493774984032, 0.02883901447057724, -0.024668777361512184, 0.060596879571676254, 0.014119094237685204, 0.017084335908293724, 0.07599681615829468, 0.07060576230287552, 0.03247934207320213, 0.029897429049015045, -0.08795101195573807, -0.04344076290726662, -0.022517457604408264, 0.011196703650057316, -0.012544451281428337, -0.014550264924764633, 0.01887883059680462, 0.017710287123918533, 0.033843979239463806, 0.06782175600528717, 0.010468591004610062, -0.011693781241774559, -0.018991544842720032, 0.03835681825876236, -0.04561850428581238, -0.006697438657283783, 0.062113165855407715, -0.02379642054438591, -0.045417509973049164, 0.0835004523396492, -0.09514068067073822, -0.07263597846031189, 0.012047127820551395, -0.04338398575782776, -0.04965152218937874, -0.027248723432421684, 0.07274352014064789, -0.03346429765224457, -0.033845189958810806, -0.12941285967826843, 0.06465870141983032, 0.08007171750068665, 0.023125791922211647, -0.07482961565256119, 0.06823841482400894, -0.042207736521959305, 0.007500976324081421, -0.01995260827243328, -0.036026760935783386, -0.026105407625436783, -0.06435327976942062, -0.059964872896671295, 0.0013285331660881639, 0.020698823034763336, -0.06579093635082245, -5.0806144192645785e-33, 0.011859198100864887, 0.02854355052113533, 0.0226565171033144, 0.00045130925718694925, -0.00019295686797704548, -0.016100306063890457, 0.08223750442266464, -0.00766792893409729, 0.11630088090896606, -0.024846447631716728, -0.034148383885622025, -0.009084711782634258, -0.013572899624705315, -0.004318890627473593, 0.007481342181563377, -0.0004438149044290185, -0.03804822638630867, 0.0783531591296196, -0.01519713457673788, -0.06660324335098267, -0.01086305920034647, 0.017127757892012596, 0.047037214040756226, 0.02027014270424843, -0.04247612878680229, 0.038433875888586044, -0.018919311463832855, -0.06848450750112534, -0.009859365411102772, 0.012766816653311253, -0.016084518283605576, 0.024908043444156647, 0.09712984412908554, -0.009848893620073795, 0.010382224805653095, -0.002541455440223217, 0.04017733410000801, 0.00924089178442955, -0.043601736426353455, -0.036245495080947876, 0.11516407877206802, 0.022813908755779266, 0.058131273835897446, 0.08267153799533844, -0.007123262155801058, 0.12885726988315582, -0.02828504517674446, 0.029746180400252342, -0.043726492673158646, -0.05840643495321274, 0.01204600092023611, 0.08967629075050354, -0.07471943646669388, 0.07142927497625351, -0.043434083461761475, 0.0791037306189537, -0.07973536103963852, 0.00049488281365484, 0.025016196072101593, -0.028199613094329834, -0.01856951229274273, -0.03236407786607742, 0.062358781695365906, -0.006661970168352127, 0.006146445404738188, 0.08563538640737534, -0.06390084326267242, -0.05143952742218971, -0.11250045895576477, 0.10523524880409241, -0.0069738226011395454, -0.05884738266468048, -0.030945271253585815, -0.08333108574151993, -0.0800122320652008, 0.055343255400657654, -0.047073811292648315, -0.007220436353236437, -0.050082940608263016, 0.0980750098824501, -0.042328137904405594, 0.029268043115735054, 0.030520685017108917, -0.007706672418862581, -0.09309020638465881, -0.043243542313575745, 0.13731935620307922, 0.10619385540485382, -0.006135692819952965, -0.06181802228093147, -0.049335990101099014, -0.0715959444642067, 0.022722069174051285, 0.041380077600479126, 0.03945998102426529, -4.439343470608037e-08, -0.07245694100856781, -0.01334348414093256, 0.03472993150353432, -0.032187625765800476, -0.05365144833922386, -0.03834719583392143, 0.009699900634586811, 0.02978726476430893, -0.014873730950057507, -0.013474447652697563, -0.01641695201396942, -0.03067801147699356, -0.059302885085344315, -0.053375329822301865, 0.02696397341787815, 0.10514053702354431, -0.0050809080712497234, -0.02370341494679451, 0.0349874310195446, -0.011638123542070389, -0.007596998941153288, -0.04392222687602043, 0.005799735430628061, 0.022283943369984627, -0.07164594531059265, 0.022942494601011276, -0.041376374661922455, -0.06277748197317123, 0.04812374338507652, 0.0610780231654644, 0.05591581016778946, -0.059730105102062225, 0.01216807123273611, 0.0066848634742200375, -0.0518592931330204, -0.026587313041090965, -0.1001584380865097, -0.055940594524145126, -0.0002101199352182448, -0.08483697474002838, -0.06371089816093445, -0.034926511347293854, 0.020803408697247505, 0.04762834310531616, -0.008172320201992989, 0.01406569592654705, -0.024524176493287086, -0.06207825243473053, -0.013995752669870853, -0.10301658511161804, 0.0016903964569792151, -0.05627201125025749, 0.007107013836503029, -0.048121772706508636, 0.06514748185873032, -0.001469039125367999, -0.04414587467908859, -0.02240152657032013, 0.0013734453823417425, 0.00792353879660368, 0.008260204456746578, 0.04520532116293907, 0.10227970033884048, 0.01270642876625061 ] }, { "text": "## Dictionaries\n\n```python\n# Creating and accessing\nstudent = {\n \"name\": \"Alice\",\n \"age\": 20,\n \"grades\": [85, 90, 92]\n}\n\nprint(student[\"name\"]) # Alice\nprint(student.get(\"age\")) # 20\nprint(student.get(\"email\", \"N/A\")) # N/A (default)\n\n# Adding/updating\nstudent[\"email\"] = \"alice@example.com\"\nstudent[\"age\"] = 21\n\n# Iterating\nfor key, value in student.items():\n print(f\"{key}: {value}\")\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_6", "embedding": [ 0.020250927656888962, 0.12082942575216293, 0.016479920595884323, -0.026840507984161377, -0.015691567212343216, -0.07680206745862961, 0.0351036861538887, 0.022303642705082893, -0.03246590122580528, 0.01460112351924181, 0.09855373948812485, 0.04828932136297226, 0.031686827540397644, -0.025717973709106445, 0.10548750311136246, 0.07990449666976929, -0.10350591689348221, -0.008863745257258415, -0.0120399734005332, -0.10968007147312164, 0.013217099010944366, 0.01873018406331539, -0.004361135419458151, 0.025559844449162483, -0.00047477116459049284, 0.05318894609808922, -0.0120093347504735, -0.004543938208371401, -0.03157852217555046, 0.052025727927684784, 0.04151780903339386, 0.00478140776976943, 0.04673033952713013, 0.09640031307935715, 0.006217032205313444, 0.012608028016984463, -0.015021189115941525, 0.09224387258291245, 0.04577174037694931, 0.05562187358736992, -0.07829517126083374, -0.013004190288484097, -0.05155633017420769, -0.043261948972940445, 0.007676044944673777, -0.01653670147061348, -0.07635027170181274, 0.020703298971056938, -0.009556662291288376, 0.01981230452656746, -0.045239027589559555, -0.03221457079052925, -0.060560327023267746, -0.018233133479952812, -0.021060045808553696, 0.025561844930052757, -0.013522584922611713, -0.005422889720648527, -0.009137957356870174, -0.10823339223861694, -0.037762582302093506, 0.014199947938323021, 0.010424898937344551, -0.0065760426223278046, -0.07468938082456589, -0.08368915319442749, -0.02187722735106945, 0.015506484545767307, 0.05880459398031235, 0.05212605372071266, 0.010065063834190369, 0.027600424364209175, 0.030139314010739326, -0.038094282150268555, 0.04960433766245842, -0.07226836681365967, 0.022867916151881218, 0.005872573237866163, 0.021844450384378433, 0.0656346008181572, -0.08147088438272476, -0.035057004541158676, -0.0019343679305166006, -0.0007719579734839499, 0.021781068295240402, -0.06045011430978775, 0.04999693110585213, -0.03993786498904228, -0.06313367187976837, 0.016675284132361412, -0.08492003381252289, -0.0653543621301651, 0.018795764073729515, 0.017461245879530907, 0.07877685874700546, 0.07329517602920532, 0.07043024152517319, -0.0840306207537651, -0.04655938968062401, 0.06084391847252846, -0.051185738295316696, 0.016768895089626312, 0.00016436295118182898, -0.03154146671295166, -0.024374976754188538, -0.007183769717812538, 0.0870288535952568, -0.08094706386327744, -0.011017093434929848, -0.01990608125925064, 0.059449050575494766, 0.012131039053201675, -0.05623312294483185, -0.03355361893773079, 0.024661080911755562, -0.05025618523359299, 0.032643940299749374, 0.0626530572772026, 0.07022098451852798, 0.06216754764318466, 0.05808519572019577, -0.04164300486445427, 0.0032500452362000942, -0.025698695331811905, -0.08394140005111694, -0.10180286318063736, -0.0007513088639825583, 1.170320798146227e-33, 0.02242927998304367, 0.0030138331931084394, -0.0410250723361969, -0.003988793585449457, -0.03073216788470745, -0.015134476125240326, 0.06457601487636566, 0.04140995442867279, -0.08150584995746613, -0.03690057992935181, -0.029861990362405777, 0.13613255321979523, 0.050704482942819595, 0.007565891370177269, -0.027166197076439857, 0.00025599246146157384, -0.0020106015726923943, 0.09494641423225403, 0.01533077098429203, 0.04737718030810356, 0.11582209914922714, -0.06372777372598648, 0.017675498500466347, -0.01116064004600048, -0.02887372486293316, -0.02874513901770115, 0.007854009047150612, 0.03410305082798004, 0.020406337454915047, -0.018513767048716545, 0.0361919179558754, -0.046977926045656204, -0.018719999119639397, -0.016801470890641212, -0.045987095683813095, -0.002747710794210434, 0.08525444567203522, 0.015354056842625141, -0.060591861605644226, -0.10071684420108795, 0.0063570342026650906, -0.027771787717938423, 0.09108391404151917, 0.04896099865436554, -0.045839473605155945, 0.08390842378139496, -0.0015002854634076357, -0.01801278255879879, 0.03425269201397896, 0.027961978688836098, -0.010052753612399101, -0.04407457262277603, -0.11739394813776016, -0.0021084791515022516, -0.08541644364595413, 0.026937786489725113, -0.01087748073041439, 0.01262612547725439, -0.010189859196543694, -0.09512864053249359, 0.03602898120880127, 0.04573027789592743, 0.058611396700143814, 0.03455748409032822, 0.0639985129237175, 0.017607899382710457, 0.07897333055734634, 0.0084250932559371, 0.1003652885556221, -0.01734040305018425, -0.07094625383615494, -0.01363670825958252, -0.0746043249964714, -0.03939490765333176, -0.04773393273353577, 0.014431259594857693, -0.006695984862744808, -0.08990482985973358, 0.014215437695384026, -0.043156739324331284, 0.12499186396598816, -0.048310231417417526, -0.10546770691871643, -0.009448672644793987, 0.004526984877884388, -0.00241779419593513, -0.04058421403169632, -0.0050238268449902534, 0.021480239927768707, -0.023020170629024506, -0.07944872975349426, -0.030712170526385307, -0.0829635038971901, -0.005637585651129484, 0.046317704021930695, -3.2223459297106735e-33, 0.12260209023952484, -0.01906968094408512, -0.0037898484151810408, 0.03393704816699028, 0.06660232692956924, -0.015438050031661987, 0.02936892956495285, 0.03979192301630974, 0.06917130202054977, -0.027483200654387474, -0.047668833285570145, -0.04773159325122833, -0.013553640805184841, -0.027420999482274055, 0.04345164820551872, 0.03278648853302002, -0.10442890971899033, 0.05996827781200409, 0.02875458635389805, -0.025289887562394142, -0.06841529905796051, 0.023700794205069542, -0.032272566109895706, 0.041384775191545486, -0.028754357248544693, -0.025715038180351257, 0.011627151630818844, -0.09056179225444794, 0.013194839470088482, 0.02753288485109806, -0.0022797754500061274, 0.032949455082416534, -0.003190778661519289, 0.06419968605041504, -0.09080132842063904, -0.03134295344352722, -0.01065191812813282, -0.014371323399245739, -0.07762204110622406, 0.0322083942592144, 0.13703131675720215, 0.05874820426106453, -0.013705458492040634, 0.0190789345651865, 0.08453787118196487, -0.002092931419610977, 0.005095479544252157, 0.07810215651988983, 0.01487579196691513, -0.0028971622232347727, 0.07440265268087387, -0.05165942758321762, -0.06871901452541351, -0.011032628826797009, 0.008710204623639584, 0.03218456357717514, -0.02095469832420349, -0.049911148846149445, 0.011857597157359123, 0.010231736116111279, -0.03517516329884529, -0.08587383478879929, -0.0009055657428689301, 0.10430152714252472, -0.03587770462036133, -0.09226926416158676, -0.11998248100280762, -0.011835482902824879, -0.05947080999612808, 0.005893222987651825, 0.030981851741671562, -0.018527578562498093, 0.0005554361268877983, -0.09350298345088959, -0.0021481586154550314, 0.005191379226744175, -0.02602282352745533, 0.01797870174050331, 0.0019533198792487383, 0.07592178881168365, -0.0013075819006189704, 0.0076179783791303635, 0.00831117108464241, 0.08135440945625305, -0.06360673159360886, -0.06095214933156967, 0.08198920637369156, 0.05363493040204048, 0.03648721054196358, 0.0031116981990635395, 0.06558297574520111, 0.002308684168383479, -0.01215760875493288, -0.029461469501256943, -0.04634769260883331, -4.144389720295294e-08, -0.03669067472219467, 0.018468691036105156, -0.06246502324938774, 0.13234493136405945, -0.05635049566626549, 0.07291614264249802, 0.03851171210408211, -0.011442835442721844, 0.025597261264920235, 0.023527171462774277, 0.044227998703718185, -0.029172947630286217, -0.013692084699869156, -0.02515519969165325, -0.0008444713894277811, 0.12687835097312927, 0.018019845709204674, 0.006116875912994146, 0.04458479955792427, 0.07009067386388779, 0.1190788671374321, -0.08181958645582199, 0.06165759637951851, 0.0367678701877594, -0.031113944947719574, 0.007059664931148291, 0.024762030690908432, 0.04328770190477371, -0.07870980352163315, 0.011389680206775665, -0.038606949150562286, -0.02309224382042885, 0.043313272297382355, -0.049734316766262054, 0.031165938824415207, -0.09008750319480896, -0.025890827178955078, -0.06842362880706787, 0.010157543234527111, 0.04137560352683067, -0.0038898943457752466, -0.08499425649642944, -0.09099770337343216, -0.013058451935648918, 0.012492869980633259, -0.019149882718920708, -0.04935624450445175, 0.030422713607549667, 0.05890258401632309, 0.03452451154589653, -0.025002386420965195, 0.005378547124564648, -0.0011739330366253853, -0.12395187467336655, -0.04400106891989708, 0.041387852281332016, 0.018702544271945953, 0.0051520830020308495, -0.016481731086969376, -0.07780522853136063, 0.050512440502643585, -0.028166742995381355, 0.036095622926950455, 0.03486565873026848 ] }, { "text": "## Classes and Objects\n\n```python\n# Define a class\nclass Dog:\n def __init__(self, name, age):\n self.name = name\n self.age = age\n \n def bark(self):\n return f\"{self.name} says Woof!\"\n \n def get_age_in_dog_years(self):\n return self.age * 7\n\n# Create objects\nmy_dog = Dog(\"Buddy\", 3)\nprint(my_dog.bark()) # Buddy says Woof!\nprint(my_dog.get_age_in_dog_years()) # 21\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_7", "embedding": [ -0.02468385174870491, 0.05078161135315895, 0.014775961637496948, 0.06476147472858429, -0.07706958800554276, -0.05294834449887276, 0.05555252730846405, -0.021777426823973656, -0.06623629480600357, -0.031441830098629, 0.030909933149814606, -0.0011225518537685275, 0.0201495923101902, 0.04635913670063019, 0.07390904426574707, 0.018297886475920677, -0.019804205745458603, 0.013883122242987156, -0.019634651020169258, -0.06859633326530457, 0.059657759964466095, 0.030864577740430832, 0.02227148413658142, 0.05074248090386391, -0.06231878325343132, -0.01949167810380459, -0.054601944983005524, -0.04433804377913475, 0.01454524602741003, -0.015027878805994987, 0.007335579488426447, 0.0645001009106636, -0.01647070236504078, 0.07363905012607574, -0.03701105713844299, 0.028320522978901863, 0.04408092051744461, 0.05349007248878479, 0.02975393459200859, 0.051475632935762405, -0.03167923912405968, -0.008031805977225304, -0.006078619975596666, -0.04351738840341568, -0.04344060644507408, 0.02863018773496151, -0.10368910431861877, -0.032303180545568466, 0.07336398959159851, -0.11305490136146545, -0.07651033252477646, 0.03628692030906677, -0.06668952852487564, -0.008818037807941437, -0.007308976259082556, 0.01899171806871891, 0.07519575208425522, 0.031562793999910355, -0.052818287163972855, -0.022230863571166992, -0.07541488856077194, 0.07287204265594482, 0.08377937972545624, 0.021513568237423897, -0.05222373828291893, -0.07600347697734833, -0.018574362620711327, 0.09054677933454514, -0.0194590725004673, 0.12568342685699463, 0.013717200607061386, 0.058136455714702606, 0.0674598217010498, 0.041897550225257874, 0.0648278146982193, -0.023975389078259468, 0.008117055520415306, 0.049355752766132355, 0.042207300662994385, -0.03689713031053543, -0.1284296065568924, -0.031296294182538986, -0.022842781618237495, 0.020409034565091133, 0.034880705177783966, -0.04198117181658745, 0.020033076405525208, 0.011689620092511177, -0.09355677664279938, 0.044744107872247696, -0.06680496037006378, -0.02710951305925846, -0.006790438666939735, 0.025450725108385086, -0.03273676708340645, 0.010565300472080708, 0.03959572687745094, -0.07800815999507904, -0.03354402631521225, 0.01658739149570465, -0.116386279463768, -0.0010746006155386567, 0.07039189338684082, -0.012685530818998814, 0.03813227638602257, 0.007268603425472975, -0.05141274258494377, -0.08575182408094406, 0.0273892804980278, 0.011635572649538517, -0.00942153763025999, -0.06113845482468605, -0.04156075045466423, -0.010761327110230923, 0.016429588198661804, 0.042903218418359756, -0.07612515985965729, -0.03567768260836601, 0.02483478933572769, 0.044618211686611176, 0.12235669046640396, 0.04441921412944794, 0.038596976548433304, 0.02081909403204918, -0.05211586877703667, -0.037838637828826904, -0.02829100750386715, -1.24269635266834e-33, -0.0010574429761618376, -0.049349479377269745, -0.054892536252737045, 0.08015023171901703, -0.018795469775795937, 0.01900358870625496, 0.00265153544023633, 0.019120650365948677, -0.037595514208078384, 0.01099767629057169, -0.05027354881167412, 0.04063376039266586, 0.05013495311141014, -0.002387414686381817, 0.10233289003372192, 0.07027921080589294, -0.05888178199529648, 0.05353468284010887, 0.004208339378237724, 0.016867952421307564, -0.005547311622649431, 0.04681652411818504, -0.017405105754733086, -0.02358207292854786, 0.05986583232879639, 0.07655616104602814, 0.009396224282681942, -0.055520378053188324, -0.05768682435154915, 0.011960653588175774, -0.014692338183522224, -0.01789712719619274, 0.024217665195465088, -0.04204894229769707, -0.0357808843255043, -0.012406107038259506, 0.041230909526348114, 0.017746904864907265, -0.08381007611751556, -0.06428733468055725, 0.0355592742562294, -0.043103523552417755, 0.04476743936538696, -0.0003782101848628372, -0.036691948771476746, -0.033376097679138184, -0.014320781454443932, 0.05383666604757309, -0.02295268326997757, 0.05748356506228447, -0.025499051436781883, -0.007677742280066013, 0.03882791846990585, -0.007439568638801575, -0.03803586587309837, 0.001664722920395434, 0.052130427211523056, 0.05059672147035599, 0.007438767235726118, -0.08138974756002426, 0.1050572618842125, 0.010462719947099686, 0.0303716491907835, 0.009672533720731735, 0.009371273219585419, -0.013175862841308117, 0.021092399954795837, 0.015737297013401985, 0.05159725621342659, 0.006659004837274551, 0.003590950509533286, -0.0012998924357816577, -0.1356527954339981, -0.06292854994535446, 0.036469098180532455, -0.0036485164891928434, 0.05048777163028717, -0.09909379482269287, -0.020052842795848846, -0.05748823657631874, 0.05248873680830002, -0.003963285591453314, -0.06265603750944138, 0.013177596032619476, -0.04149631783366203, -0.007226826157420874, 0.023191610351204872, 0.0034421999007463455, -0.015179569832980633, 0.060666896402835846, -0.10840783268213272, -0.1284140944480896, 0.010713127441704273, -0.019849641248583794, -0.005046813748776913, -3.9520182522782693e-33, 0.03571942448616028, 0.07700356841087341, -0.004923683591187, 0.004709300585091114, -6.824059528298676e-05, -0.011606586165726185, -0.055941347032785416, 0.04966885969042778, -0.00631294259801507, 0.01871703937649727, -0.04754623770713806, -0.012669825926423073, 0.08120641112327576, -0.0037122583016753197, 0.04615137353539467, 0.026889394968748093, -0.13977323472499847, 0.018301261588931084, 0.006584585644304752, -0.06024013087153435, -0.07812713831663132, 0.04100970923900604, -0.027976593002676964, 0.023723166435956955, -0.07250599563121796, 0.002082338323816657, -0.04833456128835678, -0.07372530549764633, 0.011237885802984238, 0.014970787800848484, -0.03754064068198204, -0.05128004401922226, -0.0376819409430027, 0.006236347835510969, -0.06700683385133743, -0.0015696703922003508, 0.012035359628498554, -0.10454289615154266, -0.040319252759218216, -0.016826575621962547, 0.1013808473944664, 0.025583384558558464, -0.02633054554462433, 0.024238960817456245, -0.021209487691521645, -0.023665625602006912, -0.0008224275661632419, -0.0025505688972771168, 0.061242055147886276, -0.002302285050973296, -0.01408828143030405, -0.03264608234167099, -0.030100349336862564, -0.06340762972831726, -0.1037190705537796, 0.0033265871461480856, 0.026028107851743698, -0.017507988959550858, -0.0009811683557927608, 0.06816178560256958, -0.03398161008954048, -0.03982410952448845, -0.03160986676812172, 0.08284404873847961, -0.14291051030158997, -0.10528403520584106, -0.09052804857492447, -0.0024013754446059465, 0.043341223150491714, -0.11732564121484756, 0.04387429356575012, 0.1071677878499031, -0.04514361172914505, 0.00252184784039855, -0.05331442132592201, 0.09209366142749786, -0.000616145902313292, -0.007477268576622009, 0.011046999134123325, 0.03439504653215408, -0.04303790256381035, -0.03657589107751846, -0.0162035021930933, 0.09053348004817963, -0.09627882391214371, -0.09304508566856384, 0.053769681602716446, 0.08904042094945908, 0.0061745718121528625, -0.050192493945360184, 0.013335252180695534, 0.10556045919656754, -0.010893061757087708, 0.06911038607358932, -0.09108187258243561, -4.061410407985022e-08, -0.03897847607731819, -0.006217177025973797, 0.05755569413304329, 0.08685170859098434, -0.01109089981764555, 0.06573538482189178, -0.019226152449846268, -0.011344349011778831, -0.030444985255599022, 0.03976491466164589, 0.034200262278318405, 0.008175973780453205, -0.017939070239663124, 0.007166481111198664, 0.02866583690047264, 0.04879209026694298, -0.0047110216692090034, 0.07695531100034714, 0.028251100331544876, 0.0596657432615757, 0.02910427935421467, -0.08083116263151169, 0.04055003449320793, 0.04063749313354492, -0.09217999875545502, -0.08041141927242279, 0.033002275973558426, 0.05293590575456619, -0.06648700684309006, 0.014918128959834576, -0.01980729028582573, 0.0772489681839943, -0.03635869547724724, 0.06234423816204071, 0.022551214322447777, -0.03188398852944374, -0.04237101227045059, 0.024406127631664276, 0.005327996797859669, 0.05555126443505287, -0.0007209717878140509, -0.036006998270750046, -0.13516207039356232, -0.028412094339728355, 0.06551612913608551, 0.017276227474212646, -0.012261188589036465, -0.09613495320081711, -0.007661537732928991, 0.028940647840499878, -0.14209742844104767, 0.057494454085826874, -0.01753862388432026, -0.07475531101226807, 0.009758551605045795, 0.027340086176991463, 0.026368333026766777, 0.009900156408548355, 0.011756756342947483, -0.012748186476528645, -0.021086694672703743, 0.055854856967926025, 0.09309413284063339, 0.04060254245996475 ] }, { "text": "## File Handling\n\n```python\n# Writing to a file\nwith open(\"output.txt\", \"w\") as file:\n file.write(\"Hello, World!\\n\")\n file.write(\"Python is awesome!\")\n\n# Reading from a file\nwith open(\"output.txt\", \"r\") as file:\n content = file.read()\n print(content)\n\n# Reading line by line\nwith open(\"output.txt\", \"r\") as file:\n for line in file:\n print(line.strip())\n```\n\n## Error Handling\n\n```python\n# try-except\ntry:\n result = 10 / 0\nexcept ZeroDivisionError:\n print(\"Cannot divide by zero!\")\nexcept Exception as e:\n print(f\"An error occurred: {e}\")\nfinally:\n print(\"This always executes\")\n\n# Raising exceptions\ndef divide(a, b):\n if b == 0:\n raise ValueError(\"Divisor cannot be zero\")\n return a / b\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_8", "embedding": [ -0.07004525512456894, 0.09676863253116608, -0.04685194417834282, 0.05530184507369995, 0.019818907603621483, -0.10009951889514923, -0.017782064154744148, 0.06847672909498215, -0.02397586777806282, 0.027921879664063454, 0.06660880893468857, 0.0546230673789978, 0.07999476790428162, 0.02531263418495655, -0.06286131590604782, -0.026983443647623062, -0.11165155470371246, 0.054415248334407806, -0.09391096979379654, -0.08397936075925827, 0.04600895941257477, 0.05960320681333542, 0.03175129368901253, 0.04416324570775032, -0.031822569668293, 0.023887138813734055, -0.04183938726782799, -0.020585592836141586, -0.03823646903038025, 0.01909157820045948, 0.0348719023168087, 0.02365744486451149, 0.03557129576802254, 0.04377958923578262, 0.07864660024642944, -0.009607442654669285, 0.0423552580177784, -0.05736185237765312, -0.03325400501489639, 0.00603219261392951, -0.03549717366695404, 0.006924370303750038, -0.05835701897740364, 0.04975535348057747, 0.032607484608888626, -0.025721769779920578, -0.06359986215829849, 0.03630508482456207, -0.013271411880850792, 0.029879126697778702, -0.028576483950018883, 0.06355110555887222, -0.035202495753765106, -0.03653630241751671, 0.02583751641213894, -0.056828856468200684, 0.01297114696353674, -0.023131035268306732, -0.04816314950585365, -0.1158226728439331, -0.05324379727244377, 0.02562052756547928, -0.0009043855243362486, -0.05838510021567345, 0.031001435592770576, 0.011958499439060688, -0.06928250193595886, 0.0861571803689003, -0.028248796239495277, 0.039303869009017944, -0.04149949550628662, 0.022324418649077415, -0.05852007865905762, 0.04158077389001846, -0.005850330926477909, -0.023010270670056343, -0.010395977646112442, 0.019314849749207497, -0.04128170758485794, 0.07402125746011734, -0.013889672234654427, -0.09332859516143799, 0.033929385244846344, -0.04101288318634033, -0.04876368120312691, -0.07259098440408707, 0.01965804025530815, 0.08377894759178162, 0.07930929958820343, 0.0028722116257995367, -0.08069774508476257, 0.04523475840687752, -0.004478905349969864, -0.03627092018723488, 0.01621013879776001, 0.10282633453607559, -0.04172598943114281, 0.006765785627067089, -0.04781713709235191, 0.02274637296795845, 0.026763277128338814, -0.03097454644739628, -0.00651827547699213, -0.0024310313165187836, 0.09292522817850113, -0.0047628432512283325, 0.08778846263885498, 0.0016969334101304412, 0.045540858060121536, -0.07972486317157745, 0.07635614275932312, -0.08104442805051804, 0.04048547521233559, -0.01585116796195507, 0.06045384332537651, -0.08309069275856018, 0.01631340943276882, 0.07551876455545425, -0.03115079551935196, 0.06776454299688339, 0.03457403928041458, 0.00529085285961628, 0.03712938353419304, 0.07968951016664505, 0.06450557708740234, -0.02269725129008293, 0.06018589809536934, 7.367471087864167e-33, -0.05210188776254654, -0.052303168922662735, 0.06348280608654022, 0.0738379955291748, 0.029105432331562042, 0.06342952698469162, -0.02595481276512146, -0.02359279803931713, -0.06098202243447304, 0.010559936985373497, -0.04601183533668518, -0.03228932246565819, 0.08042412251234055, -0.02122548408806324, 0.04962451383471489, 0.012381364591419697, 0.08032925426959991, -0.07419351488351822, 0.04275204986333847, 0.0020711945835500956, 0.0442141629755497, -0.03142130747437477, 0.00914564449340105, 0.008717923425137997, -0.06024722009897232, -0.0555446520447731, -0.07257838547229767, -0.09104783833026886, -0.0034777969121932983, -0.006309993099421263, -0.05196308344602585, -0.05255617946386337, 0.02995903044939041, -0.0332302451133728, -0.039315611124038696, -0.011658935807645321, 0.024913111701607704, 0.0008247660007327795, -0.03830228000879288, 0.004454776179045439, -0.12006024271249771, -0.04368666186928749, 0.04744844511151314, 0.01593785546720028, -0.001031461637467146, -0.005396225489675999, -0.04356024041771889, 0.11385514587163925, -0.04265076294541359, 0.06241833046078682, -0.018472012132406235, 0.057956818491220474, 0.07555562257766724, 0.032513659447431564, 0.013653256930410862, 0.011475177481770515, 0.01696566678583622, -0.025545315816998482, -0.006167486775666475, -0.04466407746076584, 0.04944099485874176, 0.01941021904349327, -0.07733344286680222, -0.005908816121518612, 0.011474394239485264, 0.005361473187804222, 0.07908903062343597, 0.04127084091305733, -0.059602364897727966, 0.011748230084776878, -0.10352690517902374, -0.0690896287560463, -0.001539044314995408, -0.014157616533339024, 0.010360781103372574, -0.009041892364621162, 0.07920510321855545, -0.04446885362267494, 0.04064767062664032, -0.03989892080426216, 0.06802713871002197, 0.041981182992458344, 0.09416689723730087, -0.102348692715168, -0.02751799486577511, -0.03736777976155281, -0.01290937326848507, 0.03422309458255768, -0.024550264701247215, -0.07182308286428452, 0.0019516571192070842, -0.062175024300813675, 0.02074362523853779, -0.037523847073316574, 0.07873120158910751, -7.529438046360154e-33, 0.04024586081504822, 0.04119645431637764, -0.01593243144452572, -0.00761016458272934, -0.050578273832798004, -0.015516300685703754, 0.047348503023386, -0.008443635888397694, 0.12191269546747208, -0.02097892016172409, -0.10019976645708084, 0.013676246628165245, 0.05212678760290146, 0.025850659236311913, 0.029725942760705948, -0.017090195789933205, -0.06877711415290833, 0.08024876564741135, -0.016317255795001984, 0.06712540239095688, -0.020570354536175728, -0.035714223980903625, 0.004411085043102503, 0.016309384256601334, -0.01764267310500145, 0.05596226826310158, -0.023613907396793365, 0.0057282112538814545, -0.03600318357348442, -0.012210119515657425, -0.03752094879746437, 0.021367916837334633, 0.007450412958860397, -0.07947715371847153, 0.0671975240111351, -0.06239303946495056, -0.03685372322797775, -0.007473134435713291, -0.017782684415578842, 0.03971293568611145, 0.03217504918575287, 0.08508321642875671, 0.0055213929153978825, 0.007186432369053364, 0.05271243676543236, 0.024095825850963593, -0.03952480107545853, 0.07048000395298004, -0.05336448922753334, -0.03745893016457558, -0.05303244665265083, 0.05022452399134636, 0.008638485334813595, 0.07726651430130005, 0.0044715916737914085, -0.004230793099850416, 0.009544199332594872, 0.021977977827191353, -0.06990213692188263, -0.017656709998846054, -0.0636063665151596, -0.02302546426653862, -0.039135076105594635, 0.03230782225728035, -0.04981736093759537, 0.010118596255779266, 0.007568784058094025, 0.055553924292325974, 0.03948507457971573, -0.026603391394019127, 0.07433528453111649, 0.016495056450366974, -0.025315508246421814, -0.03442316874861717, -0.01263428758829832, 0.0889531672000885, -0.02286440320312977, -0.05474136397242546, -0.05413714796304703, 0.11333069950342178, 0.02606133371591568, 0.02772943489253521, 0.015580378472805023, 0.0684974268078804, -0.006128997541964054, -0.03385808318853378, 0.02123497799038887, 0.03432674705982208, 0.047696325927972794, -0.003627688391134143, 0.020495044067502022, -0.036515239626169205, 0.0788097083568573, 0.03857889771461487, 0.01449465099722147, -5.281480852659115e-08, -0.01726660318672657, -0.08106927573680878, -0.028275996446609497, -0.020246488973498344, 0.0004317626007832587, 0.06826890259981155, -0.033905524760484695, -0.16678382456302643, -0.013870704919099808, 0.03854914754629135, 0.04298439621925354, -0.04963156580924988, -0.17970842123031616, -0.07121371477842331, -0.026582682505249977, 0.07758874446153641, 0.12704651057720184, -0.07055788487195969, -0.03631044179201126, -0.028231214731931686, 0.0031423436012119055, -0.01931019127368927, 0.007064360193908215, 0.011902964673936367, -0.03405461832880974, -0.027080129832029343, 0.0255094263702631, -0.0010515105677768588, -0.05245219171047211, -0.12630262970924377, 0.0005873982445336878, -0.09111250936985016, 0.028301658108830452, 0.06805846840143204, -0.025607114657759666, 0.007967106066644192, 0.1257513165473938, 0.07088036090135574, 0.01971535012125969, -0.002427067141979933, -0.03224135935306549, 0.02962862327694893, -0.0342801958322525, 0.005038856063038111, -0.0640934482216835, -0.08504515886306763, -0.03705237805843353, -0.021239718422293663, -0.000750690815038979, -0.021861134096980095, -0.010471682995557785, 0.08582381159067154, -0.09239503741264343, 0.028646398335695267, -0.057120226323604584, -0.0036105394829064608, 0.023469705134630203, -0.006711261346936226, -0.07481967657804489, 0.02136095054447651, 0.09450681507587433, 0.07990724593400955, 0.03863903135061264, -0.0399094857275486 ] }, { "text": "## Modules and Imports\n\n```python\n# Importing standard library\nimport math\nprint(math.pi) # 3.141592653589793\nprint(math.sqrt(16)) # 4.0\n\n# Import specific functions\nfrom math import pi, sqrt\nprint(pi)\n\n# Import with alias\nimport numpy as np\nimport pandas as pd\n\n# Your own modules\n# In mymodule.py:\ndef my_function():\n return \"Hello from module\"\n\n# In main.py:\nimport mymodule\nprint(mymodule.my_function())\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_9", "embedding": [ -0.036996833980083466, -0.045116398483514786, -0.0721079409122467, -0.0370929017663002, -0.05228442698717117, -0.08371015638113022, -0.010429410263895988, 0.07562223821878433, -0.01384694129228592, 0.005750715732574463, 0.11054994910955429, 0.0035528226289898157, -0.0014549059560522437, 0.01151152141392231, 0.06759587675333023, 0.0072960639372467995, -0.0037902838084846735, 0.028122885152697563, -0.019853714853525162, -0.06577377766370773, 0.042832765728235245, 0.09969733655452728, -0.01713566482067108, 0.03576960414648056, -0.00518671702593565, -0.10191314667463303, 0.0373590812087059, 0.007935537956655025, 0.03439082205295563, -0.02914533019065857, 0.03717610612511635, 0.06849793344736099, 0.03797442093491554, -0.010807913728058338, -0.052659180015325546, 0.10299795866012573, -0.09191261976957321, -0.07401672005653381, 0.05437387898564339, -0.021639136597514153, 0.003196901408955455, -0.03165917843580246, 0.05234919488430023, -0.02984427474439144, -0.026641061529517174, -0.01832442171871662, -0.0172699186950922, 0.06819579750299454, 0.057145681232213974, -0.024878283962607384, -0.01677899807691574, 0.08767670392990112, -0.15218542516231537, -0.008141273632645607, 0.06654743105173111, 0.0017233293037861586, 0.04616771265864372, -0.09162769466638565, -0.0015953658148646355, 0.0052699432708323, -0.10571201145648956, 0.09505616128444672, 0.0581350177526474, -0.05381548032164574, -0.021305033937096596, -0.03250808268785477, -0.008022775873541832, 0.004501944407820702, -0.026797106489539146, 0.07068239152431488, -0.060964688658714294, -0.010908701457083225, -0.037913378328084946, 0.07979745417833328, 0.014683504588901997, -0.08900108188390732, -0.01690690964460373, 0.022427059710025787, -0.02508493885397911, -0.0019081023056060076, -0.04071754589676857, -0.010237996466457844, 0.013065516948699951, -0.011053311638534069, 0.038340501487255096, -0.020710306242108345, -0.03147164732217789, 0.04460212215781212, 0.07664354145526886, -0.03793361410498619, 0.0007029506959952414, -0.059317804872989655, -0.09279891848564148, 0.011673168279230595, -0.08070318400859833, -0.005085371434688568, 0.0492614209651947, 0.04977957531809807, -0.04133516177535057, 0.022608404979109764, -0.022590652108192444, -0.03689778223633766, -0.00959219504147768, -0.06123817339539528, 0.026509523391723633, 0.04677639156579971, 0.0702979639172554, -0.008075409568846226, 0.07505934685468674, 0.01236496027559042, -0.050462692975997925, -0.057234883308410645, 0.003952817525714636, -0.06522945314645767, 0.09769439697265625, 0.026050947606563568, -0.0011404964607208967, -0.020431796088814735, 0.04795737564563751, 0.03552760183811188, 0.04632740840315819, 0.04891194403171539, 0.04426244646310806, 0.0654820054769516, -0.04370976984500885, 0.028061643242836, -0.02691717818379402, 7.830751043938492e-33, -0.03879804164171219, 0.00919776689261198, 0.0463484525680542, 0.019630081951618195, -0.005747541319578886, 0.009494367986917496, 0.0320800356566906, -0.10496436059474945, 0.010767382569611073, 0.043543338775634766, -0.032635606825351715, 0.09942883253097534, -0.039407093077898026, 0.030308112502098083, -0.016696423292160034, 0.005520148668438196, 0.09392806887626648, -0.05514482408761978, 0.023994404822587967, 0.026572328060865402, -0.0051849898882210255, 0.015033675357699394, -0.023063067346811295, 0.03459831699728966, 0.03659532591700554, 0.056055910885334015, -0.018365124240517616, -0.027770819142460823, -0.016377650201320648, 0.02425697073340416, -0.044073980301618576, 0.013128143735229969, -0.04827498644590378, -0.022628864273428917, 0.051925696432590485, -0.030033757910132408, 0.021355587989091873, -0.06295277178287506, -0.08005698025226593, -0.023044530302286148, -0.02498333528637886, 0.02353069745004177, -0.008905483409762383, 0.012525263242423534, 0.03047783300280571, 0.014716316014528275, 0.021753821521997452, 0.08381887525320053, 0.027049988508224487, -0.04037514701485634, -0.06077013164758682, -0.011958369053900242, 0.07636895775794983, 0.06992094963788986, -0.0008364848326891661, -0.07656026631593704, 0.0002957737015094608, -0.051208388060331345, 0.047788355499506, -0.02252049744129181, -0.039487358182668686, -0.001134720048867166, -0.010028194636106491, -0.0022934044245630503, -0.023609450086951256, -0.0363970547914505, -0.0478254035115242, 0.03172369673848152, 0.0072512319311499596, 0.06135844811797142, 0.01489675510674715, 0.03719398379325867, -0.08778867870569229, -0.020370854064822197, 0.013471882790327072, -0.0016841586912050843, 0.008565005846321583, -0.07434556633234024, -0.028595194220542908, -0.05033044144511223, 0.049077603965997696, 0.055883362889289856, -0.013571882620453835, -0.04947539418935776, 0.02912147156894207, -0.05723033472895622, 0.01994929276406765, 0.020396215841174126, -0.05999010428786278, -0.1492779701948166, -0.14467287063598633, -0.014760859310626984, 0.03573022782802582, 0.016883550211787224, -0.04423712566494942, -1.1497353023023372e-32, -0.033973198384046555, 0.11521218717098236, -0.016906557604670525, -0.002816705033183098, -0.056092310696840286, 0.017383433878421783, 0.011911633424460888, -0.011241023428738117, 0.05105999857187271, 0.011174177750945091, -0.09114029258489609, -0.10122379660606384, 0.06955656409263611, -0.049482546746730804, 0.0597357377409935, 0.08433344960212708, -0.06975744664669037, 0.023228930309414864, -0.050988636910915375, -0.03257475048303604, -0.14207826554775238, 0.07038907706737518, 0.01813703589141369, -0.01035876665264368, -0.021857546642422676, 0.00579824298620224, 0.01605994440615177, -0.047947052866220474, -0.01407079491764307, 0.0319998599588871, -0.07535118609666824, 0.06657115370035172, -0.07312392443418503, 0.025429418310523033, -0.032182980328798294, -0.010624760761857033, 0.07565460354089737, -0.01789466291666031, -0.026882508769631386, -0.10154861211776733, 0.13130155205726624, 0.058057643473148346, 0.07747988402843475, 0.039123013615608215, -0.027676444500684738, -0.02683495171368122, 0.04143543541431427, -0.04509993642568588, -0.01379914116114378, -0.010194968432188034, -0.035392772406339645, -0.02628171443939209, 0.014149671420454979, 0.0086966622620821, -0.10975103825330734, 0.004457219038158655, 0.05553540587425232, 0.06264575570821762, 0.02032638154923916, -0.04751484468579292, -0.03083299659192562, -0.08610375970602036, -0.026729438453912735, -0.04148987680673599, -0.06048621982336044, -0.07459158450365067, -0.044273994863033295, 0.009586270898580551, 0.07815026491880417, -0.06341161578893661, -0.019700856879353523, 0.03399835526943207, 0.003639993956312537, 0.0009801809210330248, -0.08369678258895874, 0.05570346862077713, 0.032669343054294586, 0.027087377384305, 0.03623640909790993, 0.12496250867843628, 0.12883253395557404, -0.02825056202709675, 0.040979575365781784, -0.03620609641075134, -0.11495047062635422, -0.11383573710918427, 0.06027865782380104, 0.0392887257039547, -0.0158625990152359, -0.08793250471353531, -0.024108488112688065, 0.01693442463874817, -0.0167599655687809, 0.04133773222565651, 0.018513349816203117, -4.91743392672106e-08, -0.009493492543697357, 0.03344104066491127, 0.0012853709049522877, -0.08265041559934616, -0.004986611660569906, 0.06293842941522598, -0.011997808702290058, -0.017876265570521355, -0.049861520528793335, -0.009667865931987762, -0.005084652919322252, -0.003817030694335699, -0.017781183123588562, -0.04047869145870209, 0.0069571263156831264, 0.12697038054466248, 0.024164369329810143, 0.07382224500179291, 0.007715797517448664, -0.02286618947982788, -0.002166521968320012, 0.006781935691833496, 0.03698231279850006, 0.005452913697808981, -0.1323428452014923, -0.020120054483413696, -0.017040595412254333, 0.026067061349749565, -0.04856247827410698, 0.012142481282353401, -0.0052984487265348434, -0.012166417203843594, -0.025085845962166786, 0.023419799283146858, -0.04573776200413704, -0.0414857380092144, 0.02593599446117878, -0.019724618643522263, 0.08879128843545914, 0.10305260866880417, -0.08436106890439987, -0.04244140163064003, -0.05390622466802597, -0.012843549251556396, 0.02193697914481163, -0.031489111483097076, 0.09228486567735672, -0.04886443912982941, -0.0033631378319114447, 0.043855637311935425, -0.0007969453581608832, 0.010041906498372555, -0.014796189032495022, -0.05294003337621689, 0.06928610801696777, 0.02458973042666912, -0.06336800754070282, 0.0068414765410125256, -0.033302441239356995, -0.03816283866763115, -0.05583494156599045, 0.08173131942749023, 0.11601642519235611, -0.033222176134586334 ] }, { "text": "## Useful Built-in Functions\n\n```python\n# len() - length\nprint(len([1, 2, 3])) # 3\nprint(len(\"Hello\")) # 5\n\n# type() - check type\nprint(type(42)) # \n\n# range() - sequence of numbers\nlist(range(5)) # [0, 1, 2, 3, 4]\n\n# enumerate() - index and value\nfor i, fruit in enumerate([\"apple\", \"banana\"]):\n print(f\"{i}: {fruit}\")\n\n# zip() - combine iterables\nnames = [\"Alice\", \"Bob\"]\nages = [25, 30]\nfor name, age in zip(names, ages):\n print(f\"{name} is {age}\")\n\n# map() - apply function\nnumbers = [1, 2, 3, 4]\nsquared = list(map(lambda x: x**2, numbers))\n# [1, 4, 9, 16]\n\n# filter() - filter elements\nevens = list(filter(lambda x: x % 2 == 0, numbers))\n# [2, 4]\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_10", "embedding": [ 0.05659046769142151, 0.12874454259872437, 0.027883676812052727, -0.03261053189635277, 0.015965783968567848, 0.018830187618732452, 0.037650831043720245, -0.032079510390758514, -0.12300164997577667, -0.026545431464910507, 0.06115720048546791, -0.012206490151584148, 0.05674104392528534, -0.016751175746321678, 0.012464631348848343, 0.0722748339176178, -0.011670750565826893, 0.03944475203752518, 0.001258903299458325, -0.17356055974960327, 0.022724132984876633, 0.05780165642499924, -0.007712512742727995, -0.00911987666040659, -0.02549048699438572, 0.012509257532656193, -0.08643795549869537, -0.016971424221992493, -0.06321962922811508, 0.011469705030322075, -0.011004265397787094, 0.04973777383565903, 0.0967729389667511, 0.004853422287851572, -0.06044550612568855, 0.0035810964182019234, -0.049964483827352524, 0.009793771430850029, 0.01711280457675457, 0.050212468951940536, -0.0339394137263298, -0.032588761299848557, -0.07303022593259811, -0.0987529382109642, -0.005328832659870386, 0.04946822300553322, 0.007295507472008467, -0.027829786762595177, -8.747970241529401e-06, 0.0014340054476633668, -0.07244201749563217, 0.06416039168834686, -0.06049173325300217, -0.03769977390766144, 0.02489358000457287, -0.07660601288080215, -0.010242065414786339, -0.12054693698883057, 0.056145310401916504, -0.05389757826924324, -0.020473763346672058, -0.1078944131731987, 0.010114209726452827, -0.02722175046801567, -0.026039620861411095, -0.022786583751440048, 0.035063717514276505, 0.029896417632699013, 0.053033497184515, 0.005100521259009838, 0.026758139953017235, 0.12305909395217896, -0.0456756055355072, 0.01567850634455681, 0.001071765087544918, 0.00496295653283596, 0.07133384048938751, -0.039497002959251404, -0.05863584950566292, 0.044485870748758316, -0.09393832832574844, -0.0756101906299591, -0.0007911633001640439, -0.010778665542602539, -0.05305137485265732, -0.04401346668601036, 0.007778637111186981, -0.008383568376302719, -0.035566333681344986, 0.07015234231948853, -0.07046253979206085, 0.007747389376163483, 0.08773639798164368, 0.0021711504086852074, 0.05183737352490425, 0.009375842288136482, 0.09646987915039062, -0.0602475106716156, -0.036447007209062576, 0.044038522988557816, -0.07674545049667358, -0.01838819310069084, 0.03913043439388275, -0.09148845821619034, 0.020013267174363136, -0.0019690287299454212, 0.049653857946395874, -0.1072889193892479, 0.026006678119301796, -0.02323577180504799, 0.010958142578601837, -0.11432081460952759, -0.006872585043311119, 0.05340495705604553, -0.010678942315280437, -0.006121557671576738, 0.019316544756293297, 0.02599531225860119, 0.08250299096107483, 0.02283140830695629, 0.07563579082489014, 0.055347517132759094, 0.07149581611156464, 0.023372717201709747, 0.011262140236794949, 0.025605324655771255, -0.01954147405922413, 3.9052034550728025e-33, -0.07836584746837616, -0.014466446824371815, 0.012909810058772564, 0.09430380165576935, 0.014727653935551643, -0.05335775762796402, 0.04672574624419212, -0.08098257333040237, 0.04106650501489639, 0.015326113440096378, -0.034631650894880295, 0.07762844115495682, -0.016458461061120033, 0.021162202581763268, 0.030386105179786682, 0.013027620501816273, 0.05101695656776428, 0.016525544226169586, 0.006894667167216539, 0.0008728525135666132, -0.0023086850997060537, -0.0644710585474968, 0.019868630915880203, -0.023617500439286232, 0.025187339633703232, -0.04681898280978203, 0.04107479006052017, -0.04607687518000603, 0.09425755590200424, -0.008104752749204636, 0.007562495768070221, 0.039511341601610184, -0.004952782299369574, -0.014931749552488327, 0.09679463505744934, -0.013616839423775673, 0.09370701014995575, 0.04343493655323982, 0.0019442463526502252, 0.02844322845339775, -0.06313745677471161, -0.02806953527033329, 0.0570051483809948, 0.09844853729009628, -0.02528170868754387, -0.01439244206994772, 0.05889454111456871, 0.020385121926665306, -0.010734195820987225, 0.12303970009088516, -0.07282564043998718, -0.048136528581380844, -0.026524648070335388, 0.07477890700101852, -0.03554658964276314, 0.012063656933605671, -0.008313626982271671, 0.03769785165786743, -0.038230761885643005, 0.04219767823815346, 0.04576047509908676, -0.00039287807885557413, 0.03138895332813263, 0.021952329203486443, 0.026358965784311295, 0.033094581216573715, 0.08185219019651413, 0.0360078290104866, 0.05526338890194893, 0.04126652330160141, -0.022893469780683517, -0.05682072788476944, 0.038850799202919006, -0.04460267350077629, -0.02649621106684208, -0.027320152148604393, 0.0597374364733696, -0.07238835096359253, -0.05447922646999359, -0.07682745158672333, 0.07668107748031616, -0.0008647872018627822, -0.054164476692676544, 0.022491484880447388, -0.06272530555725098, -0.07777263224124908, -0.022982509806752205, -0.008746226318180561, 0.049391165375709534, -0.05872887000441551, -0.08809573203325272, 0.017530303448438644, 0.019439807161688805, -0.07371121644973755, 0.021685417741537094, -5.217127149619463e-33, 0.01726655103266239, -0.019520075991749763, 0.051124945282936096, -0.007421406917273998, 0.08369871973991394, -0.06609126925468445, 0.026469456031918526, 0.015603769570589066, 0.1089031994342804, -0.07791513949632645, -0.07965255528688431, -0.030199386179447174, 0.05860599875450134, -0.06572633981704712, 0.00788054522126913, 0.07207749038934708, -0.03599846363067627, 0.05431966111063957, -0.07185130566358566, -0.04089260846376419, -0.025458255782723427, 0.005594118498265743, 0.0010197380324825644, 0.014899354428052902, -0.01675245352089405, 0.01873360574245453, 0.035013966262340546, -0.08558051288127899, 0.061706848442554474, 0.02857525646686554, -0.003212911309674382, -0.004219518043100834, 0.060950618237257004, 0.02899237349629402, -0.0025402286555618048, -0.07900035381317139, 0.0311986543238163, 0.01219280157238245, -0.05512940511107445, -0.003842057893052697, 0.05625113472342491, 0.05010835826396942, 0.017590204253792763, 0.01273391768336296, -0.02152155339717865, 0.03593277186155319, -0.0185483917593956, 0.020700719207525253, -0.012452985160052776, 0.00835445523262024, -0.003935604821890593, 0.0678030401468277, -0.14738819003105164, 0.04227215051651001, -0.007481792010366917, -0.03403094783425331, -0.0403154194355011, 0.006589637137949467, -0.008213435299694538, 0.023449361324310303, -0.07365792989730835, -0.09198684245347977, 0.03072071447968483, 0.01450570672750473, -0.021924391388893127, -0.02050328627228737, -0.06411831825971603, -0.08643169701099396, -0.09854321926832199, 0.08860912173986435, 0.005234131123870611, -0.08198467642068863, -0.01984824426472187, -0.09062155336141586, -0.11949250102043152, -0.006544725503772497, -0.029698023572564125, -0.0016980045475065708, -0.03810547664761543, 0.0801926776766777, -0.004796796478331089, -0.0011304072104394436, 0.016195807605981827, 0.08109281212091446, -0.09126227349042892, -0.05241378769278526, 0.10138638317584991, 0.06959911435842514, 0.023754462599754333, -0.007180345710366964, 0.010983253829181194, -0.06858134269714355, 0.029088879004120827, 0.07515312731266022, -0.003314895322546363, -5.096917732316797e-08, 0.01699700765311718, -0.06944593042135239, -0.06089187413454056, 0.05118313059210777, 0.0015373091446235776, 0.0661325454711914, -0.0504610538482666, 0.04166259989142418, -0.01659465953707695, 0.012305602431297302, 0.037363745272159576, 0.09596730023622513, 0.005546589847654104, 0.007628356106579304, 0.06924956291913986, 0.017105042934417725, 0.03612449765205383, 0.06356712430715561, 0.02723422460258007, 0.08393214643001556, -0.00730495247989893, -0.04591608792543411, -0.0184020958840847, 0.024846436455845833, -0.05931216478347778, -0.05205685272812843, 0.012121237814426422, -0.06049356982111931, 0.009176310151815414, 0.008419038727879524, 0.01240528468042612, -0.004515558015555143, -0.016520189121365547, -0.033615194261074066, -0.05693655088543892, -0.08908237516880035, -0.07241074740886688, -0.0042985281907022, -0.04767487198114395, 0.027203086763620377, 0.009801625274121761, 0.0008547811303287745, -0.072735995054245, -0.002430219203233719, 0.03798729553818703, -0.017057139426469803, 0.008370029740035534, -0.02878248132765293, 0.023321684449911118, 0.07406207174062729, -0.09373591095209122, 0.03973161056637764, 0.05544197931885719, -0.08715378493070602, 0.04419080913066864, 0.03972820192575455, -0.013950285501778126, 0.00803477130830288, 0.06069985404610634, 0.03501683846116066, 0.054903823882341385, -0.039930593222379684, 0.10954250395298004, -0.03480970486998558 ] }, { "text": "## Common Mistakes to Avoid\n\n1. **Indentation Errors**: Python uses indentation (not brackets)\n2. **Mutable Default Arguments**: Don't use mutable defaults in functions\n3. **Not Closing Files**: Use `with` statement\n4. **Index Out of Range**: Check list length before accessing\n5. **Integer Division**: Use `//` for floor division, `/` for float\n\n## Practice Projects\n\n### Beginner\n- Calculator\n- To-do list\n- Number guessing game\n- Password generator\n\n### Intermediate\n- Web scraper\n- Data analyzer\n- Simple game (snake, tic-tac-toe)\n- API consumer", "source": "python.md", "type": "markdown", "chunk_id": "python.md_11", "embedding": [ -0.10297106206417084, 0.0825660303235054, -0.07231494784355164, -0.04311583936214447, -0.07060442119836807, -0.1236264705657959, 0.0005880010430701077, 0.03353610262274742, -0.09318988025188446, 0.023411625996232033, 0.03239795193076134, -0.07473333925008774, 0.08460970968008041, -0.007296568714082241, 0.03298014774918556, -0.00029642932349815965, -0.07428474724292755, 0.030665259808301926, 0.01933748833835125, -0.1437879353761673, -0.009806226938962936, 0.03042103722691536, 0.020912744104862213, -0.0012031513033434749, -0.04512079805135727, 0.01846502348780632, -0.046307407319545746, 0.022733204066753387, -0.0076475730165839195, -0.04554109275341034, -0.0040659476071596146, 0.019682573154568672, 0.044446248561143875, 0.029691997915506363, 0.03962479159235954, 0.01691906340420246, -0.07214631140232086, -0.10553787648677826, -0.008259590715169907, 0.04826869070529938, -0.058593954890966415, -0.03876309096813202, -0.05145580321550369, -0.008976269513368607, -0.06628230959177017, -0.028488149866461754, -0.07724921405315399, -0.0011296272277832031, 0.03818817064166069, 0.005285895429551601, -0.14127112925052643, 0.06155738979578018, -0.027636077255010605, -0.07845687866210938, 0.015547916293144226, -0.04851667210459709, 0.01478533074259758, -0.015341176651418209, 0.04627584293484688, -0.07660336792469025, 0.013243942521512508, -0.041305165737867355, 0.00016886710363905877, -0.002495312364771962, -0.009580342099070549, -0.040096819400787354, -0.02702844701707363, 0.04287309572100639, 0.012339443899691105, 0.002712052082642913, -0.06052238494157791, 0.025102965533733368, -0.05788397043943405, 0.0421607568860054, -0.005634922068566084, -0.0441603846848011, -0.017129233106970787, -0.016787368804216385, -0.0404173769056797, -0.013736866414546967, -0.094324491918087, -0.11141312122344971, 0.018328839913010597, 0.0866929441690445, 0.007055155001580715, 0.009156056679785252, 0.027131086215376854, 0.08449605852365494, 0.03488435596227646, -0.029794303700327873, 0.03759210556745529, -0.02089317888021469, 0.02586052566766739, 0.005878697149455547, 0.026598967611789703, 0.08186323195695877, 0.00453507574275136, -0.08826445788145065, -0.08564621955156326, 0.035733532160520554, -0.053912561386823654, 0.0063328975811600685, -0.0062522185035049915, -0.03727524355053902, 0.005451954901218414, -0.015046914108097553, 0.04322884976863861, 0.029649857431650162, 0.04289080947637558, -0.01799808442592621, 0.008066459558904171, 0.025129178538918495, -0.04711995646357536, 0.024970149621367455, 0.06565150618553162, 0.018784189596772194, -0.012996312230825424, 0.020606281235814095, 0.06137742102146149, 0.08580661565065384, 0.10931695252656937, 0.05964420735836029, -0.06951524317264557, 0.03295544534921646, 0.04203331843018532, -0.05314316600561142, -0.00833373237401247, 2.1024205029296173e-33, -0.06415120512247086, -0.07341702282428741, 0.03097955510020256, 0.03386741504073143, 0.037004049867391586, -0.025268781930208206, 0.044863391667604446, 0.00949980691075325, -0.07766310125589371, 0.04814693331718445, -0.03436313197016716, 0.10440970212221146, -0.043664660304784775, 0.04988809674978256, 0.11704996228218079, -0.010797003284096718, -0.024890482425689697, 0.021518371999263763, 0.0225172508507967, -0.04025899991393089, 0.096671923995018, -0.03892817720770836, 0.051987580955028534, 0.0368955135345459, -0.014483002945780754, 0.09095920622348785, -0.09693825989961624, -0.011547212488949299, 0.053498052060604095, 0.018510248512029648, -0.0522385872900486, -0.09792599827051163, -0.01720939576625824, -0.009129303507506847, 0.041730526834726334, 0.04554935544729233, 0.06530091911554337, -0.007996735163033009, -0.07518056780099869, -0.0037760220002382994, -0.07465722411870956, -0.011587737128138542, 0.06266770511865616, 0.01668340153992176, -0.062012121081352234, -0.0023194735404103994, -0.03399655967950821, 0.06463607400655746, 0.062227096408605576, 0.1167484000325203, -0.06644786894321442, 0.02906656451523304, 0.05567818135023117, -0.04311694577336311, -0.010443522594869137, -0.009443500079214573, 0.0049220845103263855, -0.04381384700536728, -0.0538778118789196, -0.014223868027329445, 0.030837759375572205, 0.023078706115484238, 0.04939122125506401, -0.03637048974633217, -0.02855503372848034, -0.01297097746282816, -0.01230146735906601, 0.023266414180397987, 0.0514567568898201, 0.06659036874771118, -0.033812735229730606, 0.0457502119243145, 0.06192558631300926, -0.030526699498295784, 0.03914692625403404, -0.04930771142244339, 0.025267034769058228, -0.08934052288532257, -0.027491191402077675, -0.09418097883462906, 0.11202866584062576, -0.025709347799420357, 0.02617359533905983, -0.08638851344585419, 0.009071893990039825, 0.002579379826784134, 0.04622514545917511, -0.038736872375011444, -0.0004437931929714978, 0.018576787784695625, -0.055170249193906784, -0.03866606950759888, -0.05339974910020828, -0.052307114005088806, -0.039701949805021286, -5.553569428530141e-33, 0.0029901526868343353, 0.03862852603197098, 0.044006720185279846, 0.0650947093963623, 0.018669050186872482, -0.05664171651005745, 0.05747288092970848, -0.027639644220471382, 0.10094334930181503, -0.019492028281092644, -0.08469250053167343, 0.06078968942165375, 0.012208119966089725, -0.05220487713813782, 0.060592055320739746, 0.054875992238521576, -0.05018354579806328, 0.006635860074311495, 0.014506714418530464, -0.06386909633874893, -0.09511350095272064, 0.057117581367492676, -0.07979331165552139, -0.02670610323548317, -0.005106150172650814, 0.015921732410788536, 0.010481650941073895, -0.08049990236759186, 0.05908682569861412, 0.009826523251831532, -0.03808188810944557, 0.0014498598175123334, 0.04064100608229637, 0.06311001628637314, -0.01766178570687771, -0.03376324102282524, 0.08119817823171616, 0.05584530532360077, 0.007184848189353943, 0.007558475714176893, 0.11431010067462921, 0.014240837655961514, -0.053275641053915024, 0.01989656686782837, 0.027996424585580826, -0.007201978005468845, -0.018836623057723045, 0.11273060739040375, -0.03799665346741676, -0.022547271102666855, 0.0330040417611599, 0.029422014951705933, -0.02680775336921215, -0.05845474451780319, -0.06461327522993088, 0.09261563420295715, 0.035396091639995575, 0.008183774538338184, -0.05474546551704407, 0.0035069298464804888, -0.06916945427656174, -0.004049029666930437, -0.05510812997817993, 0.06482897698879242, -0.009220230393111706, -0.0413680374622345, -0.08421929180622101, -0.0014984107110649347, -0.08927534520626068, -0.046703942120075226, -0.05935591831803322, 0.020971037447452545, 0.04731808975338936, -0.09609076380729675, -0.04543904587626457, 0.0452517531812191, -0.10593578219413757, 0.08075664937496185, 0.03537922725081444, 0.0901297926902771, -0.031202085316181183, 0.08548332750797272, 0.0520949624478817, 0.02117527276277542, -0.053159598261117935, 0.017783308401703835, 0.06691641360521317, 0.05203673616051674, 0.03366635739803314, -0.05286833643913269, 0.0009997468441724777, 0.019406815990805626, 0.08724737912416458, 0.06369836628437042, 0.05343221500515938, -5.566823801927967e-08, 0.00813981518149376, -0.008463793434202671, -0.06706041097640991, 0.10809323191642761, 0.040444910526275635, 0.11774281412363052, -0.0436435341835022, -0.038039132952690125, 0.003198245307430625, 0.03746763616800308, 0.05417460575699806, 0.010706139728426933, -0.07364024966955185, 0.018005510792136192, 0.00756628205999732, 0.050064146518707275, 0.04386705905199051, -0.04066125676035881, -0.019957387819886208, -0.016695134341716766, 0.014097141101956367, -0.02142721600830555, -0.004746532067656517, -0.019507886841893196, -0.03895380347967148, -0.012751794420182705, -0.09882339090108871, 0.043562449514865875, -0.025292152538895607, -0.018729856237769127, 0.029944876208901405, -0.048658113926649094, 0.014222987927496433, -0.041536156088113785, 0.02765496075153351, -0.012884555384516716, -0.007358808070421219, 0.005698176566511393, 0.010411991737782955, 0.01757444255053997, -0.07935753464698792, -0.04771377891302109, -0.06942307204008102, -0.018972305580973625, 0.0012940549058839679, -0.04479832202196121, -0.0832783654332161, -0.04544183611869812, 0.05084916949272156, -0.02996698208153248, -0.005153037142008543, 1.0640100299497135e-05, -0.036240529268980026, -0.04171202331781387, 0.11689218878746033, 0.0298744048923254, -0.00885095540434122, -0.0332326740026474, -0.06663449108600616, 0.05849972739815712, 0.07050241529941559, 0.05768340453505516, -0.014669355005025864, -0.0034458457957953215 ] }, { "text": "## Essential Libraries\n\n```python\n# Data Science\nimport numpy as np # Numerical computing\nimport pandas as pd # Data manipulation\nimport matplotlib.pyplot as plt # Visualization\n\n# Web Development\nfrom flask import Flask # Web framework\nimport requests # HTTP requests\n\n# Automation\nimport os # Operating system\nimport sys # System-specific\nfrom pathlib import Path # File paths\n```", "source": "python.md", "type": "markdown", "chunk_id": "python.md_12", "embedding": [ 0.0016826150240376592, -0.04953210428357124, -0.07051635533571243, -0.05200956016778946, 0.06505117565393448, -0.14855454862117767, -0.025966975837945938, 0.047578662633895874, -0.06186618655920029, 0.01635168492794037, 0.04133393242955208, -0.019830133765935898, -0.04950256273150444, -0.05443008244037628, 0.0261953417211771, 0.025905994698405266, -0.08332151919603348, -0.04223646968603134, 0.023443635553121567, -0.0697699561715126, 0.04616500437259674, 0.016183804720640182, 0.02263837307691574, -0.01695242151618004, 0.014638652093708515, -0.03003801219165325, -0.0024449098855257034, 0.019345538690686226, 0.005528287496417761, -0.01735967956483364, 0.015257075428962708, -0.014014189131557941, -0.005292728077620268, 0.043397463858127594, -0.05520819127559662, 0.011845160275697708, 0.06141975522041321, -0.018727941438555717, -0.009454995393753052, 0.04090578854084015, -0.008517501875758171, 0.02716207690536976, 0.06109720841050148, -0.06902720034122467, -0.018925277516245842, -0.040163394063711166, -0.05792297422885895, -0.03431902825832367, 0.015102306380867958, 0.07251841574907303, -0.09257175028324127, 0.02396349050104618, -0.0711745098233223, 0.0017310139955952764, 0.006199654191732407, -0.0717552974820137, 0.026046881452202797, -0.09769217669963837, 0.04002612084150314, -0.04852050170302391, -0.03635750710964203, 0.0452284961938858, 0.0648040696978569, -0.019390886649489403, 0.048713404685258865, -0.025995105504989624, -0.030471930280327797, 0.061631109565496445, 0.07275556027889252, 0.03342662379145622, -0.05291017144918442, -0.032899197190999985, -0.02440621517598629, -0.005943178664892912, -0.032361503690481186, -0.10349870473146439, -0.023938128724694252, 0.0031608939170837402, -0.010982271283864975, -0.023191865533590317, 0.002574979793280363, 0.036100856959819794, -0.0005433634505607188, 0.058391816914081573, -0.027865052223205566, -0.04045359790325165, -0.060527361929416656, 0.11123422533273697, 0.022730303928256035, -0.05852030962705612, 0.00046044628834351897, 0.005371480248868465, -0.0998980775475502, 0.05700087174773216, -0.0659877210855484, 0.05088618025183678, 0.07588384300470352, 0.014890450052917004, -0.009468232281506062, 0.014878428541123867, 0.03832612186670303, -0.11863386631011963, 0.022419728338718414, 0.09023228287696838, 0.006160156335681677, 0.015669865533709526, 0.05566374957561493, 0.04040127992630005, -0.02091587521135807, -0.00027989529189653695, -0.028920045122504234, -0.05228245630860329, -0.065716952085495, -0.01742992177605629, 0.0659843310713768, -0.06074516847729683, -0.05612524226307869, -0.014674036763608456, -0.07687869668006897, 0.06476138532161713, 0.008179105818271637, 0.05655390024185181, 0.021275250241160393, 0.06051716208457947, 0.0061897700652480125, -0.014693235047161579, 0.0008206008933484554, 1.351464826582827e-32, -0.02285328321158886, -0.018156064674258232, 0.023227699100971222, -0.006863297428935766, 0.07458480447530746, -0.04477493837475777, 0.029817111790180206, -0.07809510082006454, -0.03734230250120163, 0.06197801232337952, -0.017366498708724976, 0.07432189583778381, 0.005972523707896471, 0.033486369997262955, -0.010685553774237633, -0.08331151306629181, 0.08187586069107056, -0.08533304184675217, 0.025329770520329475, -0.0575413778424263, 0.0431196354329586, 0.019296852871775627, -0.014547650702297688, 0.04010561481118202, 0.012129995040595531, -0.02613719552755356, -0.05055106058716774, 0.09411437064409256, -0.010801427066326141, 0.03547768294811249, 0.01830378733575344, -0.03148208558559418, -0.04902266710996628, -0.05028693377971649, -0.005927447695285082, -0.028213661164045334, 0.036210913211107254, -0.0731404721736908, -0.07695166766643524, -0.03461356461048126, 0.00042079866398125887, -0.002554259030148387, 0.0009557610028423369, 0.04806893318891525, -0.030247310176491737, 0.019341908395290375, -0.04822040721774101, 0.10436926782131195, 0.07752460241317749, 0.00926136877387762, -0.1345212757587433, -0.024260304868221283, 0.06573618948459625, 0.03730613738298416, -0.023120947182178497, 0.0016451182309538126, -0.032054852694272995, -0.08540995419025421, -0.011079554446041584, -0.018370000645518303, 0.02780836448073387, -0.06770091503858566, -0.0024688602425158024, -0.03296351805329323, -0.004704679362475872, -0.04339093714952469, 0.05272877588868141, 0.045829955488443375, 0.019180726259946823, 0.10849861055612564, -0.08810842782258987, 0.025183899328112602, 0.021587850525975227, 0.008737998083233833, 0.05483771488070488, -0.0022369115613400936, 0.04041290283203125, -0.03517270088195801, -0.04893261566758156, -0.0016463212668895721, -0.006419613026082516, -0.06836948543787003, 0.00041420754860155284, -0.06303438544273376, 0.013365909457206726, -0.06136016920208931, 0.026765678077936172, 0.09560344368219376, -0.025266608223319054, -0.1263434737920761, -0.015553418546915054, -0.021487541496753693, -0.019821906462311745, 0.0006786967278458178, -0.07160865515470505, -1.5553463871460847e-32, -0.04395630583167076, 0.09151591360569, 0.06675814837217331, 0.03800109028816223, 0.007659718859940767, 0.05835815519094467, 0.02986031025648117, -0.034919604659080505, 0.06818033754825592, 0.034091781824827194, -0.0775713250041008, -0.08497373759746552, 0.011597512289881706, -0.0221543125808239, 0.09279294312000275, 0.08530638366937637, -0.06474938243627548, -0.029062988236546516, 0.010855508036911488, -0.038476452231407166, -0.15317685902118683, 0.043262600898742676, 0.03862158581614494, -0.042330995202064514, -0.06950557976961136, 0.003505494212731719, -0.022699318826198578, -0.09143620729446411, -0.010241367854177952, 0.012904324568808079, -0.12069904059171677, 0.024694211781024933, -0.07765060663223267, 0.053672000765800476, 0.022041823714971542, 0.03744955360889435, 0.0980314388871193, 0.021499134600162506, -0.057453855872154236, -0.029466332867741585, 0.07889075577259064, 0.03157739341259003, -0.039161037653684616, -0.024586359038949013, -0.0006253314786590636, 0.09708002209663391, -0.04414395987987518, 0.08342181146144867, -0.02271999791264534, -0.04310673847794533, 0.03269125148653984, 0.09355839341878891, 0.004879329819232225, 0.017246589064598083, -0.019449669867753983, -0.01075571496039629, 0.041458114981651306, 0.04236089438199997, -0.0711296871304512, -0.038434166461229324, -0.05560113489627838, -0.11852943152189255, -0.08976026624441147, 0.0035958653315901756, 0.004652298986911774, -0.06954503059387207, -0.12761881947517395, -0.03982860594987869, -0.006428609136492014, -0.00869721733033657, 0.013202647678554058, 0.02940666861832142, 0.03330225870013237, 0.005799556151032448, 0.0215471051633358, 0.013619848527014256, -0.025239478796720505, -0.014227562583982944, -0.054289497435092926, 0.11317680776119232, 0.13263694941997528, 0.03245057910680771, 0.07538352906703949, 0.047559160739183426, -0.09249213337898254, -0.030040228739380836, 0.018428009003400803, 0.006911673117429018, -0.005571302957832813, -0.06875230371952057, 0.041485127061605453, -0.01627586968243122, -0.009059129282832146, 0.027993163093924522, 0.050454769283533096, -5.205027520105432e-08, 0.005804782267659903, -0.027297545224428177, 0.03588821366429329, -0.004809774458408356, 0.014164749532938004, 0.16681788861751556, 0.01505196187645197, 0.06878673285245895, 0.01425529271364212, 0.025044910609722137, 0.02571888267993927, -0.006251065991818905, 0.01780812069773674, 0.005133908707648516, -0.057540543377399445, 0.06544261425733566, -0.0027005441952496767, 0.046665556728839874, 0.054112061858177185, -0.02498769201338291, 0.010847012512385845, -0.05377809330821037, 0.0067357285879552364, 0.030647488310933113, 0.001278686337172985, 0.03523045405745506, -0.04193420708179474, 0.02008591592311859, -0.07897645235061646, 0.007147269789129496, -0.06252477318048477, -0.12085361778736115, -0.009660699404776096, 0.055457018315792084, 0.01565561629831791, -0.04368355870246887, -0.0734606683254242, -0.010951113887131214, -0.02522461861371994, 0.031204828992486, -0.10526277869939804, 0.1116759181022644, -0.033459655940532684, 0.005505972541868687, 0.0731789767742157, 0.031207023188471794, -0.04782514274120331, 0.01692238822579384, 0.027185114100575447, -0.02286469377577305, 0.009065086953341961, -0.04287406802177429, 0.008476736955344677, -0.010413163341581821, 0.04237290471792221, -0.009999296627938747, -0.03235987573862076, -0.007205782923847437, -0.03800342604517937, -0.02788025699555874, 0.009358175098896027, 0.06809651851654053, 0.024632930755615234, -0.10769988596439362 ] }, { "text": "## Resources for Learning\n\n### Online Platforms\n- [Python.org Tutorial](https://docs.python.org/3/tutorial/)\n- [Real Python](https://realpython.com/)\n- [Python for Everybody](https://www.py4e.com/)\n\n### Practice\n- [LeetCode](https://leetcode.com/) - Coding challenges\n- [HackerRank](https://www.hackerrank.com/) - Python track\n- [Project Euler](https://projecteuler.net/) - Math problems\n\n### Books\n- \"Python Crash Course\" by Eric Matthes\n- \"Automate the Boring Stuff with Python\" by Al Sweigart\n- \"Fluent Python\" by Luciano Ramalho (Advanced)", "source": "python.md", "type": "markdown", "chunk_id": "python.md_13", "embedding": [ -0.09646843373775482, -0.0026912344619631767, 0.002113227266818285, 0.013281126506626606, 0.013830608688294888, -0.09423297643661499, 0.0042525241151452065, 0.05847426876425743, -0.12324079871177673, 0.014031155966222286, 0.011251207441091537, 0.03567752614617348, 0.08825238794088364, 0.03464343398809433, -0.031379666179418564, 0.042792659252882004, -0.08893179893493652, 0.07675577700138092, 0.008604814298450947, -0.10537737607955933, -0.012650725431740284, -0.000897742051165551, 0.059270258992910385, 0.03832651674747467, 0.006606558337807655, -0.03802694380283356, 0.0037608996499329805, -0.03506121039390564, 0.013027746230363846, -0.03372859209775925, -0.06654457002878189, 0.022640250623226166, 0.0251037385314703, -0.026653394103050232, 0.04078689217567444, -0.006131554953753948, -0.00037221176899038255, -0.028842099010944366, 0.0013333148090168834, 0.05979377031326294, -0.02652488276362419, 0.022650383412837982, 0.013237975537776947, -0.039897456765174866, -0.021896515041589737, 0.03484673053026199, -0.07994122058153152, -0.015666820108890533, 0.01221713051199913, -0.04036293178796768, -0.09314266592264175, -0.02007180266082287, -0.053579553961753845, -0.04997817054390907, -0.021363018080592155, -0.015897909179329872, 0.08991732448339462, -0.02878461591899395, 0.06301364302635193, -0.10177478194236755, 0.04713844135403633, -0.011425378732383251, -0.007921426557004452, -0.0258509311825037, -0.014205417595803738, -0.02667934261262417, 0.037257831543684006, 0.09656558930873871, 0.05821174755692482, 0.03841094672679901, -0.1052788645029068, -0.010141882114112377, -0.025807863101363182, 0.08473442494869232, 0.10807567089796066, -0.03057851269841194, -0.02183558978140354, -0.023003024980425835, -0.04636644199490547, 0.02860001102089882, -0.036011554300785065, -0.06530484557151794, -0.009867805987596512, 0.014566130004823208, 0.05211818590760231, -0.04422659054398537, 0.019030513241887093, 0.05842498317360878, 0.07531668990850449, 0.00016071030404418707, 0.03821570426225662, -0.03877450153231621, 0.06257331371307373, 0.053233224898576736, 0.013718989677727222, 0.06071384251117706, 0.05515920743346214, -0.05603071674704552, -0.012339606881141663, 0.036789074540138245, 0.011748756282031536, -0.027356471866369247, 0.028518056496977806, -0.024634871631860733, 0.048468999564647675, 0.06294718384742737, 0.080250583589077, 0.004809022415429354, 0.0884534940123558, -0.09067851305007935, -0.006093911360949278, -0.07301295548677444, -0.0012805984588339925, -0.06358994543552399, 0.0740165188908577, 0.034996625036001205, 0.028380922973155975, 0.05621441453695297, 0.039184994995594025, 0.029556943103671074, 0.011474233120679855, 0.014961283653974533, 0.0044553037732839584, -0.01564924232661724, 0.05214165151119232, -0.025644520297646523, -0.06190209463238716, -2.048954812640552e-35, 0.017382146790623665, -0.0006812726496718824, 0.02921253815293312, 0.044660165905952454, 0.14028461277484894, -0.0719856321811676, 0.012137423269450665, 0.016561448574066162, -0.09801864624023438, 0.0015731194289401174, -0.00020509240857791156, 0.09531882405281067, -0.013043166138231754, 0.07232214510440826, 0.0029334572609514, -0.12084703892469406, -0.010503673925995827, 0.023179642856121063, 0.035513922572135925, 0.020804695785045624, 0.0369671955704689, -0.04870316758751869, 0.020871201530098915, -0.01590661145746708, 0.0327720046043396, 0.03649847209453583, 0.004179411102086306, -0.03940391167998314, 0.08894039690494537, 0.02402602694928646, -0.13783912360668182, -0.015880543738603592, -0.053319673985242844, -0.0034025642089545727, -0.011077233590185642, 0.01698458380997181, -0.02582690678536892, -0.07628414779901505, 0.012474706396460533, -0.005224974825978279, -0.06600486487150192, 0.014670121483504772, 0.02924821339547634, -0.052255406975746155, -0.04607856646180153, 0.004341717343777418, -0.01133545208722353, 0.10033524036407471, 0.06565895676612854, -0.01287022139877081, -0.09660792350769043, -0.06120322644710541, -0.008992328308522701, -0.030047345906496048, -0.05824938043951988, 0.04253047704696655, 0.003685570089146495, 0.006129223853349686, 0.045587800443172455, -0.03450305014848709, 0.08198878914117813, 0.05541718006134033, 0.014970574527978897, -0.06704135239124298, -0.019205735996365547, 0.040706485509872437, 0.005406771320849657, 0.042155660688877106, 0.03375733271241188, 0.03637496754527092, -0.07950437068939209, 0.053391680121421814, -0.019516471773386, -0.015496968291699886, 0.039335064589977264, 0.05184140056371689, 0.013704474084079266, -0.09187847375869751, -0.05240952596068382, -0.02319670282304287, -0.023075975477695465, -0.03260225057601929, 0.05615909770131111, -0.0980488657951355, -0.03010292910039425, -0.035850465297698975, 0.02309049665927887, -0.020359179005026817, -0.016862064599990845, -0.013581189326941967, -0.012872595340013504, -0.06367909163236618, -0.015858983621001244, 0.04864523187279701, -0.016557469964027405, 9.669954025312518e-35, -0.0013552597956731915, 0.053451791405677795, -0.031151803210377693, 0.05891866609454155, 0.036757808178663254, -0.03503584489226341, -0.023159747943282127, 0.02491121180355549, 0.10688266158103943, -0.03995852544903755, -0.0732945129275322, -0.039111535996198654, 0.012340491637587547, 0.06473276019096375, 0.00262376107275486, -0.018645798787474632, -0.05811849609017372, -0.018851445987820625, 0.007357570808380842, 0.00934439804404974, -0.10611581802368164, 0.049462370574474335, -0.11005594581365585, -0.0751367062330246, 0.020577067509293556, 0.02696274220943451, -0.005010297056287527, -0.029276834800839424, 0.01113232970237732, 0.04135956987738609, -0.008536898531019688, 0.018719149753451347, -0.04838458076119423, 0.016746584326028824, -1.9052993593504652e-05, 0.058567795902490616, 0.030952120199799538, -0.02669941633939743, 0.007015051785856485, -0.015265588648617268, 0.16918931901454926, 0.020442375913262367, 0.011049293912947178, -0.040108438581228256, 0.05012137070298195, 0.049038100987672806, -0.06358451396226883, 0.0846569687128067, -0.0338737815618515, -0.0017101126722991467, 0.019501373171806335, 0.01108156144618988, 0.02476278506219387, -0.048823513090610504, -0.03753713518381119, 0.038593970239162445, 0.047173626720905304, 0.035240791738033295, 0.003446288174018264, -0.005436107516288757, -0.1308862864971161, -0.024533608928322792, -0.03655599430203438, 0.07920774817466736, -0.10125632584095001, -0.08968456089496613, -0.13117237389087677, 0.022066300734877586, -0.07495669275522232, -0.042628176510334015, -0.032398778945207596, 0.059492167085409164, -0.011792127043008804, -0.02658379077911377, -0.06181363761425018, 0.016451148316264153, -0.0723888948559761, 0.07031935453414917, -0.028073282912373543, 0.022352173924446106, 0.06909091025590897, 0.0053797559812664986, -0.004292174242436886, 0.08923394978046417, -0.06912100315093994, 0.0965525433421135, 0.06772159039974213, 0.06406960636377335, 0.018634021282196045, -0.027216501533985138, -0.011759292334318161, 0.03522730991244316, 0.06729059666395187, 0.06939679384231567, 0.0042662667110562325, -4.866836178507583e-08, 0.0021663920488208532, 0.09398263692855835, -0.015565695241093636, 0.04282068461179733, 0.015181519091129303, 0.08019202202558517, -0.001164606655947864, -6.905578629812226e-05, -0.059429850429296494, 0.0796377956867218, 0.013021563179790974, -0.062296345829963684, -0.03634609654545784, 0.004145796876400709, -0.0750097930431366, 0.1419340968132019, -0.028411976993083954, -0.003766541602090001, 0.012150476686656475, -0.02811516635119915, 0.06599429994821548, 0.0065248762257397175, -0.004038131795823574, 0.0461532287299633, -0.05118674039840698, 0.0410446897149086, 0.08341233432292938, -0.007846619933843613, -0.001910370890982449, -0.055090729147195816, 0.005210633855313063, -0.030177336186170578, 0.006264569237828255, -0.044472966343164444, 0.01888298988342285, 0.06409148871898651, -0.03966879844665527, -0.04974321275949478, -0.002467902610078454, 0.009909809567034245, -0.08699438720941544, -0.001461780397221446, 0.02794976346194744, -0.03245027735829353, 0.0318741574883461, -0.004016984719783068, -0.05151576176285744, -0.02814418263733387, -0.002116461982950568, -0.023649364709854126, -0.0047742039896547794, -0.042121320962905884, -0.03256119787693024, -0.03929286077618599, 0.1641896814107895, 0.07106801867485046, -0.05937652289867401, 0.020656978711485863, 0.025767946615815163, 0.04553382471203804, 0.0006442975136451423, 0.15059225261211395, 0.03763885796070099, 0.07478494197130203 ] }, { "text": "## Google Colab Example\n\nTry this code in [Google Colab](https://colab.research.google.com):\n\n```python\n# Data analysis example\nimport pandas as pd\nimport matplotlib.pyplot as plt\n\n# Create sample data\ndata = {\n 'Name': ['Alice', 'Bob', 'Charlie', 'David'],\n 'Age': [25, 30, 35, 28],\n 'Score': [85, 90, 78, 92]\n}\n\ndf = pd.DataFrame(data)\nprint(df)\n\n# Plot\nplt.bar(df['Name'], df['Score'])\nplt.title('Student Scores')\nplt.xlabel('Name')\nplt.ylabel('Score')\nplt.show()\n```\n\n## Key Takeaways\n\n- Python is beginner-friendly with clean syntax\n- Strong typing but dynamically typed\n- Indentation matters (use 4 spaces)\n- Rich standard library and ecosystem\n- Great for automation, data science, and web development\n- Practice is essential - code daily!", "source": "python.md", "type": "markdown", "chunk_id": "python.md_14", "embedding": [ 0.004626929294317961, -0.0033058207482099533, 0.0020599348936229944, -0.06716925650835037, 0.023039329797029495, 0.04799511656165123, -0.0022014945279806852, 0.045496996492147446, -0.004737392067909241, 0.00037893286207690835, 0.05498761311173439, -0.023966403678059578, 0.016013270244002342, -0.06938769668340683, 0.0335749089717865, -0.0005320326890796423, -0.035085830837488174, -0.09279678761959076, 0.04096032306551933, -0.12983858585357666, 0.027215151116251945, 0.03147505968809128, -0.00967256911098957, 0.01710454374551773, 0.028728866949677467, 0.05082637071609497, 0.015725508332252502, -0.0011180974543094635, -0.033858947455883026, -0.004408180247992277, -0.003001195378601551, -0.04297609627246857, 0.09302876889705658, 0.08971574902534485, -0.09797771275043488, -0.005430925637483597, 0.007885073311626911, 0.09113187342882156, -0.002569901989772916, 0.023729966953396797, 0.015428130514919758, -0.04010137915611267, 0.06910562515258789, -0.012816161848604679, 0.06608008593320847, -0.04174448922276497, -0.04898907244205475, -0.11478596180677414, 0.0604269802570343, 0.05251836031675339, -0.062283486127853394, 0.02912815473973751, -0.022655444219708443, -0.02378021739423275, 0.011344457976520061, -0.007780671119689941, 0.009510805830359459, -0.10417277365922928, 0.07578721642494202, -0.040630489587783813, -0.08279470354318619, 0.03572390228509903, 0.05492643639445305, 0.005951658822596073, 0.08311948925256729, -0.0403624065220356, -0.009322534315288067, 0.04860684648156166, 0.00484400475397706, 0.08229435235261917, 0.05845578759908676, 0.012416260316967964, 0.014662635512650013, -0.05462287738919258, -0.05751173198223114, -0.03983131796121597, -0.055490072816610336, 0.009020954370498657, 0.016853980720043182, 0.03630974888801575, -0.05001489445567131, 0.001362084993161261, 0.043639179319143295, 0.03207438811659813, -0.026198871433734894, -0.058055415749549866, 0.036138929426670074, -0.015392090193927288, -0.03442870080471039, -0.06615903228521347, -0.043550264090299606, 0.0038781664334237576, -0.03431730717420578, 0.09865659475326538, -0.02298034355044365, 0.034447867423295975, 0.037911154329776764, -0.06934336572885513, -0.00705653615295887, 0.044002387672662735, -0.0019289376214146614, 0.05301378667354584, -0.024193907156586647, -0.07518009841442108, -0.05985355004668236, -0.005696763750165701, 0.055724095553159714, 0.034366145730018616, 0.03896449878811836, 0.024002648890018463, -0.0026901860255748034, 0.023960648104548454, -0.057326462119817734, 0.05351746827363968, 0.009490679018199444, -0.03695433959364891, -0.020440993830561638, 0.02069063112139702, -0.004961682483553886, 0.008933285251259804, 0.024060964584350586, 0.06550697982311249, -0.011731840670108795, -0.0075221373699605465, -0.07407578080892563, -0.02274882048368454, -0.02801223285496235, 3.369134684743653e-33, -0.031186217442154884, -0.09841777384281158, 0.019993117079138756, -0.0004954221658408642, 0.006842026021331549, -0.039506006985902786, -0.0637531504034996, 0.004044828936457634, -0.04697798565030098, 0.033441219478845596, 0.017015663906931877, 0.01635890081524849, 0.0355413444340229, 0.05203920975327492, 0.02346712350845337, -0.004865366965532303, -0.004394641611725092, -0.0030224882066249847, -0.028493249788880348, 0.0016746200853958726, 0.030598340556025505, 0.02326275035738945, 0.07680394500494003, -0.003948835656046867, 0.015802517533302307, -0.04170256480574608, 0.03570128604769707, 0.039011601358652115, 0.006693445611745119, -0.015154227614402771, -0.03671726584434509, -0.046697065234184265, -0.040564365684986115, -0.09204281121492386, -0.0045564668253064156, -0.040046289563179016, 0.032640762627124786, 0.017019137740135193, -0.0629616230726242, 0.03707875683903694, -0.01814320497214794, -0.04899715632200241, -0.009548664093017578, 0.03804198279976845, -0.042542193084955215, 0.08573339879512787, 0.013104616664350033, 0.05365346372127533, 0.025931578129529953, 0.1025126501917839, -0.12335101515054703, -0.008048090152442455, -0.025885162875056267, 0.014274807646870613, -0.0717727467417717, 0.08140117675065994, -0.02013462595641613, -0.009054437279701233, -0.06062623858451843, -0.14164875447750092, 0.00039128505159169436, 0.001790177426300943, 0.028976356610655785, 0.004782109521329403, -0.0189529862254858, 0.06928583234548569, -0.029640842229127884, 0.033769793808460236, 0.07160864025354385, -0.027120718732476234, -0.062180791050195694, 0.012988921254873276, -0.021318210288882256, -0.04065634682774544, 0.021300969645380974, -0.043520621955394745, -0.020491326227784157, -0.012042012065649033, -0.03227055445313454, -0.0359199158847332, 0.0783696100115776, -0.09086333960294724, -0.0058391280472278595, -0.07411706447601318, 0.01907181926071644, -0.017104461789131165, 0.07995375245809555, -0.03605346009135246, -0.08156214654445648, -0.1072889193892479, -0.07299381494522095, -0.006815824192017317, -0.03087630495429039, 0.0306631401181221, -0.04106752574443817, -6.0232558288164484e-33, 0.009575084783136845, 0.04885048046708107, 0.06220440939068794, -0.0004903718363493681, 0.12760883569717407, -0.016140591353178024, 0.027365295216441154, 0.010640349239110947, 0.02262895368039608, -0.011660795658826828, -0.07059488445520401, -0.07481463253498077, 0.03518890589475632, -0.026242610067129135, 0.05580940842628479, 0.09578627347946167, -0.09220929443836212, 0.06452122330665588, -0.14329062402248383, -0.0546366386115551, -0.03767438232898712, 0.08642825484275818, -0.007479656487703323, -0.025228183716535568, 0.006988089997321367, 0.004283027723431587, 0.011718430556356907, -0.05378459766507149, -0.04122517630457878, -0.03700883686542511, -0.021118955686688423, 0.050836287438869476, -0.050130486488342285, 0.04198293015360832, -0.05707623064517975, 0.03146813437342644, 0.06525856256484985, -0.12931478023529053, -0.09764859825372696, 0.06374316662549973, 0.05861878767609596, 0.07341910898685455, -0.019197264686226845, -0.030747119337320328, 0.029849786311388016, 0.09429328143596649, -0.011915218085050583, -0.0029613340739160776, -0.012843368574976921, 0.042011506855487823, -0.04052652046084404, 0.04305621609091759, -0.03315914794802666, 0.031423021107912064, 0.006533655803650618, -0.053666338324546814, 0.0016761984443292022, 0.018464989960193634, -0.11794444918632507, -0.03901326283812523, -0.037276364862918854, -0.04973916709423065, -0.035350438207387924, 0.07236135751008987, 0.043801773339509964, -0.08211496472358704, -0.016311852261424065, -0.02099098637700081, 0.022374309599399567, 0.025053907185792923, -0.02477310597896576, -0.047711096704006195, 0.03776528313755989, -0.056776173412799835, 0.02696843631565571, 0.1222580224275589, -0.031661342829465866, 0.019295362755656242, -0.09314867854118347, 0.06656341254711151, 0.06590244174003601, -0.050977908074855804, 0.10764117538928986, 0.056089382618665695, -0.037019211798906326, -0.014522071927785873, 0.1094544306397438, 0.055663466453552246, 0.020568223670125008, 0.02905939891934395, 0.00893937423825264, -0.030763493850827217, 0.011471239849925041, 0.05770436301827431, 0.0613132044672966, -5.062864616434126e-08, 0.01046172995120287, -0.017874058336019516, -0.05387888476252556, 0.07238425314426422, -0.06815879046916962, 0.09569447487592697, -0.016206437721848488, -0.052394602447748184, -0.019922396168112755, 0.033080846071243286, 0.037037208676338196, -0.010804145596921444, -0.06735189259052277, -0.010149762965738773, -0.062468066811561584, 0.02433030679821968, -0.037254590541124344, 0.06713072210550308, 0.042128585278987885, -0.004075014032423496, 0.012780864723026752, -0.06278718262910843, -0.005856086499989033, 0.06935442984104156, -0.05456746742129326, -0.04271276667714119, -0.04010080546140671, -0.004631754942238331, -0.10799455642700195, 0.03712081164121628, -0.0033837808296084404, -0.012368136085569859, 0.07072395831346512, -0.02458592876791954, 0.10081572085618973, -0.05591890215873718, 0.035050276666879654, 0.008740835823118687, 0.05944808945059776, 0.15455837547779083, -0.06663982570171356, 0.007217628415673971, -0.06622724235057831, -0.010037971660494804, 0.07544448226690292, 0.025623301044106483, 0.0005038761883042753, 0.06745374202728271, 0.06838047504425049, 0.02579664997756481, -0.0064865415915846825, -0.03197244927287102, -0.0636858344078064, -0.07852861285209656, 0.0887937992811203, 0.0796344205737114, -0.08051406592130661, 0.0967286005616188, -0.033026330173015594, -0.04274137318134308, 0.03493393957614899, 0.027597732841968536, 0.016604015603661537, -0.10122080147266388 ] }, { "text": "## Related Topics\n\n- [Machine Learning](ml.html) - Use Python for ML\n- [NumPy](numpy.html) - Numerical computing library\n- [Data Structures](data-structures.html) - Core CS concepts\n\n## Next Steps\n\n1. Install Python on your machine\n2. Complete a beginner tutorial\n3. Build small projects\n4. Learn a library (NumPy, Pandas, or Flask)\n5. Contribute to open source\n\n---\n\n**Last Updated:** November 8, 2025 \n**Difficulty Level:** Beginner", "source": "python.md", "type": "markdown", "chunk_id": "python.md_15", "embedding": [ -0.03457193449139595, -0.09457878768444061, -0.04613775759935379, -0.029627179726958275, 0.03839372470974922, -0.10495632141828537, -0.04072033613920212, -0.044731590896844864, -0.13741566240787506, -0.042250651866197586, -0.019616302102804184, -0.0346323698759079, 0.03855206072330475, -0.0664210319519043, -0.01848004199564457, 0.079908587038517, -0.04648846760392189, 0.04724392294883728, -0.002933449111878872, -0.06310474127531052, -0.002473801840096712, 0.002827940508723259, -0.0756867378950119, -0.01508299633860588, 0.01916765794157982, 0.03692165017127991, 0.06831981986761093, 0.05150603502988815, 0.020471123978495598, -0.00020017633505631238, 0.03594851866364479, -0.08508100360631943, 0.057546284049749374, 0.06069868430495262, -0.0464661531150341, 0.015990737825632095, 0.016532758250832558, -0.031350504606962204, -0.05435160920023918, 0.030703339725732803, -0.005747043527662754, -0.04456494748592377, 0.026357833296060562, -0.0530090369284153, 0.08553571999073029, 0.047205742448568344, -0.08490639925003052, -0.0793737843632698, 0.028404776006937027, -0.0033712652511894703, -0.13960759341716766, -0.07387605309486389, -0.029425017535686493, -0.026342079043388367, -0.08268294483423233, -0.058096062391996384, 0.05833057686686516, -0.11168327182531357, 0.012999484315514565, -0.05384382978081703, 0.014553628861904144, -0.04184930771589279, -0.003939379006624222, 0.02060563489794731, 0.046549927443265915, 0.001965711358934641, 0.008953660726547241, 0.042144905775785446, 0.07358939200639725, -0.02463415078818798, -0.0173745546489954, 0.00487843994051218, -0.036940764635801315, 0.010788305662572384, -0.030158398672938347, -0.06710328161716461, 0.04817873239517212, -0.04164651036262512, 0.039656296372413635, 0.010006285272538662, -0.05622844398021698, 0.04675845056772232, -0.00764140859246254, 0.046978022903203964, -0.003504968946799636, -0.047496773302555084, -0.043033991008996964, 0.0992107167840004, -0.019851982593536377, -0.03377075120806694, 0.06418328732252121, 0.023495450615882874, -0.06594718247652054, 0.0033031573984771967, -0.04144806042313576, 0.11848235130310059, 0.059793174266815186, -0.031032655388116837, -0.0015145353972911835, 0.07902126014232635, -0.08600903302431107, -0.09247513860464096, -0.011028286069631577, 0.0036860450636595488, 0.008885417133569717, -0.013193627819418907, 0.0933879092335701, 0.08231481909751892, 0.07640369236469269, -0.09819424152374268, -0.006693621166050434, -0.046120863407850266, -0.09035047143697739, -0.0337136834859848, 0.01144446711987257, -0.023645663633942604, 0.02795904502272606, -0.04223967343568802, 0.019443241879343987, 0.07435650378465652, -0.02327306754887104, 0.05508765950798988, -0.04952157661318779, -0.007077673450112343, -0.03668315336108208, -0.05812747776508331, -0.07745664566755295, 3.527582507026866e-33, 0.010571170598268509, 0.026160238310694695, 0.02131478115916252, 0.011266215704381466, 0.0708732008934021, -0.04045994207262993, 0.032845236361026764, -0.07697687298059464, 0.00041035946924239397, 0.0543912909924984, 0.02265629544854164, 0.03646734356880188, -0.05320112779736519, 0.039168864488601685, 0.01656944677233696, -0.11111760139465332, 0.09049531817436218, -0.037017907947301865, 0.045412927865982056, -0.033436119556427, 0.032910287380218506, 0.015089105814695358, 0.04241547733545303, 0.04945451021194458, 0.0017022890970110893, 0.0810280442237854, 0.0037073050625622272, 0.023277997970581055, 0.004405084531754255, 0.016852175816893578, 0.03860614821314812, 0.040487222373485565, -0.08022227883338928, -0.021965790539979935, 0.06629320979118347, -0.0012368217576295137, 0.021086031571030617, -0.010279475711286068, -0.011837702244520187, -0.01600244827568531, -0.03724467381834984, 0.02117551863193512, 0.07567789405584335, -0.05940311774611473, -0.04283679276704788, 0.0010694563388824463, 0.014656869694590569, -0.007661494426429272, 0.0898410975933075, -0.07536912709474564, -0.05463680252432823, -0.06036565080285072, 0.013212447054684162, 0.037664804607629776, -0.05472496896982193, 0.0593663789331913, 0.008549830876290798, -0.0068471478298306465, 0.019765259698033333, -0.03538057580590248, 0.057679031044244766, -0.03582741320133209, 0.057152338325977325, -0.07488374412059784, 0.01735718362033367, -0.024790136143565178, 0.014949178323149681, 0.06234648823738098, 0.05404605343937874, -0.00158233055844903, -0.013090817257761955, 0.05911744013428688, 0.027020515874028206, -0.033207524567842484, 0.021253885701298714, 0.018392888829112053, 0.05136062949895859, -0.06701725721359253, -0.0006850684876553714, -0.0019431007094681263, -0.011611657217144966, 0.05224175006151199, 0.03651177138090134, -0.11970189213752747, 0.043244753032922745, -0.03696061298251152, -0.014102883636951447, -0.004087607841938734, -0.03676500916481018, -0.078989677131176, -0.07518689334392548, 0.041627831757068634, 0.013530825264751911, -0.013330667279660702, -0.033503349870443344, -5.090589958199244e-33, -0.056915704160928726, 0.08208779990673065, -0.011596890166401863, 0.056886304169893265, -0.013638580217957497, 0.04166406765580177, -0.07552181929349899, 0.04784462973475456, -0.010194173082709312, 0.03671351075172424, -0.009085637517273426, -0.06608159840106964, 0.03982331231236458, 0.020764386281371117, 0.04127546027302742, 0.03835247829556465, -0.03612211346626282, -0.006495147943496704, 0.0157501008361578, 0.003961167298257351, -0.0828985795378685, 0.04290143400430679, -0.03337346762418747, -0.05406967177987099, -0.010545400902628899, -0.0074201179668307304, -0.012228687293827534, 0.00535685196518898, 0.03738752752542496, 0.035699136555194855, -0.052041325718164444, 0.03976063430309296, -0.016825906932353973, 0.01696314476430416, 0.01072224322706461, 0.035864345729351044, 0.04670657962560654, -0.03537951037287712, 0.06698206067085266, -0.015188435092568398, 0.10274169594049454, 0.024775441735982895, -0.020481031388044357, -0.08993273973464966, 0.014300752431154251, 0.014001705683767796, 0.00301264226436615, 0.06552837044000626, -0.0016086588148027658, -0.06363949924707413, 0.0351402573287487, 0.004429248161613941, -0.06689759343862534, 0.002741910284385085, -0.03271704912185669, 0.015427357517182827, 0.02291635051369667, 0.017319364473223686, 0.03404552862048149, -0.027250686660408974, -0.15450432896614075, -0.10086246579885483, -0.0019294113153591752, 0.03418273478746414, -0.032407812774181366, -0.02437608875334263, -0.09297496825456619, 0.04931553080677986, -0.06888075172901154, -0.007002829574048519, -0.08604355156421661, 0.10770311951637268, 0.07698941975831985, -0.01663314923644066, -0.09575647115707397, -0.09644940495491028, -0.032176438719034195, 0.014503526501357555, -0.005796161945909262, 0.026066379621624947, 0.09984920918941498, 0.020829830318689346, 0.02234250120818615, 0.031030617654323578, 0.016474714502692223, 0.0019079744815826416, 0.13498564064502716, -0.02972491830587387, 0.0010225966107100248, -0.06728784739971161, -0.0942210927605629, 0.06922554224729538, 0.050197284668684006, 0.07313468307256699, -0.021885201334953308, -4.667822395276744e-08, -0.03618612512946129, -0.02105526812374592, 0.05025457963347435, 0.0075773391872644424, 0.04011542722582817, 0.14232616126537323, -0.01428720261901617, 0.0073656062595546246, -0.012059848755598068, 0.024951640516519547, 0.04993489384651184, -0.04917430132627487, -0.0027887746691703796, -0.01083957776427269, -0.075531505048275, 0.13398459553718567, -0.0001645142474444583, 0.024399638175964355, 0.038184069097042084, 0.031099362298846245, 0.05896619334816933, -0.012126777321100235, 0.042008962482213974, 0.035746775567531586, 0.05431404337286949, -0.06962049752473831, -0.08027724921703339, 0.0028515083249658346, -0.04593677446246147, -0.039600223302841187, -0.08232124149799347, -0.03595663234591484, 0.014140205457806587, 0.04223654791712761, 0.07871968299150467, 0.028574159368872643, -0.0477701760828495, -0.033830467611551285, -0.016456620767712593, -0.016161922365427017, -0.017887884750962257, 0.10328155010938644, -0.08218388259410858, -0.01589295081794262, 0.10207389295101166, 0.074896901845932, -0.01850339211523533, -0.1083037331700325, -0.029982158914208412, 0.047039955854415894, 0.0510285347700119, -0.010089017450809479, 0.03862844780087471, 0.046139419078826904, 0.07941333204507828, 0.0033943166490644217, 0.011357483454048634, 0.029523421078920364, 0.06927917897701263, 0.02597944065928459, 0.01028352975845337, 0.0802760124206543, -0.014249909669160843, -0.012884524650871754 ] }, { "text": "---\ntitle: \"LLM FAQ\"\nid: \"faq\"\ncategory: \"genai\"\ntags: [\"evaluation\", \"llm\", \"prompt\", \"finetuning\", \"medium\"]\nrelated: [\"llm\"]\ndate: \"2023-09-18\"\ndescription: \"Q&A for LLM\"\n---\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/llm-q-a-4c98031d9ea3) \n\nIf you’ve been curious about LLMs and still have questions, this article \nis just for you. Get ready to dive deep into the world of language models!", "source": "2023-09-18-LLM_Q_A.md", "type": "markdown", "chunk_id": "2023-09-18-LLM_Q_A.md_0", "embedding": [ 0.014799459837377071, -0.03728250786662102, -0.0004927319823764265, -0.019938549026846886, 0.03530058637261391, 0.05674873664975166, 0.01292845606803894, 0.028035113587975502, 0.03292372450232506, -0.014611409977078438, -0.006807258352637291, -0.022051656618714333, 0.07253097742795944, 0.013727746903896332, 0.046176765114068985, 0.08168784528970718, 0.03368046507239342, -0.0319526381790638, -0.019882045686244965, -0.05605566129088402, 0.04206557944417, 0.10105842351913452, 0.05781923234462738, 0.016377907246351242, 0.016786742955446243, -0.0023380557540804148, -0.014526812359690666, 0.06901011615991592, 0.07840472459793091, -0.005849385634064674, -0.03123946487903595, 0.10895764082670212, 0.04175815358757973, 0.07275357842445374, -0.049442991614341736, 0.059162724763154984, -0.03120233677327633, 0.00785262044519186, 0.01766648329794407, -0.025757208466529846, -0.015585573390126228, -0.048144057393074036, 0.01700916327536106, -0.03581870347261429, 0.11482248455286026, -0.01164272427558899, -0.07578682899475098, -0.0031739871483296156, -0.16207045316696167, 0.01843131333589554, -0.07343767583370209, -0.0891142264008522, -0.0032685345504432917, 0.068414606153965, -0.023945067077875137, 0.056624919176101685, -0.03465568274259567, -0.05177611485123634, -0.03319871053099632, -0.055859457701444626, -0.08151139318943024, -0.03551875054836273, -0.09871084243059158, 0.06678865849971771, 0.03596077114343643, -0.04907413572072983, -0.027987463399767876, 0.08915474265813828, -0.011353723704814911, 0.009387051686644554, -0.0006584165384992957, -0.05233364552259445, 0.030954858288168907, 0.07006075233221054, -0.040533412247896194, 0.02111835777759552, 0.01234560739248991, 0.06071879714727402, 0.047505512833595276, -0.01055100467056036, -0.0054216389544308186, 0.004520732443779707, -4.326972339185886e-05, 0.001761643448844552, 0.002918819198384881, 0.004721512086689472, 0.035748936235904694, -0.021732961758971214, 0.0028218873776495457, 0.007888452149927616, 0.02395527809858322, -0.07733730971813202, 0.04723638296127319, 0.06654877215623856, 0.03452135995030403, 0.05805249512195587, 0.038846805691719055, -0.15354445576667786, 0.013428241945803165, 0.042642008513212204, 0.02312646061182022, 0.0722733736038208, 0.021500524133443832, -0.024621961638331413, -0.0661059319972992, -0.04860204458236694, 0.004261629190295935, 0.077120840549469, -0.013065874576568604, -0.06393852829933167, 0.009183185175061226, 0.03541303053498268, 0.031175756826996803, -0.04451676085591316, 0.01650858111679554, -0.08272850513458252, 0.07774611562490463, -0.02317703329026699, 0.12430215626955032, -0.01140142697840929, -0.09359768778085709, 0.006653012707829475, -0.05055077001452446, -0.021302783861756325, 0.052301693707704544, -0.03197532147169113, -0.06434502452611923, 2.370775761317768e-33, 0.09914989769458771, 0.016266249120235443, -0.039594776928424835, 0.04483617842197418, 0.06126965954899788, 0.045194026082754135, 0.03939835727214813, 0.015878826379776, 0.010728213004767895, 0.0032741522882133722, -0.02473870851099491, 0.048304229974746704, -0.07463261485099792, 0.013767031021416187, -0.0004660676349885762, 0.010677898302674294, -0.03398272767663002, -0.01742428168654442, -0.002975679701194167, -0.023056760430336, 0.0057447850704193115, 0.06335274130105972, 0.055041950196027756, -0.02582625485956669, 0.046314653009176254, 0.0944858267903328, 0.08456555753946304, -0.06465350091457367, -0.023530980572104454, 0.05502323433756828, -0.06404439359903336, -0.01210427563637495, -0.010758615098893642, -0.01016923412680626, -0.04382089525461197, 0.06500419229269028, -0.1110590398311615, 0.003329324070364237, 0.012374273501336575, -0.07251974940299988, 0.02394193783402443, 0.005387511570006609, -0.023067880421876907, -0.043051306158304214, -0.04303422570228577, -0.010617267340421677, -0.021816225722432137, 0.02424403466284275, -0.024683430790901184, 0.01566186174750328, 0.028509946539998055, -0.06131557375192642, -0.09978421777486801, 0.005818425212055445, -0.0027102127205580473, 0.023953547701239586, -0.03670172393321991, 0.034106820821762085, -0.09978536516427994, -0.05786784738302231, 0.018124781548976898, 0.034537848085165024, 0.05003660172224045, 0.00634479895234108, 0.05697950720787048, -0.013231099583208561, -0.08681429922580719, 0.005122246686369181, 0.09196162223815918, -0.0028946916572749615, 0.016568435356020927, -0.027029693126678467, -0.07261618226766586, 0.012171478010714054, 0.00915603432804346, -0.07338530570268631, -0.01675204187631607, -0.06792419403791428, 0.06451340019702911, 0.04823675379157066, 0.016444621607661247, 0.030067557469010353, -0.050186220556497574, -0.0069448817521333694, 0.021907202899456024, -0.039157576858997345, 0.04789064824581146, -0.03449510037899017, 0.03984563797712326, -0.01690797135233879, 0.02058590017259121, 0.00329467561095953, 0.020012646913528442, 0.06726998090744019, -0.04502437636256218, -3.2092942689967e-33, 0.00998508557677269, -0.0044046672992408276, -0.05690455064177513, 0.13704121112823486, 0.007986447773873806, -0.1427898406982422, -0.025526873767375946, 0.12346389144659042, 0.014094092883169651, -0.023512575775384903, -0.04659762606024742, -0.04260087385773659, -0.03511125221848488, 0.016242943704128265, 0.04963194206357002, -0.05447607487440109, -0.0162473376840353, -0.07348526269197464, 0.028992891311645508, 0.09042271971702576, -0.01671486161649227, 0.07236941903829575, -0.09424647688865662, -0.011924725957214832, -0.008360717445611954, -0.005873229820281267, 0.04515307769179344, 0.039348483085632324, -0.03601779416203499, 0.051913194358348846, 0.04336171969771385, -0.0796196460723877, -0.03999736160039902, -0.00719026243314147, -0.0418955460190773, -0.00478561082854867, 0.09634072333574295, 0.01593838445842266, 0.04049128666520119, 0.04378035292029381, 0.04266969859600067, 0.0182833019644022, 0.011500380001962185, 0.03288878872990608, -0.043894559144973755, -0.016817433759570122, -0.03868069499731064, -0.0573413111269474, 0.07388631254434586, -0.10788024216890335, -0.019329342991113663, -0.09828205406665802, 0.01384653802961111, -0.04777643457055092, -0.05146249756217003, -0.05679512396454811, 0.02119334042072296, -0.04060288518667221, -0.1082104742527008, -0.0035901078954339027, -0.039326004683971405, -0.008512154221534729, 0.008783181197941303, -0.04925284907221794, 0.031260181218385696, -0.009801854379475117, -0.051202476024627686, 0.03548002243041992, -0.06743498891592026, -0.06894750148057938, 0.05897827446460724, -0.01039880607277155, -0.07526640594005585, 0.020484287291765213, 0.006637763697654009, -0.02834758348762989, -0.02909190021455288, -0.02337750233709812, 0.06627761572599411, -0.08486571162939072, 0.025782808661460876, -0.0073146698996424675, -0.077992282807827, 0.12172820419073105, -0.05979669466614723, -0.01866927184164524, 0.0658545270562172, 0.09352218359708786, -0.06104148179292679, 0.014546246267855167, 0.054585881531238556, 0.052110739052295685, 0.0227225199341774, 0.03154649958014488, -0.03755006194114685, -5.537848579706406e-08, -0.06435630470514297, -0.07392362505197525, -0.06241007521748543, 0.05906754359602928, 0.024040503427386284, -0.02015123888850212, -0.058217599987983704, -0.004225272219628096, 0.06701173633337021, -0.008972976356744766, 0.003610956249758601, 0.06640946865081787, -0.12797759473323822, -0.016171244904398918, 0.043246787041425705, 0.0031536465976387262, -0.03315587341785431, 0.08788121491670609, -0.033708516508340836, -0.06899133324623108, 0.05062168464064598, 0.056091394275426865, 0.024125397205352783, -0.01274358294904232, 0.08822176605463028, 0.01978474296629429, -0.034325841814279556, 0.03619401156902313, -0.010336099192500114, 0.022420084103941917, 0.013061802834272385, 0.02220301516354084, -0.07417495548725128, 0.045038942247629166, -0.003928779624402523, 0.04080549255013466, 0.011133135296404362, -0.12116457521915436, 0.051487766206264496, -0.022276299074292183, 0.10000594705343246, -0.04281416907906532, -0.060664620250463486, 0.04337221384048462, -0.015635080635547638, -0.031747736036777496, -0.008717522025108337, -0.11590790748596191, -0.03415326029062271, -0.04502378776669502, 0.008235093206167221, -0.06567930430173874, 0.048263467848300934, -0.017578544095158577, -0.008435862138867378, 0.045424409210681915, 0.03457630053162575, -0.020438430830836296, 0.05512692779302597, -0.02577117457985878, 0.07734731584787369, 0.11407039314508438, 0.003307626349851489, 0.02726856619119644 ] }, { "text": "---\ntitle: \"Machine Learning Fundamentals\"\nid: \"ml\"\ncategory: \"machine-learning\"\ntags: [\"machine learning\", \"AI\", \"algorithms\", \"supervised learning\", \"ai-generated\"]\nrelated: [\"python\", \"dl\"] # Added your trial note\ndate: \"2025-11-08\"\ndescription: \"Introduction to machine learning concepts, algorithms, and applications\"\n---\n\n# Machine Learning Fundamentals\n\n**This article is generated by Claude Opus 4.5**\n\n## Overview\n\nMachine Learning (ML) is a subset of artificial intelligence that focuses on building systems that can learn from and make decisions based on data. Instead of being explicitly programmed, these systems improve their performance through experience.", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_0", "embedding": [ -0.0332602895796299, -0.023391034454107285, 0.018660003319382668, 0.015155304223299026, 0.03307412564754486, -0.07709832489490509, 0.027194328606128693, -0.03219056874513626, -0.0837400034070015, -0.015634747222065926, -0.05029824748635292, 0.019932152703404427, 0.07587159425020218, -0.05033131316304207, -0.042306143790483475, 0.056883279234170914, 0.01698712445795536, 0.033084917813539505, -0.08801651000976562, -0.08767468482255936, 0.024599704891443253, 0.0022178194485604763, -0.03855157271027565, 0.018255319446325302, -0.0068101114593446255, 0.055899642407894135, 0.028250159695744514, -0.0030349295120686293, 0.002537989756092429, -0.038880135864019394, 0.03268449008464813, -0.056900933384895325, 0.05844217166304588, -0.005551139358431101, -0.06791640818119049, -0.007847866043448448, -0.03155488148331642, 0.016354680061340332, 0.05821681395173073, -0.0009222656372003257, -0.035199496895074844, -0.06748335808515549, -0.0036930579226464033, -0.0422445610165596, 0.07996073365211487, 0.12801405787467957, -0.06406790763139725, -0.10625957697629929, -0.023378582671284676, -0.011552681215107441, -0.16273312270641327, -0.05269857868552208, -0.03768187388777733, 0.023721447214484215, -0.04379754886031151, 0.01566299796104431, 0.01332138292491436, 0.02341793105006218, 0.04205288365483284, -0.0273957047611475, 0.0034196844790130854, -0.07914002984762192, -0.001457424252294004, 0.018661130219697952, -0.0027495897375047207, 0.02408784069120884, -0.028771789744496346, 0.010626712813973427, 0.027502257376909256, -0.027980061247944832, -0.0018957891734316945, 0.12028838694095612, -0.0008943177526816726, 0.0496298186480999, 0.009867345914244652, 0.007447301410138607, -0.0009801199194043875, -0.026892388239502907, 0.045713238418102264, -0.00927386712282896, -0.027187572792172432, 0.016963116824626923, -0.06043718382716179, 0.039887841790914536, 0.04971076920628548, -0.085402712225914, -0.017092052847146988, 0.02558131515979767, 0.00519054988399148, -0.018763838335871696, -0.009417837485671043, -0.0753864124417305, -0.018955335021018982, -0.04304802790284157, -0.0001744181354297325, 0.08645080029964447, -0.03185482695698738, -0.1379820853471756, -0.01878567412495613, 0.04997367039322853, -0.05532650277018547, 0.044083498418331146, -0.012242700904607773, 0.048824235796928406, 0.049787722527980804, -0.004850707016885281, 0.04076550900936127, 0.014334985055029392, 0.10634299367666245, -0.08059794455766678, -0.016472402960062027, -0.009352636523544788, -0.033862799406051636, -0.08808864653110504, 0.03504525497555733, -0.019811829552054405, -0.00010793397814268246, 0.05315190553665161, 0.027743590995669365, 0.11621183902025223, -0.01158731896430254, 0.024546045809984207, 0.015654291957616806, -0.013531330972909927, -0.02702890709042549, -0.06731529533863068, -0.07382035255432129, 6.576801812419425e-34, -0.05199788138270378, -0.0836593508720398, 0.012296374887228012, 0.01269549410790205, 0.05546338111162186, -0.09275379776954651, -0.023874133825302124, -0.04225851967930794, 0.0468648299574852, 0.018046550452709198, -0.03378380462527275, 0.013222908601164818, -0.020390557125210762, 0.1201770231127739, 0.044926468282938004, -0.006636014208197594, 0.0379035510122776, 0.02522808127105236, -0.023260049521923065, -0.05190766602754593, 0.04471893236041069, -0.01580265909433365, 0.05637379363179207, -0.026957504451274872, 0.013885846361517906, 0.05082164704799652, 0.022652633488178253, -0.03816511109471321, 0.015146381221711636, 0.028237348422408104, -0.0319366492331028, 0.045704614371061325, -0.0716027095913887, -0.012271909043192863, 0.020124927163124084, 0.02456117980182171, -0.04892225190997124, -0.0007636201335117221, 0.013836449012160301, 0.02080564759671688, -0.06409521400928497, -0.03886455297470093, 0.006623031571507454, -0.029717376455664635, -0.03452788665890694, 0.02645540051162243, -0.03753110393881798, -0.09214721620082855, 0.004075119271874428, -0.052631400525569916, -0.019263744354248047, -0.030874494463205338, 0.009762730449438095, -0.05445249378681183, -0.023026227951049805, 0.0633661299943924, -0.0072328802198171616, 0.03741691634058952, -0.042000189423561096, -0.01586679369211197, 0.02185066230595112, -0.018930355086922646, 0.019253050908446312, 0.04345133900642395, -0.003223233390599489, 0.013961776159703732, 0.11296304315328598, 0.08669555187225342, 0.060665879398584366, 0.014575968496501446, -0.03625747188925743, 0.04746728762984276, 0.01883935183286667, -0.018250925466418266, 0.022481869906187057, -0.028272416442632675, 0.02189008705317974, -0.06582300364971161, -0.01180511899292469, 0.029520075768232346, -0.028172863647341728, -0.0021658276673406363, -0.035787612199783325, -0.09322074800729752, 0.032442666590213776, -0.02431514672935009, -0.021094562485814095, -0.06498356908559799, -0.04019820690155029, -0.030172308906912804, -0.141189306974411, 0.012759329751133919, -0.019052721560001373, 0.059532176703214645, -0.05938170105218887, -4.748270207534455e-33, -0.010405912064015865, 0.021702725440263748, -0.05906519293785095, 0.08808505535125732, -0.015729863196611404, -0.020829807966947556, -0.084894098341465, 0.003756806021556258, -0.053019214421510696, 0.03969356045126915, -0.04005501791834831, -0.0282649714499712, 0.04350622370839119, 0.04136760160326958, -0.007825066335499287, 0.04023658111691475, -0.07959045469760895, -0.042047660797834396, 0.006447228603065014, 0.03298399597406387, -0.058716386556625366, 0.09771507233381271, -0.05097993090748787, 0.012059269472956657, 0.04657228663563728, -0.016309700906276703, -0.05521801486611366, 0.027222691103816032, 0.03864172473549843, 0.01926889270544052, -0.07486788928508759, 0.03659813851118088, -0.049599528312683105, -0.01265137828886509, 0.015077844262123108, 0.03454483672976494, 0.07046034932136536, -0.07952069491147995, -0.011595085263252258, 0.07834190875291824, 0.08177228271961212, 0.04497252032160759, -0.048266664147377014, -0.06522317230701447, 0.010691831819713116, -0.05381704866886139, -0.03992419317364693, 0.02641630545258522, 0.0014617756241932511, -0.06050629913806915, 0.027006899937987328, 0.01689261384308338, -0.0821061059832573, -0.049001216888427734, -0.04037809371948242, -0.006509025581181049, 0.024656081572175026, 0.01860339567065239, 0.02914094179868698, 0.08169219642877579, -0.09321688115596771, -0.09841048717498779, 0.046022266149520874, 0.08682112395763397, -0.062313053756952286, 0.050428345799446106, -0.04209650680422783, 0.050176989287137985, -0.04476473852992058, -0.047897323966026306, 0.05222081393003464, 0.03616907820105553, -0.025925055146217346, 0.06863541901111603, -0.07390205562114716, -0.04763443395495415, -0.02715514414012432, -0.034652773290872574, -0.047031838446855545, -0.00743509829044342, 0.05958079919219017, -0.08408503979444504, 0.012152474373579025, 0.07515303045511246, -0.00326455757021904, 0.03885781019926071, 0.027900414541363716, 0.012386617250740528, 0.0036925789900124073, -0.05590025708079338, -0.024670179933309555, 0.05562223121523857, -0.04156496003270149, 0.0962938591837883, -0.11690454185009003, -5.053500728990912e-08, -0.04685264453291893, 0.011010825634002686, 0.08280787616968155, 0.028601273894309998, 0.0992167517542839, 0.05388703569769859, -0.04933414235711098, 0.08555775135755539, -0.05667261406779289, -0.05041354522109032, 0.08755740523338318, -0.011213075369596481, -0.031507283449172974, 0.02514471299946308, 0.05177195742726326, 0.08639544993638992, -0.006187947001308203, -0.0033394177444279194, 0.03371969610452652, -0.0020340692717581987, 0.14589530229568481, -0.01959446258842945, 0.012571743689477444, -0.03812295198440552, 0.05904415249824524, -0.11095593124628067, -0.025931715965270996, 0.04329218342900276, -0.08093713968992233, 0.05031875893473625, -0.022267654538154602, 0.04610278084874153, 0.012216944247484207, -0.01864304579794407, 0.10956332832574844, 0.10801272839307785, 0.06198091432452202, -0.14441607892513275, -0.06163575127720833, 0.003226153552532196, -0.02890683151781559, 0.0972268208861351, -0.044606152921915054, -0.02637414261698723, 0.047394394874572754, 0.01372511312365532, 0.018130436539649963, -0.059325963258743286, -0.02608039416372776, 0.002950846217572689, 0.0629127025604248, -0.01129190158098936, 0.06565544009208679, 0.048731688410043716, 0.12369009852409363, 0.02230345644056797, 0.03133480250835419, -0.0501444935798645, 0.08683587610721588, 0.06064128503203392, 0.05388331040740013, 0.08575158566236496, 0.044089335948228836, -0.020084703341126442 ] }, { "text": "## What is Machine Learning?\n\nMachine Learning enables computers to learn patterns from data without being explicitly programmed for every scenario. It's the foundation of many modern AI applications, from recommendation systems to autonomous vehicles.\n\n### Key Concepts\n\n- **Training Data**: Historical data used to teach the model\n- **Features**: Input variables used to make predictions\n- **Labels**: The output we want to predict (in supervised learning)\n- **Model**: The mathematical representation of patterns in data", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_1", "embedding": [ -0.032586656510829926, 0.001991639146581292, 0.01200021244585514, 0.01752866618335247, 0.04980077967047691, 0.04319082945585251, 0.00646542850881815, -0.036308709532022476, -0.11098611354827881, 0.0053396159783005714, -0.04816880077123642, 0.06435222178697586, 0.0514657236635685, -0.03350389376282692, -0.015992283821105957, 0.05544406548142433, 0.010075331665575504, -0.02405182085931301, -0.07582138478755951, -0.06620734184980392, 0.06286139786243439, 0.004435332491993904, -0.06449148803949356, 0.03627005219459534, -0.04194805771112442, 0.10826831310987473, 0.023203186690807343, 0.0014640375738963485, -0.011528356932103634, 0.025694556534290314, 0.01478525996208191, -0.012975029647350311, 0.028444984927773476, 0.016790514811873436, -0.05519641935825348, -0.051781315356492996, -0.031185124069452286, 0.018599096685647964, 0.007696251850575209, -0.049355171620845795, -0.009753366000950336, -0.10591479390859604, 0.0016769589856266975, 0.011748718097805977, 0.09417369216680527, 0.1339028924703598, -0.06730660796165466, -0.10101277381181717, -0.05086885020136833, 0.0277091171592474, -0.11986891180276871, -0.02195102907717228, 0.027487196028232574, -0.011123280972242355, -0.05063403397798538, 0.02374195121228695, 0.04211479797959328, 0.05463940277695656, 0.01889127679169178, -0.010923289693892002, -0.00956557784229517, -0.09086603671312332, -0.019362550228834152, 0.008814995177090168, -0.022663593292236328, -0.0493486151099205, -0.04199667274951935, 0.006364132277667522, 0.04767126217484474, -0.05237811058759689, -0.008906037546694279, 0.10993310064077377, 0.03778224438428879, 0.01778353564441204, 0.03059348277747631, -0.01038768794387579, -0.06955847889184952, -0.018974684178829193, 0.04544973000884056, -0.0012361614499241114, -0.04495298117399216, -0.006790899205952883, -0.005053321365267038, 0.0757158100605011, 0.016479292884469032, -0.02871125563979149, -0.029766222462058067, -0.05266055092215538, -0.0096364077180624, -0.007425022777169943, -0.029199279844760895, -0.09028366953134537, 0.00961898174136877, -0.047243017703294754, -0.0025432591792196035, 0.0671326220035553, -0.042192377150058746, -0.12178925424814224, 0.0023136502131819725, -0.007009502965956926, -0.06127410754561424, 0.10460598021745682, -0.014301558025181293, 0.014429380185902119, 0.024530058726668358, -0.019838877022266388, 0.01579430140554905, -0.014040844514966011, 0.11675776541233063, -0.06776513159275055, -0.04573458433151245, 0.0275962445884943, -0.01879284344613552, -0.07256092131137848, -0.013681168667972088, -0.04592638090252876, -0.018422210589051247, 0.019691966474056244, -0.0256298016756773, 0.10419082641601562, -0.06297074258327484, -0.0033730207942426205, 0.017538605257868767, 0.032783832401037216, 0.021745674312114716, -0.0701926127076149, -0.09528186917304993, -6.754818952414441e-34, 0.011031486093997955, -0.09477843344211578, 0.020634884014725685, 0.02042212523519993, 0.057996250689029694, -0.12442484498023987, -0.05250626057386398, -0.02944282256066799, 0.07143180817365646, 0.0561048723757267, -0.022661402821540833, 0.05250031128525734, 0.0021865651942789555, 0.0989687368273735, -0.0076470403000712395, 0.043014850467443466, 0.03716301918029785, -0.011134053580462933, -0.007102454546838999, -0.0255717933177948, 0.06556374579668045, 0.04944806173443794, 0.05665368586778641, -0.01473158411681652, 0.007229238748550415, 0.06092330068349838, 0.004063690081238747, 0.04329352825880051, 0.06927313655614853, 0.031611621379852295, -0.009298629127442837, 0.04530404880642891, -0.07793015986680984, 0.01472174096852541, 0.004920953419059515, 0.05203063413500786, 0.01261614728718996, -0.04833652451634407, 0.03280205279588699, 0.04613164812326431, 0.055536650121212006, -0.049798090010881424, 0.003303162520751357, -0.06545563787221909, -0.06561274826526642, -0.00950461346656084, 0.0637459009885788, -0.06429193168878555, 0.024307051673531532, -0.05994705855846405, -0.04930794984102249, -0.035278331488370895, -0.06152231618762016, -0.06621289998292923, 0.0052442410960793495, 0.08526766300201416, -0.03042747639119625, 0.0035908594727516174, -0.0431377999484539, 0.009230789728462696, 0.032781485468149185, -0.033774375915527344, 0.04868055507540703, 0.04157988727092743, -0.029915107414126396, 0.007694194559007883, 0.03590584918856621, 0.06741959601640701, 0.007656982634216547, 0.04020741954445839, -0.010890155099332333, 0.04994337260723114, -0.025038357824087143, -0.05616417154669762, 0.07662982493638992, 0.016565853729844093, 0.0247961338609457, -0.055040374398231506, -0.03251531347632408, 0.004317413084208965, -0.030970510095357895, -0.01435566321015358, -0.02955201454460621, -0.07887192070484161, 0.01118292473256588, 0.06804380565881729, -0.025625143200159073, -0.07497619837522507, -0.0465024895966053, -0.04944710060954094, -0.06942564249038696, -0.05143655091524124, -0.08486666530370712, 0.021611565724015236, -0.055687833577394485, -4.357405478916582e-33, -0.01724204607307911, 0.05794493108987808, -0.07593952864408493, 0.030787434428930283, -0.0078124296851456165, 0.0010842172196134925, -0.07203911244869232, -0.019580567255616188, -0.02134557254612446, -0.00513441301882267, -0.06833048164844513, 0.009057111106812954, 0.10556082427501678, 0.009956058114767075, -0.07996130734682083, 0.03391701728105545, -0.0801212340593338, -0.03718065470457077, -0.0751570537686348, 0.01284331176429987, -0.04608191177248955, -0.021244728937745094, -0.05665847286581993, -0.02819298766553402, 0.03861847519874573, -0.028419582173228264, -0.035519588738679886, 0.03431382402777672, 0.052225805819034576, 0.056558847427368164, -0.0010482344077900052, -0.028468752279877663, 0.014484192244708538, -0.051998674869537354, -0.012345841154456139, 0.009982882998883724, 0.0595935694873333, -0.0383608378469944, -0.02324664033949375, 0.0318937674164772, 0.042086247354745865, -0.009336674585938454, -0.0310827549546957, -0.07844554632902145, 0.015324748121201992, -0.0248139426112175, -0.06505076587200165, 0.020098064094781876, 0.03469026833772659, -0.07499375194311142, 0.061265598982572556, 0.019316723570227623, -0.05295584723353386, -0.07825198024511337, -0.047899775207042694, 0.08079556375741959, -0.02159435860812664, 0.059647414833307266, 0.021546337753534317, 0.10435966402292252, -0.063494011759758, -0.037250816822052, 0.028342561796307564, 0.04986390471458435, -0.022008400410413742, -0.0012576259905472398, -0.0156669020652771, 0.012257887981832027, -0.012963523156940937, -0.056754786521196365, 0.044577859342098236, 0.049184612929821014, -0.05146777257323265, 0.10422921925783157, -0.041650500148534775, -0.060188643634319305, -0.009809553623199463, -0.05374710261821747, -0.048621825873851776, 0.02415267936885357, 0.07380816340446472, -0.07678085565567017, -0.006314617581665516, 0.06325685232877731, 0.03533695265650749, 0.05951183661818504, 0.025318985804915428, 0.032179877161979675, -0.04104473814368248, -0.052444253116846085, -0.058561962097883224, 0.040462393313646317, -0.09029050171375275, 0.10786253213882446, -0.12474367022514343, -4.5231789869149e-08, -0.024152573198080063, -0.03910009190440178, 0.1050194650888443, 0.004110890906304121, 0.06534994393587112, 0.0609169602394104, 0.01591493748128414, 0.0852869302034378, -0.0818527340888977, 0.0242986548691988, 0.014763711020350456, 0.060849372297525406, -0.055037833750247955, 0.0064529841765761375, 0.03658457472920418, 0.07322845607995987, 0.07263654470443726, -0.010309908539056778, 0.03257664665579796, 0.03324606269598007, 0.08099612593650818, -0.07803422212600708, -0.00206439895555377, -0.023582572117447853, 0.10277651250362396, -0.07791879028081894, 0.003009036649018526, 0.09280101954936981, -0.04322824627161026, 0.07681125402450562, -0.06752578169107437, 0.0034258090890944004, 0.0667741447687149, -0.02321234904229641, 0.029167205095291138, 0.07554305344820023, 0.03987019136548042, -0.10899140685796738, -0.015620176680386066, -0.06000915914773941, -0.03130291402339935, 0.096256323158741, -0.053809937089681625, -0.008175499737262726, -0.005258804652839899, 0.07541465759277344, 0.04694690927863121, -0.048214174807071686, -0.05707941949367523, 0.03208740055561066, 0.006567171774804592, 0.055897586047649384, 0.03582437336444855, 0.10222409665584564, 0.08141393959522247, 0.020894192159175873, 0.020147597417235374, -0.08848708868026733, 0.06077422946691513, -0.01364617608487606, 0.033153388649225235, 0.06892427802085876, 0.05132797732949257, -0.038237281143665314 ] }, { "text": "## Types of Machine Learning\n\n### 1. Supervised Learning\n\nThe algorithm learns from labeled training data, making predictions based on that data.\n\n**Examples:**\n- Classification (spam detection, image recognition)\n- Regression (price prediction, weather forecasting)\n\n```python\n# Simple supervised learning example with sklearn\nfrom sklearn.linear_model import LinearRegression\nimport numpy as np\n\n# Training data\nX = np.array([[1], [2], [3], [4], [5]])\ny = np.array([2, 4, 6, 8, 10])\n\n# Create and train model\nmodel = LinearRegression()\nmodel.fit(X, y)\n\n# Make prediction\nprediction = model.predict([[6]])\nprint(f\"Prediction for 6: {prediction[0]}\") # Output: ~12\n```", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_2", "embedding": [ -0.06961344182491302, -0.0673472061753273, -0.0002745496167335659, 0.03818533569574356, 0.10495015978813171, -0.011534121818840504, 0.0024170144461095333, -0.03418927639722824, -0.10003799200057983, -0.05892554670572281, -0.03796487674117088, 0.024417279288172722, 0.008062158711254597, -0.023450180888175964, -0.05973324179649353, 0.049376823008060455, -0.08916857838630676, -0.029318105429410934, 0.01071616169065237, -0.07837443798780441, 0.04830143600702286, 0.016865696758031845, -0.055086735635995865, 0.07031001150608063, 0.04499225690960884, 0.0048010931350290775, 0.011734801344573498, 0.07926607131958008, -0.09220706671476364, 0.0052404096350073814, 0.014317452907562256, -0.023662570863962173, -0.008236335590481758, 0.06548885256052017, -0.05681385099887848, -0.002112241927534342, -0.05014011636376381, 0.04460896924138069, 0.022544626146554947, 0.015637680888175964, 0.02883962169289589, -0.04745562747120857, 0.005639774724841118, -0.03316657617688179, 0.09709568321704865, 0.039618004113435745, -0.021338624879717827, -0.0620897002518177, 0.010395119898021221, -0.007381507661193609, -0.07996995002031326, -0.04207058250904083, -0.003800459671765566, -0.022613659501075745, -0.05783695727586746, -0.0585266537964344, 0.018018268048763275, -0.0252991933375597, 0.09142030030488968, -0.019133251160383224, -0.0027152516413480043, -0.05568188056349754, -0.04251830652356148, -0.011188751086592674, 0.022792143747210503, -0.035387780517339706, -0.03983447328209877, 0.042550116777420044, -0.05734575539827347, 0.01007496751844883, 0.02733662538230419, 0.11445905268192291, -0.0224890299141407, -0.007935620844364166, 0.004523453302681446, -0.09748106449842453, 0.11846449226140976, 0.020906120538711548, 0.05911939963698387, 0.031825583428144455, -0.05314495787024498, 0.046437036246061325, 0.016589561477303505, 0.016220182180404663, -0.01553420815616846, -0.07376182079315186, 0.04036324843764305, 0.00875609740614891, 0.028565332293510437, 0.0030541636515408754, 0.030258184298872948, -0.01961117424070835, -0.07915560901165009, -0.04148697108030319, -0.06550010293722153, 0.08058544993400574, -0.01709892973303795, -0.09073115140199661, 0.028924979269504547, 0.06802010536193848, 0.022098049521446228, -0.006902602966874838, 0.01716150902211666, -0.019852882251143456, 0.0986110121011734, 0.03333621472120285, 0.006733798421919346, 0.017839744687080383, 0.051728181540966034, -0.05363348498940468, -0.0474262498319149, -0.01082397811114788, -0.046662405133247375, 0.0039405194111168385, 0.05891326814889908, 0.021910646930336952, -0.02424594573676586, 0.006219538860023022, -0.06942327320575714, 0.06311184912919998, -0.02464359439909458, 0.04437951371073723, 0.04507560282945633, 0.02077050879597664, -0.026717133820056915, -0.04220995306968689, -0.07439140230417252, 7.142650446429711e-33, -0.06691575050354004, -0.06790047883987427, 0.04550459235906601, -0.047507792711257935, 0.025981012731790543, -0.05034732446074486, -0.028962843120098114, -0.013772021047770977, -0.0012238497147336602, 0.06129928678274155, -0.051405053585767746, 0.007155552040785551, -0.015611485578119755, 0.091312937438488, 0.01627872698009014, 0.0053266254253685474, 0.03765119984745979, 0.002056388882920146, 0.056149158626794815, -0.02871164120733738, -0.011901689693331718, -0.028310345485806465, 0.06892184168100357, -0.05418401584029198, -0.046965546905994415, -0.03362321853637695, 0.023815657943487167, 0.02462438866496086, -0.03700947389006615, -0.0005842825630679727, -0.017496949061751366, 0.08517859876155853, 0.0472320131957531, -0.02090848982334137, 0.041159357875585556, -0.05704667046666145, 0.006376688834279776, 0.023394927382469177, 0.004088772460818291, -0.04910340532660484, 0.034093793481588364, 0.03934887796640396, 0.007260039448738098, -0.07439500093460083, 0.016882477328181267, 0.06378065049648285, -0.012921716086566448, 0.036150261759757996, 0.029514145106077194, 0.06519904732704163, -0.03961379826068878, -0.10461976379156113, -0.03937029838562012, 0.05232265964150429, -0.06056042015552521, 0.07778844237327576, 0.0007463448564521968, -0.007297383155673742, 0.020337197929620743, -0.06090990826487541, 0.05104970186948776, -0.041317202150821686, 0.10602454841136932, -0.06372653692960739, -0.0009021267760545015, 0.0006053349934518337, 0.07807512581348419, 0.06406636536121368, 0.03578459098935127, 0.04917079955339432, -0.018720967695116997, 0.05835210904479027, -0.0393124558031559, -0.002077712444588542, 0.07312516123056412, -0.06081044301390648, 0.005497961305081844, -0.05968672037124634, -0.04039193317294121, 0.0032829358242452145, 0.007026590406894684, 0.023205451667308807, 0.03775956109166145, -0.06535923480987549, -0.059204958379268646, -0.041864704340696335, 0.006817021872848272, -0.03477485477924347, -0.0382380411028862, -0.019081054255366325, -0.16618481278419495, 0.018601927906274796, -0.06600118428468704, 0.0331527404487133, 0.012865997850894928, -8.988072986781037e-33, 0.01953168585896492, 0.10579250007867813, 0.018265994265675545, -0.03690816089510918, -0.04386134073138237, 0.02323390357196331, -0.05088449642062187, 0.04360713064670563, -0.011558321304619312, 0.016903476789593697, -0.033441659063100815, -0.055674631148576736, 0.040056705474853516, 0.0327313095331192, 0.036729831248521805, 0.004283703397959471, -0.06624452769756317, -0.0032338984310626984, -0.019297441467642784, 0.040225550532341, -0.09528546780347824, 0.0910763368010521, -0.11420963704586029, 0.06451722234487534, -0.07384910434484482, 0.0013766409829258919, 0.006639664527028799, 0.08987845480442047, 0.003390347585082054, -0.028060296550393105, -0.0607699416577816, 0.0264839269220829, -0.028516948223114014, 0.027124492451548576, 0.01788526400923729, 0.04416786506772041, 0.058849383145570755, -0.052277568727731705, 0.0001450068230042234, 0.026735402643680573, 0.0885409340262413, 0.09598714858293533, -0.06244751065969467, -0.08136794716119766, 0.011288126930594444, -0.021114595234394073, -0.025859760120511055, 0.03210960328578949, 0.014163498766720295, -0.011486943811178207, -0.026837054640054703, 0.03423294797539711, -0.12713409960269928, 0.029178233817219734, -0.09425657987594604, -0.04158635437488556, -0.047856274992227554, -0.02466473914682865, 0.01284391526132822, 0.017951376736164093, -0.09679117798805237, -0.06384715437889099, -0.020583054050803185, 0.016665160655975342, 0.004276426509022713, -0.04145738109946251, -0.05527718737721443, 0.02610040456056595, 0.004792866762727499, 0.012329346500337124, -0.0001275920803891495, 0.08143350481987, 0.021280938759446144, -0.012390329502522945, -0.08741511404514313, -0.061391811817884445, -0.050724297761917114, -0.028720317408442497, -0.039412591606378555, 0.09092187136411667, 0.049497708678245544, -0.005925880745053291, 0.02023155800998211, 0.1224929690361023, -0.017928194254636765, 0.034361984580755234, 0.12330807745456696, 0.04633283242583275, 0.021985340863466263, -0.11698023974895477, 0.03595849126577377, 0.04517252743244171, -0.01451870333403349, 0.09370270371437073, -0.04274912551045418, -5.876358244449875e-08, -0.016638705506920815, -0.05141768231987953, 0.06929861009120941, 0.0411946140229702, -0.027715150266885757, 0.032836269587278366, 0.03243281692266464, 0.06468716263771057, -0.030906034633517265, -0.005785632878541946, 0.010528667829930782, 0.0009602861246094108, -0.08172081410884857, 0.041060302406549454, -0.025315942242741585, 0.06509066373109818, -0.008646568283438683, 0.017389852553606033, 0.011787403374910355, 0.023573921993374825, 0.04153873771429062, -0.09141292423009872, 0.024124765768647194, 0.011615162715315819, 0.1007770225405693, -0.12541046738624573, -0.0426492765545845, 0.11704593151807785, -0.014798046089708805, 0.10163997113704681, -0.015925759449601173, -0.0075680771842598915, 0.04236013442277908, -0.03469911217689514, 0.0581405945122242, 0.10303924232721329, 0.011392508633434772, -0.08138377964496613, 0.030173059552907944, 0.009959845803678036, -0.10156228393316269, 0.08607999980449677, -0.11513795703649521, -0.05726345255970955, 0.05417235568165779, 0.002032930962741375, 0.031969550997018814, -0.11101255565881729, 0.045702140778303146, 0.01195319090038538, 0.04317781701683998, -0.011043940670788288, 0.053475406020879745, 0.031034179031848907, 0.09753160178661346, -0.06422049552202225, -0.053162045776844025, -0.04520399495959282, 0.00840961467474699, 0.03607214242219925, 0.008319823071360588, -0.021049799397587776, -0.006976954638957977, -0.0004766382335219532 ] }, { "text": "### 2. Unsupervised Learning\n\nThe algorithm finds patterns in unlabeled data.\n\n**Examples:**\n- Clustering (customer segmentation)\n- Dimensionality reduction (data compression)\n- Anomaly detection\n\n### 3. Reinforcement Learning\n\nThe algorithm learns through trial and error, receiving rewards or penalties.\n\n**Examples:**\n- Game playing (AlphaGo, Chess engines)\n- Robotics\n- Resource optimization", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_3", "embedding": [ -0.07465828210115433, -0.02420581318438053, -0.06316237151622772, 0.014341950416564941, 0.06087123975157738, -0.012417260557413101, 0.023170148953795433, -0.0877189114689827, -0.08134517073631287, 0.012108400464057922, -0.07451178878545761, 0.01493250485509634, 0.027237005531787872, -0.001352806924842298, -0.053976867347955704, -0.030612627044320107, 0.09081417322158813, 0.05325005576014519, -0.040671225637197495, -0.10948987305164337, 0.024410869926214218, -0.03889409825205803, 0.009404825046658516, 0.03425438702106476, 0.05865706875920296, 0.06856849044561386, 0.03284545987844467, -0.012516260147094727, 0.05039341002702713, -0.04459020122885704, 0.07017569243907928, 0.0012530790409073234, 0.10459014773368835, 0.006582439877092838, -0.06166727840900421, 0.07098273187875748, -0.08427176624536514, -0.025445230305194855, -0.06162573769688606, 0.038368139415979385, -0.008308345451951027, -0.033477433025836945, -0.03961259499192238, 0.011999237351119518, 0.08986739814281464, 0.03277282044291496, -0.11284030228853226, -0.03809322416782379, -0.08656048029661179, -0.03484029695391655, -0.0735708698630333, -0.0738828107714653, -0.01927395723760128, 0.0850134938955307, -0.024743717163801193, 0.004810453858226538, 0.022779766470193863, 0.018634265288710594, 0.06421002000570297, -0.0403670072555542, 0.028175747022032738, -0.09077125042676926, -0.018793605268001556, 0.03761725500226021, -0.030868494883179665, -0.016979504376649857, -0.016534635797142982, 0.011394212022423744, 0.024310503154993057, -0.04965285211801529, 0.05874846503138542, 0.08387434482574463, -0.015911681577563286, 0.027826493605971336, 0.03323680907487869, 0.02235867641866207, 0.03477101027965546, -0.017631124705076218, 0.038596563041210175, -0.022084105759859085, -0.026041559875011444, -0.029827579855918884, -0.02962297759950161, 0.04481440782546997, 0.049197833985090256, -0.035926029086112976, -0.06771495193243027, -0.03735173121094704, 0.03665970638394356, 0.02381499856710434, -0.0032641952857375145, 0.05175359174609184, 0.0004458202456589788, -0.08500785380601883, -0.041509535163640976, -0.01996087096631527, -0.061836306005716324, -0.08676953613758087, 0.01583211123943329, 0.036696821451187134, -0.04394255205988884, 0.1267443299293518, -0.001183331711217761, 0.025032687932252884, -0.010679147206246853, -0.0018018034752458334, 0.018283359706401825, -0.007469341158866882, 0.10088423639535904, -0.007417246233671904, -0.07487005740404129, 0.01610400155186653, -0.03481372073292732, -0.020431237295269966, -0.0028302937280386686, 0.006546983495354652, 0.04530298337340355, -0.0006995906587690115, -0.05299566313624382, 0.1077471524477005, 0.005732059013098478, -0.05086382478475571, 0.009103379212319851, 0.03214196860790253, -0.02097289450466633, -0.012451610527932644, -0.11303820461034775, 2.53340209867617e-33, -0.02911200560629368, -0.0809544026851654, -0.02887752279639244, -0.07959987223148346, 0.01927943341434002, -0.03340302035212517, -0.019741322845220566, -0.04485625401139259, 0.06692378968000412, 0.04805794730782509, 0.026918670162558556, 0.14134082198143005, 0.00808878242969513, 0.16367731988430023, 0.12046703696250916, -0.04942125082015991, 0.05539563670754433, 0.05525067076086998, -0.021520374342799187, -0.044454239308834076, 0.08656978607177734, 0.07298247516155243, 0.02564757503569126, -0.024996435269713402, -0.030311545357108116, 0.031389202922582626, -0.049381326884031296, -0.06283346563577652, 0.10043156147003174, 0.021183282136917114, 0.0055178324691951275, 0.044330913573503494, -0.11611882597208023, 0.08600594103336334, 0.05464284494519234, 0.07543391734361649, -0.05230383947491646, -0.012519950047135353, 0.02935771457850933, 0.014643868431448936, -0.014767461456358433, -0.09069029241800308, 0.05951892212033272, -0.0977131724357605, -0.021251872181892395, -0.05777004361152649, 0.05558877810835838, -0.08537227660417557, 0.015142643824219704, -0.0574641078710556, 0.02215605229139328, -0.02456543780863285, 0.020945485681295395, -0.05852164328098297, -0.0024510659277439117, 0.10216477513313293, 0.044984519481658936, 0.0035484216641634703, -0.03831934183835983, -0.0034992052242159843, 0.018723778426647186, -0.032300084829330444, 0.03536803275346756, -0.005967084784060717, -0.03699817508459091, 0.012250620871782303, -0.005523905623704195, 0.004905852489173412, 0.03927474468946457, 0.05201250687241554, 0.007652136497199535, 0.11165489256381989, -0.004757217597216368, 0.03076919913291931, 0.006955510005354881, -0.01246462669223547, -0.00045945768943056464, -0.0027967302594333887, -0.06944107264280319, -0.031827062368392944, -0.07132808864116669, -0.02971033565700054, -0.0025226338766515255, -0.021686529740691185, -0.03430255874991417, 0.03821898251771927, 0.009394194930791855, -0.04325048252940178, -0.023385360836982727, -0.007227583788335323, -0.05663587152957916, -0.012579295784235, -0.09578876942396164, 0.059248968958854675, 0.03791235759854317, -4.781116825774291e-33, -0.052637405693531036, 0.01244139764457941, -0.07460755854845047, 0.02706090547144413, -0.04148693010210991, 0.00012492534006014466, -0.04902246221899986, 0.016695408150553703, 0.023331932723522186, -0.028031691908836365, -0.07853438705205917, 0.0436277836561203, 0.03798322007060051, -0.008956012316048145, -0.05374212563037872, -0.007866118103265762, -0.01967824250459671, 0.009066317230463028, 0.006418572273105383, 0.05779462680220604, -0.0032356802839785814, 0.04547087848186493, -0.11715137958526611, -0.04322338476777077, 0.06671759486198425, -0.008740659803152084, -0.021711546927690506, 0.008456893265247345, 0.03186129033565521, 0.08739718794822693, 0.0028833874966949224, 0.005404949653893709, -0.024288352578878403, -0.010754001326858997, -0.04186483472585678, 0.05556996166706085, 0.04975317046046257, -0.028874902054667473, -0.0035789338871836662, -0.0011114708613604307, 0.022028502076864243, 0.027900617569684982, -0.01614006608724594, 0.004824745003134012, 0.060602571815252304, -0.022958964109420776, -0.054418306797742844, 0.035974375903606415, -0.011730506084859371, 0.028330590575933456, -0.018875468522310257, 0.033856041729450226, -0.022309672087430954, -0.004594896920025349, -0.047398973256349564, 0.060686200857162476, -0.030269717797636986, 0.01275508850812912, 0.05577642470598221, -0.0002771852305158973, -0.012113797478377819, 0.004977811593562365, -0.05130874738097191, 0.05587342008948326, -0.03921859711408615, -0.059530653059482574, 0.005651454441249371, 0.0011340486817061901, -0.021074192598462105, -0.05365530773997307, 0.012312224134802818, 0.09272478520870209, -0.016091078519821167, 0.03701986372470856, -0.062004826962947845, -0.001705917646177113, -0.01993297040462494, -0.000623948173597455, 0.004184084478765726, -0.06782542914152145, 0.04705449193716049, -0.013838006183505058, -0.016122736036777496, 0.08685982972383499, -0.013173348270356655, 0.07568501681089401, 0.049170710146427155, -0.015986062586307526, -0.039157748222351074, -0.09799090027809143, 0.0060364846140146255, -0.0048668100498616695, 0.0064977617003023624, 0.04836989939212799, -0.04869796708226204, -4.19488195291251e-08, -0.05793485417962074, -0.1017836332321167, 0.12155020982027054, -0.05133458599448204, 0.11570130288600922, -0.03260178864002228, -0.02085849829018116, 0.06663557887077332, -0.06927526742219925, -0.04168485477566719, -0.005989380180835724, 0.03387114778161049, -0.054370589554309845, -0.017374632880091667, 0.03123699501156807, 0.05814061313867569, 0.12866392731666565, 0.04596569016575813, 0.0002141474833479151, 0.04456953704357147, 0.02138173207640648, -0.04699094593524933, -0.025802895426750183, -0.033890727907419205, 0.01809588074684143, -0.09714774787425995, -0.015131942927837372, 0.008928750641644001, 0.025849778205156326, 0.01733778789639473, -0.016567396000027657, 0.00200843159109354, 0.10420731455087662, -0.03972496837377548, 0.060881614685058594, 0.15810157358646393, 0.013088409788906574, -0.09613018482923508, -0.08656977117061615, -0.09507042169570923, 0.0029018002096563578, 0.10807600617408752, 0.011854857206344604, -0.05728171765804291, 0.0072577218525111675, 0.047993261367082596, -0.007043652702122927, -0.10850458592176437, 0.035790830850601196, -0.015150852501392365, 0.03615335002541542, 0.019875379279255867, -0.0300445593893528, -0.0009009952191263437, 0.06946110725402832, 0.051909640431404114, 0.015938514843583107, -0.08969829976558685, 0.07552988827228546, 0.03958091884851456, 0.06298734247684479, 0.017162151634693146, -0.031912945210933685, -0.007577215321362019 ] }, { "text": "## Common Algorithms\n\n### Linear Regression\nPredicts continuous values based on linear relationships.\n\n### Logistic Regression\nClassification algorithm for binary outcomes.\n\n### Decision Trees\nTree-like model for classification and regression.\n\n### Neural Networks\nInspired by biological neurons, forms the basis of deep learning.\n\n### Support Vector Machines (SVM)\nFinds optimal boundaries between classes.\n\n### K-Means Clustering\nGroups similar data points together.", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_4", "embedding": [ -0.02975715696811676, -0.07618122547864914, 0.007790903560817242, 0.008485580794513226, 0.036148976534605026, 0.003548180218786001, -0.02562520280480385, -0.0168191846460104, -0.0687200129032135, -0.00022706040181219578, -0.027278685942292213, 0.04019730165600777, -0.01527440920472145, 0.02804265357553959, -0.06508756428956985, 0.02549186907708645, -0.035936448723077774, 0.03462790697813034, -0.08478723466396332, 0.004790295381098986, 0.07992658019065857, 0.04495124891400337, -0.036330122500658035, 0.022084331139922142, -0.016406986862421036, 0.043218571692705154, 0.02665810100734234, -0.009596479125320911, -0.04703985154628754, 0.005268817767500877, -0.01725142076611519, -0.01348090823739767, 0.08583809435367584, 0.05385199561715126, -0.10400519520044327, 0.005876594688743353, -0.03435844928026199, 0.027637463063001633, -0.04587990790605545, 0.04884268715977669, -0.051909346133470535, -0.0780448317527771, 0.06219243258237839, 0.053265221416950226, 0.10625961422920227, 0.14007915556430817, -0.09543977677822113, -0.07764830440282822, -0.09765826165676117, 0.010280890390276909, -0.05727511644363403, -0.029930803924798965, 0.028563711792230606, 0.047174885869026184, -0.02142770029604435, -0.07563614845275879, 0.018142981454730034, -0.018175318837165833, 0.03267310932278633, 0.015305486507713795, 0.09293978661298752, -0.031033765524625778, -0.009315093979239464, -0.008826661854982376, -0.014800631441175938, 0.05549866333603859, -0.04199739545583725, 0.06950431317090988, 0.01721476949751377, -0.00521848164498806, 0.024547981098294258, 0.05405779555439949, -0.07275644689798355, 0.017026254907250404, 0.015236524865031242, 0.046267375349998474, 0.07953145354986191, 0.03787523880600929, 0.009722250513732433, -0.04470108821988106, -0.060628704726696014, 0.06655619293451309, 0.007073246408253908, 0.02001076750457287, 0.09463884681463242, 0.006142512429505587, -0.02389644645154476, 0.019516507163643837, -0.08401352912187576, -0.02521355450153351, -0.018565377220511436, -0.02862536534667015, 0.008996461518108845, -0.03460722044110298, -0.0907169058918953, -0.015902940183877945, -0.004760071635246277, -0.11360041797161102, 0.022222165018320084, 0.031214764341711998, -0.05630357563495636, 0.0010285135358572006, 0.03967688977718353, -0.01434347778558731, 0.02249150164425373, -0.005360597278922796, 0.06061244383454323, 0.021249398589134216, 0.1521468311548233, -0.05783702805638313, -0.04549562186002731, 0.014805152080953121, -0.1159115582704544, 0.0004423004575073719, 0.06229813024401665, -0.07989562302827835, 0.01705039106309414, -0.06753981113433838, -0.005891549866646528, 0.017188463360071182, -0.07129901647567749, -0.009821398183703423, -0.028127219527959824, -0.05457631126046181, 0.03190643712878227, -0.03698493540287018, -0.17064177989959717, 5.588016555797019e-33, -0.036668792366981506, -0.060442592948675156, -0.0019247476011514664, -0.0006490265368483961, 0.0787251815199852, -0.0815996378660202, -0.03460177779197693, -0.0035007379483431578, 0.053620703518390656, 0.010387853719294071, -0.10273102670907974, 0.07786022126674652, 0.013677570968866348, 0.18410320580005646, 0.03437907621264458, -0.02464054524898529, 0.04526112973690033, 0.019267765805125237, -0.004854464437812567, -0.04585247486829758, 0.020122075453400612, -0.001877099392004311, 0.04518229514360428, -0.05809380114078522, -0.03416449949145317, 0.05989367142319679, -0.03260672464966774, -0.0026102191768586636, 0.0007855393923819065, 0.00873174425214529, -0.0001774243573890999, 0.07087273895740509, -0.05257360637187958, -0.05590760335326195, 0.03588774800300598, 0.03733919560909271, 0.004503010772168636, 0.026307493448257446, 0.02149384841322899, -0.05217328667640686, -0.03622233495116234, -0.035976313054561615, -0.029745161533355713, -0.02490803226828575, 0.028573324903845787, 0.03588342294096947, 0.00129983713850379, -0.03888111189007759, 0.06643077731132507, -0.020548049360513687, -0.042317409068346024, -0.003911780193448067, -0.042333461344242096, -0.03212777152657509, 0.03326357528567314, 0.08141140639781952, -0.0355396531522274, 0.006447711493819952, -0.01806231215596199, -0.0007168177980929613, 0.04375112056732178, -0.011331386864185333, -0.010042453184723854, -0.10230781883001328, -0.04092280566692352, -0.011868178844451904, 0.04116629809141159, -0.013166352175176144, 0.050036195665597916, 0.04142574220895767, -0.03057282418012619, 0.08668656647205353, -0.01155116781592369, -0.02662242203950882, -0.06493713706731796, 0.06847886741161346, -0.002398089272901416, -0.04521690681576729, -0.05967465788125992, 0.04062684252858162, -0.01804421842098236, 0.013717325404286385, -0.01976112648844719, -0.11384239047765732, 0.02415100298821926, 0.02361910045146942, -0.013023052364587784, -0.07809913903474808, -0.059722334146499634, -0.005715527571737766, -0.10088873654603958, 0.032250598073005676, 0.0049880496226251125, 0.02732279896736145, -0.01601589098572731, -7.10202830040117e-33, -0.06282953172922134, 0.07948728650808334, -0.07581102848052979, 0.031446464359760284, 0.011179633438587189, 0.025672547519207, -0.0968911200761795, -0.08900310844182968, -0.01392369531095028, 0.015955140814185143, 0.054775528609752655, 0.02852504514157772, 0.029377499595284462, 0.08263807743787766, -0.027316508814692497, -0.024263031780719757, -0.08889199048280716, -0.03702477738261223, -0.021515127271413803, 0.012190278619527817, 0.03632339462637901, 0.05014543607831001, -0.10009175539016724, -0.022461025044322014, -0.004270143806934357, -0.038346126675605774, -0.05667731165885925, 0.07787057012319565, 0.039153534919023514, 0.013273217715322971, 0.011475186794996262, -0.07099169492721558, -0.032871656119823456, -0.039230022579431534, 0.03457191586494446, 0.03529571369290352, 0.0006746504222974181, -0.08461689203977585, 0.027274666354060173, 0.004776766989380121, 0.07390587776899338, 0.011046361178159714, -0.016246668994426727, -0.0748671218752861, -0.028007052838802338, -0.0101134879514575, 0.052146490663290024, 0.014347836375236511, 0.013858129270374775, -0.00467414315789938, 0.05666310340166092, -0.0025533554144203663, -0.03101806901395321, -0.01797567494213581, 0.009361602365970612, 0.012980274856090546, -0.02756338380277157, 0.009639916941523552, 0.04367677494883537, 0.008659085258841515, -0.07022816687822342, -0.03453409671783447, 0.04839722812175751, 0.07973167300224304, -0.02727651037275791, -0.09492051601409912, -0.05815014988183975, 0.03148077428340912, -0.04258047789335251, -0.02103199064731598, -0.017778290435671806, 0.01895200088620186, 0.027178915217518806, 0.1196102574467659, -0.074034683406353, -0.10388313978910446, -0.0521816685795784, -0.04556228220462799, -0.024995004758238792, 0.007002809550613165, 0.09165257215499878, -0.025378119200468063, 0.0021468696650117636, 0.09763830155134201, 0.038684021681547165, 0.07806198298931122, 0.03734976053237915, 0.023023882880806923, 0.056084904819726944, -0.07330290228128433, -0.04094010964035988, 0.06420069187879562, -0.06767317652702332, 0.06502853333950043, -0.06684419512748718, -4.1292771868484124e-08, -0.050698164850473404, -0.04913940653204918, 0.05278678610920906, 0.01018870435655117, 0.05939765274524689, 0.005624434445053339, 0.04242560639977455, 0.08357097953557968, -0.07568027824163437, 0.04509330913424492, 0.02925308607518673, 0.07459256798028946, -0.07795614749193192, 0.013348275795578957, 0.018391398712992668, -0.003391051199287176, -0.015522325411438942, 0.05348151922225952, 0.06919701397418976, 0.033389296382665634, 3.068677688133903e-05, -0.05223286151885986, -0.04787234589457512, 0.03448030725121498, 0.12732098996639252, -0.1207188293337822, -0.00548265315592289, 0.06862804293632507, -0.060117170214653015, 0.07627949863672256, 0.017160486429929733, 0.057807087898254395, 0.008218804374337196, -0.0173095241189003, 0.04492455720901489, 0.1251978576183319, -0.021441536024212837, -0.021058309823274612, -0.04399837180972099, -0.02948528714478016, -0.026758292689919472, 0.06932108849287033, -0.02683972753584385, 0.01409950666129589, 0.00259938882663846, 0.044775594025850296, 0.05998455360531807, -0.056081514805555344, -0.03783781826496124, 0.0017028196016326547, 0.011867858469486237, 0.04024296998977661, 0.017707746475934982, 0.04684193804860115, 0.02574249543249607, 0.029210498556494713, -0.0017544410657137632, -0.086470827460289, 0.07221689820289612, 0.024714134633541107, -0.0018670312128961086, 0.016962386667728424, 0.08011532574892044, -0.005729130003601313 ] }, { "text": "## The ML Workflow\n\n1. **Problem Definition**: What are we trying to predict or understand?\n2. **Data Collection**: Gather relevant data\n3. **Data Preprocessing**: Clean and prepare data\n4. **Feature Engineering**: Create meaningful features\n5. **Model Selection**: Choose appropriate algorithm\n6. **Training**: Teach the model with training data\n7. **Evaluation**: Test model performance\n8. **Deployment**: Use the model in production\n9. **Monitoring**: Track performance over time", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_5", "embedding": [ -0.05025169253349304, -0.007931176573038101, 0.03411067649722099, 0.015373739413917065, 0.031778864562511444, -0.06408320367336273, -0.053274936974048615, -0.005338530521839857, -0.1315934807062149, -0.04035528749227524, -0.04415826126933098, -0.06438712775707245, 0.008131704293191433, -0.08238298445940018, -0.051768649369478226, 0.09381809085607529, 0.03346142917871475, -0.03234351798892021, -0.0809122771024704, -0.06969378888607025, 0.04547487199306488, 0.014000825583934784, -0.024840617552399635, 0.07772713899612427, -0.05558764189481735, 0.04019300639629364, 0.018039248883724213, 0.03188701719045639, 0.0029714307747781277, -0.016198638826608658, -0.02451477013528347, 0.0063664778135716915, 0.06579741835594177, 0.04959943890571594, -0.00355353276245296, 0.018401408568024635, 0.004705964121967554, -0.020471544936299324, 0.01539507508277893, 0.00665473286062479, -0.03158484771847725, -0.11290252953767776, -0.01197840180248022, -0.042417123913764954, 0.05021484196186066, -0.02411298267543316, 0.0081064747646451, -0.08965309709310532, -0.02279066853225231, -0.015234497375786304, -0.12011316418647766, -0.09968812018632889, -0.050061874091625214, -0.04168160259723663, -0.038747623562812805, -0.03513966128230095, 0.06849348545074463, -0.06225645914673805, 0.0412350669503212, -0.06333641707897186, 0.0015703069511801004, -0.05298778787255287, -0.079958975315094, 0.018369877710938454, -0.02037908136844635, -0.10258852690458298, -0.031190192326903343, 0.01500372588634491, 0.007640503346920013, 0.009818635880947113, -0.016765369102358818, 0.11446908861398697, -0.07585441321134567, -0.007694629952311516, -0.04419287294149399, 0.07077652961015701, 0.0794064924120903, -0.009030609391629696, 0.05833657085895538, -0.061885908246040344, -0.04072513431310654, 0.037209704518318176, -0.010359600186347961, 0.030245253816246986, 0.02367381751537323, -0.03206928074359894, 0.0061762211844325066, 0.03047103062272072, 0.017177989706397057, 0.0029818289913237095, 0.01920882798731327, -0.035800717771053314, -0.006584441754966974, -0.02948601543903351, 0.014809305779635906, 0.12077855318784714, 0.012755844742059708, -0.11906326562166214, -0.011610545217990875, 0.021051643416285515, -0.029414856806397438, 0.10126545280218124, 0.058104850351810455, -0.03183911740779877, -0.04909651353955269, -0.029358532279729843, 0.044021811336278915, 0.08363077044487, 0.009201143868267536, -0.08260376006364822, 0.05714385583996773, -0.008483810350298882, -0.05194070190191269, -0.04415925219655037, 0.038906294852495193, -0.006156419403851032, -0.06726252287626266, -0.024225536733865738, -0.12683559954166412, 0.12973973155021667, -0.03837801143527031, 0.010783807374536991, -0.001688186195679009, -0.0016107746632769704, -0.004028810653835535, -0.0077094510197639465, -0.08460817486047745, 2.1797259705564834e-33, 0.009257802739739418, -0.023863891139626503, -0.035506103187799454, 0.08795555680990219, 0.05362839251756668, -0.02804318070411682, -0.02119523100554943, -0.0001937016349984333, 0.06022778898477554, -0.006126271095126867, -0.006013455335050821, -0.03954991325736046, -0.0780467540025711, 0.026801075786352158, 0.029497502371668816, -0.06399445980787277, -0.026499725878238678, 0.09578485786914825, -0.023430000990629196, 0.07055675983428955, 0.10416162759065628, -0.11072584241628647, -0.018940409645438194, -0.0392267219722271, 0.045563600957393646, 0.06282182037830353, 0.045645833015441895, 0.008987090550363064, -0.02479715459048748, 0.04321030527353287, -0.03345439210534096, 0.011346470564603806, -0.031964752823114395, 0.05556677654385567, -0.03195097669959068, 0.03582475706934929, 0.00349866459146142, -0.04848775640130043, 0.11699463427066803, 0.03955798223614693, -0.02796032279729843, -0.009216966107487679, -0.020752327516674995, -0.03790099546313286, 0.022585049271583557, 0.04610361531376839, -0.003896559588611126, -0.03427968546748161, 0.012503747828304768, 0.01857202872633934, 0.028078338131308556, -0.057137589901685715, 0.01002836786210537, -0.05303538963198662, -0.012856924906373024, 0.034735266119241714, 0.021381748840212822, -0.07667431980371475, -0.009191812947392464, 0.09094079583883286, -0.05988464504480362, -0.014987308531999588, -0.0455315001308918, 0.013662604615092278, 0.0063438452780246735, -0.05300584435462952, 0.05082671344280243, 0.05715949833393097, 0.08156074583530426, -0.05726300925016403, -0.049442991614341736, -0.029659967869520187, 0.018422452732920647, -0.030754132196307182, 0.03432958945631981, -0.05681990832090378, 0.05250902846455574, -0.0012200891505926847, 0.010781055316329002, -0.004430614411830902, -0.026349861174821854, 0.08222518861293793, -0.02055438980460167, -0.0838480070233345, 0.06189538165926933, -0.03621814399957657, -0.01671791449189186, 0.014151930809020996, -0.11656295508146286, -0.01952790468931198, -0.05090184509754181, 0.04351170361042023, -0.016774315387010574, 0.032617878168821335, -0.001584353158250451, -5.610171685574142e-33, -0.008880211040377617, 0.08297339081764221, 0.004453195258975029, 0.02984454296529293, 0.019492169842123985, -0.050239406526088715, -0.04319224879145622, -0.014246679842472076, 0.022895649075508118, 0.009580218233168125, -0.01643463596701622, -0.05991556495428085, -0.040238622575998306, -0.030956324189901352, -0.09529662132263184, -0.041735973209142685, -0.007650742772966623, -0.08899975568056107, 0.008561070077121258, 0.06665842980146408, -0.05992572382092476, 0.05275851488113403, -0.11513976007699966, 0.02896815352141857, -0.04315480962395668, -0.0026735118590295315, -0.018457628786563873, 0.01308664120733738, 0.03328609839081764, -0.0003994798462372273, 0.004278872162103653, -0.051436081528663635, 0.020593732595443726, 0.00017813504382502288, 0.0032776028383523226, -0.014708532951772213, 0.0687788724899292, -0.029783662408590317, 0.09168431907892227, 0.11514685302972794, 0.12472529709339142, 0.014802060090005398, -0.07627609372138977, -0.03135600686073303, -0.048080213367938995, 0.00683572655543685, 0.05925523489713669, 0.01050622295588255, 0.02059781923890114, -0.03963516280055046, 0.004824599716812372, -0.037173520773649216, -0.05519026890397072, -0.015582872554659843, -0.06322646886110306, 0.04593890905380249, 0.09407106041908264, -0.07438786327838898, -0.02857370860874653, 0.06802479922771454, -0.04241657257080078, 0.0208660326898098, 0.09208162128925323, 0.03378352150321007, -0.00940082035958767, 0.007933656685054302, 0.010494939051568508, 0.03896751627326012, -0.07274223864078522, 0.011312184855341911, -0.07747860997915268, 0.01416721474379301, -0.04609422758221626, 0.028096947818994522, -0.011075850576162338, -0.08948985487222672, -0.062323588877916336, -0.06286181509494781, 0.04385964199900627, 0.021405089646577835, -0.07692602276802063, -0.03392647206783295, -0.010314853861927986, 0.021093744784593582, 0.0336318165063858, 0.023209894075989723, 0.07231251895427704, 0.03563231602311134, 0.017408547922968864, -0.07024301588535309, -0.10192126780748367, -0.017397355288267136, -0.017046751454472542, 0.04327370226383209, 0.011560020968317986, -5.935246250032833e-08, -0.063374824821949, -0.006964315194636583, 0.09494994580745697, 0.058066677302122116, 0.03685886785387993, 0.02005724422633648, -0.02849298156797886, 0.09078270941972733, 0.050681423395872116, 0.013383524492383003, 0.03324461355805397, 0.0005320354248397052, -0.08747973293066025, 0.048158057034015656, 0.10063160955905914, 0.012210486456751823, -0.028358392417430878, 0.08622432500123978, -0.05646858364343643, -0.05646349489688873, 0.10087840259075165, -0.0538317933678627, 0.04847831651568413, -0.03618011251091957, 0.08827021718025208, -0.12633095681667328, 0.00248676142655313, 0.08840463310480118, -0.002588089555501938, 0.021218793466687202, -0.03504995256662369, -0.017687160521745682, -0.02756604552268982, 0.026212085038423538, 0.04248981922864914, -0.0038052506279200315, 0.08530265092849731, -0.031664520502090454, 0.03478238359093666, 0.04449792951345444, -0.02572777308523655, 0.11052556335926056, -0.07378655672073364, -0.020405840128660202, 0.018156426027417183, 0.017311153933405876, -0.0684855729341507, -0.03737754374742508, -0.015855327248573303, 0.04491591081023216, 0.03623656928539276, 0.01613285392522812, 0.0794222503900528, 0.09855148196220398, 0.0788130983710289, 0.06176438555121422, 0.0338313952088356, -0.013979047536849976, 0.01633073017001152, -0.0005064095021225512, 0.001097730710171163, 0.016924697905778885, -0.015496395528316498, -0.005817766766995192 ] }, { "text": "## Practical Example: Predicting House Prices\n\n```python\nimport pandas as pd\nfrom sklearn.model_selection import train_test_split\nfrom sklearn.ensemble import RandomForestRegressor\nfrom sklearn.metrics import mean_squared_error\n\n# Load data\ndata = pd.DataFrame({\n 'size': [1500, 1600, 1700, 1800, 1900],\n 'bedrooms': [3, 3, 4, 4, 5],\n 'age': [10, 15, 20, 5, 8],\n 'price': [300000, 320000, 340000, 380000, 400000]\n})\n\n# Prepare features and target\nX = data[['size', 'bedrooms', 'age']]\ny = data['price']\n\n# Split data\nX_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2)\n\n# Train model\nmodel = RandomForestRegressor(n_estimators=100)\nmodel.fit(X_train, y_train)", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_6", "embedding": [ 0.05044136196374893, -0.06325496733188629, 0.04209252819418907, 0.0838528722524643, 0.11071445047855377, -0.05731770396232605, -0.08094529807567596, 0.021380778402090073, -0.0974884182214737, -0.030209386721253395, 0.00117455143481493, -0.059241823852062225, -0.006490835454314947, -0.059660278260707855, 0.017603131011128426, -0.019908646121621132, -0.035870492458343506, -0.010374876670539379, 0.02988400124013424, -0.04308716952800751, 0.04423122853040695, 0.032334428280591965, 0.01033988781273365, 0.04208461567759514, 0.02380572259426117, -0.05948864668607712, 0.0012759814271703362, -0.010404566302895546, -0.09773474931716919, 0.03029678575694561, 0.04736626520752907, -0.06910175085067749, -0.011230384930968285, -0.03554295003414154, -0.031407784670591354, 0.006100882310420275, 0.002676086500287056, 0.02720806375145912, -0.03630848601460457, 0.06252960860729218, -0.03934558480978012, -0.08613063395023346, -0.022535691037774086, -0.05107715353369713, 0.022079333662986755, 0.009600226767361164, -0.017436733469367027, 0.006963382475078106, 0.0629495158791542, 0.007416997570544481, -0.0321829728782177, 0.06757688522338867, -0.09336351603269577, -0.03847702592611313, 0.023314479738473892, 0.005790895316749811, 0.0029349541291594505, -0.05983458831906319, 0.11948365718126297, -0.04676764830946922, 0.009409436956048012, -0.0055425516329705715, 0.030194362625479698, -0.06518884003162384, 0.05440076068043709, -0.07215853780508041, -0.02800310216844082, 0.03971328213810921, -0.059082817286252975, -0.005072897300124168, 0.1075567826628685, -0.004035738296806812, -0.04107705503702164, 0.04223039373755455, 0.07331918179988861, -0.019676148891448975, 0.07225293666124344, 0.008185040205717087, 0.053961336612701416, 0.013667814433574677, -0.13034099340438843, 0.013277438469231129, -0.02664194628596306, -0.05552250146865845, -0.01979828253388405, -0.02951175533235073, 0.09524641185998917, -0.06241448596119881, -0.04201251268386841, 0.008602655492722988, 0.087883859872818, -0.01883569173514843, -0.05651771277189255, 0.04994134604930878, 0.05132060870528221, 0.03888107091188431, 0.061756450682878494, -0.058625198900699615, 0.050447847694158554, 0.02519364282488823, -0.004535868298262358, -0.01066225953400135, 0.03815878555178642, -0.0036615438293665648, -0.006366158835589886, -0.07567420601844788, 0.105263851583004, 0.004643755964934826, -0.00866016186773777, 0.026998132467269897, -0.004327542148530483, -0.05667616426944733, -0.04958835989236832, 0.04623384028673172, 0.051809731870889664, -0.005429395008832216, -0.03512818366289139, -0.03616749495267868, -0.061582282185554504, 0.06362487375736237, -0.028315847739577293, 0.0438225083053112, 0.020284133031964302, 0.02431757189333439, 0.04348008707165718, 0.035742100328207016, -0.012070199474692345, 2.3512300453284782e-33, -0.03181536868214607, -0.03401234745979309, -0.00484015978872776, -0.045379966497421265, -0.018789997324347496, -0.017717858776450157, -0.002334567019715905, 0.03317016735672951, 0.0725693628191948, 0.11759182065725327, -0.007793798577040434, -0.08556384593248367, -0.03154800459742546, -0.0014711975818499923, 0.045160528272390366, 0.019642602652311325, -0.025806380435824394, 0.013944212347269058, 0.011694497428834438, 0.05804507061839104, 0.07175581157207489, 0.05039473623037338, -0.021205924451351166, -0.06698117405176163, -0.06757897883653641, -0.056495700031518936, -0.04275215044617653, 0.03675233945250511, -0.043873533606529236, 0.013740244321525097, -0.06702765822410583, 0.007903610356152058, -0.012924290262162685, -0.005799224600195885, -0.085155189037323, -0.09504897892475128, 0.04373079538345337, 0.02101697213947773, -0.11955628544092178, -0.05821352079510689, 0.007243406493216753, 0.01949743553996086, 0.03620197996497154, 0.0013153571635484695, 0.02045438624918461, 0.05875236168503761, 0.029737642034888268, 0.016497714444994926, -0.02538444474339485, 0.1152658686041832, -0.051772590726614, -0.06103610247373581, -0.0625387653708458, 0.10153044760227203, -0.09756596386432648, 0.07139313966035843, 0.0037809996865689754, -0.0912540927529335, 0.03955553472042084, -0.05357774347066879, -0.07110714912414551, -0.04988715425133705, 0.05910640209913254, -0.007135565858334303, 0.02326614037156105, -0.0021499344147741795, 0.11782334744930267, 0.0193463321775198, 0.04156649485230446, 0.05722951516509056, -0.0395023487508297, -0.07605379074811935, 0.007830279879271984, 0.0007896259194239974, 0.022421427071094513, -0.08078137040138245, 0.045726969838142395, 0.06661579757928848, -0.004335350822657347, -0.05710826441645622, 0.04012544825673103, 0.09859593957662582, 0.02496345341205597, -0.10501664876937866, 0.05917070433497429, -0.01729413866996765, -0.04370968043804169, -0.047589048743247986, -0.0906687080860138, -0.039351388812065125, -0.09433086961507797, 0.02542550303041935, 0.018066665157675743, -0.016166850924491882, -0.008338448591530323, -5.103031463876744e-33, 0.008108704350888729, 0.03821553289890289, 0.09548507630825043, -0.02099240943789482, 0.033055439591407776, 0.013453933410346508, -0.06781429052352905, -0.025020331144332886, 0.01643107645213604, -0.04867703095078468, -0.05675555765628815, -0.056411951780319214, 0.13706062734127045, 0.02873631939291954, 0.014265437610447407, 0.0024392756167799234, 0.04255589470267296, -0.026569372043013573, -0.02576213888823986, 0.0011269192909821868, -0.053493257611989975, 0.014600020833313465, -0.018077194690704346, -0.015659062191843987, -0.07037179172039032, -0.05055423453450203, -0.014595736749470234, 0.07873494923114777, -0.02958069182932377, -0.0827937200665474, -0.038213491439819336, 0.005535538773983717, -0.06508422642946243, 0.10308395326137543, -0.006213494576513767, -0.0399588905274868, 0.023969894275069237, -0.05151912569999695, -0.09461522102355957, 0.06737799197435379, 0.08738986402750015, 0.10253497213125229, -0.09953753650188446, 0.06984395533800125, 0.0077225505374372005, 0.02356930635869503, 0.016692468896508217, -0.014146005734801292, 0.07566651701927185, 0.008273609913885593, 0.023073876276612282, 0.01631142944097519, -0.1278449147939682, 0.034394558519124985, -0.05899406969547272, 0.04476358741521835, 0.02146465890109539, 0.014421035535633564, -0.02560718171298504, 0.07445095479488373, -0.01369171217083931, 0.027627037838101387, -0.0391329787671566, 0.06875529885292053, 0.02068989910185337, -0.02840990386903286, -0.050586212426424026, -0.036160048097372055, 0.05305691808462143, 0.04442061483860016, -0.08577591180801392, -0.038277845829725266, 0.06104845926165581, -0.026325222104787827, -0.05473829433321953, -0.044580500572919846, -0.028472431004047394, -0.01968163251876831, 0.060871656984090805, 0.05451682582497597, 0.022414304316043854, -0.01073508057743311, 0.021004006266593933, 0.004278269596397877, -0.027307478711009026, -0.004539365880191326, 0.06228531152009964, 0.12879715859889984, -0.04973866045475006, -0.04173068702220917, 0.010367556475102901, -0.00017336987366434187, 0.04364335909485817, 0.05149153247475624, -0.01432797685265541, -6.066359503620333e-08, 0.008115668781101704, 0.07337342947721481, 0.04326058179140091, 0.07566867768764496, -0.034060683101415634, -0.05287240445613861, -0.028254425153136253, 0.029662899672985077, -0.03358606994152069, 0.03558763861656189, 0.037891291081905365, 0.009919924661517143, -0.11133447289466858, 0.04952562227845192, 0.02011435106396675, -0.0483383983373642, -0.04681374877691269, 0.07517305761575699, -0.019976722076535225, 0.058155205100774765, 0.07299190014600754, -0.07581467181444168, -0.011027845554053783, 0.010215194895863533, 0.022997679188847542, -0.05152689665555954, 0.05443046987056732, 0.07924646139144897, 0.001823247061111033, 0.09759297221899033, -0.02739490382373333, -0.06184154003858566, 0.009823376312851906, -0.008716695941984653, 0.04600149020552635, 0.013229923322796822, 0.03299422189593315, 0.025225425139069557, 0.05837440490722656, 0.03933923318982124, -0.03133617714047432, -0.006642940919846296, -0.058966293931007385, -0.06211453676223755, 0.0003114064165856689, 0.0008697553421370685, -0.03219956159591675, -0.019170869141817093, 0.09153265506029129, 0.014463278464972973, 0.004755181726068258, -0.05566449463367462, -0.004011854529380798, -0.030931035056710243, 0.12490413337945938, -0.006484347395598888, -0.10464257746934891, 0.029561849310994148, -0.023250572383403778, -0.03513527289032936, 0.030302295461297035, -0.03311688080430031, -0.03066439926624298, -0.011824243701994419 ] }, { "text": "# Train model\nmodel = RandomForestRegressor(n_estimators=100)\nmodel.fit(X_train, y_train)\n\n# Evaluate\npredictions = model.predict(X_test)\nmse = mean_squared_error(y_test, predictions)\nprint(f\"Mean Squared Error: {mse}\")\n```", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_7", "embedding": [ 0.021059725433588028, -0.00869476143270731, -0.03795768693089485, 0.09621284902095795, 0.07099714875221252, -0.03875565156340599, -0.05092112347483635, 0.1128062829375267, -0.07272333651781082, -0.019375277683138847, -0.030770011246204376, -0.08213941752910614, 0.022599132731556892, -0.025080561637878418, -0.07878489047288895, -0.017563870176672935, -0.0654195174574852, -0.04799487441778183, 0.023962365463376045, -0.07913418114185333, 0.10906277596950531, 0.05042501911520958, 0.004190754145383835, 0.039381545037031174, 0.026917876675724983, -0.09461380541324615, -0.057514771819114685, 0.04091866314411163, -0.09496819972991943, 0.018570272251963615, 0.033561352640390396, -0.0736071988940239, 0.04488222301006317, 0.03575904294848442, -0.014728689566254616, -0.06931277364492416, 0.021571006625890732, -0.11022121459245682, 0.018539339303970337, 0.0456882044672966, -0.037229519337415695, -0.06971397250890732, 0.004959636367857456, -0.04528181254863739, 0.011729615740478039, -0.010454406030476093, -0.02962474711239338, -0.037209462374448776, 0.018628690391778946, 0.0015077817952260375, -0.010925507172942162, -0.073644258081913, -0.11065320670604706, -0.083741195499897, 0.0594770684838295, -0.013368719257414341, 0.03294087573885918, -0.03141448646783829, 0.016709694638848305, -0.042028456926345825, 0.0721568912267685, 0.0009003715240396559, 0.009719536639750004, -0.001927483594045043, 0.01409323513507843, -0.027420878410339355, -0.057529233396053314, 0.015585425309836864, -0.07572539150714874, -0.02959025837481022, 0.06614043563604355, 0.0020566105376929045, -0.02771717496216297, -0.06970972567796707, 0.04997174069285393, -0.007500485051423311, 0.025789259001612663, 0.07507474720478058, 0.025780683383345604, 0.07332292199134827, -0.12981091439723969, -0.020397957414388657, 0.016852302476763725, -0.046772684901952744, -0.009421069175004959, 0.00846604723483324, 0.07887320220470428, 0.006956063210964203, 0.04408741369843483, 0.006566504016518593, 0.030927376821637154, -0.03970557451248169, -0.1004880741238594, 0.1043560579419136, -0.03499229624867439, 0.03575701266527176, 0.07433842122554779, -0.04542765021324158, -0.006544272415339947, -0.005359013099223375, -0.055865030735731125, 0.0413336344063282, 0.030574629083275795, 0.02083708345890045, 0.02200264111161232, 0.015547591261565685, 0.11929955333471298, -0.06120426580309868, 0.019849861040711403, -0.018167193979024887, 0.0042092869989573956, 0.04062595218420029, -0.004365846514701843, 0.07450024038553238, 0.04200578108429909, -0.014156095683574677, -0.08056505769491196, 0.011877572163939476, -0.042307790368795395, 0.028156206011772156, -0.03200376033782959, 0.067551389336586, 0.008225883357226849, 0.01506944838911295, 0.007407807279378176, 0.019387967884540558, -0.045612357556819916, 2.0926082475071205e-33, -0.027029331773519516, -0.0003343018179293722, 0.08793774247169495, -0.04275598004460335, 0.05651668459177017, -0.030235489830374718, -0.01809457316994667, -0.055002402514219284, 0.0808042511343956, 0.01833403669297695, -0.09917589277029037, -0.03780384734272957, -0.009060454554855824, -0.02348543517291546, -0.0042127277702093124, 0.008958851918578148, 0.013911875896155834, -0.025382939726114273, -0.002747579477727413, 0.044256795197725296, 0.13124848902225494, 0.011852292343974113, -0.056893546134233475, -0.10832898318767548, -0.010874277912080288, 0.039200179278850555, 0.008704889565706253, 0.01575939729809761, -0.0344853550195694, 0.03008023090660572, -0.0655997022986412, -0.03960530832409859, 0.039601389318704605, -0.02837161347270012, -0.011458657681941986, -0.07236979156732559, 0.0849161446094513, 0.04570838063955307, -0.08933056145906448, -0.07830626517534256, 0.02993839792907238, 0.027822505682706833, 0.018346259370446205, -0.040549080818891525, 0.028975173830986023, -0.00953624676913023, 0.0025569633580744267, 0.058906614780426025, 0.10517189651727676, 0.12143558263778687, -0.06624599546194077, -0.02703632041811943, -0.023611539974808693, 0.06971102952957153, -0.021680161356925964, 0.09222285449504852, 0.036461856216192245, 0.05049510672688484, 0.05254349485039711, -0.07753650099039078, -0.010262550786137581, -0.036133669316768646, 0.07496312260627747, -0.06434420496225357, 0.0455670990049839, 0.05598439648747444, 0.07198166847229004, -0.050800662487745285, 0.02015611156821251, 0.08659889549016953, -0.06796295940876007, -0.030895672738552094, -0.003637454006820917, 0.006545740645378828, -0.009330986067652702, -0.07953599840402603, 0.019948050379753113, 0.020199241116642952, -0.014212933368980885, -0.032708216458559036, 0.011709760874509811, 0.09243437647819519, -0.1212112307548523, -0.13222861289978027, 0.012288106605410576, -0.005668602883815765, -0.03598003834486008, -0.04587982967495918, -0.02121131122112274, 0.027766644954681396, -0.07293897122144699, 0.01729407161474228, 0.04313387721776962, -0.012027619406580925, -0.03789160028100014, -4.910288226566306e-33, 0.05312719568610191, 0.07167190313339233, 0.06891096383333206, -0.025186017155647278, -0.003172626718878746, -0.010050144977867603, -0.01900486834347248, 0.027818944305181503, -0.03425378352403641, -0.005139519926160574, -0.028390424326062202, -0.046073030680418015, 0.04486803337931633, 0.004354143515229225, 0.05531818047165871, -0.02730981819331646, 0.052708376199007034, -0.0010128075955435634, -0.027256423607468605, -0.04127846285700798, -0.04852301627397537, 0.015313884243369102, 0.02236727438867092, -0.016495030373334885, 0.014451251365244389, -0.04915541037917137, 0.02414347231388092, 0.07113637775182724, -0.05875097215175629, -0.1106402650475502, 0.030870487913489342, 0.03717631846666336, -0.037642478942871094, 0.04118862748146057, -0.027881866320967674, -0.0651981309056282, 0.08866068720817566, -0.07134463638067245, -0.0011554741067811847, 0.013785197399556637, 0.04056437686085701, 0.10300587862730026, -0.05559930205345154, 0.061955906450748444, -0.00829226989299059, 0.04638303816318512, 0.011607099324464798, -0.07225309312343597, 0.10279041528701782, -0.03995684161782265, 0.021850179880857468, -0.07555674016475677, -0.13854390382766724, -0.001941944588907063, -0.019481085240840912, 0.031008483842015266, -0.032974373549222946, -0.03478303551673889, -0.06397911161184311, 0.0017088454915210605, 0.0057936906814575195, -0.021654555574059486, -0.037615567445755005, 0.011605457402765751, -0.030379019677639008, 0.0047381059266626835, -0.10356307029724121, 0.04017074033617973, 0.07795331627130508, 0.09008508175611496, -0.009155682288110256, 0.004721437115222216, 0.018678581342101097, 0.0582551546394825, -0.04527836665511131, -0.03420143201947212, -0.06439756602048874, 0.025065243244171143, 0.03943523019552231, 0.04649367555975914, 0.045368243008852005, 0.030723582953214645, 0.05085863918066025, -0.027650397270917892, 0.0118862921372056, -0.03402596339583397, 0.08204574882984161, 0.08860720694065094, -0.09068334847688675, -0.08283046633005142, -0.0016245284350588918, 0.0022765188477933407, 0.049611277878284454, 0.09708372503519058, 0.01450498029589653, -3.7465255786628404e-08, -0.05829733982682228, 0.0006007759948261082, 0.050298113375902176, 0.04734368249773979, -0.018727121874690056, 0.017494643107056618, -0.049489013850688934, -0.07159523665904999, -0.022958753630518913, 0.013104867190122604, -0.014737827703356743, -0.045289937406778336, -0.1347445845603943, 0.028255878016352654, 0.04511912912130356, 0.005298055242747068, -0.06311342120170593, 0.09371040761470795, 0.018985295668244362, 0.02081906422972679, 0.03427540883421898, -0.09299427270889282, -0.015945058315992355, 0.003080842550843954, 0.01880321279168129, -0.03743697702884674, 0.021723004058003426, 0.07457836717367172, -0.024996984750032425, 0.07038018852472305, -0.006357844453305006, -0.01760498434305191, 0.03637737035751343, 0.0033641059417277575, -0.061615850776433945, 0.004327838309109211, 0.0647374764084816, 0.0523105226457119, 0.08713241666555405, 0.08749587088823318, -0.01145518384873867, 0.03882923722267151, -0.03555917367339134, -0.05474480241537094, 0.005141552537679672, 0.06735716015100479, 0.015434511937201023, 0.00014995523088146, 0.026051681488752365, -0.04202669858932495, 0.032163891941308975, -0.07836508750915527, -0.020499104633927345, 0.010227909311652184, 0.014620616100728512, -0.007414834573864937, -0.04691137373447418, 0.015392947010695934, -0.060502927750349045, -0.021243508905172348, 0.01173965074121952, 0.005628461949527264, 0.05582590401172638, -0.008010929450392723 ] }, { "text": "## Resources for Learning\n\n### Online Courses\n- [Coursera: Machine Learning by Andrew Ng](https://www.coursera.org/learn/machine-learning)\n- [Fast.ai: Practical Deep Learning](https://www.fast.ai/)\n\n### Books\n- \"Hands-On Machine Learning\" by Aurélien Géron\n- \"Pattern Recognition and Machine Learning\" by Christopher Bishop\n\n### Practice Platforms\n- [Kaggle](https://www.kaggle.com) - Competitions and datasets\n- [Google Colab](https://colab.research.google.com) - Free GPU for experiments", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_8", "embedding": [ -0.0995539054274559, -0.06436406821012497, 0.0018675351748242974, 0.02103404514491558, 0.05633263289928436, -0.02485540322959423, -0.0209504384547472, -0.021146828308701515, -0.08479899913072586, -0.02749522589147091, -0.03876585513353348, 0.0472138449549675, -0.03406834974884987, -0.013983522541821003, -0.012042163871228695, 0.015327607281506062, 0.013373631983995438, 0.07200460880994797, -0.03681161627173424, -0.07240420579910278, 0.0052490681409835815, -0.034456368535757065, 0.07929632067680359, -0.049485038965940475, 0.030516592785716057, 0.014718307182192802, 0.0735250860452652, -0.09008068591356277, 0.034709177911281586, -0.0010612382320687175, -0.04197302460670471, -0.04656551778316498, -0.016560260206460953, -0.016913827508687973, -0.03238854184746742, -0.05214589461684227, -0.009792717173695564, -0.016340700909495354, 0.047929905354976654, -0.006040622480213642, -0.012917019426822662, -0.05998598784208298, 0.03342398628592491, 0.0228655394166708, 0.09219232201576233, 0.056055232882499695, -0.024043118581175804, -0.07736959308385849, 0.016100149601697922, 0.02801729179918766, -0.08000211417675018, -0.051972247660160065, -0.06697596609592438, 0.021620620042085648, -0.11573704332113266, 0.012899358756840229, 0.047772739082574844, 0.013319791294634342, 0.0017705056816339493, -0.002528766170144081, 0.05450822785496712, -0.1414666473865509, -0.024357151240110397, 0.006859918124973774, -0.0512809231877327, 0.0106005584821105, 0.0030557839199900627, 0.09970994293689728, 0.07140807062387466, -0.048678748309612274, 0.013969910331070423, 0.06217896565794945, -0.004628018010407686, 0.03032185323536396, 0.05541631206870079, 0.004302584566175938, 0.014872978441417217, 0.001295673311688006, 0.05869319289922714, 0.03472668305039406, -0.0050313035026192665, -0.027300728484988213, 0.01877981424331665, -0.0016328358324244618, 0.05786256864666939, -0.06137367710471153, -0.02290196344256401, -0.003772121388465166, -0.010980380699038506, -0.07869437336921692, 0.03204590082168579, 0.022931477054953575, 0.04138696938753128, -0.013908052816987038, 0.022871317341923714, -0.04463164880871773, -0.015293576754629612, -0.13224542140960693, -0.06340537965297699, 0.038378480821847916, -0.06941711157560349, 0.0286859180778265, 0.01061669085174799, 0.07737424224615097, -0.07751902937889099, 0.06220988184213638, -0.011008641682565212, 0.02202247828245163, 0.07633969932794571, -0.013638071715831757, 0.008006745018064976, 0.052688825875520706, -0.010974276810884476, -0.05955483764410019, 0.02160973846912384, -0.038199424743652344, -0.0004932872834615409, 0.016997486352920532, 0.08774545788764954, 0.10772760957479477, -0.13946299254894257, -0.03533528745174408, 0.009294137358665466, 0.030750799924135208, 0.0359191857278347, -0.043638210743665695, -0.11869723349809647, 1.7457011301382473e-33, 0.04181310907006264, -0.017731424421072006, 0.012358921580016613, -0.08177124708890915, 0.07992496341466904, -0.08472921699285507, 0.03092784620821476, 0.02357644774019718, -0.04848199337720871, 0.09314508736133575, -0.02607421576976776, 0.0911409854888916, -0.06355766952037811, 0.13137486577033997, 0.019673166796565056, -0.07372750341892242, -0.009149037301540375, 0.009501658380031586, 0.08076043426990509, 0.016966935247182846, 0.043877046555280685, 0.020893337205052376, 0.01914336532354355, 0.03350946307182312, 0.0032876478508114815, 0.01664300449192524, -0.020361291244626045, -0.008441099897027016, 0.08779995888471603, 0.027255792170763016, -0.053858693689107895, -0.0013872156850993633, -0.058614857494831085, -0.021156882867217064, 0.01663213036954403, 0.010265237651765347, -0.06599637120962143, -0.02943313494324684, 0.025531912222504616, 0.047456447035074234, -0.016517577692866325, 0.03257330507040024, 0.10929699242115021, -0.07394463568925858, -0.13212847709655762, -0.025909649208188057, 0.042837005108594894, 0.010454235598444939, 0.08760179579257965, -0.11037611216306686, -0.13422666490077972, 0.021705441176891327, -0.12823989987373352, -0.03701719269156456, -0.01424600649625063, 0.017111260443925858, 0.01364130713045597, 0.07712139934301376, 0.03411760553717613, 0.05498199164867401, -0.033866412937641144, 0.07530587166547775, -0.014417946338653564, 0.03355049341917038, -0.09806376695632935, -0.03531511500477791, -0.02925608493387699, 0.01644224300980568, -0.05117615684866905, 0.0007651369669474661, -0.02061425894498825, 0.03813725337386131, 0.023380843922495842, -0.07021326571702957, 0.028646960854530334, 0.04264799878001213, 0.07396835088729858, -0.05965119227766991, -0.08445422351360321, -0.002403903752565384, -0.0060038273222744465, 0.012933101505041122, 0.0443100705742836, -0.033352985978126526, -0.0660366341471672, 0.017112933099269867, -0.031091734766960144, -0.0961182489991188, -0.014294547960162163, -0.016637615859508514, -0.035250309854745865, -0.019807633012533188, -0.032567285001277924, 0.009525304660201073, -0.03456153720617294, -1.1834611719494894e-33, 0.008829585276544094, -0.013006898574531078, 0.0005303575890138745, 0.12882018089294434, 0.12852810323238373, 0.004339632112532854, -0.016427842900156975, -0.01366054080426693, 0.021615497767925262, 0.021647434681653976, -0.021932024508714676, 0.07801640033721924, 0.039018698036670685, 0.09129306674003601, -0.022326188161969185, 0.0027138027362525463, -0.07100531458854675, -0.07164479047060013, -0.037794049829244614, -0.0371490903198719, 0.022866645827889442, 0.08019035309553146, -0.03543064370751381, -0.08633918315172195, -0.007759465835988522, -0.019923094660043716, -0.007386152632534504, -0.0010118682403117418, -0.010353472083806992, 0.03327953815460205, -0.015559830702841282, 0.0021964500192552805, -0.06995166093111038, 0.038775734603405, 0.03712686896324158, 0.05421026051044464, 0.06898289918899536, 0.03271153196692467, 0.02054566703736782, 0.044511083513498306, 0.10556233674287796, -0.004414482973515987, 0.00908342469483614, -0.05672448128461838, 0.030871234834194183, -0.00598528515547514, -0.08683448284864426, 0.042962297797203064, 0.013979080133140087, 0.008367395959794521, 0.015048127621412277, 0.03316034376621246, 0.0071092890575528145, -0.05567096918821335, 4.2835956264752895e-05, -0.023675912991166115, -0.009138084948062897, 0.04986674711108208, 0.016543418169021606, 0.05627895146608353, -0.059965621680021286, -0.004813648294657469, -0.08449635654687881, 0.04318062216043472, -0.0277445986866951, -0.04904225468635559, 0.004809000063687563, 0.08282648772001266, 0.06885211169719696, -0.017333585768938065, -0.04237474873661995, 0.04117175191640854, 0.025310993194580078, 0.011088325642049313, -0.11569243669509888, 0.03182082995772362, -0.02015480026602745, 0.04223185032606125, 0.017684495076537132, 0.02445685677230358, 0.08643088489770889, 0.009501934051513672, -0.04382525011897087, 0.07745152711868286, 0.05394453555345535, 0.11425160616636276, 0.04629243537783623, 0.0018949221121147275, 0.001695971586741507, -0.011330917477607727, -0.027699992060661316, 0.050978198647499084, 0.030685707926750183, 0.03583652153611183, -0.07879465818405151, -4.564647326787963e-08, 0.054318759590387344, -0.029057513922452927, 0.05205485224723816, 0.039072174578905106, 0.03329550474882126, 0.05270835757255554, 0.004291636403650045, -0.0033070615027099848, -0.08733689039945602, 0.0362452007830143, 0.03668268024921417, -0.04485073685646057, 0.0018611326813697815, -0.01400207169353962, 0.0018895635148510337, 0.028759578242897987, 0.01818675734102726, -0.016460809856653214, 0.0370754636824131, -0.012906269170343876, 0.024627363309264183, 0.030639901757240295, 0.022409137338399887, -0.019456040114164352, -0.009095908142626286, -0.005195543169975281, 0.07292144000530243, 0.0036534962709993124, -0.03241207078099251, 0.027001405134797096, -0.050549451261758804, 0.020439621061086655, 0.06462740153074265, -0.15661436319351196, 0.12415555119514465, 0.03531884029507637, 0.03553735464811325, 0.01570170372724533, 0.027389168739318848, -0.057020433247089386, -0.04612107574939728, 0.03312430530786514, -0.004833143670111895, -0.05277851223945618, -0.002508845180273056, 0.005443322937935591, -0.017165407538414, -0.0594974122941494, 0.04308266565203667, 0.09163746237754822, -0.002891987795010209, 0.023623967543244362, -0.005900894291698933, 0.04981439933180809, 0.10854724049568176, 0.05014931783080101, -0.008306458592414856, -0.06757568567991257, 0.06743525713682175, 0.08165955543518066, -0.02923239767551422, 0.01093254704028368, -0.07783833146095276, 0.007803615182638168 ] }, { "text": "## Key Takeaways\n\n- Machine Learning enables computers to learn from data\n- Three main types: Supervised, Unsupervised, and Reinforcement Learning\n- The ML workflow is iterative and requires continuous improvement\n- Start with simple algorithms before moving to complex ones\n- Practice is essential - work on real projects and datasets\n\n## Related Topics\n\n- [Deep Learning](dl.html) - Neural networks and advanced architectures\n- [Python Basics](python.html) - Programming fundamentals for ML\n- [Statistics](statistics.html) - Mathematical foundations", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_9", "embedding": [ -0.01787489838898182, -0.06033063307404518, 0.046755291521549225, -0.021412944421172142, 0.018110791221261024, -0.024406909942626953, -0.03999193012714386, -0.037285856902599335, -0.1154453456401825, 0.00944046676158905, -0.0954030305147171, 0.04304943233728409, 0.013472848571836948, -0.04918855056166649, -0.0038869024720042944, 0.04332453012466431, -0.01352811697870493, 0.023407332599163055, -0.0775245949625969, -0.08898034691810608, 0.030734999105334282, 0.009800668805837631, -0.04041774570941925, 0.004613817203789949, -0.0138029670342803, 0.07057558745145798, 0.03325483202934265, -0.0028382076416164637, 0.019791722297668457, 0.01607520319521427, -0.010938436724245548, -0.04147482290863991, 0.0752173513174057, 0.026656867936253548, -0.04062996804714203, -0.004364343825727701, 0.022038094699382782, 0.006897994317114353, 0.032339632511138916, 0.011785991489887238, -0.03377195820212364, -0.07141982018947601, 0.02760683372616768, -0.04724889248609543, 0.11507036536931992, 0.09527967125177383, -0.09097298979759216, -0.12721942365169525, -0.018900664523243904, 0.011999132111668587, -0.11359748244285583, -0.04559392109513283, 0.004627397749572992, 0.031357940286397934, -0.07485944032669067, 0.0140526806935668, 0.04569419473409653, 0.061691608279943466, -0.015763046219944954, -0.02644406259059906, -0.022508252412080765, -0.08821458369493484, -0.017455505207180977, -0.0324670746922493, 0.012689641676843166, -0.042846307158470154, -0.051216352730989456, 0.05008278787136078, 0.09051427990198135, -0.0010339232394471765, -0.025447163730859756, 0.044111233204603195, -0.051559921354055405, 0.03227068483829498, -0.01789792627096176, -0.03989289700984955, -0.002804290037602186, -0.05472858250141144, 0.05497413128614426, -8.97676291060634e-05, 0.01036876905709505, 0.018928973004221916, -0.01646551862359047, 0.107612743973732, 0.0642501711845398, -0.047773342579603195, -0.09124340862035751, 0.03138086199760437, -0.050677161663770676, -0.04682491347193718, 0.0189486276358366, -0.04377105459570885, -0.007065166719257832, 0.022516649216413498, -0.01876845210790634, 0.057559799402952194, -0.04650147631764412, -0.10793600976467133, -0.01130648609250784, 0.047276321798563004, -0.05471379682421684, 0.023397190496325493, 0.0425349697470665, 0.017817886546254158, 0.04651246219873428, -0.014030873775482178, 0.05035805329680443, 0.02822461724281311, 0.086884044110775, -0.09055487811565399, -0.023164695128798485, 0.0288253091275692, -0.03578285500407219, -0.04516083747148514, -0.0063219391740858555, -0.037231482565402985, -0.018598007038235664, 0.0019417388830333948, -0.016250284388661385, 0.09026415646076202, -0.08235526084899902, 0.02019832469522953, 0.028060346841812134, -0.010818105190992355, 0.016700731590390205, -0.053400859236717224, -0.09131870418787003, 1.9244220055403216e-33, -0.06079217046499252, -0.04139373451471329, 0.01666136458516121, 0.05075575411319733, 0.10766773670911789, -0.08508755266666412, 0.01683136075735092, -0.031533367931842804, 0.07397967576980591, 0.04825875535607338, 0.01700425148010254, 0.09255499392747879, -0.039636701345443726, 0.09644582867622375, 0.03372703865170479, -0.02393997274339199, 0.03742777556180954, -0.013821998611092567, -0.013976788148283958, -0.03244011104106903, 0.08687036484479904, 0.031964972615242004, 0.04442214220762253, 0.04166993871331215, 0.007929322309792042, 0.00496131693944335, 0.017784619703888893, 0.028100229799747467, 0.03217582404613495, 0.018893420696258545, -0.028915438801050186, 0.0377320796251297, -0.0882125198841095, 0.007089429069310427, 0.03339090943336487, 0.029211807996034622, 0.01713360846042633, -0.09951192140579224, 0.024644283577799797, -0.01598268374800682, -0.05550254508852959, 0.030436072498559952, 0.03867969661951065, -0.10616974532604218, -0.056526534259319305, -0.0008326082024723291, 0.027804167941212654, -0.036417171359062195, 0.06668552756309509, -0.08454465866088867, -0.02267855405807495, -0.036011096090078354, 0.000656955991871655, -0.039466988295316696, 0.02678227238357067, 0.0794975608587265, 0.008706350810825825, 0.015391451306641102, -0.004249135963618755, 0.04064948484301567, 0.009580329991877079, -0.020090285688638687, 0.06044938042759895, -0.012669047340750694, 0.01525488868355751, 0.05744253098964691, 0.04162617400288582, 0.0944221094250679, 0.016765998676419258, -0.004309984855353832, -0.024034734815359116, 0.039274778217077255, 0.000667707237880677, -0.03253631666302681, 0.01845436543226242, 0.08403302729129791, -0.01776677742600441, -0.10084529966115952, -0.003003498772159219, 0.10181822627782822, -0.04176808521151543, 0.049412455409765244, 0.01403751689940691, -0.05966364964842796, 0.016085755079984665, 0.04488179832696915, -0.02488258294761181, -0.0455680787563324, 0.009915565140545368, -0.048235900700092316, -0.05932491272687912, -0.020320964977145195, -0.0424569733440876, 0.05628706514835358, -0.030263056978583336, -4.243821133216471e-33, -0.06472671031951904, 0.11679337173700333, -0.1045159175992012, 0.06299235671758652, 0.04676545038819313, 0.032758936285972595, -0.05826306715607643, -0.048696983605623245, 0.02094772644340992, -0.0011708562960848212, -0.03616923466324806, -0.012700009159743786, 0.015357593074440956, 0.003141345689073205, -0.04232889413833618, 0.004398507997393608, -0.09263845533132553, -0.012950548902153969, -0.03863435611128807, 0.0026379891205579042, -0.08634182810783386, 0.012497343122959137, -0.07249662280082703, -0.04529982805252075, 0.02048857882618904, -0.011089932173490524, -0.06434350460767746, 0.0062193311750888824, 0.06711485236883163, 0.008217847906053066, -0.0043324981816112995, -0.01630978286266327, -0.02491273172199726, 0.0309588685631752, 0.044885605573654175, 0.003092759056016803, 0.04354797303676605, -0.03736104071140289, 0.06281580775976181, 0.037983134388923645, 0.12296894192695618, -0.017025478184223175, 0.038041915744543076, -0.08200615644454956, -0.008384369313716888, 0.014568228274583817, -0.05095377191901207, 0.02980915457010269, 0.03468364477157593, -0.0883713960647583, 0.07999150454998016, -0.00019276961393188685, -0.004247621167451143, -0.044729169458150864, -0.011033118702471256, 0.012759889476001263, 0.01856840029358864, -0.006202219519764185, 0.056156255304813385, 0.04425550624728203, -0.13191182911396027, -0.05908806622028351, -0.015821944922208786, 0.04789752513170242, -0.0885268822312355, 0.015080577693879604, -0.016055244952440262, 0.05927310883998871, -0.05519179254770279, -0.06520623713731766, -0.042000770568847656, 0.059684235602617264, 0.027685953304171562, 0.05404002219438553, -0.1284022033214569, -0.05268366262316704, -0.033665504306554794, -0.043654344975948334, -0.01567487046122551, -0.02975950390100479, 0.07732024788856506, -0.049607060849666595, -0.04491783306002617, 0.025054270401597023, 0.046091582626104355, 0.0629710778594017, 0.0338769257068634, -0.03726950287818909, 0.0015845459420233965, -0.11260571330785751, -0.08074553310871124, 0.04146751016378403, -0.027318667620420456, 0.06704330444335938, -0.06278515607118607, -4.6865039848853485e-08, 0.013143415562808514, -0.006046560127288103, 0.06533510237932205, -0.028967922553420067, 0.08731432259082794, 0.06512670964002609, -0.07262420654296875, 0.11253610998392105, -0.019172975793480873, 0.07239090651273727, 0.03096858412027359, 0.008901689201593399, 0.0036431499756872654, -0.02180088311433792, -0.006642909254878759, 0.0823272094130516, 0.04494680091738701, -0.001497962512075901, 0.06642657518386841, -0.014171511866152287, 0.05878187343478203, -0.07629890739917755, -0.009564665146172047, -0.03449741750955582, 0.07870662957429886, -0.1014079824090004, -0.01752493716776371, 0.04428206756711006, -0.039131660014390945, 0.06145985797047615, -0.0477275513112545, -0.02243800275027752, 0.06633874028921127, 0.01058235578238964, 0.05343388766050339, 0.058189187198877335, 0.064610056579113, -0.10697542130947113, -0.033741313964128494, -0.06815457344055176, -0.029143312945961952, 0.12087113410234451, -0.046192269772291183, -0.009489036165177822, -0.005458232015371323, 0.013483578339219093, -0.012842469848692417, -0.030773714184761047, -0.050008367747068405, 0.05790963023900986, 0.028217710554599762, 0.027265649288892746, 0.09422548115253448, 0.07966038584709167, 0.07328806817531586, 0.07152067869901657, 0.040174394845962524, -0.068682961165905, 0.05215109884738922, 0.06624840945005417, 0.04088982567191124, 0.044138118624687195, 0.026145396754145622, 0.015109776519238949 ] }, { "text": "## Tools and Libraries\n\n- **Scikit-learn**: General-purpose ML library\n- **TensorFlow**: Deep learning framework\n- **PyTorch**: Deep learning framework\n- **Pandas**: Data manipulation\n- **NumPy**: Numerical computing\n\n---\n\n**Last Updated:** November 8, 2025 \n**Difficulty Level:** Beginner to Intermediate", "source": "ml.md", "type": "markdown", "chunk_id": "ml.md_10", "embedding": [ -0.0993935763835907, -0.0939042791724205, 0.0004005180671811104, -0.04179561138153076, 0.025165895000100136, -0.1092318743467331, -0.04263602942228317, -0.04363260418176651, -0.12217980623245239, -0.055545974522829056, -0.010355543345212936, -0.03380824252963066, -0.08345790952444077, -0.04847019165754318, -0.03444938361644745, 0.03595828264951706, -0.01469011977314949, 0.06891254335641861, -0.06493634730577469, -0.08798448741436005, -0.04038679599761963, 0.045283835381269455, -0.04387304559350014, 0.017435098066926003, 0.024781608954072, -0.007674031425267458, 0.020590977743268013, -0.05745359882712364, -0.009195813909173012, -0.01788993924856186, 0.028349798172712326, -0.035784799605607986, 0.0361178033053875, 0.004750956315547228, -0.04116050899028778, -0.006644775625318289, -0.013749564997851849, -0.06438510864973068, -0.0545186810195446, 0.012652439996600151, -0.07743681222200394, -0.0754031240940094, 0.026856672018766403, -0.05560670793056488, 0.033741824328899384, 0.05509969964623451, -0.039212536066770554, -0.060743581503629684, 0.06948203593492508, -0.005873403511941433, -0.049836788326501846, -0.052562128752470016, -0.056205980479717255, 0.0785132497549057, 0.006800872273743153, -0.036560408771038055, 0.07104921340942383, -0.06082957237958908, 0.041880637407302856, -0.03719073534011841, 0.00936555489897728, 0.00019452460401225835, -0.01075872965157032, -0.005781013518571854, -0.024491004645824432, -0.007992614060640335, 0.019564207643270493, -0.013691987842321396, 0.08933492004871368, -0.06158839166164398, 0.010087146423757076, 0.029592478647828102, -0.04215965420007706, 0.009022807702422142, -0.018365882337093353, -0.054881274700164795, 0.055734533816576004, -0.0235974732786417, 0.09489940851926804, -0.04698190093040466, 0.0013743326999247074, 0.060822851955890656, 0.03836001828312874, 0.0351753793656826, 0.014352341182529926, -0.09833177179098129, -0.06184817850589752, 0.11948169022798538, 0.02376207523047924, -0.016220077872276306, 0.09014835208654404, -0.014085897244513035, -0.008396657183766365, -0.009294981136918068, -0.051768574863672256, 0.06209345906972885, 0.04518355056643486, -0.1105022132396698, -0.04592220112681389, 0.04838654026389122, -0.07465460151433945, -0.03878222778439522, 0.016859257593750954, 0.03469347581267357, -0.0045722732320427895, -0.01427245233207941, 0.06947007030248642, 0.04505607858300209, 0.025823306292295456, -0.04406309872865677, 0.019466957077383995, -0.04338862746953964, -0.054469846189022064, -0.06438160687685013, 0.0819828063249588, -0.016246110200881958, 0.020028486847877502, 0.03490128368139267, -0.0001561277749715373, 0.04760836437344551, -0.08400193601846695, 0.054398514330387115, -0.06204283982515335, 0.030572379007935524, -0.03158307448029518, 0.004620486404746771, -0.07540056109428406, -3.2611607531748255e-33, 0.009134290739893913, 0.006239192094653845, 0.0011638602009043097, 0.037752989679574966, 0.03943120315670967, -0.08949938416481018, 0.004932902287691832, -0.05914941057562828, -0.022855855524539948, 0.05896568298339844, -0.04381876066327095, 0.056394416838884354, -0.07561630010604858, 0.10499957948923111, 0.007871503941714764, -0.128109872341156, 0.07871610671281815, -0.015103191137313843, 0.002398112555965781, 0.034720465540885925, 0.04940437525510788, 0.011172506958246231, -0.004424487240612507, 0.02615506201982498, 0.0070588490925729275, 0.04819072410464287, 4.5417589717544615e-05, -0.038630250841379166, 0.039808232337236404, 0.007693382445722818, -0.11188235133886337, -0.004304335918277502, -0.056517522782087326, -0.0031879902817308903, 0.0012398456456139684, -0.02482491545379162, -0.0028148454148322344, -0.04764178767800331, 0.013591023162007332, -0.03739001601934433, -0.03771870955824852, 0.03834579512476921, -0.005021937191486359, -0.04395216703414917, -0.024113614112138748, 0.05563753843307495, 0.0572080984711647, 0.08123384416103363, 0.09131352603435516, -0.05395308881998062, -0.08055209368467331, -0.04157498478889465, -0.0010707225883379579, 0.007754218764603138, 0.009092931635677814, 0.02238016203045845, 0.054220426827669144, 0.024894125759601593, 0.029688077047467232, 0.007496521808207035, 0.051253944635391235, 0.00993362907320261, 0.011955346912145615, -0.04119006171822548, 0.013293749652802944, -0.006387678440660238, 0.0036128179635852575, 0.07186359912157059, 0.025898009538650513, 0.028767969459295273, -0.1379953920841217, 0.0784030482172966, 0.05417730286717415, -0.06542358547449112, 0.025643350556492805, 0.009748989716172218, 0.07357607781887054, -0.08211446553468704, -0.0329560711979866, 0.03409956768155098, -0.06502518057823181, 0.05579809099435806, 0.031248779967427254, -0.0804370641708374, 0.02345256693661213, -0.017553534358739853, -0.04319918155670166, -0.03370320051908493, -0.07019901275634766, -0.08622384071350098, -0.05779137462377548, 0.0020418998319655657, 0.03011920116841793, 0.0627242773771286, -0.05309732258319855, -5.271421764316006e-34, -0.005452843848615885, 0.03702005371451378, -0.06279589235782623, 0.032049018889665604, 0.020259564742445946, 0.036397937685251236, -0.07537584006786346, -0.00958112720400095, 0.001075462088920176, -0.008159209974110126, -0.03465360403060913, -0.04117526859045029, 0.059956058859825134, -0.05070756748318672, 0.03329995274543762, -0.013225757516920567, -0.0955730602145195, -0.006157158873975277, -0.037543609738349915, -0.0032417664770036936, -0.1093369871377945, 0.04773822799324989, -0.0072189378552138805, -0.06133931130170822, -0.058006398379802704, -0.04095831885933876, -0.008525338023900986, -0.03246603161096573, 0.006543805357068777, 0.013285557739436626, -0.05235547944903374, -0.006921779830008745, -0.024703050032258034, 0.027685469016432762, 0.033811137080192566, 0.06819898635149002, 0.09721222519874573, 0.0022670177277177572, -0.00025222060503438115, -0.05318455398082733, 0.14992931485176086, 0.08334573358297348, -0.01522777508944273, -0.005647311452776194, -0.011872967705130577, 0.056226011365652084, -0.07655081152915955, 0.07746277004480362, -0.00609896844252944, -0.03481558710336685, 0.019853435456752777, -0.038241155445575714, -0.04413989186286926, -0.02353176847100258, -0.022315653041005135, 0.0628361627459526, 0.06535753607749939, -0.012900159694254398, 0.047355495393276215, 0.029302267357707024, -0.1474320888519287, -0.09157463163137436, -0.04716086760163307, 0.05677563697099686, -0.08043611794710159, 0.006221759598702192, -0.0640152096748352, 0.015504472889006138, -0.00546308746561408, 0.002681516343727708, 0.039662692695856094, 0.039390675723552704, 0.0853118970990181, 0.038774363696575165, -0.06494679301977158, -0.03923206776380539, -0.004866189789026976, -0.02435450628399849, 0.004795605316758156, 0.016458505764603615, 0.12407413125038147, -0.02085653692483902, 0.05531037598848343, 0.11361873149871826, 0.014707791619002819, 0.07667803764343262, 0.07395312935113907, 0.024445096030831337, 0.01845000497996807, -0.025907672941684723, -0.05424709618091583, 0.04908027499914169, 0.007121636066585779, 0.06724277883768082, -0.01473276223987341, -3.834051298667873e-08, 0.018173998221755028, 0.0012981847394257784, 0.05961931496858597, -0.05797533318400383, 0.02771809697151184, 0.09240198135375977, 0.04565379023551941, 0.052531179040670395, -0.047959212213754654, 0.06666632741689682, 0.057628341019153595, -0.04792718216776848, -0.04473104327917099, -0.036624155938625336, -0.035513173788785934, 0.1341499537229538, 0.0361236147582531, 0.02055267058312893, 0.035580191761255264, -0.02118372730910778, 0.08222166448831558, -0.017245059832930565, 0.016106998547911644, -0.007193916477262974, -0.017086558043956757, -0.07507911324501038, -0.003063799114897847, 0.05491502955555916, -0.013490816578269005, -0.028089817613363266, -0.05939111486077309, -0.05120024085044861, 0.0015141249168664217, 0.023926276713609695, 0.08453867584466934, 0.08127747476100922, -0.04829898476600647, -0.019392378628253937, -0.027400551363825798, 0.05389600619673729, -0.04597948491573334, 0.09850620478391647, -0.07216157764196396, -0.03531502187252045, -0.012619656510651112, 0.05394147336483002, -0.021134942770004272, -0.06425832957029343, 0.007819575257599354, 0.05876687169075012, 0.07723160833120346, 0.05698177218437195, 0.03118433989584446, 0.07357976585626602, 0.05347761511802673, 0.08103401213884354, -0.05029291287064552, -0.022351743653416634, 0.0027602030895650387, 0.037968624383211136, 0.042135633528232574, 0.061610814183950424, -0.0287331473082304, -0.008284204639494419 ] }, { "text": "---\ntitle: \"Word Vectors\"\nid: \"wordvector\"\ncategory: \"genai\"\ntags: [\"vectors\"]\nrelated: [\"dl\", \"llm\"]\ndate: \"2023-01-01\"\ndescription: \"Notebook for word vectors\"\n---\n\n
\n\n
", "source": "2023-01-01-word_vectors.md", "type": "markdown", "chunk_id": "2023-01-01-word_vectors.md_0", "embedding": [ -0.057466231286525726, 0.026326125487685204, -0.027564775198698044, -0.035587772727012634, 0.08335762470960617, 0.042468320578336716, -0.03339654952287674, -0.026681754738092422, 0.03857211768627167, -0.0349004752933979, 0.009015003219246864, 0.04979775473475456, -0.003126318333670497, 0.02715548500418663, -0.021853866055607796, 0.07599060237407684, -0.06893468648195267, 0.05087490752339363, 0.011908788233995438, -0.018598463386297226, -0.02005918323993683, 0.07731292396783829, 0.09312182664871216, -0.028732838109135628, 0.054017435759305954, 0.10114642977714539, -0.03323351964354515, 0.005779277998954058, -0.00285306922160089, 0.004989911336451769, 0.10079292953014374, 0.00815601833164692, 0.004884667228907347, 0.06491726636886597, -0.028349850326776505, 0.009679085575044155, -0.05058900639414787, 0.01140995230525732, -0.0017758203903213143, 0.0007704093004576862, -0.015876056626439095, -0.003506581299006939, -0.027839088812470436, 0.07533794641494751, 0.07011338323354721, 0.010857243090867996, -0.08947788178920746, -0.011606439016759396, -0.02639591507613659, 0.026117343455553055, -0.10077280551195145, -0.1336221694946289, 0.04106266796588898, 0.022120840847492218, -0.07853575795888901, 0.029258614405989647, -0.017072144895792007, -0.04846853390336037, 0.062098316848278046, -0.04349449649453163, 0.054975125938653946, 0.046388041228055954, 0.02833591029047966, -0.001940245507284999, -0.023790115490555763, -0.01807546615600586, -0.07321816682815552, 0.05045454204082489, -0.07078518718481064, 0.021626928821206093, -0.006904218345880508, 0.051808327436447144, 0.016966450959444046, -0.04804382845759392, -0.04228174313902855, 0.04165493696928024, -0.014581864699721336, -0.006426255218684673, 0.07867898792028427, -0.08732844889163971, -0.019402096047997475, 0.014643153175711632, 0.01661767065525055, 0.0152216712012887, 0.06465248018503189, 0.0732339471578598, 0.05842405930161476, -0.06629836559295654, 0.019542427733540535, -0.023309268057346344, 0.0016356054693460464, -0.09558132290840149, 0.13218916952610016, 0.06722971796989441, -0.04045006260275841, 0.023527082055807114, -0.015159236267209053, -0.06922653317451477, 0.025492960587143898, 0.05464676767587662, 0.02842479757964611, -0.011881481856107712, -0.03566775470972061, -0.012358976528048515, -0.05988498404622078, 0.018930649384856224, -0.014425089582800865, 0.05115943402051926, 0.013089976273477077, -0.03655202314257622, -0.05334049090743065, 0.07075142115354538, -0.024475933983922005, -0.0005850224406458437, -0.07285310328006744, -0.07522695511579514, -0.018025139346718788, -0.021948980167508125, 0.17177091538906097, -0.041759151965379715, 0.02451726235449314, 0.05653714761137962, -0.05785496532917023, -0.007149826735258102, -0.11985363811254501, -0.01241608988493681, 0.01730130985379219, 5.3908501536496274e-33, 0.014064897783100605, -0.0566587895154953, -0.058271728456020355, 0.060716062784194946, 0.06309787184000015, -0.012176820077002048, -0.09984549134969711, -0.003806624561548233, -0.09419525414705276, -0.02387555129826069, -0.10503768175840378, -0.034259993582963943, -0.07792676985263824, 0.053796280175447464, -0.03546556457877159, -0.07352451980113983, -0.012501023709774017, 0.0025871912948787212, 0.030189963057637215, -0.03113909251987934, -0.057209957391023636, -0.012217553332448006, -0.032816022634506226, -0.030974991619586945, -0.0604071170091629, 0.069814033806324, 0.02474643476307392, -0.08340314030647278, -0.044611960649490356, 0.011737929657101631, -0.015080858953297138, -0.0328463539481163, 0.016327209770679474, -0.05282621458172798, -0.039626531302928925, 0.010082180611789227, -0.03869931399822235, -0.01767597533762455, -0.011587433516979218, -0.01261694822460413, -0.023623181506991386, -0.06010650843381882, -0.034508150070905685, -0.1106787696480751, 0.024157347157597542, 0.12365235388278961, 0.10548312962055206, 0.05670711025595665, -0.02058718167245388, 0.018123367801308632, -0.03772979974746704, 0.022739237174391747, -0.0955415666103363, -0.0026665262412279844, 0.0016958172200247645, -0.007194053381681442, -0.030505282804369926, 0.06635967642068863, -0.01240368653088808, -0.057490307837724686, 0.04546096548438072, 0.09147349745035172, 0.12337606400251389, -0.06059861183166504, -0.010830373503267765, -0.025575492531061172, 0.027206920087337494, 0.08353649079799652, 0.04083995521068573, 0.027233894914388657, 0.014013784006237984, -0.0006719341035932302, -0.003679615678265691, -0.002419610507786274, -0.00569856958463788, -0.0059598349034786224, -0.02273779921233654, -0.09748956561088562, -0.046201083809137344, 0.06067322939634323, -0.07032408565282822, -0.08921713382005692, 0.001810691668651998, -0.06302136182785034, -0.01719745807349682, -0.04992533475160599, -0.0027242405340075493, -0.08979354053735733, 0.086887426674366, 0.049350809305906296, -0.007110899779945612, 0.0149405337870121, -0.024477895349264145, -0.014421407133340836, -0.031173735857009888, -5.603327737058464e-33, -0.04593868553638458, -0.05984235927462578, -0.043815597891807556, 0.03418426215648651, -0.005272803362458944, -0.017450176179409027, 0.05057283490896225, 0.14181596040725708, 0.01761690154671669, 0.06120159849524498, 0.01239617820829153, 0.025446215644478798, -0.012822133488953114, 0.018706543371081352, 0.07685067504644394, 0.10752179473638535, -0.03159159794449806, 0.0649079754948616, 0.002291143173351884, 0.044758256524801254, -0.012815647758543491, 0.04078800231218338, -0.01708904653787613, 0.04851232096552849, 0.10312215238809586, 0.03990501910448074, 0.06626889109611511, 0.037247445434331894, -0.045760516077280045, -0.06331955641508102, -0.030010856688022614, -0.02543463557958603, -0.050979070365428925, 0.05723825469613075, 0.035559941083192825, 0.0036830489989370108, 0.024193989112973213, -0.08321326225996017, 0.06503572314977646, -0.017991237342357635, -0.02332291565835476, 0.06373237073421478, -0.05365733429789543, -0.007030209992080927, -0.07701273262500763, 0.02020440436899662, 0.027860213071107864, 0.035231247544288635, 0.08914218097925186, 0.009397742338478565, 0.009717120788991451, 0.01306428574025631, 0.04890638589859009, -0.026530954986810684, -0.0024160698521882296, -0.03779261186718941, -0.004501090385019779, -0.0341426320374012, -0.05384804680943489, 0.0348527617752552, -0.0014968917239457369, -0.003136141924187541, -0.025972796604037285, -0.024225838482379913, 0.09568347036838531, -0.06532792747020721, -0.018353154882788658, 0.06683230400085449, -0.031274374574422836, -0.039811961352825165, 0.07509174942970276, 0.10225033760070801, -0.012272038497030735, -0.012963717803359032, 0.002958426484838128, -0.010415214113891125, 0.07402388006448746, 0.002978484844788909, 0.04325934126973152, -0.10845392942428589, 0.06462231278419495, 0.030121801421046257, 0.015137492679059505, -0.00037985885865055025, -0.03165455162525177, 0.016066819429397583, -0.05021513253450394, 0.05074800178408623, -0.02014351636171341, 0.036555882543325424, -0.012194696813821793, -0.03584667295217514, 0.03394242376089096, 0.09181888401508331, 0.04310043901205063, -5.011918702280127e-08, -0.05479831621050835, -0.08275237679481506, -0.055540040135383606, -0.030784033238887787, -0.05194462090730667, -0.05709460377693176, 0.022969430312514305, -0.015178791247308254, -0.056679751724004745, -0.039224959909915924, 0.0844748243689537, -0.00208871066570282, -0.09462009370326996, 0.06483019888401031, -0.016725962981581688, -0.019105784595012665, -0.04897753521800041, 0.0970584899187088, 0.012013324536383152, -0.0880466103553772, 0.06367969512939453, 0.011447414755821228, 0.009950085543096066, 0.06436086446046829, -0.01605844497680664, -0.020773230120539665, -0.06762329488992691, 0.004215390887111425, 0.09339185059070587, -0.04526413604617119, -0.022455263882875443, 0.03897082805633545, -0.07080394774675369, -0.0838889554142952, 0.011313035152852535, 0.07327767461538315, -0.08319135755300522, -0.010475515387952328, 0.02222745306789875, 0.04248075187206268, 0.05894828960299492, -0.018693698570132256, 0.012785476632416248, 0.005597501061856747, 0.026872150599956512, 0.03378256782889366, -0.01948968693614006, -0.0869431123137474, -0.013339129276573658, -0.08193406462669373, 0.0054568033665418625, 0.009887797757983208, 0.06136687099933624, 0.03843846172094345, -0.06504325568675995, -0.021378548815846443, -0.001696092775091529, 0.07808436453342438, 0.014589984901249409, -0.0443352609872818, 0.03419623523950577, 0.0731944888830185, 0.06912150233983994, 0.013876325450837612 ] }, { "text": "---\ntitle: \"Temperature\"\nid: \"temperature\"\ncategory: \"genai\"\ntags: [\"temperature\", \"llm\", \"video\"]\nrelated: [\"configuration\"]\ndate: \"2025-11-08\"\ndescription: \"A brief description of temperature parameter\"\n---\n\n# Temperature \n\n**Temperature** is a parameter which is injected into the **softmax function**, enabling the users to manipulate the \noutput probabilities. It helps us to control the **creativeness** of a Large Language Model.\n\nThe range of the temperature parameter is defined as 0 and 1 in OpenAI documentation. In the context of Cohere, \ntemperature values fall within the range of 0 to 5. _See the references below._\n\n-----------------------------------------------------\n\nThis is the original softmax function:", "source": "2023-10-16-Temperature_parameter.md", "type": "markdown", "chunk_id": "2023-10-16-Temperature_parameter.md_0", "embedding": [ -0.02267896570265293, -0.008450279012322426, -0.08491203933954239, 0.07451026141643524, 0.040533557534217834, 0.005947202909737825, -0.02299208752810955, -0.023142728954553604, 0.05564920976758003, -0.09765119850635529, 0.033927883952856064, -0.11538302153348923, 0.021051155403256416, -0.02178473398089409, 0.04936469346284866, -0.005945209413766861, 0.05345270037651062, -0.09893912076950073, -0.14264580607414246, -0.11312567442655563, 0.06165088340640068, 0.11285080015659332, -0.062020059674978256, -0.00032626191386952996, -0.003832089714705944, -0.0826876237988472, 0.013700416311621666, 0.03959425911307335, 0.058529872447252274, 0.09258541464805603, -0.03019954450428486, 0.043891068547964096, 0.0028649091254919767, 0.037816304713487625, 0.014036868698894978, 0.01648860238492489, -0.045845456421375275, -0.09513946622610092, -0.06727540493011475, 0.08595623075962067, 0.07530038803815842, 0.004610380623489618, 0.03455768898129463, 0.004733257927000523, 0.05909016728401184, 0.017676226794719696, -0.06821230798959732, -0.0447797067463398, -0.05814851447939873, -0.012675158679485321, -0.07334333658218384, 0.026609398424625397, -0.04712299630045891, 0.08250490576028824, -0.001472944742999971, 0.046114686876535416, -0.12811870872974396, -0.0599212609231472, 0.019154606387019157, -0.017387904226779938, 0.053871091455221176, -0.031775377690792084, -0.025110624730587006, 0.0045920489355921745, 0.09156618267297745, -0.09890315681695938, -0.006541167851537466, -0.03207945451140404, 0.027590518817305565, -0.02007613703608513, -0.023432759568095207, 0.06269916146993637, 0.04361662268638611, -0.05652324855327606, 0.018802335485816002, 0.05875960737466812, -0.004799257032573223, -0.044816143810749054, 0.07181002199649811, -0.06930454820394516, 0.03854154795408249, -0.10195980966091156, 0.07533954828977585, -0.048548970371484756, 0.03821505233645439, -0.014397677965462208, 0.07013104110956192, 0.03407934680581093, 0.039587296545505524, 0.039932794868946075, -0.031376179307699203, -0.052902135998010635, -0.006959924940019846, 0.031863290816545486, -0.046082910150289536, 0.0881253182888031, 0.022154059261083603, -0.038183532655239105, -0.03019961528480053, -0.01071093324571848, -0.06153704226016998, -0.0560171864926815, 0.004795399494469166, 0.10772449523210526, -0.041106127202510834, -0.10525410622358322, 0.05444016307592392, 0.0704818069934845, 0.01718660444021225, -0.00451204739511013, -0.06890761852264404, 0.044844020158052444, 0.08228282630443573, -0.07529406994581223, 0.06565042585134506, 0.026726102456450462, -0.07233838737010956, 0.03960757702589035, 0.07338900864124298, 0.018903164193034172, -0.015736736357212067, 0.0374286063015461, -0.05976327136158943, 0.06981892138719559, -0.02748238295316696, 0.08410925418138504, 0.01925593800842762, 8.753569394302675e-34, 0.13301625847816467, 0.030778948217630386, 0.006454422138631344, -0.017672808840870857, 0.030172545462846756, -0.008585100062191486, -0.06967566907405853, -0.02613786607980728, 0.012061839923262596, -0.020397331565618515, -0.04930123686790466, 0.057048700749874115, -0.07598216086626053, 0.020547781139612198, 0.004652701318264008, -0.0024021430872380733, -0.020989423617720604, 0.0519716702401638, 0.013337712734937668, 0.07089994102716446, -0.007436463143676519, 0.0795651376247406, -0.010970037430524826, 0.017256606370210648, -0.04909805208444595, 0.08739322423934937, 0.04661840200424194, -0.051099736243486404, -0.08686428517103195, 0.01393042504787445, -0.05696643143892288, -0.03029313124716282, -0.05175476521253586, -0.01876710169017315, 0.029182562604546547, -0.020277729257941246, -0.04796944931149483, -0.010973363183438778, -0.019991815090179443, -0.045705396682024, 0.00035186365130357444, 0.020326633006334305, -0.0029787253588438034, -0.030231785029172897, -0.01861533708870411, -0.028572149574756622, -0.021036406978964806, 0.07321425527334213, -0.09080299735069275, 0.004069747868925333, -0.09849730879068375, 0.02868378534913063, 0.021502232179045677, -0.012114706449210644, -0.003361606039106846, -0.07290370762348175, 0.047234829515218735, -0.02587251551449299, -0.003250479232519865, 0.01323071587830782, -0.03968431055545807, -0.014172275550663471, 0.03845950588583946, -0.044922370463609695, 0.04016352817416191, 0.10953528434038162, -0.02154369279742241, 0.022089723497629166, 0.07693268358707428, -0.018587734550237656, 0.05195651575922966, 0.0717485249042511, -0.0409979447722435, -0.02899508737027645, -0.010649703443050385, -0.028547002002596855, 0.11563197523355484, -0.08657188713550568, 0.03433847427368164, 0.004899618681520224, -0.08086902648210526, 0.055943336337804794, 0.04609854146838188, -0.03129461407661438, -0.12472127377986908, -0.06998869776725769, -0.04904250428080559, -0.017775526270270348, -0.023624757304787636, 0.010351031087338924, -0.012105055153369904, -0.033650629222393036, 0.032254427671432495, 0.0360073521733284, -0.06713442504405975, -1.5636741768744852e-33, -0.020336030051112175, -0.04295537620782852, -0.05841459333896637, 0.06181151792407036, -0.02792321890592575, -0.03925713151693344, 0.04356697201728821, 0.08782275766134262, 0.07236431539058685, -0.027789538726210594, 0.09145698696374893, -0.04774116724729538, 0.019319474697113037, -0.07473964244127274, 0.02656290866434574, -0.011625166982412338, -0.0876597985625267, 0.015387708321213722, 0.008872567676007748, 0.060932524502277374, -0.04024801775813103, 0.049102380871772766, -0.06789013743400574, 0.05998968333005905, 0.02678259089589119, 0.03669268265366554, 0.044358547776937485, -0.03501512110233307, -0.04102860018610954, -0.03472501412034035, -0.025908662006258965, -0.06951496750116348, -0.05856790766119957, 0.08798062801361084, -0.08710994571447372, 0.01764468289911747, 0.08962104469537735, -0.05596556141972542, 0.003294333815574646, -0.0024627172388136387, 0.010615787468850613, 0.017175376415252686, -0.017869889736175537, 0.04229796305298805, -0.028972765430808067, 0.08998706191778183, -0.0038946860004216433, -0.03242964297533035, 0.03315993398427963, -0.018645724281668663, 0.03402504324913025, -0.04877113178372383, -0.04396074265241623, 0.04233621060848236, -0.08703845739364624, 0.0038694445975124836, -0.08195778727531433, -0.0016292083309963346, -0.0028000224847346544, -0.00885536428540945, 0.013321666046977043, -0.05517707020044327, 0.02228623442351818, 0.03648226708173752, -0.04633689299225807, 0.032205741852521896, -0.010667741298675537, 0.040992558002471924, -0.0035469168797135353, -0.010345913469791412, 0.07914666831493378, -0.031792644411325455, 0.05390367656946182, 0.000541703833732754, 0.0009538915473967791, -0.08031457662582397, -0.005211533512920141, -0.025321602821350098, 0.01611768826842308, -0.017420347779989243, -0.09168427437543869, 0.031154511496424675, 0.012145536951720715, 0.0516025647521019, 0.07058795541524887, -0.0446229912340641, 0.07092226296663284, 0.040220774710178375, 0.03580097109079361, 0.06483516842126846, -0.04254397377371788, -0.00803410541266203, -0.07548251748085022, 0.07742229104042053, -0.012404411099851131, -5.832677274497655e-08, -0.05173221603035927, -0.04466206952929497, -0.00048427871661260724, 0.036376990377902985, 0.03833594545722008, -0.023304853588342667, 0.043815623968839645, -0.03887099027633667, 0.05823752284049988, 0.023399481549859047, 0.0751127153635025, 0.020370326936244965, -0.011562126688659191, -0.032898228615522385, -0.04967421293258667, -0.03912986442446709, -0.002605755114927888, 0.022131094709038734, 0.023874206468462944, -0.09276174753904343, 0.006962239276617765, -0.055677954107522964, 0.005874344147741795, -0.01990477368235588, 0.04889146238565445, -0.000624309410341084, -0.05346004292368889, 0.12640078365802765, 0.05335181951522827, -0.025256052613258362, -0.05755629390478134, 0.0031183320097625256, 0.06709418445825577, 0.005822245962917805, -0.046219706535339355, 0.09466177970170975, 0.027361899614334106, 0.10932156443595886, -0.059071134775877, 0.023772014304995537, -0.006998311262577772, 0.0040732696652412415, -0.06093200668692589, 0.0015299844089895487, 0.03993579372763634, -0.0373045988380909, -0.019874155521392822, -0.06439258903265, 0.04237434267997742, 0.04037926718592644, 0.021190496161580086, 0.016361353918910027, 0.012439414858818054, 0.0751902312040329, -0.035636402666568756, -0.08752291649580002, -0.032958805561065674, -0.007950845174491405, -0.01750975288450718, 0.02585255727171898, 0.012712135910987854, 0.0055895280092954636, -0.05200681462883949, 0.013970782980322838 ] }, { "text": "-----------------------------------------------------\n\nThis is the original softmax function: \n\n
\n \n
\n
\n\n\nWhen we add Temperature parameter:\n\n
\n \n
\n
\n\nRemember that zj is the output of the neural network: it is a floating number. If you want to learn more about \nsoftmax function, read [here](https://github.com/pelinbalci/Intro_Deep_Learning/blob/master/Intro_NN/notes/1_Perceptron_math.md#multiclass-classification--softmax:~:text=Multiclass%20Classification%20%26%20Softmax).", "source": "2023-10-16-Temperature_parameter.md", "type": "markdown", "chunk_id": "2023-10-16-Temperature_parameter.md_1", "embedding": [ -0.0669318288564682, -0.03640703484416008, -0.025721698999404907, 0.0915926843881607, 0.07445929199457169, -0.02636614814400673, 0.007516837678849697, 0.029721034690737724, 0.04208271577954292, -0.03435051813721657, 0.03270435333251953, -0.007360321003943682, 0.055014718323946, 0.026229731738567352, -0.049362536519765854, 0.005461270920932293, -0.05690392479300499, 0.008629553020000458, -0.15169702470302582, -0.022848015651106834, 0.03823873773217201, -0.09074776619672775, 0.06055267155170441, -0.04576313495635986, 0.026176927611231804, -0.02399519830942154, 0.041151124984025955, 0.07245048880577087, 0.04068391025066376, -0.009104825556278229, -0.010865654796361923, -0.005321995355188847, 0.04094668850302696, 0.006022079847753048, 0.004634025041013956, 0.07893282920122147, -0.018301067873835564, -0.06816839426755905, 0.01878291554749012, 0.01809673011302948, 0.015000582672655582, 0.017403336241841316, 0.017430659383535385, -0.05548173189163208, 0.08456157147884369, 0.04279498755931854, -0.0063620503060519695, -0.025942780077457428, 0.022546660155057907, 0.026230279356241226, 0.02130735106766224, 0.04774861037731171, -0.04507790505886078, 0.06574790179729462, 0.00041606088052503765, 0.06483925133943558, -0.040300313383340836, -0.037610024213790894, -0.003964157309383154, 0.011067078448832035, -0.0161671731621027, 0.005614371504634619, 0.05500113219022751, -0.05676579102873802, 0.13429366052150726, -0.08612892776727676, -0.05129702389240265, -0.02639118954539299, -0.05200665816664696, -0.02617545984685421, -0.002345239743590355, -0.017069198191165924, 0.017785970121622086, -0.08470270037651062, 0.002111585810780525, -0.07911397516727448, 0.035656604915857315, -0.047235969454050064, 0.003097563050687313, 0.00912686437368393, 0.04306555911898613, -0.08684520423412323, 0.07806270569562912, -0.025984961539506912, 0.06248190999031067, 0.0033809503074735403, 0.018234167248010635, 0.025290565565228462, 0.0022968400735408068, 0.03520471602678299, -0.042756348848342896, 0.0034734068904072046, -0.10997529327869415, 0.13075599074363708, -0.014507042244076729, 0.04822720214724541, -0.015701405704021454, 0.018551811575889587, -0.029418116435408592, 0.017595166340470314, -0.025236619636416435, -0.07803580164909363, 0.09969624131917953, -0.005599311552941799, 0.05556359887123108, -0.07030652463436127, 0.10983797162771225, 0.06324094533920288, -0.0009882953017950058, -0.05385180190205574, -0.07878728210926056, 0.046211231499910355, -0.053611889481544495, 0.017616091296076775, -0.04273548722267151, 0.017607344314455986, -0.014056218788027763, 0.004218513611704111, 0.02228114940226078, -0.0023521871771663427, 0.03073958307504654, 0.09811412543058395, -0.05226248502731323, 0.09455595910549164, 0.036980558186769485, -0.002328681293874979, -0.054826099425554276, 1.1400816651488045e-33, -0.01910335011780262, -0.012143476866185665, -0.059620168060064316, -0.058801181614398956, 0.026820087805390358, 0.017174798995256424, -0.015998251736164093, -0.026249852031469345, -0.08309965580701828, -0.01621250808238983, -0.07080765813589096, 0.07165752351284027, -0.0508308969438076, -0.00665512727573514, -0.02343961037695408, -0.06548748165369034, 0.03443945199251175, -0.0159895159304142, 0.02537795528769493, 0.0076342080719769, -0.03731146827340126, 0.03195022791624069, 0.011016122996807098, -0.007781079970300198, -0.02377364970743656, 0.10717544704675674, 0.06688877195119858, 0.07868530601263046, -0.08184357732534409, -0.011409418657422066, 0.028576847165822983, -0.03317605331540108, -0.040265366435050964, -0.059076063334941864, 0.0489976704120636, -0.020474636927247047, -0.011621867306530476, 0.07836034893989563, -0.038305092602968216, -0.030789652839303017, -0.043933022767305374, 0.01918075792491436, -0.03068583272397518, 0.03942202404141426, -0.026494858786463737, 0.03661174327135086, 4.5800290536135435e-05, 0.0859675258398056, 0.030303893610835075, -0.04977766424417496, -0.06878279894590378, -0.012319305911660194, -0.014793900772929192, -0.048247080296278, -0.05806645378470421, -0.04275694116950035, 0.018341470509767532, -0.017330540344119072, -0.07474208623170853, -0.035915765911340714, 0.04504777118563652, -0.012565010227262974, 0.0014341790229082108, 0.012594902887940407, 0.02400396391749382, 0.12153249233961105, -0.017517080530524254, 0.06570329517126083, 0.05558876320719719, -0.0022905964870005846, -0.03170491382479668, 0.054859332740306854, 0.08308742940425873, -0.0076673696748912334, 0.026979511603713036, 0.01552071887999773, 0.04937461391091347, -0.03852987289428711, -0.07058912515640259, 0.00539293373003602, -0.079278364777565, 0.08000949770212173, -0.0018286146223545074, -0.023628273978829384, -0.08419869095087051, 0.010433475486934185, -0.04821821674704552, -0.004650220274925232, 0.0039957668632268906, 0.05695458501577377, -0.03620605170726776, -0.06473672389984131, -0.02236553281545639, 0.0069622015580534935, -0.09125903993844986, -7.579044826319816e-34, -0.05071273818612099, 0.08074434101581573, -0.07462238520383835, 0.10834856331348419, -0.02376534603536129, 0.023511815816164017, 0.019373668357729912, -0.02069118432700634, 0.030654724687337875, 0.029855653643608093, 0.056619737297296524, -0.015068192034959793, -0.10634554177522659, -0.12303850799798965, 0.005868025589734316, 0.06981145590543747, -0.09108280390501022, 0.016343554481863976, -0.025792688131332397, -0.024040279909968376, 0.006703037302941084, 0.11960875988006592, -0.0021658886689692736, 0.07515686750411987, -0.05325063318014145, 0.048131149262189865, 0.03703273832798004, 0.006282484158873558, 0.02115676924586296, 0.006647867150604725, -0.06579131633043289, -0.04834059253334999, -0.07398665696382523, 0.007204514928162098, -0.006115370895713568, -0.023706134408712387, -0.0009635253227315843, -0.06097567081451416, -0.04206210374832153, 0.03075217641890049, 0.08428170531988144, -0.02551962435245514, -0.06576135754585266, 0.02071576751768589, 0.0011430480517446995, 0.07551641762256622, 0.08244457840919495, -0.09729884564876556, 0.04183041304349899, 0.03096780553460121, 0.07774682343006134, -0.053183358162641525, 0.03786519169807434, 0.061249177902936935, -0.011902417987585068, -0.0011475221253931522, -0.09614137560129166, 0.040244344621896744, 0.07100864499807358, 0.06735753268003464, 0.014549419283866882, -0.12249607592821121, -0.061507731676101685, 0.009202464483678341, -0.08197006583213806, 0.05281224474310875, -0.013484529219567776, 0.0033446436282247305, 0.05312305688858032, 0.06463904678821564, 0.08044689893722534, 0.0748601034283638, 0.1407575011253357, 0.019608832895755768, -0.06238483637571335, -0.0318700410425663, -0.03092033602297306, -0.00017699670570436865, -0.02396882325410843, -0.04610730707645416, 0.023455442860722542, -0.030406197533011436, -0.0550679937005043, 0.043257493525743484, 0.03569592162966728, -0.030255494639277458, 0.00023945176508277655, 0.050569843500852585, 0.00786349456757307, -0.054872822016477585, 0.0336388424038887, -0.016088655218482018, 0.016164930537343025, 0.030494900420308113, -0.09866068512201309, -5.1755648655671393e-08, -0.017032934352755547, -0.021342435851693153, -0.038620345294475555, -0.01076054573059082, 0.05582082271575928, 0.004917643032968044, 0.025004668161273003, -0.013142181560397148, -0.021544180810451508, -0.039517827332019806, 0.10454690456390381, 0.05116419866681099, 0.04100053757429123, -0.04406239092350006, -0.021718449890613556, -0.018487438559532166, 0.011150257661938667, 0.04767010360956192, 0.07190977782011032, 0.0162008348852396, -0.0035760351456701756, -0.0299508236348629, -0.03668976575136185, 0.023254433646798134, 0.0254379753023386, -0.008220062591135502, -0.08389188349246979, 0.0688943862915039, 0.040691763162612915, -0.027761656790971756, 0.06788214296102524, 0.034800510853528976, 0.09442884474992752, 0.00824665930122137, -0.07105225324630737, 0.03148958086967468, -0.016949987038969994, 0.005548469722270966, -0.05519378185272217, 0.08789059519767761, -0.037444572895765305, -0.016410501673817635, 0.03629705309867859, -0.011044615879654884, -0.05668746307492256, -0.03733783960342407, 0.019459571689367294, -0.11402171850204468, 0.1053835079073906, 0.07194134593009949, 0.10290797799825668, -0.02866559475660324, 0.0024942823220044374, 0.043506234884262085, 0.016550302505493164, -0.13165932893753052, 0.03938138484954834, -0.014110689982771873, -0.01838357001543045, 0.060179099440574646, 0.010246407240629196, 0.012608465738594532, -0.07804689556360245, -0.002351936884224415 ] }, { "text": "-----------------------------------------------------\n\n- As Temperature approaches 0, the output probabilities become more \"sharp\". One of the probability will be close to 1.\n- As Temperature increases, the output probabilities become more \"flat\" or \"uniform\", reducing the difference between the probabilities of different elements.\n\nIf we want repetitive answers, and no creativity at all, we can decrease the Temperature. If we want more creative answers, we can increase it.\n\n-----------------------------------------------------\n\n# Example \n\nLet's imagine that our corpus has only 5 words: [\"donut\", \"cake\", \"apple\", \"juice\", \"book\"]\n\nThe prediction of next token of given sentence: \"At the table, there is a delicious\" will be one of the words in the corpus.", "source": "2023-10-16-Temperature_parameter.md", "type": "markdown", "chunk_id": "2023-10-16-Temperature_parameter.md_2", "embedding": [ -0.04403766617178917, -0.021185927093029022, -0.002697412157431245, 0.07448246330022812, 0.008562478236854076, -0.001364055322483182, 0.045635417103767395, 0.01507722120732069, 0.1062382161617279, 0.03151177242398262, -0.009249565191566944, -0.10331802815198898, 0.10459059476852417, -0.055293209850788116, 0.0450889989733696, -0.027544602751731873, 0.03366314619779587, -0.02350449748337269, -0.12611129879951477, -0.14279787242412567, 0.04520950838923454, 0.015033242292702198, 0.02864890731871128, 0.004985438194125891, -0.002315906807780266, -0.018447227776050568, -0.011394712142646313, -0.043970368802547455, -0.04479965567588806, 0.033856794238090515, -0.023814285174012184, 0.0587165467441082, 0.0561554990708828, 0.01235585380345583, 0.0189227107912302, 0.0028506345115602016, -0.08948163688182831, 0.03819429501891136, 0.039027921855449677, -0.027877330780029297, -0.04536030814051628, 0.01729743368923664, -0.008392887189984322, 0.102854885160923, 0.05105971917510033, -0.030037183314561844, -0.08240944147109985, -0.0418747216463089, 0.028009366244077682, -0.008669335395097733, -0.1005820780992508, 0.053096264600753784, -0.020428556948900223, -0.033224817365407944, -0.04011569172143936, -0.04276253283023834, -0.04234111309051514, 0.04366440698504448, -0.006308572832494974, -0.047080639749765396, -0.03947039321064949, -0.02180667035281658, -0.08888477087020874, -0.02303066849708557, 0.08908586204051971, -0.13752301037311554, 0.03647107630968094, 0.03464968129992485, -0.0523943267762661, 0.1572996824979782, 0.003576923394575715, 0.07967351377010345, 0.035651154816150665, 0.04503372684121132, 0.06269610673189163, 0.010880977846682072, -0.0019429445965215564, -0.08138509094715118, 0.028237637132406235, 0.07952480018138885, -0.009764437563717365, -0.10740193724632263, 0.0848967581987381, -0.006676815450191498, -0.022486088797450066, -0.049587130546569824, 0.10452354699373245, 0.04449035972356796, -0.00040072709089145064, -0.03685532882809639, -0.10004352778196335, -0.10049404948949814, -0.017843900248408318, -0.047692183405160904, -0.004700587131083012, 0.09753695875406265, -0.006879832595586777, -0.05069316551089287, 0.005688263103365898, 0.028156111016869545, 0.061330314725637436, -0.0022747693583369255, -0.020463641732931137, -0.011096401140093803, 0.024469584226608276, -0.03546926751732826, -0.04066169261932373, 0.03231564909219742, 0.02358994446694851, -0.058981753885746, -0.026333795860409737, 0.006154057569801807, 0.021157007664442062, 0.008895418606698513, -0.0164530947804451, -0.032843250781297684, -0.03345050290226936, 0.025883501395583153, -0.05227948725223541, 0.05469746142625809, -0.013687893748283386, 0.07772281020879745, 0.024237487465143204, 0.04295244812965393, -0.04721158370375633, -0.002446207217872143, 0.09487058967351913, -2.9683654978651407e-33, 0.014989336021244526, 0.020814279094338417, -0.0042582289315760136, 0.00494654756039381, 0.059317752718925476, -0.034306254237890244, -0.06063849851489067, 0.0660267099738121, 0.023800868541002274, -0.02265252359211445, -0.011709058657288551, 0.013661199249327183, -0.00804975163191557, 0.0666089653968811, 0.07268063724040985, -0.04409228265285492, -0.04067425802350044, 0.02484441176056862, -0.0007284772000275552, 0.005253333132714033, -0.11510246247053146, 0.012756707146763802, 0.09733393043279648, -0.040301363915205, -0.03434482961893082, -0.022867638617753983, 0.03023262321949005, -0.046542901545763016, -0.08137866854667664, -0.012293814681470394, -0.05018460750579834, 0.03687765449285507, -0.05669057369232178, -0.08075267821550369, -0.030971813946962357, -0.040309879928827286, 0.008714682422578335, -0.005110916681587696, -0.01914396323263645, 0.027557305991649628, -0.07925044000148773, 0.04132075607776642, 0.07810664921998978, 0.05881651118397713, 0.06946001201868057, 0.09021531790494919, -0.012056036852300167, 0.011976012028753757, -0.10165857523679733, 0.00027637454331852496, -0.04119031876325607, -0.03685976192355156, 0.0842379704117775, 0.05171331763267517, 0.060325976461172104, 0.022760877385735512, 0.0559939369559288, -0.04078305512666702, 0.04281706362962723, 0.012791845016181469, -0.028482770547270775, 0.04617125913500786, -0.03249179571866989, -0.003075001062825322, 0.0505075603723526, 0.10632746666669846, -0.020857999101281166, 0.015388822183012962, 0.06707301735877991, 0.04869566857814789, 0.06009579449892044, 0.03390699252486229, -0.04461288079619408, -0.06562358886003494, -0.02319905534386635, 0.07287292927503586, 0.05972648411989212, -0.07725855708122253, 0.004279932007193565, -0.06180078163743019, -0.004313624929636717, -0.05660991743206978, -0.012548795901238918, -0.11387062072753906, -0.03550635650753975, -0.06861161440610886, 0.03892030194401741, -0.04831036180257797, -0.036704421043395996, -0.005092221312224865, -0.028026631101965904, -0.05633973702788353, 0.07557537406682968, 0.005597265437245369, -0.016825668513774872, 7.552676100307972e-34, -0.07379469275474548, -0.051370248198509216, -0.04601852968335152, 0.09912735223770142, -0.057323966175317764, 0.015820540487766266, -0.011768912896513939, -0.03707301616668701, -0.018463745713233948, -0.052456825971603394, -0.005819104146212339, 0.003967806231230497, 0.03605477139353752, -0.017031652852892876, -0.01679410971701145, -0.0026777677703648806, -0.008806005120277405, 0.12515129148960114, -0.04398684576153755, 0.10392939299345016, -0.03437567502260208, 0.06901752203702927, -0.06522787362337112, 0.0631178468465805, 0.03458086773753166, 0.03683490306138992, -0.01716383546590805, 0.01220199279487133, -0.039719779044389725, -0.018301816657185555, -0.07088634371757507, -0.0657663494348526, -0.006135938689112663, -0.07823985069990158, -0.011584896594285965, 0.034081391990184784, 0.05261656641960144, -0.03948168084025383, 0.012222723104059696, 0.04426540806889534, -0.008600790053606033, -0.03226236626505852, 0.02008630894124508, -0.026416907086968422, -0.005148088093847036, -0.04662540555000305, -0.07605811953544617, -0.02460101619362831, 0.027396980673074722, 0.09444008022546768, 0.10769310593605042, -0.02648419514298439, -0.14746107161045074, 0.02866792492568493, -0.02133725769817829, -0.04285142570734024, -0.10058390349149704, -0.0361628420650959, 0.011825153604149818, 0.07357096672058105, -0.0643327459692955, 0.019091667607426643, 0.039136163890361786, 0.045192815363407135, 0.03863693028688431, -0.03674373775720596, -0.08627792447805405, 0.02277234010398388, 0.0340963713824749, 0.01260362472385168, 0.050595514476299286, 0.049907948821783066, 0.008553965017199516, -0.02417411282658577, 0.012720159254968166, -0.013723297044634819, 0.02244708128273487, -0.03478352725505829, -0.033652421087026596, -0.04621148854494095, -0.05960303172469139, 0.03558863326907158, -0.032425206154584885, 0.023335395380854607, -0.03980490565299988, -0.03643490746617317, 0.021026475355029106, -0.029646093025803566, 0.04831821471452713, 0.05926235392689705, -0.04574417322874069, -0.025295719504356384, 0.017341800034046173, 0.05356935039162636, -0.045585062354803085, -6.640700433990787e-08, 0.0144203444942832, -0.017169838771224022, 0.0020369829144328833, 0.03872498497366905, 0.1117904856801033, 0.0005630661034956574, -0.006072062999010086, -0.03589573875069618, -0.005270086228847504, -0.08803538233041763, 0.12635476887226105, 0.0786130353808403, -0.003928573336452246, 0.039236076176166534, 0.022056395187973976, 0.05805610120296478, 0.025175778195261955, -0.002327422611415386, 0.0015766284195706248, -0.10502687096595764, 0.0576055645942688, 0.015685049816966057, -0.07382433116436005, -0.015178343281149864, -0.04541553556919098, 0.06503426283597946, -0.049239400774240494, 0.06791028380393982, 0.017679359763860703, -0.031390100717544556, -0.04891286417841911, -0.05005068704485893, -0.07963542640209198, 0.04431506246328354, 0.06754907220602036, -0.0067062294110655785, -0.014335879124701023, 0.0008591708028689027, 0.02811180241405964, -0.0030885450541973114, -0.009789661504328251, 0.013822718523442745, 0.006937890313565731, 0.050303682684898376, 0.0013285233872011304, -0.07204906642436981, -0.02176835760474205, 0.01904732920229435, 0.028679467737674713, 0.02789495326578617, -0.018608206883072853, -0.005654589738696814, -0.02482624351978302, -0.009626287035644054, 0.02142634242773056, -0.010961819440126419, -0.029050471261143684, 0.11297722905874252, -0.07606008648872375, 0.0808347836136818, 0.07033439725637436, 0.003840227611362934, -0.053099218755960464, -0.03678105026483536 ] }, { "text": "The prediction of next token of given sentence: \"At the table, there is a delicious\" will be one of the words in the corpus. \n\nThese are the original results: \n\n
\n \n
\n
\n\nYou can try different temperature values to see how the output changes.\n\n
\n\n
\n\nListen my YouTube Vide from [here](https://youtu.be/KbUPOJ8Fmzs)\n\nHappy Learning! :)", "source": "2023-10-16-Temperature_parameter.md", "type": "markdown", "chunk_id": "2023-10-16-Temperature_parameter.md_3", "embedding": [ -0.0481308177113533, -0.07973021268844604, -0.0060077449306845665, 0.03156687319278717, 0.12279707938432693, 0.06509892642498016, 0.0009006327018141747, -0.04196928068995476, 0.08430497348308563, -0.04137706384062767, 0.020970474928617477, -0.03435851261019707, 0.027586521580815315, -0.023042235523462296, -0.005431876517832279, -0.019086645916104317, 0.028906291350722313, 0.0440860316157341, -0.0634622573852539, -0.1649506837129593, 0.046500496566295624, 0.049420036375522614, 0.047168903052806854, 0.016999080777168274, 0.023800132796168327, 0.12417934089899063, -0.05228492617607117, 0.0880451500415802, 0.003661810653284192, -0.00949933286756277, -0.028260942548513412, -0.039015743881464005, 0.05418216437101364, 0.04383717104792595, -0.04926763102412224, -0.028221342712640762, -0.08137443661689758, -0.03186497837305069, 0.035257671028375626, 0.0005798271740786731, -0.028783176094293594, -0.06809984147548676, 0.04820083826780319, 0.02641371823847294, 0.05802880972623825, 0.024927057325839996, -0.09380864351987839, -0.04057485610246658, 0.012115935795009136, -0.022884080186486244, -0.12807737290859222, -0.04785411059856415, 0.049921441823244095, -0.00650945445522666, -0.08371704816818237, 0.0454426072537899, 0.031194470822811127, -0.05414757505059242, 0.09439418464899063, -0.01664784736931324, -0.02989554964005947, -0.03445904701948166, 0.04043179377913475, -0.010446326807141304, 0.0675467997789383, -0.06387247890233994, -0.046414367854595184, 0.06995800882577896, -0.0370008647441864, 0.06870966404676437, -0.031149374321103096, 0.04005737975239754, 0.0178492683917284, -0.009820695966482162, -0.03698890656232834, 0.007458062376827002, 0.03813851997256279, -0.03343895450234413, 0.01964765600860119, -0.0054883514530956745, 0.05824901908636093, -0.11450760066509247, 0.08620946109294891, -0.013755721040070057, 0.04156559333205223, 0.0072083440609276295, 0.1180570051074028, -0.028591962531208992, -0.04071672260761261, -0.0033126529306173325, -0.07014600187540054, -0.06613585352897644, -0.0104411281645298, 0.044980794191360474, -0.07257753610610962, 0.0984632819890976, -0.041354257613420486, -0.12802086770534515, 0.06055782362818718, 0.06355035305023193, -0.008084920234978199, -0.037387456744909286, 0.010218458250164986, -0.04570252448320389, -0.028602318838238716, -0.05431937053799629, 0.036892689764499664, 0.08824394643306732, 0.10259576886892319, -0.01636514998972416, -0.05392947793006897, 0.098264679312706, -0.011637254618108273, -0.016477320343255997, -0.07436611503362656, -0.03279632329940796, -0.0039884657599031925, -0.04084620997309685, 0.05037906393408775, 0.027606487274169922, 0.035342875868082047, 0.09005876630544662, -0.029039768502116203, 0.06344670802354813, -0.056982968002557755, -0.06028511002659798, 0.04016968980431557, 7.34253444457941e-33, -0.03741985931992531, -0.06270583719015121, -0.011048599146306515, -0.04819079115986824, 0.10256664454936981, 0.018443915992975235, -0.09802506864070892, 0.0029987837187945843, -0.04963561147451401, -0.02899925224483013, 0.013096082955598831, -0.0187930166721344, -0.05674440413713455, 0.09347981214523315, -0.019266696646809578, -0.057715944945812225, 0.012151657603681087, 0.02296820841729641, 0.010917496867477894, -0.011357496492564678, -0.1287718266248703, 0.04357192665338516, 0.023925401270389557, 0.0009497199789620936, -0.05815655738115311, 0.08551991730928421, 0.03339388966560364, -0.03597249463200569, -0.059660691767930984, -0.007387867663055658, -0.010093235410749912, -0.045117367058992386, -0.031192133203148842, -0.07692402601242065, 0.024570073932409286, -0.05977959185838699, -0.04509977251291275, 0.03336022049188614, -0.020637350156903267, -0.012251459993422031, -0.00861374195665121, 0.0027966981288045645, -0.01730150543153286, -0.01680879294872284, -0.06478488445281982, 0.06085466966032982, 0.009776489809155464, 0.0776473805308342, -0.05669074505567551, 0.029475536197423935, -0.024651650339365005, -0.008702644146978855, -0.033912621438503265, 0.009937257505953312, 0.06720781326293945, 0.048411764204502106, 0.016361815854907036, -0.0013657927047461271, 0.04817347973585129, -0.06838780641555786, 0.04397052899003029, 0.06135372444987297, 0.08937042951583862, -0.071288101375103, 0.0088729253038764, 0.11028621345758438, -0.00075034104520455, -0.04056722670793533, 0.06954973936080933, 0.023906318470835686, -0.018385468050837517, 0.024284230545163155, 0.0690784677863121, -0.015218749642372131, -0.03007933497428894, 0.004895143676549196, -0.04544803127646446, -0.06446032226085663, -0.017706571146845818, -0.01803487539291382, 0.013237630017101765, -0.04994456097483635, 0.018101179972290993, -0.04682863503694534, -0.05147060006856918, -0.019528374075889587, -0.02700701914727688, -0.07909530401229858, -0.029697509482502937, 0.004508150741457939, -0.021866928786039352, -0.027013514190912247, 0.018627574667334557, 0.02421802096068859, -0.022819992154836655, -6.752006490344603e-33, -0.0126120550557971, 0.11756400018930435, 0.01852964237332344, 0.09893538802862167, -0.007072232197970152, -0.03920583799481392, 0.034490473568439484, 0.03984608128666878, 0.09057436138391495, 0.0012507820501923561, 0.029424838721752167, -0.08098584413528442, -0.08039745688438416, -0.08911582082509995, 0.003532366594299674, 0.12755948305130005, 0.024989912286400795, 0.03981455788016319, -0.033817797899246216, 0.06734652817249298, -0.05423559993505478, 0.07195115089416504, -0.020964760333299637, 0.0827464833855629, -0.02675662189722061, 0.03824755176901817, 0.10529284179210663, 0.05083034560084343, -0.08139761537313461, -0.04127837345004082, -0.029131215065717697, -0.05270079895853996, -0.07245437800884247, 0.02589753456413746, -0.013563350774347782, 0.008179672993719578, 0.023411765694618225, -0.08905752748250961, 0.03487175330519676, 0.03540412709116936, 0.05486784130334854, 0.07020639628171921, -0.05445486679673195, -0.058227669447660446, -0.04002173990011215, 0.03973047435283661, -0.00745310029014945, 0.05524545535445213, 0.040183234959840775, 0.014583170413970947, 0.024310607463121414, -0.013581819832324982, -0.046503592282533646, -0.005888104904443026, -0.024329951032996178, -0.05371902883052826, -0.05912453681230545, -0.009404558688402176, -0.02627832442522049, 0.001379914814606309, -0.02578677050769329, -0.0034956170711666346, 0.034838851541280746, -0.004436044488102198, 0.03891899436712265, -0.04143544286489487, -0.08458075672388077, 0.04736453667283058, 0.06079587712883949, 0.06585440039634705, 0.06525800377130508, 0.054902322590351105, 0.05832812935113907, -0.0034687244333326817, 0.008602757938206196, -0.029275713488459587, 0.018139922991394997, -0.02983778901398182, -0.04366503283381462, -0.05875866860151291, -0.016900960355997086, 0.05279620364308357, 0.008133524097502232, -0.03331548720598221, 0.020372068509459496, 0.07522561401128769, -0.023393286392092705, 0.02041342295706272, 0.045768626034259796, 0.030222691595554352, -0.013107397593557835, 0.0016630166210234165, 0.014156739227473736, 0.08635632693767548, 0.044555459171533585, -6.267499230716567e-08, -0.03929685428738594, -0.08988424390554428, -0.04778079316020012, 0.038038041442632675, 0.02145937643945217, -0.016405442729592323, 0.030062483623623848, -0.007693544030189514, -0.005494097713381052, -0.07848823815584183, 0.12162627279758453, 0.0700976625084877, -0.02323639765381813, 0.0437358058989048, -0.06872746348381042, 0.028074422851204872, -0.005723961628973484, 0.02286183461546898, 0.030787020921707153, -0.028594786301255226, 0.03683219477534294, 0.05055881291627884, 0.014333244413137436, -0.012419718317687511, -0.0183802992105484, 0.02370879240334034, -0.0912502259016037, 0.04268953576683998, -0.014654452912509441, -0.04839210957288742, 0.03881742060184479, 0.0013361090095713735, -0.07758758217096329, -0.04314277693629265, 0.02503863535821438, 0.01496351882815361, -0.060498032718896866, -0.05558785796165466, -0.00917127262800932, 0.08194926381111145, 0.03287448361515999, -0.015474585816264153, -0.060981035232543945, 0.023955054581165314, -0.018923666328191757, 0.008280315436422825, 0.04998807981610298, -0.09786736220121384, 0.07957349717617035, -0.021916557103395462, 0.043381623923778534, -0.03934567794203758, -0.0575234554708004, 0.02785142883658409, 0.061957813799381256, -0.08393742144107819, 0.013996402733027935, 0.10425663739442825, -0.03532204031944275, 0.05761338397860527, 0.02033841982483864, -0.004614402074366808, -0.012956507503986359, -0.026041103526949883 ] }, { "text": "Listen my YouTube Vide from [here](https://youtu.be/KbUPOJ8Fmzs)\n\nHappy Learning! :)\n\n# References\n- [1] https://platform.openai.com/docs/api-reference/audio/createTranscription#audio/createTranscription-temperature\n- [2] https://txt.cohere.com/llm-parameters-best-outputs-language-ai/\n- [3] https://peterchng.com/blog/2023/05/02/token-selection-strategies-top-k-top-p-and-temperature/", "source": "2023-10-16-Temperature_parameter.md", "type": "markdown", "chunk_id": "2023-10-16-Temperature_parameter.md_4", "embedding": [ -0.040537029504776, -0.09490678459405899, -0.05883649364113808, -0.02657630480825901, -0.009884352795779705, 0.04067230969667435, 0.02497183531522751, -0.0034771496430039406, -0.006557341665029526, -0.03068956360220909, -0.03178155794739723, -0.04951808601617813, 0.020562604069709778, -0.04462116211652756, 0.06148570030927658, 0.017178434878587723, 0.10814297199249268, 0.09849921613931656, -0.04787503182888031, -0.16986875236034393, 0.08548010140657425, 0.004582184832543135, 0.03437143191695213, -0.009473956190049648, 0.03316633775830269, 0.030981525778770447, 0.011102136224508286, 0.05318216234445572, 0.05185028538107872, -0.008430492132902145, -0.028396788984537125, 0.03830384090542793, 0.10129376500844955, -0.01106743048876524, -0.08977612107992172, -0.045845046639442444, -0.0636335164308548, -0.12093500047922134, -0.040217865258455276, -0.010341586545109749, 0.015858812257647514, 0.02120988629758358, 0.03889632225036621, -0.07442308962345123, 0.03902382031083107, 0.049800094217061996, -0.08131962269544601, 0.0054030041210353374, -0.03043993189930916, -0.020492486655712128, -0.06727393716573715, -0.05915191397070885, 0.005353034473955631, 0.04370754584670067, -0.10177794098854065, 0.03308168798685074, -0.018387801945209503, -0.021445877850055695, 0.0635511726140976, -0.013545197434723377, 0.02500205859541893, -0.00860664714127779, -0.04978477954864502, 0.014721783809363842, 0.09771035611629486, -0.07700387388467789, 0.018165506422519684, 0.08652064204216003, 0.004682174883782864, 0.018618503585457802, -0.10184085369110107, 0.040571365505456924, 0.020185163244605064, 0.021420441567897797, 0.016429733484983444, 0.010455247946083546, 0.06488031148910522, -0.05958505719900131, -0.01075051911175251, -0.02765950746834278, 0.05432472750544548, -0.07100574672222137, 0.02247435599565506, 0.0276230126619339, 0.04361811280250549, -0.0022711465135216713, 0.08456459641456604, -0.03457207605242729, 0.03754212707281113, 0.040812600404024124, -0.08192400634288788, -0.016958126798272133, 0.009509008377790451, -0.024911027401685715, 0.031296681612730026, 0.08303329348564148, -0.05718943104147911, -0.0872936025261879, 0.02799886465072632, 0.013053388334810734, -0.02960875630378723, -0.056163232773542404, -0.007006110157817602, 0.02992093935608864, -0.031312648206949234, -0.06968489289283752, 0.017817074432969093, 0.04787614196538925, 0.08031085878610611, -0.015475695952773094, -0.016141261905431747, 0.006478327326476574, 0.02154729887843132, -0.071723073720932, 0.07192371040582657, 0.06959372758865356, -0.010912849567830563, 0.014741000719368458, 0.09179066866636276, 0.052072908729314804, -0.025474777445197105, -0.06042858958244324, -0.03967326879501343, 0.06572382152080536, -0.02197474241256714, 0.036931853741407394, 0.02715669758617878, 7.428857055903037e-34, 0.04667815566062927, 0.02814592607319355, -0.003672996535897255, 0.005845167674124241, 0.06439801305532455, -0.036086007952690125, -0.014327742159366608, -0.02462441474199295, -0.01107522752135992, 0.0014011015882715583, -0.029929878190159798, 0.01901327446103096, -0.043518517166376114, 0.023137178272008896, 0.016919096931815147, -0.08942662179470062, -0.060954466462135315, 0.10478347539901733, -0.03050961159169674, 0.020246347412467003, 0.001832769368775189, 0.03250782564282417, 0.0481879748404026, 0.0019209592137485743, 0.07744067907333374, 0.034089136868715286, 0.05249829590320587, -0.08320511877536774, -0.012970213778316975, 0.01579107902944088, -0.03683127835392952, -0.0762709528207779, -0.04595443606376648, 0.005591518245637417, 0.014141522347927094, 0.03307654336094856, -0.14648032188415527, 0.020687779411673546, -0.009781744331121445, -0.03864607959985733, 0.005221265368163586, 0.049589693546295166, 0.026858555153012276, -0.04517242684960365, -0.07576635479927063, 0.004695229697972536, -0.06563805788755417, 0.04699382185935974, 0.02086642012000084, -0.01881459914147854, -0.012507558800280094, 0.03933170437812805, -0.050679516047239304, -0.011431113816797733, 0.06319655478000641, -0.06291051208972931, 0.0778631716966629, 0.04638127237558365, 0.006115596741437912, 0.008002961054444313, -0.049850523471832275, 0.05364386737346649, 0.03716926649212837, -0.07639797031879425, -0.0004773888213094324, 0.07728806138038635, -0.02403150498867035, -0.03397820144891739, 0.08599041402339935, -0.04643282666802406, -0.01908472366631031, 0.07624533027410507, 0.05661008134484291, -0.02090900018811226, -0.05148673057556152, 0.03793586045503616, 0.06050214171409607, -0.11557109653949738, 0.009571654722094536, -0.06254081428050995, -0.03858703747391701, 0.0542161799967289, 0.0052873846143484116, -0.03005821257829666, -0.004648083355277777, -0.0814027413725853, -0.030632834881544113, -0.08147643506526947, 0.016513140872120857, 0.03475097194314003, -0.08425683528184891, 0.0033300782088190317, 0.021554162725806236, 0.04356427118182182, -0.0118826013058424, 5.8878578895494256e-34, 0.0021733371540904045, 0.07925845682621002, 0.052719902247190475, 0.13094264268875122, -0.06699366867542267, 0.0009273530449718237, 0.046767380088567734, 0.044926717877388, 0.04655514657497406, 0.023722505196928978, 0.004394215531647205, -0.06278730928897858, 0.03050198405981064, -0.06557769328355789, 0.016767725348472595, -0.04288755729794502, -0.06990575045347214, 0.011336812749505043, 0.0910506322979927, 0.03462405875325203, -0.011920290999114513, 0.029890671372413635, -0.05488996580243111, 0.021608751267194748, -0.05662826821208, 0.011690305545926094, -0.05116217955946922, 0.034337520599365234, 0.006328250281512737, -0.05754917487502098, -0.04869794100522995, -0.0144827701151371, -0.08035310357809067, -0.010695078410208225, -0.05120579153299332, 0.03982891887426376, 0.10049819946289062, 0.07919143885374069, 0.015432586893439293, 0.05824475735425949, 0.04317266494035721, 0.014907286502420902, 0.0032615098170936108, -0.05686016008257866, -0.04471580311655998, 0.026984382420778275, -0.04659107327461243, 0.04482930898666382, -0.02010163478553295, -0.04836903512477875, 0.0968589261174202, -0.06643889844417572, -0.07847905904054642, -0.005404283292591572, -0.0835009291768074, -0.03008178249001503, 0.04347109794616699, 0.004953276365995407, -0.026963595300912857, -0.022321846336126328, -0.028969554230570793, -0.09466831386089325, 0.023742273449897766, 0.023510023951530457, -0.048223838210105896, 0.004566187039017677, 0.026065971702337265, 0.08491065353155136, -0.0015642649959772825, -0.025754263624548912, 0.014265173114836216, -0.005753791891038418, 0.11137637495994568, 0.01106075756251812, -0.020452192053198814, -0.0583016574382782, 0.005450725555419922, -0.0665091797709465, -0.02176090143620968, -0.032240670174360275, -0.09889567643404007, 0.06532268971204758, -0.041664592921733856, 0.07866466045379639, 0.09338188171386719, 0.15256112813949585, 0.08865369856357574, 0.004098108969628811, 0.04527899995446205, 0.051607001572847366, -0.009265965782105923, 0.08568517863750458, 0.01896783336997032, 0.05570300668478012, -0.018568554893136024, -5.037998462853466e-08, -0.05052871257066727, -0.09838829934597015, 0.013862605206668377, 0.08973380923271179, -0.01482483372092247, -0.008896056562662125, 0.011028097942471504, -0.033854447305202484, 0.043402720242738724, -0.030917830765247345, 0.03932729363441467, 0.05822385102510452, -0.030274344608187675, 0.043904293328523636, -0.01755521446466446, -0.02034151926636696, -0.02731078304350376, 0.12072627246379852, -0.028795436024665833, -0.0837184339761734, 0.04316727817058563, 0.06898500770330429, 0.06992309540510178, -0.04582497105002403, 0.052467141300439835, 0.006898853462189436, 0.01616673916578293, 0.06786996126174927, 0.03731260076165199, -0.023791950196027756, -0.08022574335336685, 0.03139938414096832, -0.014141383580863476, -0.10136908292770386, 0.03879579156637192, 0.061884805560112, -0.02861662581562996, 0.013350344263017178, -0.07298416644334793, 0.021862957626581192, 0.05277545750141144, 0.026692518964409828, -0.06572523713111877, 0.0038520970847457647, 0.007846402004361153, -0.0422876812517643, 0.0037428231444209814, -0.06635129451751709, 0.03434625267982483, 0.03463320434093475, -0.010311895050108433, -0.004541260190308094, -0.009397944435477257, 0.05261204019188881, 0.05100654065608978, 0.009793984703719616, -0.062111202627420425, 0.004849147982895374, 0.00031118266633711755, 0.07327313721179962, 0.019415082409977913, 0.027833502739667892, -0.06178009882569313, 0.03934454172849655 ] }, { "text": "---\ntitle: \"Introduction to Agentic Architecture\"\nid: \"agentic-architecture\"\ncategory: \"genai\"\ntags: [\"agents\", \"LLM\", \"autonomous systems\", \"AI architecture\"]\nrelated: [\"llm\"]\ndate: \"2025-11-25\"\ndescription: \"An overview of agentic AI systems, frameworks, and protocols that enable autonomous LLM-powered agents\"\n---\n\n# Introduction to Agentic Architecture\n\n**This article is generated by Claude Opus 4.5**\n\n## Overview\n\nAgentic architecture represents a paradigm shift in how we build AI systems. Instead of simple prompt-response interactions, agentic systems can plan, reason, use tools, and execute multi-step tasks autonomously. These systems transform Large Language Models (LLMs) from passive responders into active problem-solvers.", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_0", "embedding": [ -0.009958402253687382, -0.011931941844522953, -0.009814955294132233, -0.0002898497332353145, 0.03269871696829796, -0.01440791692584753, 0.013803116977214813, 0.04012748971581459, 0.03475240245461464, 0.03283728286623955, -0.062469348311424255, -0.06488378345966339, 0.059586722403764725, 0.029115568846464157, 0.07875971496105194, 0.03325836360454559, 0.057304710149765015, -0.0020404858514666557, -0.06571462750434875, -0.05966833606362343, 0.014977811835706234, 0.05163451284170151, -0.017182718962430954, 0.007447779644280672, -0.08139718323945999, 0.025280343368649483, 0.019789211452007294, -0.07057192176580429, -0.003923526965081692, 0.00846177525818348, 0.07680484652519226, 0.027542240917682648, 0.06906534731388092, 0.05285337567329407, -0.0525146946310997, 0.06482508033514023, -0.07689189165830612, -0.009090862236917019, 0.004676441196352243, -0.08941687643527985, -0.04741789028048515, -0.04538841173052788, -0.005897948984056711, -0.05487098544836044, 0.08412674814462662, -0.011314659379422665, -0.10680894553661346, -0.011964627541601658, -0.007794358301907778, -0.02696160227060318, -0.1630350798368454, -0.07969597727060318, 0.05048687756061554, 0.0714746043086052, -0.0671066865324974, 0.011288841255009174, 0.033561982214450836, 0.017448678612709045, 0.015793204307556152, -0.07333891093730927, -0.0426894947886467, -0.06655310094356537, -0.010242327116429806, 0.02469187043607235, -0.03199099376797676, 0.07366510480642319, -0.01871884986758232, -0.01106553990393877, -0.012421767227351665, -0.03807881474494934, -0.01502777449786663, -0.019418302923440933, 0.041622668504714966, -0.010659976862370968, -0.008675673976540565, 0.02335001341998577, 0.006005449686199427, 0.024308739230036736, 0.06523063033819199, -0.05420691892504692, -0.03716018423438072, -0.037027377635240555, -0.00176865269895643, 0.046882618218660355, 0.04036175087094307, 0.031236495822668076, -0.024915801361203194, 0.023514652624726295, 0.05483241751790047, 0.021684564650058746, -0.038825925439596176, -0.08033589273691177, 0.10490972548723221, 0.038594670593738556, 0.06484834849834442, 0.038664475083351135, -0.02824210189282894, -0.11333245038986206, -0.060252685099840164, 0.04651254415512085, -0.024799205362796783, 0.047404494136571884, -0.019758140668272972, -0.018898524343967438, -0.06694743037223816, -0.0006287334254011512, 0.03946854546666145, 0.01440334040671587, 0.007743096444755793, -0.0688781589269638, -0.05535877123475075, -0.008416992612183094, 0.11079368740320206, -0.009591298177838326, 0.08131080120801926, -0.038728710263967514, 0.030490687116980553, 0.008982659317553043, 0.060441747307777405, -0.01882905140519142, 0.03014584630727768, -0.011723985895514488, -0.013136720284819603, 0.04124370962381363, 0.11527623236179352, 0.009792917408049107, 0.006056648679077625, 8.509668091831474e-34, 0.035916220396757126, 0.022051136940717697, 0.039218124002218246, 0.10707943141460419, 0.04164007306098938, -0.0574045293033123, 0.06528020650148392, 0.031051887199282646, -0.0038340457249432802, -0.008303198963403702, -0.015736043453216553, 0.023312093690037727, -0.013455078937113285, 0.09019824862480164, 0.004552575759589672, -0.05402728170156479, 0.0011355038732290268, 0.038956787437200546, -0.019563274458050728, -0.05537765473127365, -0.004756601061671972, 0.002244570292532444, 0.09656678885221481, -0.011081361211836338, 0.0768933966755867, 0.06749371439218521, 0.025652630254626274, -0.10873997956514359, 0.008655221201479435, 0.011058290489017963, -0.09970073401927948, 0.01484229788184166, -0.05227242037653923, 0.0985889658331871, -0.05907204747200012, 0.023779718205332756, -0.0701257511973381, -0.023242933675646782, 0.016698528081178665, 0.0026703339535743, -0.042308028787374496, 0.041880931705236435, 0.02965964563190937, -0.016062472015619278, -0.004126530606299639, -0.010273192077875137, -0.05035431683063507, 0.006620028987526894, 0.0037448883522301912, -0.056019414216279984, 0.029543008655309677, 0.052592165768146515, -0.008854555897414684, -0.017508070915937424, 0.03840203955769539, -0.01106702908873558, -0.028599286451935768, 0.04441366344690323, -0.02091478370130062, 0.02325604483485222, 0.025269143283367157, 0.009297438897192478, -0.0038550514727830887, 0.09371785819530487, 0.12627176940441132, -0.007006553467363119, -0.026852982118725777, 0.06228313967585564, 0.0764409676194191, -0.007904808968305588, 0.001816579489968717, 0.010597562417387962, 0.02724161557853222, 0.06117815524339676, -0.043542228639125824, -0.030281301587820053, 0.032244134694337845, -0.12738779187202454, 0.054670918732881546, 0.027845855802297592, -0.04921071603894234, -0.02961522899568081, -0.09245031327009201, 0.012603066861629486, 0.06762522459030151, -0.059098467230796814, -0.044248491525650024, -0.04905826598405838, -0.04277321323752403, -0.009390732273459435, -0.04510238394141197, -0.003742653178051114, -0.03959638997912407, 0.11599058657884598, -0.027122722938656807, -3.061634362447166e-33, -0.008018789812922478, -0.050084467977285385, -0.15472203493118286, 0.07795577496290207, -0.04582890868186951, -0.07987011224031448, -0.07608873397111893, -0.0060052890330553055, 0.02184673771262169, -0.005102795083075762, -0.05308636650443077, -0.03625600412487984, 0.07175438106060028, 0.005345368757843971, 0.03333909809589386, -0.05946847051382065, 0.015900446102023125, -0.03897399455308914, 0.02459024079144001, 0.035443056374788284, -0.004590269643813372, 0.09269219636917114, -0.08697748184204102, -0.038460515439510345, 0.011577866971492767, -0.006137384567409754, 0.02510732412338257, 0.05803357809782028, 0.02648717723786831, 0.0516175851225853, -0.029507553204894066, -0.023220406845211983, -0.012880513444542885, 0.013954746536910534, 0.0016371618257835507, 0.08063651621341705, -0.010235527530312538, -0.008403574116528034, -0.020787011831998825, 0.03552532568573952, 0.08977730572223663, -0.08475351333618164, -0.07876196503639221, 0.0038602426648139954, -0.014476170763373375, 0.0250022541731596, -0.07809879630804062, 0.02161087654531002, -0.049022238701581955, -0.044063497334718704, 0.0068032145500183105, -0.05067455768585205, -0.03339312970638275, -0.08045478910207748, -0.07428433001041412, -0.03621212765574455, 0.047049734741449356, -0.013836538419127464, -0.012508876621723175, -0.025923103094100952, -0.017467975616455078, -0.002198529429733753, 0.06623036414384842, -0.002196036744862795, -0.03622446954250336, 0.03913899138569832, -0.04267631843686104, 0.0057965237647295, -0.018570177257061005, -0.05984325706958771, 0.1292305290699005, -0.010116792283952236, -0.04986322671175003, 0.06970494240522385, 0.05789349228143692, -0.03156911954283714, -0.08867929130792618, -0.09100904315710068, 0.004318130202591419, -0.09395211189985275, -0.02463754452764988, 0.04955575615167618, 0.03950025886297226, 0.04900446534156799, -0.0286075659096241, 0.0357600636780262, 0.0038938431534916162, 0.08436663448810577, 0.021249881014227867, 0.012650350108742714, 0.03757099434733391, 0.05143478512763977, 0.030420327559113503, 0.07943995296955109, -0.12443044036626816, -4.5503842471816824e-08, -0.017392205074429512, 0.03395722806453705, 0.038359303027391434, 0.027204148471355438, 0.019232364371418953, -0.044068071991205215, -0.01978014037013054, -0.03158467635512352, -0.015426336787641048, -0.018319541588425636, 0.02979346364736557, -0.017250938341021538, 0.03522421792149544, 0.008650013245642185, 0.06757946312427521, 0.027596386149525642, -0.017292240634560585, -0.002574098529294133, -0.03175905719399452, -0.09125101566314697, 0.11860563606023788, -0.03628428652882576, -0.051510121673345566, -0.012669489718973637, 0.048673804849386215, -0.0451582670211792, -0.04589645564556122, 0.003942824434489012, -0.014336390420794487, 0.06420541554689407, 0.0074895648285746574, -0.007098504342138767, -0.01497107557952404, 0.021103285253047943, 0.06477662920951843, 0.05849924683570862, 0.05554208904504776, -0.13490226864814758, -0.012983502820134163, -0.1197846531867981, -0.014680511318147182, 0.019202129915356636, -0.09201212227344513, -0.03022470511496067, 0.04180603846907616, 0.007719989866018295, -0.0460219644010067, -0.13787752389907837, 0.03323042765259743, -0.057457901537418365, -0.0483018234372139, -0.02351723611354828, 0.019340984523296356, 0.09764371812343597, 0.060831960290670395, 0.0332208089530468, 0.0645819753408432, -0.05931466445326805, 0.10045205801725388, 0.017554741352796555, 0.06244349107146263, 0.09674072265625, -0.019244147464632988, -0.06243516877293587 ] }, { "text": "## What Makes an AI System \"Agentic\"?\n\nAn agentic system exhibits several key characteristics that distinguish it from traditional LLM applications:\n\n- **Autonomy**: The ability to make decisions and take actions without constant human intervention\n- **Tool Use**: Integration with external tools, APIs, and data sources to accomplish tasks\n- **Planning**: Breaking down complex goals into manageable steps\n- **Memory**: Maintaining context across interactions and learning from past experiences\n- **Reflection**: Self-evaluation and course correction when things go wrong", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_1", "embedding": [ 0.02512788027524948, -0.06010221317410469, -0.04925939440727234, -0.04980865493416786, 0.06632101535797119, -0.04405766353011131, -0.017055220901966095, 0.063434898853302, -0.013900435529649258, 0.07996160537004471, -0.0404592826962471, 0.00015043767052702606, 0.07643767446279526, -0.001456465688534081, 0.06734173744916916, 0.03203115984797478, 0.07548993825912476, -0.027760542929172516, -0.04370415210723877, 0.011401470750570297, 0.045763418078422546, 0.018752384930849075, -0.06569626927375793, -0.00853720959275961, -0.09387049823999405, 0.06384335458278656, 0.032280195504426956, -0.05856844410300255, -0.0422801673412323, -0.021727757528424263, 0.05116654559969902, 0.05233127251267433, 0.05771912634372711, 0.012935946695506573, 0.017491504549980164, 0.03840941935777664, -0.048260971903800964, -0.027433758601546288, 0.05969204008579254, -0.011555097065865993, -0.02697945386171341, -0.0513932928442955, -0.004429580643773079, -0.0646304339170456, 0.07339926064014435, 0.08559848368167877, -0.0598088763654232, -0.07422517240047455, -0.02323029935359955, -0.0075130704790353775, -0.12612244486808777, 0.017007319256663322, 0.0112195098772645, 0.004964783787727356, -0.11413418501615524, -0.04853997007012367, 0.017769651487469673, 0.0308298971503973, -0.04123707860708237, -0.054889556020498276, 0.011118828319013119, -0.008800511248409748, 0.019978996366262436, 0.04518445208668709, -0.032396212220191956, 0.03378499299287796, -0.05778098851442337, -0.040068358182907104, 0.04796481877565384, -0.10047810524702072, 0.02776324935257435, -0.0367450937628746, 0.007462265435606241, -0.010677295736968517, -0.005251642316579819, -0.023788845166563988, 0.029248038306832314, 0.0016259995754808187, 0.049768269062042236, -0.05017266049981117, -0.03286202251911163, 0.042648717761039734, 0.0339052714407444, 0.14042094349861145, -0.039626799523830414, 0.01668580435216427, -0.025683710351586342, 0.020325545221567154, 0.04388329014182091, -0.004648091271519661, 0.026383915916085243, -0.08113529533147812, 0.025715453550219536, -0.040229931473731995, 0.10879714787006378, 0.0355437807738781, -0.01911783590912819, -0.11232897639274597, -0.04879516735672951, 0.02485269121825695, -0.05769183486700058, -0.015361394733190536, -0.0321466401219368, 0.024122415110468864, -0.016745686531066895, 0.012567466124892235, 0.06833375990390778, -0.03244698792695999, 0.04672037065029144, -0.05892638862133026, -0.049640633165836334, -0.033728718757629395, 0.0420890636742115, -0.015047150664031506, 0.10212921351194382, -0.06259707361459732, 0.03565334901213646, 0.06828223168849945, 0.04180709272623062, 0.005103020928800106, 0.011119270697236061, -0.06653200834989548, 0.04632129520177841, 0.03664418309926987, 0.07206697762012482, 0.025682365521788597, -0.013247068040072918, -6.880595011242503e-34, -0.03451409935951233, 0.004148928914219141, 0.044458165764808655, -0.006977868732064962, 0.013024300336837769, -0.07876212149858475, 0.045837290585041046, 0.027086755260825157, 0.005181319545954466, 0.026999277994036674, -0.01885841228067875, 0.06712540984153748, -0.016391301527619362, 0.09921888262033463, 0.03639278560876846, 0.013792433775961399, -0.03153614699840546, 0.004903736058622599, 0.025273079052567482, -0.0058324760757386684, 0.03784686699509621, 0.04717741534113884, 0.08393566310405731, -0.03772743418812752, 0.06156864017248154, 0.04846625402569771, -0.007129043340682983, -0.0589478574693203, 0.05131424218416214, -0.017016947269439697, 0.010229012928903103, 0.08062766492366791, -0.06241147220134735, 0.03838428482413292, -0.03552228584885597, 0.08458303660154343, -0.10219968110322952, 0.0041399141773581505, 0.008851006627082825, 0.009226969443261623, -0.04784155264496803, 0.012223221361637115, 0.03848670423030853, 0.00786573812365532, -0.032139163464307785, -0.033399440348148346, -0.002717705676332116, -0.03137965500354767, -0.022669686004519463, -0.06683460623025894, 0.0009622711804695427, 0.061000462621450424, 0.029936498031020164, -0.06634965538978577, 0.015881678089499474, 0.011850656941533089, 0.0006462791934609413, 0.03847331181168556, -0.07439389079809189, -0.05982785299420357, 0.07751192152500153, -0.03687569126486778, 0.008643780834972858, 0.06727665662765503, 0.07108204811811447, 0.049636173993349075, -0.011443319730460644, 0.06752251833677292, 0.07932432740926743, 0.0015956662828102708, -0.019602837041020393, 0.028418609872460365, -0.010683166794478893, -0.006034333258867264, -0.01585313305258751, -0.05791644752025604, 0.04782508313655853, -0.1483745127916336, 0.03476971760392189, 0.0002667219378054142, -0.07853779196739197, 0.013352219015359879, -0.03795444965362549, -0.04026958718895912, 0.04809504374861717, -0.057368434965610504, -0.10030102729797363, 0.013889750465750694, 0.013644441030919552, 0.03504326567053795, -0.015999257564544678, -0.04023304954171181, -0.12636007368564606, 0.17530187964439392, -0.0452348031103611, -2.8831796263129574e-33, -0.04002084955573082, -0.06580011546611786, -0.1207248792052269, 0.07167839258909225, 0.0036502638831734657, -0.06692924350500107, -0.07719090580940247, -0.004129824228584766, 0.012365623377263546, 0.020180802792310715, -0.03658221662044525, 0.005101366899907589, 0.01066999789327383, 0.023678677156567574, -0.0375029556453228, -0.05769900605082512, -0.048630211502313614, -0.03510499745607376, 0.027322571724653244, 0.027495797723531723, 0.005247451830655336, 0.058086659759283066, -0.053501978516578674, -0.0730418711900711, 0.025639431551098824, -0.003352491185069084, -0.027330782264471054, 0.0020932869520038366, 0.03821437060832977, 0.008599885739386082, 0.07404406368732452, -0.005862966645509005, 0.024677008390426636, -0.0009823444997891784, 0.020790109410881996, 0.11053664237260818, -0.012368434108793736, 0.002344598062336445, -0.05527353659272194, 0.002811286598443985, -0.015546523034572601, -0.08303170651197433, -0.01606796309351921, -0.03987959772348404, 0.026365837082266808, 0.00973209273070097, -0.09302499890327454, 0.064308762550354, 0.04297404736280441, -0.01475299522280693, -0.018877793103456497, -0.04225512966513634, -0.06638438254594803, -0.05475534498691559, -0.015067875385284424, 0.00787483062595129, 0.05573363974690437, 0.039106518030166626, -0.0627816915512085, -0.02793259732425213, -0.05067933723330498, -0.02036469243466854, -0.01546261552721262, -0.016312988474965096, -0.05194447562098503, 0.06463369727134705, -0.021798213943839073, -0.0323951430618763, -0.006878815125674009, -0.05371975153684616, 0.08956752717494965, -0.04181574657559395, -0.04893096536397934, 0.05515211820602417, 0.04545464366674423, -0.033723134547472, -0.0524747259914875, -0.027540840208530426, -0.005381619092077017, -0.07699384540319443, -0.020607739686965942, -0.015532394871115685, -0.012909069657325745, 0.04508982598781586, -0.077314592897892, 0.058972831815481186, -0.02963564731180668, 0.019013356417417526, -0.015971995890140533, 0.016597669571638107, 0.04506940022110939, 0.002709117950871587, -0.024701816961169243, 0.05188298225402832, -0.15608832240104675, -5.296906735452467e-08, 0.014767864719033241, -0.022216858342289925, 0.10470190644264221, 0.049609117209911346, -0.0205669067800045, -0.029743149876594543, 0.01943061128258705, 0.02086671255528927, -0.03536125272512436, 0.024838874116539955, 0.054223474115133286, -0.00050536630442366, -0.007809184491634369, -0.03955495357513428, 0.10346424579620361, 0.008974592201411724, 0.022828754037618637, -0.0015065122861415148, 0.020030688494443893, -0.012202182784676552, 0.10407000035047531, -0.11537442356348038, -0.07997233420610428, -0.05655346438288689, 0.027487730607390404, -0.06786690652370453, -0.07454439252614975, 0.009401281364262104, -0.06390893459320068, 0.13418808579444885, 0.013576757162809372, -0.009108132682740688, 0.023094020783901215, 0.035070162266492844, 0.014821356162428856, -0.006267739925533533, 0.02474992349743843, -0.12878543138504028, 0.0075502763502299786, -0.09486294537782669, 0.018398113548755646, 0.052627984434366226, -0.03374099358916283, -0.031346552073955536, 0.06047395244240761, 0.014123892411589622, -0.05342823266983032, -0.0757562518119812, 0.07483766973018646, -0.04621361941099167, -0.024152662605047226, 0.004766985774040222, -0.0032787376549094915, 0.07455305755138397, 0.13325777649879456, 0.032494835555553436, 0.08730483055114746, -0.06289014220237732, 0.06929051131010056, 0.06347174942493439, 0.024516163393855095, 0.08540868759155273, 0.004654961638152599, -0.045733410865068436 ] }, { "text": "## The Agent Loop\n\nAt its core, most agentic systems follow a similar pattern:", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_2", "embedding": [ -0.009740793146193027, -0.031975798308849335, -0.06357162445783615, -0.06480888277292252, 0.054678771644830704, -0.026489317417144775, 0.07842645049095154, -0.009202520363032818, 0.04544549807906151, 0.0071124117821455, 0.0407731719315052, 0.07930086553096771, 0.021373597905039787, -0.0344342440366745, 0.009441111236810684, 0.02357730083167553, -0.03723094239830971, -0.02734716609120369, -0.0031687060836702585, -0.02262408845126629, 0.06590920686721802, 0.009247305803000927, -0.061719607561826706, -0.011585677973926067, -0.0783466324210167, 0.03284187242388725, -0.04474262893199921, -0.05128946155309677, 0.03057231940329075, -0.0593901202082634, 0.008462357334792614, 0.0884862095117569, 0.037351153790950775, 0.043679527938365936, 0.09412826597690582, 0.02165195532143116, -0.08142540603876114, -0.005733477883040905, -0.001768244314007461, 0.11313328891992569, 0.05655617639422417, -0.05285714566707611, 0.009093967266380787, -0.020733101293444633, -0.03279542922973633, 0.06025806814432144, -0.1389506608247757, 0.040919993072748184, -0.0475473627448082, -0.05114998668432236, -0.12456920742988586, -0.00616050511598587, -0.007119522430002689, 0.04037350043654442, -0.00480030057951808, -0.05021271854639053, 0.01570281758904457, 0.01821000687777996, -0.002978533273562789, -0.047126900404691696, 0.09535501152276993, -0.0009577512973919511, -0.040178332477808, 0.04177302494645119, 0.0815679058432579, 0.04426642134785652, -0.04774396866559982, -0.0005996262189000845, 0.023854484781622887, -0.026058750227093697, -0.01107625849545002, -0.00911459419876337, -0.01504241768270731, -0.04239850118756294, 0.0630713552236557, 0.06670095771551132, -0.0027648289687931538, -0.03276670724153519, 0.04029287397861481, -0.043826211243867874, -0.07325954735279083, -0.02181924134492874, 0.03395659103989601, 0.05295826867222786, -0.004844070412218571, -0.010341821238398552, 0.005795315373688936, -0.029959894716739655, 0.06946904212236404, 0.011594441719353199, -0.04182682931423187, -0.01731368899345398, 0.05650107562541962, -0.0011072574416175485, 0.01258098054677248, 0.12573662400245667, 0.03729929402470589, -0.04050067439675331, -0.0815846398472786, 0.048319097608327866, -0.01313259731978178, -0.025669913738965988, 0.004043526481837034, 0.037999458611011505, -0.01748058944940567, -0.05051549896597862, 0.06618094444274902, 0.014601116068661213, 0.037964701652526855, -0.06987041980028152, -0.03481344133615494, -0.03667421638965607, 0.049808237701654434, 0.008849997073411942, 0.061767350882291794, -0.10111403465270996, 0.03538743779063225, 0.08296088129281998, 0.009483120404183865, -0.010290835052728653, 0.10906188935041428, -0.0390438474714756, -0.0251537524163723, -0.01961519382894039, 0.08278626203536987, 0.07193758338689804, -0.06253468245267868, -2.4007971523538e-33, -0.024375373497605324, 0.028816279023885727, 0.053966060280799866, 0.0043070437386631966, -0.0320686474442482, -0.053268637508153915, -0.04538474977016449, -0.044113386422395706, 0.001548230997286737, 0.09091110527515411, -0.03092039003968239, 0.02262917160987854, -0.03803911805152893, 0.07698064297437668, -0.026666374877095222, -0.11270026117563248, 0.00717227254062891, 0.018587591126561165, -0.010712509043514729, -0.0171344131231308, 0.045163240283727646, 0.06878297030925751, -0.011983838863670826, -0.023193005472421646, -0.00976174883544445, 0.08424682170152664, -0.06257069110870361, -0.05401124432682991, 0.05849742144346237, 0.024347759783267975, 0.018407369032502174, 0.08503928035497665, -0.06665404140949249, 0.06355989724397659, -0.059222351759672165, 0.05649822577834129, 0.030599059537053108, -0.037863388657569885, 0.018547626212239265, -0.010529797524213791, -0.044133175164461136, 0.023853808641433716, 0.04054618626832962, -0.06645562499761581, 0.021944580599665642, -0.04947078227996826, 0.010063796304166317, -0.004380847327411175, -0.005083457101136446, 0.03075014054775238, -0.0327741801738739, 0.0635434240102768, 0.07444527745246887, -0.003243523184210062, 0.10152304917573929, 0.01752357743680477, 0.0466131828725338, 0.038802288472652435, -0.03250093385577202, 0.14490331709384918, 0.03797168284654617, -0.016497859731316566, 0.018487924709916115, -0.009646902792155743, 0.018543260172009468, -0.006735760718584061, -0.018228771165013313, 0.0003125679795630276, -0.002210359089076519, 0.09252546727657318, -0.07658021152019501, 0.13972559571266174, 0.00037257358781062067, 0.05144855007529259, -0.0488247349858284, -0.04737022891640663, -0.0351063497364521, -0.04013844206929207, -0.0762481763958931, -0.05179120600223541, -0.06375309079885483, -0.007970190607011318, -0.01304756198078394, -0.02124684490263462, 0.0072312732227146626, 0.01388528198003769, -0.0637228712439537, -0.09058373421430588, -0.015563981607556343, 0.0027731668669730425, 0.011564962565898895, -0.030769217759370804, -0.00039940953138284385, 0.10581454634666443, -0.05794176086783409, 9.655391211509264e-34, -0.0534856840968132, -0.08875643461942673, -0.06355525553226471, 0.009492876008152962, -0.00610837247222662, -0.03765644133090973, -0.004556134808808565, -0.07577948272228241, -0.021714624017477036, 0.044771041721105576, 0.03345320373773575, 0.04555992782115936, -0.0198079701513052, 0.05378807336091995, 0.08867911249399185, -0.06393378227949142, 0.040701963007450104, -0.03684645891189575, 0.012620114721357822, -0.02340642176568508, -0.02765939012169838, 0.005155707709491253, -0.07276063412427902, -0.010528620332479477, 0.03401315584778786, 0.05015364661812782, -0.033493317663669586, 0.07081159204244614, 0.11590501666069031, -0.024035261943936348, -0.00012266921112313867, -0.014090532436966896, 0.023446103557944298, 0.0358436219394207, 0.0002742547367233783, 0.055975958704948425, -0.04913461580872536, 0.007416375447064638, -0.013974231667816639, 0.01090933382511139, 0.04094526916742325, -0.11580688506364822, 0.042811643332242966, 0.011670961044728756, -0.004330609459429979, -0.014023392461240292, 0.04267179220914841, 0.04076695442199707, -0.034202832728624344, -0.026504555717110634, -0.025682784616947174, -0.05289594456553459, -0.06701592355966568, -0.0469193197786808, -0.05875469744205475, 0.15083448588848114, -0.002732933033257723, 0.06546170264482498, -0.02389867790043354, -0.04416458308696747, 0.012962819077074528, -0.02239043265581131, -0.021059105172753334, 0.030517106875777245, 0.021784532815217972, -0.0025381213054060936, -0.039026856422424316, -0.048228755593299866, -0.0022039541509002447, -0.03350925073027611, 0.14113900065422058, 0.04247065261006355, -0.14194422960281372, 0.003605950390920043, -0.0007728630444034934, -0.0023283902555704117, -0.03166991099715233, -0.05907629430294037, 0.03274419531226158, -0.05176979675889015, -0.1054428294301033, 0.06611090898513794, -0.034893181174993515, -0.024019379168748856, -0.02913467027246952, 0.03520597144961357, -0.024231374263763428, 0.04493322595953941, -0.01813623122870922, -0.006029236596077681, -0.007652257103472948, 0.009146862663328648, 0.028170522302389145, 0.021767525002360344, -0.13752473890781403, -2.2496001506056018e-08, -0.016137752681970596, -0.02807682566344738, 0.0582684651017189, 0.06039976328611374, 0.0356510691344738, 0.012271072715520859, 0.06849343329668045, -0.06070616468787193, -0.014052565209567547, 0.01862216368317604, 0.038055915385484695, -0.037981193512678146, 0.028660446405410767, 0.028265539556741714, 0.09592229872941971, 0.009283562190830708, -0.02284865826368332, 0.010355236940085888, -0.05797762796282768, -0.08397872000932693, -0.05113096535205841, -0.01880600117146969, -0.04272856563329697, -0.020317111164331436, -0.024964313954114914, 0.02263392135500908, -0.02722128853201866, 0.08574648946523666, 0.015762919560074806, 0.08050937950611115, 0.019928939640522003, -0.011534885503351688, -0.005363940726965666, 0.01802968420088291, -0.08009166270494461, 0.10418850183486938, -0.037086211144924164, -0.017552215605974197, 0.07145525515079498, -0.09359733015298843, -0.01700492948293686, -0.004902735818177462, -0.05442073568701744, 0.010373469442129135, 0.04207400605082512, 0.04025806114077568, -0.07318975776433945, -0.0911499634385109, 0.07131727784872055, -0.0845557451248169, -0.11631585657596588, -0.04529403895139694, -0.024473432451486588, 0.0770045816898346, 0.07195637375116348, -0.019630417227745056, 0.07610459625720978, -0.06016466021537781, 0.09583663940429688, 0.0765528753399849, -0.01974906213581562, 0.01824883185327053, 0.029766177758574486, -0.0186794213950634 ] }, { "text": "```\n┌─────────────────────────────────────────┐\n│ │\n│ User Goal/Task │\n│ │ │\n│ ▼ │\n│ ┌───────────┐ │\n│ │ Observe │ ◄── Environment State │\n│ └─────┬─────┘ │\n│ │ │\n│ ▼ │\n│ ┌───────────┐ │\n│ │ Think │ ◄── LLM Reasoning │\n│ └─────┬─────┘ │\n│ │ │\n│ ▼ │\n│ ┌───────────┐ │\n│ │ Act │ ──► Tool Execution │\n│ └─────┬─────┘ │", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_3", "embedding": [ -0.0006158517207950354, -0.07263092696666718, -0.029021291062235832, 0.009030880406498909, 0.08235172182321548, -0.0631459653377533, 0.10686060041189194, 0.02235637605190277, -0.049639325588941574, 0.09727782756090164, 0.013779043219983578, -0.07870980352163315, 0.06180388852953911, 0.021150480955839157, 0.030590804293751717, 0.037147633731365204, 0.004496309440582991, -0.0522523857653141, -0.0060975379310548306, -0.08507401496171951, 0.06338832527399063, -0.0644504651427269, 0.028121724724769592, 0.029078595340251923, -0.08679400384426117, 0.02063947543501854, 0.0216902457177639, -0.04427777975797653, 0.01586703583598137, -0.021870294585824013, -0.0014262549811974168, 0.0577893890440464, 0.03204145282506943, 0.01704428158700466, 0.11117410659790039, 0.14750759303569794, -0.025769570842385292, -0.07254232466220856, -0.013815261423587799, -0.06781160086393356, -0.06360672414302826, -0.03175254166126251, -0.06445226073265076, -0.08515254408121109, -0.036579180508852005, -0.06779645383358002, -0.01680224947631359, -0.11225630342960358, -0.0634973868727684, -0.004125142470002174, -0.07768701761960983, -0.08024655282497406, -0.07214964926242828, -0.027005884796380997, 0.07005400955677032, 0.043619684875011444, 0.031986482441425323, -0.003332716878503561, 0.0017918969970196486, -0.028446681797504425, 0.004842394031584263, -0.007439630106091499, -0.09035424143075943, -0.00299790664575994, 0.05111334100365639, 0.03100809082388878, -0.08073098212480545, 0.06418884545564651, -0.04147659242153168, -0.06655534356832504, -0.06848566979169846, -0.00779634527862072, -0.06608976423740387, -0.05906271934509277, -0.01068137213587761, -0.07914887368679047, 0.01699201948940754, -0.042192552238702774, -0.01415691152215004, -0.07017574459314346, -0.07090521603822708, -0.02464227005839348, -0.07153567671775818, 0.06601454317569733, -0.005039222072809935, 0.015541362576186657, -0.02394918166100979, -0.041947148740291595, 0.08120283484458923, 0.04959336668252945, -0.016917888075113297, -0.13532552123069763, 0.026124702766537666, 0.04203846678137779, 0.04131544381380081, 0.045918527990579605, -0.00027222654898650944, -0.0058986349031329155, 0.040446873754262924, 0.07622657716274261, 0.006564636714756489, -0.029524201527237892, 0.023465251550078392, -0.017662188038229942, -0.018803756684064865, -0.019151797518134117, -0.0254749096930027, -0.025301966816186905, 0.011860115453600883, -0.03900963440537453, -0.0628344938158989, -0.03365926817059517, -0.004198840353637934, -0.05413055047392845, 0.0447867289185524, -0.09110695868730545, 0.013069548644125462, 0.02148495614528656, -0.016316568478941917, 0.01604006253182888, 0.061405960470438004, 0.030790377408266068, 0.032711662352085114, 0.0292422566562891, 0.053179122507572174, 0.0017888644943013787, 0.001759107457473874, 8.918128501513218e-34, 0.06595293432474136, -0.08048749715089798, -0.02271195501089096, 8.51227596285753e-05, 0.07260968536138535, 0.05136982724070549, 0.02800793945789337, 0.06173243373632431, 0.001801836653612554, 0.047911860048770905, 0.031239448115229607, -0.04320135340094566, -0.03328569605946541, 0.037044938653707504, 0.049942340701818466, -0.02240082062780857, -0.0789494663476944, 0.04487018659710884, -0.07192675769329071, 0.013478044420480728, -0.02343709021806717, 0.032190658152103424, -0.0688045546412468, 0.022304248064756393, 0.04058432951569557, 0.006182725541293621, 0.05980977788567543, -0.005566539242863655, -0.06774817407131195, 0.023494314402341843, 0.04236479103565216, -0.030828822404146194, -0.020684864372015, 0.11549157649278641, -0.012809643521904945, 0.054818831384181976, -0.0035665298346430063, 0.04356929287314415, -0.009649793617427349, -0.058139216154813766, -0.01473452802747488, 0.029267357662320137, 0.029125090688467026, -0.014974660240113735, 0.020339949056506157, -0.0728883296251297, -0.019647246226668358, -0.023091105744242668, 0.07558126747608185, 0.007598325610160828, 0.009825676679611206, -0.007766300346702337, 0.16665591299533844, -0.05061066895723343, 0.014746373519301414, -0.01919417828321457, -0.02616024762392044, 0.02105017751455307, 0.03280741721391678, -0.005096482578665018, -0.013373293913900852, -0.023027559742331505, -0.01381675060838461, 0.02695273794233799, 0.04174749553203583, 0.010243238881230354, -0.04296348616480827, -0.0012128722155466676, 0.09063132852315903, 0.04719945788383484, -0.14083412289619446, 0.013543895445764065, 0.014838287606835365, 0.03961711376905441, -0.02141355536878109, -0.05566525086760521, -0.0183146670460701, -0.06077083945274353, -0.06840543448925018, -0.08436021953821182, -0.0697135180234909, -0.016544627025723457, -0.09271600097417831, -0.00837500300258398, 0.06290867924690247, 0.02020951919257641, -0.06194038316607475, -0.07053802907466888, -0.02422184683382511, -0.011423018760979176, -0.016816964372992516, -0.0550701878964901, -0.048117756843566895, 0.04669058322906494, -0.08679022639989853, -7.30428679713953e-33, 0.03542215749621391, 0.013128085993230343, -0.04136163368821144, -0.024379471316933632, -0.019266223534941673, -0.006304641719907522, -0.004771118052303791, -0.10216030478477478, -0.023765958845615387, 0.014431445859372616, -0.14479874074459076, 0.05313079431653023, 0.06514047831296921, 0.05542544275522232, 0.06550823152065277, -0.0359705314040184, 0.004404239356517792, -0.02275947853922844, -0.003144647926092148, 0.015345176681876183, -0.06483194977045059, 0.07298531383275986, -0.09191664308309555, 0.03343536704778671, 0.027713235467672348, -0.009702477604150772, -0.00044924585381522775, -0.02535979636013508, 0.027439139783382416, -0.00534074567258358, -0.015439450740814209, -0.06823937594890594, -0.10110147297382355, 0.05788241699337959, -0.08460211753845215, -0.012209958396852016, 0.003630149643868208, -0.021684469655156136, -0.020420357584953308, 0.0747588723897934, 0.0031191492453217506, -0.06889887899160385, -0.018592020496726036, 0.05263165384531021, -0.027875931933522224, 0.10037173330783844, -0.009195426478981972, 0.01447255164384842, -0.06281136721372604, -0.039090365171432495, -0.0013965812977403402, 0.017758212983608246, -0.10966037958860397, -0.05921318382024765, 0.015773070976138115, -0.043400056660175323, 0.006120111793279648, -0.029885636642575264, -0.04394116997718811, -0.02029442973434925, -0.0030410680919885635, 0.03941965475678444, 0.05726495012640953, 0.021304424852132797, -0.0405731126666069, -0.014279588125646114, -0.08485030382871628, 0.05400704964995384, -0.06279920041561127, -0.06029645353555679, 0.05943693593144417, 0.009408595971763134, -0.16775654256343842, -0.04971267282962799, 0.05429682508111, -0.03993503004312515, -0.059726133942604065, -0.06479870527982712, -0.03796418383717537, 0.011448724195361137, -0.02239575982093811, -0.01164990197867155, 0.00616838363930583, -0.0258927159011364, -0.08024638146162033, -0.05237323045730591, -0.024364855140447617, 0.09463373571634293, -0.034944288432598114, -0.014116503298282623, -0.06277302652597427, 0.03149612620472908, -0.005535118281841278, 0.028575420379638672, -0.031998127698898315, -5.704841754550216e-08, -0.0653281882405281, -0.0006617457256652415, 0.02120758220553398, 0.04840588942170143, 0.029258238151669502, 0.050346553325653076, -0.06147472932934761, 0.06128266826272011, 0.019420308992266655, -0.04198746383190155, 0.05838708207011223, -0.030366668477654457, -0.06954710930585861, 0.05412821099162102, 0.02158624492585659, -0.026412857696413994, -0.047800417989492416, 0.08752934634685516, -0.050214603543281555, -0.02817094884812832, 0.06704654544591904, 0.04661276936531067, -0.045562613755464554, -0.01181190088391304, 0.0024684257805347443, -0.040125127881765366, -0.048117801547050476, 0.061511460691690445, 0.044077035039663315, 0.03655936196446419, 0.07295908033847809, 0.046481773257255554, -0.02012990415096283, -0.029173171147704124, 0.031670425087213516, 0.009184859693050385, 0.010640248656272888, 0.019372915849089622, 0.06898041069507599, -0.023718155920505524, -0.019281063228845596, 0.023673100396990776, 0.0020047295838594437, 0.08385971188545227, -0.05446014925837517, 0.0016335241962224245, -0.05649237707257271, -0.03397592529654503, 0.003490412374958396, -0.0875677615404129, -0.05016724765300751, -0.02770647406578064, -0.058168862015008926, 0.05750786140561104, 0.0806022509932518, 0.07434500753879547, 0.10185065120458603, -0.04126546159386635, -0.020570436492562294, 0.03580256924033165, 0.03470609337091446, 0.12569382786750793, -0.024237386882305145, -0.02845720201730728 ] }, { "text": "│ ┌───────────┐ │\n│ │ Act │ ──► Tool Execution │\n│ └─────┬─────┘ │\n│ │ │\n│ ▼ │\n│ Goal Achieved? ──No──► Loop Back │\n│ │ │\n│ Yes │\n│ │ │\n│ ▼ │\n│ Return Result │\n│ │\n└─────────────────────────────────────────┘\n```", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_4", "embedding": [ 0.004321557004004717, 0.025321613997220993, -0.04212430864572525, -0.00529096694663167, -0.0013615473872050643, 0.008713441900908947, 0.0919189602136612, 0.007578149903565645, -0.04947428032755852, 0.013474834151566029, 0.07993297278881073, -0.00027161030448041856, 0.07733764499425888, -0.07200676947832108, 0.024792153388261795, 0.010982085950672626, -0.06953638792037964, 0.07569599896669388, 0.004512080457061529, -0.15618081390857697, 0.0485617071390152, 0.0060638682916760445, 0.02672971598803997, 0.0010978830978274345, 0.005180346313863993, 0.0357300229370594, -0.05030891299247742, -0.06273923069238663, 0.0354682132601738, -0.04935822635889053, -0.011172167025506496, -0.03917882964015007, 0.044717997312545776, 0.05005541816353798, 0.12338625639677048, 0.0792752355337143, -0.0401395708322525, -0.0489250011742115, -0.03488929197192192, 0.027601804584264755, -0.0593995600938797, -0.04486098885536194, -0.01527675986289978, -0.09224963188171387, 0.01990797370672226, -0.07846474647521973, -0.11520874500274658, -0.06837098300457001, -0.03273532912135124, 0.01286375243216753, -0.05328718200325966, -0.07142539322376251, -0.07104913145303726, -0.033006198704242706, 0.056184928864240646, 0.05411234125494957, 0.009932797402143478, -0.02312553860247135, -0.015004421584308147, -0.04772454872727394, -0.008630075491964817, -0.01705397665500641, -0.10585469007492065, -0.03029223158955574, 0.021887261420488358, -0.04967228323221207, -0.03634926676750183, 0.001013365457765758, -0.002625236054882407, 0.03972986713051796, -0.038298141211271286, -0.008607209660112858, -0.057463858276605606, 0.007853301241993904, 0.04617322236299515, 0.0277609471231699, 0.03234734386205673, -0.014003852382302284, -0.09833445399999619, -0.011740307323634624, -0.09532813727855682, -0.018023530021309853, -0.031924277544021606, 0.011794635094702244, -0.00205604312941432, 0.0027972939424216747, -0.003025881014764309, 0.040502335876226425, 0.09461919963359833, -0.032071538269519806, -0.10270939022302628, -0.06279662251472473, -0.02772025391459465, 0.03331797569990158, 0.03046206384897232, 0.06295470893383026, 0.026808924973011017, -0.060512278228998184, 0.018676623702049255, 0.05562534183263779, -0.0033463500440120697, 0.0028959964402019978, -0.003147205337882042, -0.12207790464162827, -0.04129161685705185, -0.011582404375076294, 0.017896875739097595, -0.03418692946434021, 0.01389661431312561, -0.0825507715344429, -0.052110329270362854, -0.04664716124534607, 0.09938707947731018, -0.046541545540094376, 0.05156921222805977, -0.0496380552649498, -0.06635598838329315, 0.025782816112041473, -0.008042006753385067, 0.0017283681081607938, 0.036269575357437134, 0.10206770896911621, 0.03752840682864189, 0.03358587995171547, -0.01035352237522602, -0.02722487971186638, -0.04317351058125496, 4.4041321140457374e-33, -0.01111118495464325, -0.044632405042648315, 0.04485274478793144, -0.04255017265677452, 0.02804720401763916, -0.022074997425079346, 0.004338821861892939, -0.0006832436774857342, -0.011087046936154366, 0.09047991037368774, 0.004038638435304165, -0.08071921020746231, -0.061437852680683136, 0.0432155504822731, 0.024869682267308235, -0.05230483412742615, 0.04686715081334114, 0.010894687846302986, -0.047348592430353165, 0.04762651026248932, -0.023945026099681854, 0.02893362008035183, 0.007548615802079439, 0.037089087069034576, 0.03572650998830795, 0.011103790253400803, 0.04734338819980621, -0.03224179893732071, -0.0953492522239685, 0.021678559482097626, 0.02970929816365242, -0.051816340535879135, -0.037940867245197296, -0.007576593663543463, 0.0032178217079490423, 0.10049246996641159, 0.00945591926574707, 0.007659824565052986, 0.01859387569129467, 0.0717378705739975, -0.0906440019607544, -0.012228168547153473, -0.045306332409381866, 0.03289984166622162, 0.013036945834755898, -0.05873576179146767, -0.0061538503505289555, -0.019340382888913155, 0.05845624580979347, 0.033779654651880264, 0.015732545405626297, 0.0031618240755051374, 0.12542083859443665, -0.011448709294199944, 0.023588361218571663, -0.03514093533158302, -0.04919242113828659, 0.0689534991979599, -0.009564763866364956, 0.08765789866447449, 0.012546367943286896, -0.0589141845703125, -0.03852100297808647, 0.020315468311309814, -0.05820954591035843, 0.002277308376505971, 0.024672849103808403, -0.03769702464342117, 0.06176406145095825, 0.09286229312419891, -0.1303156465291977, 0.01703270711004734, -0.05856231600046158, -0.06997989118099213, 0.04293231666088104, -0.04652334749698639, -0.030464066192507744, -0.10984309017658234, 0.03231547772884369, -0.11245094984769821, -0.030888361856341362, 0.014567157253623009, -0.07205971330404282, -0.0792405903339386, 0.10942283272743225, 0.06724168360233307, 0.013162488117814064, -0.10505930334329605, -0.04121796786785126, -0.037688013166189194, -0.09160930663347244, -0.02327148988842964, -0.027679838240146637, 0.004099519923329353, -0.02387104369699955, -7.882381694562484e-33, 0.11179322749376297, 0.04106222093105316, -0.010127284564077854, -0.01954386942088604, -0.007093667518347502, 0.006042733322829008, 0.0418090857565403, -0.12061041593551636, -0.024882959201931953, 0.030432239174842834, -0.08502726256847382, -0.0013919653138145804, 0.04970129206776619, 0.0074185277335345745, 0.0995493233203888, -0.027789652347564697, -0.01887754164636135, -0.004555186256766319, 0.010803836397826672, 0.029871515929698944, -0.02722807787358761, 0.052662160247564316, -0.0003341914853081107, 0.015278355218470097, 0.008323980495333672, -0.024071816354990005, -0.000749175320379436, 0.04489557072520256, 0.035136546939611435, -0.020109789445996284, 0.06309565156698227, -0.03119131177663803, -0.08327444642782211, 0.08274226635694504, -0.030614852905273438, 0.010299109853804111, 0.037149202078580856, -0.04608900472521782, 0.03625008091330528, 0.07487624138593674, 0.007993464358150959, -0.06633417308330536, 0.00914186891168356, 0.05938633158802986, -0.013316668570041656, 0.036172837018966675, 0.002626407193019986, 0.005663686897605658, -0.03177645429968834, -0.010576886124908924, 0.033696312457323074, 0.01586640626192093, -0.15719887614250183, -0.034917932003736496, -0.006933060474693775, -0.03455052897334099, -0.03837971389293671, -0.10485635697841644, -0.03080916777253151, 0.013529466465115547, -0.07565595209598541, 0.020651182159781456, 0.06189446523785591, 0.03119281306862831, 0.04949237033724785, -0.02011919394135475, -0.023976046591997147, 0.04513387009501457, -0.07247625291347504, 0.011689453385770321, 0.0328027606010437, 0.05353657901287079, -0.12395597249269485, -0.0032173788640648127, 0.009004050865769386, 0.05870874226093292, -0.06005766987800598, -0.0014630577061325312, -0.01959744468331337, 0.019928622990846634, -0.041365280747413635, -0.006462708115577698, 0.01871977001428604, 0.012453338131308556, -0.034733954817056656, 0.0006391295464709401, 0.008655584417283535, 0.09424515813589096, -0.0029874632600694895, 0.03418445214629173, 0.030213145539164543, -0.004747182596474886, 0.0919177457690239, 0.08032380789518356, 0.026317698881030083, -4.4800138709888415e-08, -0.11268840730190277, -0.011797798797488213, -0.00599765544757247, 0.060505468398332596, 0.016523122787475586, 0.09673762321472168, -0.056904684752225876, 0.0211420189589262, -0.006888358388096094, -0.11813008785247803, 0.05214029178023338, -0.028744425624608994, -0.045063566416502, 0.05463125929236412, 0.05493205413222313, -0.006443412974476814, -0.013252435252070427, 0.05884145200252533, -0.00017392112931702286, -0.06841473281383514, 0.05599859729409218, 0.029824763536453247, 0.021161258220672607, 0.0017324606887996197, -0.0634758323431015, -0.01870463229715824, -0.07488234341144562, 0.09429154545068741, -0.03592681884765625, 0.011882469989359379, 0.08715648949146271, -0.04557560384273529, -0.01802944578230381, 0.002585579175502062, 0.06611452251672745, -0.02898944355547428, 0.06174048036336899, -0.0021180713083595037, 0.03607085347175598, 0.05780072882771492, 0.018988393247127533, 0.05827761068940163, 0.04286926984786987, 0.037342462688684464, -0.10165827721357346, -0.021967630833387375, -0.039536163210868835, -0.057094551622867584, -0.0020802831277251244, -0.12586551904678345, -0.03920266404747963, -0.04534134641289711, -0.046796027570962906, -0.031833138316869736, 0.04328657314181328, 0.05900466814637184, 0.07051000744104385, -0.019789818674325943, -0.04960225895047188, 0.06052941828966141, -0.013882855884730816, 0.011167659424245358, 0.03404372185468674, -0.028544537723064423 ] }, { "text": "This \"observe-think-act\" loop allows agents to iteratively work toward goals, adapting their approach based on feedback from each action.", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_5", "embedding": [ 0.0027473492082208395, -0.05163534730672836, -0.06509702652692795, -0.05672489106655121, 0.029042163863778114, 0.04990549013018608, 0.06067930534482002, 0.01324586383998394, 0.07461756467819214, -0.014422863721847534, 0.0038574158679693937, 0.03293193504214287, 0.029308468103408813, 0.041713897138834, 0.014140425249934196, -0.013718885369598866, 0.006853858940303326, 0.059550799429416656, -0.018149172887206078, -0.07019547373056412, 0.01910858415067196, -0.03722241148352623, 0.06273475289344788, -0.004187673330307007, -0.1266944408416748, 0.0770510882139206, -0.024494336917996407, -0.05090612918138504, 0.024990636855363846, -0.026130538433790207, 0.09573012590408325, 0.013373141176998615, 0.05766773596405983, 0.009490770287811756, 0.004617351572960615, 0.057198021560907364, -0.10368277877569199, 0.05519109219312668, -0.01339561678469181, -0.008178271353244781, -0.03640015050768852, -0.010405625216662884, 0.009143619798123837, -0.08079031854867935, 0.0029005156829953194, -0.026181353256106377, -0.046453576534986496, 0.003706138813868165, -0.07487370073795319, 0.009564670734107494, -0.14761552214622498, -0.06081903353333473, 0.0030530295334756374, -0.05760280042886734, 0.052429020404815674, 0.018746744841337204, 0.03903910890221596, 0.04213971644639969, 0.02131102792918682, -0.10758619010448456, 0.05919206514954567, -0.0739014521241188, -0.09485156089067459, 0.023065635934472084, 0.011727767065167427, 0.03298497200012207, -0.07069079577922821, 0.025154659524559975, -0.02159895934164524, -0.017952831462025642, -0.017793405801057816, 0.01708008348941803, 0.02171759307384491, -0.0955425426363945, 0.10849215090274811, 0.02861923724412918, -0.007577341515570879, -0.04528551921248436, 0.03763040900230408, -0.006248961202800274, -0.05453374609351158, -0.0020638294517993927, -0.014253809116780758, 0.0015833720099180937, 0.04660697653889656, -0.03164799511432648, 0.019685253500938416, 0.03695576265454292, 0.08366987109184265, 0.01150632556527853, -0.06339021027088165, -0.036664415150880814, -0.060918740928173065, 0.0018743756227195263, -0.03423604369163513, 0.10337889194488525, -0.024223173037171364, -0.061221569776535034, -0.03288082778453827, 0.027434542775154114, 0.03783620148897171, 0.029972663149237633, -0.05994712933897972, -0.02292032726109028, -0.03975284472107887, -0.1087728813290596, 0.0750734955072403, 0.016060175374150276, 0.017979657277464867, -0.06380981206893921, -0.042223405092954636, -0.042639102786779404, 0.07628908008337021, 0.08700685948133469, 0.02691487967967987, -0.029677418991923332, 0.0011124128941446543, 0.08504804968833923, 0.00971464067697525, -0.030653588473796844, 0.11784029752016068, -0.04265083372592926, 0.05510008707642555, -0.012868761084973812, 0.04706846550107002, 0.024126728996634483, -0.02885066717863083, -2.4679513079063542e-33, 0.005599879659712315, -0.0006919503794051707, 0.09170141816139221, -0.017937077209353447, 0.047454506158828735, -0.061612553894519806, -0.021566662937402725, -0.054986242204904556, -0.005469502415508032, 0.017298521474003792, 0.042752455919981, 0.021267330273985863, -0.00037434010300785303, 0.1053982675075531, 0.027568692341446877, -0.08234836161136627, -0.09212116152048111, 0.0714229941368103, -0.01891241781413555, 0.03028837963938713, 0.06613199412822723, 0.006700905039906502, 0.045010704547166824, -0.04050908610224724, 0.04533800110220909, 0.03318221494555473, -0.0009340030956082046, 0.053639449179172516, -0.044276535511016846, 0.001672749756835401, 0.007924122735857964, 0.11167959868907928, -0.13125857710838318, 0.022413548082113266, -0.05371584743261337, 0.036757707595825195, 0.020481983199715614, -0.05311274155974388, 0.04811502993106842, 0.030407080426812172, -0.025135863572359085, 0.004610853269696236, 0.027880707755684853, 0.010756018571555614, -0.012875719927251339, 0.005954003427177668, -0.017266448587179184, 0.004121461417526007, -0.047209709882736206, 0.03133466839790344, 0.041576992720365524, 0.0006607562536373734, 0.029813243076205254, -0.13069090247154236, 0.02234736457467079, 0.00679898401722312, -0.040314555168151855, 0.03489960357546806, -0.0017733857966959476, 0.04346994310617447, 0.08764027804136276, -0.06940124183893204, -0.03870826214551926, 0.05000058561563492, 0.012554142624139786, 0.07523368299007416, -0.00837797112762928, 0.011145872063934803, 0.09884244948625565, 0.012576409615576267, -0.047552671283483505, 0.08060436695814133, -0.004562183748930693, -0.029130905866622925, 0.0073889484629035, -0.07244522869586945, -0.022643575444817543, -0.10463669151067734, 0.001822340302169323, -0.04108245298266411, -0.006009054370224476, -0.06695956736803055, -0.06592781841754913, 0.004201969597488642, -0.01948040910065174, -0.021055959165096283, -0.05307812988758087, -0.07093890756368637, -0.06889256089925766, -0.010375193320214748, -0.054102394729852676, -0.007098216563463211, 0.0023823133669793606, 0.09588371962308884, 0.005001849960535765, 9.20449821082772e-34, 0.005570224951952696, -0.07005993276834488, -0.03908291459083557, 0.024324145168066025, 0.05554547160863876, -0.004556622821837664, -0.035804569721221924, -0.10858269035816193, 0.015341327525675297, 0.0005917374510318041, -0.07205428928136826, -0.03488057851791382, -0.0507625937461853, 0.09808316826820374, 0.0017743324860930443, -0.07243885844945908, 0.058177459985017776, -0.03089364618062973, 0.015430029481649399, -0.0432860292494297, 0.027498209848999977, 0.06041125953197479, -0.039400648325681686, -0.042166486382484436, 0.03228861838579178, 0.054915618151426315, 0.026240818202495575, 0.05098142474889755, 0.04942413046956062, -0.03015013225376606, 0.0014201835729181767, -0.08638980984687805, 0.014149113558232784, 0.042021751403808594, -0.015097977593541145, 0.11337290704250336, 0.020254837349057198, -0.03383161872625351, 0.01566949672996998, 0.04543190449476242, -0.007929734885692596, -0.11965211480855942, 0.0064802044071257114, 0.03071441687643528, -0.004824477713555098, 0.009290367364883423, -0.00607856921851635, 0.12546850740909576, -0.09039053320884705, -0.0009024274768307805, 0.01763083226978779, 0.01807577908039093, -0.09917930513620377, -0.07647108286619186, -0.05554911866784096, 0.037245169281959534, 0.024537328630685806, -0.07499346137046814, 0.03511083126068115, -0.027003496885299683, -0.07774019986391068, 0.008650191128253937, 0.03789690509438515, 0.0536227747797966, 0.029717547819018364, 0.0532415546476841, -0.015569047071039677, -0.020136095583438873, 0.06457876414060593, -0.0031151510775089264, 0.08664453029632568, -0.017689570784568787, -0.07411593198776245, 0.01498455461114645, 0.0951949879527092, -0.04021743685007095, -0.06756880134344101, -0.10000628232955933, -0.0082773482427001, -0.07916679978370667, -0.07745418697595596, -0.023366905748844147, 0.024716956540942192, 0.011537372134625912, -0.005575197283178568, 0.059234242886304855, -0.04234604164958, 0.08369343727827072, 0.01419711485505104, 0.016722422093153, -0.04461823031306267, 0.03332286700606346, 0.06916501373052597, 0.04435344785451889, -0.10669024288654327, -2.3998367737476656e-08, -0.05663930997252464, -0.028434863314032555, 0.037238799035549164, 0.08982701599597931, 0.027689585462212563, -0.008701527491211891, 0.03095874935388565, -0.039732471108436584, 0.008300344459712505, -0.06194977089762688, 0.05315576493740082, -0.04448765516281128, 0.08607123047113419, 0.08265111595392227, 0.0679139718413353, -0.011829454451799393, 0.03870620205998421, 0.013400508090853691, -0.059595659375190735, -0.0214794110506773, 0.03161311522126198, -0.017959007993340492, -0.022443028166890144, -0.016300788149237633, -0.0010788145009428263, -0.04019507020711899, -0.04563786834478378, 0.10192842036485672, 0.004702480509877205, 0.014369999058544636, 0.07806539535522461, 0.0026088061276823282, 0.0348447784781456, 0.01712433248758316, 0.03074723295867443, 0.021366780623793602, 0.0535687580704689, -0.028825514018535614, 0.049440279603004456, -0.053455062210559845, -0.026094354689121246, 0.0457674115896225, 0.006413619499653578, 0.052210234105587006, -0.04564306139945984, 0.031886063516139984, -0.11385481059551239, -0.10987710952758789, 0.05552998557686806, -0.03328011557459831, -0.01708848401904106, 0.04296337068080902, -0.0319632850587368, 0.03763690963387489, 0.0611664280295372, 0.0512155257165432, 0.04892030730843544, -0.04222225397825241, 0.03823428601026535, 0.09225235134363174, 0.022042416036128998, 0.04589918255805969, -0.06235315650701523, 0.0038165654987096786 ] }, { "text": "## Key Concepts in Agentic Systems\n\n### Tools and Function Calling\n\nTools extend an agent's capabilities beyond text generation. Modern LLMs support \"function calling\" where the model can request to execute specific functions with structured parameters:\n\n```python\n# Example: Defining a tool for an agent\ntools = [\n {\n \"name\": \"search_database\",\n \"description\": \"Search the product database for items\",\n \"parameters\": {\n \"type\": \"object\",\n \"properties\": {\n \"query\": {\"type\": \"string\", \"description\": \"Search query\"},\n \"limit\": {\"type\": \"integer\", \"description\": \"Max results\"}\n }\n }\n }\n]\n```", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_6", "embedding": [ -0.0015851713251322508, 0.0011752581922337413, -0.07107708603143692, 0.021061185747385025, -0.0913010761141777, -0.023777613416314125, -0.027469785884022713, 0.03426522761583328, 0.002359781414270401, -0.009350098669528961, -0.01573777385056019, 0.0034543683286756277, 0.0874483585357666, -0.005397025495767593, 0.1267717182636261, 0.09960830956697464, 0.062298815697431564, -0.0016022230265662074, -0.028938407078385353, -0.024402031674981117, 0.13765063881874084, 0.08271589875221252, -0.013471667654812336, -0.015176331624388695, -0.0986582487821579, -0.08754108101129532, -0.036510538309812546, -0.0025988409761339426, 0.030765194445848465, 0.018076492473483086, 0.047276467084884644, 0.06767022609710693, -0.02203761599957943, 0.10858407616615295, 0.038791559636592865, 0.06872725486755371, -0.07266340404748917, -0.029684854671359062, -0.011683475226163864, -0.016498854383826256, 0.017807405441999435, -0.025478428229689598, -0.05066000670194626, -0.05076540261507034, 0.018534790724515915, -0.02623441442847252, -0.0343206450343132, -0.04090729355812073, -0.05851335823535919, 0.0035590436309576035, -0.10643535107374191, 0.004676531534641981, -0.05079587921500206, -0.03467082232236862, 0.024555882439017296, -0.017653493210673332, -0.016551634296774864, -0.011808068491518497, -0.022149987518787384, -0.0791982039809227, -0.011518408544361591, -0.03912366181612015, -0.0025351212825626135, 0.026591839268803596, -0.017849182710051537, 0.001596605172380805, -0.03658538684248924, 0.010299970395863056, 0.00685898819938302, -0.02129971608519554, -0.035116661339998245, -0.08468663692474365, -0.025957532227039337, -0.013003402389585972, 0.03459949418902397, 0.047224901616573334, 0.04870259389281273, 0.009445248171687126, 0.012673426419496536, -0.018142687156796455, -0.03635898232460022, -0.039698224514722824, -0.009014902636408806, 0.10366622358560562, -0.02801334112882614, 0.04393839091062546, 0.011700757779181004, -0.029122265055775642, 0.14658328890800476, 0.00858669076114893, 0.004837353248149157, -0.10110338777303696, -0.0019992084708064795, -0.025030050426721573, -0.025586025789380074, 0.010016728192567825, -0.003721849760040641, -0.12679532170295715, -0.01948544569313526, 0.01661762408912182, -0.055410560220479965, 0.018732702359557152, 0.08420872688293457, -0.03818682208657265, -0.05795643478631973, 0.01158660277724266, 0.030943937599658966, -0.03107409179210663, 0.012739094905555248, -0.024081498384475708, -0.04261273145675659, 0.03680265694856644, 0.03234448656439781, -0.038254253566265106, 0.052389875054359436, -0.07521415501832962, 0.06954248249530792, -0.032089248299598694, 0.05420370399951935, -0.018438832834362984, 0.06386371701955795, 0.022274574264883995, -0.026930855587124825, 0.036327049136161804, 0.05739184841513634, 0.06564706563949585, 0.0008837321656756103, 1.793664422058666e-33, 0.04784037545323372, -0.027795130386948586, 0.029730135574936867, 0.05352417752146721, 0.018772322684526443, 0.05489882454276085, 0.12229546904563904, 0.01671600714325905, -0.06893615424633026, 0.07197096198797226, -0.08272362500429153, 0.06016887351870537, -0.0585339181125164, 0.034434426575899124, 0.029276879504323006, 0.006244157440960407, 0.033776525408029556, 0.056844256818294525, 0.03843512758612633, 0.0014616306871175766, -0.0025401595048606396, 0.04153583571314812, 0.04301823303103447, 0.012897328473627567, 0.05272490158677101, 0.07515192031860352, 0.015586509369313717, -0.04632454738020897, 0.001158703351393342, -0.015887031331658363, -0.07695789635181427, 0.00978685449808836, 0.013926609419286251, 0.07985028624534607, -0.046353716403245926, 0.08659959584474564, -0.11466662585735321, 0.005683570634573698, 0.014873957261443138, -0.02997887134552002, -0.013007442466914654, 0.03244804963469505, 0.012981727719306946, -0.04935357719659805, -0.05215588957071304, -0.062416668981313705, -0.10168002545833588, 0.06185737997293472, 0.04257511347532272, -0.01194310188293457, -0.010133984498679638, 0.061472319066524506, 0.045975204557180405, -9.670848157838918e-06, 0.07401397824287415, 0.034119654446840286, -0.004950235597789288, 0.03231705352663994, -0.02235502190887928, 0.011346071027219296, -0.06319283694028854, -0.022950835525989532, 0.05127095803618431, 0.010591811500489712, 0.12814770638942719, -0.02218823879957199, 0.03093131259083748, 0.04896312206983566, 0.047684766352176666, 0.024968162178993225, 0.023332504555583, 0.05522765591740608, -0.0593864843249321, -0.012550676241517067, 0.027358070015907288, -0.10294847190380096, 0.03798004984855652, -0.11332149803638458, 0.05388085916638374, -0.02622290514409542, 0.05263504385948181, -0.007386419456452131, -0.035121843218803406, 0.03876616060733795, 0.05670161172747612, -0.040069594979286194, -0.054597772657871246, -0.0683038979768753, -0.012983527034521103, -0.05560553818941116, -0.08630475401878357, -0.05181968957185745, -0.12940585613250732, 0.04927273839712143, -0.019680608063936234, -3.326991742898735e-33, 0.00964891817420721, -0.10654251277446747, -0.04079216718673706, 0.12990379333496094, -0.018093498423695564, -0.1188403069972992, -0.034752581268548965, -0.03914806246757507, -0.02220858447253704, -0.004402738530188799, 0.0006881703156977892, -0.03448779508471489, 0.028911784291267395, -0.10732226818799973, 0.008840505965054035, -0.010654519312083721, -0.06452052295207977, -0.12523747980594635, 0.04881962016224861, 0.021263860166072845, -0.04528481140732765, 0.07519230991601944, -0.06502801179885864, 0.03580080345273018, -0.031984902918338776, -0.0453604981303215, 0.02877054177224636, 0.026984283700585365, 0.05349043756723404, 0.01090631540864706, 0.012376152910292149, 0.02666831575334072, -0.0026783510111272335, 0.013785285875201225, -0.0597209706902504, -0.015319757163524628, 0.07851890474557877, 0.06395553052425385, 0.03595711290836334, 0.031275130808353424, 0.06223069131374359, 0.015374332666397095, 0.005298895761370659, -0.008478749543428421, 0.011518214829266071, 0.01408662460744381, -0.030603021383285522, -0.014479746110737324, 0.05263809859752655, -0.045181941241025925, 0.0027386266738176346, -0.044380538165569305, -0.08453928679227829, -0.04075556620955467, -0.0919816642999649, -0.05286572501063347, 0.002746179234236479, -0.06686484813690186, -0.012205343693494797, -0.06612993776798248, -0.04513564705848694, 0.02035905234515667, 0.023236693814396858, -0.037820108234882355, -0.015041615813970566, 0.005077418405562639, -0.0768546611070633, -0.07915301620960236, -0.06727434694766998, -0.04721726477146149, 0.08727922290563583, -0.040862295776605606, 0.0029349103569984436, 0.04895762726664543, 0.021853342652320862, -0.038942452520132065, -0.08583448827266693, -0.044845737516880035, 0.07564494758844376, 0.005025620572268963, 0.04951547831296921, 0.03641442209482193, 0.09206076711416245, 0.11572116613388062, -0.08644787967205048, 0.007406341843307018, -0.045727793127298355, 0.1524352729320526, -0.021793557330965996, -0.02398057095706463, 0.007636282127350569, -0.01802506484091282, -0.04006281867623329, 0.09320557862520218, -0.07785344123840332, -5.379411760486619e-08, -0.050177156925201416, 0.022631501778960228, -0.02401353418827057, 0.0022796920966356993, -0.04839218035340309, 0.03398209810256958, 0.015156224370002747, 0.05494875833392143, 0.016239428892731667, -0.017586616799235344, 0.08491548895835876, 0.012292991392314434, -0.0421830490231514, 0.016519784927368164, 0.05433386564254761, 0.01439948845654726, 0.03795269876718521, 0.02624073438346386, -0.033413659781217575, -0.04529551416635513, 0.015737472102046013, 0.017686262726783752, -0.01750386320054531, -0.015252111479640007, 0.10395428538322449, -0.048478662967681885, -0.11301583051681519, 0.07378688454627991, 0.01501928549259901, 0.102344810962677, 0.03137185797095299, -0.041443970054388046, 0.03590121492743492, 0.0790121927857399, -0.01089024730026722, 0.0346355140209198, -0.009700114838778973, -0.06196404621005058, 0.04841116443276405, -0.034499552100896835, -0.0067431507632136345, 0.03468888998031616, -0.07377398014068604, 0.017614902928471565, -0.004502539057284594, -0.017804495990276337, 0.008228140883147717, -0.04577662795782089, 0.03505935147404671, -0.020614994689822197, -0.06490084528923035, -0.008743474259972572, -0.02649691142141819, 0.02135300636291504, -0.020440319553017616, 0.016730453819036484, 0.07328590005636215, -0.05032027140259743, 0.08627701550722122, -0.009286249987781048, -0.009205757640302181, 0.005948582198470831, 0.04479200765490532, -0.024800091981887817 ] }, { "text": "### Memory Systems\n\nAgents need memory to maintain coherence across long interactions:\n\n- **Short-term memory**: Current conversation context\n- **Long-term memory**: Persistent storage of facts, preferences, and past interactions\n- **Episodic memory**: Recollection of specific past events or tasks\n- **Semantic memory**: General knowledge and learned concepts\n\n### Planning Strategies\n\nDifferent approaches to breaking down complex tasks:\n\n- **ReAct (Reasoning + Acting)**: Interleave reasoning traces with actions\n- **Chain of Thought**: Step-by-step reasoning before acting\n- **Tree of Thoughts**: Explore multiple reasoning paths\n- **Plan-and-Execute**: Create a full plan first, then execute", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_7", "embedding": [ 0.06126389652490616, -0.009238344617187977, -0.018254926428198814, 0.01092306338250637, -0.0033944458700716496, 0.004047280177474022, 0.021110188215970993, 0.07555968314409256, 0.004312689416110516, 0.010892365127801895, -0.04878304898738861, 0.01595478691160679, 0.0011270196409896016, 0.0575566403567791, 0.07564720511436462, 0.06026332825422287, 0.0022578700445592403, -0.019502656534314156, -0.0469474196434021, -0.05421916022896767, 0.049726054072380066, -0.016008997336030006, 0.05040925368666649, 0.018984932452440262, -0.08655602484941483, 0.0617574118077755, 0.027874333783984184, -0.07952603697776794, 0.034386999905109406, -0.018875543028116226, 0.140607088804245, 0.06443442404270172, 0.005074753891676664, 0.041381947696208954, -0.02862057462334633, 0.12118250131607056, -0.09436017274856567, 0.011794173158705235, -0.004278995096683502, -0.06000177562236786, -0.10164515674114227, 0.030767695978283882, -0.02932383306324482, -3.1244333513313904e-05, 0.06043831259012222, 0.004892116878181696, -0.06524155288934708, -0.029618792235851288, -0.030292633920907974, -0.002944969804957509, -0.15045759081840515, 0.010708297602832317, -0.019619973376393318, 0.025947948917746544, 0.0321446917951107, 0.07242359966039658, 0.010169769637286663, 0.01756368763744831, -0.02490558847784996, -0.04576590284705162, -0.03625857084989548, -0.11016052216291428, -0.017415335401892662, -0.020458418875932693, -0.08777051419019699, 0.064860038459301, -0.005758284591138363, 0.004398766905069351, 0.057131268084049225, 0.017835192382335663, -0.0676058754324913, 0.012627034448087215, -0.03696582466363907, -0.002147366525605321, -0.01601542718708515, 0.03076126053929329, 0.001230017514899373, -0.08907314389944077, 0.006939675658941269, -0.06148971617221832, -0.025820674374699593, 0.0037148913834244013, -0.008264666423201561, 0.060600798577070236, 0.04810820147395134, -0.0164080448448658, 0.022876029834151268, 0.04269782081246376, 0.0034574607852846384, -0.0174906924366951, 0.04047130048274994, -0.10391107946634293, 0.05389782041311264, -0.01888449303805828, 0.03568725660443306, 0.08433663100004196, -0.05977960303425789, -0.0837608203291893, -0.05719698965549469, 0.00538281723856926, 0.034786518663167953, 0.07799419015645981, -0.026513582095503807, -0.01842654123902321, -0.09089790284633636, 0.0077273170463740826, 0.016436489298939705, -0.013710902072489262, -0.022883377969264984, -0.0159069262444973, -0.047836195677518845, -0.02853192389011383, 0.03029489889740944, 0.04726099222898483, 0.06633006036281586, -0.0006598439067602158, 0.03236619010567665, 0.032230444252491, 0.06640511006116867, 0.05195588618516922, 0.08605197817087173, -0.025857822969555855, 0.014295400120317936, 0.045357853174209595, -0.021851390600204468, -0.0499223992228508, 0.026333963498473167, 3.801511709374889e-35, -0.003314446425065398, 0.006625252775847912, 0.015586679801344872, 0.12225303053855896, 0.06934463977813721, 0.029772650450468063, 0.02867347002029419, 0.006040931213647127, -0.035975463688373566, 0.035616159439086914, 0.055320046842098236, -0.0016964467940852046, -0.05582937225699425, 0.058560457080602646, 0.03616456314921379, -0.0665564090013504, -0.1079128310084343, 0.07812876999378204, -0.0002565212780609727, -0.01734127663075924, -0.0012803032295778394, 0.028995584696531296, 0.010068323463201523, 0.0031894186977297068, 0.09481396526098251, 0.03643578290939331, 0.04073315113782883, 0.005587878171354532, 0.0162950549274683, -0.037799689918756485, -0.07748930901288986, 0.050540462136268616, -0.1186184361577034, 0.04891559109091759, 0.016850735992193222, 0.05040324479341507, -0.039899926632642746, -0.07983040809631348, 0.039991170167922974, -0.04958934336900711, -0.023635482415556908, 0.0068350122310221195, 0.019112395122647285, 0.013462362810969353, -0.01605483703315258, -0.048436760902404785, -0.004279050976037979, -0.0035054779145866632, -0.008350984193384647, 0.02483433671295643, -0.030340366065502167, 0.026807857677340508, -0.004775145556777716, -0.08904871344566345, 0.00896360632032156, -0.024031002074480057, 0.01321541890501976, -0.03052741102874279, 0.06962418556213379, 0.074826180934906, 0.07443954050540924, 0.008249245584011078, -0.055528827011585236, 0.09524139016866684, 0.049349360167980194, 0.06234905868768692, -0.08958236128091812, 0.0914665162563324, 0.08824261277914047, -0.035152751952409744, -0.040706660598516464, 0.03847253695130348, 0.06456584483385086, 0.004289842210710049, -0.06115122139453888, -0.056001100689172745, -0.007341599557548761, -0.09637081623077393, -0.04077152907848358, 0.008062154985964298, 0.006898095365613699, -0.06009206920862198, -0.05776217579841614, -0.010362345725297928, 0.03206001594662666, -0.07646362483501434, -0.018806036561727524, -0.07909709960222244, -0.03960246592760086, 0.06665045768022537, -0.03397499769926071, 0.015858350321650505, 0.010880417190492153, 0.03935082256793976, -0.06824050843715668, -2.4352095658031302e-33, 0.007567265536636114, -0.060127586126327515, -0.05857422947883606, 0.015928814187645912, 0.035991352051496506, -0.06519842147827148, -0.04365626722574234, -0.06366989016532898, -0.0038295930717140436, -0.07150886952877045, -0.09551042318344116, 0.031515318900346756, 0.04182979837059975, -0.0028027573134750128, 0.008531727828085423, -0.02348753809928894, 0.048537131398916245, -0.04493687301874161, 0.01912064105272293, 0.002484846394509077, -0.0019291081698611379, 0.047097302973270416, -0.10663934051990509, 0.024432769045233727, -0.020621048286557198, 0.03750201314687729, 0.06219892203807831, -0.0256515946239233, 0.007192316465079784, 0.027592305094003677, -0.03691242262721062, -0.09475953876972198, 0.0420733243227005, 0.013884282670915127, -0.06373392790555954, 0.009237194433808327, 0.04183513671159744, -0.04542364180088043, -0.04473382607102394, 0.011298205703496933, 0.07489839941263199, -0.06645282357931137, -0.04804170876741409, -0.050068940967321396, -0.020357558503746986, 0.0033879324328154325, -0.13209731876850128, 0.09191079437732697, -0.04917200282216072, 0.02135954424738884, -0.017957566305994987, -0.007157915737479925, -0.08121922612190247, -0.13432660698890686, -0.01645994372665882, -0.029615649953484535, 0.047335367649793625, -0.05749513953924179, 0.04576149955391884, -0.0494842566549778, -0.04640627279877663, 0.004033421631902456, -0.006036220584064722, 0.0005170193035155535, 0.010697589255869389, -0.010771228931844234, -0.0640648603439331, -0.011561059392988682, -0.006157089490443468, -0.00401294557377696, 0.046328868716955185, 0.029413817450404167, -0.050132449716329575, -0.036814238876104355, 0.12418868392705917, -0.03649960085749626, -0.10190185904502869, -0.05948210507631302, -0.017546750605106354, -0.03802580013871193, -0.06586828082799911, 0.013553944416344166, 0.03764869645237923, 0.08119451254606247, -0.051550399512052536, 0.07855571806430817, -0.08884551376104355, 0.11355616897344589, 0.0028809690847992897, -0.034150704741477966, -0.050948746502399445, -0.020872056484222412, 0.05113784968852997, 0.033507995307445526, -0.09447261691093445, -4.55673614396801e-08, -0.03559910133481026, -0.05389341339468956, 0.0802285373210907, 0.022755496203899384, 0.06598375737667084, -0.0609767884016037, -0.01486194971948862, 0.03809742256999016, -0.008886117488145828, 0.032505471259355545, 0.05309540033340454, 0.03913889825344086, -0.01830654963850975, 0.0433669313788414, 0.06444436311721802, 0.007253244984894991, 0.05431153625249863, 0.02060643769800663, 0.007122080773115158, -0.0349714457988739, 0.08933503180742264, -0.0683274120092392, -0.07469119131565094, 0.08104962855577469, 0.024534201249480247, -0.03552504628896713, 0.012562924064695835, 0.11199667304754257, 0.0006295486818999052, 0.05909009277820587, 0.013708878308534622, -0.012504744343459606, 0.002350020920857787, -0.020770803093910217, 0.03084617853164673, -0.020066678524017334, 0.04972495511174202, -0.023335156962275505, 0.017971960827708244, -0.026278773322701454, -0.05162975937128067, 0.029755663126707077, -0.024138951674103737, 0.04758168384432793, 0.022853834554553032, 0.034984197467565536, -0.1258077323436737, -0.07930640131235123, 0.009177816100418568, -0.06018401309847832, -0.05400187522172928, 0.063176728785038, -0.0023928452283143997, 0.0852176621556282, 0.10020504891872406, 0.041886139661073685, 0.05914641171693802, -0.024447621777653694, 0.0343003086745739, 0.0275934636592865, 0.06561587005853653, 0.09085088223218918, -0.05400518700480461, -0.002597553189843893 ] }, { "text": "## The Agentic Ecosystem\n\nThe field is rapidly evolving with frameworks, protocols, and tools designed to make building agents easier and more reliable.\n\n### Agent Frameworks\n\nSeveral frameworks have emerged to simplify agent development:\n\n**Pydantic AI** - A Python framework that leverages Pydantic's type system for building type-safe, validated agents. It emphasizes developer experience with clean APIs and strong typing.\n\n**AWS Bedrock Agents** - Amazon's managed service for building agents that can securely connect to enterprise data sources and take actions. Provides infrastructure for production-grade agent deployments.\n\n**LangGraph** - A framework for building stateful, multi-actor applications with LLMs, supporting complex agent workflows and coordination.", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_8", "embedding": [ -0.026604190468788147, -0.011884501203894615, -0.06494338810443878, -0.055608928203582764, 0.04716106131672859, -0.0886828750371933, 0.0013952089939266443, 0.002478690817952156, -0.01013804692775011, 0.04438880458474159, -0.023775896057486534, -0.03518713265657425, 0.08812474459409714, 0.02030995488166809, 0.10647176206111908, 0.0353962704539299, 0.022109806537628174, -0.0018479387508705258, -0.014478178694844246, -0.07723734527826309, -0.06436966359615326, 0.06635689735412598, -0.025456653907895088, 0.010400612838566303, -0.13163088262081146, -0.010770679451525211, -0.025644898414611816, -0.03164799511432648, -0.00535642821341753, -0.052588772028684616, 0.04043492674827576, 0.06335471570491791, 0.028712939471006393, 0.0637831762433052, 0.03937673941254616, 0.10915979743003845, -0.049225807189941406, -0.040523115545511246, -0.02993902750313282, 0.02995382994413376, -0.007203256245702505, -0.05348236486315727, -0.06261811405420303, -0.05626329779624939, -0.0737634226679802, 0.007822600193321705, -0.025030536577105522, -0.0017369190463796258, 0.012898820452392101, -0.044734206050634384, -0.09012885391712189, -0.0687381774187088, 0.00032899543293751776, -0.01495030615478754, -0.06677084416151047, 0.002252106321975589, 0.033281244337558746, -0.0002895682991947979, -0.00546412356197834, -0.11778569966554642, 0.0357750803232193, -0.006110748276114464, 0.014297585003077984, 0.028714345768094063, -0.03641723468899727, 0.08357823640108109, -0.0674516037106514, -0.020041102543473244, 0.057203855365514755, -0.10670156031847, -0.045686084777116776, -0.07864890992641449, -0.01880757138133049, 0.027076758444309235, -0.03580264747142792, -0.001369065954349935, 0.009061886928975582, -0.028790784999728203, 0.07103846967220306, -0.03663364797830582, -0.04811228811740875, -0.000736297806724906, -0.06458508223295212, 0.11083769053220749, -0.01174008846282959, 0.013935313560068607, 0.05941769853234291, 0.03998691216111183, 0.045726533979177475, 0.002926543587818742, 0.06856054812669754, -0.03921033442020416, 0.13093844056129456, 0.032009292393922806, 0.024411367252469063, 0.074857197701931, -0.027499213814735413, -0.1011374369263649, -0.0567314438521862, 0.0484062060713768, -0.05127491056919098, -0.05294818803668022, -0.011970527470111847, -0.004041101783514023, 0.007874772883951664, 0.04761640354990959, -0.020314892753958702, 0.001867694896645844, 0.01181131973862648, -0.0002925300213973969, -0.058873459696769714, -0.008837436325848103, 0.005535863805562258, -0.03398692235350609, 0.043603796511888504, 0.02690497227013111, -0.030097730457782745, 0.08806673437356949, 0.013837733305990696, 0.01981731317937374, 0.0949898511171341, -0.009069724939763546, 0.03383895009756088, -0.020321086049079895, 0.09674307703971863, 0.05496262386441231, -0.0022339606657624245, 2.0387379128028275e-33, -0.0054573859088122845, 0.046964000910520554, -0.003193154465407133, 0.05058768019080162, 0.0737752616405487, -0.031760867685079575, 0.05473418906331062, 0.029899965971708298, -0.08002927154302597, -0.03932904079556465, -0.024299336597323418, 0.10587753355503082, -0.03064286895096302, 0.05845829099416733, 0.007526818197220564, -0.07419601827859879, -0.02843591570854187, 0.05879250168800354, 0.052694082260131836, 0.06074434891343117, 0.05531954765319824, -0.006999469827860594, 0.040654975920915604, 0.0610528290271759, 0.09407082945108414, 0.03270109370350838, 0.02249082364141941, -0.029420319944620132, 0.1327061802148819, 0.015561896376311779, -0.07577592134475708, 0.032639674842357635, -0.05300247296690941, 0.05903046950697899, -0.07493214309215546, 0.018647050485014915, -0.11896210163831711, -0.08808444440364838, -0.003680542577058077, -0.015598362311720848, -0.0698692575097084, 0.008646110072731972, 0.04969817399978638, -0.06959760189056396, -0.03703049570322037, -0.04460418224334717, -0.0572037510573864, 0.05427052825689316, 0.06246986985206604, -0.02126246877014637, 0.006033651996403933, -0.009484355337917805, 0.1011878103017807, 0.04381468892097473, -0.007760352920740843, -0.012490781024098396, 0.03799663856625557, -0.001388078206218779, -0.03152237460017204, -0.017086299136281013, 0.004446358419954777, 0.0007790732197463512, -0.008446205407381058, 0.024894120171666145, 0.01682944968342781, -0.04247307777404785, -0.006551952101290226, 0.07501405477523804, 0.041999947279691696, -0.0012802524724975228, -0.005491584539413452, 0.07757946848869324, 0.07176230102777481, 0.08811616897583008, -0.045283786952495575, -0.061636172235012054, 0.021151680499315262, -0.05012897402048111, 0.04019736498594284, 0.0074999043717980385, -0.09206826239824295, 0.04633861780166626, -0.02194131538271904, 0.05719469115138054, -0.007437203545123339, -0.09549803286790848, -0.05133004114031792, 0.03248655050992966, -0.0237960834056139, 0.03451591357588768, -0.09541372209787369, -0.06632956862449646, -0.008020413108170033, 0.08321402221918106, -0.03856553137302399, -3.56658467490318e-33, -0.04622665047645569, -0.06843814253807068, -0.10090481489896774, 0.046339958906173706, 0.020825214684009552, -0.11079058051109314, -0.01137689221650362, 0.009012050926685333, -0.01147210318595171, -0.005325688980519772, -0.03521624580025673, -0.0010340306907892227, 0.05668437480926514, -0.10072149336338043, 0.01155050564557314, -0.0767449215054512, -0.01466272585093975, -0.09431494772434235, 0.029306426644325256, -0.007338690105825663, -0.030676068738102913, 0.0073842392303049564, -0.10243554413318634, -0.02972567453980446, 0.04792611673474312, 0.011757837608456612, -0.03391215205192566, -0.022225400432944298, 0.005750102922320366, 0.005977059248834848, -0.013338710181415081, 0.020682867616415024, -0.022920899093151093, -0.0063730450347065926, -0.02985851652920246, 0.029699942097067833, -0.0029767993837594986, 0.004971106071025133, -0.0252766702324152, -0.02686639316380024, 0.0997469574213028, -0.03109973855316639, -0.047292523086071014, -0.013196722604334354, -0.004888929892331362, 0.06800150126218796, -0.06001724302768707, 0.09308372437953949, 0.01784706674516201, -0.07462744414806366, -0.04909425228834152, 0.04060394689440727, -0.01641884259879589, -0.093842051923275, -0.023526065051555634, 0.016203807666897774, 0.10287477821111679, 0.07200923562049866, -0.04037584736943245, -0.003861277597025037, -0.055514488369226456, -0.03300865739583969, 0.024716895073652267, 0.08452627062797546, -0.061316102743148804, 0.002854775870218873, -0.07809380441904068, -0.03440475091338158, -0.04316118732094765, -0.04953031986951828, 0.10742384195327759, -0.001025734469294548, -0.06257738173007965, 0.04631001129746437, 0.0244036503136158, -0.002329544397071004, -0.05772656202316284, -0.06726675480604172, 0.037117425352334976, -0.0064922901801764965, 0.008174254558980465, 0.04704148694872856, 0.02224905788898468, 0.06366520375013351, 0.02730713039636612, 0.03979729488492012, 0.0043873912654817104, 0.0281422920525074, 0.06263121962547302, 0.050981149077415466, -0.05880643054842949, 0.0008145856554619968, -0.016025077551603317, 0.050501324236392975, -0.08336896449327469, -4.7136367697930837e-08, -0.0054521034471690655, 0.018912341445684433, 0.015782346948981285, -0.013364243321120739, -0.022658294066786766, -0.007688474841415882, 0.03840057551860809, -0.012135833501815796, 0.045557502657175064, 0.023605024442076683, 0.0588948130607605, -0.07321631908416748, -0.055144358426332474, 0.01145082525908947, 0.04835912585258484, 0.07899870723485947, 0.014074466191232204, 0.03232032060623169, -0.028060540556907654, -0.05753792077302933, 0.03030729852616787, -0.019347775727510452, -0.07478592544794083, 0.010808714665472507, 0.020783528685569763, -0.0032687606289982796, -3.605934762163088e-05, 0.009256486780941486, -0.014543958008289337, 0.08493319153785706, 0.008382098749279976, -0.05585770681500435, 0.0245492123067379, 0.043388597667217255, 0.02645869553089142, 0.0843287780880928, -0.030019471421837807, -0.0832848772406578, 0.017843900248408318, -0.018480893224477768, -0.032926417887210846, 0.05223223567008972, -0.06140778958797455, -0.058531567454338074, 0.09569919109344482, 0.022633254528045654, -0.09472071379423141, -0.0325489416718483, 0.05388414114713669, -0.03004494309425354, -0.034527845680713654, -0.026532527059316635, -0.06142623350024223, 0.07890867441892624, 0.06385715305805206, 0.03531021252274513, 0.04075366631150246, -0.09362570941448212, 0.13557375967502594, 0.030221974477171898, -0.011663655750453472, 0.017301347106695175, 0.12447923421859741, -0.024352027103304863 ] }, { "text": "### Interoperability Protocols\n\nAs agents become more sophisticated, standards for communication become crucial:\n\n**Model Context Protocol (MCP)** - An open protocol developed by Anthropic for connecting AI assistants to external data sources and tools. MCP provides a standardized way to expose capabilities to LLMs.\n\n**Agent2Agent (A2A)** - Google's protocol enabling different AI agents to communicate and collaborate, regardless of their underlying frameworks or vendors.\n\n### Observability and Monitoring\n\nProduction agents require robust monitoring:\n\n**Langfuse** - An open-source observability platform for LLM applications. It provides tracing, analytics, and evaluation tools specifically designed for understanding agent behavior and debugging issues.", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_9", "embedding": [ -0.017589643597602844, -0.06329724937677383, -0.01584078185260296, -0.009779530577361584, 0.06602546572685242, -0.06053419038653374, -0.01248085219413042, -0.05049027130007744, -0.05616649612784386, -0.012087656185030937, -0.016608597710728645, -0.05561358109116554, 0.032896947115659714, 0.021866943687200546, 0.007961675524711609, 0.057196930050849915, 0.1673750877380371, -0.030515484511852264, -0.011837693862617016, -0.03217846155166626, 0.004780108574777842, 0.05372872203588486, -0.057743139564991, 5.342661825125106e-05, -0.07716640084981918, 0.013300417922437191, 0.041145209223032, -0.07677920162677765, -0.011560832150280476, -0.012114137411117554, -0.004603608511388302, -0.01571829989552498, -0.016578441485762596, 0.06270159035921097, 0.04364016652107239, 0.05852411314845085, 0.06751719862222672, 0.0021425089798867702, -0.021903328597545624, -0.041615862399339676, 0.006376253440976143, -0.0609465092420578, -0.052840862423181534, -0.05808216705918312, -0.007460251450538635, -0.017524592578411102, -0.026103997603058815, -0.04854616895318031, -0.07822804152965546, 0.0007687969482503831, -0.06973505765199661, -0.031124792993068695, 0.05630124732851982, 0.00020199180289637297, 0.03594060242176056, 0.003803204046562314, 0.00906379520893097, -0.004267917014658451, -0.017416806891560555, 0.03786774352192879, -0.03264983370900154, -0.0036889030598104, -0.0678076222538948, 0.03801741451025009, -0.005178212188184261, 0.0623353086411953, -0.006222772412002087, 0.04356939718127251, 0.005916187074035406, -0.07690839469432831, -0.08045102655887604, -0.03709664195775986, -0.05948471277952194, -0.010073027573525906, -0.04379855841398239, 0.03685300424695015, -0.03995620459318161, -0.002088272711262107, 0.11257319897413254, -0.07493898272514343, -0.04262089356780052, -0.014055576175451279, 0.0062332660891115665, 0.10319265723228455, 0.02471192367374897, 0.01400744542479515, 0.051874421536922455, 0.07347525656223297, 0.05347221717238426, 0.05669533833861351, -0.02475069649517536, -0.003610790241509676, 0.017171837389469147, 0.047108810395002365, 0.12415321171283722, 0.05500852316617966, -0.02748604118824005, -0.09109484404325485, -0.01982029527425766, 0.04098709300160408, -0.03177317976951599, 0.029725629836320877, -0.019572820514440536, -0.024585183709859848, -0.03752397745847702, 0.004536650609225035, 0.014791375957429409, -0.017036229372024536, 0.08046558499336243, 0.001532011548988521, 0.009050514549016953, 0.01233004778623581, 0.032492004334926605, -0.03339145705103874, 0.11042677611112595, -0.0033391022589057684, 0.0016674227081239223, 0.03232691437005997, 0.0053465720266103745, -0.023000484332442284, 0.050597745925188065, -0.05705907940864563, 0.03771340847015381, 0.017397742718458176, 0.12366002798080444, 0.049462299793958664, 0.007149862591177225, 2.060000401557295e-33, 0.06595999747514725, 0.0009403981384821236, 0.003869253909215331, 0.05527588352560997, 0.05863924324512482, 0.043367184698581696, 0.04078863933682442, 0.019545966759324074, -0.02122366800904274, -0.01670079678297043, -0.0180773064494133, 0.11984023451805115, -0.07062282413244247, -0.03429216146469116, 0.03773870691657066, 0.022553864866495132, 0.02201627939939499, 0.1084061786532402, 0.020587043836712837, 0.019543534144759178, 0.025774342939257622, -0.06200661137700081, 0.02000807598233223, -0.0026437388733029366, 0.1028037741780281, 0.08714998513460159, -0.015121398493647575, -0.03880336135625839, 0.11576958745718002, 0.03032888099551201, -0.008357815444469452, 0.02973000891506672, -0.03392741084098816, 0.07508930563926697, -0.07189363241195679, -0.009405238553881645, -0.15012039244174957, -0.07066382467746735, -0.03527134656906128, 0.020864399150013924, -0.046625033020973206, -0.016365353018045425, 0.014291725121438503, -0.06374409794807434, -0.09008892625570297, -0.0545416921377182, -0.06051976606249809, -0.04065226390957832, 0.08246991783380508, -0.04762589931488037, 0.04182160645723343, 0.04857031628489494, 0.07001961767673492, -0.07201529294252396, 0.018731629475951195, -0.007835091091692448, 0.04113329201936722, -0.035679735243320465, -0.046213820576667786, 0.05634341388940811, -0.02619389072060585, 0.05078420788049698, -0.0032307635992765427, 0.005227672401815653, 0.09725245088338852, -0.04720056802034378, -0.06952749192714691, 0.05981424078345299, 0.03885408863425255, 0.003331138752400875, -0.03348711133003235, 0.01877669245004654, 0.0324227511882782, 0.0395716167986393, -0.05091702565550804, -0.08134771138429642, 0.010788989253342152, -0.01071180496364832, 0.049087151885032654, -0.02918550930917263, -0.014735213480889797, 0.00952038262039423, -0.0018358222441747785, -0.030037766322493553, 0.006105863954871893, -0.04632798209786415, -0.13734285533428192, -0.00015463668387383223, -0.012721369974315166, 0.0809747725725174, -0.04259457439184189, -0.007766376249492168, -0.03305841237306595, 0.10362216830253601, -0.06548702716827393, -4.0006572697794185e-33, -0.06414013355970383, -0.056130535900592804, -0.08234468102455139, 0.07796069234609604, -0.021436894312500954, -0.11652161926031113, -0.03236465901136398, 0.037460532039403915, 0.035464875400066376, 0.013286768458783627, -0.062407806515693665, -0.03417380899190903, 0.034531112760305405, -0.04072941839694977, 0.010720726102590561, -0.08339488506317139, 0.001109056524001062, -0.0985005646944046, 0.007010182365775108, -0.05651421099901199, 0.038379717618227005, 0.0422249361872673, 0.010828034020960331, -0.07562172412872314, 0.007650227285921574, 0.03510536998510361, 0.01948253996670246, -0.010976402088999748, 0.052077341824769974, -0.040203649550676346, 0.07013840973377228, 0.06517684459686279, 0.0013174941996112466, 0.015916913747787476, -0.004471530206501484, 0.047254957258701324, 0.005165595095604658, 0.042814772576093674, 0.009791288524866104, -0.011566795408725739, 0.10282070934772491, -0.0007676049135625362, -0.06462316960096359, 0.006981364917010069, -0.004419389646500349, 0.034304410219192505, -0.040487140417099, 0.04428635537624359, 0.02113933674991131, -0.08813179284334183, -0.025392889976501465, -0.045387908816337585, 0.004548846278339624, -0.09398967027664185, -0.10472548007965088, 0.05161972716450691, 0.06712179630994797, 0.01905667409300804, -0.04258307069540024, -0.011889379471540451, 0.006030414253473282, -0.05536118149757385, 0.04940621554851532, 0.07766739279031754, -0.027717838063836098, 0.07669124007225037, 0.026106005534529686, 0.010829283855855465, -0.017331842333078384, -0.015700919553637505, 0.12293637543916702, -0.057068679481744766, -0.09543228894472122, 0.025627614930272102, 0.07147428393363953, -0.008874072693288326, -0.08838722109794617, -0.1038668230175972, -0.007546229753643274, -0.01777799427509308, 0.021039403975009918, 0.02960817702114582, -0.002088974229991436, 0.029046477749943733, 0.0074887522496283054, 0.04510292038321495, 0.0005735923768952489, 0.0988885834813118, 0.0811813697218895, -0.011247034184634686, -0.08330786973237991, 0.027055099606513977, -0.12939874827861786, 0.02436404675245285, -0.08501268178224564, -4.378797768822551e-08, -0.041007041931152344, -0.025229020044207573, 0.04179374501109123, -0.0310277808457613, -0.011632001958787441, 0.016119521111249924, -0.02063150331377983, -0.009066492319107056, 0.056039489805698395, 0.030369115993380547, -0.018603364005684853, -0.08007971197366714, -0.046991877257823944, -0.029683459550142288, 0.09063210338354111, -0.016454700380563736, -0.004662869963794947, 0.0013829520903527737, -0.060449354350566864, -0.08628584444522858, 0.029430726543068886, -0.004800465423613787, -0.013858162797987461, 0.05074208602309227, 0.013647664338350296, -0.06993885338306427, -0.016254009678959846, 0.10231431573629379, -0.018638746812939644, 0.053294047713279724, -0.002564220456406474, -0.0007774218684062362, 0.040048860013484955, -0.0016747398767620325, -0.027797361835837364, 0.07998304069042206, -0.002788838930428028, -0.10588973760604858, 0.050943974405527115, -0.06081679090857506, -0.03708353638648987, 0.036055877804756165, -0.027412960305809975, 0.020333314314484596, 0.041275639086961746, 0.019665345549583435, -0.030017787590622902, -0.07986588776111603, 0.026988960802555084, -0.03229766711592674, -0.036440543830394745, -0.03690874204039574, -0.00974310003221035, 0.09104328602552414, 0.02875266596674919, -0.0016357897548004985, 0.021850142627954483, -0.10858031362295151, 0.1289367526769638, 0.06679364293813705, -0.005208829417824745, 0.021168258041143417, 0.04746631905436516, -0.016485512256622314 ] }, { "text": "## Why Agentic Architecture Matters\n\n### Current Applications\n\nAgents are already transforming various domains:\n\n- **Coding Assistants**: Autonomous code generation, debugging, and refactoring\n- **Research Agents**: Literature review, data analysis, and report generation\n- **Customer Service**: Complex issue resolution with tool access\n- **Data Analysis**: End-to-end analysis from data collection to visualization\n- **Personal Assistants**: Calendar management, email handling, task automation", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_10", "embedding": [ -0.06793384999036789, -0.037852466106414795, -0.04798488691449165, -0.006990604568272829, -0.03948540613055229, -0.04158777743577957, -0.01166300568729639, 0.003296956419944763, -0.062453851103782654, 0.004115829709917307, -0.04036583751440048, -0.022827129811048508, 0.0026912495959550142, 0.014346304349601269, 0.06735414266586304, 0.08695797622203827, 0.07867459207773209, -0.057330284267663956, -0.023157550022006035, -0.03317747637629509, 0.01179933175444603, 0.06276429444551468, -0.05096704140305519, 0.006913880351930857, -0.09914368391036987, 0.01911962777376175, 0.019162826240062714, -0.11098922789096832, -0.020344337448477745, -0.013693375512957573, 0.011768149212002754, 0.07473459094762802, 0.0332818329334259, 0.08333386480808258, 0.06312210112810135, 0.07367715239524841, 0.014971824362874031, 0.0024939512368291616, 0.027126071974635124, -0.01503363810479641, -0.10433575510978699, -0.06122475862503052, -0.05094222351908684, -0.016923196613788605, 0.05626475438475609, -0.07116839289665222, -0.0155576691031456, -0.03850194066762924, -0.036557529121637344, 0.0032903135288506746, -0.08676234632730484, -0.04220882058143616, 0.05751040205359459, 0.02815861999988556, -0.08307665586471558, -0.010951385833323002, 0.04457520321011543, -0.00539762619882822, 0.010442224331200123, 0.012476545758545399, -0.024269819259643555, 0.021587403491139412, -0.027919145300984383, 0.040624700486660004, -0.03355467692017555, -0.007924054749310017, -0.10063084959983826, -0.04154503718018532, 0.007564950734376907, -0.08854140341281891, -0.0979430228471756, -0.03394164890050888, -0.03021056391298771, 0.018147367984056473, 0.05318804085254669, -0.011122966185212135, -0.029121678322553635, 0.01874171569943428, 0.1041380763053894, -0.1260436326265335, -0.018684305250644684, -0.0034984908998012543, -0.004375897813588381, 0.12277863919734955, -0.018025513738393784, 0.04054901376366615, 0.009794818237423897, 0.032403960824012756, -0.004153246525675058, 0.009788286872208118, 0.05222633481025696, -0.04394546523690224, 0.12354155629873276, -0.016874827444553375, 0.059361234307289124, 0.01771191507577896, -0.035595450550317764, -0.14152401685714722, -0.061913713812828064, 0.019395429641008377, -0.03966759517788887, 0.0319950245320797, -0.009862546809017658, -0.011163879185914993, -0.07469912618398666, 0.008404058404266834, 0.03847568854689598, 0.05201146379113197, -0.00236662314273417, -0.04847102239727974, -0.04915068671107292, -0.022758817300200462, -0.024704525247216225, -0.06244831159710884, 0.13009054958820343, -0.04008166119456291, -0.010480322875082493, 0.06773053854703903, 0.031248953193426132, 0.052636392414569855, 0.009187445975840092, -0.027071744203567505, -0.09299326688051224, 0.023057924583554268, 0.11187291145324707, 0.044818393886089325, -0.050751131027936935, 4.032057662625759e-34, 0.016263453289866447, 0.08327984809875488, 0.02106727659702301, 0.0838112160563469, 0.03225550800561905, -0.04076775163412094, 0.015433459542691708, 0.013636250980198383, -0.015661567449569702, -0.030246181413531303, 0.020765481516718864, 0.13325105607509613, -0.04518618434667587, 0.05928967148065567, -0.003892834996804595, -0.0022908481769263744, -0.030868781730532646, 0.10118235647678375, 0.01222308911383152, 0.02099507860839367, -0.006761452183127403, 0.013266213238239288, 0.06990256905555725, 0.047919295728206635, 0.06995128095149994, 0.06821763515472412, -0.006297894287854433, -0.028506338596343994, 0.08494249731302261, -0.002910949755460024, -0.060356225818395615, 0.029852213338017464, -0.037347760051488876, 0.06700123846530914, -0.07872147113084793, 0.04059396684169769, -0.03934500366449356, -0.09862155467271805, 0.0008088659378699958, 0.05619632825255394, -0.07903464883565903, 0.08600004017353058, 0.025198165327310562, -0.04711579158902168, 0.03390314057469368, -0.0369437001645565, 0.018199054524302483, 0.009054088033735752, 0.08011800050735474, -0.004820872098207474, 0.03676719218492508, 0.09678983688354492, 0.02687765099108219, 0.04173748567700386, 0.016726741567254066, -0.026410775259137154, 0.05713324993848801, -0.031789977103471756, 0.04455283656716347, -0.0036981012672185898, 0.020859837532043457, -0.030490940436720848, -0.0192202590405941, 0.00963812880218029, 0.007067810278385878, -0.06863968074321747, 0.05020314082503319, 0.04211333766579628, 0.05264105275273323, 0.0390160046517849, -0.0672161653637886, 0.038377340883016586, 0.04807869717478752, 0.0621148981153965, -0.04297788068652153, -0.07730311155319214, -0.004639039747416973, -0.08366468548774719, 0.02172963134944439, -0.03774912282824516, -0.048787008970975876, 0.07476646453142166, -0.001546201528981328, -0.03222834691405296, 0.032806478440761566, -0.05180155485868454, -0.01847681775689125, -0.04029727354645729, -0.023732418194413185, 0.05715791508555412, -0.03429592400789261, 0.013410807587206364, -0.05923566594719887, 0.1107882559299469, -0.008662591688334942, -3.2399427128004986e-33, -0.042850151658058167, -0.0635138526558876, -0.14959153532981873, 0.037561532109975815, -0.0050230990163981915, -0.07014474272727966, -0.004223763942718506, -0.06445998698472977, 0.050102733075618744, -0.029229408130049706, -0.020781949162483215, -0.026674417778849602, -0.0012065371265634894, -0.03082473948597908, 0.01936669833958149, -0.02034742571413517, -0.007530190981924534, -0.10616394877433777, -0.011916536837816238, 0.002035558922216296, 0.039266571402549744, 0.06701377779245377, -0.046765588223934174, -0.04499530419707298, 0.006327442824840546, -0.012583387084305286, -0.009940798394382, 0.022313622757792473, 0.10361696034669876, -0.06965193897485733, 0.013930710032582283, -0.004190582782030106, 0.008218072354793549, -0.01896621473133564, 0.003831132547929883, 0.013562028296291828, 0.020148003473877907, -0.022474022582173347, 0.023657014593482018, 0.04307786375284195, 0.1188310831785202, -0.0827944427728653, -0.026143990457057953, 0.004114162176847458, 0.03223069757223129, 0.008701643906533718, -0.10487492382526398, 0.049630407243967056, -0.043460503220558167, -0.042074017226696014, -0.026392893865704536, -0.00757446838542819, -0.05924089625477791, -0.10012155771255493, -0.018362034112215042, 0.028018319979310036, 0.09205169230699539, -0.035850122570991516, -0.027886157855391502, 0.01976168528199196, -0.05069153755903244, 0.027514448389410973, 0.061592258512973785, 0.0020152509678155184, -0.0328284315764904, -0.051941223442554474, -0.02492956630885601, -0.01425494346767664, -0.08736486732959747, -0.04905656352639198, 0.14684447646141052, -0.07754790782928467, -0.13166563212871552, 0.03099125809967518, -0.012324310839176178, -0.022889364510774612, -0.03212590515613556, -0.05036076158285141, -0.006058467086404562, -0.0058980099856853485, -0.07541270554065704, 0.04654344543814659, 0.05040125548839569, 0.051143404096364975, -0.03032885119318962, 0.08346381038427353, 0.014699792489409447, 0.027552761137485504, -0.010907224379479885, -0.014973025768995285, -0.06448031961917877, -0.016893425956368446, -0.0012932713143527508, 0.00322895054705441, -0.08962468057870865, -4.5585050401086846e-08, 0.017192864790558815, -0.022293293848633766, 0.049295246601104736, 0.01603146456182003, -0.0004977763164788485, -0.05195217952132225, -0.02115982584655285, 0.09601126611232758, 0.03363333269953728, 0.025498373433947563, 0.05151764303445816, -0.020063161849975586, 0.004443326499313116, 0.01039601769298315, 0.10316403955221176, 0.06024551764130592, -0.010591086000204086, -0.02775140292942524, -0.013301522471010685, -0.06112157553434372, 0.03376896306872368, 0.0198845025151968, -0.09089597314596176, -0.04611597955226898, 0.0015632680151611567, -0.03838665783405304, -0.040094535797834396, 0.04396422207355499, -0.02781011536717415, 0.04252297431230545, 0.015243005007505417, 0.01571754179894924, 0.0786488950252533, -0.033425286412239075, 0.03135007619857788, -0.0028479150496423244, 0.048029009252786636, -0.030340425670146942, 0.0008458660449832678, -0.07875198125839233, -0.014431166462600231, 0.022277677431702614, -0.03041386790573597, -0.041072070598602295, 0.05007403343915939, -0.01792958937585354, -0.017235493287444115, -0.05493799224495888, 0.04230588674545288, -0.04265783354640007, -0.06036371737718582, 0.004080102313309908, -0.007626657839864492, 0.07763225585222244, 0.1181897521018982, 0.03797063231468201, 0.023707419633865356, -0.09839010238647461, 0.10696619749069214, 0.06539127230644226, 0.009577170014381409, 0.0029733453411608934, -0.005860277451574802, -0.0012716957135125995 ] }, { "text": "### Challenges and Considerations\n\nBuilding reliable agents comes with unique challenges:\n\n- **Reliability**: Ensuring consistent behavior across diverse inputs\n- **Safety**: Preventing harmful actions, especially with tool access\n- **Cost**: Managing token usage and API costs at scale\n- **Latency**: Balancing thoroughness with response time\n- **Evaluation**: Measuring agent performance on open-ended tasks", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_11", "embedding": [ -0.05273685231804848, -0.02911045029759407, -0.06871333718299866, 0.026877224445343018, 0.012416988611221313, -0.03726452216506004, -0.021260159090161324, -0.020024172961711884, -0.011004419066011906, -0.013701660558581352, -0.0359371043741703, -0.07192151248455048, 0.05334291607141495, -0.005476784892380238, 0.07233265042304993, 0.003618010552600026, 0.12623290717601776, 0.010070431977510452, -0.06915406137704849, -0.040147654712200165, -0.0265042744576931, 0.046142760664224625, -0.018884046003222466, 0.023067772388458252, -0.09883204847574234, -0.04248502105474472, -0.02612815611064434, -0.1353859156370163, -0.022824550047516823, -0.04706990346312523, 0.01567423716187477, -0.021511003375053406, -0.06951690465211868, 0.05199365317821503, 0.014967324212193489, 0.06504929810762405, -0.05238651484251022, -0.044935859739780426, 0.0425550602376461, -0.028174826875329018, -0.07837534695863724, -0.07386872917413712, -0.10429681837558746, -0.008470049127936363, -0.055895060300827026, -0.045256607234478, -0.021694647148251534, -0.041459038853645325, -0.030986368656158447, 0.014824602752923965, -0.06843136250972748, -0.06378363817930222, 0.10674934089183807, -0.0032809528056532145, -0.0930335596203804, -0.026238396763801575, -0.009307162836194038, -0.006472008768469095, -0.017593838274478912, 0.015961866825819016, 0.026653455570340157, -0.05612364783883095, -0.03249238431453705, 0.04118058830499649, 0.015202787704765797, 0.008972810581326485, -0.05756580829620361, -0.07679840922355652, 0.03157502040266991, -0.024466924369335175, -0.05887208506464958, -0.0232925433665514, -0.03819834068417549, 0.011185732670128345, 0.041365981101989746, 0.005989885423332453, -0.015583189204335213, -0.023833565413951874, 0.07094479352235794, -0.03893372789025307, -0.012431798502802849, -0.02085874043405056, 0.0008076727390289307, 0.1577625870704651, 0.0681365430355072, -0.001406449475325644, 0.07697021216154099, 0.04051922261714935, 0.024957869201898575, -0.04771389439702034, 0.055761925876140594, 0.0198200736194849, 0.1355762928724289, -0.002221205970272422, 0.0644122064113617, 0.046669378876686096, -0.03322052210569382, -0.07115685939788818, -0.05036456137895584, 0.035992369055747986, -0.028061572462320328, 0.034883711487054825, -0.03511779010295868, -0.003580356715247035, 0.009796729311347008, 0.0020166768226772547, 0.02143247239291668, 0.004639239050447941, 0.034073032438755035, -0.002506653545424342, -0.02795851044356823, -0.03657284006476402, 0.04085352644324303, 0.009158476255834103, 0.0758695900440216, 0.021129222586750984, -0.04274779185652733, 0.02113073132932186, 0.047118090093135834, 0.04492107778787613, 0.06870800256729126, -0.025555353611707687, 0.035003963857889175, -0.04474368691444397, 0.10905129462480545, 0.07351373136043549, 0.08585313707590103, -1.5097087465139206e-34, -0.04104764387011528, 0.0679229348897934, -0.020811639726161957, 0.017887845635414124, 0.008044584654271603, -0.03298963978886604, 0.009149924851953983, 0.04562252014875412, -0.061046089977025986, -0.05970599129796028, 0.0025685178115963936, 0.0964910238981247, -0.049917735159397125, 0.01736791990697384, 0.06719470024108887, -0.06584101915359497, -0.02859741449356079, 0.1162581741809845, 0.027171876281499863, -0.001228464301675558, 0.021862952038645744, -0.08878272026777267, 0.05576704442501068, 0.04187948256731033, 0.10087618231773376, 0.022674603387713432, 0.04516373574733734, -0.007638896815478802, 0.07718353718519211, 0.0026357925962656736, -0.07560103386640549, 0.01043260470032692, -0.0042599462904036045, 0.04820619523525238, -0.06536798924207687, 0.07331451773643494, -0.08068408817052841, -0.08247016370296478, 0.003218477126210928, -0.03991173207759857, -0.096372589468956, 0.031123008579015732, 0.03496164828538895, -0.03719758242368698, -0.00178634375333786, -0.04370948299765587, -0.06454218924045563, -0.036013320088386536, 0.024603305384516716, 0.0059624649584293365, 5.448404044727795e-05, 0.10460169613361359, 0.061299409717321396, 0.019671723246574402, 0.03792693093419075, -0.0637912005186081, 0.026805350556969643, 0.0006478035356849432, -0.02327692322432995, 0.03832929953932762, 0.007409682497382164, -0.06422820687294006, -0.07978062331676483, 0.045207679271698, 0.007392875384539366, 0.020997026935219765, 0.016715504229068756, 0.06961500644683838, 0.03698723763227463, 0.021079029887914658, -0.019313380122184753, 0.026853615418076515, 0.038725174963474274, -0.029432563111186028, -0.10374153405427933, -0.07525204867124557, 0.015176022425293922, -0.05223780870437622, 0.0438869446516037, -0.03089108318090439, -0.046088751405477524, -0.01500946655869484, -0.07353756576776505, 0.04174181818962097, -0.004559433087706566, -0.047713279724121094, -0.033210672438144684, -0.022313378751277924, -0.07839813083410263, 0.11126789450645447, -0.01532431785017252, 0.009043319150805473, -0.04519125446677208, 0.08153232932090759, -0.013714654371142387, -1.371526033579151e-33, -0.051968030631542206, -0.07794806361198425, -0.07068563252687454, 0.09939868748188019, -0.016587194055318832, -0.04937228187918663, -0.05173187702894211, -0.04680924117565155, 0.03874165937304497, 0.016638893634080887, -0.11228051036596298, 0.014248735271394253, 0.01520243939012289, -0.020556339994072914, -0.02280765026807785, -0.043631795793771744, -0.01699237897992134, -0.05352270230650902, 0.007225318346172571, -0.023925218731164932, 0.10729292780160904, 0.0582025945186615, -0.10378871113061905, 0.013143887743353844, 0.0026583008002489805, 0.07009264081716537, -0.08454594761133194, -0.03800950199365616, 0.02905159257352352, -0.03920784965157509, 0.02000771090388298, -0.038440655916929245, 0.016908496618270874, 0.0006025068578310311, 0.030542246997356415, -0.0015326169086620212, 0.0458185188472271, 0.07502493262290955, 0.006044964771717787, 0.05739513039588928, 0.09893365204334259, -0.06678912043571472, -0.0563809759914875, -0.056078553199768066, 0.017281396314501762, 0.07721307128667831, -0.06183921545743942, 0.012491539120674133, -0.07359083741903305, 0.028516050428152084, 0.01835680939257145, -0.030783269554376602, -0.08513975143432617, -0.0636429488658905, -0.0835445374250412, 0.03481011092662811, 0.035726532340049744, -0.016624588519334793, -0.020041588693857193, -0.0015846737660467625, -0.0639464259147644, 0.0014988986076787114, 0.048580266535282135, 0.09263721853494644, -0.005641565658152103, -0.01577439159154892, -0.004417489282786846, 0.016238123178482056, 0.024265479296445847, 0.025753282010555267, 0.05388937518000603, -0.012080596759915352, -0.03825856000185013, 0.04156971722841263, 0.01948518678545952, 0.030414193868637085, -0.04871012642979622, -0.09075316041707993, -0.015061510726809502, 0.016578827053308487, -0.05157412961125374, 0.06458917260169983, 0.02318490669131279, 0.048335012048482895, -0.013155926950275898, 0.08065352588891983, 0.037176210433244705, 0.026292383670806885, 0.048292845487594604, 0.04447033256292343, -0.04934544861316681, 0.013015287928283215, -0.06301520019769669, 0.036403022706508636, -0.061866383999586105, -4.306226131234325e-08, 0.008002880960702896, 0.01478404738008976, 0.0314905047416687, 0.02995971404016018, -0.015052491798996925, -0.009335537441074848, 0.0034935760777443647, -0.0158251766115427, 0.011366837657988071, 0.07015257328748703, 0.06710516661405563, -0.051377683877944946, -0.03908711299300194, 0.027083689346909523, 0.04753757640719414, 0.030582603067159653, -0.038354866206645966, 0.06879372894763947, -0.05927777290344238, -0.08557282388210297, 0.029049495235085487, 0.05125552415847778, -0.015087278559803963, -0.005982483271509409, -0.03803539648652077, 0.001188113004900515, -0.01613570749759674, 0.1115226298570633, -0.0359327532351017, 0.03579334169626236, 0.0001445674424758181, 0.004653343930840492, 0.04483361914753914, -0.02429826930165291, -0.04273959621787071, 0.08887698501348495, -0.0282578244805336, -0.04233696684241295, 0.004750159103423357, -0.01583917997777462, -0.006358832120895386, 0.06463287770748138, -0.0544939748942852, 0.00016026571393013, 0.04956752061843872, 0.00307083735242486, -0.10360778868198395, 0.0033350305166095495, 0.06703899055719376, -0.07629550248384476, -0.07663356512784958, -0.05461348593235016, -0.047581881284713745, 0.13577307760715485, 0.08829810470342636, -0.020126264542341232, 0.023921579122543335, -0.10039660334587097, 0.13829182088375092, 0.05335662513971329, 0.05252617225050926, 0.013312679715454578, 0.0415930300951004, 0.006714945659041405 ] }, { "text": "## Getting Started\n\nIf you're new to building agents, here's a recommended learning path:\n\n1. **Understand LLM fundamentals** - Function calling, prompting techniques\n2. **Start with a framework** - Pick one (Pydantic AI is great for Python devs)\n3. **Build a simple agent** - A single-tool agent for a specific task\n4. **Add complexity gradually** - Multiple tools, memory, planning\n5. **Implement observability** - Add Langfuse or similar from the start\n6. **Explore protocols** - Understand MCP and A2A for interoperability", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_12", "embedding": [ 0.0020558321848511696, -0.06250723451375961, -0.05482041463255882, -0.048655204474925995, -0.09035370498895645, -0.08694490045309067, -0.038911670446395874, 0.06296652555465698, -0.07640063762664795, 0.019146446138620377, -0.03763775900006294, -0.026913980022072792, 0.055153798311948776, 0.02749037556350231, 0.05307701230049133, 0.059329595416784286, 0.075717993080616, 0.0017385146347805858, 0.0066118608228862286, -0.10427242517471313, 0.06136066094040871, 0.0057169306091964245, 0.022182708606123924, -0.03635437414050102, -0.0778520256280899, 0.005788890644907951, 0.07541126012802124, -0.055936966091394424, 0.02202565409243107, -0.010732092894613743, 0.040262967348098755, -0.013985277153551579, 0.027416281402111053, 0.032889991998672485, 0.04046202450990677, 0.07237919420003891, 0.0007584774284623563, -0.03832341358065605, -0.008067880757153034, 0.020524989813566208, -0.05755535140633583, -0.02529083378612995, -0.06749449670314789, -0.08205394446849823, 0.011763311922550201, 0.017768971621990204, -0.025178825482726097, 0.011113587766885757, -0.0033924567978829145, -0.02712034061551094, -0.07140028476715088, -0.029779337346553802, -0.019373515620827675, -0.023011013865470886, -0.04768826439976692, -0.015573408454656601, 0.02754819393157959, -0.009645529091358185, -0.0016594635089859366, -0.1267753690481186, -0.009541800245642662, -0.004243866540491581, -0.015294316224753857, 0.013653839007019997, -0.006055433303117752, 0.01806546375155449, -0.014860976487398148, 0.05320549011230469, 0.0731215551495552, -0.06661991775035858, -0.04011867195367813, -0.09691275656223297, -0.025530263781547546, 0.04814590513706207, 0.010797642171382904, -0.07547197490930557, 0.007498057093471289, 0.017852379009127617, 0.05890955030918121, -0.0305683184415102, -0.002347612753510475, 0.020965373143553734, -0.0415322445333004, 0.14008499681949615, -0.009049847722053528, -0.007028211839497089, 0.015294241718947887, 0.128109410405159, 0.01882370002567768, 0.010372713208198547, 0.08164887875318527, 0.009827925823628902, -0.02936479263007641, 0.011239130981266499, 0.07218575477600098, 0.08307863771915436, -0.02533264085650444, -0.1356855183839798, -0.012301674112677574, 0.02338004671037197, -0.07587216049432755, -0.041067935526371, -0.02368943765759468, -0.03370320051908493, -0.06353021413087845, 0.05884869396686554, -0.026531755924224854, -0.04109292849898338, 0.05195535346865654, -0.052512846887111664, -0.03846405819058418, -0.017708783969283104, 0.007271036505699158, -0.002488775411620736, 0.10122723877429962, 0.031861308962106705, 0.07058205455541611, 0.03972060978412628, 0.04434183984994888, 0.013733001425862312, 0.01778499223291874, 0.0021909596398472786, -0.012947515584528446, 0.0464208610355854, 0.09669231623411179, 0.030632248148322105, -0.04475987330079079, -1.0485090021808175e-33, 0.041166868060827255, 0.06475408375263214, -0.025262096896767616, 0.0987929105758667, 0.06699410080909729, -0.0418187640607357, 0.14337757229804993, 0.08592727780342102, -0.07001955807209015, 0.04730663448572159, 0.031119244173169136, 0.045599315315485, -0.04870345816016197, 0.016052059829235077, 0.0014013093896210194, -0.12545743584632874, -0.008672324940562248, -0.001389599870890379, 0.010744278319180012, 0.021821599453687668, -0.03891928493976593, 0.020332621410489082, 0.09017490595579147, 0.04031207412481308, 0.0873454287648201, 0.0595584437251091, -0.0003840521676465869, -0.04428654909133911, 0.09394466131925583, -0.011681352742016315, -0.07883476465940475, 0.0540911890566349, -0.06614114344120026, 0.06165999546647072, -0.06982745230197906, 0.0322580523788929, -0.11819525063037872, -0.051706086844205856, 0.038699015974998474, -0.041874006390571594, -0.0684923604130745, 0.016152046620845795, 0.05335678532719612, -0.10721749812364578, -0.025218648836016655, -0.003673563012853265, -0.05837259441614151, -0.012962479144334793, 0.04970799386501312, -0.01739671640098095, 0.03559081256389618, -0.03873369097709656, 0.01513195876032114, 0.014396775513887405, -0.016281528398394585, 0.0018253292655572295, -0.024770988151431084, -0.010270456783473492, -0.0278807170689106, -0.005485698580741882, 0.026247961446642876, 0.012344182468950748, -0.0013945421669632196, 0.07644646614789963, 0.016150984913110733, -0.03347722440958023, -0.05233178660273552, 0.09245215356349945, 0.10512801259756088, -0.03373461216688156, -0.008404550142586231, 0.04663073271512985, 0.0425376296043396, -0.03450421616435051, -0.02788843959569931, -0.012521698139607906, 0.049410369247198105, -0.09612630307674408, 0.004158946219831705, 0.03160346299409866, -0.025321075692772865, 0.05462707579135895, 0.033908911049366, -0.02167881838977337, 0.04128710553050041, -0.03759856894612312, -0.06575942784547806, -0.0008692292030900717, -0.006429740693420172, 0.05022700875997543, -0.043744247406721115, -0.0392683781683445, -0.024835320189595222, 0.1083865687251091, 0.003398730419576168, -2.2805740186364276e-33, 0.012399528175592422, -0.00572586664929986, -0.06445044279098511, 0.0516899898648262, 0.011903899721801281, -0.06616786867380142, -0.07572989910840988, -0.042053304612636566, 0.03036174364387989, -0.027126217260956764, -0.08970601111650467, 0.007604992017149925, 0.05263519287109375, -0.02447991818189621, 0.0074602942913770676, -0.06690613180398941, 0.01522895973175764, -0.030684294179081917, 0.04764048755168915, -0.021920382976531982, -0.04172869026660919, 0.060011256486177444, -0.07837243378162384, -0.04996724799275398, -0.013862117193639278, -0.01306763757020235, 0.01642625778913498, 0.002172186505049467, 0.04023041948676109, 0.02399073727428913, 0.018092123791575432, -0.026875868439674377, 0.030799632892012596, 0.031750407069921494, -0.031582485884428024, 0.07499247789382935, 0.03322949633002281, 0.03133887052536011, 0.02670767903327942, -0.020103663206100464, 0.12426188588142395, -0.06994041800498962, -0.02342996560037136, -0.08139227330684662, -0.009614182636141777, -0.01872357912361622, -0.05705682560801506, 0.08925890177488327, -0.0027048871852457523, -0.062481481581926346, -0.03511091321706772, 0.011146767996251583, -0.016557343304157257, -0.10559381544589996, -0.08925368636846542, 0.018992938101291656, 0.10206574201583862, -0.009150863625109196, 0.009102193638682365, -0.0338461771607399, -0.09081517904996872, -0.039251454174518585, 0.05651608109474182, 0.05123572424054146, -0.12415799498558044, 0.030562624335289, -0.0848422721028328, -0.01277797482907772, -0.03875231742858887, -0.04017595201730728, -0.008785420097410679, 0.019488105550408363, -0.04260601848363876, 0.028754184022545815, 0.03840703144669533, -0.050976794213056564, -0.13902315497398376, -0.03387785330414772, -0.011204998940229416, 0.01957520842552185, 0.01315137930214405, 0.03672502189874649, -0.05690961703658104, 0.07766411453485489, -0.07827726751565933, 0.0786057561635971, 0.05293002352118492, 0.014841089025139809, 0.05101397633552551, -0.03882403299212456, -0.050796989351511, 0.06234227120876312, 0.0248489361256361, 0.03744026646018028, -0.06472388654947281, -4.276384046875137e-08, -0.013765870593488216, -0.04370805621147156, 0.07494605332612991, 4.822917253477499e-05, -0.009478728286921978, 0.0390901081264019, -0.02640288695693016, 0.022393109276890755, 0.04512614384293556, 0.022878209128975868, 0.04556647688150406, -0.032131172716617584, -0.03137985244393349, 0.00028273824136704206, 0.03407125547528267, 0.06525616347789764, 0.025971733033657074, 0.015289662405848503, -0.01097921933978796, -0.06126760318875313, 0.03815486282110214, -0.05531207472085953, 0.004113975912332535, 0.03565815091133118, 0.022834885865449905, -0.0851992592215538, -0.06895982474088669, -0.0276121087372303, -0.027094842866063118, 0.08913962543010712, 0.005369553342461586, -0.019858693704009056, 0.045417483896017075, 0.021427741274237633, 0.03554732725024223, 0.034874290227890015, 0.004498648922890425, -0.09420324116945267, 0.05258050933480263, -0.07884617894887924, -0.032052308320999146, 0.0565057173371315, -0.0243593268096447, -0.03251638635993004, 0.042389657348394394, 0.012399647384881973, -0.06381063908338547, -0.09353236109018326, 0.004104369319975376, -0.04458082094788551, 0.00524732144549489, 0.045932404696941376, -0.06940960884094238, 0.005080210044980049, 0.08721678704023361, 0.056156039237976074, 0.03267676383256912, -0.08434537798166275, 0.09634263068437576, 0.03440618887543678, -0.05737481266260147, 0.09421875327825546, -0.004486417397856712, 0.01644379459321499 ] }, { "text": "## Topics to Explore\n\nThis introduction sets the stage for deeper dives into specific aspects of agentic architecture:\n\n- [Pydantic AI](pydantic-ai.html) - Type-safe agent development in Python\n- [AWS Bedrock Agents](bedrock-agents.html) - Enterprise-grade managed agents\n- [Model Context Protocol](mcp.html) - Standardized tool and data integration\n- [Agent2Agent Protocol](a2a.html) - Multi-agent communication\n- [Langfuse](langfuse.html) - Observability for LLM applications\n- [Agent Design Patterns](agent-patterns.html) - Common architectures and best practices", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_13", "embedding": [ -0.025294233113527298, -0.017150457948446274, -0.05194374918937683, -0.08439899981021881, 0.03846201300621033, -0.06651998311281204, -0.03247588872909546, -0.000996059156022966, -0.038258470594882965, 0.023723164573311806, -0.016080521047115326, -0.007393722888082266, 0.10808316618204117, -0.014070876874029636, 0.12853579223155975, 0.05616413429379463, 0.08172044157981873, 0.023954134434461594, -0.021510973572731018, -0.022992132231593132, -0.0006276871426962316, 0.03571974113583565, -0.03385329619050026, -0.016793180257081985, -0.16860821843147278, 0.03508901596069336, 0.022506020963191986, -0.0253763385117054, 0.019130220636725426, -0.036958929151296616, 0.07090964913368225, 0.03355298563838005, 0.032561078667640686, 0.06991245597600937, 0.023655908182263374, 0.10954069346189499, -0.06441438943147659, -0.051974646747112274, -0.03255736455321312, 0.06371067464351654, 0.039425160735845566, -0.04927106946706772, -0.04106512293219566, -0.07315278798341751, -0.03343723714351654, -0.009578838013112545, -0.03718574717640877, -0.0069464403204619884, -0.019925598055124283, -0.05407867953181267, -0.10298008471727371, -0.01712983287870884, 0.023941541090607643, 0.014632217586040497, -0.04715796187520027, -0.043343693017959595, 0.009286604821681976, -0.006337419617921114, -0.022150307893753052, -0.11607445776462555, 0.03267903998494148, 0.019482454285025597, 0.019797753542661667, 0.049102265387773514, -0.027416802942752838, 0.07593559473752975, -0.07168099284172058, 0.004442141391336918, 0.053520090878009796, -0.08328954130411148, -0.0389382429420948, -0.10157143324613571, -0.0018239791970700026, -0.011121262796223164, -0.009751692414283752, -0.014774355106055737, 0.005141249392181635, 0.0062104384414851665, 0.0460808128118515, -0.04141288995742798, -0.033951543271541595, -0.00783055555075407, -0.03362610563635826, 0.0787729024887085, -0.012036836706101894, -0.0008077636011876166, 0.006132380571216345, 0.01624337211251259, 0.023391099646687508, -0.004836878273636103, 0.08585233241319656, -0.0020804675295948982, 0.09129906445741653, 0.039330799132585526, 0.10422594100236893, 0.11220990121364594, -0.040621064603328705, -0.09096184372901917, -0.051963433623313904, 0.04063498228788376, -0.0506458543241024, -0.0649712011218071, -0.07382000982761383, 0.05168769136071205, 0.004310809075832367, -0.014835570007562637, -0.0030057942494750023, 0.023631976917386055, 0.04398706927895546, -0.0036824869457632303, -0.03370378538966179, -0.02038843370974064, 0.02770969457924366, -0.026261035352945328, 0.03935812786221504, -0.003723581088706851, 0.01316224504262209, 0.07889944314956665, 0.04323738068342209, 0.02254110388457775, 0.06600914150476456, -0.03310771286487579, 0.031765226274728775, 0.011331476271152496, 0.10799578577280045, 0.06567443907260895, -0.012626470066606998, 5.157849265394899e-34, -0.028217853978276253, 0.04220582917332649, -0.008015334606170654, 0.03536583110690117, 0.057187676429748535, -0.04747409746050835, 0.053654517978429794, -0.03531458228826523, -0.02624613046646118, -0.00399492122232914, -0.001604790915735066, 0.07154444605112076, -0.03820803388953209, 0.06436670571565628, 0.012371091172099113, -0.02235449105501175, -0.021321134641766548, 0.04954668506979942, 0.06271127611398697, 0.004508194979280233, 0.05081363767385483, 0.02951224148273468, 0.08401121944189072, 0.04523087292909622, 0.07325133681297302, 0.07705602794885635, -0.017594503238797188, -0.0627610832452774, 0.10849684476852417, 0.022356539964675903, -0.021120090037584305, 0.07061904668807983, -0.04505904018878937, 0.04915636405348778, -0.07788339257240295, 0.04529748111963272, -0.13164347410202026, -0.08929958194494247, -0.04615003615617752, -0.035283397883176804, -0.05241477116942406, 0.0016618496738374233, 0.06750574707984924, -0.05255357548594475, -0.02902115508913994, -0.07956214994192123, -0.04548061266541481, 0.006983546540141106, 0.04456610977649689, -0.06842952221632004, 0.015468738041818142, -0.012020592577755451, 0.09718191623687744, -0.00341024249792099, 0.011894727125763893, -0.03146452084183693, 0.014029553160071373, 0.007133570499718189, -0.014217652380466461, 0.015185242518782616, 0.008313151076436043, 0.0030988494399935007, 0.037919290363788605, -0.005170019809156656, 0.05341137573122978, -0.03665773943066597, -0.049460116773843765, 0.06497959047555923, 0.037554968148469925, -0.02062821015715599, 0.005924035795032978, 0.07709252089262009, 0.018891891464591026, 0.06999634951353073, -0.05171549320220947, -0.059508759528398514, 0.03100796602666378, -0.08704215288162231, 0.041402146220207214, 0.007291807793080807, -0.07344887405633926, 0.06999282538890839, -0.0020668930374085903, 0.05472646281123161, -0.0034839462023228407, -0.068393774330616, -0.06707272678613663, 0.021489761769771576, -0.0034239529632031918, 0.05411069095134735, -0.04058847203850746, -0.05592704191803932, -0.023678958415985107, 0.05805065482854843, -0.0056845517829060555, -2.796205717650578e-33, -0.05206775665283203, -0.04471343010663986, -0.10899531841278076, 0.03724554926156998, 0.0038798372261226177, -0.1293579488992691, -0.02424687147140503, 0.011769898235797882, 0.0211543757468462, -0.004504803568124771, -0.033962003886699677, 0.00927713792771101, 0.06811624020338058, -0.07272013276815414, 0.013077512383460999, -0.04633193090558052, 0.00834213849157095, -0.10141104459762573, 0.0436386913061142, -0.02475854940712452, 0.020604856312274933, -0.0034518949687480927, -0.08915345370769501, -0.0299004465341568, 0.0637473538517952, 0.009446006268262863, -0.02646259404718876, -0.011699064634740353, 0.04233286902308464, -0.03545956313610077, -0.0030454143416136503, 0.02909613400697708, -0.01392698846757412, 0.04113899916410446, -0.013519546017050743, 0.05644231662154198, -0.05496884137392044, 0.016299711540341377, -0.010165620595216751, -0.016959644854068756, 0.100529745221138, -0.04745032638311386, -0.061623651534318924, -0.005354700144380331, -0.002956744283437729, 0.025237126275897026, -0.024634290486574173, 0.09724009037017822, 0.04016134887933731, -0.07420946657657623, -0.05156058818101883, 0.008246936835348606, 0.009782662615180016, -0.09028792381286621, -0.027638837695121765, 0.06155816465616226, 0.09128611534833908, 0.08121103048324585, -0.03533639386296272, -0.022154245525598526, -0.008938022889196873, -0.016688283532857895, 0.002475534798577428, 0.043757274746894836, -0.08424536138772964, 0.02915656566619873, -0.057110533118247986, -0.007965481840074062, -0.018233060836791992, -0.07068019360303879, 0.07578077912330627, 0.02468651905655861, -0.07282561808824539, 0.03217001259326935, 0.05471732094883919, -0.006371704861521721, -0.05101827159523964, -0.05958004295825958, 0.02590346522629261, -0.0012215744936838746, -0.048738669604063034, 0.08116064220666885, -0.058529190719127655, 0.04932496324181557, 0.06852874904870987, 0.0289302971214056, 0.010484404861927032, 0.02184554934501648, 0.047286506742239, -0.023898258805274963, -0.05367351695895195, 0.002775835804641247, -0.027849609032273293, 0.06097926199436188, -0.10859829187393188, -4.944575593412992e-08, -0.028984664008021355, -0.01225576363503933, 0.05807946249842644, -0.03044506348669529, -0.0076242126524448395, -0.0035238987766206264, 0.017312297597527504, -0.07448738813400269, -0.0018705240217968822, 0.010579402558505535, 0.02480384148657322, -0.023585868999361992, -0.043466757982969284, -0.009327197447419167, 0.06938786059617996, 0.04503218084573746, 0.002858139807358384, -0.015254765748977661, -0.025244446471333504, -0.07473903149366379, 0.004268661607056856, -0.03470121696591377, -0.0831572562456131, -0.005907289683818817, 0.03379831090569496, 0.027316967025399208, -0.0012756733922287822, -0.03184656426310539, -0.038961730897426605, 0.10310007631778717, 0.0025591235607862473, -0.039452362805604935, -0.007162624970078468, 0.07453306764364243, 0.010928254574537277, 0.06885376572608948, -0.007144873961806297, -0.08992357552051544, -0.0009528344962745905, -0.0741051584482193, -0.01163445319980383, 0.020804643630981445, -0.037033285945653915, -0.0507342703640461, 0.11231395602226257, 0.07811283320188522, -0.06452406942844391, -0.031281404197216034, 0.023079819977283478, 0.003130936296656728, -0.04942924529314041, -0.03476125746965408, -0.07473152875900269, 0.10016941279172897, 0.09628666192293167, -0.006350327283143997, 0.07001388818025589, -0.12199137359857559, 0.14924640953540802, 0.022888459265232086, -0.020301997661590576, 0.05475080385804176, 0.08020664751529694, -0.028960350900888443 ] }, { "text": "## Key Takeaways\n\n- Agentic systems extend LLMs with autonomy, tools, planning, and memory\n- The observe-think-act loop is fundamental to agent behavior\n- Multiple frameworks exist with different tradeoffs (Pydantic AI, Bedrock, etc.)\n- Protocols like MCP and A2A enable interoperability\n- Observability (Langfuse) is essential for production systems\n- Start simple and add complexity as needed", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_14", "embedding": [ 0.04832608252763748, -0.09057383984327316, -0.05186990648508072, -0.08713553100824356, 0.045040763914585114, -0.017175616696476936, -0.03502582758665085, 0.05939101800322533, 0.01767318695783615, 0.08375640958547592, 0.0007849881076253951, 0.018651748076081276, 0.024231892079114914, 0.035291701555252075, 0.08752518147230148, 0.024735119193792343, 0.051264550536870956, -0.024505944922566414, 0.008813348598778248, -0.06358985602855682, 0.03837718442082405, -0.03988911956548691, -0.05635601282119751, 0.008158165961503983, -0.1320013403892517, 0.03992345556616783, -0.029578080400824547, -0.04370369017124176, -0.009324638172984123, -0.06453779339790344, 0.04655667394399643, 0.05815591663122177, 0.06170858442783356, -0.010493779554963112, 0.04546411707997322, 0.06921394169330597, -0.01865268312394619, -0.014532837085425854, -0.010917712934315205, 0.007147407159209251, -0.004739314783364534, -0.045524563640356064, -0.022371290251612663, -0.08261340856552124, -0.004103258717805147, 0.026671556755900383, -0.03933870047330856, -0.020495319738984108, -0.10862179845571518, -0.02044720947742462, -0.10480937361717224, -0.03392265364527702, -0.0009871912188827991, -0.060335662215948105, 0.004121044650673866, -0.0224520955234766, 0.043787818402051926, 0.03186327964067459, -0.01154501736164093, -0.08629589527845383, 0.02478494495153427, -0.02378203719854355, -0.04530708119273186, 0.047363799065351486, 0.007295618299394846, 0.051984094083309174, -0.033862847834825516, 0.042240504175424576, 0.03231867775321007, -0.05757448822259903, -0.022073132917284966, -0.11008001118898392, -0.008522529155015945, -0.020429175347089767, -0.002036235760897398, -0.03566378355026245, 0.02175889164209366, -0.0003232978342566639, 0.05146760493516922, -0.034801848232746124, -0.03482728824019432, 0.05352761968970299, -0.0462014265358448, 0.08727135509252548, -0.018107501789927483, -0.011535371653735638, -0.009635727852582932, 0.07288047671318054, 0.04329841956496239, -0.0047789569944143295, 0.03172905370593071, -0.03638363257050514, -0.029649484902620316, 0.029302794486284256, 0.09173606336116791, 0.06493978947401047, -0.015549257397651672, -0.0713120624423027, -0.008624644950032234, -0.005694110412150621, -0.02006390132009983, 0.01711995340883732, -0.0023907076101750135, 0.01711079105734825, -0.026125656440854073, -0.0049858782440423965, 0.005087970290333033, -0.03612465038895607, 0.045789916068315506, -0.05215641111135483, -0.0384824238717556, 0.01764671690762043, 0.07097363471984863, 0.017677834257483482, 0.07016496360301971, -0.05586620047688484, 0.06878908723592758, 0.053882382810115814, 0.03126722201704979, -0.03317749872803688, 0.014885337091982365, -0.06367749720811844, 0.05326678231358528, 0.017827747389674187, 0.10301932692527771, 0.05769509822130203, -0.00024535987176932395, 2.4026435968395526e-33, -0.04733786731958389, -0.01105791237205267, -0.024512920528650284, 0.004046235233545303, 0.08780977874994278, -0.03974722698330879, 0.08175531774759293, -0.00927598588168621, -0.014626136980950832, 0.0370139554142952, -0.006967161316424608, 0.06247960403561592, -0.025626102462410927, 0.04220246523618698, 0.07360786944627762, -0.04202204942703247, 0.02496589906513691, 0.011450432240962982, 0.05218124762177467, -0.006476276088505983, 0.02935379557311535, 0.033446673303842545, 0.05816400796175003, 0.0028693322092294693, 0.12203726917505264, 0.05578376352787018, 0.04206829518079758, -0.00586845213547349, 0.07300606369972229, 0.006265304982662201, -0.00712782796472311, 0.07581830024719238, -0.07342316210269928, 0.11338941752910614, -0.04058021306991577, 0.053875602781772614, -0.11503336578607559, -0.06660659611225128, 0.01960146240890026, -0.0248501505702734, -0.05946790426969528, 0.02731284871697426, 0.026717910543084145, -0.05532511696219444, -0.041695863008499146, -0.05670986324548721, -0.030817843973636627, 0.030236806720495224, 0.00837893970310688, -0.011661854572594166, 0.043198805302381516, 0.021459346637129784, 0.05092085897922516, -0.06544306129217148, 0.04899400845170021, -0.01294367853552103, -0.01569427363574505, -0.008532960899174213, -0.06235366687178612, 0.07247532904148102, -0.025871947407722473, 0.001467167749069631, 0.001124541275203228, 0.031399574130773544, 0.11788980662822723, 0.008950199000537395, -0.06699149310588837, 0.015778662636876106, 0.07105846703052521, 0.008078272454440594, -0.007232093717902899, 0.03992848098278046, 0.004056164529174566, 0.04020325466990471, -0.012153168208897114, -0.07782343775033951, 0.02837294153869152, -0.08274152874946594, 0.05736071988940239, 0.009796284139156342, -0.05166330188512802, 0.03838116675615311, -0.03141453489661217, 0.009420499205589294, 0.010075964964926243, -0.06080292910337448, -0.10836363583803177, 0.02025347389280796, -0.001961845438927412, 0.032635655254125595, -0.050710029900074005, -0.06141766533255577, 0.004025508649647236, 0.14969828724861145, -0.03406418487429619, -2.979265085562148e-33, -0.002443434437736869, -0.10431697964668274, -0.07663579285144806, 0.10158129036426544, 0.00874665193259716, -0.046426642686128616, -0.04296637326478958, -0.05326693505048752, -0.020487111061811447, -0.023998457938432693, -0.09421999752521515, -0.0031355286482721567, 0.0441216416656971, -0.0016313785454258323, -0.004839541390538216, -0.09042562544345856, 0.013340518809854984, -0.11271645873785019, 0.06698594242334366, -0.028289854526519775, -0.020075904205441475, 0.06993060559034348, -0.011420312337577343, -0.0390511155128479, 0.03222249448299408, 0.04482303187251091, -0.07714887708425522, -0.0014494097558781505, 0.028911471366882324, -0.01773262955248356, 0.057092342525720596, -0.028475213795900345, 0.014371844008564949, 0.026621781289577484, -0.00932807382196188, 0.09987760335206985, -0.018728777766227722, 0.07617636770009995, -0.02069314755499363, -0.01917397230863571, 0.028708988800644875, -0.08083509653806686, -0.011202326975762844, -0.0030937599949538708, 0.0033238984178751707, 0.02299112267792225, -0.062484171241521835, 0.08810381591320038, 0.025063741952180862, -0.05100162699818611, -0.05765967443585396, -0.010435868054628372, -0.01792527735233307, -0.10814365744590759, -0.05788864567875862, 0.03382188081741333, 0.0556272529065609, 0.01262282021343708, -0.05644729733467102, -0.03375851735472679, 0.021386435255408287, -0.04031407833099365, 0.01692267879843712, 0.03115871362388134, -0.00757290655747056, 0.11213850975036621, -0.025176741182804108, -0.017128735780715942, 0.009712577797472477, -0.07132287323474884, 0.12064492702484131, -0.021738309413194656, -0.10582712292671204, 0.0416359044611454, 0.06581311672925949, -0.04327428340911865, -0.10447914898395538, -0.0890214592218399, -0.00045365418191067874, -0.05885262042284012, -0.004260392393916845, 0.05719868093729019, -0.014944138005375862, 0.04838863015174866, -0.059092916548252106, 0.055898625403642654, -0.010694398544728756, 0.028272222727537155, 0.0299832820892334, -0.030097467824816704, -0.0033422147389501333, -0.000489676371216774, -0.00559208681806922, 0.06924489140510559, -0.11107945442199707, -4.430851063830232e-08, 0.0013684153091162443, -0.02497575618326664, 0.07390329986810684, 0.0004290637152735144, -0.023113766685128212, -0.04539867118000984, 0.026132410392165184, 0.01197693683207035, 0.056507740169763565, 0.05436897277832031, 0.046501874923706055, -0.0364191047847271, -0.03174937888979912, 0.04292863607406616, 0.10345140099525452, -9.211742144543678e-05, 0.006007699761539698, 0.03523913770914078, -0.052510540932416916, -0.0459674634039402, 0.05161366984248161, -0.04003698006272316, -0.06453163176774979, 0.018725214526057243, 0.05432455986738205, -0.05446546897292137, -0.02976350300014019, 0.04756082966923714, 0.03397589549422264, 0.12137709558010101, 0.027866629883646965, -0.029510876163840294, 0.022617274895310402, 0.09753371775150299, 0.03470472991466522, 0.012542440555989742, 0.02048768475651741, -0.09124497324228287, 0.02745676599442959, -0.09425832331180573, -0.0419212244451046, 0.015904951840639114, -0.03682752698659897, 0.024978095665574074, 0.003809576155617833, -0.014244752004742622, -0.12608204782009125, -0.10277961939573288, 0.01929044909775257, -0.02772795595228672, -0.018496744334697723, 0.0315312035381794, -0.04201243445277214, 0.08427852392196655, 0.08511482924222946, 0.04130975902080536, 0.09528309106826782, -0.089663065969944, 0.10656611621379852, 0.07786399126052856, -0.010548537597060204, 0.025703562423586845, 0.013049148954451084, -0.03461265563964844 ] }, { "text": "## Resources\n\n### Documentation\n- [Anthropic MCP Documentation](https://modelcontextprotocol.io/)\n- [Pydantic AI Docs](https://ai.pydantic.dev/)\n- [AWS Bedrock Agents](https://docs.aws.amazon.com/bedrock/latest/userguide/agents.html)\n- [Langfuse Documentation](https://langfuse.com/docs)\n\n### Papers and Research\n- \"ReAct: Synergizing Reasoning and Acting in Language Models\"\n- \"Toolformer: Language Models Can Teach Themselves to Use Tools\"\n- \"Generative Agents: Interactive Simulacra of Human Behavior\"\n\n---\n\n**Last Updated:** November 25, 2025 \n**Difficulty Level:** Intermediate", "source": "agentic_architecture.md", "type": "markdown", "chunk_id": "agentic_architecture.md_15", "embedding": [ -0.06919887661933899, -0.07204180210828781, 0.06086602061986923, 0.019833171740174294, 0.007820277474820614, 0.04057573154568672, -0.0018651688005775213, 0.07268331199884415, 0.007598530035465956, 0.04598035290837288, -0.033506397157907486, -0.06777550280094147, 0.04191078990697861, 0.08416090160608292, 0.12336558848619461, 0.03870958462357521, -0.025709550827741623, -0.02643454261124134, -0.003013530746102333, -0.10210994631052017, 0.05746520310640335, -0.03839973360300064, 0.017133522778749466, -0.017399288713932037, -0.06997860968112946, 0.05418707802891731, 0.025634530931711197, -0.09944401681423187, 0.06011953949928284, 0.005745680071413517, 0.024059316143393517, 0.06997053325176239, 0.04264146834611893, -0.009866295382380486, -0.01038162037730217, 0.18446992337703705, -0.1005529910326004, -0.04813549295067787, -0.02465720847249031, -0.028249356895685196, -0.04411455988883972, -0.06049531325697899, -0.013052172027528286, -0.10179150849580765, 0.04073880612850189, -0.0008457213989458978, -0.02572634443640709, 0.0009389001061208546, -0.041722893714904785, -0.02719520777463913, -0.1644205003976822, -0.04792238026857376, 0.06529463082551956, -0.06313078105449677, 0.011238820850849152, -0.030464159324765205, 0.05540282279253006, -5.44302019989118e-05, 0.039264511317014694, -0.09839054942131042, 0.0017773860599845648, -0.033731769770383835, 0.001932248705998063, 0.03723260387778282, 0.010430820286273956, 0.03785020858049393, -0.023518109694123268, 0.06453078985214233, 0.03732379153370857, -0.02538272924721241, -0.047578439116477966, -0.044444963335990906, 0.0449846126139164, -0.01578577421605587, 0.050636567175388336, -0.0030802316032350063, 0.03327760100364685, -0.04185329005122185, 0.05401777848601341, -0.06028499826788902, -0.01281024795025587, -0.0017949363682419062, -0.029456455260515213, 0.03329861909151077, -0.002909627975896001, 0.013972682878375053, 0.05525847151875496, 0.02688279002904892, 0.04024675115942955, 0.02742007002234459, 0.03646091744303703, -0.06628715246915817, 0.044280171394348145, 0.06366264820098877, 0.03824978694319725, 0.08099312335252762, -0.04953477159142494, -0.03717350959777832, -0.05941815674304962, -0.005248339846730232, -0.0013599859084933996, 0.04519006609916687, -0.0347684882581234, -0.022221764549613, -0.06331095844507217, -0.08215657621622086, -0.06267933547496796, -0.00738512771204114, 0.006170065142214298, 0.008026883006095886, -0.020620029419660568, -0.010864077135920525, 0.011915239505469799, 0.014084629714488983, 0.04514759033918381, -0.026217803359031677, 0.03936257213354111, -0.008053773082792759, 0.07094096392393112, 0.025025080889463425, 0.040645353496074677, 0.0076026455499231815, 0.005667601712048054, 0.05381052941083908, 0.08854413777589798, 0.03253110498189926, -0.023846948519349098, -4.2772846104840005e-34, 0.07741452008485794, 0.01089560892432928, 0.030655520036816597, 0.08221151679754257, 0.05400560796260834, -0.05623450502753258, 0.05249057710170746, -0.05650070682168007, -0.029887676239013672, -0.04325639456510544, -0.021604368463158607, 0.053882110863924026, -0.08783386647701263, 0.10612814873456955, -0.07107570022344589, -0.07306144386529922, -0.07225285470485687, 0.028579825535416603, -0.015410495921969414, 0.022625263780355453, 0.05820364132523537, 0.03523855283856392, -0.00037951100966893137, 0.006289644166827202, 0.029488176107406616, 0.04326467961072922, 0.06419430673122406, -0.018043730407953262, 0.04834914952516556, -0.018373381346464157, -0.05873779579997063, -0.021171772852540016, -0.062343187630176544, 0.0717734545469284, -0.024463297799229622, -0.021580014377832413, -0.06739402562379837, -0.060965754091739655, -0.034163545817136765, -0.05928260460495949, -0.014162090606987476, 0.03034333884716034, 0.06444190442562103, -0.006048175040632486, -0.037220295518636703, -0.014874918386340141, -0.022720739245414734, 0.026352275162935257, 0.03837410360574722, 0.010017001070082188, 0.011857518926262856, 0.05036862567067146, 0.06506626307964325, -0.05055088549852371, 0.06025666370987892, 0.02239096909761429, 0.016872474923729897, 0.009285051375627518, 0.020859576761722565, -0.03127623721957207, 0.022329574450850487, 0.04308456555008888, 0.034008320420980453, 0.013132625259459019, 0.05311797186732292, 0.053376052528619766, -0.06470895558595657, -8.888028241926804e-05, 0.0843096673488617, 0.00681665912270546, -0.04028584063053131, 0.02508966438472271, -0.0019772702362388372, 0.06413533538579941, 0.01583121344447136, -0.07503995299339294, 0.008721557445824146, -0.12305894494056702, 0.0450504831969738, 0.007527121342718601, -0.09228739142417908, -0.008434509858489037, -0.009227880276739597, 0.0919559970498085, -0.02198275923728943, -0.08289341628551483, -0.04747074842453003, -0.025747496634721756, 0.024241192266345024, -0.021695392206311226, 0.010131915099918842, -0.09607324004173279, -0.02251637727022171, 0.04382588714361191, -0.04799601063132286, -2.3373728036422066e-33, -0.008475488983094692, -0.07420139759778976, -0.08664674311876297, 0.05725640803575516, -0.05693706125020981, -0.10104167461395264, 0.047607261687517166, 0.06799910217523575, 0.056608811020851135, -0.05785661190748215, -0.02084699459373951, 0.050056759268045425, 0.09692754596471786, -0.01644965447485447, 0.002118166070431471, -0.041223835200071335, 0.03248770162463188, -0.03640371933579445, 0.07045108079910278, 0.03942187502980232, 0.0050246152095496655, 0.035748861730098724, -0.13632270693778992, 0.008029261603951454, 0.017876295372843742, 0.008331077173352242, 0.012874611653387547, -0.0017238250002264977, -0.011407225392758846, -0.032611481845378876, 0.019623419269919395, -0.010397053323686123, -0.10162430256605148, 0.03290160372853279, -0.07253492623567581, 0.03320661559700966, -0.012803674675524235, 0.014105187729001045, -0.034597430378198624, 0.0149302389472723, 0.052339695394039154, -0.04868142679333687, -0.09428856521844864, 0.006607882212847471, -0.003079988295212388, 0.04463294893503189, -0.06502756476402283, 0.0002701451303437352, 0.005451780743896961, -0.04841194301843643, -0.01932106353342533, -0.004405790939927101, -0.02027323842048645, -0.1480225771665573, -0.05715298280119896, -0.05783584713935852, 0.06920883059501648, -0.06830944865942001, 0.023521248251199722, -0.028729302808642387, -0.04485384002327919, -0.01006137765944004, 0.01532628946006298, 0.0016277795657515526, -0.08155930042266846, -0.0077983480878174305, -0.08098971098661423, -0.015036927536129951, 0.0578220896422863, -0.04899115115404129, 0.10582461208105087, 0.024717483669519424, 0.018311649560928345, 0.007562308572232723, 0.10969213396310806, -0.015012960880994797, -0.08263517916202545, -0.02687423676252365, 0.03190254047513008, -0.07999709993600845, 0.010471200570464134, 0.040550172328948975, 0.03234180808067322, 0.026940712705254555, 0.008576628752052784, 0.05520372465252876, 0.002227888675406575, 0.12642306089401245, 0.0456242598593235, 0.03916176036000252, -0.0677424743771553, -0.000944050494581461, -0.00914169941097498, 0.09449625015258789, -0.0944729670882225, -5.161386695817782e-08, -0.021436363458633423, 0.03331170231103897, 0.03351087495684624, -0.015128378756344318, -0.026129094883799553, -0.015206531621515751, -0.02418295480310917, -0.04363127052783966, -0.026467958465218544, 0.028846437111496925, 0.023105941712856293, 0.0020704499911516905, -0.034801192581653595, 0.00926696602255106, 0.05626542121171951, 0.08349475264549255, 0.042557284235954285, 0.06881722807884216, -0.045991264283657074, -0.052015431225299835, 0.0429171659052372, -0.009832468815147877, -0.11751500517129898, 0.03318220376968384, 0.0451405793428421, 0.004551663529127836, -0.045211877673864365, 0.0037915678694844246, -0.0241575688123703, -0.007770184893161058, -0.004831718746572733, 0.012426264584064484, -0.01185591984540224, 0.04010830074548721, 0.05322540923953056, 0.08784757554531097, -0.013139245100319386, -0.08128100633621216, -0.01905965805053711, 0.012712190859019756, 0.0026191568467766047, 0.051993079483509064, -0.09484560787677765, -0.0320381224155426, 0.07820283621549606, 0.032812949270009995, -0.12300779670476913, -0.06420980393886566, 0.013679791241884232, 0.05058492720127106, 0.018733199685811996, -0.0031312420032918453, -0.1477712243795395, 0.04893764853477478, 0.08042924106121063, 0.01740507408976555, 0.0034101230558007956, -0.059410084038972855, 0.033019598573446274, -0.005816393531858921, 0.021991612389683723, 0.07650206983089447, 0.05701539292931557, -0.010026417672634125 ] }, { "text": "---\ntitle: \"Quantization 2\"\nid: \"quantization_2\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"dl\", \"quantization\", \"medium\"]\nrelated: [\"quantization\"]\ndate: \"2024-05-06\"\ndescription: \"Mastering Post-training Quantization: A Guide with PyTorch and TensorFlow\"\n---\n\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/quantization-2-7398a0ce7584) \n\nUnderstanding quantization can feel like learning two different languages when comparing TensorFlow and PyTorch. In this \npost, I’ll guide you through the differences and similarities, providing clear explanations along the way. You can find \nall the code references and notes in the provided [notebook](https://github.com/pelinbalci/LLM_Notebooks/blob/main/Quantization.ipynb)", "source": "2024-05-06-Quantization_2.md", "type": "markdown", "chunk_id": "2024-05-06-Quantization_2.md_0", "embedding": [ -0.07392889261245728, -0.10464947670698166, 0.02450426295399666, -0.04595888778567314, -0.0251639261841774, -0.012263881973922253, -0.004983371123671532, -0.049929313361644745, -0.02474040724337101, -0.11192430555820465, 0.015662679448723793, -0.01729718968272209, -0.1085001677274704, 0.044543903321027756, 0.001952520222403109, 0.03409108519554138, 0.008394398726522923, 0.05591261759400368, -0.15024295449256897, -0.061179086565971375, 0.07750095427036285, -0.022722288966178894, 0.007380982395261526, 0.007064151111990213, 0.06359315663576126, 0.06090283766388893, -0.0025652162730693817, -0.010674400255084038, 0.06658802926540375, 0.023984551429748535, 0.038236744701862335, 0.04083898290991783, 0.04029059782624245, 0.024653904139995575, -0.005718862637877464, 0.04944702237844467, -0.026850465685129166, -0.031083879992365837, -0.01268703956156969, -0.04061901196837425, -0.030527526512742043, -0.04496633633971214, -0.014265215955674648, -0.011897042393684387, 0.0651606097817421, 0.10432682931423187, 0.03478172793984413, 0.04538733884692192, -0.048866622149944305, -0.03427107632160187, -0.007873615249991417, 0.04197537153959274, -0.08363791555166245, 0.036288004368543625, 0.02303951606154442, 0.049179185181856155, 0.056488998234272, 0.07796721160411835, -0.08341945707798004, -0.04661593586206436, -0.018872685730457306, -0.004126169718801975, 0.053997743874788284, 0.06637339293956757, 0.015523204579949379, -0.036665335297584534, -0.03814445436000824, 0.006841729395091534, 0.07211299240589142, -0.04725169762969017, 0.022114146500825882, 0.008401179686188698, -0.0725102499127388, 0.08871600776910782, 0.026079751551151276, -0.0041076852940022945, 0.07623659074306488, 0.04522189870476723, -0.00935027189552784, -0.03996601700782776, 0.033084042370319366, 0.02447790652513504, 0.009878388606011868, -0.0021993350237607956, 0.05421096086502075, -0.0531136617064476, -0.06998620182275772, 0.023700734600424767, -0.06661447882652283, -0.08161580562591553, 0.047955986112356186, 0.014073370955884457, -0.040479522198438644, 0.02540189027786255, 0.060170333832502365, 0.019544197246432304, -0.019685138016939163, 0.031035691499710083, -0.02126033417880535, 0.005265883635729551, 0.006405437830835581, -0.027388766407966614, -0.02818397805094719, 0.008118181489408016, 0.0413689985871315, 0.0038940273225307465, 0.008211454376578331, -0.007026179693639278, 0.02406601794064045, -0.08572638779878616, 0.03624632582068443, 0.01579120382666588, -0.002526425989344716, -0.018727341666817665, 0.02886943519115448, 0.0704583004117012, 0.041871536523103714, 0.12383867055177689, 0.11546188592910767, 0.014634508639574051, -0.10032287985086441, -0.0007448302349075675, -0.04537525773048401, 0.000599810155108571, -0.0004802349430974573, -0.08362369984388351, -0.11709365248680115, 4.959991433796934e-33, 0.03008504956960678, -0.03706745803356171, 0.003948245197534561, -0.019268814474344254, 0.06776383519172668, -0.039458565413951874, 0.0685993880033493, -0.03623262792825699, -0.0003696864878293127, 0.06633594632148743, 0.012840240262448788, 0.033630989491939545, -0.08961888402700424, 0.06790969520807266, -0.007745414972305298, -0.0759197548031807, -0.053413163870573044, -0.013149113394320011, 0.039860766381025314, 0.004372823052108288, 0.08848356455564499, 0.058028873056173325, -0.028493663296103477, 0.10897023230791092, -0.004830785561352968, -0.022022509947419167, 0.0593380406498909, 0.039662960916757584, -0.043127451092004776, -0.005872535053640604, -0.12600372731685638, -0.07620862871408463, -0.026159990578889847, -0.04284299537539482, -0.029917316511273384, -0.015448135323822498, 0.03406107425689697, -0.013617451302707195, -0.02937314286828041, -0.13716116547584534, -0.021476415917277336, 0.026534603908658028, 0.003811147063970566, -0.0699746385216713, -0.05460043624043465, 0.006584704853594303, -0.0449441634118557, -0.035932477563619614, 0.000696514849551022, -0.0947471484541893, -0.007265813183039427, -0.08849158883094788, -0.03956823796033859, 0.002039568033069372, 0.09807825833559036, -0.020542031154036522, 0.08154959231615067, 0.038154393434524536, -0.009338419884443283, 0.03249600529670715, 0.01861388236284256, -0.012283110991120338, 0.021789217367768288, 0.024084238335490227, 0.022983863949775696, 0.02291649952530861, -0.04935585334897041, 0.06397085636854172, 0.00619269534945488, 0.07535097002983093, -0.1106247827410698, 0.07447068393230438, 0.0038497522473335266, -0.029374051839113235, 0.11229488253593445, -0.03815208375453949, 0.025272469967603683, -0.05383894965052605, -0.005479760933667421, 0.028483804315328598, -0.06786127388477325, 0.09955065697431564, 0.0003295118222013116, 0.04418075829744339, -0.1287713497877121, -0.007550548296421766, 0.0001426533272024244, -0.040071748197078705, 0.04711346700787544, 0.039088666439056396, -0.060867518186569214, -0.024429069831967354, -0.03557853400707245, 0.026267051696777344, -0.051247525960206985, -6.458072658553551e-33, -0.06438691169023514, 0.10374540835618973, -0.06201612949371338, 0.07111020386219025, -0.0585293173789978, -0.037236589938402176, -0.004758909810334444, 0.006530155427753925, 0.07622260600328445, -0.05238742381334305, 0.013376395218074322, -0.011536380276083946, -0.014295816421508789, 0.00600023427978158, -0.024965206161141396, 0.0021445516031235456, -0.02406013384461403, 0.016495821997523308, -0.037471286952495575, 0.08678340166807175, -0.009268990717828274, 0.08415951579809189, -0.07583966106176376, -0.10195378959178925, -0.05927777662873268, -0.0472392663359642, -0.006437741685658693, 0.03576594591140747, 0.0567065104842186, 0.0007383193587884307, 0.020987432450056076, -0.05463648587465286, -0.05944110080599785, -0.007321460638195276, -0.014374817721545696, -0.03451923280954361, 0.05928947031497955, -0.018506059423089027, -0.03666646033525467, -0.01367299072444439, 0.07744421809911728, -0.0038193664513528347, -0.05075237900018692, 0.017023244872689247, -0.016922397539019585, 0.05604860186576843, -0.03669494390487671, -0.02610429935157299, -0.050517868250608444, -0.010101841762661934, 0.0585145577788353, 0.01518105249851942, -0.005382145754992962, 0.037507642060518265, -0.027926748618483543, -0.020647801458835602, 0.08020687103271484, 0.007728283293545246, -0.030190831050276756, 0.05427701398730278, -0.03963319584727287, -0.08302802592515945, -0.03890587389469147, 0.009286811575293541, -0.07634013146162033, -0.02121352031826973, -0.0849265307188034, 0.10016743093729019, 0.03566451370716095, -0.033982884138822556, 0.0009783232817426324, -0.051548849791288376, 0.049087390303611755, 0.04216913506388664, -0.03843230754137039, -0.051268354058265686, -0.002769946586340666, 0.01393722090870142, 0.018404385074973106, 0.03396979346871376, 0.0133294016122818, 0.008073986507952213, -0.044042136520147324, 0.05433337390422821, 0.09651896357536316, 0.10748402029275894, 0.00579267181456089, 0.07996243238449097, 0.028390809893608093, -0.002836481900885701, -0.009438891895115376, -0.008534255437552929, -0.04494781792163849, 0.027021700516343117, -0.0456712506711483, -5.72229339468322e-08, -0.09013491868972778, 0.08254335820674896, -0.00020545636652968824, -0.07235583662986755, 0.03981199115514755, -0.03221387788653374, -0.003650897881016135, 0.11659180372953415, -0.05443793535232544, 0.02427082695066929, -0.024005994200706482, 0.05309882014989853, -0.10782250016927719, -0.06102530658245087, -0.041617851704359055, 0.1397833377122879, -0.018567873165011406, -0.021312139928340912, 0.09422223269939423, -0.004706524778157473, 0.08380478620529175, -0.006442498881369829, -0.026999620720744133, -0.04545610025525093, -0.047055359929800034, -0.0569174662232399, 0.02172662504017353, 0.03280879929661751, 0.004685182590037584, -0.008523359894752502, -0.04724535346031189, 0.039370305836200714, 0.0645393431186676, -0.005471244920045137, 0.07166249305009842, 0.03439973294734955, -0.06354353576898575, -0.11812833696603775, 0.009250613860785961, 0.007843030616641045, -0.05663358047604561, 0.0034774409141391516, -0.02717660740017891, 0.02607630379498005, 0.09842078387737274, -0.05186418443918228, 0.04767856001853943, -0.05013010650873184, 0.01833636313676834, 0.03509456664323807, 0.05074933171272278, 0.06470692157745361, 0.019132981076836586, 0.007164099719375372, 0.02670484408736229, 0.09333105385303497, -0.05432341247797012, -0.028934042900800705, 0.006754880305379629, 0.027503132820129395, 0.018492724746465683, 0.018210262060165405, 0.03238527476787567, 0.009058700874447823 ] }, { "text": "---\ntitle: \"LLM Configurations\"\nid: \"configuration\"\ncategory: \"genai\"\ntags: [\"llm\", \"configuration\", \"top_k\", \"medium\", \"video\"]\nrelated: [\"llm\", \"temperature\"]\ndate: \"2023-07-22\"\ndescription: \"A brief introduction to LLM configurations\"\n---\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/llm-inference-222c8e8a6ba7) \n\nWhat are the configuration parameters that can influence the model’s output during inference? \n\nClick here to watch the video on [YouTube](https://youtu.be/KbUPOJ8Fmzs)", "source": "2023-07-22-LLM_Configurations.md", "type": "markdown", "chunk_id": "2023-07-22-LLM_Configurations.md_0", "embedding": [ -0.02767796441912651, -0.05682967230677605, -0.02739272639155388, 0.008650310337543488, 0.0715143159031868, 0.020329032093286514, -0.048750441521406174, 0.03665802255272865, -0.011587152257561684, -0.029938118532299995, 0.026524189859628677, -0.015775585547089577, 0.03566422313451767, -0.07687193900346756, 0.0033060722053050995, 0.08700698614120483, 0.07338517904281616, -0.033200398087501526, -0.08227168023586273, -0.08877060562372208, 0.10907373577356339, 0.00048142753075808287, 0.024060724303126335, -0.017689064145088196, 0.0102611742913723, -0.007220716681331396, 0.017455218359827995, 0.12161145359277725, 0.029300767928361893, -0.05777338147163391, -0.009814033284783363, 0.13101401925086975, -0.042933620512485504, 0.030454028397798538, 0.0298050157725811, -0.02096722461283207, -0.023703450337052345, -0.07019926607608795, -0.038583386689424515, 0.04821601137518883, 0.08155655115842819, 0.0013749373611062765, 0.03021363727748394, -0.025692371651530266, 0.06491264700889587, 0.06978150457143784, -0.008283172734081745, 0.03111470676958561, -0.11154212802648544, 0.010742559097707272, -0.021926170215010643, -0.02781996689736843, -0.03927299752831459, 0.016985086724162102, -0.039026904851198196, 0.018617352470755577, -0.022823339328169823, -0.023647796362638474, 0.004273511935025454, -0.06035231053829193, -0.019736437126994133, -0.04279300570487976, -0.07553813606500626, 0.012643327005207539, 0.09217719733715057, -0.019869711250066757, 0.016041701659560204, 0.07331721484661102, 0.01326742209494114, -0.008505205623805523, -0.010979392565786839, 0.006119091063737869, -0.03863586112856865, -0.05305304005742073, -0.022408364340662956, -0.01957249827682972, 0.04465651512145996, -0.024579422548413277, 0.07834411412477493, -0.10030626505613327, 0.0017160881543532014, -0.03385284170508385, -0.035055480897426605, -0.02642202563583851, -0.018427163362503052, -0.02031455934047699, -0.002783419331535697, -0.002873053075745702, 0.03861190378665924, 0.0697852149605751, 0.008245344273746014, -0.13771720230579376, -0.13170786201953888, 0.04922565072774887, -0.023735754191875458, 0.07425512373447418, 0.0064628636464476585, -0.12080395966768265, -0.015948176383972168, 0.03400157019495964, 0.03290049731731415, 0.06726295500993729, 0.1363423615694046, 0.05153366178274155, -0.010778754949569702, -0.08775438368320465, 0.06387708336114883, 0.11585208773612976, -0.02478961832821369, -0.02116015926003456, 0.043402690440416336, 0.07739900797605515, 0.10461927950382233, 0.010617626830935478, 0.04482041299343109, -0.02514633908867836, 0.041148025542497635, 0.04993542656302452, -0.0054442849941551685, -0.07502417266368866, -0.08030595630407333, 0.012970737181603909, -0.0635298416018486, 0.024759497493505478, 0.009739129804074764, 0.01980608142912388, -0.09037686884403229, 2.284455905059026e-33, 0.10810014605522156, -0.05841938778758049, -0.023222925141453743, 0.030000394210219383, 0.03684374317526817, 0.10383107513189316, -0.016093023121356964, 0.014126166701316833, 0.03576280549168587, 0.05797034874558449, -0.10727333277463913, -0.04217398166656494, -0.06383512914180756, 0.041806697845458984, -0.0012728605652227998, -0.0232615377753973, -0.013289905153214931, 0.07949332892894745, -0.04927758499979973, 0.050170790404081345, 0.030161384493112564, 0.08909361064434052, -0.05373172461986542, -0.06614807993173599, -0.0017772727878764272, 0.08637037873268127, 0.08780694007873535, 0.002784878481179476, -0.14015871286392212, 0.02559703402221203, -0.028148716315627098, 0.021996354684233665, -0.00503069581463933, 0.024629369378089905, 0.018586425110697746, 0.009088701568543911, -0.04760795459151268, -0.01513627264648676, 0.02125220187008381, -0.05524679645895958, -0.023059532046318054, 0.040667176246643066, 0.017682932317256927, -0.017424415796995163, -0.12535905838012695, -0.07309228181838989, -0.0022567857522517443, 0.03701392188668251, 0.029762545600533485, 0.04507853463292122, 0.01995697058737278, -0.037507351487874985, 0.01480831578373909, -0.06571643054485321, -0.009742303751409054, -0.024798251688480377, 0.0020869653671979904, -0.026643969118595123, -0.0011053038761019707, 0.010298104956746101, -0.02820601314306259, -0.014167403802275658, -0.016640258952975273, -0.06754478067159653, 0.10097061097621918, 0.08259068429470062, -0.11512435972690582, -0.043055590242147446, 0.08662170171737671, 0.011836506426334381, -0.02584323287010193, 0.02227681875228882, -0.05245833843946457, -0.028693797066807747, 0.0116859907284379, -0.04568136855959892, -0.016009772196412086, -0.04247063398361206, 0.02130568027496338, 0.011487152427434921, -0.01075743231922388, 0.11022006720304489, -0.03757360577583313, -0.010405367240309715, -0.03386581316590309, -0.025884652510285378, -0.01039893552660942, -0.013918780721724033, -0.04154720902442932, -0.062138237059116364, -0.005456411279737949, -0.0070424191653728485, 0.05346990376710892, 0.052089884877204895, -0.026556452736258507, -1.8260276182467267e-33, -0.01199781708419323, 0.012820449657738209, 0.015825193375349045, 0.12542907893657684, 0.00873503740876913, -0.04730715602636337, 0.01701958291232586, 0.1085062325000763, 0.04213342070579529, -0.07027537375688553, 0.02652338519692421, -0.036765120923519135, -0.03493199869990349, -0.032020874321460724, 0.036489490419626236, -0.03567567095160484, -0.06676781177520752, -0.03923121839761734, 0.04454277455806732, -0.0006356408703140914, -0.04742826893925667, -0.003893401240929961, 0.0033000244293361902, -0.001047502737492323, -0.02224639616906643, 0.013297921046614647, 0.013459702022373676, 0.05240010842680931, 0.003092639148235321, 0.005461698863655329, 0.007890455424785614, -0.021988017484545708, -0.06703110784292221, 0.07594295591115952, -0.07342922687530518, 0.024417191743850708, 0.0494849719107151, 0.07794253528118134, 0.024474680423736572, 0.03434378653764725, 0.023856423795223236, 0.07381678372621536, -0.014143653213977814, 0.033096130937337875, -0.03532100468873978, 0.03806789591908455, 0.015796389430761337, -0.08408135920763016, 0.06085938215255737, -0.06405610591173172, 0.0148721719160676, -0.046678658574819565, 0.0033045595046132803, 0.052438635379076004, -0.02649816870689392, -0.041226405650377274, -0.024611108005046844, -0.011302173137664795, -0.017682300880551338, -0.014647644944489002, 0.01809832453727722, -0.02598755992949009, -0.0014247252838686109, -0.03692663460969925, -0.05341274291276932, 0.03632548823952675, -0.01421140693128109, -0.0014603325398638844, 0.028289252892136574, 0.007155825849622488, 0.036915767937898636, -0.04773567616939545, 0.029751311987638474, -0.025335371494293213, 0.021565202623605728, -0.10527995228767395, -0.02739029936492443, -0.004632026422768831, 0.06074317544698715, -0.048413559794425964, -0.06896475702524185, -0.02879386767745018, -0.07818423211574554, 0.08280676603317261, 0.01532226987183094, -0.029141943901777267, 0.03490027040243149, 0.06544719636440277, 0.037435486912727356, 0.056792762130498886, 0.014651037752628326, 0.05072038993239403, 0.003339892253279686, 0.09110351651906967, -0.032790541648864746, -5.58566490838075e-08, -0.08449958264827728, -0.07909547537565231, -0.01703333482146263, 0.07269646227359772, -0.0008363710367120802, 0.0011444592382758856, 0.06586068868637085, 0.031720977276563644, 0.07944482564926147, -0.001188497757539153, 0.1120680719614029, 0.06097158417105675, -0.04639223590493202, -0.01868075504899025, 0.06100570410490036, -0.028685225173830986, 0.0027625798247754574, 0.024442819878458977, -0.0661008432507515, -0.07652803510427475, 0.028166374191641808, -0.029407843947410583, -0.020478535443544388, 0.00933552160859108, 0.1688012033700943, -0.012308381497859955, 0.01324916910380125, 0.1040882021188736, 0.006975135300308466, 0.08380141854286194, -0.03386562690138817, -0.029379000887274742, -0.0512554794549942, -0.018004275858402252, -0.0556410476565361, 0.08616037666797638, -0.052037253975868225, 0.01007029414176941, 0.08793359994888306, -0.04438347369432449, -0.030769092962145805, -0.04636910930275917, -0.07075034081935883, 0.04698609933257103, 0.010152710601687431, -0.05180126801133156, 0.07228384912014008, -0.08946376293897629, -0.0507003590464592, 0.020537912845611572, -0.009600789286196232, 0.0010118124773725867, 0.011281754821538925, -0.0023572291247546673, -0.008870177902281284, 0.021150395274162292, 0.023987263441085815, -0.012558483518660069, 0.027433430776000023, 0.005035518668591976, 0.06706448644399643, 0.007978196255862713, -0.08346989750862122, -0.029717832803726196 ] }, { "text": "---\ntitle: \"LLM Evaluation\"\nid: \"evaluation\"\ncategory: \"genai\"\ntags: [\"evaluation\", \"llm\", \"medium\"]\nrelated: [\"llm\"]\ndate: \"2023-08-01\"\ndescription: \"A practical guide to measure the model performance\"\n---\n\n\n[TL;DR? Read the full version on Medium](https://medium.com/@balci.pelin/llm-evaluation-6b63b3cfd48b) \n\nThis article is a practical guide to measure the model performance and to make sure that the model gives good results \nafter fine-tuning.", "source": "2023-08-01-LLM_Evaluation.md", "type": "markdown", "chunk_id": "2023-08-01-LLM_Evaluation.md_0", "embedding": [ 0.03766103833913803, -0.0019626053981482983, -0.06443074345588684, -0.0009621818899177015, 0.04898475855588913, -0.019627993926405907, -0.054613035172224045, 0.02176922746002674, -0.03577994555234909, -0.05084719881415367, -0.034007761627435684, -0.003285493003204465, 0.02321571856737137, -0.02221185714006424, -0.04437735676765442, 0.05361442640423775, 0.15375494956970215, 0.033350612968206406, -0.03260001912713051, -0.05183691158890724, 0.03559591621160507, 0.0232667438685894, 0.09188611805438995, -0.02701091207563877, -0.023463746532797813, -0.03222181275486946, -0.04804181307554245, 0.06339367479085922, 0.0306497011333704, -0.03542100265622139, -0.028900345787405968, 0.07529789209365845, 0.010000066831707954, 0.05669483169913292, -0.058283593505620956, 0.02842453494668007, -0.03676997125148773, -0.009942415170371532, 0.03569340333342552, 0.006124966777861118, 0.051668860018253326, -0.021465091034770012, 0.06785464286804199, -0.025258922949433327, 0.10379685461521149, -0.04988301917910576, -0.04136466979980469, -0.052785441279411316, -0.13395529985427856, -0.005739748477935791, -0.05922746658325195, -0.027076780796051025, 0.0026132590137422085, -0.02005584165453911, -0.0392124280333519, 0.052847132086753845, -0.0003968691744375974, -0.10295987129211426, -0.01969950832426548, -0.05112144723534584, -0.004433321766555309, -0.047387342900037766, -0.085551418364048, -0.014418644830584526, 0.05336138233542442, -0.04471172019839287, 0.0029414412565529346, 0.04554077237844467, -0.025037797167897224, -0.03674241900444031, -0.0018285209080204368, 0.009675015695393085, 0.00011563189764274284, 0.011644162237644196, -0.05122785642743111, 0.05376327410340309, 0.006657044403254986, 0.037329062819480896, 0.05587660148739815, -0.02500162273645401, 0.008688009344041348, -0.015242919325828552, -0.039895445108413696, -0.038233209401369095, 0.056274931877851486, -0.032402828335762024, 0.05611923336982727, -0.029210442677140236, 0.01665181666612625, 0.05021506920456886, 0.06306564807891846, 0.029211392626166344, -0.037538543343544006, 0.0284127127379179, 0.026078257709741592, 0.0684213638305664, 0.023442035540938377, -0.1378326565027237, -0.02848486788570881, 0.07239806652069092, 0.012039856053888798, 0.09893254190683365, 0.006181268021464348, -0.02262185886502266, -0.03347555920481682, -0.03505722060799599, 0.10247130692005157, 0.1316985785961151, 0.0002927225432358682, -0.03636721521615982, 0.047265708446502686, 0.07988603413105011, 0.015390575863420963, 0.046485234051942825, 0.05426614359021187, -0.013226806186139584, 0.028892027214169502, 0.033733073621988297, 0.1259450763463974, 0.05799748748540878, -0.03056192398071289, -0.0625196173787117, 0.031765107065439224, -0.053424227982759476, 0.00541680259630084, 0.044037383049726486, -0.0596231110394001, 3.0485753548934995e-33, -0.00038692617090418935, -0.03941233828663826, -0.051779985427856445, 0.03226349130272865, -0.04467231407761574, 0.012531247921288013, -0.021123254671692848, -0.003442120738327503, -0.006482741795480251, -0.015843670815229416, -0.1357671320438385, 0.043893542140722275, -0.07583899796009064, 0.047649919986724854, 0.03452945128083229, -0.0025168168358504772, -0.02358938753604889, 0.05877947807312012, -0.020302388817071915, 0.04044877365231514, 0.05002211034297943, -0.026406319811940193, 0.005412018392235041, -0.08049166947603226, 0.0812520757317543, 0.09507334977388382, 0.05569655820727348, -0.03040771186351776, -0.06843946129083633, 0.0565032996237278, 0.013805592432618141, 0.02302527241408825, -0.021843936294317245, -0.01510642096400261, -0.019586730748414993, 0.04643740877509117, -0.10847534239292145, 0.06880985200405121, 0.031555868685245514, -0.05532042309641838, -0.048956092447042465, 0.03569931909441948, -0.010270708240568638, -0.07404617965221405, -0.10973219573497772, 0.005624502897262573, -0.023326201364398003, 0.011895603500306606, 0.017225757241249084, 0.02210187539458275, 0.020680148154497147, -0.030013201758265495, -0.0659397691488266, 0.009922103956341743, -0.03923925757408142, 0.02443614788353443, 0.035358279943466187, 0.022438673302531242, -0.04606997221708298, 0.0461491160094738, -0.04667436331510544, 0.025955304503440857, -0.0190185084939003, -0.027263307943940163, 0.03834671899676323, 0.01509497594088316, -0.053953129798173904, 0.01614379696547985, 0.03549973666667938, -0.06655411422252655, 0.021909460425376892, -0.04172004386782646, -0.01121598668396473, -0.030979031696915627, 0.04795585572719574, -0.1120038777589798, 0.024604342877864838, -0.030113141983747482, 0.014687681570649147, 0.004612336400896311, 0.03964299336075783, 0.12443027645349503, -0.03937143459916115, -0.11148244142532349, 0.022798845544457436, -0.019146351143717766, -0.008271916769444942, -0.018837330862879753, -0.055134572088718414, -0.004376058466732502, -0.003296994837000966, 0.047319334000349045, 0.014298856258392334, 0.06463906913995743, -0.033470671623945236, -3.5059229215870115e-33, -0.01020776852965355, -0.005292768590152264, 0.010273962281644344, 0.16098086535930634, 0.04703088477253914, -0.12024588137865067, -0.050297029316425323, 0.08095089346170425, -0.05280067399144173, -0.004977245815098286, 0.007708405144512653, -0.04061736911535263, -0.05949641764163971, 0.01683419942855835, 0.006902608089148998, -0.017067410051822662, -0.04008862376213074, -0.08696242421865463, 0.05954283848404884, 0.020432153716683388, -0.009539038874208927, 0.10375652462244034, -0.007657058537006378, 0.01648174598813057, -0.05399540066719055, 0.026354053989052773, 0.0026994438376277685, -0.020480502396821976, -0.05651158094406128, -0.07053161412477493, 0.02889002487063408, -0.03385096788406372, -0.0010627759620547295, 0.06551595777273178, 0.006825182121247053, 0.03450114652514458, 0.11336259543895721, -0.027319427579641342, 0.051688261330127716, 0.0971888080239296, 0.04519703984260559, 0.09298529475927353, -0.041366782039403915, 0.006441169418394566, -0.04411633312702179, 0.00945212785154581, -0.03355364874005318, -0.030688652768731117, 0.04405888170003891, -0.024345487356185913, 0.03652922064065933, -0.03664250299334526, -0.009620246477425098, -0.02239471860229969, -0.03955211490392685, -0.06830919533967972, 0.013786752708256245, -0.07250767201185226, -0.09812799841165543, 0.055955417454242706, -0.05822718143463135, -0.0076103853061795235, -0.019652042537927628, 0.0028637771029025316, 0.0013305486645549536, 0.015639685094356537, -0.007354895584285259, -0.021328043192625046, -0.0217465590685606, 0.04568582773208618, 0.019431741908192635, 0.00620430801063776, -0.060330674052238464, 0.029366973787546158, -0.028133196756243706, -0.06346187740564346, -0.00030606973450630903, 0.02895476669073105, 0.04009324312210083, -0.06721902638673782, -0.03275499865412712, 0.018737250939011574, -0.11358184367418289, -0.003128924872726202, -0.055574681609869, 0.0073352777399122715, 0.10140175372362137, 0.0019013402052223682, -0.05691475421190262, 0.016467934474349022, 0.020121203735470772, 0.03126920014619827, -0.054866496473550797, -0.017580384388566017, 0.02072429470717907, -5.544624670505982e-08, -0.026457909494638443, -0.09387876838445663, -0.006476786453276873, 0.0723300352692604, -0.056656524538993835, -0.00102814135607332, -0.054478470236063004, 0.046693045645952225, 0.03951249271631241, -0.026200303807854652, 0.1319659948348999, -0.0004572000470943749, -0.12698625028133392, 0.03380676358938217, 0.07446397095918655, -0.05544426292181015, 0.01894870400428772, 0.12069346755743027, -0.09414953738451004, -0.03531400114297867, 0.05359213054180145, 0.05789623409509659, 0.06252989172935486, -0.0568423829972744, 0.11580642312765121, -0.05357341468334198, -0.015168783254921436, 0.04169384762644768, -0.013629631139338017, -0.01133235078305006, 0.021259905770421028, 0.02908683940768242, -0.0694013386964798, 0.017317332327365875, 0.014288384467363358, 0.09004384279251099, -0.03454915061593056, -0.045903727412223816, 0.08769995719194412, 0.10142497718334198, 0.03475824370980263, 0.009938407689332962, -0.026177700608968735, 0.04667772352695465, 0.0019823021721094847, -0.0839301124215126, -0.032751817256212234, -0.04906788840889931, -0.05511844530701637, -0.017619850113987923, 0.02108810842037201, -0.05202239751815796, -0.058876119554042816, 0.00892727356404066, 0.014637893997132778, 0.03243662044405937, 0.03827277943491936, -0.020690644159913063, 0.05776466801762581, 0.026787057518959045, 0.08347108215093613, -0.033383939415216446, -0.10425363481044769, 0.027673495933413506 ] }, { "text": "---\ntitle: \"Deep Dream Generator\"\nid: \"deepdream\"\ncategory: \"deep-learning\" # \"genai\", \"deep-learning\", \"conference\", \"machine-learning\", \"edge-ml\", \"visualization\"\ntags: [\"deep dream\", \"image generation\", \"image\", \"inception\", \"CNN\"]\nrelated: [\"imageprocess\"]\ndate: \"2026-01-09\"\ndescription: \"What happens when you ask a neural network to enhance what it sees, over and over again? You get Deep Dream—one of the first techniques that let us peek inside the black box of AI\"\n---\n\nI am reading the book How Smart Machines Think by Sean Gerrish. In one chapter, he explains the Deep Dream Generator. \nIt was very popular in 2015, and I used it a lot to make my pictures look dreamy. Thanks to Clade, I can now understand \nthe logic behind it. Here is a notebook that explains it better.", "source": "2026-01-09-Deep_Dream_Generator.md", "type": "markdown", "chunk_id": "2026-01-09-Deep_Dream_Generator.md_0", "embedding": [ -0.05619250610470772, -0.009346301667392254, 0.05711471289396286, 0.051829420030117035, 0.038485363125801086, -0.04014439880847931, -0.024552613496780396, -0.053691960871219635, 0.057725705206394196, -0.08581553399562836, -0.04131893068552017, 0.04951462522149086, 0.03575578331947327, -0.09388861805200577, -0.06621187180280685, 0.013667112216353416, 0.056823987513780594, 0.010136131197214127, -0.11244813352823257, -0.05108069255948067, 0.07753346115350723, -0.07629659026861191, 0.0005971439532004297, -0.08249669522047043, 0.039364513009786606, 0.054528091102838516, -0.001868470455519855, -0.035756032913923264, 0.03847457841038704, -0.005291544366627932, 0.056791096925735474, 0.02217654138803482, -0.013700004667043686, 0.054806794971227646, -0.01429600827395916, 0.08223981410264969, -0.05253095552325249, 0.057326540350914, 0.009195846505463123, -0.0006012424128130078, 0.03054298646748066, -0.06410060822963715, -0.004990458954125643, 0.001281524309888482, 0.05614810064435005, 0.02794399857521057, -0.013904068619012833, -0.100362628698349, -0.03390758857131004, -0.03809620812535286, -0.15622760355472565, -0.06676005572080612, -0.028117161244153976, 0.001029976294375956, 0.04494696483016014, 0.06377530097961426, 0.0030617606826126575, 0.00048734431038610637, -0.01913481391966343, 0.02828998491168022, 0.01042124629020691, -0.009536766447126865, 0.00400076387450099, -0.008724432438611984, 0.0887092649936676, -0.05485689267516136, 0.009696797467768192, -0.005631974432617426, 0.05615399405360222, -0.09718146175146103, 0.04981059581041336, 0.08101097494363785, -0.019467096775770187, 0.0008939314284361899, 0.04487937316298485, 0.04103684425354004, -0.0019065866945311427, -0.012383312918245792, 0.037239257246255875, -0.06614861637353897, 0.07020118087530136, -0.02209554612636566, 0.021065184846520424, -0.02582547813653946, 0.025005387142300606, 0.013415701687335968, -0.02358291856944561, -0.02109251730144024, -0.05276187136769295, 0.043832700699567795, -0.015779715031385422, -0.10689009726047516, -0.10872694104909897, 0.009771333076059818, 0.07052230834960938, 0.04966035485267639, -0.0639096349477768, -0.14835688471794128, -0.02960040792822838, 0.013075871393084526, 0.007683892734348774, -0.03828785941004753, 0.04402778670191765, -0.052024394273757935, 0.01964220404624939, -0.014080113731324673, 0.08477643877267838, 0.0604621097445488, 0.036225929856300354, -0.0212106853723526, 0.009674577973783016, 0.024233588948845863, -0.00039730544085614383, 0.023161334916949272, -0.039316076785326004, -0.03488019481301308, -0.027804430574178696, 0.07795631885528564, -0.011669592931866646, 0.037134695798158646, -0.04933645576238632, 0.00934580061584711, -0.024000002071261406, -0.037389639765024185, -0.03385657072067261, -0.04880330711603165, -0.061829980462789536, -7.348799921304789e-34, -0.01855624094605446, -0.01078601460903883, 0.015277797356247902, 0.06052931025624275, 0.11300381273031235, -0.015659872442483902, -0.0241177286952734, -0.08200787007808685, -0.022887859493494034, 0.02977956272661686, -0.020847048610448837, 0.0482243075966835, -0.03909337520599365, 0.2404516637325287, 0.002006442053243518, -0.04761519283056259, -0.05867401883006096, -0.016348622739315033, 0.06449109315872192, 0.0027071938384324312, 0.0011647498467937112, 0.01790270395576954, 0.030014734715223312, -0.06207886338233948, -0.04673994705080986, 0.06825891882181168, 0.013725077733397484, -0.0101203927770257, 0.01902100071310997, 0.00840449146926403, -0.08337441086769104, 0.07603377103805542, -0.05764758586883545, -0.049779411405324936, 0.016396593302488327, 0.09009230136871338, 0.023637576028704643, -0.028389303013682365, -0.022204795852303505, 0.016956645995378494, 0.004682828672230244, 0.08095723390579224, -0.047633085399866104, -0.02300991863012314, -0.04350662603974342, 0.06011652573943138, 0.04711524397134781, 0.027479495853185654, -0.07920721918344498, -0.0013299690326675773, 0.030277548357844353, -0.03648996725678444, -0.049941033124923706, -0.09894105792045593, 0.011296898126602173, 0.017792459577322006, 0.023679833859205246, -0.016844434663653374, 0.0873737707734108, 0.025655025616288185, 0.03375955671072006, -0.032510071992874146, -0.01241424772888422, 0.07798885554075241, 0.003253689967095852, 0.07149408012628555, 0.04611779749393463, 0.03487687557935715, 0.009386639110744, -0.004520304501056671, -0.0005323964287526906, 0.007606126833707094, -0.03292281925678253, -0.052445244044065475, -0.016444241628050804, 0.008054220117628574, -0.03339102119207382, -0.014717168174684048, -0.02219521813094616, 0.05761265382170677, -0.004072252660989761, 0.04268103465437889, -0.03954669088125229, -0.05815611034631729, -0.013335991650819778, 0.08874011039733887, -0.04294667765498161, -0.06587407737970352, -0.04111858084797859, -0.008446605876088142, 0.0039047321770340204, -0.023612434044480324, 0.029562899842858315, 0.012004731222987175, -0.10163742303848267, -7.422985094278695e-34, 0.024827128276228905, 0.023268382996320724, -0.04407915100455284, 0.07307492941617966, 0.034634754061698914, -0.05809557065367699, 0.004039689898490906, 0.0031418034341186285, -0.06503422558307648, -0.0008079891558736563, 0.049162302166223526, 0.007020068354904652, -0.053694892674684525, -0.024954544380307198, -0.014457184821367264, -0.12007160484790802, 0.03240009769797325, -0.03985172510147095, -0.06561125069856644, -0.00929458998143673, 0.017866868525743484, 0.12248814105987549, -0.041548438370227814, -0.03080558590590954, -0.02795420028269291, 0.04387844353914261, -0.030477043241262436, 0.10003947466611862, 0.005664409138262272, 0.00753055652603507, 0.004692696966230869, -0.07146937400102615, -0.05409429967403412, 0.01074951607733965, 0.044088251888751984, 0.1099250540137291, 0.08252429217100143, -0.07346300780773163, -0.005375273525714874, -0.027614951133728027, 0.026748977601528168, -0.007348146755248308, -0.060219939798116684, -0.0005853514885529876, -0.04457526654005051, 0.004924403037875891, -0.024020014330744743, 0.04417285695672035, 0.028584040701389313, 0.028246238827705383, 0.05235300958156586, 0.042720239609479904, -0.0733916312456131, -0.053875602781772614, -0.07082347571849823, -0.03709813952445984, -0.0018508031498640776, 0.04436860606074333, 0.06300287693738937, 0.08460056036710739, -0.029015356674790382, -0.06060432642698288, -0.07482922077178955, -0.034523073583841324, -0.08184107393026352, 0.06112281233072281, -0.057432398200035095, 0.04579821601510048, 0.03116474114358425, 0.007771625649183989, 0.037055496126413345, -0.014178591780364513, 0.031870752573013306, 0.06713758409023285, -0.015293256379663944, -0.03063386306166649, -0.004856029059737921, -0.0006898111314512789, 0.04820406064391136, -0.05039629712700844, -0.06509312242269516, -0.11505382508039474, -0.038644708693027496, 0.11069917678833008, 0.07674873620271683, 0.01755603402853012, -0.022127604112029076, -0.025209203362464905, 0.0011180998990312219, -0.00876136776059866, -0.05208627134561539, 0.0021684227976948023, -0.0939093679189682, 0.11864791810512543, -0.006090073846280575, -5.2910191783439586e-08, -0.05630454048514366, -0.014146977104246616, 0.0761534571647644, -0.0120945293456316, 0.0629744604229927, -0.06500773876905441, 0.019142668694257736, 0.06449775397777557, -0.019680378958582878, -0.07946760207414627, 0.07394763827323914, -0.004141098819673061, -0.07200419902801514, 0.005550683476030827, 0.047284871339797974, 0.0676361694931984, 0.031154043972492218, 0.03313829004764557, 0.04274652898311615, -0.032776013016700745, 0.025437433272600174, -0.022496948018670082, 0.02831217274069786, -0.030974341556429863, 0.07166974991559982, -0.02866942249238491, -0.04260006546974182, 0.05571511387825012, -0.07863891869783401, 0.020528919994831085, 0.017462585121393204, 0.004095996730029583, 0.0737088993191719, 0.01672421209514141, 0.06117343530058861, 0.012172088958323002, -0.06397531181573868, -0.019431650638580322, -0.0017660980811342597, -0.05144869163632393, 0.0069804065860807896, 0.029898084700107574, 0.0700698122382164, -0.003977510612457991, -0.03844573348760605, -0.04686408489942551, 0.06943617761135101, -0.079310342669487, -0.01724616438150406, 0.1095651164650917, 0.0005358987837098539, -0.019691243767738342, 0.06560298055410385, 0.05659952014684677, 0.057655323296785355, -0.05187614634633064, 0.05620088428258896, -0.011626997962594032, 0.004932873882353306, 0.12328722327947617, 0.027398327365517616, 0.07327359914779663, -0.05524173006415367, -0.027617568150162697 ] }, { "text": "The Colab link: https://colab.research.google.com/drive/1EvQjVea0M3qkUVMkil3ZtujnGcRGjBB_?usp=sharing\n\nThe actual deep dream generator: https://deepdreamgenerator.com/\n\n
\n\n
", "source": "2026-01-09-Deep_Dream_Generator.md", "type": "markdown", "chunk_id": "2026-01-09-Deep_Dream_Generator.md_1", "embedding": [ -0.10951995849609375, -0.036192476749420166, 0.05230994150042534, 0.04133251681923866, 0.01730857975780964, -0.020788729190826416, -0.140804260969162, -0.05428147688508034, 0.016645116731524467, -0.10409700125455856, -0.082607701420784, 0.004101797007024288, -0.03404520824551582, -0.081044040620327, -0.04173194244503975, 0.04714054614305496, -0.011508447118103504, 0.07000066339969635, -0.01937692053616047, -0.05856022238731384, 0.037597037851810455, -0.05784483626484871, 0.06453315913677216, -0.040831342339515686, 0.026390593498945236, 0.015320542268455029, 0.025239042937755585, 0.021451633423566818, 0.025529110804200172, -0.050649743527173996, 0.06183714047074318, 0.009093928150832653, -0.011753907427191734, 0.021068336442112923, 0.02980932779610157, 0.05097249522805214, -0.0395284928381443, 0.025890430435538292, -0.03642755746841431, -0.05223966762423515, 0.050736721605062485, 0.010891778394579887, 0.057827118784189224, 0.10940733551979065, -0.046478815376758575, 0.025755569338798523, -0.03068012371659279, -0.05046148970723152, 0.008061205968260765, -0.022785605862736702, -0.06776454299688339, -0.09474499523639679, 0.06789327412843704, 0.0018446018220856786, 0.0447620190680027, 0.03713209182024002, 0.019959308207035065, -0.033693067729473114, 0.06621479988098145, -0.019975833594799042, 0.05422341078519821, 0.027725549414753914, 0.026298565790057182, -0.0666845515370369, 0.05379626154899597, -0.018192218616604805, -0.037499748170375824, 0.0774296298623085, -3.372928767930716e-05, -0.06845604628324509, -0.0074848211370408535, 0.02551214024424553, -0.056881729513406754, -0.020504599437117577, 0.024208122864365578, 0.02233007177710533, -0.016970951110124588, -0.04891452565789223, -0.029747487977147102, -0.017425283789634705, 0.04043569788336754, -0.014505760744214058, 0.06808248162269592, 0.00408928282558918, 0.03634369745850563, 0.032001953572034836, 0.045471884310245514, -0.01693195290863514, -0.029320495203137398, -0.014640895649790764, -0.013694239780306816, -0.04210357367992401, -0.013044619932770729, 0.015988942235708237, -0.013738362118601799, 0.011622702702879906, -0.03638983517885208, -0.10768217593431473, -0.04645564407110214, -0.015997981652617455, 0.027383193373680115, -0.030481120571494102, 0.03769524395465851, -0.04715501889586449, -0.009050102904438972, 0.012610048055648804, 0.0039226217195391655, 0.11597291380167007, 0.036765776574611664, -0.003539721015840769, 0.03129209950566292, 0.03357229381799698, 0.028607763350009918, 0.03927386552095413, -0.0054674167186021805, -0.0980474054813385, -0.055798258632421494, 0.06115460768342018, 0.04024064540863037, 0.024617601186037064, -0.042471081018447876, 0.04167195037007332, -0.011991653591394424, -0.05817457288503647, -0.0913216769695282, -0.047397587448358536, -0.05714421346783638, 9.20397162609275e-33, 0.11802588403224945, -0.05266239494085312, -0.03131461888551712, 0.03863093629479408, 0.17449568212032318, -0.061600811779499054, -0.014583728276193142, -0.030443480238318443, -0.13987953960895538, 0.019967807456851006, 0.011985257267951965, 0.043407801538705826, -0.09867764264345169, 0.16356658935546875, 0.00014433143951464444, -0.1480959951877594, -0.07902304828166962, 0.025521818548440933, 0.011129127815365791, -0.03965054079890251, -0.081944540143013, 0.0766715407371521, -0.014823953621089458, -0.02682841755449772, 0.020713701844215393, 0.11576137691736221, 0.038834478706121445, 0.06934640556573868, 0.018982376903295517, 0.004260202404111624, -0.08542279899120331, -0.0037015199195593596, -0.0014790213899686933, -0.03179096058011055, 0.012860034592449665, 0.01595161110162735, -0.011767225340008736, -0.009296927601099014, -0.061371684074401855, 0.004067628178745508, 0.03088795393705368, -0.029069209471344948, -0.051914431154727936, -0.030727030709385872, -0.07772913575172424, 0.015764819458127022, 0.07550492882728577, 0.05423843860626221, 0.03886964172124863, -0.009049278683960438, -0.02713828906416893, -0.030523737892508507, -0.07398569583892822, -0.08828809857368469, 0.04302460700273514, -0.031085185706615448, 0.019064119085669518, 0.03361482173204422, 0.12880100309848785, -0.005164724308997393, 0.010517214424908161, 0.05948929488658905, -0.016092386096715927, -0.013514683581888676, -0.04970419779419899, 0.04834562540054321, -0.001559566124342382, 0.019109537824988365, 0.04483392462134361, -0.06172318756580353, -0.03376087173819542, -0.031101670116186142, 0.05715174973011017, 0.003975242841988802, -0.047128282487392426, -0.015579970553517342, -0.030605528503656387, -0.010916581377387047, -0.07380758225917816, 0.0003167633549310267, -0.012796108610928059, 0.027605850249528885, -0.009334721602499485, 0.01658468134701252, 0.05922401696443558, 0.05190126597881317, -0.023670712485909462, -0.059112560003995895, -0.017384832724928856, 0.033164866268634796, -0.052014660090208054, -0.08293920755386353, 0.03650955855846405, -0.0433213971555233, -0.07161756604909897, -7.302388373762952e-33, 0.034160297363996506, -0.0038026648107916117, -0.025335976853966713, 0.08620324730873108, 0.10389689356088638, -0.0027566736098378897, 0.051500897854566574, -0.016299203038215637, -0.0003160857886541635, 0.04945201426744461, 0.03719204291701317, 0.06897513568401337, 0.015448296442627907, -0.021205883473157883, 0.005967854987829924, -0.029220346361398697, 0.030932392925024033, -0.036371711641550064, -0.10839094966650009, -0.02766917273402214, 0.013415657915174961, 0.07624829560518265, -0.02330181747674942, -0.04805886000394821, -0.056796640157699585, 0.0004958127392455935, 0.01759829930961132, 0.10098899155855179, -0.01954251155257225, -0.018562430515885353, 0.005013392306864262, 0.012259433977305889, -0.07020338624715805, -0.01631886325776577, -0.036394428461790085, 0.04414990171790123, 0.0633208304643631, -0.031968310475349426, 0.015224149450659752, -0.07614567130804062, -0.044991567730903625, -0.004633810371160507, -0.08228632062673569, 0.03467791527509689, -0.022305214777588844, 0.04358209669589996, -0.019134093075990677, -0.030778583139181137, 0.03710838407278061, 0.059497199952602386, 0.02229120209813118, -0.006621209438890219, -0.011066787876188755, -0.011954309418797493, -0.0363394170999527, -0.06226561218500137, -0.01577303186058998, 0.035445451736450195, 0.052355989813804626, 0.07656451314687729, -0.02844678983092308, -0.010479872114956379, -0.040940191596746445, -0.036344897001981735, 0.02879541739821434, 0.04959335923194885, -0.071537084877491, 0.1168508529663086, 0.04344144091010094, 0.018238963559269905, 0.034860216081142426, 0.03489864617586136, 0.10881298780441284, 0.08617152273654938, 0.03795008733868599, -0.022233596071600914, 0.025943122804164886, 0.03072705678641796, 0.0938987210392952, -0.046272099018096924, -0.011190343648195267, 0.035206589847803116, -0.016673732548952103, 0.05296662449836731, 0.0732317566871643, -0.0131132947281003, 0.021543540060520172, 0.06032510846853256, -0.006803255528211594, 0.008489570580422878, -0.1004217192530632, 0.02628319524228573, 0.015365607105195522, 0.13251012563705444, 0.008973591960966587, -5.730578322982183e-08, 0.003356339642778039, 0.03119727224111557, 0.0378163605928421, -0.022496428340673447, 0.012052885256707668, -0.013380331918597221, 0.026028629392385483, 0.006537329871207476, 0.002397889271378517, -0.003472805256024003, 0.04522622749209404, -0.0333227701485157, -0.04965602979063988, 0.05389874801039696, -0.03243647888302803, 0.008335987105965614, 0.03230636194348335, 0.087064728140831, 0.0037650084123015404, -0.08895894885063171, 0.03158852085471153, 0.0873776450753212, 0.06895744055509567, -0.003093691309913993, 0.05203907564282417, -0.013208791613578796, -0.09567497670650482, -0.024956542998552322, -0.06723033636808395, -0.024414654821157455, -0.0199167188256979, 0.006704401224851608, 0.03553611785173416, -0.10497990250587463, 0.03641616180539131, 0.08125524967908859, -0.12525959312915802, 0.051077455282211304, -0.0036074190866202116, -0.059813935309648514, 0.08641759306192398, -0.028261268511414528, 0.029259804636240005, 0.011869026347994804, -0.07618401944637299, 0.015733255073428154, -0.024998987093567848, -0.06160527095198631, 0.0034613674506545067, 0.14242075383663177, -0.000986643717624247, -0.04502830281853676, 0.028220418840646744, 0.018048366531729698, 0.07638745754957199, -0.027410555630922318, -0.03962722420692444, 0.029712848365306854, -0.00779700418934226, 0.027808889746665955, 0.049666810780763626, 0.08109083026647568, -0.03931171074509621, 0.0078116790391504765 ] }, { "text": "---\ntitle: \"LLM FewShot Learning\"\nid: \"fewshot\"\ncategory: \"genai\"\ntags: [\"llm\", \"fewshot\", \"zeroshot\", \"prompt\", \"medium\", \"video\"]\nrelated: [\"llm\"]\ndate: \"2023-07-24\"\ndescription: \"Explanation of Zero-Shot One-Shot and Few Shot on code\"\n---\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/llm-few-shot-learning-d7df1d2c4446) \n\nExplanation of Zero-Shot One-Shot and Few Shot on code.\n\nClick here to watch the video on [YouTube](https://youtu.be/byRgzRCRSvw)", "source": "2023-07-24-LLM_FewShot_Learning.md", "type": "markdown", "chunk_id": "2023-07-24-LLM_FewShot_Learning.md_0", "embedding": [ -0.007288854569196701, 0.054075732827186584, 0.006653393153101206, -0.02294427528977394, 0.1384284794330597, 0.021142322570085526, 0.04569801315665245, 0.010493199340999126, 0.016601640731096268, 0.005669672042131424, 0.07938503473997116, -0.028560813516378403, 0.033180080354213715, 0.009582488797605038, -0.011921453289687634, 0.030296241864562035, -0.013720597140491009, 0.007667112164199352, -0.010331841185688972, -0.018147043883800507, -0.049029022455215454, -0.07062812149524689, 0.10520479083061218, 0.04300853610038757, 0.016406644135713577, -0.0040571000427007675, -0.020024916157126427, 0.05604410544037819, 0.026867814362049103, -0.03389231488108635, 0.03471308574080467, 0.09237740188837051, -0.016196105629205704, 0.0726984366774559, -0.05430448055267334, 0.01601284369826317, 0.00712248869240284, 0.10203588008880615, -0.053279876708984375, 0.03978816419839859, 0.011406546458601952, 0.022715231403708458, 0.036199986934661865, 0.0021016220562160015, 0.013738134875893593, 0.07251795381307602, -0.06342252343893051, -0.11609338968992233, -0.05160060152411461, -0.04169454053044319, -0.1199059933423996, -0.06367501616477966, -0.07184314727783203, -0.005262445192784071, 0.015750069171190262, -0.0757870152592659, -0.02677534706890583, -0.057740744203329086, 0.0284138061106205, -0.05362028628587723, -0.005394758656620979, -0.10099153965711594, -0.06636835634708405, 0.021775519475340843, 0.0957738608121872, -0.003205876098945737, -0.013636020012199879, 0.021207479760050774, -0.02242119424045086, -0.05908346548676491, 0.0014699953608214855, 0.036877818405628204, -0.0541653111577034, 0.04945974797010422, -0.07211826741695404, -0.0242893286049366, -0.02898452989757061, 0.06302978843450546, -0.01288582757115364, -0.01877589337527752, 0.024691469967365265, -0.039034854620695114, -0.08071737736463547, -0.002238967688754201, -0.02393401600420475, 0.04059157893061638, 0.05232742428779602, -0.001525641418993473, 0.011256515979766846, 0.004818329121917486, -0.0862608253955841, 0.0025459739845246077, 0.0053096916526556015, 0.04426153004169464, -0.024394715204834938, 0.003752261633053422, -0.039693985134363174, -0.08620219677686691, -0.040999580174684525, 0.08002693951129913, 0.03764621913433075, 0.0016132009914144874, 0.04122747480869293, -0.008544309996068478, 0.0011956695234403014, 0.047701891511678696, 0.04762045294046402, 0.04579538851976395, 0.032514866441488266, -0.046720556914806366, 0.009567913599312305, 0.026466129347682, -0.01658274419605732, -0.00208089011721313, 0.010475397109985352, -0.01974075846374035, -0.01779235154390335, 0.0063469139859080315, 0.06947951763868332, -0.014326428063213825, 0.011928611434996128, -0.05590103939175606, -0.09619227051734924, -0.046201542019844055, -0.015010359697043896, -0.044779278337955475, 0.01845369301736355, 2.5526535737357696e-33, 0.1550356149673462, -0.016592903062701225, 0.004164448007941246, 0.04234073683619499, 0.11202748864889145, -0.01998302713036537, 0.04787075147032738, 0.0342562310397625, -0.0664273276925087, 0.00391555717214942, 0.010802770964801311, -0.048298753798007965, -0.0623742938041687, 0.03768642246723175, -0.014289040118455887, -0.06634104251861572, -0.028521109372377396, -0.042356278747320175, 0.09025858342647552, 0.07870661467313766, -0.03694041818380356, 0.022784318774938583, 0.00029604099108837545, -0.0667092353105545, 0.0049600680358707905, 0.10207603871822357, 0.03322606533765793, -0.04250757768750191, 0.018837125971913338, 0.049335576593875885, -0.09463862329721451, 0.07518251985311508, -0.026060136035084724, -0.04597288370132446, 0.08720508962869644, -0.003131220815703273, -0.07792748510837555, -0.020413702353835106, 0.017821945250034332, -0.03539251163601875, -0.029628651216626167, 0.05205030366778374, -0.07996614277362823, -0.11482614278793335, -0.030679358169436455, -0.03479460999369621, -0.05044819414615631, 0.08520852029323578, -0.05681241676211357, 0.04024629294872284, 0.03737541660666466, -0.007291125133633614, -0.059995781630277634, -0.07609216123819351, -0.06564317643642426, 0.03211303427815437, -0.06469237059354782, -0.03026888333261013, -0.061549995094537735, -0.02102520689368248, 0.06573852896690369, 0.062170181423425674, -0.04101036861538887, -0.002207415644079447, 0.03201157599687576, 0.060451775789260864, 0.02287250943481922, 0.04237399622797966, 0.10499662160873413, -0.029266079887747765, -0.022214526310563087, 0.007411465980112553, -0.05900818854570389, -0.08710888773202896, 0.06931941211223602, -0.018343523144721985, 0.07015909999608994, -0.06415989249944687, 0.040531665086746216, 0.05459493398666382, -0.022403893992304802, -0.0003026540216524154, -0.03203624114394188, 0.006860037799924612, -0.053578902035951614, -0.026088513433933258, 0.05025095492601395, -0.0570288747549057, -0.0667218342423439, -0.004044658504426479, -0.0444314144551754, -0.020457817241549492, -0.00693957693874836, 0.024976836517453194, -0.023876836523413658, -2.5430170914529193e-33, 0.0246435534209013, 0.018926924094557762, -0.0702555850148201, 0.09354175627231598, 0.04225245863199234, -0.01489851251244545, 0.06372150778770447, 0.12113308161497116, 0.05941515415906906, 0.06534439325332642, -0.012811172753572464, -0.03565113618969917, -0.1083868071436882, -0.01847313903272152, -0.006522313226014376, -0.0379600003361702, 0.027697911486029625, 0.014809365384280682, -0.054930053651332855, 0.024286458268761635, 0.058816488832235336, 0.07943985611200333, 0.04708026349544525, 0.04811708256602287, 0.006353349890559912, 0.08784773200750351, 0.08680401742458344, 0.08897394686937332, -0.017086731269955635, 0.00169090973213315, 0.04979541152715683, -0.03881949186325073, 0.0056532761082053185, -0.03750625252723694, -0.06903323531150818, 0.045151352882385254, 0.07125517725944519, 0.028582550585269928, 0.05179186910390854, 0.042712293565273285, 0.05582040175795555, -0.0013519931817427278, 0.02443467639386654, -0.02378120645880699, -0.026584813371300697, -0.027393873780965805, -0.04946976900100708, 0.059585053473711014, 0.02960211969912052, 0.025518428534269333, -0.059308990836143494, -0.018413852900266647, -0.07563874870538712, -0.012759621255099773, -0.05887240543961525, -0.11535535007715225, 0.07064884901046753, 0.01681656390428543, -0.004439263604581356, 0.04049001261591911, -0.02445090375840664, -0.03458605334162712, -0.08649060875177383, -0.011868934147059917, -0.016869205981492996, 0.023420309647917747, -0.05437075346708298, 0.012560306116938591, -0.08356226235628128, -0.02738284133374691, 0.07767697423696518, 0.007490884978324175, 0.004489637911319733, -0.10922504216432571, -0.026694469153881073, 0.0005657823057845235, -0.02250427007675171, 0.04746488481760025, 0.01607115939259529, -0.06466373056173325, 0.036537885665893555, -0.08555746078491211, -0.09486864507198334, 0.10390906035900116, 0.06237415224313736, 0.09022999554872513, 0.06860064715147018, 0.007683660835027695, 0.002195380162447691, -0.0025469744578003883, -0.011567282490432262, 0.08837491273880005, 0.05865831673145294, 0.025211937725543976, -0.007534786593168974, -4.7447841211578634e-08, -0.045987363904714584, -0.05380210652947426, -0.025482455268502235, 0.013875187374651432, 0.02500210516154766, 0.019323986023664474, -0.05583330988883972, 0.029134666547179222, 0.05854736268520355, -0.03989458829164505, 0.10666751116514206, 0.08688902854919434, -0.06037774682044983, 0.00558885931968689, -0.01279135700315237, 0.04446660727262497, -0.0733301192522049, 0.0290386863052845, -0.04853441193699837, 0.04329238459467888, 0.028064854443073273, -0.06655628979206085, 0.05717344582080841, -0.0705181285738945, -0.03463500738143921, -0.09136724472045898, 0.0006994837312959135, 0.04588700458407402, 0.039553266018629074, -0.09240654110908508, -0.017047442495822906, 0.030240999534726143, -0.00447456119582057, -0.04716765508055687, 0.015565790235996246, 0.03649221360683441, 0.012615741230547428, -0.0073583731427788734, 0.003974233288317919, -0.0472525879740715, -0.06484892219305038, -0.032502979040145874, 0.053607020527124405, 0.03552323579788208, -0.05875684693455696, 0.001533949514850974, 0.06043272092938423, -0.10513399541378021, -0.05479384958744049, 0.03697194159030914, -0.02043953165411949, -0.01301778294146061, -0.01586524024605751, 0.05412806570529938, 0.02564450353384018, 0.0393141470849514, 0.02023499272763729, -0.04650668054819107, 0.014758991077542305, 0.015115708112716675, 0.08638976514339447, 0.10488054156303406, -0.05707445740699768, 0.08430621773004532 ] }, { "text": "---\ntitle: \"Arduino Edge Impulse Set Up\"\nid: \"arduino-edgeimpulse\"\ncategory: \"edge-ml\"\ntags: [\"edge machine learning\", \"arduino\"]\nrelated: [\"arduinosensor\"]\ndate: \"2021-11-22\"\ndescription: \"Set Arduino Tiny ML Kit up in Edge Impulse\"\n---\n\nI've bought Arduino Tiny Machine Learning Kit for my tiny machine learning projects. As a start, I'm taking the lecture: Introduction to Embedded Machine Learning from Coursera. To set the device up to Edge impulse you need to install Edge Impulse CLI and Arduino CLI. \nHere you can find some tips so that you don't deal with errors during the installation: \nRemember that those tips are valid for Windows OS. \n\n### 1. Sign up to edge impulse and create a project.", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_0", "embedding": [ -0.02498416043817997, -0.04383239150047302, -0.0046758586540818214, 0.010074300691485405, 0.003854794194921851, -0.05222013592720032, -0.021837275475263596, -0.01676403544843197, -0.18377076089382172, -0.028210923075675964, 0.077022984623909, -0.07378901541233063, -0.04531211778521538, 0.0035042373929172754, -0.07851697504520416, 0.08950497210025787, 0.05226469039916992, -0.012199008837342262, 0.00073574751149863, 0.006731370463967323, 0.022312773391604424, -0.044677428901195526, -0.042796503752470016, -0.03627178072929382, -0.007514486089348793, 0.03412451595067978, 0.018298588693141937, 0.06214511767029762, 0.02471103146672249, -0.03580635040998459, 0.0954970270395279, -0.02929055318236351, 0.08577191829681396, 0.019917704164981842, 0.08170150220394135, 0.023731902241706848, 0.031184863299131393, 0.004862972069531679, 0.03300485759973526, -0.043468549847602844, 0.04149959608912468, -0.028432536870241165, -0.027918435633182526, -0.06191142648458481, 0.04576735198497772, -0.022131452336907387, 0.0491718053817749, -0.07729701697826385, 0.0018425488378852606, -0.006126367021352053, -0.024984033778309822, -0.048557814210653305, -0.03511139377951622, -0.03536904603242874, -0.07196127623319626, -0.040489520877599716, -0.015149283222854137, 0.08200625330209732, 0.059431977570056915, 0.029471339657902718, -0.01146092638373375, -0.07822763919830322, -0.006292046047747135, -0.005902214907109737, -0.06190186366438866, 0.034887634217739105, 0.03805403783917427, 0.03123699687421322, -0.027588946744799614, -0.04395349323749542, 0.06467780470848083, 0.03185674175620079, -0.07616116106510162, 0.09533809125423431, 0.0103782182559371, -0.025962457060813904, 0.03967340663075447, 0.0020298005547374487, -0.04905225336551666, 0.017843853682279587, -0.08955097943544388, -0.05751802399754524, -0.09085918217897415, 0.04721066728234291, 0.060157764703035355, 0.06547759473323822, -0.03763895854353905, 0.03484372794628143, -0.04555631801486015, -0.03599850460886955, 0.03396889194846153, -0.04919150471687317, -0.037387602031230927, 0.0008093798533082008, 0.12028122693300247, 0.031189776957035065, -0.018242569640278816, -0.11358605325222015, -0.10050360858440399, 0.01981636881828308, -0.0888293907046318, -0.09759819507598877, -0.03699222952127457, 0.03921050205826759, 0.0033546483609825373, -0.008322021923959255, 0.026945531368255615, -0.005304796155542135, 0.08104190975427628, -0.03330809250473976, 0.007368168793618679, 0.02469620481133461, -0.028511110693216324, 0.005555717274546623, -0.013165105134248734, -0.03827391937375069, -0.024373402819037437, -0.04881979897618294, 0.06354283541440964, -0.02405351959168911, -0.08699683845043182, 0.044302526861429214, -0.10286872833967209, -0.05690157413482666, 0.03859300911426544, -0.02414577268064022, -0.06933615356683731, 4.775166252965238e-33, 0.05543515831232071, 0.03875736892223358, -0.04561774432659149, -0.028869232162833214, 0.06276293843984604, -0.046506963670253754, 0.02637552097439766, -0.024052530527114868, -0.019895454868674278, 0.02787056937813759, -0.04525690898299217, -0.1041143536567688, -0.03215479850769043, 0.05781283229589462, -0.00123104068916291, -0.06136692315340042, 0.024211321026086807, -0.07093310356140137, 0.031794872134923935, -0.028356194496154785, 0.0161752849817276, -0.02071632444858551, -0.04562060162425041, 0.02045104093849659, -0.05034687742590904, 0.11099185794591904, 0.061437610536813736, 0.026709502562880516, 0.14556074142456055, 0.046360310167074203, -0.08902081847190857, 0.0606023408472538, -0.0024713766761124134, -0.032183628529310226, 0.028509849682450294, 0.0755339041352272, -0.019752485677599907, 0.0305892676115036, -0.015675481408834457, -0.041046008467674255, 0.03460715711116791, 0.051372312009334564, 0.004661554004997015, -0.08868321031332016, 0.0007886382518336177, -0.0805797427892685, 0.07789456099271774, -0.039062127470970154, 0.03767115995287895, 0.043718378990888596, -0.06519463658332825, -0.04678870737552643, 0.07745344936847687, 0.006472141947597265, -0.0002657460863701999, -0.014060622081160545, -0.026349863037467003, 0.07999958097934723, 0.04585125297307968, -0.02713596448302269, 0.08506978303194046, -0.06158104166388512, 0.0024424914736300707, 0.07419280707836151, 0.04805151745676994, 0.02339911088347435, 0.011624769307672977, 0.04980224370956421, 0.019909551367163658, -0.01508761290460825, -0.02789485454559326, 0.026979411020874977, -0.013600672595202923, -0.019216906279325485, 0.025208547711372375, -0.03255736455321312, 0.015515757724642754, 0.02854139544069767, -0.01071939617395401, -0.022170759737491608, -0.017253665253520012, 0.039412930607795715, 0.06558959186077118, -0.08504672348499298, 0.030275333672761917, 0.008699576370418072, -0.004674395080655813, -0.024383308365941048, -0.060510408133268356, 0.031947020441293716, -0.022096052765846252, 0.025805622339248657, -0.02625400759279728, 0.09354986250400543, -0.07346441596746445, -5.123600043622242e-33, 0.011128658428788185, 0.03789116442203522, 0.07368310540914536, 0.07507181167602539, -0.03543606773018837, 0.06035347655415535, 0.032440103590488434, 0.010823861695826054, -0.042045362293720245, -0.006914734374731779, -0.05890654772520065, 0.011521095409989357, 0.026442041620612144, -0.0050133392214775085, -0.023606736212968826, 0.03585919365286827, -0.008747714571654797, -0.052871912717819214, 0.051976993680000305, -0.010676156729459763, -0.016277743503451347, 0.050346143543720245, -0.008017189800739288, 0.004712812602519989, -0.005011847708374262, -0.03890664130449295, -0.0001844584767241031, 0.06918925046920776, 0.014421130530536175, -0.02699967660009861, 0.017303474247455597, 0.021460456773638725, -0.0725078135728836, -0.057090792804956436, 0.03514230623841286, 0.03319970518350601, 0.031097693368792534, -0.04733199626207352, 9.94721194729209e-05, -0.033278632909059525, 0.02303236909210682, -0.01242249459028244, -0.11072825640439987, -0.07206064462661743, 0.046864308416843414, 0.04549416899681091, 0.004347637295722961, 0.017130453139543533, -0.10639188438653946, -0.02025141753256321, -0.05224134027957916, 0.06948615610599518, -0.015238958410918713, -0.022148508578538895, -0.0053072962909936905, -0.02784217894077301, 0.10960885137319565, 0.0799219086766243, -0.0015583732165396214, -0.0053191641345620155, -0.07764176279306412, -0.09430521726608276, -0.01566833257675171, -0.06383594125509262, -0.01699455827474594, 0.0828218013048172, 0.027227146551012993, -0.0055937436409294605, -0.07572675496339798, 0.026805205270648003, -0.049833763390779495, 0.08314516395330429, 0.048768509179353714, -0.06357000023126602, -0.03840732201933861, -0.023528823629021645, -0.09057095646858215, -0.003126261755824089, 0.04279354214668274, 0.005077008623629808, 0.014177133329212666, -0.005470767617225647, -0.08175516128540039, 0.07560599595308304, -0.014366009272634983, 0.01867440715432167, 0.04725872352719307, -0.007655557710677385, -0.03955572098493576, -0.005160905420780182, -0.0944206565618515, 0.03245435655117035, 0.07961484789848328, 0.08863382786512375, -0.1020207405090332, -4.737617587124987e-08, -0.030721411108970642, 0.07249202579259872, -0.013546982780098915, 0.02525026723742485, 0.020811857655644417, 0.04526308923959732, -0.027475079521536827, 0.030569477006793022, 0.02139688841998577, -0.03559591993689537, 0.03282679617404938, -0.045874547213315964, -0.045978061854839325, 0.08088315278291702, 0.015578074380755424, 0.05672873556613922, -0.0188547745347023, 0.01156193669885397, 0.06615538150072098, -0.013017883524298668, 0.09486638009548187, 0.005556559190154076, 0.055854085832834244, 0.02734837308526039, 0.05420165881514549, -0.11849278956651688, 0.001763150212354958, 0.03287703916430473, -0.006318349856883287, -0.04359894618391991, -0.09105074405670166, 0.03999754786491394, 0.10176306217908859, 0.021266231313347816, -0.008300499990582466, 0.048059605062007904, -0.007494688965380192, 0.04643034189939499, 0.058990590274333954, -0.0008778900373727083, 0.06422426551580429, 0.07907047122716904, -0.06094251200556755, -0.09854627400636673, -0.08228867501020432, 0.024652043357491493, 0.029367458075284958, -0.028301555663347244, -0.03840363398194313, 0.019056696444749832, 0.09186793863773346, 0.033320117741823196, 0.021438196301460266, 0.04105350002646446, 0.10944512486457825, 0.016659192740917206, 0.050588611513376236, -0.11145691573619843, 0.05066157504916191, 0.056166570633649826, 0.04786306992173195, 0.007267654873430729, -0.10091511905193329, 0.07121232897043228 ] }, { "text": "### 2. Install Edge Impulse CLI: \n\n- [https://docs.edgeimpulse.com/docs/cli-installation](https://docs.edgeimpulse.com/docs/cli-installation)\n- Make sure that you **download Visual Studio Community (using the \"Desktop development with C++\" workload).** \n- Download the latest version of python. \n- Install node.js from: https://nodejs.org/en/\n- **Install the additional tools when installing NodeJS.** \n\n
\n \n
Figure 1: Node.js download
\n
", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_1", "embedding": [ -0.02624168060719967, -0.04095274582505226, 0.018291108310222626, 0.06420212984085083, 0.09811694175004959, -0.007219240069389343, -0.10101894289255142, 0.07170066237449646, -0.05793728679418564, 0.0652695968747139, 0.04572204127907753, -0.03528427332639694, -0.032925017178058624, 0.03922509774565697, 0.08734505623579025, 0.08459071069955826, -0.05296896770596504, 0.005390206351876259, 0.08329455554485321, -0.015533971600234509, -0.020020421594381332, -0.11602982133626938, -0.013978350907564163, -0.07116765528917313, 0.035704828798770905, 0.012760504148900509, -0.05498139560222626, 0.06905896961688995, -0.012552921660244465, -0.048418305814266205, 0.009432142600417137, -0.04225180298089981, 0.035213299095630646, 0.016106363385915756, 0.03722545877099037, 0.11702640354633331, 0.028320617973804474, -0.08435559272766113, -0.021259484812617302, -0.016423145309090614, 0.0018319907831028104, 0.018664825707674026, -0.002462389413267374, -0.1514245569705963, 0.06150834262371063, -0.005679963156580925, 0.007456757593899965, -0.019836198538541794, -0.004066106863319874, 0.0029429723508656025, -0.02372976951301098, -0.02173536643385887, 0.0034381786826997995, -0.07173467427492142, 0.01560456957668066, -0.0001552407629787922, 0.07956013828516006, -0.056790485978126526, 0.12157655507326126, 0.044962409883737564, -0.010999557562172413, -0.030538717284798622, 0.08480998128652573, -0.061474017798900604, -0.018923193216323853, 0.06656073033809662, -0.055239949375391006, 0.01872057281434536, -0.0014688733499497175, -0.02355211041867733, 0.026814281940460205, -0.016642766073346138, -0.07540819048881531, 0.04438488930463791, -0.06661521643400192, -0.10099251568317413, 0.016032151877880096, -0.016064703464508057, -0.05132035166025162, 0.09042318910360336, -0.05687776207923889, -0.05106572061777115, -0.042356301099061966, 0.09457891434431076, 0.03532989323139191, 0.08847498148679733, 0.016383029520511627, -0.011361949145793915, -0.055385664105415344, -0.01183199230581522, -0.04186318442225456, -0.020483754575252533, -0.08641254901885986, 0.05850540101528168, 0.04851319268345833, -0.011384264566004276, -0.019462965428829193, -0.03666643053293228, -0.10589795559644699, -0.006956428289413452, -0.006631744094192982, -0.156370609998703, 0.04230351746082306, -0.021464884281158447, 0.04008923098444939, 0.030268486589193344, 0.09404879063367844, 0.001575544010847807, 0.01054308470338583, 0.011615054681897163, 0.01845509186387062, 0.04236703738570213, -0.10944808274507523, -0.03166850656270981, -0.060835037380456924, 0.032343216240406036, -2.142902849300299e-05, -0.0158899687230587, 0.06699001044034958, 0.034605834633111954, 0.07535333931446075, 0.10808133333921432, -0.03343471139669418, 0.027950221672654152, 0.08862587809562683, -0.0680849626660347, -0.0005636795540340245, 6.383781415581582e-33, 0.02850894257426262, -0.018925048410892487, -0.026976048946380615, 0.03642938286066055, 0.11565978080034256, -0.022548669949173927, -0.005390757229179144, -0.09287195652723312, -0.1171831339597702, -0.06724761426448822, -0.043195728212594986, 0.0064660124480724335, -0.010679210536181927, 0.0619245320558548, 0.0027356331702321768, -0.10137981921434402, 0.06128883361816406, -0.02579212561249733, 0.054228417575359344, -0.005572977010160685, -0.02910236455500126, -0.03929651528596878, -0.03078889660537243, 0.09208516776561737, -0.07515914738178253, 0.06374356150627136, 0.03561370447278023, 0.04819338023662567, 0.0997600182890892, -0.0014433846808969975, -0.017614202573895454, 0.08575321733951569, 0.0763327106833458, 0.04675505310297012, -0.02517028898000717, 5.6808494264259934e-05, -0.011763812974095345, 0.018331026658415794, -0.05232693627476692, 0.009707685559988022, -0.012430456466972828, 0.11758051812648773, -0.04345773905515671, -0.05002197250723839, -0.05156513676047325, -0.039437126368284225, -0.0029877705965191126, 0.0020212680101394653, 0.06302037835121155, 0.02950209379196167, -0.057258229702711105, -0.03452087566256523, 0.02019328810274601, 0.02625027298927307, 0.005290827248245478, -0.043547000735998154, -0.057363517582416534, -0.019879812374711037, 0.00802958756685257, -0.0625482052564621, 0.19063784182071686, 0.0052182311192154884, -0.0009396256064064801, -0.022472679615020752, 0.055850233882665634, 0.08147730678319931, 0.00027228292310610414, 0.032366782426834106, -0.009012154303491116, 0.009188628755509853, -0.06164093315601349, 0.017430700361728668, 0.05951197072863579, 0.00880451500415802, 0.04260052740573883, 0.001700547756627202, -0.01943177357316017, 0.05043474957346916, -0.029861634597182274, 0.04395925626158714, -0.03529907017946243, -0.018181603401899338, 0.024888966232538223, -0.08635182678699493, 0.039735209196805954, 0.005879602394998074, 0.02889821119606495, 0.08421651273965836, -0.0014614848187193274, -0.03762839734554291, 0.06266681104898453, -0.01429878268390894, -0.03322901949286461, 0.032480958849191666, -0.14117531478405, -5.119027370597543e-33, -0.03899726644158363, 0.08349867165088654, 0.02294609695672989, 0.054891228675842285, -0.031742554157972336, 0.03419137001037598, -0.006863167509436607, -0.10960469394922256, 0.006585677154362202, 0.0009830632479861379, -0.007291367277503014, -0.005909059662371874, -0.03143002465367317, -0.01749408431351185, -0.03322652727365494, 0.0060263508930802345, 0.025888947769999504, -0.00817172508686781, 0.007234056945890188, -0.00882721971720457, -0.047459330409765244, 0.019119376316666603, 0.00025617433129809797, -0.04885393753647804, -0.04601040482521057, 0.027093570679426193, 0.003963255323469639, 0.008129226975142956, -0.034182555973529816, -0.07869017869234085, -0.019534612074494362, 0.0341058187186718, -0.07577630132436752, -0.00017641368322074413, 0.07256751507520676, -0.004046376794576645, -0.012077405117452145, -0.029595449566841125, 0.010621749795973301, -0.04270542412996292, 0.04157140105962753, -0.05560028925538063, -0.0732065811753273, -0.05891282856464386, 0.03603620082139969, 0.019946353510022163, -0.007137354929000139, 0.05078311637043953, -0.051333021372556686, -0.029691001400351524, -0.05003020912408829, -0.027677329257130623, 0.06371620297431946, -0.030514413490891457, -0.008477173745632172, -0.05343004688620567, 0.0390072837471962, 0.1139422059059143, 0.020820477977395058, 0.01786300539970398, -0.025295879691839218, -0.06981737166643143, -0.07716794312000275, -0.0100733432918787, -0.03512943908572197, 0.08905843645334244, -0.10893864929676056, -0.04896429181098938, -0.0038301541935652494, -0.011724721640348434, -0.048479072749614716, 0.10232958942651749, 0.07304315268993378, -0.024338249117136, -0.017829064279794693, 0.02880033478140831, -0.0343153290450573, 0.06388626992702484, 0.027446581050753593, -0.034665629267692566, -0.011963244527578354, 0.06310681998729706, -0.051806312054395676, -0.0020551264751702547, -0.07230564951896667, 0.034411005675792694, -0.007563160266727209, -0.00012821328709833324, 0.026975857093930244, -0.05274266004562378, -0.09192881733179092, 0.008046959526836872, 0.0607982836663723, 0.05389842391014099, 0.0035606450401246548, -5.682239745397055e-08, -0.0008980506681837142, 0.03534543514251709, -0.06154259294271469, -0.03962203860282898, 0.011807870119810104, 0.05888316035270691, 0.06293249130249023, 0.01776840351521969, 0.061850979924201965, 0.052058372646570206, 0.0326630063354969, 0.01866772212088108, -0.009234051220119, 0.009150736965239048, -0.009958635084331036, 0.07413849979639053, -0.019245846197009087, 0.09123824536800385, 0.09759175777435303, 0.025444570928812027, 0.01920468546450138, -0.03404739126563072, 0.026436569169163704, 0.04300528019666672, -0.06279085576534271, -0.044907256960868835, 0.001311926287598908, 0.017227867618203163, -0.04166232794523239, -0.03478015214204788, 0.004926313646137714, 0.021603230386972427, 0.05619717761874199, -0.016605349257588387, -0.002796322340145707, -0.041665565222501755, -0.10380571335554123, 0.006677343510091305, 0.028068045154213905, 0.062226101756095886, 0.03235188499093056, 0.08284080028533936, -0.025371385738253593, -0.049797892570495605, -0.05729244276881218, 0.008246044628322124, 0.032128822058439255, -0.00854461919516325, -0.03112790919840336, 0.07029008865356445, 0.062213458120822906, -0.023390263319015503, -0.02267269417643547, 0.009521487168967724, 0.02467273734509945, -0.006827552802860737, 0.04349219799041748, -0.06469505280256271, -0.015089948661625385, 0.049711260944604874, 0.05348942428827286, -0.05311168357729912, -0.02749750204384327, 0.033360544592142105 ] }, { "text": "- Check this website for additional configurations: [https://github.com/nodejs/node-gyp#on-windows](https://github.com/nodejs/node-gyp#on-windows)\n \n- Set msvs version\n \n `$npm config set msvs_version 2017`\n\n- If you have multiple Python versions installed, **you need to identify which Python version node-gyp should use**: \n [https://github.com/nodejs/node-gyp#on-windows]\n\n `$npm config set python /path/to/executable/python`\n\n- Additional info can be found here: [https://github.com/Microsoft/nodejs-guidelines](https://github.com/Microsoft/nodejs-guidelines/blob/master/windows-environment.md#compiling-native-addon-modules)\n- Install CLI tools via: \n \n `$npm install -g edge-impulse-cli --force`", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_2", "embedding": [ -0.030611947178840637, -0.02058766968548298, -0.015351702459156513, 0.04673343524336815, 0.06679211556911469, -0.026736373081803322, -0.08414898067712784, 0.02535037137567997, -0.056520745158195496, 0.04296482354402542, -0.045750848948955536, -0.010213195346295834, -0.041261330246925354, 0.0873573049902916, 0.04202353581786156, 0.07435201108455658, 0.01305983867496252, 0.06183534488081932, 0.05215942859649658, 0.015482403337955475, -0.002067318418994546, -0.012374131008982658, 0.058043256402015686, -0.0567750483751297, -0.03297044709324837, -0.1055777296423912, -0.06613832712173462, 0.0822480171918869, 0.03265474736690521, 0.026152275502681732, -0.0015942075988277793, -0.01529687363654375, 0.028654443100094795, 0.044710829854011536, 0.03329797461628914, 0.1062292829155922, 0.034121982753276825, -0.017138304188847542, -0.06265868991613388, -0.07113891839981079, 0.08952678740024567, 0.076207734644413, -0.07199426740407944, -0.07464554905891418, 0.00521896593272686, -0.0038334536366164684, -0.013036559335887432, -0.014247097074985504, -0.046572234481573105, 0.006936193443834782, -0.009544444270431995, -0.06677131354808807, -0.07693656533956528, -0.09895750880241394, -0.09111421555280685, -0.02691822685301304, -0.013013678602874279, 0.06521453708410263, 0.08433814346790314, 0.02567094750702381, -0.011449513025581837, -0.02360663004219532, 0.02420564368367195, -0.052055489271879196, -0.025472667068243027, 0.09515175223350525, 0.005308669526129961, -0.013351654633879662, 0.027619987726211548, 0.0033939899876713753, 0.007067697122693062, -0.07548972964286804, -0.10676581412553787, -0.03239123523235321, -0.10895432531833649, 0.0038365523796528578, 0.032666463404893875, 0.019021082669496536, -0.07477062195539474, 0.059609461575746536, -0.022449810057878494, -0.011565586552023888, -0.042878877371549606, 0.06651925295591354, -0.06418982148170471, 0.019136182963848114, -0.054310284554958344, 0.03637916222214699, 0.014308799989521503, 0.023531626909971237, -0.016597583889961243, -0.0822877362370491, -0.09280366450548172, 0.0427817702293396, 0.05798761919140816, 0.03420111536979675, -0.0016698939725756645, 0.00938800536096096, 0.0010776948183774948, -0.033663567155599594, -0.059536587446928024, -0.12954987585544586, 0.027533283457159996, 0.030320383608341217, 0.06743066757917404, 0.06048488989472389, 0.08903171867132187, -0.02267722226679325, 0.042831145226955414, -0.05993872135877609, 0.03265432268381119, 0.06992124766111374, -0.010143459774553776, -0.04571855440735817, -0.04461538791656494, 0.011549538001418114, -0.00434141093865037, 0.06319229304790497, 0.0046636988408863544, 0.07212244719266891, 0.01039328332990408, 0.026515446603298187, -0.005676375236362219, -0.06401609629392624, -0.007625949569046497, 0.0010827959049493074, 0.0505351684987545, 3.213065034468947e-33, 0.021237274631857872, -0.07834860682487488, 0.10442283004522324, 0.019788207486271858, 0.14460542798042297, -0.006044852547347546, 0.055708277970552444, -0.10071691870689392, -0.053065236657857895, -0.04885230213403702, -0.061337340623140335, -0.03512777388095856, 0.006956744473427534, -0.04640704765915871, -0.04482506960630417, -0.042165204882621765, 0.026932163164019585, -0.060197871178388596, 0.06097037345170975, 0.009656131267547607, 0.03295009210705757, 0.004163078498095274, -0.007755659986287355, 0.03238538280129433, 0.01220789272338152, -0.05596701055765152, 0.015297645702958107, -0.004207928199321032, 0.10730885714292526, -0.023044539615511894, -0.03630126640200615, 0.05689859390258789, 0.005003165453672409, 0.06062754616141319, -0.02529292181134224, 0.01570690982043743, -0.04475295916199684, -0.0073972358368337154, -0.004343220964074135, -0.024926472455263138, 0.031027186661958694, 0.08859087526798248, 0.06378857791423798, -0.02782215178012848, 0.00075312185799703, -0.05051221698522568, -0.04783862829208374, -0.05452153831720352, 0.048235729336738586, 0.056885313242673874, -0.03594091162085533, 0.017237471416592598, -0.06323464214801788, 0.0007026717066764832, -0.06379079818725586, -0.046053532510995865, 0.03971106559038162, 0.005797273013740778, -0.017144396901130676, -0.09362036734819412, 0.07348308712244034, -0.009970083832740784, 0.01788383536040783, -0.03559158742427826, 0.06484366208314896, 0.0077982572838664055, -0.05329471454024315, -0.005449484568089247, -0.05809355899691582, 0.09298524260520935, -0.04427908733487129, 0.03387722373008728, 0.015282091684639454, 0.03391992300748825, -0.020120220258831978, -0.0029170853085815907, 0.005885783117264509, -0.034980494529008865, 0.053484782576560974, 0.02804872766137123, -0.040063098073005676, 0.07123643904924393, -0.03145396709442139, -0.04968149587512016, 0.025979161262512207, -0.051610641181468964, -0.05406813323497772, 0.04201474040746689, 0.08402717113494873, -0.01965850219130516, 0.05685723200440407, -0.017570920288562775, 0.03890960291028023, 0.03382756561040878, -0.13701345026493073, -5.0411449923838124e-33, -0.0004823468334507197, 0.03819708153605461, 0.05442492663860321, 0.10516536980867386, -0.04926256090402603, -0.029501507058739662, -0.07816291600465775, -0.06667763739824295, 0.007141384296119213, 0.03007870353758335, -0.009862245060503483, -0.0002993927919305861, 0.08728460222482681, 0.07937271893024445, -0.0033909243065863848, 0.06865669041872025, -0.04643731191754341, 0.09231020510196686, 0.040730226784944534, -0.003125287825241685, -0.018718667328357697, 0.04156430438160896, 0.04313414916396141, 0.012296134606003761, 0.05379321053624153, -0.09653269499540329, -0.000784245494287461, 0.0031378408893942833, -0.0043699415400624275, -0.05522675812244415, -0.02093510329723358, 0.09199033677577972, -0.09197147190570831, -0.04075555503368378, 0.0578015111386776, -0.035397157073020935, 0.017642926424741745, -0.00386932329274714, 0.07984448969364166, 0.0021940800361335278, 0.07670995593070984, -0.05050434172153473, -0.07374430447816849, -0.0034678890369832516, 0.08216620981693268, 0.06255033612251282, 0.009557361714541912, 0.07115207612514496, -0.03854259476065636, -0.03762843459844589, -0.04999146610498428, 0.028250113129615784, 0.00602185633033514, 0.0174909308552742, 0.007446249481290579, -0.03728093206882477, 0.026931922882795334, 0.08714376389980316, -0.05386871472001076, -0.037500202655792236, 0.021684769541025162, -0.060702305287122726, -0.08381277322769165, -0.06159476190805435, -0.029454775154590607, 0.1203777939081192, -0.10959844291210175, -0.005715755745768547, -0.023881858214735985, -0.04225480929017067, -0.06825000047683716, -0.0019366329070180655, 0.01416640542447567, -0.00531682139262557, -0.05854805186390877, -0.025394825264811516, 0.005076012574136257, -0.1120343878865242, -0.015127580612897873, 0.03968781977891922, 0.025574078783392906, 0.09708959609270096, -0.03052348829805851, 0.013410055078566074, -0.05552511289715767, 0.014059283770620823, -0.03712260723114014, 0.022290442138910294, -0.0014125354355201125, 0.0391341969370842, -0.060811929404735565, -0.060018301010131836, 0.015719246119260788, 0.01625240407884121, 0.008646177127957344, -4.402228270805608e-08, -0.0010132838506251574, 0.06072283908724785, -0.09546570479869843, -0.013850172981619835, 0.029630618169903755, 0.06537263840436935, 0.01219191588461399, -0.011442047543823719, 0.0515274740755558, 0.04037622734904289, 0.043349090963602066, -0.06584248691797256, -0.015765780583024025, -0.032513223588466644, -0.028804179280996323, 0.07605671882629395, -0.07774952054023743, 0.08390592038631439, 0.0679575651884079, -0.005046631209552288, 0.026091163977980614, -0.02463577315211296, -0.021441491320729256, 0.11696598678827286, -0.0634366050362587, -0.04529980197548866, 0.046073418110609055, 0.022376680746674538, -0.07139690965414047, -0.003914941567927599, -0.04143000394105911, -0.018223177641630173, 0.0371098555624485, 0.036498114466667175, -0.048027291893959045, -0.03551281988620758, -0.03911745920777321, 0.041924331337213516, 0.12276507914066315, 0.028613505885004997, 0.025617161765694618, 0.05434801056981087, -0.04353850707411766, -0.01598287746310234, -0.04714875668287277, 0.008135299198329449, -0.015070701949298382, 0.04024288058280945, -0.06188739091157913, -0.006153550930321217, 0.07754232734441757, -0.02417895756661892, -0.022368667647242546, 0.06898238509893417, 0.06110961735248566, 0.06470946222543716, -0.03365582227706909, -0.0824260488152504, 0.0016226795269176364, -0.04737265780568123, -0.0417155884206295, -0.001365920645184815, 0.04537760466337204, -0.06049705669283867 ] }, { "text": "(Note that before python config and downloading visual studio community, I got plenty of errors during installation of CLI tools. )", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_3", "embedding": [ -0.028391344472765923, -0.06470555812120438, 0.005788975860923529, -0.007876671850681305, 0.01252815779298544, -0.0797804668545723, -0.0422561913728714, -0.04623512178659439, -0.05716612562537193, -0.020786108449101448, -0.0052662803791463375, -0.07822772115468979, 0.016418345272541046, 0.06837480515241623, 0.06882277131080627, 0.05860394984483719, -0.002868050243705511, -0.0370684489607811, 0.06565139442682266, 0.08180385828018188, 0.0012073909165337682, 0.0789383053779602, -0.04165182635188103, 0.008737269788980484, -0.016833674162626266, -0.05618584156036377, -0.05341792479157448, 0.017857661470770836, 0.016527486965060234, 0.07990844547748566, -0.07572120428085327, 0.08852320909500122, -0.0006525171338580549, -0.03759264573454857, 0.1250160187482834, 0.06761161237955093, 0.06877019256353378, -0.04924102500081062, 0.006783385295420885, 0.011547369882464409, 0.026009250432252884, 0.04864579439163208, -0.042035698890686035, -0.10723323374986649, -0.0317230224609375, -0.031822558492422104, 0.02440652810037136, -0.05657561123371124, -0.0003276107890997082, -0.002464523073285818, -0.038895346224308014, 0.007625300902873278, -0.018217647448182106, -0.060267142951488495, 0.06567469984292984, 0.008986512199044228, 0.018942944705486298, -0.016682060435414314, 0.015455369837582111, -0.03650177642703056, 0.020177947357296944, -0.011886772699654102, -0.010974510572850704, 0.05242706090211868, -0.06731954216957092, 0.05716903880238533, 0.0176931694149971, -0.014465412124991417, 0.02907336689531803, -0.07846414297819138, -0.10082980990409851, -0.010996791534125805, -0.09074249863624573, -0.01592838019132614, 0.0283164344727993, 0.019994813948869705, 0.02303469367325306, -0.017744597047567368, 0.025753192603588104, -0.0444270484149456, -0.06733758002519608, 0.026524115353822708, -0.03294204920530319, 0.07796172052621841, 0.03434136509895325, -0.015707608312368393, 0.04588842764496803, -0.014987326227128506, 0.051267169415950775, 0.030541053041815758, 0.014060256071388721, -0.050031039863824844, 0.016372086480259895, 0.01362296286970377, 0.052008241415023804, 0.030673380941152573, 0.012810055166482925, 0.008828272111713886, -0.00197787769138813, -0.009417114779353142, -0.07617949694395065, -0.10862293094396591, 0.05090750753879547, 0.012866835109889507, 0.006645758170634508, 0.04944237321615219, 0.12247701734304428, -0.052592307329177856, -0.05892636254429817, -0.02302997000515461, -0.011198988184332848, -0.058442242443561554, 0.06007472053170204, -0.07008083164691925, 0.07120227813720703, 0.08373808115720749, -0.015501384623348713, 0.07926108688116074, 0.020929163321852684, 0.013607047498226166, -0.034195154905319214, 0.0038318829610943794, -0.0437009371817112, -0.016713043674826622, 0.031087113544344902, 0.03942025452852249, 0.010398341342806816, 8.333559752624102e-34, 0.007293424103409052, -0.007472904399037361, 0.019911671057343483, 0.09845772385597229, 0.05815225467085838, -0.019411545246839523, -0.0323004275560379, -0.03994372859597206, -0.05811712145805359, -0.04602569714188576, 0.02657289244234562, -0.02057194709777832, 0.007179994601756334, 0.0621766671538353, 0.014778206124901772, -0.07243291288614273, 0.0343141108751297, 0.060721833258867264, -0.008050655014812946, -0.025283895432949066, 0.016951963305473328, -0.07227279990911484, 0.06959965080022812, -0.05170973390340805, -0.0009585525840520859, -0.026390692219138145, 0.024549972265958786, 0.02776201069355011, 0.08373063802719116, -0.01617785543203354, -0.062395334243774414, 0.015551835298538208, 0.05554162338376045, 0.03433693200349808, -0.0195902232080698, 0.033483777195215225, 0.027882901951670647, -0.01966344751417637, -0.044193606823682785, 0.0853537991642952, -0.06630851328372955, 0.10416169464588165, -0.05270104855298996, -0.08283068239688873, 0.036450356245040894, -0.029225097969174385, -0.0053090304136276245, -0.008841712027788162, 0.059359483420848846, 0.0479043647646904, -0.07050788402557373, -0.012371447868645191, -0.006636227015405893, 0.09833663702011108, -0.00564119266346097, -0.04695375636219978, 0.07040425390005112, -0.0028135620523244143, 0.008988662622869015, -0.05303788557648659, 0.027409622445702553, 0.09060247242450714, 0.06520833820104599, -0.02815949358046055, 0.10077281296253204, -0.02067352831363678, 0.03369641304016113, 0.07365237176418304, 0.05007728561758995, -0.01439545676112175, 0.0029655410908162594, 0.03107488714158535, -0.04061084985733032, -0.025914086028933525, 0.04153843969106674, -0.07229098677635193, -0.011135605163872242, -0.039069779217243195, 0.0568271204829216, 0.0909930020570755, -0.007952469401061535, -0.006524593569338322, -0.004578310530632734, -0.10292695462703705, 0.01626109890639782, -0.002856340492144227, 0.026587655767798424, 0.12592816352844238, 0.007350587751716375, -0.06942016631364822, 0.012489928863942623, -0.039728086441755295, 0.05388442054390907, 0.007947363890707493, -0.150272399187088, -2.2526167222120426e-33, -0.0015601199120283127, -0.03801031410694122, 0.05620836839079857, 0.027870289981365204, -0.029862146824598312, -0.018951034173369408, -0.09574858844280243, -0.07330631464719772, 0.0200251042842865, -0.05829092115163803, 0.06426206231117249, -0.032813314348459244, 0.011972425505518913, 0.06714433431625366, 0.017434576526284218, 0.09111319482326508, -0.0014546079328283668, -0.03994085267186165, -0.011422274634242058, -0.02348840981721878, 0.024159537628293037, 0.004627544432878494, -0.00556015782058239, -0.02768513932824135, -0.05954355746507645, -0.06201785430312157, 0.026171935722231865, -0.031787462532520294, -0.02774386666715145, 0.010029151104390621, -0.00041294394759461284, 0.0900951474905014, -0.1394921839237213, -0.03431953117251396, 0.059207260608673096, 0.010945931077003479, 0.04924384132027626, -0.016004743054509163, 0.02218681015074253, -0.021405886858701706, 0.0560770109295845, 0.008818424306809902, -0.00931208673864603, -0.04155607521533966, -0.002650038804858923, -0.010450145229697227, 0.07721695303916931, -0.024641230702400208, -0.06904222071170807, 0.012037073262035847, 0.007445160765200853, -0.03800974786281586, 0.0744619145989418, -0.09666593372821808, -0.06731700897216797, -0.018152862787246704, 0.07796091586351395, 0.031451158225536346, -0.03284412994980812, -0.0852755755186081, -0.07231450080871582, 0.03254470229148865, -0.03648380562663078, -0.05464060604572296, -0.03260952979326248, 0.13414305448532104, -0.09543123841285706, 0.03387255594134331, -0.09233610332012177, -0.113286592066288, -0.05971049517393112, 0.018726762384176254, 0.004377387929707766, -0.04719335213303566, -0.04560501500964165, 0.009965714067220688, -0.03646809980273247, 0.017812609672546387, 0.03166203945875168, 0.07129021733999252, 0.007672999519854784, -0.03342726081609726, 0.017137013375759125, -0.06010860577225685, -0.14570742845535278, 0.032070308923721313, -0.04656023532152176, -0.0375477634370327, 0.03676871955394745, 0.0031533765140920877, -0.06936571002006531, -0.06055309996008873, 0.1065114289522171, 0.05733088403940201, 0.08267810940742493, -2.9335259554841286e-08, -0.0007818375597707927, 0.030578667297959328, -0.06098045036196709, -0.0044352407567203045, 0.01740298606455326, 0.05320613458752632, 0.0233794953674078, 0.006172331515699625, 0.010828210972249508, 0.09295869618654251, -0.015336431562900543, -0.005363312549889088, -0.06219133362174034, 0.07291845977306366, -0.03127165138721466, 0.04759572073817253, -0.06538084149360657, 0.04129822552204132, 0.04440728947520256, -0.11155633628368378, 0.12225767225027084, -0.026176471263170242, 0.012168697081506252, 0.06534770131111145, 0.00044121756218373775, -0.04962579160928726, 0.0003667353594209999, -0.024741843342781067, -0.08153115212917328, -0.09502027928829193, 0.09730014950037003, -0.01775014027953148, -0.06186951696872711, 0.0133231021463871, 0.0958980992436409, 0.0014798567863181233, 0.0009083710028789937, -0.009612408466637135, 0.019744519144296646, 0.044405076652765274, 0.02531062625348568, 0.05744652450084686, 0.00577890919521451, -0.07522175461053848, 0.0018532845424488187, 0.02991063892841339, -0.020939355716109276, 0.0720919743180275, -0.06172468140721321, -0.10140324383974075, 0.024623120203614235, 0.0022720659617334604, -0.024403009563684464, 0.06490326672792435, 0.049124911427497864, 0.03333781287074089, -0.02402428537607193, -0.005306887440383434, 0.011438688263297081, 0.0026064207777380943, -0.00017159726121462882, 0.02491355501115322, 0.03961276262998581, -0.04134787619113922 ] }, { "text": "### 3. Install Arduino CLI \n\n- Install Arduino CLI to your C:/ directory from [https://arduino.github.io/arduino-cli/0.20/installation/](https://arduino.github.io/arduino-cli/0.20/installation/). Then add the Arduino \n CLI installation path to your PATH environment variable. \n- Run the following commands:\n \n `$ arduino-cli core list`\n \n `$ arduino-cli board list`\n\nFor me, those commands were both empty :( I will explain the solution in a minute.", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_4", "embedding": [ 0.06483470648527145, -0.10156500339508057, -0.02308046817779541, -0.04917536675930023, 0.002684105886146426, 0.025723595172166824, 0.027276290580630302, 0.024938810616731644, -0.08016743510961533, 0.0020753329154103994, 0.014695629477500916, -0.14913564920425415, -0.040878381580114365, 0.0765780434012413, -0.00236983853392303, 0.029515298083424568, 0.031250908970832825, -0.04244498535990715, 0.07812870293855667, 0.08309221267700195, -0.003841061145067215, -0.005385809112340212, -0.06460404396057129, -0.04554470255970955, -0.04103253409266472, -0.04998143017292023, 0.04266294464468956, -0.008334428071975708, -0.08039237558841705, 0.01227184571325779, -0.08864856511354446, 0.08351431041955948, 0.12285035103559494, -0.01762958988547325, 0.09296494722366333, 0.04239175096154213, -0.002109142718836665, -0.05352285876870155, 0.08686445653438568, -0.09545539319515228, 0.08027543127536774, 0.08622018992900848, -0.011379111558198929, -0.010967687703669071, 0.021547013893723488, -0.024601517245173454, 0.031334247440099716, -0.03079940192401409, 0.001101217814721167, 0.005548355169594288, -0.039786551147699356, 0.02585901878774166, 0.012479720637202263, -0.10395627468824387, -0.0010685804300010204, -0.022890282794833183, -0.07096921652555466, 0.01014458853751421, 0.13734273612499237, -0.012461581267416477, 0.0029710836242884398, 0.06280491501092911, -0.003526695305481553, 0.00900326855480671, -0.07051810622215271, -0.06865368783473969, 0.027845166623592377, 0.0023072673939168453, -0.015930313616991043, 0.024891724810004234, 0.03509565442800522, 0.05022231861948967, -0.0747588649392128, 0.01944875530898571, -0.056671950966119766, 0.02283342368900776, 0.026520278304815292, -0.0007492012809962034, -0.04820466414093971, -0.04886966198682785, -0.08433917164802551, 0.053076665848493576, -0.05752743035554886, 0.06918670237064362, 0.004710969049483538, 0.037734780460596085, -0.02873380109667778, -0.039209116250276566, 0.026046965271234512, -0.04266221821308136, 0.01109800860285759, -0.06858792155981064, -0.07261406630277634, -0.01956343650817871, 0.014236885122954845, 0.011654342524707317, -0.008336665108799934, 0.030449289828538895, -0.07278778403997421, -0.010438910685479641, -0.07447550445795059, -0.0579225979745388, 0.056088998913764954, 0.03760339319705963, -0.03627543896436691, 0.04423115774989128, 0.03229941427707672, -0.05561290308833122, -0.04260143265128136, 0.01678857021033764, -0.06132204830646515, 0.050008855760097504, 0.0033670933917164803, -0.04766549915075302, 0.0077833142131567, 0.05408181622624397, 0.0568360798060894, 0.006894960999488831, 0.014124391600489616, 0.021935172379016876, -0.06015552207827568, -0.026386583223938942, 0.022683922201395035, 0.00442372914403677, -0.010195964016020298, -0.04153747111558914, -0.0205596461892128, 1.6036371277116043e-33, 0.011635088361799717, -0.05071299523115158, 0.023896291851997375, 0.029110252857208252, 0.08290259540081024, -0.02334566041827202, -0.012838715687394142, -0.010137153789401054, -0.011209198273718357, -0.021383659914135933, 0.009177353233098984, -0.05830925330519676, -0.009220034815371037, 0.11967909336090088, -0.003879705909639597, 0.04811219871044159, 0.030625158920884132, -0.02540837787091732, 0.007266097702085972, -0.008830799721181393, -0.002006462076678872, 0.011696597561240196, -0.007829423062503338, -0.024190835654735565, -0.042246926575899124, -0.038408588618040085, 0.07318833470344543, 0.012504443526268005, 0.08267921209335327, 0.006649709306657314, 0.06119167432188988, 0.07305273413658142, 0.021649524569511414, -0.025203315541148186, -0.018287310376763344, -0.05929182097315788, 0.016269052401185036, 0.09508617222309113, -0.03251644968986511, 0.040227439254522324, -0.01598791964352131, 0.03790159523487091, -0.0337299220263958, -0.03617369383573532, 0.0774347186088562, -0.1263929307460785, -0.040996044874191284, 0.0706721693277359, 0.02029958926141262, 0.04849853366613388, -0.054513949900865555, -0.04036303237080574, 0.0370878204703331, -0.04986469820141792, 0.06227356567978859, -0.04820094630122185, -0.07177094370126724, -0.021750181913375854, 0.012369740754365921, -0.0256810300052166, 0.05257401615381241, 0.10737784206867218, 0.038515303283929825, 0.04079762101173401, 0.010009050369262695, 0.00607135659083724, -0.09836509823799133, -0.006454318296164274, 0.054264139384031296, 0.08057104796171188, -0.013402665965259075, -0.028690528124570847, -0.02857445739209652, 0.009280556812882423, -0.006953817792236805, 0.012500151060521603, -0.04472039267420769, -0.0637248158454895, 0.025428760796785355, 0.04329775646328926, 0.059216853231191635, -0.00021020742133259773, 0.06558272987604141, -0.01870451495051384, 0.092778779566288, -0.02931353449821472, -0.0009983422933146358, 0.06547959893941879, -0.02888375334441662, 0.002364334650337696, 0.10426142811775208, 0.007078161928802729, -0.051936376839876175, 0.025320876389741898, -0.08367599546909332, -5.129704532722856e-33, 0.09659412503242493, -0.0049906643107533455, 0.03970804810523987, -0.07893667370080948, -0.1127084270119667, -0.00107498315628618, -0.10142351686954498, -0.09748843312263489, -0.02321319468319416, -0.06877684593200684, -0.06495632231235504, 0.05639951303601265, 0.05001050978899002, 0.023840218782424927, 0.02879035845398903, -0.00721144350245595, 0.00937680434435606, 0.037583138793706894, -0.016295121982693672, -0.0345611646771431, -0.024878133088350296, -0.04970964044332504, 0.017058152705430984, -0.02160784602165222, -0.07944434881210327, -0.06076579540967941, 0.024526657536625862, 0.07450482994318008, 0.012958027422428131, 0.0426451750099659, -0.0408332496881485, 0.015580986626446247, -0.06122104078531265, 0.06349614262580872, 0.0006688159774057567, 0.051026664674282074, 0.04578687995672226, -0.01485439669340849, -0.034574199467897415, -0.08949533104896545, 0.03185438737273216, -0.04963843151926994, -0.019269181415438652, -0.12304013222455978, 0.03704318404197693, -0.031050581485033035, 0.04719620570540428, -0.05369780957698822, -0.030276022851467133, -0.07670308649539948, 0.03454018384218216, -0.06927023082971573, 0.08940102905035019, -0.009715380147099495, 0.02175922505557537, 0.006558593828231096, 0.07290863990783691, 0.04782416671514511, 0.002403989899903536, -0.07520163804292679, -0.07935298979282379, -0.04566989466547966, -0.023859301581978798, -0.07453346252441406, -0.03900660201907158, 0.02335718832910061, -0.05411994084715843, 0.03008672595024109, -0.08803088217973709, -0.11850441992282867, -0.04912899434566498, 0.08632782846689224, -0.010236200876533985, 0.05705855041742325, 0.013796337880194187, 0.05339804291725159, -0.05982746556401253, 0.0122551703825593, 0.03942897543311119, 0.0873829647898674, 0.04474054276943207, 0.011497375555336475, -0.09223382920026779, -0.022039668634533882, -0.0558612085878849, 0.042011797428131104, -0.04256228357553482, -0.06389372795820236, 0.018219448626041412, 0.013337775133550167, 0.03731463849544525, -0.02012171782553196, 0.09155189990997314, 0.04606397822499275, -0.006353962235152721, -4.868207170716232e-08, 0.029186731204390526, 0.01718991808593273, -0.03418146073818207, 0.012601072899997234, 0.019724491983652115, 0.06739570945501328, -0.008355709724128246, -0.10179436951875687, 0.0441402941942215, -0.02155335433781147, -0.008979574777185917, 0.01740037463605404, 0.038787417113780975, 0.09542182832956314, 0.001226582215167582, -0.005028786137700081, -0.02922774665057659, 0.001454951474443078, 0.09905797988176346, 0.01752030849456787, 0.05453982204198837, -0.03482693061232567, -0.017211075872182846, 0.06541422009468079, 0.0245700441300869, -0.08595899492502213, 0.024485819041728973, -0.03738625720143318, -0.09995805472135544, 0.00012574745051097125, 0.020039545372128487, -0.027278712019324303, -0.004697372671216726, -0.023899652063846588, 0.08853008598089218, 0.00014188073691911995, -0.013278592377901077, -0.015794871374964714, 0.06912264227867126, -0.05829540267586708, 0.02325967513024807, 0.09461548924446106, -0.043401848524808884, -0.0839742124080658, 0.03993762284517288, -0.07019291818141937, -0.006372977048158646, 0.07459758967161179, -0.08033082634210587, -0.04277186095714569, 0.07797304540872574, 0.017323510721325874, 0.018624024465680122, 0.001869906554929912, 0.05920787155628204, 0.03251290321350098, -0.015963086858391762, -0.08696182072162628, 0.030624181032180786, 0.0360640287399292, -0.0014598224079236388, 0.008852657862007618, -0.12132325023412704, 0.021930713206529617 ] }, { "text": "### 4. Update the firmware\n- You need to download the latest Edge Impulse firmware and unzip the file: \n [https://docs.edgeimpulse.com/](https://docs.edgeimpulse.com/docs/arduino-nano-33-ble-sense#2-update-the-firmware)\n- Open flash_windows.bat to flash the firmware. \n- Wait until it is completed. \n \n `Here, I got this error: Unknown FQBN: platform arduino:mbed is not installed`\n\nIf you don't care about this error and jump to the last step (like me!) with the command \n\n $edge-impulse-daemon\n\nyou will get timeout error. :)\n\n `Failed to get info off device Timeout when waiting for > (timeout: 5000) onConnected`\n\nLet's turn back to Step 3. All these errors are coming from the arduino:mbed installation.\nI searched for the solution from the following websites:", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_5", "embedding": [ -0.03696633130311966, -0.014212962239980698, -0.044199634343385696, -0.0439353846013546, -0.006031401455402374, -0.03747137635946274, -0.051298364996910095, 0.012573874555528164, -0.08179684728384018, 0.09394197911024094, 0.08260554820299149, -0.04272665083408356, -0.052797481417655945, -0.0028716586530208588, 0.03553200140595436, 0.05635363236069679, -0.022232593968510628, 0.004506526980549097, 0.038639310747385025, 0.0008350225980393589, 0.0010926331160590053, -0.02531741000711918, 0.008876392617821693, -0.03809371218085289, -0.06939906626939774, 0.009130212478339672, 0.026597853749990463, 0.030999217182397842, -0.02305625192821026, -0.026581117883324623, 0.05684791877865791, 0.03787790238857269, 0.08840427547693253, -0.00945131853222847, 0.11855456233024597, 0.008343134075403214, -0.006823092699050903, 0.06388833373785019, -0.0348811112344265, -0.05984027683734894, 0.01842646114528179, -0.0026466255076229572, -0.04622353985905647, -0.03739359229803085, 0.12045397609472275, 0.024524616077542305, 0.04636259377002716, 0.028766483068466187, 0.027865881100296974, -0.04187517240643501, -0.014899075962603092, 0.02677079103887081, -0.019426867365837097, -0.04556705057621002, 0.0025452645495533943, -0.008738544769585133, -0.013943544588983059, 0.07116673141717911, 0.07078796625137329, 0.02832367643713951, 0.04258952662348747, -0.04592809081077576, -0.011893186718225479, -0.039964087307453156, -0.02591550163924694, 0.044483717530965805, 0.0297123771160841, 0.022424260154366493, -0.053607746958732605, 0.06608720123767853, 0.10702428221702576, -0.007065705489367247, -0.07876201719045639, -0.023984987288713455, -0.053304772824048996, 0.06549333781003952, 0.08331135660409927, 0.04832494631409645, -0.025264684110879898, -0.052187323570251465, -0.020601505413651466, -0.07201521843671799, 0.048011861741542816, 0.018336931243538857, 0.04186556860804558, -0.010433761402964592, -0.03393630310893059, 0.03771338611841202, -0.033930469304323196, 0.015762588009238243, -0.019724154844880104, 0.031046628952026367, -0.048989322036504745, -0.009337086230516434, 0.07629532366991043, 0.06810145825147629, 0.006204194389283657, -0.02291683293879032, -0.07667075097560883, 0.00130179722327739, -0.05003136768937111, -0.06109693646430969, -0.03196457773447037, 0.06448719650506973, -0.05691458657383919, -0.012678273022174835, 0.013894359581172466, 0.06425102055072784, 0.09494776278734207, -0.02647557482123375, -0.01430185791105032, 0.028154920786619186, -0.04195215553045273, -0.021935833618044853, -0.05645424872636795, -0.05817068740725517, -0.04357386380434036, 0.03385084867477417, 0.05002874135971069, -0.010973073542118073, -0.005144238006323576, 0.04594143107533455, -0.04417673870921135, -0.07121715694665909, -0.034504156559705734, 0.035566721111536026, 0.00848327111452818, 2.931531198711132e-33, 0.02702961303293705, 0.03634532168507576, -0.0945180207490921, 0.017877867445349693, 0.044175971299409866, -0.002348008332774043, 0.04458193480968475, -0.006426544860005379, -0.012213412672281265, 0.0050266641192138195, -0.08523330092430115, -0.10763468593358994, -0.005584129597991705, -0.04584980756044388, 0.011274483986198902, -0.07405652105808258, 0.012029891833662987, -0.049722135066986084, 0.06258419901132584, -0.023501375690102577, 0.09798019379377365, -0.02610587514936924, -0.021909231320023537, -0.04334448277950287, 0.02270355448126793, 0.012305817566812038, -0.013969496823847294, 0.027960799634456635, 0.15450933575630188, 0.03966442123055458, -0.05164250731468201, 0.037656623870134354, -0.0451301634311676, -0.09576985239982605, 0.0021180096082389355, -0.026945099234580994, -0.0369211807847023, -0.021342922002077103, -0.08471924066543579, -0.05731567367911339, 0.006324549205601215, 0.017393380403518677, -0.08821579068899155, -0.0029290805105119944, -0.012434106320142746, -0.06886406242847443, -0.06316836178302765, -0.05188645422458649, 0.04601770639419556, 0.10560660809278488, -0.07587435096502304, -0.012645314447581768, 0.09713505953550339, -0.08644650876522064, 0.03820452094078064, -0.00980765838176012, -0.07881493866443634, 0.031005531549453735, 0.005328119266778231, 0.036408960819244385, 0.12913420796394348, -0.04855102673172951, -0.03662988543510437, 0.0035446234978735447, 0.015703026205301285, 0.01747436262667179, -0.009700722061097622, 0.04912084341049194, -0.05119609832763672, 0.010684285312891006, -0.03392736613750458, 0.017570216208696365, 0.09235195815563202, -0.00930753629654646, -0.022091900929808617, -0.026824967935681343, -0.01882178708910942, -0.042458418756723404, -0.03575294837355614, -0.07867875695228577, -0.02666722983121872, -0.014663775451481342, 0.004243198782205582, -0.01404150016605854, 0.07982683926820755, 0.01832796260714531, -0.014083358459174633, 0.00866768229752779, 0.02394169382750988, 0.06477529555559158, 0.058009106665849686, -0.08399733901023865, 0.004164924845099449, 0.10751304775476456, -0.11799321323633194, -2.487624858906296e-33, -0.0575496181845665, 0.013014078140258789, 0.01838630624115467, -0.011143691837787628, -0.03324631229043007, 0.007930605672299862, 0.029643161222338676, 0.06124943494796753, -0.047333840280771255, -0.027548184618353844, -0.02617720328271389, 0.03309198468923569, 0.023323379456996918, -0.0631580501794815, -0.07435640692710876, 0.04375694692134857, 0.005097829736769199, -0.12458839267492294, 0.043759893625974655, 0.06487736850976944, -0.019679134711623192, -0.05391388013958931, 0.049799103289842606, 0.01695881597697735, -0.07064788788557053, 0.07079726457595825, 0.05398647487163544, 0.06704652309417725, 0.01914520002901554, -0.01900375634431839, 0.08717963844537735, 0.0421050488948822, -0.05924970656633377, 0.007432608399540186, 0.010391327552497387, 0.04172305762767792, 0.041196104139089584, -0.06897392123937607, 0.005929639562964439, -0.05352136492729187, 0.021465333178639412, 0.022333219647407532, -0.09057317674160004, -0.059222713112831116, 0.1171557828783989, 0.08420904725790024, -0.025499042123556137, -0.002845136681571603, -0.0786646381020546, -0.07279536128044128, -0.015658514574170113, 0.0429752953350544, 0.0059370924718678, 0.04776005446910858, 0.002102847909554839, -0.0994580090045929, 0.0758884996175766, 0.09956064820289612, -0.04685884714126587, 0.04186401516199112, 0.006493452005088329, -0.03120354935526848, 0.007245706394314766, 0.01370974536985159, 0.046523429453372955, 0.04664549604058266, 0.022186992689967155, 0.06461331993341446, -0.02987406589090824, 0.03127136826515198, -0.07467018812894821, 0.00576205225661397, -0.016403742134571075, 0.020794890820980072, 0.025338919833302498, 0.04310886934399605, -0.022038498893380165, -0.03237627446651459, 0.004201352596282959, 0.025106381624937057, 0.018532264977693558, 0.08952397108078003, -0.057166993618011475, 0.021040499210357666, -0.08997026085853577, -0.034876223653554916, 0.07028449326753616, 0.03367380425333977, 0.016906574368476868, -0.050082240253686905, -0.05172424763441086, -0.08527655154466629, 0.017670802772045135, 0.1495143324136734, -0.028801418840885162, -4.926321750531315e-08, -0.0038044226821511984, 0.04535485804080963, -0.009538043290376663, -0.07077345252037048, 0.06803915649652481, -0.008180554024875164, 0.02059006690979004, 0.018000269308686256, 0.055462516844272614, -0.03647517412900925, 0.024714497849345207, -0.04077986627817154, -0.012698858976364136, 0.10508350282907486, 0.006433290895074606, 0.04284565523266792, -0.061968810856342316, -0.004611512180417776, 0.06116611883044243, -0.06583116948604584, 0.03712617978453636, 0.035187505185604095, 0.013596940785646439, -0.030194349586963654, 0.05777021124958992, -0.054318372160196304, 0.016936402767896652, -0.060883354395627975, 0.020089304074645042, -0.03027484565973282, -0.14246656000614166, -0.003639186965301633, 0.10762429982423782, 0.0763079896569252, -0.05472014471888542, -0.023010561242699623, 0.02815714292228222, 0.028033830225467682, 0.07765740156173706, 0.04447770491242409, 0.06455401331186295, 0.06475493311882019, -0.05309341475367546, -0.03932465240359306, 0.012834825552999973, -0.003383214585483074, -0.005142502021044493, 0.10230707377195358, -0.0173569917678833, 0.02982674539089203, 0.05887844040989876, -0.006379909347742796, -0.013302525505423546, -0.0063852411694824696, -0.030966615304350853, -0.03257083147764206, -0.08140692114830017, -0.08202444016933441, 0.024634821340441704, 0.013811394572257996, 0.06754538416862488, -0.09705694764852524, -0.09403356164693832, 0.08244047313928604 ] }, { "text": "- [forum_egde_impulse_1](https://forum.edgeimpulse.com/t/incorrect-fqbn-error-installing-ei-firmware-for-arduino-nano-33ble-sense/1372/12)\n- [forum_egde_impulse_2](https://forum.edgeimpulse.com/t/arduino-cli-version/1332/6)\n- [forum_egde_impulse_3](https://forum.edgeimpulse.com/t/issue-uploading-edge-impulse-firmware-for-nano/1683/2)\n- [forum_egde_impulse_4](https://forum.arduino.cc/t/problem-uploading-to-new-board-arduino-nano-33-ble/685958) \n- [get_start_with_arduino_1](https://create.arduino.cc/projecthub/B45i/getting-started-with-arduino-cli-7652a5)\n- [get_start_with_arduino_1](https://docs.arduino.cc/software/ide-v1/tutorials/getting-started/cores/arduino-mbed_nano)", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_6", "embedding": [ -0.03761235252022743, -0.054040469229221344, -0.02769532799720764, -0.09839751571416855, 0.10005668550729752, -0.03563189134001732, 0.026639021933078766, 0.0042106276378035545, -0.07323969155550003, 0.021990688517689705, 0.08473121374845505, -0.09244466572999954, -0.04518728330731392, 0.06867393106222153, 0.012192062102258205, 0.06777872145175934, -0.03704243525862694, -0.10674390941858292, 0.025476302951574326, 0.07077489793300629, 0.020751170814037323, -0.039396099746227264, 0.01532389409840107, 0.01952006295323372, -0.03699949383735657, -0.04799952358007431, 0.013359863311052322, 0.03447485715150833, -0.019804654642939568, -0.12414668500423431, 0.0712016299366951, 0.05123242363333702, 0.07078535109758377, -0.06382042169570923, 0.12952189147472382, 0.04362572729587555, 0.02917482703924179, -0.0073367031291127205, 0.00965386163443327, -0.08241795003414154, 0.022337188944220543, -0.01133390050381422, -0.05905561149120331, -0.028910592198371887, 0.01879970356822014, -0.0018607079982757568, 0.0416199192404747, 0.015649013221263885, 0.04715171828866005, -0.01889028586447239, -0.004788812715560198, -0.024207204580307007, 0.010063830763101578, -0.007892466150224209, 0.07901425659656525, 0.06188386306166649, -0.09957873821258545, 0.06199068948626518, 0.10373908281326294, -0.03948195278644562, 0.008687378838658333, -0.036562711000442505, -0.015590815804898739, 0.0015707737766206264, 0.04002190753817558, 0.05824216455221176, 0.04600486159324646, -0.052276402711868286, -0.07748470455408096, 0.015160534530878067, 0.03603279963135719, 0.051581092178821564, -0.14159688353538513, 0.03376613184809685, -0.028537839651107788, 0.10480044782161713, 0.04345883056521416, 0.04978787899017334, -0.09408682584762573, -0.056534744799137115, -0.04962470009922981, -0.05750162526965141, 0.026686105877161026, -0.01940205506980419, 0.023190518841147423, 0.06352432072162628, -0.06382668018341064, -0.015941988676786423, 0.03548065945506096, -0.037162262946367264, 0.01564154401421547, 0.033595237880945206, -0.03491235896945, 0.06944175809621811, 0.07238198816776276, 0.06409240514039993, -0.010947518981993198, 0.026155821979045868, -0.03880665823817253, 0.07306748628616333, -0.027523016557097435, -0.04947274550795555, -0.0008022959227673709, 0.0759420096874237, -0.03366158530116081, -0.005135815590620041, 0.01050738338381052, 0.011681854724884033, 0.02115500532090664, -0.014873219653964043, -0.05789309740066528, -0.02315680868923664, -0.04252174496650696, -0.006207654718309641, -0.037957169115543365, 0.025110943242907524, 0.0034698788076639175, 0.03646371141076088, 0.019536761566996574, -0.028591962531208992, 0.03636898472905159, 0.02442706748843193, -0.07011435180902481, -0.030420802533626556, -0.029356887564063072, -0.017936108633875847, -0.003578327829018235, 3.529371737998512e-34, 0.06247221305966377, -0.010525730438530445, -0.07697619497776031, 0.04106849431991577, 0.08024609088897705, 0.007226687390357256, 0.022722110152244568, 0.08086533099412918, -0.03904185816645622, -0.04309605062007904, -0.025442849844694138, -0.08167804777622223, 0.017243830487132072, -0.018036063760519028, 0.00894831120967865, -0.13459014892578125, 0.02683177962899208, 0.005471079610288143, -0.012360572814941406, -0.014067700132727623, 0.05389925464987755, 0.04514450579881668, -0.05432036146521568, -0.006494606379419565, -0.02533819153904915, 0.052926722913980484, 0.038022156804800034, 0.031005024909973145, 0.13624301552772522, 0.035357799381017685, -0.029369661584496498, -0.010321937501430511, -0.08159206807613373, -0.03511248901486397, 0.012090216390788555, -0.03927028179168701, -0.03663371503353119, -0.02077098935842514, -0.0969812273979187, -0.07804465293884277, -0.019461922347545624, 0.062149129807949066, -0.08603925257921219, -0.04473666846752167, 0.020307114347815514, -0.10157408565282822, -0.05259551852941513, -0.03784996643662453, 0.06414758414030075, 0.048606500029563904, -0.10814972966909409, -0.045871756970882416, 0.08255956321954727, -0.09631470590829849, 0.031023969873785973, -0.029345061630010605, -0.0995672196149826, -0.027867548167705536, 0.04698273539543152, -0.03112104907631874, 0.11375273764133453, 0.03284088149666786, -0.04829877242445946, -0.0051907142624258995, 0.03623535856604576, 0.04174232855439186, -0.015887107700109482, 0.00786250177770853, 0.06377912312746048, 0.047424983233213425, -0.06860905140638351, -0.049493081867694855, 0.05020490288734436, -0.01871306262910366, -0.006338384468108416, -0.03401641547679901, -0.09754372388124466, -0.03559498116374016, -0.02917063981294632, -0.04803643748164177, -0.12284781783819199, -0.030000856146216393, -0.00639829458668828, -0.0058481525629758835, 0.013006139546632767, 0.009497672319412231, -0.0013015420408919454, 0.026316598057746887, 0.032849933952093124, 0.04822748526930809, 0.04813821241259575, 0.0334380567073822, -0.06646863371133804, 0.06397897750139236, -0.043094806373119354, -1.2647959219702874e-33, -0.002533955266699195, 0.02630726248025894, 0.0151444086804986, 0.004570604767650366, -0.03980473056435585, 0.05560973659157753, 0.015030904673039913, -0.005219966638833284, 0.03527311235666275, -0.030008355155587196, -0.011033307760953903, 0.01840818114578724, 0.04695902392268181, -0.055393729358911514, 0.004915738012641668, 0.021847935393452644, -0.03429023548960686, -0.0696728453040123, 0.03571294993162155, 0.05025053396821022, 0.026976384222507477, 0.016753191128373146, -0.037253160029649734, 0.0270447488874197, -0.024022743105888367, 0.03237702697515488, 0.10677390545606613, 0.056051105260849, 0.0018268758431077003, -0.030591584742069244, 0.009124461561441422, 0.0394003801047802, -0.03454545512795448, 0.05521024391055107, -0.014755228534340858, 0.033891238272190094, 0.0436430498957634, -0.003959230612963438, 0.03139772266149521, -0.09161777049303055, 0.05326525494456291, 0.0304114930331707, -0.06650451570749283, -0.06919855624437332, -0.012767507694661617, 0.03874862194061279, 0.05755690112709999, -0.002756372094154358, -0.014637310989201069, -0.05333342403173447, -0.016173772513866425, -0.008530310355126858, 0.03556697443127632, -0.023003580048680305, 0.007197035942226648, -0.05879834666848183, 0.11007995158433914, 0.06062401458621025, -0.00648530526086688, -0.004440265707671642, 0.03970612585544586, 0.05623489245772362, -0.028728928416967392, -0.03941904380917549, 0.06526453047990799, -0.023571664467453957, -0.0274557676166296, 0.05531236156821251, -0.03481622412800789, 0.0325799398124218, -0.06643488258123398, 0.03170851990580559, 0.046963389962911606, 0.0011838198406621814, 0.022321583703160286, 0.03383288159966469, -0.058817390352487564, -0.01108296774327755, -0.010170452296733856, 0.0013430363032966852, -0.0017400550423189998, 0.05138523131608963, -0.07194574922323227, 0.09166068583726883, -0.08166142553091049, -0.049070313572883606, 0.04584358632564545, 0.03879668936133385, 0.014190571382641792, -0.04209311306476593, -0.02120550163090229, -0.011119019240140915, 0.03720895200967789, 0.20178988575935364, -0.014658044092357159, -4.3741639643712915e-08, 0.03054395504295826, -0.011950981803238392, -0.08612839132547379, 0.008744485676288605, 0.051868196576833725, -0.04900538548827171, -0.039894066751003265, -0.018665557727217674, 0.04966827854514122, -0.042634423822164536, -0.012160814367234707, 0.027641212567687035, -0.00041997036896646023, 0.06445557624101639, -0.02583690918982029, -0.059647656977176666, -0.1091286838054657, 0.001489223213866353, -0.00948567595332861, -0.07321584969758987, 0.065712571144104, -0.00938843097537756, 0.023083074018359184, -0.02409520372748375, 0.06839656084775925, -0.021835289895534515, 0.018497416749596596, -0.003023491008207202, 0.006958987098187208, -0.04016515612602234, -0.07008945941925049, 0.05023154988884926, 0.02632325142621994, -0.04846756532788277, 0.0006757323862984776, 0.07822879403829575, -0.026801664382219315, 0.03970428928732872, 0.04021220654249191, 0.023808294907212257, 0.1022692397236824, 0.0669083222746849, 0.02306469716131687, -0.08218777924776077, 0.007932186126708984, -0.040106818079948425, -0.05393611639738083, 0.06766841560602188, -0.0429091677069664, -0.038982585072517395, -0.018131501972675323, 0.008210034109652042, 0.020665843039751053, 0.029444215819239616, -0.017541078850626945, -0.027385199442505836, -0.08228505402803421, -0.0872584879398346, 0.032836005091667175, 0.011320149526000023, 0.1701846420764923, -0.014933232218027115, -0.05349237099289894, 0.07150973379611969 ] }, { "text": "Here you can find what I did to solve this problem:\n- Download Arduino IDE. \n- Download: Tools/Board Manager/ Arduino Mbed OS Nano Boards\n\nI think it is not helpful since $arduino-cli core list is still empty!\n\n- Run the following command:\n \n `$ arduino-cli core install arduino:mbed --> This gets error.`\n \n- Close the firewall and run the command above again. It works! \n- Don't forget to open the firewall. \n \n `$ arduino-cli core list`\n \n `$ arduino-cli board list` are not empty!\n\nI updated the firmware without getting any errors (Step 4). \n\nThen, with the latest step `$edge-impulse-daemon`, I've achieved to load my device to edge impulse :)", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_7", "embedding": [ -0.031863946467638016, -0.051061537116765976, 0.019745605066418648, -0.07968546450138092, 0.0035465266555547714, -0.051614537835121155, -0.019122110679745674, 0.004767128732055426, -0.06933984905481339, 0.08534857630729675, 0.06382329016923904, -0.08178189396858215, -0.05129258707165718, 0.03061111643910408, 0.06723008304834366, 0.07796718925237656, 0.018813032656908035, 0.013450494967401028, 0.0676969438791275, 0.01979183591902256, -0.0012981767067685723, -0.003317110473290086, -0.010088395327329636, -0.0388757586479187, -0.06596268713474274, -0.02547246217727661, 0.07694006711244583, 0.035565804690122604, -0.03059639222919941, 0.00039962437585927546, 0.04628653824329376, 0.03592979535460472, 0.07034330070018768, 9.406466415384784e-05, 0.08356573432683945, 0.022587373852729797, 0.0036019766703248024, 0.013754365034401417, 0.001943813287653029, -0.09239302575588226, 0.027159433811903, 0.025856023654341698, -0.04572346806526184, -0.027632903307676315, 0.08402328938245773, -0.01681794598698616, 0.06952331215143204, 0.01105769444257021, 0.05506589636206627, -0.0762133002281189, -0.04154291749000549, 0.018192358314990997, 0.016419243067502975, -0.09029405564069748, -0.023546185344457626, -0.03552168235182762, -0.012512899935245514, 0.02720971778035164, 0.1380482017993927, -0.03652764856815338, -0.009191835299134254, -0.06637795269489288, 0.023877615109086037, -0.03701618313789368, -0.056759063154459, 0.020052418112754822, 0.04666326940059662, 0.0672539696097374, -0.08245529979467392, 0.05790802091360092, 0.14417046308517456, 0.0205309446901083, -0.07274322956800461, -0.018782401457428932, -0.037300556898117065, 0.05427589267492294, 0.06382971256971359, 0.029945798218250275, -0.023275719955563545, -0.035673145204782486, -0.06366687268018723, -0.053171657025814056, 0.06004861369729042, 0.0319271981716156, -0.013075712136924267, 0.025489361956715584, -0.05302844196557999, 0.03616417199373245, -0.0107821524143219, 0.0271193515509367, 0.007154834922403097, 0.03354758769273758, -0.02297491580247879, -0.006182272918522358, 0.04848752170801163, 0.007677315268665552, 0.015612727031111717, -0.029464012011885643, -0.09444277733564377, -0.014996113255620003, -0.04737286642193794, -0.015207184478640556, -0.03428804129362106, 0.06347620487213135, -0.042264245450496674, -0.0058462955057621, 0.0412033386528492, 0.04794767126441002, 0.02920525334775448, -0.024518020451068878, -0.006862242240458727, 0.03224943205714226, -0.015085509046912193, 0.016189919784665108, -0.03779921308159828, -0.04058808833360672, -0.034361883997917175, 0.013501917012035847, -0.023885609582066536, -0.013096942566335201, -0.03677985444664955, 0.03512493148446083, -0.032850250601768494, -0.012363182380795479, -0.03289034962654114, 0.06948406994342804, -0.022585414350032806, 1.7805541702981434e-33, 0.027459628880023956, -0.0007149912999011576, -0.03493250161409378, -0.014257957227528095, -0.004410212393850088, -0.04416888207197189, -0.035394299775362015, -0.007780884858220816, 0.0008948686299845576, -0.01837908662855625, -0.08017154783010483, -0.11351118236780167, -0.03514758497476578, -0.01350201666355133, 0.005119381006807089, -0.03828611969947815, 0.003925756551325321, -0.05796213820576668, 0.045542288571596146, 0.024650689214468002, 0.01336242537945509, 0.005201701540499926, 0.012804499827325344, -0.016400407999753952, -0.03724166005849838, 0.03258586302399635, 0.0033640628680586815, 0.026437127962708473, 0.1156400740146637, 0.04686495661735535, -0.05858078598976135, 0.017481405287981033, 0.02514149434864521, -0.07480090856552124, -0.05559796839952469, 0.013335984200239182, 0.004082543309777975, 0.03114931285381317, -0.08431606739759445, -0.030846621841192245, -0.003717588260769844, 0.0009865089086815715, -0.026341496035456657, -0.0108736427500844, 0.019703969359397888, -0.10153427720069885, -0.046358443796634674, -0.025183551013469696, 0.045335523784160614, 0.12132348120212555, -0.10655120760202408, -0.04170749709010124, 0.11340152472257614, -0.0764240175485611, 0.02829829603433609, -0.03679271042346954, -0.06827767938375473, 0.06350862979888916, 0.029300807043910027, 0.014557821676135063, 0.12747535109519958, -0.011748702265322208, 0.0007739667198620737, 0.04581892117857933, 0.023969845846295357, 0.04620426520705223, -0.06001444160938263, 0.04926368221640587, -0.01086549460887909, 0.01698126085102558, -0.020991800352931023, 0.03853435814380646, 0.08191191405057907, 0.014810480177402496, 0.03405303880572319, -0.03210844472050667, -0.007787077222019434, -0.050779711455106735, 0.00033604970667511225, -0.02903526835143566, -0.005214726086705923, -0.008490468375384808, 0.027738621458411217, -0.020655004307627678, 0.10961857438087463, 0.05234203487634659, -0.003945332020521164, 0.03436433523893356, -0.005783575586974621, 0.0842343419790268, 0.052594494074583054, -0.055471695959568024, -0.02406734600663185, 0.10500895231962204, -0.11492229998111725, -2.749467143906922e-33, -0.02008199505507946, 0.009547922760248184, 0.020169351249933243, -0.0406697653234005, -0.044094789773225784, 0.04206184670329094, 0.013330659829080105, 0.009867467917501926, -0.06829676032066345, -0.07448698580265045, -0.04852515459060669, 0.01759248785674572, -0.006423384416848421, -0.0299545768648386, -0.05350164324045181, 0.020567376166582108, -0.02475079707801342, -0.12214905768632889, 0.03409511223435402, -0.005307035055011511, -0.003114661667495966, -0.047273166477680206, 0.06084692105650902, -0.00677580526098609, -0.1022377759218216, 0.027322420850396156, 0.02161412499845028, 0.08501312881708145, 0.006348007824271917, 3.10419054585509e-05, 0.10014762729406357, 0.052092570811510086, -0.05108846724033356, -0.009070517495274544, -0.011273114010691643, 0.04042613133788109, 0.04843583703041077, -0.025522859767079353, 0.015599077567458153, -0.0788312554359436, -0.05412764102220535, 0.007752538193017244, -0.03818506747484207, -0.08092928677797318, 0.07742315530776978, 0.060219116508960724, 0.04007605090737343, -0.020240802317857742, -0.07739202678203583, -0.08694515377283096, -0.030504640191793442, 0.04788157716393471, 0.017173917964100838, 0.020023489370942116, -0.006170233245939016, -0.045730505138635635, 0.057805776596069336, 0.09866538643836975, -0.048821043223142624, 0.03909424692392349, -0.031151484698057175, -0.025340039283037186, -0.026018958538770676, -0.040391236543655396, 0.02473324164748192, 0.0073077320121228695, 0.008427141234278679, 0.05845935642719269, -0.07703844457864761, 0.005597039591521025, -0.08839636296033859, 0.0515112578868866, 0.011500827036798, 0.007163168862462044, 0.0523177795112133, 0.05408412218093872, -0.07205289602279663, -0.03908286616206169, 0.041317958384752274, 0.04022321477532387, -0.009666902013123035, 0.0853109061717987, -0.07149459421634674, 0.0437462143599987, -0.09515498578548431, 0.00845242664217949, 0.05311517044901848, 0.00547502376139164, 0.030194377526640892, -0.05331063270568848, -0.06266636401414871, -0.08905673772096634, 0.050786446779966354, 0.125915989279747, -0.05650158226490021, -4.506487272237791e-08, 0.029367398470640182, 0.04966871440410614, 0.014069853350520134, -0.056832872331142426, 0.07418950647115707, 0.0015517702559009194, -0.00564427487552166, -0.027797842398285866, 0.043216343969106674, -0.04249778017401695, -0.010759968310594559, 0.00024641535128466785, -0.039164867252111435, 0.12283620238304138, 0.02533150464296341, 0.0027054434176534414, -0.04369895160198212, 0.0026008703280240297, 0.07335864752531052, -0.06532051414251328, 0.03490098565816879, 0.0015385664300993085, -0.004888121969997883, 0.009249236434698105, 0.06938696652650833, -0.05144717916846275, 0.007312082685530186, -0.0858718603849411, 0.013986127451062202, -0.03408323973417282, -0.13780075311660767, -0.0014556900132447481, 0.07038018852472305, 0.058431386947631836, -0.009232108481228352, -0.03540252521634102, -0.0036130768712610006, 0.028973808512091637, 0.09351982176303864, 0.0058970884419977665, 0.04238101840019226, 0.0575566403567791, -0.043213192373514175, -0.0792839378118515, -0.026653943583369255, 0.03202856704592705, 0.028672177344560623, 0.12887735664844513, -0.045011647045612335, 0.00796074140816927, 0.10038919746875763, -0.04461713880300522, -0.012822344899177551, -0.0010130632435902953, -0.0005387412966229022, -0.015076503157615662, -0.05256049707531929, -0.11075717955827713, 0.04316340759396553, 0.009314030408859253, 0.14497357606887817, -0.08565390110015869, -0.12931108474731445, 0.06024584174156189 ] }, { "text": "`Edge Impulse serial daemon v1.13.16\n Endpoints:\n Websocket: wss://remote-mgmt.edgeimpulse.com\n API: https://studio.edgeimpulse.com/v1\n Ingestion: https://ingestion.edgeimpulse.com\n \n ? Which device do you want to connect to? COM3 (Microsoft)\n [SER] Connecting to COM3\n [SER] Serial is connected, trying to read config...\n [SER] Retrieved configuration\n [SER] Device is running AT command version 1.6.0\n \n ? To which project do you want to connect this device? Pelin / arduino_motion\n Setting upload host in device... OK\n Configuring remote management settings... OK\n Configuring API key in device... OK\n Configuring HMAC key in device... OK\n [SER] Device is not connected to remote management API, will use daemon", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_8", "embedding": [ -0.043417833745479584, -0.041916776448488235, -0.0721963420510292, -0.10953368246555328, -0.0116729149594903, -0.030867749825119972, -0.04051613807678223, 0.045239925384521484, -0.04525391012430191, 0.05343250557780266, 0.07442762702703476, -0.009160680696368217, -0.07239550352096558, 0.014419607818126678, 0.08789218962192535, 0.04745716229081154, 0.00618735933676362, -0.03613295033574104, 0.06900623440742493, 0.02628049999475479, 0.062318552285432816, -0.05323856323957443, 0.004813780542463064, -0.02279282547533512, -0.05230727419257164, 0.002226865151897073, 0.022280346602201462, 0.06169809401035309, 0.004816101863980293, 0.030083386227488518, 0.016925843432545662, -0.013208444230258465, 0.03862467035651207, 0.0664321780204773, 0.05182778835296631, 0.004930572584271431, 0.07914533466100693, -0.017836587503552437, -0.11627312004566193, -0.012126469984650612, 0.0993589237332344, 0.027516506612300873, -0.03935886546969414, -0.06554897129535675, 0.06341180205345154, 0.03757225722074509, -0.06284812092781067, -0.0076994760893285275, -0.0558556392788887, -0.001006828504614532, -0.04239528998732567, 0.02328510582447052, 0.024352725595235825, 0.016026915982365608, 0.002073548035696149, -0.023672200739383698, -0.009866712614893913, 0.11168600618839264, 0.09665949642658234, -0.013528796844184399, -0.007579118944704533, 0.014149878174066544, -0.026074137538671494, -0.08360019326210022, -0.07934092730283737, 0.03166446462273598, 0.010704362764954567, 0.005507560912519693, -0.04068058729171753, 0.012960928492248058, -0.017152542248368263, -0.018394526094198227, -0.0839957520365715, 0.03120589256286621, -0.0770222470164299, 0.03555600717663765, 0.02718293108046055, -0.01737051084637642, -0.1537974774837494, -0.02141876332461834, -0.007033686153590679, -0.06279504299163818, -0.09044519811868668, 0.05328916758298874, -0.03157289698719978, 0.06539147347211838, -0.10829406976699829, 0.04093612730503082, -0.05581473186612129, 0.04663842171430588, 0.018529679626226425, -0.04438413307070732, -0.10564381629228592, 0.006463549565523863, 0.09068581461906433, 0.0767657533288002, -0.05182821676135063, -0.04777232185006142, -0.050856150686740875, 0.0026160229463130236, -0.04266567900776863, -0.05623114854097366, -0.03375304117798805, 0.03826092928647995, -0.01580781117081642, -0.016693973913788795, 0.008187925443053246, 0.0404454842209816, 0.037516478449106216, 0.025554222986102104, -0.004729699343442917, -0.004009351134300232, 0.004755774978548288, -0.017420858144760132, -0.06254032254219055, 0.06890536844730377, -0.10189107060432434, 0.05828777328133583, 0.07607198506593704, -0.041313983500003815, 0.019239751622080803, 0.019575264304876328, -0.08109951764345169, 0.02064831741154194, 0.018924890086054802, -0.063326396048069, 0.052015382796525955, 6.878888615888391e-33, 0.01192600280046463, -0.018473707139492035, -0.016915595158934593, 0.010009144432842731, 0.0023160488344728947, 0.026878733187913895, 0.0468851663172245, 0.005614287219941616, 0.01007943693548441, -0.03314211219549179, -0.09733221679925919, -0.03932357206940651, 0.011197718791663647, 0.00985734723508358, -0.042992234230041504, -0.09678225219249725, 0.07531092315912247, 0.010864145122468472, 0.07583228498697281, 0.033844564110040665, 0.05228642746806145, -0.0005452273762784898, -0.03793755918741226, -0.005053654313087463, -0.0619063638150692, 0.0848606526851654, -0.0578869991004467, -0.012792755849659443, 0.14334048330783844, 0.034537725150585175, 0.005851051304489374, 0.048493508249521255, 0.001912610256113112, -0.008787049911916256, 0.00990018155425787, -0.04368824139237404, -0.053009115159511566, -0.019374215975403786, -0.09321656078100204, -0.027557212859392166, 0.02439698576927185, -0.005700354464352131, -0.08918801695108414, -0.015048258006572723, -0.0977211445569992, -0.1084418073296547, 0.03169058635830879, -0.01944842003285885, 0.047213099896907806, 0.07468574494123459, -0.06353271007537842, -0.04145608842372894, 0.05808516591787338, -0.019534064456820488, 0.011333601549267769, -0.06617116183042526, -0.055469729006290436, 0.042963311076164246, -0.031151127070188522, -0.03416040167212486, 0.0858365148305893, -0.025454595685005188, 0.01770276203751564, -0.036296844482421875, 0.08804133534431458, 0.01051701232790947, -0.029340537264943123, 0.03793652728199959, 0.01851041242480278, 0.048571158200502396, -0.07823220640420914, 0.09173908829689026, -0.03832176700234413, 0.02885807864367962, -0.011952193453907967, 0.028681155294179916, -0.02257797308266163, 0.07201576977968216, -0.08921724557876587, -0.021511951461434364, -0.11073244363069534, 0.05146671459078789, 0.053660258650779724, 0.009530832059681416, 0.016205796971917152, 0.0691768154501915, 0.035185813903808594, 0.04483336955308914, 0.019613677635788918, 0.0671999603509903, 0.056945767253637314, -0.028293928131461143, -0.020507337525486946, 0.14571994543075562, -0.06748015433549881, -7.263656569587327e-33, -0.010550419799983501, 0.030933333560824394, 0.022778553888201714, 0.004459914285689592, -0.035156894475221634, 0.03270629793405533, 0.013882281258702278, -0.004587380215525627, -0.05597297102212906, -0.025765592232346535, 0.009427758865058422, -0.020032543689012527, 0.05430164933204651, -0.06481146067380905, -0.005098150577396154, 0.04633069410920143, -0.04126386344432831, -0.08027409762144089, 0.01943662017583847, -0.0012467327760532498, -0.06220393255352974, 0.04104914516210556, 0.04129103943705559, 0.01947435922920704, -0.04859320446848869, 0.02543856017291546, 0.01607855223119259, 0.025878870859742165, -0.08731375634670258, -0.044819459319114685, 0.08405490964651108, 0.02461397461593151, -0.032585952430963516, -0.01625453308224678, 0.005147275049239397, 0.04429027438163757, 0.09215336292982101, 0.011699756607413292, 0.015028790570795536, -0.08710791915655136, 0.04862053319811821, 0.03274260088801384, -0.021397680044174194, 0.006794495973736048, 0.08831154555082321, 0.048115406185388565, -0.028064889833331108, 0.025631725788116455, -0.07131026685237885, 0.012887036427855492, -0.03597906231880188, 0.06900200992822647, 0.015081566758453846, -0.022376956418156624, 0.04977567493915558, 0.00470863189548254, 0.05401965230703354, -0.00828817579895258, -0.06930980086326599, -0.011505123227834702, 0.04296549782156944, -0.09170685708522797, -0.07303653657436371, 0.04518004506826401, 0.01751423068344593, 0.10147634148597717, 0.029681149870157242, 0.0619838684797287, -0.023871349170804024, 0.013974009081721306, -0.052821576595306396, 0.05669255554676056, 0.013451293110847473, -0.019106753170490265, -0.0028391319792717695, -0.0058580380864441395, -0.06590389460325241, -0.044582389295101166, -0.015956586226820946, 0.03620355203747749, -0.02473285421729088, 0.05479050427675247, -0.06586769223213196, 0.02133817970752716, -0.09011141955852509, 0.02460888773202896, 0.04931390658020973, 0.09448486566543579, -0.0530395545065403, -0.055092740803956985, -0.08157185465097427, -0.05352111905813217, -0.03467253968119621, 0.12447486817836761, 0.009016964584589005, -5.743396869206663e-08, -0.009701826609671116, 0.00623118644580245, -0.07618678361177444, -0.018342310562729836, -0.06068190932273865, 0.06269428879022598, -0.02349855937063694, 0.012223594821989536, 0.030719181522727013, -0.016350049525499344, -0.007325553335249424, -0.10886109620332718, -0.04736069589853287, 0.04385045915842056, 0.03894227370619774, -0.025768250226974487, -0.014602813869714737, 0.022869523614645004, 0.06229456886649132, -0.04393165558576584, 0.08394353091716766, -0.053323473781347275, -0.02545660361647606, 0.012106911279261112, 0.05155277997255325, 0.016443300992250443, -0.004606182686984539, 0.003653652733191848, -0.0711294636130333, 0.009278588928282261, -0.017332326620817184, -0.02271607704460621, 0.035160183906555176, 0.016186203807592392, -0.0521148219704628, 0.029508480802178383, -0.07318902015686035, 0.038073744624853134, 0.05589868128299713, -0.03242070972919464, 0.1181035116314888, 0.07325217872858047, -0.09813261032104492, -0.04768024757504463, 0.005825851112604141, 0.029531802982091904, 0.07977621257305145, 0.055311836302280426, -0.018884047865867615, -0.004750674590468407, 0.054074421525001526, -0.012488746084272861, 0.08065776526927948, 0.007352231070399284, 0.047937918454408646, -0.014892772771418095, -0.02516280487179756, -0.10969440639019012, 0.02164592780172825, 0.002633423078805208, 0.08722411841154099, -0.05445520579814911, -0.019729137420654297, 0.05210386589169502 ] }, { "text": "Configuring HMAC key in device... OK\n [SER] Device is not connected to remote management API, will use daemon\n [WS ] Connecting to wss://remote-mgmt.edgeimpulse.com\n [WS ] Connected to wss://remote-mgmt.edgeimpulse.com\n ? What name do you want to give this device? pelin's arduino\n [WS ] Device \"pelin's arduino\" is now connected to project \"arduino_motion\"\n [WS ] Go to https://studio.edgeimpulse.com/studio/62428/acquisition/training to build your machine learning model!`", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_9", "embedding": [ -0.030875546857714653, -0.06744375824928284, -0.06446416676044464, -0.08161129802465439, -0.0036937552504241467, -0.008452276699244976, 0.027757838368415833, 0.0007920042844489217, -0.03277716785669327, 0.06757170706987381, 0.0923042744398117, 0.004637081641703844, -0.003457364160567522, 0.02224063314497471, 0.009896313771605492, 0.06882286071777344, -0.05303148552775383, -0.03740817680954933, 0.08024691790342331, -0.020974718034267426, 0.055484604090452194, -0.07661337405443192, 0.0772869735956192, 0.008399233222007751, -0.06712870299816132, 0.016766855493187904, 0.07023140788078308, 0.1446414291858673, 0.03961409628391266, -0.025561954826116562, 0.001182599226012826, -0.03165995702147484, 0.016241740435361862, 0.0481688417494297, 0.016869748011231422, 0.030313292518258095, 0.08613848686218262, -0.014868221245706081, -0.08739940077066422, -0.07823463529348373, 0.025501564145088196, -0.02022264152765274, -0.024948984384536743, 0.02423999086022377, 0.04475347325205803, 0.06411585956811905, -0.008846214041113853, -0.08459413796663284, -0.021576233208179474, 0.03970714285969734, -0.08987315744161606, -0.07844752073287964, 0.019990207627415657, -0.03570175543427467, -0.08316285163164139, -0.018549853935837746, -0.008747536689043045, 0.09297304600477219, 0.10086765885353088, -0.042307399213314056, -0.004003303125500679, -0.03529930114746094, -0.05974233150482178, -0.02619250677525997, -0.10428336262702942, 0.014641166664659977, -0.018005389720201492, -0.025577271357178688, -0.02270379848778248, -0.05620698630809784, 0.03670681640505791, -0.05682014673948288, -0.006620171945542097, 0.0233573280274868, -0.041167646646499634, 0.03425019606947899, 0.0038436921313405037, -0.06350374966859818, 0.00612354651093483, 0.0017446574056521058, -0.018703388050198555, -0.02733737975358963, -0.09650453180074692, 0.10181672871112823, 0.0449366420507431, 0.06808247417211533, -0.09071473032236099, 0.03074282594025135, 0.028918007388710976, 0.037716712802648544, -0.015749167650938034, -0.10909704864025116, -0.09141965955495834, -0.007712693884968758, 0.03044108673930168, 0.05039015784859657, -0.01903347484767437, -0.017320992425084114, -0.12498673051595688, 0.03132825344800949, -0.07679405063390732, -0.05404745042324066, -0.03964244946837425, -0.005228759720921516, 0.021435020491480827, -0.02898351289331913, 0.032741010189056396, 0.0276863481849432, 0.045065753161907196, -0.03751908242702484, -0.02848951332271099, 0.04148150607943535, -0.024250496178865433, 0.03314705193042755, -0.018981516361236572, 0.07321404665708542, -0.05829068273305893, 0.020664317533373833, -0.011989382095634937, -0.056565314531326294, -0.05933690816164017, 0.002120675053447485, -0.08203603327274323, 0.018778305500745773, -0.07746011763811111, -0.054813895374536514, -0.03405430540442467, 2.67522953286471e-33, 0.04070904850959778, 0.004894970916211605, 0.03774302825331688, -0.02900031954050064, 0.06791875511407852, -0.03229852393269539, 0.09452798217535019, -0.0016025593504309654, -0.013257722370326519, -0.004613615106791258, -0.09337674826383591, -0.02142922393977642, -0.004359354730695486, 0.00043819306301884353, -0.04135272279381752, -0.10876476019620895, 0.04282144829630852, 0.07313399761915207, 0.023112686350941658, 0.08319240063428879, 0.06651347130537033, 0.0057444218546152115, 0.006500292103737593, -0.03853708878159523, -0.015224701724946499, 0.09251324832439423, 0.0128883495926857, 0.05071648210287094, 0.11895481497049332, 0.0513821505010128, -0.009641246870160103, 0.040455274283885956, -0.0238595400005579, -0.08375275880098343, 0.0249833632260561, -0.04786818102002144, -0.010124542750418186, 0.01816999539732933, -0.01013291534036398, -0.05531138926744461, 0.02209746651351452, -0.05986795946955681, -0.0392233170568943, -0.014260266907513142, -0.06503152847290039, -0.05201087146997452, 0.048983123153448105, 0.0013288077898323536, 0.03714162856340408, 0.05728871375322342, -0.07146111875772476, -0.05427240952849388, -0.006261770147830248, -0.0692647397518158, -0.002998819574713707, -0.04427469149231911, 0.00990945752710104, 0.03803792595863342, -0.04090965539216995, -0.028724055737257004, 0.045444268733263016, 0.05212487652897835, 0.02670489065349102, -0.01740390993654728, 0.028432698920369148, -0.044217512011528015, -0.02525877021253109, 0.0118833277374506, 0.0198229793459177, 0.064858078956604, -0.02215363271534443, 0.035120587795972824, -0.0336637906730175, -0.013518491759896278, 0.055762652307748795, -0.055810004472732544, -0.0649520754814148, 0.11769670248031616, -0.05067385733127594, 0.03034995310008526, -0.02426895871758461, 0.09160736203193665, -0.0059380861930549145, 0.04148827865719795, 0.009609407745301723, 0.05460749566555023, 0.01965722255408764, 0.00625337241217494, -0.03250313922762871, 0.07429785281419754, 0.011243762448430061, 0.004689211491495371, -0.03513095900416374, 0.08561049401760101, -0.10934119671583176, -4.658357011982043e-33, -0.02095472812652588, -0.04534712806344032, 0.013302799314260483, 0.0016034359578043222, -0.021099532023072243, 0.01577739790081978, 0.0073685236275196075, 0.0612628310918808, -0.02264569140970707, 0.019413750618696213, 0.06944111734628677, -0.03191070631146431, 0.0594654306769371, -0.04052992910146713, 0.0005324769881553948, 0.03524617850780487, -0.07003353536128998, 0.012233106419444084, 0.03399312496185303, -0.005250035785138607, -0.0849522203207016, 0.07746212929487228, 0.04371742159128189, 0.039969902485609055, 0.003645053831860423, 0.013808646239340305, 0.03687272220849991, 0.09749242663383484, -0.04803578183054924, -0.0077393935061991215, 0.0006102605257183313, -0.0001789516390999779, -0.06253858655691147, -0.023746319115161896, 0.00407228572294116, 0.023373104631900787, 0.08308247476816177, -0.026243116706609726, -0.028267113491892815, -0.04966637119650841, 0.06457039713859558, -0.029977839440107346, -0.06461076438426971, -0.004721845965832472, 0.071896992623806, -0.012145345099270344, -0.02260042540729046, 0.02643773891031742, -0.07884246855974197, -0.016061633825302124, 0.004112107679247856, 0.05628987029194832, -0.013951042667031288, -0.06810826063156128, -0.01740470714867115, 0.04945696145296097, -0.03691042214632034, -0.001427078852429986, -0.011557738296687603, 0.020538676530122757, -0.0006274075130932033, -0.14033977687358856, -0.01801992394030094, 0.07784947007894516, -0.017909366637468338, -9.826396126300097e-05, 0.00781616847962141, 0.08807875961065292, -0.009725721552968025, 0.013734700158238411, -0.08836222440004349, 0.11887810379266739, 0.05582893639802933, -0.012359527871012688, 0.03059406392276287, -0.006552834529429674, -0.05689548701047897, -0.037736184895038605, -0.028306161984801292, -0.020610203966498375, -0.002383612561970949, 0.03251786530017853, -0.050310052931308746, 0.024884724989533424, 0.017664799466729164, 0.041239164769649506, 0.07554856687784195, 0.0947803407907486, -0.0669422522187233, -0.013021949678659439, -0.08910874277353287, -0.024574829265475273, -0.007785006891936064, 0.12234211713075638, -0.02005813643336296, -4.7157669769148924e-08, -0.052161723375320435, 0.06835539638996124, 0.013046713545918465, -0.01886298507452011, -0.047280453145504, 0.023609155789017677, -0.054136015474796295, -0.03038248047232628, 0.04318379610776901, -0.03204254433512688, 0.041206348687410355, -0.039589110761880875, -0.03261924907565117, 0.1087266281247139, -0.07066947966814041, -0.0049016717821359634, -0.019204698503017426, 0.10469115525484085, 0.10040170699357986, -0.005184226203709841, 0.05688847601413727, -0.06280785799026489, 0.03349541872739792, 0.020777007564902306, 0.050988368690013885, -0.004298484418541193, -0.025647178292274475, 0.019947176799178123, -0.0899285227060318, 0.021631067618727684, -0.004413180984556675, -0.03213709592819214, 0.026419417932629585, 0.025767235085368156, -0.02057398110628128, 0.023328032344579697, -0.09100773930549622, -0.009213793091475964, 0.003349646460264921, -0.008176205679774284, 0.023549245670437813, 0.07665235549211502, -0.11119486391544342, -0.013690989464521408, -0.02698964625597, 0.07710070163011551, 0.06288889795541763, -0.024042239412665367, -0.036574576050043106, 0.03236449509859085, 0.10593435168266296, -0.013565395027399063, 0.08303625881671906, -0.0359329879283905, 0.06266056001186371, 0.0424385704100132, 0.03433046117424965, -0.1797531694173813, -0.04408130422234535, 0.006396250333636999, 0.04493066295981407, -0.038503989577293396, -0.03363630175590515, 0.049859825521707535 ] }, { "text": "
\n \n
Figure 2: Finally! :)
\n
", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_10", "embedding": [ 0.09231073409318924, 0.023980699479579926, 0.0652296170592308, 0.03295040503144264, 0.15049512684345245, -0.0005713443970307708, -0.05735907331109047, 0.07612509280443192, 0.0319327674806118, 0.0951378121972084, 0.04945630952715874, 0.019001690670847893, 0.01273516658693552, 0.06102833151817322, 0.04501793906092644, -0.006301918998360634, -0.11093585193157196, -0.0400434285402298, 0.01254934910684824, 0.02445412054657936, 0.007685160730034113, -0.10929226130247116, 0.015690838918089867, -0.06208917871117592, 0.05230504274368286, -0.014320115558803082, 0.04458256810903549, 0.0849306732416153, -0.04416638985276222, -0.0823090597987175, -0.03751259669661522, -0.05904420465230942, 0.02869599498808384, -0.026618171483278275, -0.02943834848701954, 0.09088852256536484, 0.032871149480342865, -0.05899954214692116, 0.05287891998887062, -0.016898855566978455, -0.0034322140272706747, -0.03769253194332123, 0.0934712365269661, -0.06289010494947433, -0.017974350601434708, -0.0050580427050590515, 0.008399375714361668, -0.031567901372909546, 0.051522910594940186, -0.022298291325569153, -0.06962788850069046, 0.009546692483127117, 0.04537271708250046, 0.01829455979168415, 0.00587356835603714, -0.05362943932414055, 0.10047779977321625, -0.10119369626045227, 0.1093147024512291, -0.05696484446525574, 0.02282697893679142, 0.04971739649772644, 0.04345819354057312, 0.006933877710253, 0.06266934424638748, -0.02622290328145027, -0.05876324325799942, 0.01167908776551485, -0.08086467534303665, -0.00946993101388216, 0.0020887681748718023, -0.049738559871912, 0.003928846213966608, -0.0010381751926615834, -0.017606986686587334, -0.056434258818626404, -0.012733261100947857, 0.007062423974275589, 0.031101621687412262, 0.08985530585050583, -0.015027409419417381, 0.014648675918579102, 0.0019862183835357428, 0.027663374319672585, 0.04345488175749779, 0.04314638301730156, -0.0017239153385162354, -0.06162944436073303, -0.04408855736255646, -0.10255120694637299, -0.017443018034100533, 0.0723784938454628, -0.003155618906021118, 0.12950007617473602, -0.03389764577150345, -0.021172715350985527, -0.03388473019003868, -0.05264328420162201, -0.10001885145902634, 0.039972372353076935, 0.08353264629840851, -0.037316396832466125, 0.01276970561593771, -0.01721259020268917, 0.009257077239453793, 0.012306444346904755, 0.04096681997179985, 0.025342030450701714, 0.00637317169457674, 0.005330462008714676, -0.004303033463656902, 0.02011914737522602, -0.15824362635612488, 0.05388467386364937, -0.09012851864099503, 0.023037269711494446, 0.01470253523439169, -0.04253432899713516, 0.045407600700855255, -0.04392276704311371, 0.05429457873106003, 0.11136771738529205, -0.01613285019993782, -0.027718763798475266, 0.11644509434700012, -0.039738547056913376, -0.02385510690510273, 6.583877002714429e-33, 0.02205701358616352, -0.10411375761032104, -0.033634308725595474, -0.003444089787080884, 0.08067966997623444, -0.02745857834815979, -0.08346922695636749, -0.06354518234729767, -0.07826119661331177, -0.06139013543725014, -0.003913209307938814, -0.001271202345378697, -0.019902149215340614, 0.045753363519907, 0.01436460018157959, -0.013221636414527893, -0.02281920053064823, -0.0048105595633387566, 0.040362026542425156, -0.007615913636982441, -0.11454960703849792, -0.055453069508075714, -0.020643731579184532, 0.05514496564865112, -0.042581669986248016, 0.10230409353971481, 0.043387312442064285, 0.012631203047931194, -0.014713911339640617, 0.025602437555789948, 0.02613593451678753, 0.03681960329413414, 0.09573080390691757, -0.04884587228298187, -0.051075685769319534, -0.05496605858206749, -0.03676261380314827, 0.074462890625, -0.0104509387165308, 0.003309852909296751, -0.04221727326512337, -0.06818267703056335, -0.02266519144177437, -0.005928183440119028, -0.020018432289361954, -0.0014336589956656098, 0.02631990797817707, 0.04484415799379349, 0.008313566446304321, 0.01627914234995842, 0.003019126830622554, -0.03426632285118103, -0.04052158445119858, -0.039315979927778244, 0.03204052522778511, -0.006609226111322641, -0.08784669637680054, -0.02020765095949173, -0.023342547938227654, -0.08451897650957108, 0.1374044567346573, 0.019583653658628464, 0.014314668253064156, -0.0026321415789425373, 0.02337711676955223, 0.08135799318552017, 0.07885032892227173, 0.03946210816502571, 0.0053789871744811535, 0.025348138064146042, -0.053890127688646317, -0.03336402773857117, 0.08800878375768661, 0.0064752474427223206, -0.021996373310685158, -0.0025814299006015062, 0.03730307146906853, 0.014804140664637089, -0.04666208475828171, 0.09729474037885666, -0.02058911696076393, -0.02990397997200489, 0.01265772059559822, -0.06257251650094986, -0.07363703101873398, -0.01939701847732067, 0.031322311609983444, 0.008764286525547504, 0.03184056654572487, 0.014051628299057484, 0.017068929970264435, 0.018345799297094345, -0.10818609595298767, -0.013720653019845486, -0.04849657416343689, -4.983601972517169e-33, 0.048418786376714706, 0.07667664438486099, -0.023947730660438538, 0.02173357829451561, -0.05374137684702873, 0.03969646990299225, 0.09210113435983658, -0.09344428777694702, 0.014494636096060276, 0.008681573905050755, -0.0363740436732769, -0.0029835463501513004, -0.09693720936775208, -0.11178237199783325, -0.015941830351948738, -0.01131574995815754, 0.08434480428695679, 0.011727206408977509, 0.002354184864088893, 0.013393684290349483, 0.019350633025169373, 0.004106211010366678, 0.05149058997631073, -0.020602548494935036, 0.011709201149642467, 0.04204019159078598, 0.03527405485510826, 0.007121019531041384, -0.05830151587724686, -0.04460138827562332, -0.012119813822209835, -0.017926789820194244, -0.000561663880944252, 0.0160335972905159, 0.05950070917606354, -0.024831239134073257, -0.01714194007217884, -0.09054616093635559, 0.03575310483574867, -0.02131759375333786, 0.006263650953769684, -0.06542281806468964, -0.035861678421497345, -0.03552745655179024, -0.03479444608092308, -0.0563640259206295, 0.05968620255589485, -0.02278703637421131, 0.09363732486963272, -0.022442573681473732, 0.00791886541992426, -0.08713041245937347, 0.0809817835688591, -0.0019422868499532342, 0.01035939808934927, -0.018565533682703972, -0.021281475201249123, 0.11179957538843155, 0.02748793736100197, 0.09050340205430984, 0.02773016318678856, -0.03400174528360367, -0.046363092958927155, 0.016292329877614975, -0.04779249429702759, 0.02853146754205227, -0.04601871222257614, -0.009513657540082932, 0.008352307602763176, 0.023413708433508873, 0.03415430337190628, 0.06488729268312454, 0.10478422790765762, 0.0041533117182552814, -0.02793312259018421, 0.05401244014501572, -0.024603335186839104, 0.09993050247430801, 0.013808684423565865, -0.07159548997879028, 0.055791184306144714, 0.010079015046358109, -0.11825025081634521, -0.06235511600971222, -0.017793705686926842, 0.0228890273720026, -0.037933994084596634, 0.007388269528746605, -0.001525932690128684, -0.07072259485721588, -0.06611756235361099, 0.03752831742167473, 0.09542757272720337, 0.008097317069768906, 0.005223907995969057, -4.019068100546974e-08, 0.056554317474365234, -0.008704454638063908, 0.07817167788743973, -0.02212231233716011, -0.05786171182990074, 0.07007170468568802, 0.0004587537841871381, -0.05504020303487778, -0.0015303293475881219, 0.0755133256316185, 0.0553690530359745, 0.06453245878219604, 0.03114829771220684, 0.022944023832678795, -0.03150833025574684, 0.04521028697490692, -0.02483382262289524, 0.07938788086175919, 0.06805481016635895, -0.010896136052906513, -0.05549226701259613, -0.027020525187253952, -0.0009665269171819091, -0.016456909477710724, -0.0858331099152565, 0.0473480150103569, -0.048759907484054565, 0.0463012158870697, -0.034749601036310196, -0.09321502596139908, 0.03450046479701996, 0.01427750289440155, -0.011161501519382, -0.05916855111718178, -0.015717053785920143, -0.05239301919937134, -0.06444156914949417, -0.009688707068562508, -0.007339402101933956, -0.047559089958667755, -0.019564000889658928, -0.023633915930986404, 0.027208374813199043, -0.00041529446025379, -0.04774261638522148, 0.0310202669352293, 0.013046635314822197, -0.007049690466374159, -0.03190648555755615, 0.049749378114938736, 0.04268886148929596, -0.04675566032528877, -0.016977384686470032, -0.017350465059280396, -0.02914634719491005, -0.08322986215353012, 0.1303473711013794, 0.004017870873212814, -0.07695529609918594, 0.019515719264745712, 0.05427471175789833, 0.01387521531432867, -0.07067474722862244, 0.01623162068426609 ] }, { "text": "## Key Words\nTiny ML, Arduino, Edge Impulse, Timeout, arduino:mbed", "source": "2021-11-22-Arduino-Edge-Impulse.md", "type": "markdown", "chunk_id": "2021-11-22-Arduino-Edge-Impulse.md_11", "embedding": [ -0.0319431908428669, -0.027091210708022118, -0.005010832566767931, -0.07578317075967789, -0.02581714652478695, -0.004041160922497511, 0.03945783153176308, 0.00029529890161938965, -0.023165468126535416, 0.0007780097657814622, 0.10815925151109695, 0.011952807195484638, -0.04088757932186127, -0.07529205083847046, -0.06784957647323608, 0.061116959899663925, 0.02719774655997753, 0.023366931825876236, -0.04189368709921837, -0.07447992265224457, 0.05867728590965271, 0.046479482203722, -0.03163935989141464, -0.016744758933782578, 0.0038611642085015774, 0.053283195942640305, 0.07595938444137573, 0.031040439382195473, 0.04518436640501022, -0.03273114189505577, 0.059237606823444366, 0.0211144108325243, 0.06375007331371307, 0.02567058987915516, 0.0591018870472908, 0.026005130261182785, 0.013832705095410347, 0.004554653540253639, -0.03305047005414963, -0.07629693299531937, 0.02553115226328373, -0.05771422013640404, 0.011263507418334484, -0.0028045123908668756, 0.058167923241853714, 0.0016744924942031503, -0.008208104409277439, -0.059822481125593185, 0.019996676594018936, -0.09289417415857315, -0.05659797415137291, -0.04270844906568527, -0.04254959151148796, -0.058692991733551025, -0.04281492158770561, -0.08584068715572357, -0.0037245354615151882, -0.0073363748379051685, 0.08106217533349991, 0.022470595315098763, -0.012671373784542084, 0.004049854818731546, 0.00700126588344574, 0.019757715985178947, 0.04928838461637497, 0.024898450821638107, 0.027387581765651703, 0.013469741679728031, -0.01599709503352642, 0.06613043695688248, 0.0044109332375228405, 0.020903099328279495, -0.059910837560892105, 0.05540979281067848, -0.03621714934706688, 0.008430042304098606, 0.005075125955045223, -0.08370564877986908, 0.024768322706222534, -0.05976341292262077, -0.07087516039609909, -0.04772014170885086, -0.04564618319272995, 0.05941147357225418, 0.02599075436592102, -0.011753715574741364, -0.001151659875176847, 0.06630748510360718, 0.029597626999020576, 0.0040061213076114655, -0.06416169553995132, -0.0638299435377121, -0.01811392419040203, 0.0018085152842104435, -0.04011966288089752, -0.0037720371037721634, 0.03621916472911835, -0.07067077606916428, -0.07973958551883698, 0.023010198026895523, -0.040696389973163605, 0.054118864238262177, -0.001547278487123549, 0.0146371740847826, -0.06576163321733475, -0.03267744928598404, 0.054752103984355927, 0.0788148045539856, 0.07540009170770645, -0.03463200479745865, -0.0355994775891304, -0.006221018265932798, -0.04297193884849548, -0.02147117629647255, 0.031723201274871826, -0.05030632019042969, -0.036081474274396896, -0.025357330217957497, 0.045325517654418945, 0.005114326253533363, -0.034380894154310226, -0.008978786878287792, -0.031911998987197876, -0.06851409375667572, -0.06691107153892517, 0.022603385150432587, -0.04526861384510994, 2.0767313595893424e-33, 0.0021681860089302063, -0.062475766986608505, -0.0367249920964241, 0.05081561952829361, 0.04084920883178711, 0.006130410823971033, -0.05534274876117706, -0.04106346517801285, -0.03517802432179451, 0.01792423613369465, -0.074039027094841, -0.11140893399715424, -0.04277968779206276, 0.006045907270163298, 0.05606360360980034, -0.08365415036678314, 0.018786946311593056, 0.029333949089050293, 0.03682275861501694, -0.04992954432964325, 0.04124549403786659, 0.03954785317182541, 0.010189039632678032, -0.0135653642937541, 0.03633900359272957, 0.08499597012996674, 0.014437207952141762, 0.00700373575091362, 0.08737577497959137, 0.0906539112329483, -0.02723279781639576, 0.04712873697280884, -0.10835781693458557, -0.06411918252706528, -0.027034960687160492, 0.018400641158223152, -0.03079923614859581, -0.03678271919488907, 0.008969751186668873, -0.10342544317245483, -0.10552354902029037, -0.04320833086967468, -0.014078177511692047, -0.07890766859054565, -0.0016950084827840328, -0.06372208893299103, -0.017655355855822563, -0.0009335862123407423, 0.04475224018096924, 0.10115990787744522, -0.02805344946682453, 0.005868182517588139, 0.10528445243835449, -0.006662027910351753, 0.039040468633174896, -0.02964995987713337, 0.00443395646288991, 0.13088805973529816, 0.035670116543769836, 0.11689617484807968, 0.047888193279504776, 0.033440783619880676, -0.0059222872368991375, 0.03797459602355957, 0.04173381254076958, 0.015749214217066765, 0.016509579494595528, -0.03309212625026703, -0.06258793920278549, 0.06709198653697968, -0.054634589701890945, 0.046982329338788986, 0.09185776114463806, -0.006046881899237633, -0.02593926526606083, -0.02911350503563881, 0.003659092588350177, -0.057924360036849976, -0.05045556649565697, -0.025690551847219467, -0.07138563692569733, -0.03184710815548897, -0.056823693215847015, -0.09530988335609436, 0.07291454076766968, 0.008485748432576656, -0.014308037236332893, -0.10225292295217514, -0.043182939291000366, -0.003602215787395835, -0.011001487262547016, 0.013108995743095875, -0.025265546515583992, 0.039673205465078354, -0.1168002262711525, -2.3831807164677973e-33, -0.026180380955338478, 0.04729483649134636, 0.042368218302726746, 0.06527978926897049, -0.06692727655172348, 0.010085973888635635, 0.057651251554489136, 0.07525437325239182, -0.008536271750926971, -0.008451823145151138, 0.012452988885343075, -0.012576360255479813, -0.024480756372213364, -0.006525557953864336, 0.0035824368242174387, -0.001638209680095315, 0.024510424584150314, -0.1073983684182167, 0.03949853405356407, 0.03588993847370148, -0.01986585557460785, 0.0008668343652971089, 0.04771500453352928, 0.005942224990576506, -0.007541891653090715, 0.0944748967885971, -0.04318294674158096, 0.11728794872760773, 0.024296632036566734, -0.031844258308410645, 0.04151691868901253, 0.11077909171581268, -0.04775150120258331, 0.033576156944036484, -0.03606753796339035, -0.004884932655841112, 0.10975872725248337, -0.014499222859740257, 0.019624479115009308, -0.02150505594909191, 0.05426640436053276, 0.04871344566345215, -0.012119628489017487, -0.015974581241607666, 0.02014784887433052, 0.09050226956605911, -0.02743767388164997, -0.03532029688358307, -0.0207193773239851, -0.045382123440504074, -0.004857934080064297, -0.003983604721724987, 0.0189459640532732, 0.05921944975852966, 0.008020693436264992, -0.04256899654865265, 0.04112755507230759, 0.07989493757486343, 0.006315293256193399, 0.05696168169379234, 0.004094578325748444, -0.1049668937921524, 0.07576930522918701, -0.0100009860470891, 0.05849270522594452, -0.0033862581476569176, 0.03382904455065727, 0.049189046025276184, -0.1112465187907219, 0.0043207197450101376, 0.06038793548941612, 0.03889574483036995, 0.010272545740008354, 0.006679859012365341, -0.024761643260717392, -0.004329667426645756, -0.04228416830301285, -0.05112435668706894, -0.0040368675254285336, 0.00032953123445622623, 0.06351400166749954, 0.04070863500237465, -0.07875239104032516, 0.04110530763864517, -0.027138570323586464, 0.009647896513342857, 0.028891948983073235, 0.04594442620873451, -0.022814787924289703, -0.0297713465988636, -0.06848377734422684, 0.07857462018728256, 0.06570687144994736, 0.11756563931703568, -0.06657421588897705, -2.454253689165853e-08, -0.05310562625527382, -0.020985538139939308, 0.03539242595434189, -0.0859726294875145, 0.08743712306022644, 0.031257860362529755, -0.08119834959506989, 0.00845944881439209, 0.07395341247320175, -0.06359755247831345, 0.1008271723985672, -0.08705490082502365, -0.04730986803770065, 0.09073375165462494, 0.04861504212021828, 0.018075071275234222, -0.10214545577764511, -0.0030479934066534042, 0.01720435544848442, -0.10620546340942383, -0.016147779300808907, 0.033168725669384, 0.014124318026006222, -0.040727708488702774, -0.0013656190130859613, -0.0475749634206295, 0.01282623503357172, 0.04994489625096321, 0.005149499047547579, -0.0594305694103241, -0.08938045054674149, 0.03008134663105011, 0.056547537446022034, 0.067229263484478, -0.09256990998983383, 0.07626169919967651, -0.0016330049838870764, 0.04098949208855629, 0.04263364151120186, 0.02323659509420395, -0.04758509248495102, 0.002071239985525608, -0.13554894924163818, -0.01817147247493267, 0.023906314745545387, 0.06159478425979614, 0.023859554901719093, 0.03688158094882965, -0.13268370926380157, -0.010815475136041641, 0.029463063925504684, 0.015051602385938168, 0.09131844341754913, -0.0101510314270854, -0.019207751378417015, 0.016397397965192795, -0.01843847706913948, -0.05601682513952255, 0.06842857599258423, 0.04306335374712944, 0.08951708674430847, -0.0010865199146792293, -0.10598298162221909, 0.06399987637996674 ] }, { "text": "---\ntitle: \"Audio Classifier with Edge Impulse\"\nid: \"edge-audio\"\ncategory: \"edge-ml\"\ntags: [\"edge machine learning\", \"arduino\", \"audio\", \"classification\", \"tensorflow\"]\nrelated: [\"edge-motion\"]\ndate: \"2021-01-01\"\ndescription: \"A motion classifier project with Edge Impulse & Arduino\"\n---\n\n\n\nIn this post you can find my second project on Edge Impulse with Arduino Tiny ML kit. I used audio dataset this time. \n\nI would like to thank Coursera and Edge Impulse to give us a chance to learn embedded machine learning. \nFind more about the lecture: [Coursera](https://www.coursera.org/learn/introduction-to-embedded-machine-learning)", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_0", "embedding": [ -0.06849183142185211, -0.1012815609574318, -0.054623205214738846, -0.024130623787641525, 0.003744749817997217, -0.025026556104421616, -0.03601353242993355, -0.06298205256462097, -0.1495400220155716, -0.046848494559526443, 0.03204046189785004, -0.01760730892419815, -0.05312192440032959, -0.025657212361693382, -0.04398857057094574, 0.04089435189962387, 0.06631916761398315, 0.01820649951696396, 0.01032954826951027, -0.007174630183726549, 0.03249112144112587, 0.045459430664777756, 0.043569762259721756, -0.010794532485306263, 0.023311631754040718, 0.08047739416360855, 0.006211548577994108, 0.031632985919713974, 0.06534339487552643, -0.0858498215675354, 0.08860664814710617, 0.04166899621486664, 0.1193549633026123, 0.05053478106856346, -0.016040286049246788, -0.004463464021682739, 0.019980324432253838, -0.02384808100759983, -0.02249152399599552, 0.016860347241163254, 0.009998681023716927, 0.023504845798015594, -0.008036576211452484, -0.07153725624084473, 0.029511023312807083, 0.0039696237072348595, -0.022815216332674026, -0.12548525631427765, -0.01614966429769993, 0.026231564581394196, -0.0510505847632885, -0.08830932527780533, -0.0673123225569725, -0.0012674480676651, -0.1082330122590065, -0.029187774285674095, 0.031066101044416428, 0.04426870495080948, 0.029470505192875862, 0.028848016634583473, 0.006660501938313246, -0.05731748417019844, -0.017801903188228607, 0.004323618486523628, -0.03602880612015724, -0.0037532143760472536, 0.00829315185546875, 0.09591864049434662, 0.009267302230000496, -0.03977622091770172, 0.021556874737143517, -0.01915670558810234, -0.013906590640544891, 0.06255632638931274, 0.04352489858865738, -0.051280636340379715, 0.06170690059661865, -0.0025181740056723356, -0.055628981441259384, 0.018754368647933006, -0.0431157723069191, -0.08623644709587097, -0.0704798474907875, -0.016482092440128326, 0.013567664660513401, 0.029479017481207848, -0.002241381211206317, 0.004398176446557045, -0.08947356790304184, -0.04049469903111458, 0.01874164305627346, -0.034957922995090485, -0.007101940922439098, -0.01157834380865097, 0.08710477501153946, 0.03185788542032242, -0.08190099895000458, -0.061830468475818634, 0.002427180763334036, 0.023045971989631653, -0.0864759236574173, -0.08137945085763931, -0.10913741588592529, 0.026817159727215767, -0.06640778481960297, -0.04351004213094711, -0.002028573537245393, 0.045901231467723846, 0.08423710614442825, -0.00018588799866847694, -0.016445335000753403, -0.01335841417312622, -0.0484880767762661, -0.043195586651563644, 0.032068368047475815, -0.03118949756026268, -0.008577000349760056, -0.02825247310101986, 0.12765683233737946, -0.02097827009856701, -0.0772196352481842, 0.04310619831085205, -0.03258499875664711, -0.015731610357761383, 0.026772653684020042, -0.07848405838012695, -0.09084179997444153, -4.7002210494251284e-34, 0.04990328848361969, 0.010958557017147541, -0.01539947185665369, -0.04177149757742882, 0.12328581511974335, -0.06850756704807281, 0.0032127820886671543, -0.01068404782563448, -0.0011292225681245327, 0.05793729051947594, -0.029598362743854523, -0.0071922712959349155, -0.006084073800593615, 0.03392086550593376, -0.040114887058734894, -0.06680851429700851, -0.056578733026981354, -0.052838027477264404, 0.0026770385447889566, 0.010819760151207447, 0.04800420626997948, 0.04045102745294571, 0.027798697352409363, 0.024377208203077316, -0.001652170205488801, 0.09744849801063538, 0.0610252320766449, -0.040122780948877335, 0.12856969237327576, 0.05013204738497734, -0.1075756773352623, 0.011601509526371956, -0.0372665636241436, -0.017090873792767525, 0.046959590166807175, 0.1042628362774849, -0.026137253269553185, 0.012621148489415646, -0.03687824308872223, -0.07136604189872742, 0.02683049440383911, 0.04081583768129349, 0.014062455855309963, -0.12276685982942581, -0.07054997980594635, -0.0437735877931118, 0.08866782486438751, 0.027871794998645782, 0.07044044137001038, 0.005801428575068712, -0.04681743308901787, -0.06489674001932144, 0.0128343990072608, -0.024567773565649986, 0.014810517430305481, -0.008686169050633907, 0.010869224555790424, 0.11846897006034851, 0.035262592136859894, -0.018168291077017784, 0.02188287489116192, 0.004549535922706127, 0.04999742656946182, -0.02086365595459938, -0.0061445641331374645, 0.025107119232416153, -0.03255182132124901, 0.042830776423215866, 0.0717615857720375, -0.05555850639939308, -0.04459068551659584, 0.04065984487533569, -0.008437206037342548, -0.03292154148221016, 0.02073558233678341, 0.00662196846678853, -0.012956717982888222, -0.018443213775753975, -0.029908258467912674, 0.006924760527908802, -0.06026357039809227, 0.017367107793688774, 0.08889709413051605, -0.06189113110303879, -0.023056665435433388, 0.0738578662276268, 0.006480041891336441, -0.08201806992292404, -0.019108671694993973, 0.03521445393562317, -0.05699072778224945, 0.03022747114300728, -0.05315132066607475, 0.05936017259955406, -0.01848710887134075, -1.6742242777815365e-33, 0.05352010577917099, 0.10607536882162094, 0.0026481992099434137, 0.09670943766832352, 0.07557867467403412, 0.060102324932813644, 0.030096858739852905, 0.09198035299777985, 0.01008921954780817, 0.041217755526304245, 0.010167250409722328, -0.00650800159201026, 0.026851342990994453, -0.013056316412985325, -0.023334147408604622, -0.03756251186132431, -0.038149621337652206, -0.09028797596693039, -0.004704158753156662, 0.026376856490969658, -0.017156952992081642, 0.10439556837081909, -0.004226238001137972, -0.03435469791293144, -0.005434676073491573, -0.013462329283356667, -0.003557424759492278, 0.09634614735841751, 0.028503786772489548, -0.033531587570905685, 0.03165372461080551, -0.05478702485561371, -0.08921314775943756, -0.0891992449760437, 0.007441610097885132, 0.07554193586111069, 0.0726078525185585, -0.0020037677604705095, -0.039479002356529236, -0.023882633075118065, 0.038142088800668716, 0.027517475187778473, -0.04493368789553642, -0.08795380592346191, 0.047799356281757355, 0.003938343841582537, -0.023955993354320526, 0.11364685744047165, -0.049928609281778336, -0.04968720301985741, 0.008500516414642334, 0.01748858019709587, 0.05859798938035965, -0.02764127030968666, 0.03497003763914108, -0.030218418687582016, 0.11485042423009872, 0.02391105145215988, -0.014572313986718655, 0.06674100458621979, -0.05854125693440437, -0.061527714133262634, -0.0380297414958477, -0.013467167504131794, -0.032759979367256165, 0.062128812074661255, -0.011770298704504967, -0.02305435761809349, -0.038858260959386826, 0.04306544363498688, -0.016559284180402756, 0.10508190095424652, 0.0029289608355611563, 0.012029307894408703, -0.07285452634096146, -0.01660735160112381, -0.05999114736914635, -0.010518205352127552, 0.016826163977384567, -0.027150170877575874, -0.0041909110732376575, -0.02175726741552353, -0.05214832350611687, 0.10475961118936539, 0.04260462895035744, 0.08180969208478928, 0.05730932205915451, -0.041216328740119934, -0.038266994059085846, 0.0067011225037276745, -0.07178384065628052, 0.041171737015247345, 0.02955489791929722, 0.03104712814092636, -0.07171550393104553, -4.274061637943305e-08, -0.04362442344427109, 0.06228615716099739, 0.018624374642968178, -0.042092327028512955, 0.03333212807774544, 0.005215401295572519, -0.013361332006752491, 0.02977485954761505, 0.013514194637537003, 0.00936914887279272, 0.034385714679956436, -0.04621196910738945, -0.00670275604352355, 0.05468086153268814, -0.02395930513739586, 0.0511891171336174, 0.007760368287563324, 0.03933407738804817, 0.03283698484301567, -0.0415278822183609, 0.11850139498710632, 0.01169648952782154, 0.0935371145606041, -0.015326473861932755, 0.044612299650907516, -0.0736691802740097, 0.03411879763007164, 0.03861897066235542, 0.026647623628377914, -0.034716129302978516, -0.1396317034959793, 0.07735055685043335, 0.07386201620101929, -0.0817335844039917, -0.0009950409876182675, 0.008836308494210243, 0.01213120948523283, -0.04372700676321983, -0.03160485252737999, 0.020060835406184196, -0.020581062883138657, 0.04214945435523987, -0.03469882532954216, -0.041508715599775314, -0.025663869455456734, 0.029691234230995178, 0.04110746830701828, -0.08042497932910919, -0.04172296077013016, 0.06936552375555038, 0.019944820553064346, 0.055333517491817474, -0.017686715349555016, 0.04743608459830284, 0.12112002074718475, 0.05299048870801926, 0.0015437285182997584, -0.08683239668607712, -0.002432151697576046, 0.025078026577830315, 0.008998117409646511, 0.00011065559374401346, -0.0715162605047226, 0.07282006740570068 ] }, { "text": "In the project description two audio datasets are given, faucet and noise. I added blender audio to this dataset. \nI've run the blender for 2 minutes. Then using Audacity interface, I divided the 2 minute-data to 50 1-second data. \n\n
\n \n
Audacity Interface
\n
\n\n--\n\nRest of the steps are:\n\n- Upload the data\n- Create Impulse\n- Generate Features\n- Model Training\n- Model Testing\n\nI've tried two different feature extraction method. I will explain the details of them later in the post.", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_1", "embedding": [ 0.012751972302794456, -0.052058372646570206, 0.018652046099305153, 0.004837705288082361, 0.07303249090909958, -0.03790656477212906, -0.07818794995546341, -0.0762060359120369, -0.056117892265319824, -0.0806344747543335, 0.05974672734737396, -0.11285784840583801, -0.044089172035455704, -0.03425472974777222, -0.038435984402894974, 0.01504738349467516, -0.0011619420256465673, -0.057268500328063965, -0.06735625118017197, -0.026798436418175697, 0.05340541526675224, -0.038779571652412415, -0.009357582777738571, 0.05884387716650963, 0.12124139070510864, 0.053169071674346924, -0.0200832299888134, 0.004322985652834177, 0.058873362839221954, -0.028148028999567032, 0.08155442029237747, -0.025790713727474213, 0.10989730805158615, 0.008098291233181953, -0.014378615655004978, -0.057955898344516754, 0.013765109702944756, 0.025308657437562943, 0.01752951554954052, -0.10157061368227005, 0.07590461522340775, -0.019527938216924667, 0.015102394856512547, -0.035345658659935, -0.03152452036738396, -0.028656739741563797, -0.03293808549642563, -0.04551049321889877, 0.0694606825709343, 0.04954845458269119, -0.04230774939060211, -0.023981381207704544, -0.05610466003417969, -0.0067087505012750626, -0.05103955790400505, 0.07826858758926392, 0.08361408859491348, 0.015776854008436203, 0.04698016867041588, -0.0009132780833169818, -0.021235158666968346, -0.051636334508657455, -0.041548747569322586, -0.039898887276649475, 0.07383555173873901, -0.06339875608682632, -0.06370025873184204, 0.019808579236268997, 0.03861159458756447, -0.027250222861766815, -0.003928339574486017, 0.07313385605812073, 0.02128898724913597, 0.008404333144426346, 0.044501736760139465, -0.02502824179828167, -0.039286546409130096, 0.03464173153042793, -0.0033477158285677433, -0.032615192234516144, 0.015428822487592697, -0.09228162467479706, 0.04607730731368065, -0.04462761431932449, 0.0005514745134860277, 0.03452135622501373, 0.07645001262426376, -0.04162809997797012, -0.16114255785942078, -0.03460884839296341, -0.05598271265625954, -0.01330255251377821, -0.02028469368815422, 0.03028446063399315, 0.05031130462884903, 0.08389394730329514, 0.027438048273324966, 0.02152225375175476, 0.06102034077048302, 0.006548249162733555, -0.05862891301512718, -0.01680969074368477, -0.02000526338815689, 0.019111158326268196, 0.037054482847452164, -0.05130400508642197, -0.024215692654252052, 0.01665511354804039, 0.01277776900678873, 0.01627163216471672, 0.029955947771668434, 0.051522620022296906, -0.07946118712425232, -0.007601363118737936, 0.11055459827184677, 0.08873631060123444, -0.08874738216400146, -0.04153412953019142, -0.030856722965836525, -0.035944584757089615, -0.038662150502204895, 0.006927106529474258, -0.047073110938072205, 0.013321863487362862, 0.11240895092487335, -0.07285837829113007, 0.0024908282794058323, 7.010765123055236e-33, -0.009607474319636822, -0.04842010512948036, -0.06937922537326813, -0.03676462918519974, 0.05769694596529007, -0.09629502892494202, -0.04245113581418991, 0.03652939200401306, 0.059336211532354355, 0.08522910624742508, -0.02114494889974594, -0.02800050377845764, -0.03341984376311302, -0.04053322225809097, -0.02638898603618145, -0.026417238637804985, -0.007640879601240158, 0.03972266986966133, -0.009637856855988503, 0.03268522769212723, 0.07152304798364639, -0.009056609123945236, 0.018607664853334427, 0.0485001802444458, 0.05427711829543114, 0.0052980887703597546, 0.009730544872581959, 0.03976355120539665, -0.005351736675947905, 0.04675161466002464, -0.04132403805851936, 0.0023851078003644943, 0.0014529350446537137, 0.026943126693367958, -0.030386347323656082, -0.018963702023029327, 0.037787795066833496, 0.052532125264406204, -0.03336716815829277, -0.02621144987642765, 0.02640724927186966, 0.0029869615100324154, -0.023291483521461487, -0.05126090347766876, -0.06219114735722542, -0.041907764971256256, -0.02289750799536705, 0.07327285408973694, 0.026268254965543747, 0.11224441230297089, 0.02771603874862194, 0.024146724492311478, -0.041447363793849945, 0.04700164496898651, -0.06515493988990784, 0.012286611832678318, 0.08434031158685684, 0.001953673781827092, 0.0293206088244915, -0.004898098297417164, 0.05204867944121361, 0.0019918628968298435, 0.017970895394682884, -0.013581844046711922, 0.013378721661865711, 0.07398800551891327, 0.007887465879321098, 0.01642749458551407, 0.11415646970272064, -0.033249225467443466, -0.030857985839247704, -0.023807909339666367, 0.022465435788035393, -0.006798433139920235, 0.07447117567062378, -0.033760543912649155, 0.04040873050689697, 0.02811514027416706, -0.054670996963977814, 0.009570326656103134, 0.015175526961684227, 0.062369637191295624, -0.0279330275952816, -0.06288149952888489, -0.007057314272969961, 0.08030200749635696, -0.01986033283174038, -0.07267653197050095, -0.04011587053537369, 1.2874946150986943e-05, -0.08387269824743271, 0.11247404664754868, -0.012675659731030464, -0.023682529106736183, -0.024279383942484856, -5.567780420547613e-33, 0.07341153919696808, 0.07496477663516998, 0.011714570224285126, 0.06305297464132309, 0.08481777459383011, 0.06028614565730095, 0.0733223408460617, 0.10794717818498611, 0.012538288719952106, 0.00786974560469389, 0.038822244852781296, -0.06008986383676529, -0.09370861947536469, -0.09125532954931259, -0.0709257423877716, -0.021425021812319756, 0.02435729093849659, -0.04849066212773323, 0.05364690348505974, 0.10578758269548416, -0.0021540974266827106, 0.07884800434112549, 0.03268047794699669, -0.008084689266979694, -0.09309029579162598, -0.006501312833279371, -0.022677287459373474, -0.018579866737127304, 0.06448998302221298, -0.009770754724740982, -0.0653521716594696, 0.07334794104099274, -0.08414944261312485, -0.1227279007434845, -0.030756352469325066, -0.03694102168083191, 0.01590157113969326, 0.00314813619479537, 0.02599024772644043, 0.027962418273091316, 0.07255479693412781, 0.05779503285884857, -0.10383617877960205, -0.07356005162000656, -0.0194658562541008, 0.009630203247070312, -0.01912868209183216, 0.022561894729733467, 0.022940585389733315, 0.02193419821560383, 0.09625068306922913, 0.014003356918692589, 0.05131968855857849, 0.03727731108665466, 0.019123442471027374, -0.012532743625342846, 0.08433637768030167, -0.050197046250104904, 0.02327127382159233, 0.09443626552820206, -0.04500759392976761, 0.011592382565140724, -0.07859653979539871, -0.0814383402466774, 0.02109227329492569, 0.05546741560101509, -0.01507660374045372, 0.05621243640780449, -0.015135654248297215, 0.06137103587388992, -0.02160501852631569, 0.03958066552877426, 0.07625136524438858, 0.05232695862650871, -0.04116559028625488, -0.02471286617219448, -0.13153958320617676, -0.06438206881284714, 0.002652216935530305, -0.01636555790901184, -0.03624672442674637, 0.0448317788541317, 0.01704738661646843, 0.07627226412296295, -0.03727811202406883, 0.10275658220052719, 0.034757211804389954, -0.04600720852613449, 0.0026511161122471094, 0.0027002226561307907, 0.008786030113697052, 0.07131031900644302, 0.04735492169857025, 0.08849865198135376, 0.061368294060230255, -5.4677844474326776e-08, -0.02177945338189602, -0.015067570842802525, 0.02399006485939026, 0.00420394167304039, -0.041915711015462875, -0.023561812937259674, -0.0817871019244194, 0.04953991621732712, 0.03000134788453579, -0.09306418895721436, 0.016032908111810684, 0.028310632333159447, -0.06419394910335541, 0.044146887958049774, -0.05216130241751671, -0.06809786707162857, 0.04501552879810333, 0.019923010841012, -0.02420763671398163, -0.15007126331329346, 0.00408425647765398, 0.027601895853877068, 0.04916031286120415, -0.06959281116724014, 0.026616152375936508, 0.03275667503476143, 0.05397860333323479, 0.07716301828622818, -0.06140195205807686, -0.06200923025608063, -0.034264810383319855, 0.021212225779891014, -0.06498043239116669, 0.008126489818096161, 0.009341335855424404, -0.013375717215240002, 0.02948886714875698, -0.0419766828417778, -0.06723953038454056, -0.024847056716680527, -0.060132984071969986, 0.043565526604652405, -0.06278733164072037, -0.03505433350801468, 0.011923964135348797, -0.014017135836184025, 0.09052007645368576, -0.07788614183664322, 0.043252281844615936, 0.04968433454632759, 0.03547480329871178, 0.02958785369992256, -0.06053534895181656, -0.037793178111314774, 0.0850013941526413, -0.00450077373534441, -0.021456094458699226, -0.009413845837116241, -0.012903239578008652, 0.009966718032956123, 0.009174104779958725, -0.027042724192142487, -0.005876029375940561, -0.031829383224248886 ] }, { "text": "### Deployment to Arduino\n\nOn the deployment page, select Arduino and click build. ei-audio_classifier-arduino-1.0.3.zip file is downloaded.\n\nSince I didn't collect the data with Arduino, this is the first time I connected Arduino to the computer. \n\nDon't forget to update the firmware: run flash_windows. After the firmware is updated open the command prompt:\n\n $edge-impulse-daemon --clean.\n\nI reentered my credentials and selected my current project. \n\nSmile :)\n\n [WS ] Device \"myarduino\" is now connected to project \"audio_classifier\"\n [WS ] Go to https://studio.edgeimpulse.com/studio/75736/acquisition/training to build your machine learning model!\n\nNow it is time to use Arduino IDE. From Sketch -> Add Zip Library, select ei-audio_classifier-arduino-1.0.3.zip", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_2", "embedding": [ -0.021635230630636215, -0.0956709235906601, -0.06709247082471848, -0.0030725018586963415, 0.007589069195091724, -0.04784396290779114, -0.007637282833456993, -0.04178433120250702, -0.1095251739025116, -0.019838929176330566, 0.05481337010860443, -0.08553949743509293, -0.12421440333127975, -0.003640536218881607, -0.03057800605893135, 0.03902295231819153, 0.015232480131089687, -0.035468582063913345, 0.020399734377861023, 0.00011267051013419405, 0.08672667294740677, -0.025411061942577362, 0.03132963925600052, 0.0183884110301733, 0.03074493445456028, 0.021512534469366074, 0.08448056876659393, 0.06513084471225739, -0.041855670511722565, -0.06582457572221756, 0.10794489830732346, 0.003998885862529278, 0.14484374225139618, -0.010617678053677082, 0.038999930024147034, -0.04931719973683357, 0.037384916096925735, -0.052551720291376114, 0.00541289895772934, -0.02095157280564308, 0.028546327725052834, 0.0025732736103236675, -0.019441429525613785, -0.045271772891283035, 0.01945929415524006, -0.04575398936867714, -0.022534886375069618, -0.028372956439852715, 0.03539916127920151, -0.023911230266094208, -0.022640474140644073, -0.0879257470369339, -0.011540978215634823, -0.04305468127131462, -0.056917283684015274, 8.198281284421682e-05, 0.08838620036840439, 0.04887659475207329, 0.07117468863725662, -0.016909325495362282, -0.020404238253831863, -0.05641518905758858, 0.0689900815486908, -0.031042488291859627, -0.09944107383489609, 0.021008433774113655, 0.01964726112782955, 0.03076227195560932, -0.010329966433346272, -0.017714673653244972, 0.03365292772650719, 0.07038706541061401, -0.049548082053661346, 0.05029162019491196, 0.046827636659145355, 0.03010101057589054, 0.07048866897821426, 0.08891181647777557, 0.005969547666609287, 0.013970457017421722, -0.05955890193581581, -0.09031199663877487, 0.012932023033499718, -0.00026570563204586506, 0.07565794885158539, 0.06555259972810745, -0.015041008591651917, -0.05702222138643265, -0.007735786959528923, 0.019293587654829025, -0.04588141292333603, -0.05718139559030533, -0.06272411346435547, 0.007943053729832172, 0.08181139826774597, 0.061350882053375244, -0.020015835762023926, -0.023701269179582596, -0.050673700869083405, 0.01624937169253826, -0.10839197039604187, -0.09249494969844818, -0.03535344451665878, 0.030682964250445366, -0.011876748874783516, -0.016914118081331253, -0.005423979368060827, 0.01857752911746502, 0.03712654486298561, -0.03671301156282425, -0.02995712123811245, -0.05633505806326866, -0.037525538355112076, -0.023604176938533783, 0.013749869540333748, 0.07678084075450897, -0.08230512589216232, 0.027822133153676987, 0.0446663424372673, 0.007291944231837988, -0.028119133785367012, 0.041709594428539276, -0.0471574142575264, 0.0014523487770929933, -0.017636096104979515, -0.03247419744729996, -0.0855509340763092, 1.606856512864919e-33, 0.05048835650086403, -0.013362708501517773, -0.08413022011518478, 0.04214584454894066, 0.052553690969944, -0.13936036825180054, -0.03165283426642418, 0.006926123518496752, 0.03441089391708374, -0.00565677136182785, -0.08811487257480621, -0.017531992867588997, 0.007770458701997995, 0.021339815109968185, -0.05539692938327789, -0.018965866416692734, -0.024410519748926163, 0.0020344587974250317, -0.00032770924735814333, -0.0012945587513968349, 0.053232114762067795, -0.05683450773358345, 0.017112072557210922, -0.01811888813972473, 0.019241435453295708, 0.15575836598873138, 0.031104637309908867, -0.03971334919333458, 0.0931779071688652, 0.06113598868250847, -0.03609668090939522, 0.0033659490291029215, 0.04092779755592346, -0.060138098895549774, 0.029915615916252136, 0.039774876087903976, 0.021142233163118362, 0.09777010977268219, -0.029602227732539177, -0.013303558342158794, 0.0813504084944725, 0.003317852970212698, -0.014298511669039726, -0.06904217600822449, -0.0149344177916646, -0.1087636798620224, 0.010826226323843002, -0.002626079134643078, 0.06484431773424149, 0.03636068478226662, -0.015359042212367058, -0.04173363000154495, 0.027245838195085526, 0.055250875651836395, 0.004022711887955666, -0.0672365352511406, 0.0152375353500247, 0.09437783807516098, 0.06588306277990341, -0.08495894819498062, 0.06081432104110718, 0.043560098856687546, 0.03110221028327942, -0.020664032548666, 0.029218392446637154, 0.043925609439611435, -0.010072427801787853, 0.04628213122487068, 0.07166144251823425, -0.028393197804689407, 0.001604355638846755, -0.027648376300930977, 0.003766793292015791, -0.0034242321271449327, -0.003793747164309025, 0.02344347909092903, -0.04142015427350998, 0.031230617314577103, -0.060190726071596146, 0.011356174945831299, -0.015146290883421898, 0.021872317418456078, -0.001862786477431655, -0.057751305401325226, 0.02080303616821766, 0.07648330181837082, 0.034189000725746155, -0.053582362830638885, -0.013997743837535381, 0.061251815408468246, 0.0007809742819517851, 0.03135425224900246, -0.06211303919553757, 0.04733779653906822, -0.015905678272247314, -2.7313551636836508e-33, 0.04082296043634415, 0.06411498039960861, 0.037058647722005844, -0.022704074159264565, -0.0280575230717659, 0.06899618357419968, 0.021926086395978928, 0.08341691642999649, -0.01670113578438759, -0.03962989151477814, 0.018824446946382523, -0.03259747475385666, 0.031975582242012024, -0.061021216213703156, 0.013635846786201, 0.02154984511435032, -0.06525059044361115, -0.02039726823568344, 0.051754195243120193, 0.03457833454012871, -0.0338483601808548, -0.03365975618362427, 0.0349288173019886, -0.040343254804611206, -0.0710027813911438, -0.02548499032855034, -0.008850332349538803, 0.06736116111278534, 0.04204365611076355, -0.0727938562631607, 0.0028572778683155775, -0.03873266652226448, -0.1370922029018402, -0.08382724225521088, 0.019088972359895706, 0.12252455204725266, 0.050474703311920166, -0.04968133196234703, 0.005594621412456036, -0.05290590599179268, 0.0012089982628822327, 0.01139014307409525, -0.05899200960993767, -0.06237814947962761, 0.05784345790743828, 0.01190645806491375, -0.03735389560461044, 0.06148272380232811, -0.048862800002098083, -0.03584899753332138, 0.08542687445878983, 0.05885383114218712, 0.07822931557893753, -0.03741167113184929, 0.006946560461074114, -0.04219809174537659, 0.10442732274532318, 0.02758888527750969, -0.12748107314109802, 0.08339286595582962, -0.01881173439323902, -0.043519653379917145, -0.04354174807667732, -0.06506996601819992, -0.042259715497493744, 0.06266552954912186, 0.02918184921145439, 0.03172924369573593, -0.008684832602739334, 0.01746964268386364, -0.03358316794037819, 0.10121138393878937, 0.022534623742103577, 0.00560880359262228, -0.014323389157652855, 0.02079552784562111, -0.14139868319034576, -0.03151610866189003, 0.009113847278058529, -0.016882596537470818, -0.014207695610821247, 0.026616552844643593, -0.06759632378816605, 0.02686309441924095, 0.015078493393957615, -0.012593034654855728, 0.11791624873876572, 0.015275384299457073, 0.02140583097934723, -0.04255835339426994, -0.060596663504838943, 0.03953896090388298, -0.02016672119498253, 0.09258850663900375, -0.044230226427316666, -5.814276349269676e-08, -0.019476480782032013, 0.10713114589452744, 0.03808395192027092, -0.026778552681207657, 0.0924978107213974, -0.006737832445651293, -0.02155538648366928, 0.010579489171504974, 0.019892938435077667, -0.060591086745262146, 0.030949480831623077, -0.022162482142448425, 0.03528044745326042, 0.08691038191318512, 0.01784445159137249, -0.017885854467749596, -0.04589943215250969, 0.07759752869606018, 0.04629278555512428, -0.11583416908979416, 0.10430052876472473, 0.005351733881980181, 0.06924460083246231, -0.04943825304508209, 0.07492737472057343, -0.10122896730899811, 0.06375925242900848, -0.012112237513065338, -0.057607848197221756, 0.008055212907493114, -0.11006996035575867, 0.046049244701862335, 0.04895113408565521, -0.0005607922212220728, 0.016165737062692642, 0.03742721304297447, -0.06067271903157234, 0.01310622040182352, 0.01592516154050827, -0.02397049032151699, -0.013557842932641506, 0.0721273273229599, -0.027318177744746208, -0.07368522882461548, -0.044436391443014145, 0.023588379845023155, 0.04391906410455704, -0.015226159244775772, -0.01703491434454918, 0.025566376745700836, -0.00453828414902091, 0.0583549328148365, -0.014512148685753345, 0.014181033708155155, 0.05263026803731918, -0.00726656150072813, -0.008913428522646427, -0.07040069252252579, 0.010059535503387451, 0.0078075723722577095, 0.032312121242284775, -0.04065948724746704, -0.09253805875778198, 0.06055518239736557 ] }, { "text": "Now it is time to use Arduino IDE. From Sketch -> Add Zip Library, select ei-audio_classifier-arduino-1.0.3.zip\n\nSelect File -> Examples --> audio-classifier-inferencing- nano_ble33_sense_microphone_continuous \n\nHere comes the final step: I clicked \"Upload\" to compile and send the program to Arduino. Unfortunately, I got this error:\n\n Error sample buffer overrun. Decrease the number of slices per model window (EI_CLASSIFIER_SLICES_PER_MODEL_WINDOW)\n ERR: Failed to record audio...", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_3", "embedding": [ -0.01999775692820549, -0.06330417096614838, -0.05344078317284584, -0.06875120848417282, 0.03124517947435379, -0.05512683838605881, 0.004481585696339607, -0.0079277902841568, -0.10086241364479065, 0.01660224422812462, -0.022929366677999496, -0.11961695551872253, -0.0626491978764534, 0.02008349820971489, -0.0023165273014456034, 0.02354883775115013, -0.008752013556659222, 0.006405640859156847, -0.004344766493886709, 0.004216973204165697, 0.06335888057947159, 0.04668579250574112, 0.06777934730052948, 0.09569382667541504, -0.0027953011449426413, -0.010953478515148163, 0.036460354924201965, -0.0343814343214035, -0.05173572152853012, -0.03253962844610214, 0.06365476548671722, -0.005992462392896414, 0.11465053260326385, -0.04077601805329323, 0.08351588994264603, -0.04377446696162224, 0.011852403171360493, -0.02459094487130642, -0.032961536198854446, -0.07773517817258835, 0.025702059268951416, 0.04982350394129753, -0.07285214960575104, -0.029069894924759865, -0.049511924386024475, -0.11095820367336273, -0.014657213352620602, -0.01753406971693039, 0.03936152160167694, 0.044032949954271317, -0.11831584572792053, -0.02678941935300827, 0.022387947887182236, -0.022008566185832024, -0.03210972622036934, -0.008955349214375019, 0.06453709304332733, -0.008146291598677635, 0.06576040387153625, -0.0248978603631258, 0.01697591319680214, -0.05120683088898659, 0.008062836714088917, -0.020422236993908882, -0.062115639448165894, 0.01827799342572689, 0.043298784643411636, 0.04042568430304527, -0.0014200094155967236, -0.016963358968496323, -0.056192006915807724, 0.06321422010660172, -0.05350164696574211, 0.02271958999335766, 0.05056734383106232, 0.003959378227591515, 0.08254893124103546, 0.04615550488233566, -0.011799618601799011, -0.029815606772899628, -0.05557534843683243, -0.053600434213876724, 0.03975105658173561, -0.02887878194451332, 0.06479266285896301, 0.04623512551188469, -0.01147987600415945, -0.05616646260023117, -0.005671731196343899, -0.01836642064154148, -0.053778402507305145, -0.07259867340326309, -0.09264883399009705, 0.02912312187254429, 0.02569214440882206, -0.028615426272153854, 0.023165090009570122, 0.019963428378105164, -0.0012122767511755228, 0.03268713504076004, -0.05911095812916756, -0.06770257651805878, -0.024423032999038696, 0.027121642604470253, -0.004954930394887924, -0.0866393893957138, 0.06542592495679855, -0.01551925390958786, 0.01740541122853756, 0.002905371366068721, -0.016141841188073158, -0.04157664626836777, 0.011230028234422207, -0.04525817185640335, 0.0989607721567154, 0.15652014315128326, -0.07044669985771179, 0.013446198776364326, 0.013828854076564312, -0.008158907294273376, 0.009662670083343983, 0.06546668708324432, -0.10029806196689606, 0.017756978049874306, -0.013513647951185703, -0.05121798813343048, -0.015608735382556915, -6.086197765666724e-34, 0.03157564625144005, 0.012574820779263973, -0.02034933678805828, 0.057449374347925186, 0.07600028067827225, -0.06694380193948746, -0.023179810494184494, 0.05342722311615944, 0.0014211857924237847, 0.00033962950692512095, -0.038792070001363754, -0.033650510013103485, -0.001403431175276637, 0.0197262242436409, -0.011191328056156635, 0.01666937582194805, -0.08290725201368332, 0.038655512034893036, -0.0018638422479853034, -0.005172627978026867, 0.04015006870031357, -0.07459556311368942, -0.022441474720835686, 0.028901610523462296, -0.0014108793111518025, 0.11894792318344116, 0.07218780368566513, -0.0024454155936837196, 0.08578255772590637, 0.041041817516088486, -0.02035859413444996, -0.0022787624038755894, 0.02311692014336586, -0.06364461779594421, 0.02509397268295288, -0.010554531589150429, 0.042504649609327316, 0.14917248487472534, -0.06374245136976242, -0.07416411489248276, 0.010994215495884418, 0.06257601082324982, -0.02253802865743637, -0.07056833058595657, 0.04238111898303032, -0.07312159985303879, -0.036694467067718506, 0.03443094715476036, 0.020569106563925743, 0.09486701339483261, 0.04987286776304245, -0.009275517426431179, -0.008723982609808445, 0.05426647886633873, -0.05365973338484764, -0.0605284757912159, 0.0505046620965004, 0.05105743184685707, 0.045081157237291336, -0.04833022877573967, 0.07435854524374008, 0.07589481770992279, 0.03797461465001106, -0.03511953353881836, 0.031037718057632446, 0.021354014053940773, -0.04330991953611374, -0.006768414285033941, 0.04038945212960243, 0.032941095530986786, -0.03242788463830948, -0.009500959888100624, 0.009631756693124771, -0.0029304358176887035, -0.04316222295165062, -0.032357294112443924, -0.03910108655691147, 0.02425435744225979, -0.049514297395944595, 0.019821111112833023, -0.008244054391980171, 0.008945593610405922, 0.006530177313834429, -0.10560593008995056, -0.007884780876338482, 0.0033438068348914385, 0.008386493660509586, 0.002948760287836194, -0.026259366422891617, 0.027800042182207108, 0.01867963932454586, 0.03110462613403797, 0.021588096395134926, -0.05455325171351433, -0.058624036610126495, -6.890918698543103e-34, 0.05278059095144272, 0.10681318491697311, -0.008103142492473125, -0.005677978973835707, -0.06350824236869812, 0.041596733033657074, 0.04833116754889488, 0.07911338657140732, -0.0068894377909600735, -0.05943533405661583, -0.022261230275034904, -0.03991236537694931, 0.13290245831012726, 0.034603286534547806, 0.05212860181927681, -0.003453090786933899, -0.046835288405418396, -0.06089653819799423, 0.031226210296154022, 0.05207782983779907, 0.01538749411702156, -0.05584143474698067, 0.04858500510454178, 0.006136044859886169, -0.07257726788520813, -0.0004612656484823674, -0.04788704589009285, 0.07795638591051102, 0.051375240087509155, -0.125715970993042, -0.026746349409222603, 0.022754309698939323, -0.14897966384887695, -0.05439475178718567, 0.022619929164648056, -0.020581867545843124, 0.04548437148332596, -0.01856205426156521, 0.026111848652362823, -0.020583704113960266, 0.008862555958330631, -0.0019935278687626123, -0.028019404038786888, -0.032219551503658295, 0.04035858437418938, 0.029831087216734886, 0.002671261550858617, 0.04586933180689812, -0.05245891213417053, -0.026973320171236992, 0.022233694791793823, -0.02027241326868534, 0.052801117300987244, -0.05792681872844696, 0.01978076994419098, -0.005454991478472948, 0.09270381927490234, 0.010857393965125084, -0.07000800222158432, 0.08233761042356491, -0.013674424961209297, 0.03879491612315178, 0.016353359445929527, -0.13971711695194244, -0.02735176309943199, 0.013826306909322739, -0.003894591936841607, 0.021634921431541443, 0.0003262084792368114, 0.08814215660095215, 0.006537729408591986, 0.10520404577255249, 0.036967989057302475, 0.06860074400901794, -0.01252574473619461, 0.07863957434892654, -0.1262158751487732, -0.06279713660478592, -0.028301725164055824, -0.015620255842804909, 0.0002699275210034102, 0.05532248318195343, 0.07276169210672379, 0.03505358099937439, 0.030903398990631104, 0.07663749903440475, 0.07806139439344406, -0.03764279559254646, 0.008116413839161396, 0.006052366457879543, -0.020171336829662323, 0.044892553240060806, 0.0956152006983757, 0.08046615868806839, -0.001790829817764461, -4.569763945028171e-08, 0.024308128282427788, 0.03877181559801102, -0.021196162328124046, -0.04521317407488823, 0.00328730046749115, -0.030684400349855423, -0.0016757597913965583, -0.01212355773895979, 0.06441843509674072, -0.03367149457335472, 0.05730092525482178, -0.06630144268274307, -0.002826593117788434, 0.12467600405216217, -0.012832209467887878, -0.03764839097857475, -0.05383000150322914, 0.049761638045310974, 0.00827710796147585, -0.12278956174850464, 0.08453848958015442, 0.026512760668992996, 0.016293754801154137, -0.009581419639289379, 0.08224686235189438, -0.1069745197892189, 0.03624281287193298, -0.01869659498333931, -0.04570682719349861, -0.09030800312757492, -0.1189478412270546, 0.03538460657000542, 0.02242027409374714, 0.023208871483802795, 0.0490163154900074, 0.0058665769174695015, -0.027972625568509102, 0.038987208157777786, -0.007596885785460472, -0.03152504563331604, -0.03734791651368141, 0.05205392464995384, -0.031780485063791275, -0.1171889454126358, -0.03259015083312988, 0.004525478929281235, 0.0004334505065344274, -0.011182800866663456, -0.019439026713371277, 0.10140538215637207, -0.07300793379545212, 0.0659923404455185, 0.011109810322523117, 0.02480018511414528, -0.0025401227176189423, 0.014851106330752373, -0.08994606137275696, -0.05412987992167473, -0.03248361125588417, -0.020384585484862328, 0.021225133910775185, -0.017583360895514488, -0.10220303386449814, 0.04272007569670677 ] }, { "text": "I decreased the EI_CLASSIFIER_SLICES_PER_MODEL_WINDOW from 3 to 2 by applying the directions on the website. \nRead more about this problem from: [edge_impulse](https://docs.edgeimpulse.com/docs/continuous-audio-sampling)\n \n /**\n * Define the number of slices per model window. E.g. a model window of 1000 ms\n * with slices per model window set to 4. Results in a slice size of 250 ms.\n * For more info: https://docs.edgeimpulse.com/docs/continuous-audio-sampling\n */\n # define EI_CLASSIFIER_SLICES_PER_MODEL_WINDOW 2\n\n:)\n\nI run the blender, and the result is below :)\nThat's great!", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_4", "embedding": [ -0.007065362296998501, -0.038877472281455994, -0.0022451377008110285, -0.017384402453899384, -0.04133838787674904, -0.08533144742250443, -0.08628447353839874, 0.01840192638337612, -0.052936214953660965, -0.06363429874181747, 0.008529454469680786, -0.1168188750743866, -0.08146822452545166, -0.03857874497771263, -0.059193000197410583, -0.0073564257472753525, 0.02338280901312828, -0.01640532910823822, -0.08865047991275787, -0.052458472549915314, 0.050442688167095184, 0.0018521888414397836, 0.012754913419485092, 0.01172935962677002, 0.02147204987704754, -0.011475421488285065, -0.042625293135643005, 0.03955318033695221, 0.06822723895311356, -0.054518844932317734, 0.17655490338802338, 0.007856398820877075, 0.050356924533843994, -0.01269849669188261, 0.031007513403892517, -0.09137407690286636, -0.03238591179251671, -0.053816333413124084, 0.027088167145848274, -0.03234151378273964, 0.07464086264371872, 0.05800683796405792, -0.039480648934841156, -0.0735960528254509, 0.02709926851093769, -0.012189186178147793, -0.03130221739411354, -0.06460584700107574, 0.03780999407172203, 0.012178453616797924, -0.034430742263793945, -0.00217841356061399, -0.03720078989863396, -0.06393548846244812, -0.03648121654987335, -0.03337070345878601, 0.061276331543922424, 0.05591368302702904, 0.01238543912768364, 0.059329286217689514, 0.0077803414314985275, -0.06485777348279953, 0.021726947277784348, -0.030039766803383827, -0.05254225432872772, 0.026071438565850258, -0.003449470503255725, 0.03641371428966522, -0.016056112945079803, 0.053643930703401566, -0.009034944698214531, 0.05815272778272629, -0.0166949350386858, 0.012319881469011307, 0.08038762956857681, -0.07617563009262085, -0.0035982055123895407, 0.020127015188336372, -0.035445041954517365, -0.012053513899445534, -0.020724395290017128, -0.08466169983148575, -0.040229566395282745, -0.05003904923796654, 0.014406898058950901, 0.01647784188389778, -0.02954382263123989, -0.04810577258467674, -0.012017975561320782, -0.0008108278852887452, 0.024130195379257202, -0.015475849620997906, -0.10255101323127747, 0.059704773128032684, 0.05642658844590187, 0.005164758302271366, -0.030881352722644806, -0.05583607405424118, -0.009410214610397816, 0.031085515394806862, -0.07542256265878677, -0.07723237574100494, 0.0493057481944561, 0.0510714128613472, 0.004443512298166752, -0.02765003591775894, 0.0027152542024850845, 0.09163649380207062, -0.06341131776571274, -0.01860031671822071, 0.052132345736026764, 0.04154901206493378, -0.025874948129057884, 0.043399494141340256, 0.09256614744663239, 0.08534149080514908, -0.006144259124994278, -0.0159043837338686, 0.0570182241499424, 0.020350055769085884, -0.07492367178201675, 0.03495170548558235, -0.10804712772369385, -0.013361251913011074, 0.03317936137318611, -0.025189843028783798, 0.011127143166959286, 8.194793562864493e-34, 0.017238706350326538, 0.01817762851715088, -0.04342946782708168, -0.03992342948913574, 0.0794023796916008, 0.03421856462955475, -0.0033661669585853815, 0.008435421623289585, 0.004874113481491804, 0.013747562654316425, -0.04532581940293312, -0.04023357480764389, 0.003932426683604717, 0.019343769177794456, 0.023879699409008026, -0.08178046345710754, 0.010743272490799427, 0.07161217927932739, -0.07510251551866531, -0.01730753295123577, 0.0966174528002739, -0.034874267876148224, -0.01749696582555771, -0.01995539851486683, -0.04767580330371857, 0.13203375041484833, -0.019324470311403275, -0.03630038723349571, 0.05349193885922432, 0.050521064549684525, -0.031465306878089905, 0.057612888514995575, 0.043792176991701126, -0.05908116325736046, 0.07456015795469284, 0.10876484960317612, 0.04413079470396042, 0.102230004966259, 0.002846886869519949, -0.1103016659617424, -0.013360545970499516, 0.08550430834293365, 0.0756247341632843, -0.019096175208687782, -0.09892039746046066, -0.0592234767973423, 0.021082371473312378, -0.011118761263787746, -0.008566000498831272, 0.07554590702056885, 0.0399198904633522, -0.006056551821529865, 0.05516687035560608, 0.07004723697900772, 0.005998548585921526, -0.06799203902482986, 0.08483665436506271, 0.09872125089168549, 0.05286775529384613, -0.015181451104581356, 0.026134878396987915, -0.006232776213437319, -0.033228255808353424, -0.032786305993795395, 0.06097996234893799, 0.08310268819332123, -0.05304819718003273, -0.03699636459350586, -0.01367233507335186, 0.02146565169095993, -0.017177095636725426, 0.044539447873830795, -0.027370523661375046, 0.03799710422754288, 0.026731939986348152, -0.04983850196003914, -0.006060429848730564, 0.05173391103744507, -0.028077352792024612, -0.010836823843419552, -0.028089284896850586, 0.11003986746072769, -0.0009574427385814488, -0.20764225721359253, 0.00938408449292183, 0.016016393899917603, 0.016083043068647385, 0.021884741261601448, -0.03911801800131798, -0.004964273888617754, -0.00850571971386671, 0.008936096914112568, 0.033374231308698654, 0.038603127002716064, -0.04074482619762421, -1.919162954017338e-33, 0.03300274908542633, 0.06290102005004883, 0.037880681455135345, 0.049027785658836365, -0.02945169061422348, 0.06491898745298386, 0.03139302507042885, 0.1426917463541031, -0.04871544986963272, -0.04164757952094078, 0.04348208010196686, -0.0061300769448280334, 0.049774203449487686, 0.06939047574996948, -0.013791493140161037, -0.050246816128492355, 0.030230948701500893, -0.08364269137382507, 0.047682031989097595, 0.037936050444841385, 0.04954490810632706, -0.0240767952054739, -0.006468229927122593, 0.01222082506865263, -0.03952931985259056, 0.017729463055729866, 0.010187785141170025, 0.03871246427297592, 0.10155186057090759, -0.11814013868570328, -0.0387413464486599, -0.010304131545126438, -0.13772115111351013, -0.10153485089540482, 0.06100735440850258, 0.06235893443226814, -0.052538804709911346, 0.027302447706460953, -0.022816607728600502, 0.025333255529403687, -0.019727420061826706, 0.01972724124789238, -0.032350603491067886, 0.010038807988166809, 0.012808339670300484, 0.0731753557920456, -0.007402911316603422, 0.02295782044529915, -0.11297645419836044, -0.033772487193346024, 0.0028250617906451225, 0.04336181655526161, 0.032968707382678986, 0.056647889316082, 0.030625220388174057, -0.027627553790807724, 0.017419995740056038, -0.030883023515343666, -0.11421649158000946, 0.0008437184151262045, -0.019025007262825966, 0.00549177173525095, -0.0960865393280983, -0.0707116425037384, 0.047235965728759766, 0.04660129174590111, -0.005028218030929565, -0.010646024718880653, 0.03699113056063652, -0.033622048795223236, -0.018354522064328194, 0.05867404118180275, 0.020166125148534775, -0.030403880402445793, -0.06353543698787689, -0.010495836846530437, -0.10967647284269333, -0.04739265516400337, 0.04542415589094162, 0.010345104150474072, -0.10886836796998978, 0.03830205649137497, 0.06227348372340202, 0.0160832442343235, -0.0008985988097265363, -0.02140861190855503, 0.036493927240371704, 0.010680809617042542, 0.007952140644192696, -0.01367803756147623, 0.0036173691041767597, -0.008353181183338165, 0.06224888935685158, 0.10602493584156036, -0.008099560625851154, -4.240045115011526e-08, -0.0573008731007576, 0.03875185549259186, -0.011860719881951809, 0.04191058874130249, -0.017912475392222404, -0.043559059500694275, -0.0054205916821956635, 0.02635822631418705, -0.031195927411317825, -0.060539375990629196, 0.0935540497303009, -0.03676803410053253, -0.0414385050535202, 0.03826432302594185, 0.03194986656308174, -0.017413506284356117, -6.370683695422485e-05, 0.0566561259329319, 0.061264000833034515, -0.06942020356655121, 0.03234998509287834, -0.04813737794756889, 0.0992358848452568, -0.06134963780641556, -0.0030244835652410984, -0.011608107946813107, 0.0528557151556015, 0.015545785427093506, 0.006592382211238146, -0.0490473248064518, -0.05436195060610771, 0.008990135043859482, 0.017385119572281837, 0.06051407754421234, -0.02188241109251976, 0.031744085252285004, -0.0675349086523056, 0.03984835371375084, -0.020313501358032227, 0.015515797771513462, -0.013680518604815006, -0.035688284784555435, -0.07179547846317291, -0.021413061767816544, -0.0350043810904026, 0.0678594633936882, 0.07223590463399887, 0.011681919917464256, 0.029362725093960762, 0.03126705810427666, 0.005748855881392956, 0.021325767040252686, -0.015547194518148899, -0.009552189148962498, -0.0074758692644536495, -0.05885450541973114, -0.04212382435798645, -0.019494766369462013, -0.024199416860938072, -0.012257088907063007, -0.01062098890542984, -0.0573890246450901, -0.12234722077846527, 0.10570911318063736 ] }, { "text": ":)\n\nI run the blender, and the result is below :)\nThat's great!\n\n\n Predictions (DSP: 165 ms., Classification: 253 ms., Anomaly: 0 ms.): \n blender: 0.00000\n faucet: 0.00000\n noise: 0.99609\n Predictions (DSP: 165 ms., Classification: 253 ms., Anomaly: 0 ms.): \n blender: 0.00000\n faucet: 0.00000\n noise: 0.99609\n Predictions (DSP: 165 ms., Classification: 253 ms., Anomaly: 0 ms.): \n blender: 0.62695\n faucet: 0.00000\n noise: 0.37305\n Predictions (DSP: 165 ms., Classification: 253 ms., Anomaly: 0 ms.): \n blender: 0.94531\n faucet: 0.00000\n noise: 0.05469", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_5", "embedding": [ -0.12176278978586197, -0.0744452103972435, 0.0758133977651596, 0.03164283558726311, 0.04548393934965134, -0.1377469301223755, -0.02537497505545616, 0.004038810729980469, -0.02594129927456379, -0.07948516309261322, -0.11851172149181366, -0.04492917284369469, -0.021338345482945442, -0.05773131921887398, -0.12016823887825012, -0.01792198233306408, 0.04750511422753334, -0.06846097111701965, -0.035916734486818314, -0.016289113089442253, -0.02866123802959919, 0.024287613108754158, -0.007917546667158604, 0.038843877613544464, 0.09776205569505692, 0.058918267488479614, 0.01829700358211994, 0.046689990907907486, -0.04060187190771103, -0.05019606649875641, 0.024004055187106133, 0.0368461012840271, -0.006296051666140556, -0.06355322152376175, -0.01198816392570734, -0.03913101553916931, -0.019544053822755814, -0.008201522752642632, 0.046426571905612946, 0.001781699014827609, 0.060392748564481735, 0.031500108540058136, 0.09343861043453217, 0.027164839208126068, 0.044306669384241104, -0.05258423089981079, -0.021411683410406113, -0.10767369717359543, 0.03161546587944031, -0.0275323074311018, -0.0341765470802784, -0.026735737919807434, -0.01801174134016037, -0.05496072396636009, -0.03851402550935745, 0.0381515696644783, 0.04900291562080383, -0.06892876327037811, 0.04597561061382294, -0.02017107419669628, 0.04627528414130211, -0.04531744122505188, -0.05671705678105354, 0.03016950935125351, 0.050194405019283295, -0.019102128222584724, -0.022738821804523468, -0.0037397395353764296, 0.04255405440926552, 0.022916516289114952, -0.06309709697961807, 0.08724107593297958, -0.05255040526390076, 0.03467315807938576, 0.06427951902151108, 0.04604796692728996, -0.020197929814457893, -0.013599805533885956, 0.05235947668552399, 0.016525253653526306, -0.004865860566496849, -0.061394188553094864, -0.021742692217230797, -0.00016619321831967682, 0.05652493238449097, 0.03945623338222504, 0.03992763161659241, -0.019938325509428978, -0.032908543944358826, 0.003642141120508313, -0.018475040793418884, -0.027988264337182045, -0.10392697155475616, 0.03893061354756355, 0.0007492314907722175, 0.1217643991112709, 0.04588918387889862, -0.1054101437330246, 0.054228492081165314, 0.06628098338842392, -0.10035334527492523, 0.0027481967117637396, 0.05281822755932808, 0.027691619470715523, 0.08717209100723267, -0.03807859867811203, 0.04206748679280281, 0.023663414642214775, -0.004082014784216881, -0.062632717192173, 0.0059487484395504, -0.0038900712970644236, 0.0044974228367209435, -0.004555143415927887, -0.01641896925866604, 0.005016392562538385, -0.038774002343416214, 0.03663003072142601, -0.09791965037584305, 0.0627184584736824, -0.041272446513175964, 0.03337525203824043, -0.019860146567225456, -0.0059219482354819775, 0.05892976373434067, 0.04034395143389702, -0.10558304935693741, 1.0454657207749355e-32, 0.020218785852193832, -0.029135065153241158, 0.030134420841932297, -0.07174185663461685, 0.07416265457868576, -0.015464738942682743, -0.07830004394054413, 0.005553663242608309, 0.001035544672049582, 0.09088489413261414, -0.04894392192363739, -0.04760541021823883, -0.050364717841148376, 0.0038890379946678877, 0.03316137194633484, -0.018528616055846214, 0.0005680128815583885, 0.060150276869535446, -0.11940039694309235, 0.009912529028952122, 0.0660131648182869, -0.02076711878180504, -0.058869555592536926, -0.06281872093677521, 0.0293568205088377, 0.07013668119907379, 0.008682089857757092, 0.07724728435277939, -0.02967851050198078, 0.04121355339884758, -0.033498164266347885, 0.0587502084672451, 0.014416167512536049, 0.00787727627903223, 0.015160144306719303, -0.020698118954896927, -0.04607595503330231, 0.015868740156292915, 0.027541784569621086, -0.02896379679441452, -0.010486988350749016, -0.011961393058300018, -0.021110331639647484, -0.017573852092027664, 0.07843712717294693, -0.006627659313380718, -0.030955536291003227, -0.00035060610389336944, 0.03139367699623108, 0.03276344761252403, -0.012267948128283024, -0.013257481157779694, -0.0253730621188879, 0.1563705950975418, -0.035536520183086395, -0.04999253898859024, 0.0789477676153183, -0.03822242468595505, -0.005858348682522774, 0.03068557009100914, -0.03706473112106323, 0.0304504856467247, -0.04867078363895416, -0.10118478536605835, 0.02974802814424038, 0.07456321269273758, 0.026787230744957924, 0.06485506147146225, 0.04502061754465103, 0.04979289695620537, 0.04133014753460884, -0.0017509552417322993, -0.028696218505501747, -0.00046170628047548234, 0.08274894207715988, -0.01981152594089508, 0.034839171916246414, 0.0857224240899086, -0.03560180589556694, -0.02760447934269905, -0.04893675073981285, 0.014669869095087051, -0.03615861386060715, -0.05954250693321228, -0.06293965131044388, 0.0067255026660859585, -0.02440161071717739, 0.0006496275891549885, -0.029385296627879143, 0.03299279510974884, -0.10351615399122238, 0.033485352993011475, 0.04328063502907753, 0.0317225344479084, -0.15551649034023285, -9.756132914084657e-33, -0.07708410918712616, 0.03215886279940605, 0.014985422603785992, 0.07902098447084427, -0.055958379060029984, -0.013252235017716885, 0.013593199662864208, 0.06840671598911285, 0.027074456214904785, 0.019399451091885567, 0.04782804474234581, 0.06057954579591751, 0.02239280566573143, -0.0285271555185318, -0.011592472903430462, 0.02054857648909092, -0.01022146176546812, -0.03483551740646362, 0.02273787185549736, 0.028003646060824394, 0.038690365850925446, 0.1056027039885521, -0.038065068423748016, -0.038848258554935455, -0.054167117923498154, 0.025108644738793373, -0.056592028588056564, 0.030054455623030663, -0.03288675472140312, -0.0500510111451149, -0.06457819789648056, 0.015344122424721718, -0.025660863146185875, -0.04351092129945755, 0.04069988802075386, 0.026537565514445305, 0.024929611012339592, -0.022548794746398926, -0.025209028273820877, 0.0316334031522274, 0.04825267568230629, 0.034017015248537064, -0.056894779205322266, 0.006278164219111204, 0.009660541079938412, 0.026044150814414024, 0.025977395474910736, -0.027923332527279854, 0.031157080084085464, 0.026561442762613297, -0.0006921049789525568, 0.08042532950639725, -0.01936618611216545, 0.10833999514579773, -0.005488840863108635, 0.018969306722283363, 0.027844639495015144, -0.022447386756539345, -0.03080536052584648, 0.0958748608827591, 0.009263268671929836, 0.0674375593662262, -0.06541461497545242, 0.025339296087622643, 0.09002024680376053, 0.04962887987494469, -0.05382534861564636, 0.05676707252860069, 0.05847213417291641, -0.006168156862258911, -0.0011220038868486881, 0.04312872886657715, -0.06043529883027077, 0.012339998967945576, 0.05341438576579094, -0.047313716262578964, -0.05324149876832962, -0.03446032479405403, 0.008854972198605537, 0.08061926811933517, -0.031033258885145187, 0.05247534438967705, 0.06819703429937363, 0.07300714403390884, 0.011241903528571129, 0.0030146061908453703, 0.01362601388245821, -0.01657789759337902, 0.030282868072390556, 0.00029422229272313416, -0.05002325773239136, 0.05734807252883911, -0.006343713495880365, 0.05967150256037712, 0.0046323067508637905, -6.042521505378318e-08, -0.0255296491086483, -0.011726860888302326, 0.04424568638205528, 0.02205454558134079, 0.060325656086206436, -0.027581149712204933, -0.09741179645061493, 0.06667427718639374, -0.09566458314657211, -0.02902837097644806, 0.06227592006325722, -0.04356498643755913, -0.15392115712165833, 0.010073596611618996, 0.10060874372720718, -0.08527135103940964, -0.04493413493037224, 0.03558195382356644, -0.071924589574337, -0.12943892180919647, 0.040497127920389175, 0.035633623600006104, 0.05124306306242943, -0.06570927798748016, 0.011120034381747246, -0.04115496203303337, 0.039439890533685684, 0.09574427455663681, -0.046997446566820145, 0.02233901433646679, -0.02571549080312252, -0.0029875505715608597, -0.002835333114489913, -0.002336818492040038, -0.08535744249820709, 0.04987594112753868, -0.003901153337210417, -0.02025741897523403, 0.0837688222527504, -0.00035418575862422585, -0.0679025873541832, -0.012188181281089783, -0.06779713183641434, 0.04401198402047157, -0.03106776252388954, -0.013475626707077026, 0.0035602592397481203, -0.08211743831634521, 0.09736413508653641, 0.008901798166334629, 0.04150361940264702, 0.031619589775800705, -0.019322659820318222, 0.01743406057357788, 0.06479132175445557, -0.05334708094596863, -0.054012540727853775, -0.07807262986898422, -0.1094396710395813, 0.02408490516245365, 0.0893101915717125, -0.02323584258556366, -0.06574641168117523, 0.021357687190175056 ] }, { "text": "## Feature Extraction\n\nI got better results with MFE Feature Extraction. I used 2d conv net for MFE, while I used 1DConv for MFFC.\n\nMFCCs are commonly derived as follows:\n- Take the Fourier transform of (a windowed excerpt of) a signal.\n- Map the powers of the spectrum obtained above onto the mel scale, using triangular overlapping windows or alternatively, cosine overlapping windows.\n- Take the logs of the powers at each of the mel frequencies. \n- Take the discrete cosine transform of the list of mel log powers, as if it were a signal.\n- The MFCCs are the amplitudes of the resulting spectrum. [wikipedia](https://en.wikipedia.org/wiki/Mel-frequency_cepstrum)\n\nMFE:", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_6", "embedding": [ 0.029282130300998688, -0.03526091203093529, -0.03011133521795273, 0.012860188260674477, 0.07916250079870224, 0.06108469143509865, -0.03827740624547005, 0.022223258391022682, -0.023110171779990196, -0.03361646085977554, -0.03338281810283661, -0.13599099218845367, 0.007548039313405752, 0.017946407198905945, -0.03123721480369568, 0.007619410287588835, 0.04798709228634834, 0.07562039792537689, 0.0205412358045578, -0.010426808148622513, 0.035056326538324356, 0.0030313755851238966, -0.01705675572156906, -0.0336887501180172, 0.046977072954177856, 0.008971203118562698, -0.03070245124399662, -0.0016652265330776572, 0.07639011740684509, -0.019650815054774284, 0.06044116988778114, 0.0876220315694809, 0.038154758512973785, 0.05561799183487892, 0.02405722811818123, -0.09165678918361664, 0.048666417598724365, 0.007242539897561073, -0.04290005937218666, -0.052701327949762344, 0.011409248225390911, 0.06174672394990921, 0.0657086968421936, -0.05089009553194046, 0.07586591690778732, 0.024802841246128082, -0.052377935498952866, -0.042458225041627884, -0.020516429096460342, -0.03095877356827259, 0.036067258566617966, 0.06252032518386841, -0.10026095062494278, 0.09759819507598877, 0.04569537192583084, 0.02621866576373577, 0.0035579141695052385, -0.05965910851955414, 0.0870036631822586, 0.020592624321579933, 0.007363428361713886, -0.024496423080563545, -0.017709145322442055, -0.016454225406050682, 0.08914029598236084, 0.026931829750537872, -0.032239362597465515, 0.009919469244778156, 0.10079387575387955, -0.08377279341220856, -0.14755894243717194, -0.029799971729516983, -0.008539889939129353, -0.04608239606022835, 0.015496603213250637, 0.15823282301425934, -0.055823396891355515, 0.01236320473253727, 0.009982112795114517, -0.01285477913916111, -0.026319853961467743, 0.04859960079193115, 0.03376856446266174, -0.04856804013252258, 0.052938297390937805, 0.0240737684071064, -0.0184781551361084, 0.009306580759584904, -0.02532694861292839, 0.08261619508266449, 0.002720225602388382, -0.010094565339386463, -0.039695922285318375, -0.022551417350769043, -0.049111366271972656, -0.04449543356895447, -0.018535200506448746, 0.022374970838427544, 0.06050913408398628, 0.030511151999235153, -0.025819206610322, -0.020506979897618294, 0.030984532088041306, 0.02896624431014061, -0.07883846014738083, -0.013473798520863056, 0.026000643149018288, 0.03154459968209267, 0.07903040200471878, -0.04195095971226692, 0.05418095737695694, 0.035745907574892044, -0.037303946912288666, -0.06320201605558395, 0.16476349532604218, 0.038385678082704544, 0.04709017649292946, 0.02740035019814968, 0.05129485949873924, 0.009643983095884323, -0.036628324538469315, -0.10233260691165924, -0.06723686307668686, -0.015820249915122986, -0.015233398415148258, 0.04908352717757225, -0.03918297216296196, 2.8549499458069678e-33, -0.025526564568281174, 0.07473088800907135, 0.03941505774855614, 0.03185621649026871, 0.05214317888021469, 0.020853295922279358, -0.02873789705336094, -0.048991747200489044, 0.08055640012025833, 0.06273670494556427, -0.06362958252429962, 0.17579299211502075, -0.0366608202457428, -0.031109683215618134, -0.09674888849258423, -0.07330487668514252, -0.02007577382028103, -0.0903448760509491, -0.011114919558167458, 0.007429644465446472, -0.0013725163880735636, 0.094242624938488, 0.06566298753023148, -0.047428034245967865, 0.037653226405382156, -0.03801511973142624, -0.06052223965525627, 0.03974445164203644, 0.02299068123102188, 0.04287159442901611, -0.031804464757442474, 0.02747154049575329, -0.027271797880530357, -0.010615773499011993, -0.035825878381729126, -0.05792279168963432, 0.03807618096470833, -0.050891585648059845, -0.010959451086819172, -0.0827266126871109, -0.026391921564936638, -0.015028880909085274, -0.0005270586116239429, -0.04804074019193649, -0.10665255039930344, -0.03189285099506378, -0.047394782304763794, 0.05391770601272583, 0.06712362915277481, -0.01204676553606987, 0.02726958692073822, -0.01040860265493393, -0.08126403391361237, -0.04893501475453377, 0.02901008166372776, 0.021528445184230804, 0.016474658623337746, -0.0064156739972531796, 0.03369453176856041, 0.12106173485517502, -0.02913331799209118, 0.012037930078804493, -0.00249019218608737, -0.018978167325258255, 0.025415511801838875, -0.05715962126851082, -0.06110743060708046, 0.06576042622327805, -0.005955435335636139, 0.011750055477023125, -0.0004154272610321641, 0.07664190977811813, 0.04527890309691429, -0.09401935338973999, 0.05024062842130661, -0.006737167946994305, 0.0221589133143425, 0.0477437861263752, -0.06144440546631813, -0.007721083704382181, -0.0054059019312262535, 0.08752251416444778, 0.010075587779283524, -0.08498561382293701, -0.0014330256963148713, 0.013094003312289715, -0.04615508392453194, -0.07925404608249664, -0.06668269634246826, -0.07338602840900421, -0.06648197770118713, 0.05233323946595192, 0.10536567121744156, 0.061651553958654404, -0.09733588993549347, -2.3020106274916105e-33, 0.01606598123908043, 0.049621500074863434, 0.00365561805665493, -0.03210080415010452, -0.02142169326543808, 0.03647303581237793, 0.03853140398859978, 0.005309168249368668, -0.025157887488603592, -0.08903194218873978, 0.03582669794559479, -0.06272780150175095, 0.00391510920599103, -0.054547056555747986, -0.005262266844511032, -0.0669005960226059, -0.023002874106168747, 0.01859254762530327, -0.014539571478962898, 0.06298281997442245, -0.0276191346347332, 0.028051698580384254, -0.057668205350637436, 0.03029022552073002, -0.09318823367357254, 0.04893599823117256, -0.015886832028627396, -0.0382147952914238, -0.03036891296505928, 0.045746710151433945, -0.015745701268315315, 0.027016516774892807, -0.05262479931116104, -0.0025773043744266033, 0.008519872091710567, -0.060617394745349884, 0.058669254183769226, 0.00497521972283721, 0.00737184239551425, -0.010051952674984932, 0.0037273429334163666, 0.09116993844509125, -0.043883372098207474, -0.027369588613510132, -0.03764962777495384, 0.060884490609169006, 0.017243200913071632, 0.04800056293606758, 0.08832473307847977, 0.05151693522930145, 0.004037373699247837, -0.04757736623287201, -0.08625375479459763, 0.027374301105737686, -0.08790384978055954, 0.042139071971178055, 0.0324753001332283, -0.0008477044757455587, 0.03701641410589218, 0.02157517895102501, -0.0765773355960846, -0.05848004296422005, -0.020255371928215027, -0.077712282538414, 0.08180253207683563, 0.09212824702262878, 0.08666792511940002, 0.07030072063207626, -0.022777434438467026, -0.019945796579122543, 0.056656185537576675, -0.01515920925885439, -0.018114442005753517, -0.028922604396939278, -0.033773720264434814, -0.06278177350759506, -0.014963716268539429, -0.08853822946548462, -0.044944241642951965, -0.005445650778710842, -0.0073051899671554565, 0.015253567136824131, -0.001741899410262704, 0.0032759092282503843, 0.053556058555841446, -0.0018401842098683119, 0.021473024040460587, -0.08258795738220215, 0.09060249477624893, 0.002265523886308074, -0.04436401277780533, 0.09301217645406723, -0.017774784937500954, 0.03817082196474075, 0.09098373353481293, -5.033314565139335e-08, -0.030553067103028297, -0.11172507703304291, -0.06368610262870789, -0.04415770620107651, 0.012469850480556488, 0.04519515484571457, -0.07017756253480911, -0.0005721249617636204, -0.009801158681511879, -0.019074661657214165, 0.039315275847911835, -0.07817257195711136, -0.10100261121988297, -0.010492172092199326, 0.046678103506565094, 0.0009933456312865019, -0.006380886770784855, 0.056813664734363556, 0.03361326456069946, -0.01941569149494171, -0.020936377346515656, 0.01276439055800438, 0.1325647085905075, 0.03722716495394707, -0.04108678176999092, -0.07433395087718964, -0.04602333903312683, 0.05954635515809059, 0.011970705352723598, 0.05344535410404205, -0.02641000598669052, -0.00771387480199337, -0.013728784397244453, 0.03193529695272446, 0.0022550758440047503, 0.03411861136555672, -0.023171916604042053, 0.02827303484082222, -0.04357914626598358, 0.05705227330327034, 0.0025600676890462637, 0.04627292975783348, -0.0420791395008564, 0.010326801799237728, -0.04133356735110283, 0.035875529050827026, 0.005550272297114134, 0.043793030083179474, 0.005744978319853544, 0.13020670413970947, 0.022151848301291466, 0.01709207519888878, -0.03365543484687805, -0.014782343991100788, -0.060369472950696945, -0.060510482639074326, -0.05631507933139801, 0.013058527372777462, 0.04287725314497948, -0.03778095915913582, -0.016195647418498993, 0.005247957073152065, 0.03447750210762024, -0.047742653638124466 ] }, { "text": "MFE:\n\nThe Mel-scale is a perceptual scale of pitches judged by listeners to be equal in distance from one another. \nThe idea is to extract more features (more filter banks) in the lower frequencies, \nand less in the high frequencies, thus it performs well on sounds that can be distinguished by human ear. [edge_impulse](https://docs.edgeimpulse.com/docs/audio-mfe)\n\n\n
\n \n
DSP
\n
\n\n--\n\n
\n \n
Parameters
\n
\n\n--", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_7", "embedding": [ 0.06323480606079102, -0.06631490588188171, -0.0032101860269904137, -0.026413120329380035, 0.043489720672369, 0.034149475395679474, -0.03772727772593498, 0.019921697676181793, -0.04208074137568474, -0.05808844789862633, 0.01136692799627781, -0.14058203995227814, -0.01880861073732376, 0.008726139552891254, 0.012527641840279102, 0.031053630635142326, 0.09393996745347977, 0.09603936225175858, -0.008567128330469131, -0.023858103901147842, 0.02983591891825199, -0.04294000566005707, 0.04510604962706566, -0.047588832676410675, 0.020607145503163338, 0.04196460545063019, -0.04092210903763771, 0.06658264249563217, 0.030248956754803658, -0.10000154376029968, 0.1512002795934677, 0.08147784322500229, 0.15991419553756714, 0.0125156594440341, -0.052915796637535095, -0.01206579152494669, 0.016402604058384895, -0.01410694606602192, -0.03314552083611488, -0.0468616858124733, -0.04284565895795822, 0.05520891398191452, 0.019339103251695633, -0.10092560201883316, 0.01826503686606884, -0.025576699525117874, -0.06695585697889328, -0.06668108701705933, -0.03733533248305321, -0.003249058034271002, 0.0020287835504859686, -0.03816651180386543, -0.0865943655371666, 0.04054463282227516, 0.00310978083871305, 0.03827080875635147, 0.06486528366804123, -0.0230423454195261, 0.08717520534992218, 0.05077116936445236, -0.0030712781008332968, -0.057695209980010986, 0.03300236538052559, -0.045112259685993195, 0.0539763867855072, 4.654609256249387e-06, -0.035004209727048874, -0.034047774970531464, 0.025858433917164803, -0.05533335357904434, -0.02645118348300457, -0.035711146891117096, -0.020486140623688698, 0.009950345382094383, 0.04235074669122696, 0.07292342185974121, 0.009344251826405525, 0.004113495349884033, -0.05462706834077835, 0.024635497480630875, -0.04536503180861473, -0.0889802873134613, -0.025239327922463417, -0.0539151132106781, 0.06521432846784592, 0.04821277782320976, 0.03257153183221817, -0.06001605466008186, -0.0944029912352562, 0.05638503655791283, -0.016212210059165955, 0.008862342685461044, -0.12656761705875397, 0.006670941133052111, 0.05153699591755867, -0.016933204606175423, -0.07138684391975403, -0.05127785727381706, 0.013068395666778088, 0.04443361610174179, 0.03284115344285965, -0.10352665930986404, -0.01724536158144474, 0.006428966764360666, 0.03954711928963661, -0.0533311627805233, -0.023825453594326973, 0.025505676865577698, 0.038031164556741714, -0.05375704541802406, 0.04940396919846535, 0.012663827277719975, -0.05717015638947487, 0.02626114711165428, 0.05035877227783203, 0.003736643586307764, 0.041144974529743195, 0.0006548138917423785, 0.10366623848676682, -0.0285000242292881, 0.04975637048482895, -0.012921920046210289, -0.11123401671648026, -0.06652683019638062, 0.0007548267021775246, -0.0071920533664524555, -0.07626140117645264, 6.023998594309374e-33, 0.024893607944250107, 0.04428084194660187, -0.01288673561066389, -0.05534065142273903, 0.08378491550683975, -0.014908422715961933, -0.1020876094698906, -0.05667037144303322, -0.00036978162825107574, -0.000505241914652288, -0.07684904336929321, 0.09228633344173431, -0.03668211027979851, -0.008648063987493515, -0.016249412670731544, -0.08203481137752533, -0.016879504546523094, 0.011564415879547596, 0.006198836024850607, 0.009537620469927788, -0.028062285855412483, 0.028311138972640038, 0.006075705401599407, -0.007460246793925762, 0.03967798873782158, 0.08249601721763611, -0.0015833291690796614, -0.0500655472278595, 0.06984938681125641, 0.01558657642453909, -0.08123154193162918, 0.019620932638645172, 0.02728683315217495, -0.0171895083039999, -0.03302663192152977, 0.0063810283318161964, -0.0075261881574988365, 0.012514010071754456, -0.03179800137877464, -0.10856829583644867, 0.013524732552468777, 0.07949505746364594, -0.00421137735247612, -0.027822140604257584, -0.081660196185112, -0.024309782311320305, -0.048559222370386124, 0.02897770144045353, 0.039158906787633896, 0.05304892361164093, 0.013660306110978127, -0.027618808671832085, 0.032826315611600876, 0.04379366710782051, 0.09554987400770187, -0.040373194962739944, 0.007658552844077349, 0.04327170550823212, 0.02218734659254551, 0.007918993942439556, 0.11323424428701401, -0.017723307013511658, 0.01967610791325569, -0.012985458597540855, 0.06972597539424896, 0.07140645384788513, -0.03996424749493599, 0.04529869928956032, 0.0020708793308585882, -0.04854545742273331, -0.02813328430056572, 0.08687133342027664, 0.08402368426322937, -0.011837753467261791, -0.07294562458992004, -0.04394469037652016, 0.006973623763769865, 0.04135019704699516, 0.007944983430206776, -0.0018138826126232743, -0.0799265205860138, 0.12841539084911346, -0.007615734823048115, -0.10788436979055405, -0.038828399032354355, 0.10886400192975998, -0.03632974997162819, -0.08723882585763931, -0.05561331659555435, -0.007423841394484043, -0.04572637006640434, 0.0656035766005516, -0.04778335615992546, 0.02014921046793461, -0.09024692326784134, -5.022073698567675e-33, -0.013204029761254787, 0.10319982469081879, 0.01276068203151226, 0.10770776122808456, -0.008022335357964039, 0.09193240851163864, 0.12139692157506943, 0.00021165698126424104, -0.029935656115412712, -0.0016717258840799332, -0.004179995972663164, -0.02299199253320694, 0.02689492516219616, -0.10376393049955368, -0.02163873240351677, -0.08119115233421326, 0.015656359493732452, -0.03260163590312004, 0.0011157263070344925, 0.08627939224243164, -0.010945869609713554, 0.09527716785669327, -0.026659497991204262, 0.0395941399037838, -0.09455172717571259, 0.041356321424245834, -0.06394366919994354, -0.028502246364951134, -0.03365273028612137, -0.0601208433508873, 0.043978821486234665, 0.005094105377793312, -0.07080049812793732, -0.09833043068647385, 0.09360615164041519, -0.009446532465517521, 0.011051204055547714, 0.018319502472877502, -0.025220369920134544, 0.0578499361872673, -0.0060671791434288025, 0.06546395272016525, -0.04157313331961632, -0.0642443522810936, -0.03202098608016968, 0.06549642980098724, -0.018387997522950172, 0.044192854315042496, 0.014302308671176434, 0.018574725836515427, 0.011380118317902088, 0.008497682400047779, -0.012801818549633026, -0.0019739093258976936, -0.07758118957281113, -0.027100997045636177, 0.01275620423257351, -0.004963683430105448, -0.03705614060163498, 0.09246223419904709, -0.02040116861462593, -0.06432140618562698, -0.07791446149349213, -0.07391175627708435, -0.021107258275151253, 0.14853155612945557, -0.013133716769516468, -0.027991659939289093, 0.0246153324842453, 0.02771010622382164, 0.01589241996407509, 0.02256990596652031, 0.05106770992279053, -0.01580442301928997, -0.022216595709323883, 0.009179743938148022, -0.054985810071229935, -0.028863385319709778, -0.011459453031420708, -0.027786672115325928, -0.012215015478432178, 0.05635586380958557, 0.00813259743154049, 0.02960645593702793, 0.01397649571299553, 0.0009291712194681168, -0.01973695307970047, -0.033337563276290894, 0.0247038546949625, 0.028094002977013588, -0.02911473996937275, 0.04864099249243736, -0.021216658875346184, 0.04731587693095207, 0.03478928655385971, -5.4780329605819134e-08, -0.027606358751654625, -0.04328165948390961, -0.03132641687989235, -0.0539836660027504, -0.03926537185907364, -4.659064506995492e-05, 0.019007647410035133, -0.031245773658156395, -0.008767731487751007, 0.013637136667966843, 0.06498819589614868, -0.04470636695623398, -0.06397610902786255, 0.09125559777021408, -0.0030938107520341873, 0.004413846414536238, 0.012065919116139412, 0.12788492441177368, 0.024258095771074295, -0.032870903611183167, -0.020847400650382042, 0.055750418454408646, 0.05654675140976906, -0.016851209104061127, 0.0026167514733970165, -0.018723078072071075, -0.01886201649904251, 0.059527963399887085, 0.027480363845825195, 0.006795586086809635, 0.01759762316942215, 0.04024451971054077, 0.0078164953738451, 0.025720536708831787, -0.06098715588450432, -0.00143688905518502, -0.11132263392210007, 0.05881187692284584, -0.038465067744255066, 0.08641373366117477, 0.010933850891888142, -0.020185379311442375, -0.07039682567119598, 0.014663255773484707, -0.037540748715400696, 0.0007021028432063758, 0.0795285701751709, -0.04433363303542137, -0.0238609928637743, 0.1347682625055313, 0.025380074977874756, 0.06449750065803528, -0.0037586900871247053, -0.012056916020810604, 0.038149040192365646, -0.023943278938531876, -0.012263383716344833, 0.04763944447040558, 0.014850285835564137, 0.018787749111652374, 0.0007518086931668222, -0.057243525981903076, 0.003529537934809923, 0.00596646498888731 ] }, { "text": "--\n\n
\n \n
MFE Separates better
\n
\n\n--\n\n
\n \n
Training Accuracy
\n
\n\n--\n\n
\n \n
Test Accuracy
\n
", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_8", "embedding": [ 0.07672406733036041, -0.0293410774320364, 0.03334790840744972, 0.05087625980377197, 0.13419842720031738, 0.008798846043646336, -0.06872162967920303, 0.00498749315738678, 0.054385412484407425, -0.005016326904296875, 0.04212155193090439, -0.012224803678691387, -0.00023776263697072864, 0.045766983181238174, 0.00947114359587431, -0.031210657209157944, -0.03267939016222954, 0.0266752727329731, -0.024376997724175453, -0.020750530064105988, -0.042676009237766266, -0.141954705119133, 0.0992652103304863, -0.015434271655976772, 0.03741682693362236, 0.03462959825992584, -0.017620401456952095, 0.07879535853862762, -0.05313112959265709, -0.09350574761629105, 0.045337826013565063, 0.010167543776333332, 0.03865044564008713, -0.048880454152822495, -0.05134057253599167, 0.06642545014619827, -0.018202196806669235, -0.05510793998837471, 0.0013063211226835847, -0.023817939683794975, -0.05856331065297127, -0.03626503422856331, 0.10297106206417084, -0.08590882271528244, -0.026929698884487152, 0.022321393713355064, -0.014814764261245728, -0.060184091329574585, 0.011255870573222637, -0.012709792703390121, -0.06900997459888458, -0.02686808630824089, -0.0569094754755497, 0.020435849204659462, -0.0062837605364620686, 0.03156213089823723, 0.11749193072319031, -0.04012265056371689, 0.1271963268518448, 0.016738826408982277, 0.019617322832345963, 0.011795438826084137, 0.07354705780744553, -0.012192578054964542, 0.10694393515586853, -0.012971721589565277, -0.08345004171133041, -0.026770498603582382, -0.05503155663609505, -0.011958600953221321, -0.04641622304916382, 0.011870356276631355, 0.011796348728239536, 0.020089969038963318, -0.0012623522197827697, -0.034626103937625885, -0.04439680278301239, 0.013692972250282764, 0.010033337399363518, 0.04786807298660278, -0.021263284608721733, -0.03985166549682617, 0.018402166664600372, -0.004350070375949144, 0.10628614574670792, 0.07824540138244629, 0.048466768115758896, -0.10569381713867188, -0.06788507848978043, -0.05544291436672211, -0.0577637143433094, 0.05028466135263443, -0.03234577924013138, 0.1681065708398819, -0.021955734118819237, 0.009446577169001102, -0.07270071655511856, -0.023877833038568497, -0.06009430065751076, 0.05903700739145279, 0.03729888051748276, -0.042941488325595856, 0.000882372201886028, 0.018810391426086426, 0.027096882462501526, 0.02405700646340847, 0.04711518436670303, 0.09153201431035995, 0.039022959768772125, 0.0029206403996795416, 0.03507997840642929, 0.04356147721409798, -0.13996665179729462, 0.03559158369898796, -0.0658600777387619, 0.07811489701271057, 0.027404148131608963, -0.06282525509595871, 0.04703577980399132, 0.012898016721010208, 0.0725451111793518, 0.052464794367551804, -0.03601861000061035, -0.018086005002260208, 0.09162735193967819, -0.025462321937084198, -0.037518881261348724, 8.44126166745331e-33, 0.022279879078269005, -0.06454143673181534, -0.01142504159361124, 0.029825206845998764, 0.10531078279018402, -0.03607630357146263, -0.05447159335017204, -0.01710844598710537, -0.048069823533296585, -0.010604334995150566, 0.004759605973958969, 0.03749343752861023, -0.0703132376074791, -0.0560624897480011, 0.026929553598165512, -0.050825007259845734, -0.03199749067425728, 0.016607023775577545, -0.014459843747317791, -0.0003752763441298157, -0.05024070665240288, -0.024529529735445976, 0.019120046868920326, 0.01882103830575943, 0.01783936843276024, 0.10948511958122253, 0.0204791072756052, 0.02261352725327015, -0.025249116122722626, 0.010950662195682526, -0.0026077404618263245, -0.02390170842409134, 0.06387914717197418, -0.04547324776649475, -0.029555557295680046, -0.046733222901821136, -0.025181179866194725, 0.06426911056041718, -0.01260301098227501, -0.014487170614302158, -0.06428985297679901, -0.033961471170186996, -0.00014054107305128127, -0.040124908089637756, -0.05405702069401741, 0.007967178709805012, -0.005541201680898666, 0.05322686582803726, 0.007598959840834141, 0.03815282881259918, -0.012666717171669006, -0.001627243123948574, -0.041040223091840744, 0.019417203962802887, 0.02025960385799408, -0.0038925546687096357, -0.04578103870153427, 0.018725235015153885, -0.0034471009857952595, -0.07885216921567917, 0.14487744867801666, 0.004978973418474197, 0.01829569973051548, 0.006709432695060968, 0.03242845833301544, 0.09388842433691025, 0.06455375254154205, 0.07245632261037827, 0.024337278679013252, -0.041721440851688385, -0.046338390558958054, -0.03929771110415459, 0.12385161221027374, 0.018207238987088203, -0.03974481672048569, -0.02575206197798252, 0.003257604083046317, -0.00026652112137526274, -0.015570925548672676, 0.01973736472427845, 0.0053144218400120735, 0.06470958888530731, -0.010523886419832706, -0.07049952447414398, -0.07770363241434097, -0.011004576459527016, -0.009861666709184647, -0.054625362157821655, 0.0085972985252738, 0.02137701027095318, -0.02768869511783123, 0.0629395842552185, -0.05392494052648544, -0.042200732976198196, -0.07711807638406754, -6.624881919090957e-33, 0.02633228339254856, 0.1243758425116539, -0.011102537624537945, 0.06983982026576996, -0.022811593487858772, 0.045535676181316376, 0.13736511766910553, -0.03999137133359909, 0.03546888008713722, 0.010067642666399479, 0.01867794245481491, -0.053498029708862305, -0.1423739790916443, -0.14441700279712677, -0.05972164496779442, -0.012005935423076153, 0.015567276626825333, -0.007162947673350573, -0.007011257112026215, 0.04954984411597252, 0.01303173415362835, 0.09931889176368713, 0.020475933328270912, 0.02412343956530094, -0.049062032252550125, 0.06739000976085663, 0.014278595335781574, -0.009134054183959961, -0.033095281571149826, -0.022048769518733025, -0.0034389072097837925, -0.010369398631155491, -0.06680946052074432, 0.001546861371025443, 0.05369328707456589, -0.04269299656152725, -0.03710969164967537, -0.024118827655911446, 0.01743226870894432, 0.03638250008225441, 0.011475362814962864, -9.966857032850385e-05, -0.05808931589126587, -0.06094973534345627, -0.038698676973581314, -0.019504021853208542, 0.052899572998285294, 0.030912479385733604, 0.09901011735200882, 0.03182091936469078, -0.0008868487202562392, -0.08679646253585815, 0.03365683928132057, 0.00852236058562994, -0.010715510696172714, 0.010022015310823917, -0.04234427213668823, 0.05684709548950195, -0.004376491066068411, 0.10060855746269226, 0.029160544276237488, 0.012701953761279583, -0.08290404081344604, -0.04819032549858093, -0.04286425560712814, 0.0830327495932579, -0.09021182358264923, 0.03585413470864296, 0.06431201100349426, 0.047428473830223083, -0.003639666363596916, 0.018068550154566765, 0.118195541203022, -0.053502559661865234, -0.01577966846525669, 0.04954860731959343, -0.00991173554211855, 0.03229416534304619, -0.003946398850530386, -0.07012049853801727, -0.008707132190465927, -0.0017832777230069041, -0.0812520682811737, -0.03719513490796089, -0.02074398100376129, 0.06516782939434052, -0.0274292454123497, -0.022039217874407768, 0.009289619512856007, -0.05252968519926071, -0.02425774186849594, 0.07896582037210464, 0.12886062264442444, -0.033830270171165466, 0.011503130197525024, -4.722449986616084e-08, -0.013318351469933987, -0.04490615800023079, 0.0041360631585121155, -0.03658415004611015, -0.06924170255661011, 0.0012703968677669764, -0.0031165482942014933, -0.013680463656783104, -0.01592341996729374, -0.029493423178792, 0.1008772924542427, 0.05497145280241966, 0.00394775252789259, 0.0057043153792619705, -0.07611686736345291, -0.06577875465154648, -0.04570428654551506, 0.12821140885353088, 0.008305716328322887, -0.019625194370746613, -0.03650835528969765, 0.004312886856496334, 0.05530800297856331, 0.0028432277031242847, -0.05050961300730705, 0.009799315594136715, -0.05417114496231079, 0.05862809345126152, -0.008565534837543964, -0.019665483385324478, 0.03808895871043205, 0.016771839931607246, -0.018803482875227928, -0.03795540705323219, -0.01802750490605831, -0.014179683290421963, -0.09925226867198944, 0.0035337244626134634, -0.05276380479335785, 0.010055849328637123, -0.023530710488557816, -0.0659216046333313, 0.01844511553645134, 0.02294210158288479, -0.034875620156526566, 0.00806114636361599, 0.026463208720088005, -0.0553777702152729, -0.0049509331583976746, 0.04775073006749153, 0.014258766546845436, 0.005147765856236219, -0.0555180087685585, -0.031463466584682465, 0.05318857356905937, -0.0752980187535286, 0.09425109624862671, 0.08565457165241241, -0.07573408633470535, 0.0005641710595227778, 0.030828844755887985, -0.05761799216270447, -0.0030374086927622557, -0.017435049638152122 ] }, { "text": "### Key Words\nTiny ML, Arduino, Edge Impulse, Audio, Classification", "source": "2022-01-17-Audio-Classifier.md", "type": "markdown", "chunk_id": "2022-01-17-Audio-Classifier.md_9", "embedding": [ 0.021547308191657066, -0.1106157898902893, 0.004588169511407614, -0.0550394244492054, 0.031045585870742798, 0.0029451989103108644, 0.06188945472240448, -0.021021805703639984, -0.09042580425739288, -0.03521120175719261, 0.04741844907402992, -0.015724070370197296, -0.026759086176753044, -0.06611425429582596, -0.11532999575138092, 0.050616130232810974, 0.04150356352329254, -0.001663477742113173, -0.06950318068265915, -0.04493092745542526, 0.1007549986243248, 0.02388022094964981, -0.0478070043027401, 0.02817631885409355, 0.04178488627076149, 0.08602778613567352, 0.010812264867126942, 0.03843514993786812, 0.04855441674590111, -0.09806566685438156, 0.030965251848101616, 0.06374642252922058, 0.18013951182365417, 0.027042673900723457, 0.0055758776143193245, -0.02237841486930847, -0.015469366684556007, -0.029014552012085915, -0.0097885150462389, 0.009821736253798008, -0.006314255762845278, -0.07302124798297882, 0.032062284648418427, -0.009454312734305859, 0.024858934804797173, 0.0213297288864851, -0.06799130141735077, -0.07479692995548248, -0.056944265961647034, -0.013434204272925854, -0.09081503003835678, -0.0634428858757019, -0.09137127548456192, 0.044184714555740356, -0.06750255078077316, -0.11441031843423843, 0.028060484677553177, -0.022726230323314667, 0.08252637833356857, 0.03384171426296234, 0.006595374085009098, -0.029188157990574837, -0.020374847576022148, 0.009313419461250305, -0.01656408980488777, 0.01765061356127262, 0.004639352206140757, -0.00045116464025340974, 0.026869185268878937, 0.05249929055571556, 0.00850769691169262, 0.06983412802219391, 0.01100123766809702, 0.0826084315776825, 0.058714862912893295, -0.012275304645299911, 0.009085976518690586, -0.06191302463412285, -0.011728741228580475, 0.01976812072098255, -0.10509893298149109, -0.08180046081542969, -0.07651282846927643, 0.0675273984670639, 0.04192878305912018, 0.04236052185297012, -0.04516841471195221, 0.00279234373010695, -0.036352820694446564, -0.021383600309491158, -0.08199865370988846, -0.05463065207004547, -0.012331818230450153, -0.028548385947942734, -0.018060941249132156, 0.007632039487361908, 0.011286393739283085, -0.10423184931278229, -0.02968369424343109, 0.061316926032304764, -0.02233317121863365, -0.061401113867759705, -0.0049749077297747135, -0.03448638692498207, -0.0489228218793869, -0.059162307530641556, 0.0690900906920433, 0.015471048653125763, 0.11665355414152145, 0.01737552136182785, -0.034494269639253616, -0.0515899620950222, -0.10118121653795242, -0.09189988672733307, 0.08546100556850433, -0.07990966737270355, -0.03126189485192299, -0.018176017329096794, 0.05366666987538338, -0.028279542922973633, -0.02225557342171669, 0.02237721160054207, -0.055910639464855194, -0.05314367264509201, -0.014950649812817574, -0.02767401561141014, -0.10757366567850113, 6.685219470146814e-36, 0.02095678634941578, 0.00617623794823885, -0.04892342537641525, 0.0315217450261116, 0.046474192291498184, -0.018423931673169136, -0.020133616402745247, -0.020888838917016983, 0.027018150314688683, 0.08647630363702774, -0.0927479937672615, 0.05106330290436745, -0.06661941111087799, 0.04549753665924072, 0.0326840803027153, -0.09112180769443512, -0.0034170271828770638, 0.03290822356939316, -0.04709457978606224, -0.053224630653858185, 0.005519982427358627, 0.05556442216038704, 0.039056651294231415, 0.028274113312363625, -0.006742529105395079, 0.11044838279485703, 0.005073554813861847, -0.08117074519395828, 0.06768274307250977, 0.06579624116420746, -0.054088082164525986, 0.051142070442438126, -0.009423904120922089, -0.033141590654850006, 0.023423995822668076, 0.041678763926029205, -0.03616246581077576, -0.0012934257974848151, 0.003138335421681404, -0.07612486183643341, -0.04172753915190697, 0.02212192676961422, -0.02571788989007473, -0.09349511563777924, -0.0002877244260162115, -0.017904534935951233, 0.033336080610752106, 0.054240599274635315, 0.026451794430613518, 0.04054243862628937, -0.04634849727153778, 0.014174382202327251, 0.04950719326734543, 0.0005704561481252313, 0.05069345608353615, -0.010243536904454231, 0.015899116173386574, 0.12498940527439117, 0.044416643679142, 0.030161317437887192, 0.009616871364414692, 0.01643865555524826, 0.0542837530374527, -0.02162565104663372, 0.04887237772345543, -0.00725719565525651, 0.009328046813607216, -0.015575988218188286, 0.03869418427348137, 0.031176747754216194, -0.04185623303055763, 0.07948532700538635, 0.025836756452918053, -0.018511423841118813, -0.04543698579072952, 0.026611197739839554, -0.029876666143536568, -0.042015936225652695, -0.055855244398117065, 0.016511021181941032, -0.1044234111905098, -0.01603059098124504, 0.0035810971166938543, -0.05510232225060463, -0.045972924679517746, 0.05307167023420334, 0.057953134179115295, -0.1238662526011467, -0.03351178392767906, -0.014904310926795006, -0.1230568066239357, 0.05346420034766197, -0.06692556291818619, -0.005053906701505184, -0.08632247895002365, -1.4378668939777299e-33, -0.0017856999766081572, 0.08512451499700546, 0.006396597716957331, 0.05454365909099579, -0.041348014026880264, 0.05389019101858139, 0.03415217250585556, 0.038821030408144, 0.03492548689246178, 0.041251637041568756, 0.032601092010736465, 0.021628674119710922, 0.006693580187857151, -0.05504352226853371, 0.013331272639334202, -0.036828842014074326, -0.03270813822746277, -0.005562260746955872, 0.03967246040701866, 0.03556189686059952, -0.03127046301960945, 0.0439128577709198, -0.06818391382694244, 0.044130899012088776, -0.05705849453806877, 0.041103899478912354, -0.04570112004876137, 0.07068759948015213, 0.04246407002210617, -0.025462908670306206, -0.0028439301531761885, 0.004845160525292158, 0.0024422984570264816, -0.0012789806351065636, 0.005271947477012873, 0.001911706174723804, 0.1350513994693756, 0.0062285843305289745, -0.005449515301734209, 0.007769614923745394, 0.06384506076574326, 0.03743104636669159, 0.02909151092171669, -0.03893427178263664, -0.005076820962131023, -0.025854194536805153, -0.019421400502324104, 0.05697062239050865, -0.02850247360765934, -0.021503014490008354, 0.05702385678887367, 0.0030126702040433884, -0.04584766551852226, -0.037694066762924194, -0.0025513824075460434, 0.02268269471824169, 0.005811756476759911, 0.022266479209065437, 0.02803121507167816, 0.03989551216363907, -0.056509003043174744, -0.08204381912946701, 0.00036684368387795985, 0.0019424103666096926, -0.0031459748279303312, 0.02108568698167801, -0.010669485665857792, -0.04045163467526436, -0.07774459570646286, 0.027149023488163948, 0.04678257927298546, 0.08762223273515701, 0.02794969268143177, 0.005171638913452625, -0.09400869160890579, -0.0644388496875763, -0.0945451632142067, -0.03281863406300545, -0.017487309873104095, -0.022535152733325958, 0.061120085418224335, -0.019595924764871597, 0.004793872125446796, 0.05606634542346001, 0.03889444097876549, 0.09006999433040619, 0.07776035368442535, 0.02271951548755169, -0.025963356718420982, -0.0452408529818058, -0.04030342027544975, 0.0797392949461937, 0.03881219029426575, 0.07334967702627182, -0.0967131182551384, -2.202835069908815e-08, -0.05003760755062103, -0.009829998947679996, 0.030407393351197243, -0.022984949871897697, 0.031864311546087265, 0.025189395993947983, -0.051629796624183655, 0.006835636217147112, 0.0388689786195755, -0.004454849287867546, 0.09721891582012177, -0.06351341307163239, -0.06239796057343483, 0.07225977629423141, 0.06762007623910904, 0.045114949345588684, -0.0444570928812027, 0.08334024995565414, 0.017696741968393326, -0.08476307988166809, 0.017857136204838753, 0.0036446992307901382, 0.02658628672361374, -0.04272002726793289, 0.05102381482720375, -0.059629492461681366, -0.009726224467158318, 0.10430064797401428, 0.0035832375288009644, 0.032526616007089615, -0.03812820836901665, 0.06647610664367676, 0.004857747815549374, -0.017670590430498123, -0.06602929532527924, 0.07530814409255981, -0.02943452261388302, 0.015895521268248558, -0.02856743335723877, 0.0015921610174700618, -0.044181618839502335, 0.04864396154880524, -0.12640096247196198, -0.01460474543273449, -0.017545245587825775, 0.008200628682971, 0.06702536344528198, -0.08979950845241547, -0.05896148085594177, 0.01453726552426815, -0.025686785578727722, 0.1052137240767479, 0.06986185908317566, 0.020546307787299156, 0.05957897752523422, 0.0762411430478096, 0.03954059258103371, -0.03962428867816925, -0.0012970297830179334, 0.03127072751522064, 0.08215218037366867, 0.05161691829562187, -0.008649446070194244, 0.025965850800275803 ] }, { "text": "---\ntitle: \"AWS re:Invent Recap 1\"\nid: \"reinvent\"\ncategory: \"conference\"\ntags: [\"aws\", \"reinvent\", \"medium\"]\nrelated: [\"reinvent_2\"]\ndate: \"2024-06-05\"\ndescription: \"re:Invent notes\"\n---\n\n\n[TL;DR? Read the full version on Medium](https://medium.com/@balci.pelin/aws-re-invent-2024-notes-part1-f185ed9b326b) \nThis year, I was privileged to join the AWS re: Invent in Las Vegas! It was a wonderful week, I met incredible people \nfrom around the world, exchanging ideas, and learning from their unique experiences. I’ve decided to write and share my notes :)", "source": "2024-12-17-aws-reinvent.md", "type": "markdown", "chunk_id": "2024-12-17-aws-reinvent.md_0", "embedding": [ -0.06265931576490402, 0.016970911994576454, 0.009018020704388618, 0.02708621881902218, 0.0697234719991684, 0.016793137416243553, 0.047277677804231644, -0.051299527287483215, 0.015608408488333225, 0.006064993795007467, 0.006399787962436676, 0.026151828467845917, 0.07246379554271698, -0.012990388087928295, -0.0051216320134699345, 0.017902901396155357, -0.0012160777114331722, -0.08345288038253784, -0.08167682588100433, -0.04663952812552452, -0.08097373694181442, -0.012789404951035976, -0.00309064076282084, 0.05265454947948456, -0.041792672127485275, 0.06652489304542542, -0.057153426110744476, 0.04920836538076401, -0.021281735971570015, -0.05750999599695206, 0.04124980419874191, 0.07212423533201218, -0.020893527194857597, 0.025494569912552834, 0.10869988054037094, 0.09611519426107407, -0.016024049371480942, -0.0688258707523346, 0.013123011216521263, -0.0052968580275774, 0.002632051706314087, -0.07260642200708389, 0.028014902025461197, 0.017856784164905548, 0.04425225406885147, -0.0523846298456192, 0.0013922066427767277, 0.00957641750574112, -0.019193613901734352, 0.07824550569057465, -0.028006989508867264, -0.07498500496149063, 0.012010145001113415, -0.07497350871562958, -0.009451701305806637, 0.08318556100130081, -0.04954397305846214, 0.00650298036634922, -0.04103416949510574, -0.10938667505979538, 0.047533560544252396, -0.05907166376709938, 0.0424393005669117, 0.018959874287247658, -0.08556221425533295, 0.04863981530070305, -0.013495790772140026, 0.12246924638748169, 0.014061324298381805, -0.017485247924923897, 0.016861138865351677, 0.044280070811510086, -0.07505189627408981, 0.07115019112825394, 0.03599533066153526, -0.03896365687251091, -0.0058620343916118145, -0.05860061198472977, -0.014517790637910366, 0.02647123858332634, 0.03753264993429184, -0.08013276755809784, -0.10734812170267105, -0.02397347427904606, -0.02764488197863102, -0.03385988995432854, -0.001670733210630715, -0.038103602826595306, 0.008544947020709515, -0.013218963518738747, -0.05941976606845856, -0.03701113909482956, 0.07931389659643173, -0.036488961428403854, -0.017854779958724976, 0.051800262182950974, -0.03671572357416153, 0.01444358378648758, 0.013460326008498669, 0.07313821464776993, 0.04895173758268356, 0.11080837994813919, -0.06356687098741531, 0.010171766392886639, 0.03204953670501709, 0.0340837761759758, -0.09562397003173828, 0.14301423728466034, -0.006184675730764866, -0.04469704627990723, 0.018156804144382477, 0.013685745187103748, 0.035089872777462006, -0.037863146513700485, 0.042244743555784225, 0.039556700736284256, -0.035125117748975754, 0.017749911174178123, 0.07585348933935165, 0.017709866166114807, 0.0617542564868927, 0.06725968420505524, -0.022930696606636047, -0.047169703990221024, -0.11053620278835297, -0.04002612456679344, -0.018018681555986404, 2.207360373376377e-33, 0.012211126275360584, 0.09320587664842606, 0.013413898646831512, 0.09670142829418182, 0.09269282221794128, 0.012131799943745136, -0.06843949854373932, 0.03458558768033981, -0.11350783705711365, -0.04524804651737213, 0.0029030432924628258, 0.04876162111759186, 0.04308249428868294, 0.016411053016781807, -0.024419302120804787, -0.0632484033703804, -0.05944148823618889, -0.017794469371438026, -0.010512563399970531, -0.036912333220243454, -0.0357365608215332, -0.0242981668561697, -0.0018712624441832304, -0.007331628818064928, 0.07973948121070862, 0.024606436491012573, -0.009472251869738102, -0.03616514056921005, 0.10770861059427261, 0.028170712292194366, 0.00829125102609396, 0.08041240274906158, -0.01865561492741108, -0.09453843533992767, -0.019059661775827408, 0.014784193597733974, -0.018641231581568718, -0.11283209919929504, -0.00693272240459919, 0.0037319683469831944, 0.011387924663722515, 0.05175066366791725, -0.0781165361404419, -0.0505833700299263, -0.008494997397065163, 0.06314196437597275, 0.05685514584183693, 0.05068155750632286, 0.15209847688674927, -0.04862048849463463, -0.07058091461658478, -0.023345323279500008, 0.024804873391985893, -0.0428764671087265, 0.051362041383981705, -0.07789346575737, 0.017758198082447052, 0.013581185601651669, 0.012719803489744663, 0.0031151396688073874, -0.015072859823703766, 0.07276996970176697, -0.018719617277383804, 0.06952618807554245, -0.06697475910186768, 0.018252670764923096, 0.02466653101146221, 0.053562283515930176, 0.05501139909029007, -0.010648265480995178, 0.016689326614141464, 0.07799648493528366, -0.03744332119822502, -0.05683036148548126, 0.036065224558115005, -0.014001167379319668, -0.06892158091068268, -0.05152290314435959, 0.02627474069595337, 0.05229521170258522, -0.039770785719156265, -0.04002078250050545, -0.043964412063360214, 0.057939313352108, -0.021689770743250847, -0.023939885199069977, 0.03116721659898758, -0.06406691670417786, -0.012622691690921783, 0.02100994810461998, -0.03822370618581772, 0.04751770943403244, 0.057361431419849396, -0.03064880333840847, -0.05847511067986488, -3.111903827347104e-33, 0.024495447054505348, 0.03797702491283417, 0.028254475444555283, 0.0025692975614219904, 0.06704089045524597, -0.0436888262629509, -0.006155862472951412, 0.044171977788209915, -0.03497185558080673, 0.0029600884299725294, -0.024098308756947517, 0.011294323951005936, -0.008968646638095379, -0.05868804082274437, -0.013711120001971722, -0.09552518278360367, 0.005661407019942999, -0.035843636840581894, -0.04871701821684837, -0.020055899396538734, 0.008328026160597801, 0.008270828984677792, -0.01720215007662773, 0.05994787812232971, 0.06048423796892166, 0.04809488356113434, 0.0464203767478466, -0.044447824358940125, 0.026606891304254532, -0.0664864182472229, -0.05352587625384331, 0.03255417197942734, -0.03491257131099701, 0.01834104023873806, 0.015457645058631897, 0.04588286578655243, 0.06454692780971527, -0.057882919907569885, -0.07582801580429077, -0.10686163604259491, 0.06007305160164833, 0.03277788311243057, -0.06454265862703323, 0.024124791845679283, -0.047902386635541916, 0.027505695819854736, -0.05572877824306488, 0.031687524169683456, 0.0046454621478915215, -0.01679411344230175, -0.06974931061267853, -0.10376618057489395, -0.03966168686747551, -0.050483476370573044, 0.011897094547748566, 0.026988016441464424, 0.012150993570685387, 0.023955460637807846, -0.00032802438363432884, 0.03640221431851387, -0.0577562041580677, 0.002663262188434601, 0.027634622529149055, 0.022442499175667763, 0.0167390126734972, -0.14794142544269562, 0.026043932884931564, 0.08702296018600464, -0.12752078473567963, 0.009651383385062218, 0.052587877959012985, 0.06118890643119812, -0.09904507547616959, -0.0766710638999939, 0.0013695703819394112, 0.006393687799572945, -0.0032557386439293623, -0.03039678744971752, -0.031222539022564888, -0.010526375845074654, -0.07238151133060455, 0.05017571896314621, -0.013110213913023472, 0.07872776687145233, 0.07297965884208679, 0.09797048568725586, -0.03329254686832428, -0.017303582280874252, -0.02227240987122059, 0.0600912868976593, -0.1070115938782692, -0.07719480246305466, 0.03662316873669624, 0.05550792068243027, 0.0036284569650888443, -5.0347473745659954e-08, -0.02726983278989792, 0.09305638074874878, -0.07139667123556137, 0.03518981486558914, 0.01565892994403839, -0.011144498363137245, -0.01908331923186779, -0.015633001923561096, -0.016253193840384483, -0.010907439514994621, -0.03249200060963631, -0.05493032559752464, -0.029690299183130264, 0.10111856460571289, 0.026348456740379333, -0.017673900350928307, 0.029931146651506424, 0.029340077191591263, -0.013682621531188488, -0.05889057740569115, 0.06637302041053772, 0.08111109584569931, 0.018065590411424637, -0.07321061193943024, -0.047251760959625244, 0.027700670063495636, -0.008072602562606335, 0.04944867640733719, 0.0063140420243144035, -0.03826814144849777, -0.08119907230138779, -0.04745974391698837, -0.06450238078832626, 0.028840957209467888, 0.022478779777884483, -0.13603514432907104, -0.0045005884021520615, -0.04808598756790161, -0.008546680212020874, 0.007419069763273001, -0.00964969489723444, 0.05344109237194061, 0.002882887376472354, 0.054736096411943436, 0.04134520888328552, -0.03656662628054619, -0.004369709175080061, -0.0021450482308864594, -0.03326980024576187, 0.0460020937025547, -0.0009995100554078817, -0.08413923531770706, 0.010719550773501396, 0.030945278704166412, 0.05715304613113403, 0.06200968846678734, 0.060654256492853165, 0.033964358270168304, 0.017624221742153168, 0.02547640912234783, 0.12666261196136475, -0.014354478567838669, -0.05789623036980629, 0.05958576872944832 ] }, { "text": "---\ntitle: \"EasyOCR in HuggingFace\"\nid: \"easyocr\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"dl\", \"image\", \"medium\", \"huggingface\"]\nrelated: [\"imageprocess\"]\ndate: \"2023-03-08\"\ndescription: \"Create a space about EasyOCR in HuggingFace\"\n---\n\n\n[TL;DR? Read the full version on Medium](https://medium.com/@balci.pelin/easyocr-with-hugging-face-with-streamlit-f5a27666ec5c) \n\nYou can start creating your apps on Hugging Face platform today!", "source": "2023-03-08-EasyOCR_HF_Streamlit.md", "type": "markdown", "chunk_id": "2023-03-08-EasyOCR_HF_Streamlit.md_0", "embedding": [ -0.12104957550764084, -0.03117484599351883, 0.03089062124490738, 0.004564793314784765, 0.04598482698202133, -0.04978911951184273, -0.04858953878283501, 0.0036577696446329355, -0.10606063902378082, -0.034216634929180145, 0.033987857401371, -0.09001022577285767, -0.02173464559018612, 0.07118652015924454, 0.08135324716567993, 0.027065953239798546, -0.042266663163900375, 0.026644546538591385, -0.046805527061223984, 0.09809240698814392, -0.05878704413771629, -0.018238987773656845, 0.020390575751662254, -0.05223127081990242, 0.008417360484600067, 0.04181515797972679, -0.0255022794008255, 0.012646789662539959, 0.1085653305053711, -0.03765081986784935, 0.04884198307991028, -0.030851582065224648, 0.04473421722650528, 0.03305521607398987, 0.0019047351088374853, 0.11512088030576706, -0.03725600615143776, -0.01697365567088127, -0.12933826446533203, -0.04752518609166145, -0.03295152261853218, -0.005156222730875015, 0.022959845140576363, 0.019990505650639534, 0.011351551860570908, 0.03457710146903992, -0.02289527654647827, 0.0022919278126209974, 0.007799095939844847, 0.017139069736003876, -0.05126403272151947, -0.11431605368852615, -0.02238008752465248, -0.020179400220513344, -0.0471135713160038, 0.03086024895310402, -0.03908384591341019, -0.010314231738448143, -0.0006380912382155657, 0.04554612934589386, 0.062030892819166183, -0.01282710861414671, 0.03710581734776497, 0.04881303012371063, -0.07516596466302872, 0.025816433131694794, -0.0036381182726472616, 0.10367976129055023, 0.028507763519883156, -0.042098674923181534, 0.036405906081199646, -0.023818936198949814, -0.046262454241514206, -0.010533402673900127, 0.02163485623896122, -0.03122352622449398, -0.03692752122879028, 0.015629850327968597, -0.020269926637411118, -0.026902101933956146, 0.05857167765498161, -0.003316196147352457, -0.047377441078424454, 0.06210694834589958, -0.007949195802211761, 0.012844144366681576, -0.012468776665627956, -0.03844283148646355, -0.0852753221988678, 0.01020845863968134, 0.041102804243564606, 0.004273341037333012, -0.0062550450675189495, -0.02232518419623375, -0.015316539444029331, -0.0525699183344841, -0.04570012912154198, -0.02860199846327305, -0.1887015402317047, 0.04068693891167641, -0.0635795071721077, -0.07329585403203964, 0.027769220992922783, 0.03231404349207878, 0.06303760409355164, -0.0272340327501297, -0.004392192233353853, -0.028495727106928825, 0.031212128698825836, -0.014789263717830181, -0.02415277622640133, 0.035354793071746826, -0.02429608628153801, -0.020268451422452927, 0.03664301335811615, -0.035951416939496994, -0.01792377606034279, -0.07996255904436111, 0.11768867075443268, 0.024729622527956963, 0.04791559278964996, -0.018872201442718506, -0.022773224860429764, -0.08644729852676392, 0.011595160700380802, -0.06688564270734787, -0.09389328956604004, 2.925062306361763e-33, 0.059832990169525146, 0.04934689402580261, 0.010790963657200336, 0.0712364986538887, 0.01749822124838829, -0.044651973992586136, 0.02616460807621479, 0.02020302228629589, -0.09329450130462646, -0.019710922613739967, -0.0204290971159935, 0.050336360931396484, -0.04611779749393463, 0.12278628349304199, -0.0020590515341609716, -0.048680685460567474, -0.05434316024184227, 0.03431244194507599, 0.0007710896315984428, -0.00691401120275259, -0.0838751494884491, -0.02562106028199196, -0.04882509261369705, -0.043217532336711884, -0.08968346565961838, 0.056651853024959564, 0.04348718747496605, -0.06348712742328644, 0.05790438503026962, -0.011365910992026329, -0.06878391653299332, 0.02252361550927162, 0.03667409345507622, 0.007391386199742556, 0.037030283361673355, -0.010562920942902565, 0.021784096956253052, -0.03431972488760948, -0.005212116986513138, 8.015038474695757e-05, -0.042329419404268265, 0.05536848306655884, -0.017370374873280525, -0.07543645799160004, 0.019418783485889435, 0.07916223257780075, 0.08644469082355499, -0.03590398281812668, -0.0034861466847360134, -0.06102273613214493, 0.059509340673685074, -0.002734316745772958, -0.07707810401916504, 0.020198017358779907, -0.09335124492645264, -0.04861961305141449, -0.01064430084079504, 0.03313836827874184, -0.02847248874604702, -0.016866952180862427, -0.0031023735646158457, 0.03357565402984619, 0.09470368921756744, -0.007823587395250797, -0.0476088672876358, 0.013804263435304165, 0.0683787614107132, -0.014871452003717422, -0.00885336846113205, -0.024830585345625877, -0.030323976650834084, 0.023469742387533188, -0.005338401533663273, -0.04353879764676094, 0.03288133442401886, -0.017056381329894066, 0.11302328109741211, -0.011591354385018349, -0.05826754868030548, 0.030190477147698402, 0.016243094578385353, 0.03081584721803665, 0.0260245893150568, 0.04993809759616852, -0.06473927944898605, -0.042154423892498016, 0.022670863196253777, -0.09739545732736588, -0.00458222720772028, 0.050469692796468735, -0.023715868592262268, 0.01729748025536537, 0.040122948586940765, -0.023271648213267326, -0.07419640570878983, -3.488154957132348e-33, 0.10437172651290894, -0.04565321281552315, -0.025172606110572815, -0.05680080130696297, 0.060578517615795135, 0.04297131299972534, 0.021601665765047073, 0.13560180366039276, 0.045320264995098114, 0.003734743921086192, 0.035413358360528946, -0.016096124425530434, 0.004797379951924086, -0.05210772901773453, 0.018711617216467857, 0.022915314882993698, 0.022189896553754807, -0.003158645937219262, -0.07153879851102829, 0.004236793145537376, 0.028229188174009323, 0.030734533444046974, -0.00723244296386838, -0.0131979463621974, 0.011935768648982048, 0.01225293893367052, 0.08493789285421371, -0.0016705685993656516, 0.0626509040594101, -0.016173629090189934, 0.006759852636605501, -0.09798707813024521, -0.1034722626209259, 0.044410716742277145, 0.040582504123449326, 0.021424736827611923, -0.0041144611313939095, -0.021320482715964317, -0.08948756009340286, -0.09877294301986694, 0.06415176391601562, -0.01496923714876175, -0.03702313080430031, 0.03736265003681183, 0.035426780581474304, 0.0037518010940402746, -0.03794572874903679, -0.02819155529141426, -0.06664297729730606, 0.004609385039657354, 0.03511868044734001, -0.033311255276203156, -0.020997950807213783, -0.02124643512070179, 0.0066917226649820805, 0.05637311562895775, 0.14031173288822174, -0.0076575931161642075, 0.003460267558693886, 0.043078627437353134, -0.019717296585440636, -0.06623327732086182, -0.12152068316936493, -0.09083912521600723, 0.006673058494925499, 0.06484699994325638, -0.05332278087735176, -0.008767475374042988, -0.1115475445985794, 0.014709025621414185, 0.030345220118761063, 0.021065013483166695, -0.021916016936302185, 0.045580800622701645, -0.03823898360133171, 0.06946179270744324, 0.12355513870716095, -0.08411198854446411, 0.026829170063138008, -0.0657220110297203, -0.04963042214512825, -0.028682848438620567, 0.007224202621728182, 0.031088154762983322, 0.05872019752860069, 0.05091011896729469, 0.05323738232254982, 0.03419601917266846, -0.01896260678768158, 0.007456867024302483, -0.06411449611186981, 0.07863198965787888, 0.08061216026544571, 0.09208162128925323, 0.025899814441800117, -4.9485812780858396e-08, -0.04679805412888527, -0.018007494509220123, -0.002456416841596365, -0.054577793926000595, -0.07119634747505188, 0.017092915251851082, 0.00889204815030098, -0.03066188097000122, -0.008244012482464314, -0.00046863220632076263, -0.004709208384156227, 0.02162637561559677, -0.05636138468980789, 0.0663568302989006, 0.0064947581849992275, 0.06993546336889267, -0.024446971714496613, 0.09544194489717484, -0.005959557369351387, -0.07383022457361221, -0.011146603152155876, 0.0461885891854763, 0.047533854842185974, -0.07001794129610062, 0.00033218361204490066, -0.06683743000030518, 0.009834720753133297, 0.051370929926633835, -0.02379513718187809, -0.016605913639068604, 0.019959459081292152, 0.03552277386188507, 0.06409050524234772, -0.02503175288438797, 0.06706196069717407, 0.09989047050476074, -0.04569043964147568, -0.049447521567344666, -0.0036541149020195007, -0.013448011130094528, 0.0034755186643451452, 0.0740104466676712, 0.010267147794365883, -0.029339689761400223, -0.014763237908482552, 0.04932950437068939, 0.11180751025676727, -0.06209699437022209, 0.0637916624546051, 0.07287894189357758, 0.016745276749134064, -0.02563939429819584, 0.010222997516393661, 0.0038558996748179197, 0.023428965359926224, 0.08069072663784027, -0.005660664290189743, -0.04864184930920601, 0.07646960020065308, 0.08937129378318787, 0.06267455965280533, 0.02751520462334156, -0.010608733631670475, 0.15400752425193787 ] }, { "text": "---\ntitle: \"AWS re:Invent Recap 2\"\nid: \"reinvent_2\"\ncategory: \"conference\"\ntags: [\"aws\", \"reinvent\", \"medium\"]\nrelated: [\"reinvent\"]\ndate: \"2024-06-05\"\ndescription: \"re:Invent notes\"\n---\n\n\n[TL;DR? Read the full version on Medium](https://medium.com/@balci.pelin/aws-re-invent-2024-notes-part2-5318a2295bf9) \nWelcome to the second part of my AWS re: Invent series! In this post, I’ll be diving into some of the exciting announcements and sharing insights from the sessions I attended.", "source": "2024-12-18-aws-reinvent-2.md", "type": "markdown", "chunk_id": "2024-12-18-aws-reinvent-2.md_0", "embedding": [ -0.10629615187644958, 0.026121946051716805, 0.018592463806271553, 0.03850089758634567, 0.09043224155902863, 0.014327697455883026, 0.04293002560734749, -0.056773871183395386, 0.03884986788034439, 0.023906365036964417, -0.00983284693211317, 0.03799091652035713, 0.03268386796116829, -0.04034905880689621, -0.04206975921988487, 0.010975062847137451, -0.00517573207616806, -0.08780283480882645, -0.04700677841901779, -0.09777865558862686, -0.04560157284140587, 0.012381965294480324, 0.005594119429588318, 0.056807663291692734, -0.04565808176994324, 0.04577028006315231, -0.05124363675713539, 0.053024835884571075, 0.015567800961434841, -0.060306768864393234, 0.04300328716635704, 0.07074421644210815, -0.022983495146036148, -0.011213377118110657, 0.04867076873779297, 0.07500145584344864, 0.024182947352528572, -0.058832377195358276, 0.033949632197618484, -0.02058141492307186, 0.027927091345191002, -0.045409999787807465, 0.009083250537514687, -0.0037290931213647127, 0.04028516635298729, -0.03995148465037346, 0.0055580828338861465, -0.007956328801810741, -0.03477505221962929, 0.05005108565092087, -0.028039475902915, -0.09268846362829208, -0.007758019957691431, -0.07176614552736282, 0.030072946101427078, 0.03307975083589554, -0.08571818470954895, -0.01985066942870617, -0.010079441592097282, -0.06804406642913818, 0.036097511649131775, -0.09151169657707214, 0.04093959927558899, 0.012343808077275753, -0.06582614779472351, 0.028939198702573776, -0.009769757278263569, 0.105308897793293, 0.02478620782494545, 0.009628921747207642, 0.032769739627838135, 0.032257869839668274, -0.05695950239896774, 0.027937550097703934, 0.01556761097162962, -0.005946420598775148, 0.009385171346366405, -0.03461642935872078, -0.02574848011136055, -0.014602543786168098, -0.006527802906930447, -0.09396255016326904, -0.0950450748205185, -0.042185228317976, -0.0034878533333539963, -0.05673285201191902, 0.0033381141256541014, -0.07281269133090973, -0.006179488264024258, 0.009985831566154957, -0.06624259054660797, -0.052054472267627716, 0.127598375082016, -0.011624274775385857, -0.04609078913927078, 0.06743815541267395, -0.0546768456697464, 0.010620646178722382, 0.044559840112924576, 0.06701771914958954, 0.058719828724861145, 0.11625386774539948, -0.06951849162578583, -0.036554139107465744, 0.012816261500120163, 0.0017161937430500984, -0.08242204785346985, 0.09480459988117218, 0.025345994159579277, -0.00239952583797276, 0.004018539097160101, 0.0011490780161693692, 0.03235331177711487, -0.0355929397046566, 0.018021216616034508, 0.02391495183110237, 0.005438236985355616, 0.013505983166396618, 0.07318110018968582, 0.04554338753223419, 0.10283853113651276, 0.04747649282217026, -0.02492036297917366, -0.0802200585603714, -0.050909776240587234, 0.0049893613904714584, -0.03466714546084404, 2.050143330412673e-33, 0.017627166584134102, 0.0753776952624321, -0.01512186136096716, 0.11426848918199539, 0.07032950967550278, 0.04099436104297638, -0.07171743363142014, 0.03416123613715172, -0.06859410554170609, -0.02533942274749279, -0.03350761905312538, 0.0967094823718071, -0.00973539799451828, -0.016327211633324623, -0.011000744067132473, -0.09671181440353394, -0.060652803629636765, 0.03657598793506622, -0.012369516305625439, -0.034071531146764755, -0.04505636915564537, -0.010843993164598942, 0.001114159938879311, -0.04519643634557724, 0.14737793803215027, 0.018245268613100052, 0.04704849049448967, -0.03594670072197914, 0.09627773612737656, 0.03965296223759651, 0.02626444585621357, 0.07626952975988388, -0.017609575763344765, -0.057124849408864975, -0.038895707577466965, 0.012730160728096962, -0.0349518321454525, -0.09962398558855057, 0.01878315955400467, 0.019180983304977417, 0.010893742553889751, 0.04544870927929878, -0.12022583186626434, -0.05397222563624382, -0.01796639710664749, 0.013087586499750614, 0.029878264293074608, 0.05882949009537697, 0.1723475158214569, -0.04281990975141525, -0.027369625866413116, 0.005808645859360695, 0.04341410845518112, -0.039798907935619354, 0.05696214735507965, -0.05294550210237503, -0.01887165941298008, -0.02423468418419361, 0.03217703104019165, 0.0262673981487751, -0.03618418052792549, 0.06334881484508514, -0.01893588714301586, 0.0655561164021492, -0.06789885461330414, 0.05772411450743675, 0.06329787522554398, 0.08975450694561005, -0.00636075297370553, 0.017273390665650368, 0.034066665917634964, 0.06158968433737755, -0.033140044659376144, -0.0801209956407547, 0.03175606206059456, -0.016741842031478882, -0.05518599972128868, -0.04257449507713318, 0.010133548639714718, 0.06315220147371292, -0.02470984123647213, -0.06043214350938797, -0.01774975284934044, 0.0828949585556984, -0.05481640622019768, -0.002425673883408308, 0.03128772974014282, -0.010798106901347637, -0.023998791351914406, -0.023066066205501556, -0.003828743239864707, 0.040846340358257294, 0.008363351225852966, -0.006560805253684521, -0.049179740250110626, -3.78818189042249e-33, 0.008565177209675312, 0.041141435503959656, -0.01753048785030842, -0.025069251656532288, 0.029866063967347145, -0.05101623758673668, -0.010178723372519016, 0.053119957447052, -0.055046819150447845, -0.02246161177754402, -0.026947973296046257, 0.0023715149145573378, -0.01933852583169937, -0.034252382814884186, -0.00917243305593729, -0.12189874053001404, -0.006585283670574427, -0.05831107124686241, -0.028725475072860718, 0.002743437420576811, 0.04222124069929123, -0.00709632458165288, -0.025857923552393913, 0.039087895303964615, 0.06416743248701096, 0.05067598074674606, 0.04655734449625015, -0.0269236508756876, 0.030810754746198654, -0.07299601286649704, -0.041625749319791794, -0.011257553473114967, -0.02961878292262554, 0.021790310740470886, 0.022399121895432472, 0.05886182561516762, 0.06634511053562164, -0.041045576333999634, -0.05181308835744858, -0.0727078765630722, 0.08631276339292526, 0.049654196947813034, -0.025957845151424408, 0.03407738357782364, -0.05635518208146095, 0.0007125756237655878, -0.04995761066675186, 0.09559814631938934, 0.008283887058496475, -0.010670608840882778, -0.07826083153486252, -0.08334105461835861, -0.06417091935873032, -0.04039726033806801, -0.011119588278234005, 0.02913319133222103, -0.02045031636953354, 0.004171472974121571, -0.04990357533097267, 0.06381145119667053, -0.07592464983463287, -0.02174643985927105, 0.005751252174377441, 0.028920872136950493, -0.008323297835886478, -0.13465124368667603, 0.007534430827945471, 0.032713863998651505, -0.08509021997451782, -0.01232222281396389, 0.05976551026105881, 0.04804116114974022, -0.11862238496541977, -0.0919099673628807, -0.008581958711147308, 0.04188866913318634, 0.007916459813714027, -0.04924787953495979, -0.00910609494894743, -0.012908494099974632, -0.07729056477546692, 0.05282982811331749, 0.011406379751861095, 0.07327251881361008, 0.04678959399461746, 0.09311705827713013, -0.02649429626762867, 0.022647753357887268, -0.00395670160651207, 0.060154348611831665, -0.1029893308877945, -0.09058067202568054, -0.021147677674889565, 0.08371487259864807, 0.028560560196638107, -4.8664468010883866e-08, -0.030249450355768204, 0.09028281271457672, -0.034007251262664795, 0.028966840356588364, 0.046995196491479874, -0.007445144932717085, -0.05874033644795418, 0.02030128426849842, -0.012110642157495022, -0.03099966049194336, -0.024827990680933, -0.02986895851790905, -0.058149706572294235, 0.08726032078266144, 0.024445200338959694, 0.027093131095170975, -0.001410496304742992, 0.01880769245326519, -0.025530116632580757, -0.0830090120434761, 0.0445551760494709, 0.07418763637542725, 0.04495879262685776, -0.06971432268619537, -0.04800323396921158, 0.013947626575827599, -0.016089174896478653, 0.06471646577119827, 0.016963979229331017, -0.02813827060163021, -0.04798750579357147, -0.05199151113629341, -0.06611552834510803, 0.03774387016892433, 0.005345993209630251, -0.09364759922027588, -0.03384998440742493, -0.01451274286955595, 0.00026349915424361825, -0.007550363894551992, -0.033752597868442535, 0.04054844379425049, -0.0019106032559648156, 0.08456625044345856, 0.008044478483498096, -0.03432295843958855, -0.04876807704567909, 0.01125091128051281, -0.01698256842792034, -0.005009596236050129, 0.006925029214471579, -0.10295579582452774, 0.013172019273042679, 0.03381309285759926, 0.09032595902681351, 0.1009812280535698, 0.03177857771515846, -0.006758779287338257, 0.01861441135406494, 0.04507056996226311, 0.151979461312294, -0.032740797847509384, -0.03887666389346123, 0.07444380968809128 ] }, { "text": "---\ntitle: \"Style Transfer\"\nid: \"styletransfer\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"dl\", \"image\"]\nrelated: [\"imageprocess\"]\ndate: \"2020-10-20\"\ndescription: \"How to transfer the style of an image to another image using CNN\"\n---\n\nIn this post, I would like to share my notes from the 'Style Transfer' lecture given by Udacity, Intro to Deep Learning \nwith PyTorch. You may find the references below. \n\nThe key is using the technique that a trained CNN to separate the content from the style of an image. \nThen you can merge the content of one image and style of another and you will get a new image. \n\n content image + style image = target image\n\n**Separating Style & Content**", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_0", "embedding": [ -0.09463268518447876, -0.012068664655089378, 0.039639800786972046, 0.051059916615486145, 0.018006041646003723, 0.00995730236172676, -0.03253350779414177, -0.07987678050994873, -0.053018782287836075, -0.10574198514223099, -0.04841005802154541, 0.03161098435521126, 0.03516199067234993, -0.043016526848077774, 0.0322355292737484, 0.055769894272089005, 0.0019486886449158192, 0.10520363599061966, -0.09113325923681259, 0.015096049755811691, -0.005773331969976425, -0.009979667142033577, 0.0474679097533226, -0.02767985872924328, 0.07774782925844193, 0.07691661268472672, 0.07390523701906204, -0.038268111646175385, 0.053722795099020004, -0.07448752224445343, 0.04412413761019707, -0.05812017247080803, -0.061608392745256424, 0.06308811157941818, -0.050309907644987106, 0.12046746909618378, -0.011159580200910568, 0.07187803089618683, 0.03035867027938366, 0.00813781376928091, 0.057288799434900284, -0.016059234738349915, -0.031813912093639374, -0.03285699337720871, 0.05061180517077446, 0.08626624941825867, -0.0646899938583374, 0.005220579914748669, 0.007813530042767525, 0.010601535439491272, -0.017763009294867516, -0.07289974391460419, -0.060948505997657776, 0.0640590712428093, 0.027082066982984543, 0.07570049166679382, 0.09337183088064194, 0.004828192293643951, 0.004401960875838995, 0.01390458457171917, 0.02785157784819603, 0.036062583327293396, 0.031236302107572556, -0.016605377197265625, 0.05167653039097786, -0.02778109535574913, -0.03225305303931236, 0.05799632892012596, 0.024509122595191002, -0.10640425235033035, 0.053479116410017014, -0.01825033873319626, 0.015962494537234306, 0.040361132472753525, 0.046284954994916916, 0.011783700436353683, 0.03948427364230156, 0.030605373904109, -0.06211454048752785, -0.06286630779504776, 0.040875792503356934, -0.032779138535261154, 0.04442548006772995, 0.02729082480072975, 0.044041696935892105, 0.015768716111779213, -0.09005390107631683, 0.0030694801826030016, -0.09188878536224365, -0.02638631872832775, -0.036721665412187576, -0.016990888863801956, -0.01908182166516781, -0.03924548998475075, 0.07444874197244644, -0.007922477088868618, -0.03815823420882225, -0.0783861055970192, -0.020092133432626724, 0.016326649114489555, -0.021062159910798073, -0.019727524369955063, -0.0257602296769619, -0.03843964263796806, 0.047384113073349, 0.0012748365988954902, 0.017392244189977646, 0.01870056800544262, -0.028173314407467842, -0.050523899495601654, 0.0776369497179985, 0.03305179253220558, -0.06920001655817032, -0.03886427730321884, 0.06546629220247269, 0.007815617136657238, -0.04256204888224602, -0.001124022644944489, 0.0817166194319725, -0.0669175535440445, -0.010850167833268642, 0.01939259096980095, -0.050350069999694824, -0.00795532763004303, -0.06889885663986206, -0.04596590995788574, -0.020654549822211266, 1.729297473814507e-33, 0.04419742524623871, -0.025168582797050476, -0.007474315352737904, 0.033078666776418686, 0.06577406078577042, -0.016840554773807526, -0.02520850859582424, -0.07991248369216919, -0.10444319248199463, -0.04465057700872421, 0.0028586986009031534, -0.10375884175300598, -0.05932057276368141, 0.1077408492565155, -0.08224768936634064, -0.025182006880640984, 0.013754069805145264, -0.0010308547643944621, 0.08276048302650452, 0.0518103651702404, -0.0297304168343544, 0.014832751825451851, -0.022629037499427795, 0.023586273193359375, -0.06830798089504242, -0.051826704293489456, -0.006647764705121517, 0.004613576922565699, 0.03278258815407753, -0.034781936556100845, -0.04566821828484535, -0.021478889510035515, 0.00520423473790288, 0.02254430763423443, -0.07252344489097595, -0.04083563759922981, 0.0013594120973721147, 0.021734656766057014, 0.06848302483558655, -0.013770542107522488, -0.0007330873049795628, 0.06126279756426811, -0.023419611155986786, -0.007407961413264275, -0.03125014528632164, 0.08547371625900269, 0.017875857651233673, -0.01807769574224949, -0.0036020849365741014, 0.022612392902374268, 0.11188072711229324, -0.028418133035302162, 0.009114496409893036, -0.026827819645404816, -0.008140213787555695, -0.07688932120800018, 0.030236799269914627, 0.05044643580913544, 0.07649526000022888, -0.04387516528367996, 0.12715379893779755, 0.09595926851034164, -0.014214049093425274, 0.06125466153025627, 0.08058878779411316, 0.09748992323875427, 0.05615263059735298, 0.004078878555446863, -0.04996613785624504, -0.039337705820798874, -0.014231071807444096, 0.07029499858617783, -0.052315603941679, -0.08478553593158722, 0.04053674638271332, -0.06795013695955276, -0.008670378476381302, -0.06766730546951294, 0.04820578172802925, 0.05464059114456177, -0.03453598544001579, 0.0759839341044426, -0.0016006497899070382, -0.024376384913921356, -0.09093509614467621, 0.1076422706246376, 0.014554484747350216, -0.06581218540668488, 0.061240196228027344, 0.01808791793882847, -0.040052056312561035, -0.020950863137841225, -0.06606730073690414, 0.011377561837434769, 0.08803647011518478, -2.0108805333982625e-33, 0.06361411511898041, 0.09553078562021255, 0.0026914847549051046, 0.04575001820921898, -0.0169658400118351, -0.019258873537182808, -0.035565029829740524, 0.030517805367708206, 0.027815276756882668, 0.009010604582726955, 0.05841105803847313, 0.0008017792133614421, -0.12871676683425903, -0.10253801196813583, -0.062168020755052567, -0.05957081913948059, -0.008906068280339241, 0.03842870518565178, -0.05892297998070717, -0.015604221262037754, 0.01094102207571268, 0.042633332312107086, -0.04777117446064949, 0.007175728678703308, -0.10527533292770386, 0.020389042794704437, -0.01740458607673645, 0.06019064038991928, 0.011586855165660381, -0.0037394065875560045, 0.023039737716317177, -0.0734916478395462, 0.026372531428933144, 0.02951190248131752, -0.036703869700431824, 0.04592981934547424, 0.012648680247366428, -0.03484649956226349, -0.04497912898659706, 0.031008770689368248, 0.03157055750489235, -0.04476761445403099, -0.00925566628575325, -0.012933957390487194, -0.031243355944752693, -0.002424041274935007, -0.06549248844385147, -0.005334013141691685, 0.01955421455204487, 0.08067814260721207, 0.07590284198522568, -0.05735626816749573, -0.04641052335500717, 0.02708476409316063, -0.013399994932115078, -0.014422929845750332, 0.05979038402438164, 0.10499652475118637, 0.008319891057908535, 0.012449311092495918, -0.04065768048167229, -0.09744742512702942, -0.14440499246120453, -0.06529556959867477, -0.030082982033491135, 0.013278711587190628, -0.055314887315034866, -0.05752168968319893, 0.000391368696000427, 0.05933266878128052, 0.007851135917007923, 0.058047015219926834, 0.06184203550219536, 0.08802017569541931, 0.014111299999058247, -0.04187474399805069, 0.07582926005125046, 0.019461937248706818, -0.02113124541938305, -0.04891471192240715, -0.06096087768673897, -0.05731095373630524, -0.05992325395345688, 0.054392341524362564, 0.08537407219409943, 0.13444572687149048, 0.003077592933550477, -0.013433057814836502, 0.03599361330270767, -0.10065695643424988, -0.035051506012678146, -0.03788497671484947, 0.09637187421321869, -0.00920756347477436, -0.005783755797892809, -4.437584877337031e-08, -0.008563323877751827, 0.05315709114074707, 0.03721385821700096, 0.05886857211589813, -0.019076136872172356, 0.04736759513616562, 0.005002245772629976, -0.03799881413578987, 0.04910457879304886, 0.021116001531481743, -0.07107371091842651, 0.07643414288759232, 0.027381092309951782, -0.0129332160577178, -0.07236213237047195, 0.028484731912612915, 0.045819297432899475, 0.028163623064756393, 0.0491679385304451, -0.11529439687728882, 0.006030616816133261, -0.059634529054164886, -0.001454656943678856, -0.00013715036038774997, -0.014190529473125935, -0.009582473896443844, 0.0343819223344326, 0.0323895588517189, -0.00487662386149168, -0.02528424747288227, -0.023728525266051292, -0.02738875523209572, -0.03885704278945923, -0.004270721692591906, 0.094356968998909, 0.017240960150957108, -0.023803940042853355, -0.04913089796900749, 0.015187034383416176, -0.002141333185136318, -0.029740994796156883, 0.038027118891477585, -0.020966270938515663, 0.05010879412293434, 0.014686206355690956, -0.05624982342123985, 0.05084247514605522, -0.07133936136960983, -0.009640442207455635, 0.10908068716526031, 0.09931837022304535, -0.04796767607331276, -0.0023848542477935553, 0.03795617073774338, -0.053348857909440994, -0.02125796116888523, -0.04522582143545151, 0.0539078451693058, 0.025784818455576897, 0.06312153488397598, 0.0047476994805037975, 0.03263650834560394, 0.015981392934918404, -0.05089870095252991 ] }, { "text": "content image + style image = target image\n\n**Separating Style & Content**\n\nIn deep networks, the image is transformed and the layers care about the content of the image, rather than texture and \ncolors. But what about style? It is texture, colors, curvature...", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_1", "embedding": [ -0.010549324564635754, 0.02761571668088436, 0.049846235662698746, -0.006770076230168343, 0.049983371049165726, -0.008925378322601318, -0.024627316743135452, -0.06286679208278656, 0.0441497266292572, -0.04036856070160866, -0.03557708486914635, 0.06972511857748032, 0.04641873389482498, -0.007509466260671616, 0.03694600984454155, 0.00869599636644125, 0.05901483818888664, 0.06227734684944153, -0.09354225546121597, 0.0076355645433068275, 0.01645783707499504, -0.002069724490866065, 0.005052884574979544, -0.07381612807512283, 0.03711852431297302, 0.06337731331586838, 0.07683176547288895, -0.019293660297989845, 0.08923831582069397, -0.0914359763264656, 0.023610951378941536, -0.027897648513317108, 0.022890836000442505, 0.03681296855211258, -0.153291255235672, 0.1163547933101654, 0.004598513711243868, 0.011286048218607903, -0.028493234887719154, 0.027288073673844337, -0.04867534711956978, 0.015301277860999107, -0.02289234660565853, 0.036144156008958817, 0.1275130808353424, 0.06995294243097305, 0.0039004231803119183, -0.023561015725135803, -0.05056111514568329, 0.02022240124642849, -0.03901449963450432, -0.05733397603034973, -0.11702334135770798, 0.09792571514844894, 0.04823826625943184, 0.07491426169872284, 0.042769189924001694, 0.05694422498345375, 0.0014943130081519485, 0.02627873420715332, 0.02076217718422413, 0.021278809756040573, 0.014424128457903862, 0.022912856191396713, 0.08979932218790054, 0.013253516517579556, -0.029735878109931946, 0.007752433884888887, 0.02705659344792366, -0.1500973105430603, 0.09850198775529861, 0.01174373459070921, 0.022726355120539665, 0.01884595863521099, 0.020727524533867836, 0.09057360142469406, 0.06525024026632309, -0.03572746366262436, -0.06552547216415405, -0.05759929120540619, 0.029994668439030647, -0.01882336288690567, 0.0320623479783535, 0.017800450325012207, 0.0630723237991333, 0.03615665063261986, -0.09348725527524948, -0.020907334983348846, -0.10401780903339386, 0.009809858165681362, -0.08336617052555084, -0.015119691379368305, -0.03564416244626045, -0.044549137353897095, 0.028445638716220856, -0.03140781819820404, -0.03085191361606121, -0.09663770347833633, 0.010261042974889278, -0.0015001673018559813, 0.029360312968492508, -0.06000136584043503, 0.011435247026383877, 0.042676497250795364, 0.05656609311699867, -0.060426998883485794, 0.037417829036712646, 0.06749860942363739, -0.0017445760313421488, -0.05156778544187546, 0.02894069440662861, 0.013926369138062, -0.09950172156095505, -0.05576453357934952, -0.0193114522844553, -0.08222915977239609, -0.03637628257274628, 0.020505188032984734, 0.040045760571956635, 0.016920676454901695, -0.04106055572628975, -0.03509251028299332, -0.020198805257678032, -0.0563741996884346, -0.030479956418275833, -0.0687929093837738, -0.013826685026288033, -1.856415983925406e-33, -0.004000288899987936, -0.05640927702188492, -0.0016203551786020398, -0.007573733106255531, 0.10275962203741074, -0.00025356412515975535, -0.017800768837332726, -0.11962573975324631, -0.05711255222558975, -0.023057660087943077, 0.004331186413764954, -0.019079580903053284, -0.06335946172475815, 0.18252411484718323, 0.010974490083754063, -0.019822947680950165, -0.007960804738104343, 0.04246882349252701, 0.00043618842028081417, 0.04933050647377968, -0.015367773361504078, 0.03618746995925903, 0.021539969369769096, 0.0026760566979646683, -0.01946931891143322, -0.0780458077788353, 0.00730709545314312, -0.03204186260700226, -0.04761046916246414, -0.03187698498368263, -0.062322404235601425, -0.026232179254293442, 0.0549892857670784, 0.006288101430982351, -0.029826872050762177, 0.03717854619026184, -0.024082601070404053, 0.020005788654088974, 0.054024189710617065, 0.0042154924012720585, -0.01624424196779728, 0.05961127579212189, -0.0173085518181324, 0.017456771805882454, -0.052301179617643356, 0.05156290903687477, 0.030511222779750824, -0.07016824185848236, -0.06965538114309311, -0.009006502106785774, 0.0829518511891365, -0.016467535868287086, 0.0740429237484932, -0.015047906897962093, 0.056034743785858154, -0.04054717719554901, 0.07599187642335892, 0.04070144519209862, 0.049516089260578156, -0.03179100528359413, 0.05153283476829529, 0.0659157857298851, 0.014209083281457424, 0.011602855287492275, 0.0352122038602829, 0.06533242762088776, 0.015857776626944542, -0.03394017368555069, -0.02114339917898178, -0.019711904227733612, 0.008124087005853653, 0.11788718402385712, -0.05849514901638031, -0.022416453808546066, -0.032777078449726105, -0.044308729469776154, -0.01849471777677536, -0.07234220206737518, 0.05828546732664108, 0.12332885712385178, -0.10830787569284439, 0.10728155821561813, -0.020928720012307167, -0.020367806777358055, -0.15841355919837952, 0.13557247817516327, -0.00476738391444087, -0.03533695265650749, 0.06739617139101028, -0.0030329006258398294, -0.042659711092710495, -0.0018418078543618321, -0.0315142497420311, -0.027727000415325165, 0.023097412660717964, 6.95861156111612e-34, -0.07980979233980179, 0.052270881831645966, -0.0542394183576107, 0.07916457951068878, 0.0019741500727832317, -0.02439115010201931, -0.020383819937705994, 0.030150901526212692, 0.019726060330867767, 0.0318136028945446, 0.0798453539609909, -0.009089196100831032, -0.11922068148851395, -0.06398680061101913, -0.06934447586536407, -0.07059627026319504, -0.045598581433296204, -0.01617133989930153, -0.05991964414715767, -0.02714344672858715, -0.012703831307590008, 0.029443519189953804, -0.06278371065855026, -0.016083238646388054, -0.051721930503845215, 0.05197856202721596, -0.06948418915271759, 0.050399236381053925, -0.013538746163249016, 0.026852067559957504, 0.011357990093529224, -0.08230258524417877, 0.005873848218470812, -0.014370769262313843, -0.003404316259548068, 0.027806377038359642, -0.0035002371296286583, -0.013276144862174988, -0.05540189892053604, 0.06701721251010895, 0.02105194330215454, -0.03400304540991783, -0.0038561196997761726, 0.07344786822795868, -0.057634223252534866, 0.0060636247508227825, -0.008759508840739727, -0.02226724848151207, 0.008132155984640121, 0.023709872737526894, 0.06990460306406021, 0.006330367177724838, 0.01865682192146778, -0.0014837371418252587, 0.0031570971477776766, -0.0290514025837183, -0.05519035458564758, 0.11070235818624496, -0.0013921785866841674, 0.06494522839784622, 0.006726420018821955, -0.07222899049520493, -0.12571445107460022, -0.04890439286828041, -0.05313387140631676, 0.0024707652628421783, -0.02306351438164711, -0.029255036264657974, 0.02995079755783081, 0.026803957298398018, 0.02180480770766735, 0.016940126195549965, 0.02208871580660343, 0.10658273845911026, 0.01159542053937912, -0.0803765207529068, 0.0692332461476326, 0.02888588421046734, -0.0032979128882288933, 0.008140753954648972, -0.013259253464639187, -0.009160923771560192, -0.06005299463868141, 0.07004018127918243, 0.07867893576622009, 0.11928059160709381, -0.07610424607992172, -0.04215255379676819, 0.01605048216879368, -0.07124434411525726, -0.010408079251646996, -0.012011677958071232, -0.018570253625512123, 0.01920349895954132, -0.05870911106467247, -3.3305660451787844e-08, -0.009782449342310429, -0.0066220457665622234, 0.10959886759519577, 0.0160699263215065, -0.034219466149806976, 0.043743912130594254, 0.07890128344297409, -0.02227260358631611, 0.04606102779507637, 0.040969375520944595, -0.02828803099691868, 0.026738928630948067, -0.07206247746944427, -0.02581513673067093, -0.046532731503248215, 0.04906058311462402, 0.020939361304044724, -0.011557313613593578, 0.032703932374715805, -0.03698386251926422, -0.014434631913900375, -0.013666258193552494, -0.07570456713438034, 0.0053266845643520355, 0.05027412995696068, 0.008212418295443058, 0.0034309758339077234, 0.04889016970992088, 0.010310129262506962, 0.026033325120806694, -0.03910188004374504, 0.002565876580774784, -0.039656154811382294, -0.0028441804461181164, 0.052262235432863235, 0.05945657938718796, 0.03205977752804756, -0.02938690036535263, -0.07146595418453217, -0.02060244232416153, -0.023423990234732628, 0.045018576085567474, 0.06851712614297867, 0.05858027935028076, -0.019082974642515182, -0.04058505594730377, 0.051445748656988144, -0.008111302740871906, -0.035032398998737335, 0.04443558305501938, 0.0322946161031723, -0.03937946632504463, -0.013172058388590813, 0.06076670438051224, 0.034827444702386856, -0.05566168576478958, -0.004275934305042028, 0.010950648225843906, 0.029220622032880783, 0.07285968959331512, -0.016199074685573578, -0.025115132331848145, 0.053341615945100784, -0.06579358875751495 ] }, { "text": "## VGG19 Paper Summary\n\nIn this paper[1] style transfer uses the features found in 19 layer VGG network. \n\n- Input: a color image.\n- Pass through conv and pool layers. \n- Finally 3 FC layers. Classify the image.\n- In btw 5 pooling layers --> 2 or 4 conv layers.\n\n
\n \n
Figure 1: VGG Layers for Style and Content Images
\n
", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_2", "embedding": [ -0.06509405374526978, 0.020500097423791885, 0.0257441233843565, 0.0327647365629673, 0.14713054895401, 0.030897891148924828, 0.016526613384485245, -0.034314025193452835, 0.03465372323989868, -0.06545057147741318, -0.00390288676135242, -0.019287096336483955, -0.009656177833676338, -0.007738121785223484, 0.009433611296117306, -0.012574749067425728, 0.05244579538702965, 0.08791859447956085, -0.03233271837234497, -0.003941110800951719, -0.005392914172261953, -0.12018648535013199, 0.023722395300865173, -0.10516660660505295, 0.06424892693758011, 0.029440000653266907, -0.024944454431533813, 0.035996999591588974, 0.06580449640750885, -0.1074768528342247, -0.00533934636041522, 0.024140333756804466, -0.06699223816394806, 0.09064812958240509, -0.12340837717056274, 0.06090697646141052, -0.04361956566572189, -0.05941455811262131, -0.06906061619520187, -0.009924272075295448, 0.007657598238438368, -0.06621599197387695, 0.013730717822909355, -0.05779087170958519, 0.040265846997499466, 0.0635007843375206, -0.022123515605926514, 0.013722933828830719, -0.05405677109956741, -0.0011875620111823082, 0.016557011753320694, -0.08279310166835785, -0.047591567039489746, 0.058565594255924225, 0.06653439253568649, 0.02382422611117363, 0.07536500692367554, -0.02161901257932186, 0.06190996989607811, 0.047838661819696426, -0.006598630454391241, -0.0007050206768326461, -0.00324259209446609, -0.011639519594609737, 0.05774702504277229, 0.00023190752835944295, -0.03256067633628845, 0.03528738021850586, 0.015878574922680855, -0.1328563392162323, -0.025088714435696602, 0.028392164036631584, -0.03015405312180519, -0.021141037344932556, 0.0329568050801754, 0.07588990777730942, 0.03529039025306702, 0.026011096313595772, -0.005287377163767815, -0.10755328088998795, 0.05501082167029381, 0.00858144462108612, 0.016467362642288208, 0.03381527215242386, 0.007736796513199806, 0.035503730177879333, -0.06241144612431526, -0.014695868827402592, -0.07851873338222504, 0.026264969259500504, -0.04321334511041641, 0.05436220020055771, -0.05008099973201752, 0.02185622975230217, -0.014399044215679169, -0.028483793139457703, -0.09040537476539612, -0.06844902783632278, -0.022948352620005608, 0.015456154942512512, 0.01341931987553835, -0.04863538593053818, 0.10898654162883759, 0.012368147261440754, 0.0860125944018364, -0.0237351693212986, 0.05687772482633591, 0.10745986551046371, -0.058688934892416, -0.08963057398796082, 0.014928949996829033, 0.04735167324542999, -0.08816315233707428, -0.0819425880908966, 0.03689907491207123, 0.06052859127521515, -0.04482555389404297, 0.02185293659567833, 0.037268877029418945, -0.022122086957097054, 0.02983912266790867, 0.007204695139080286, -0.05080712214112282, -0.04356611520051956, -0.011468376964330673, -0.048209287226200104, -0.0632680356502533, 7.077157043989678e-33, 0.01226726733148098, 0.03908305615186691, -0.019357219338417053, 0.029228871688246727, 0.012693769298493862, -0.019592508673667908, 0.0012728568399325013, -0.15173986554145813, -0.07942812889814377, -0.04229394719004631, -0.010235600173473358, -0.02298521064221859, -0.08131773769855499, 0.09268844872713089, 0.018220672383904457, -0.07784372568130493, 0.005122805945575237, 0.04088355600833893, 0.022659901529550552, 0.02678723633289337, 0.00488772289827466, -0.016495952382683754, -0.00493249949067831, -0.021285556256771088, -0.008809651248157024, 0.020289776846766472, -0.04336946830153465, -0.014161099679768085, -0.0020976902451366186, 0.006624180823564529, 0.047489844262599945, 0.04612618684768677, 0.04803786054253578, 0.03838471695780754, -0.04963009059429169, 9.684886026661843e-05, -0.007979817688465118, -0.01281276810914278, 0.05364149063825607, 0.0411088690161705, -0.012709793634712696, 0.035098593682050705, -0.0562526173889637, 0.02085975930094719, -0.028725827112793922, -0.0075673810206353664, 0.012632841244339943, 0.0014248626539483666, -0.011252856813371181, 0.07052358239889145, 0.039930250495672226, -0.05483018979430199, -0.05042578652501106, -0.04697144404053688, 0.07233206182718277, -0.029931800439953804, 0.05093903839588165, 0.05230925977230072, 0.026308616623282433, 0.01586565561592579, 0.15017998218536377, 0.0562053918838501, -0.07489848136901855, 0.006701955106109381, 0.06349554657936096, 0.08314681798219681, 0.07950936257839203, -0.07267636805772781, -0.04413745179772377, -0.055322159081697464, -0.051379717886447906, 0.06811627000570297, 0.00993195828050375, -0.06894640624523163, 0.03232540935277939, -0.06864557415246964, -0.0721253901720047, -0.04724661260843277, -0.017008064314723015, 0.057769980281591415, -0.05484754592180252, 0.07845606654882431, -0.02681596949696541, -0.057025980204343796, -0.11053133010864258, 0.06527266651391983, 0.006325170397758484, -0.025368252769112587, -0.008034427650272846, -0.010735348798334599, 0.03167750686407089, -0.0026438222266733646, -0.007028764579445124, -0.05858995020389557, -0.021217994391918182, -4.8583368863897305e-33, 0.01960819959640503, 0.13733915984630585, -0.039235685020685196, 0.13917948305606842, 0.005867326632142067, -0.025135943666100502, 0.08263789862394333, -0.0224752239882946, 0.02517957054078579, 0.04620051756501198, 0.05287817120552063, 0.021347979083657265, -0.08159495145082474, -0.07809008657932281, -0.018585694953799248, -0.019625121727585793, -0.05465938150882721, -0.02052312158048153, -0.032878898084163666, -0.01273032370954752, -0.03449202701449394, 0.04952053353190422, 0.03286968171596527, 0.044511593878269196, -0.09030576795339584, 0.03981127589941025, -0.020860174670815468, -0.007287436630576849, 0.01707543060183525, -0.01458860095590353, -0.04097461327910423, -0.06018320098519325, 0.023453863337635994, 0.018163084983825684, 0.08198476582765579, -0.03758597373962402, 0.06235568970441818, 0.05156697705388069, 0.018289636820554733, 0.05849410220980644, -0.025428300723433495, -0.0704648494720459, -0.06824555993080139, -0.021264025941491127, -0.06691501289606094, 0.015385031700134277, -0.024822304025292397, 0.03471053019165993, 0.003041344229131937, 0.026529880240559578, 0.05310317128896713, -0.014705021865665913, -0.034583982080221176, 0.0327514111995697, -0.018924273550510406, 0.026028458029031754, 0.02964581735432148, 0.12126405537128448, 0.05493009090423584, 0.05057738348841667, 0.022058909758925438, -0.052480146288871765, -0.07471228390932083, -0.057778097689151764, 0.012518460862338543, 0.041811373084783554, -0.018872400745749474, -0.03391728550195694, 0.04550975561141968, 0.02598266489803791, 0.03942480683326721, 0.028528202325105667, 0.07243011146783829, -0.08629495650529861, 0.04275960847735405, -0.08728370070457458, 0.08255768567323685, 0.06296829134225845, 0.04091422259807587, -0.03890009596943855, -0.08192359656095505, 0.06673429161310196, -0.008164077997207642, 0.04655344411730766, 0.08209565281867981, 0.10928327590227127, -0.04048901051282883, 0.02661760337650776, 0.08789001405239105, -0.07494885474443436, -0.06745506078004837, -0.015208187513053417, 0.08439464867115021, 0.041027266532182693, -0.0068577867932617664, -4.658137342516966e-08, 0.007627495098859072, 0.01863022893667221, 0.017851874232292175, -0.03528910502791405, -0.012186959385871887, 0.0495716854929924, 0.022347882390022278, 0.0009307711152359843, 0.01464192196726799, 0.09525931626558304, -0.03459112346172333, 0.10436680912971497, 0.013651451095938683, -0.02073773927986622, -0.025673147290945053, 0.024206597357988358, 0.016526395455002785, 0.08033701777458191, -0.008652870543301105, -0.02757296711206436, -0.0013593067415058613, -0.024887314066290855, -0.02631312608718872, 0.03506091237068176, -0.012191380374133587, -0.006302417255938053, -0.04972170665860176, 0.043867990374565125, 0.015467336401343346, -0.009721342474222183, 0.04145336151123047, 0.020862584933638573, -0.05162021145224571, -0.02181369997560978, 0.029306907206773758, 0.06417675316333771, -0.0920339897274971, -9.740817040437832e-05, -0.008114993572235107, 0.04648978263139725, -0.029942892491817474, -0.07093530148267746, 0.03863297402858734, -0.01051187515258789, 0.009947054088115692, 0.03311822563409805, -0.005695913452655077, -0.08983355015516281, -0.08478457480669022, 0.10126574337482452, 0.0012711914023384452, -0.021664893254637718, -0.07269303500652313, 0.08449845016002655, -0.02685059793293476, -0.05269775539636612, 0.06871812790632248, -0.013837744481861591, 0.07153341174125671, 0.0009044623002409935, -0.017415108159184456, 0.01679372973740101, 0.023941263556480408, -0.029701415449380875 ] }, { "text": "### Explanation of the Figure:\n\nThis is an image representations in a Convolutional Neural Network (CNN). \n\nA given input image is represented as a set of filtered images at each processing stage in the CNN. While the number of \ndifferent filters increases along the processing hierarchy, the size of the filtered\nimages is reduced by some down sampling mechanism (e.g. max-pooling) leading to a decrease in the total number of units \nper layer of the network. \n\n#### Content Reconstructions:\n\nWe can visualise the information at different processing stages in the CNN by reconstructing the input image from only \nknowing the network’s responses in a particular layer.", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_3", "embedding": [ -0.05025671422481537, 0.05673384293913841, 0.050925228744745255, -0.010705333203077316, 0.05411360412836075, -0.016889087855815887, 0.01219419576227665, -0.06537599116563797, 0.07385165989398956, -0.0933191329240799, -0.04719182476401329, 0.04238913580775261, 0.042570531368255615, 0.03244352340698242, -0.15599006414413452, 0.0014673944097012281, 0.029321711510419846, 0.023252667859196663, -0.1332741677761078, -0.06570948660373688, 0.04753085970878601, -0.002098732627928257, -0.012450111098587513, -0.05126679316163063, 0.0655619204044342, 0.0687754899263382, -0.044071849435567856, -0.029826315119862556, 0.052898015826940536, -0.08499615639448166, 0.0018102223984897137, 0.011478359811007977, 0.04748867452144623, 0.052908096462488174, -0.05379873886704445, 0.04226969927549362, -0.04871690645813942, 0.05951549485325813, 0.054691195487976074, 0.027244064956903458, 0.019268551841378212, 0.0642714872956276, 0.0009653987362980843, 0.019757041707634926, 0.025768447667360306, 0.109615258872509, -0.049456097185611725, -0.07049709558486938, 0.020189454779028893, 0.01028265617787838, -0.02814454771578312, 0.03381960093975067, -0.07855155318975449, 0.05807552859187126, 0.0784488320350647, -0.004014324862509966, -0.017916657030582428, -0.08058056980371475, 0.005781328305602074, 0.03401593863964081, 0.027800358831882477, 0.011072996072471142, 0.0003803063300438225, 0.02392476424574852, 0.07738137245178223, -0.011194459162652493, -0.02390076033771038, -0.047883305698633194, 0.045217618346214294, -0.06703571230173111, 0.040533822029829025, 0.07911032438278198, -0.0012973182601854205, -0.01735866814851761, 0.05968325957655907, -0.01762027107179165, 0.016145499423146248, 0.025385888293385506, 0.04316185042262077, -0.03134439140558243, 0.0791919156908989, 0.01809627376496792, 0.02819487825036049, 0.022706376388669014, -0.024772770702838898, -0.008989167399704456, -0.08651278167963028, -0.060179729014635086, 0.006730248220264912, -0.02419452928006649, -0.12960964441299438, -0.025644898414611816, -0.09158352017402649, 0.04256044328212738, -0.039422448724508286, 0.010232802480459213, -0.01352767925709486, -0.018110545352101326, 0.054429564625024796, 0.06451043486595154, 0.059024035930633545, -0.05777791887521744, 0.1619425266981125, -0.03389770910143852, 0.00031423033215105534, -0.06458889693021774, 0.10784420371055603, 0.07591719180345535, 0.020731665194034576, -0.024587176740169525, 0.02430223487317562, -0.02088983543217182, -0.06396489590406418, 0.031941041350364685, 0.06928624957799911, -0.02815989777445793, 0.018805034458637238, 0.016616255044937134, -0.014089779928326607, -0.0022586022969335318, -0.03111167997121811, 0.005510999821126461, -0.07573381066322327, -0.03866255283355713, -0.006923746783286333, 0.017189351841807365, -0.05256526172161102, 4.448152173432124e-33, -0.018870992586016655, -0.01122495997697115, 0.06102342903614044, 0.00023437931668013334, 0.059619124978780746, -0.015512951649725437, 0.004564271308481693, -0.06560679525136948, 0.01678048074245453, 0.03487210348248482, -0.08879658579826355, 0.031110821291804314, -0.030421048402786255, 0.16477026045322418, -0.01886708475649357, -0.09674481302499771, -0.025963198393583298, 0.06500896066427231, -0.009965510107576847, -0.04251137003302574, -0.08527608960866928, 0.04182237386703491, 0.01962033472955227, -0.026831969618797302, -0.014948371797800064, 0.012340880930423737, -0.027153652161359787, -0.00018379346875008196, -0.037389833480119705, -0.011973167769610882, -0.012407596223056316, 0.11377584934234619, -0.034732475876808167, -0.018733851611614227, 0.005010028835386038, 0.020264185965061188, 0.0739036574959755, 0.010829643346369267, 0.00810567382723093, 0.022235238924622536, 0.050209805369377136, 0.02394150197505951, 0.03279629349708557, 0.011328480206429958, -0.07841416448354721, -0.029733184725046158, 0.0082221869379282, -0.02288649044930935, -0.04774092510342598, 0.00708932988345623, 0.05110541358590126, -0.008622837252914906, -0.00016932767175603658, -0.05864055082201958, 0.05009660869836807, -0.00395622244104743, 0.052703145891427994, -0.0030289345886558294, 0.010471003130078316, 0.044265713542699814, 0.10133644938468933, -0.039592646062374115, -0.06912194937467575, 0.07587976008653641, 0.054383885115385056, 0.038773853331804276, -0.02119453437626362, -0.013085171580314636, 0.0427427813410759, 0.03411780670285225, -0.08642154932022095, 0.01636076532304287, -0.004172443877905607, -0.06164151057600975, 0.012845616787672043, 0.030523044988512993, -0.053713608533144, 0.0037045166827738285, -0.06265974789857864, 0.04919334501028061, -0.08225340396165848, -0.0300047118216753, 0.016571996733546257, -0.07660580426454544, -0.09237479418516159, 0.0826042965054512, 0.057739127427339554, -0.10352414101362228, 0.04084783047437668, -0.0442051962018013, -0.02713611163198948, -0.0288313589990139, -0.037010110914707184, 0.0050737434066832066, 0.017679262906312943, -4.4553124033965705e-33, -0.02239934168756008, 0.11959289759397507, -0.04657787084579468, 0.0290471650660038, -0.02610027603805065, -0.03400997444987297, -0.02938183955848217, 0.09318754822015762, 0.0021339452359825373, 0.012931723147630692, -0.023526210337877274, -0.020825030282139778, 0.009635853581130505, -0.08359047770500183, -0.07167665660381317, -0.06670784950256348, 0.021297313272953033, -0.10247267037630081, -0.025564920157194138, -0.059825483709573746, 0.0034219403751194477, 0.06751364469528198, 0.0550447553396225, 0.0030333795584738255, -0.08726217597723007, 0.09697486460208893, -0.012013433501124382, -0.03267455846071243, 0.11954505741596222, 0.0020249190274626017, -0.05626969784498215, -0.14017216861248016, 0.025182757526636124, 0.0152490995824337, -0.004060784354805946, 0.019790081307291985, 0.04126562178134918, -0.023719387128949165, -0.014153968542814255, -0.08110444992780685, 0.07020417600870132, -0.002982902340590954, 0.009145977906882763, 0.03807305172085762, -0.009123019874095917, -0.01978657767176628, 0.025254370644688606, -0.015671050176024437, -0.045715853571891785, 0.036774665117263794, 0.026380158960819244, 0.024308234453201294, -0.034024909138679504, 0.028054917231202126, -0.012552455998957157, 0.02469014748930931, -0.014028693549335003, 0.04321696236729622, 0.1324039101600647, 0.01587003655731678, -0.06160690262913704, -0.11517591774463654, -0.12981875240802765, -0.0055777812376618385, -0.05008130148053169, 0.04618185758590698, -0.03941922262310982, -0.01817723922431469, -0.045502547174692154, 0.1006837710738182, 0.048125408589839935, -0.03405667468905449, 0.003840385004878044, 0.005004000850021839, 0.006472371052950621, -0.1292838305234909, -0.024614162743091583, 0.07681995630264282, 0.007364074699580669, 0.05141942575573921, -0.03466867655515671, -0.0607602633535862, -0.003143117530271411, 0.08350101113319397, 0.12328048050403595, 0.013115587644279003, -0.04354527220129967, -0.013655527494847775, 0.04598228633403778, 0.02861124463379383, 0.022204497829079628, -0.012817413546144962, -0.08277008682489395, 0.024388855323195457, 0.044174231588840485, -5.2303786191032486e-08, -0.03631853684782982, -0.0114464545622468, -0.07106667757034302, -0.02547597885131836, 0.07437780499458313, -0.026163455098867416, 0.04135412350296974, 0.08984030038118362, -0.04956844076514244, -0.009385088458657265, 0.05045359954237938, 0.0002878077211789787, -0.032818082720041275, -0.034114569425582886, -0.0006428906344808638, 0.06150365620851517, 0.004873280413448811, 0.03494132682681084, 0.05748407542705536, 0.00014865816046949476, -0.017658527940511703, -0.03835234418511391, -0.006110397167503834, 0.034603301435709, 0.04003157839179039, 0.023381249979138374, -0.037981025874614716, 0.07268453389406204, -0.046344686299562454, -0.03043021447956562, 0.012662535533308983, 0.03587423264980316, 0.005337652284651995, -0.023031966760754585, 0.032961368560791016, 0.051188547164201736, -0.07881265133619308, -0.049031950533390045, -0.03819436952471733, -0.04947512596845627, -0.06530848890542984, -0.05655624717473984, 0.06477002799510956, 0.009335621260106564, 0.01392150204628706, 0.05203079804778099, 0.034740425646305084, -0.013372010551393032, 0.019224144518375397, 0.04154711961746216, -0.006772951222956181, -0.026489602401852608, 0.03543960303068161, 0.059027448296546936, -0.037593282759189606, -0.08724335581064224, -0.018915092572569847, -0.0506393127143383, 0.04099592939019203, 0.06992098689079285, -0.013792857527732849, 0.060365766286849976, -0.00425597233697772, -0.045535214245319366 ] }, { "text": "We reconstruct the input image from from layers:\n- ‘conv1 2’ (a),\n- ‘conv2 2’ (b), \n- ‘conv3 2’ (c), \n- ‘conv4 2’ (d)\n- ‘conv5 2’ (e) of the original VGG-Network. \n\nWe find that reconstruction from lower layers is almost perfect (a–c). In higher layers of the network, detailed pixel \ninformation is lost while the high-level content of the image is preserved (d,e). \n\n#### Style Reconstructions", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_4", "embedding": [ -0.09518463164567947, 0.08986090123653412, 0.059846095740795135, -0.011096061207354069, 0.09890847653150558, -0.050443485379219055, -0.010511703789234161, -0.05231855809688568, 0.034488577395677567, -0.07077185809612274, -0.053917333483695984, 0.02106751687824726, -0.008049501106142998, -0.05007217824459076, -0.062464941293001175, -0.07529886811971664, 0.06039585918188095, 0.12107555568218231, -0.03619939461350441, -0.04843279719352722, -0.05778580531477928, -0.044457368552684784, -0.0026036915369331837, -0.08279483020305634, 0.10003980994224548, 0.01554737240076065, -0.013386170379817486, 0.061822813004255295, 0.04291783273220062, -0.08878371119499207, -0.029236173257231712, 0.014763321727514267, -0.03475325554609299, 0.042376235127449036, -0.09246151894330978, 0.09008747339248657, -0.03503626585006714, 0.006777524948120117, -0.043515563011169434, -0.03509218618273735, 0.011080196127295494, 0.03777478262782097, -0.020632615312933922, -0.016537288203835487, 0.01748226396739483, 0.07996833324432373, 0.022497013211250305, -0.026677658781409264, -0.006332912016659975, -0.0333324559032917, -0.01767980121076107, -0.028042161837220192, -0.028397686779499054, 0.06799525022506714, 0.045449335128068924, 0.09417251497507095, -0.002679025987163186, -0.025227054953575134, 0.014647161588072777, 0.0733606368303299, 0.02048996463418007, 0.07898271083831787, -0.05486714467406273, 0.056379470974206924, 0.0378933846950531, -0.005453913006931543, 0.04448170214891434, -0.03599564731121063, 0.060804810374975204, -0.02060573361814022, -0.005153247620910406, 0.04351881146430969, -0.060048505663871765, -0.06037074327468872, 0.011552522890269756, 0.10095348209142685, -0.0053900363855063915, 0.0384724885225296, 0.047834087163209915, -0.0474548302590847, 0.1100514754652977, 0.026418114081025124, -0.04491512104868889, 0.046544164419174194, -0.03257369622588158, -0.008152442052960396, -0.05743410065770149, -0.00646361755207181, -0.00984716136008501, -0.034993384033441544, -0.08977430313825607, -0.015125319361686707, -0.08449580520391464, 0.04485291987657547, -0.006309669464826584, -0.02612132765352726, 0.012127610854804516, -0.047295939177274704, 0.03941875696182251, 0.08202745765447617, -0.010718702338635921, -0.0693364143371582, 0.046733830124139786, -0.04538590833544731, 0.058800652623176575, 0.03362530097365379, 0.0877687931060791, 0.08392106741666794, 0.0017337207682430744, -0.03777464106678963, 0.024880971759557724, 0.002789673861116171, -0.007571004796773195, 0.00959237664937973, 0.12077528238296509, -0.030877552926540375, -0.00842690747231245, 0.04595750942826271, -5.490907278726809e-05, -0.04170819744467735, -0.08570071309804916, -0.02439534105360508, -0.061413560062646866, -0.04772907868027687, -0.014222140423953533, -0.06211509183049202, -0.04232653230428696, 5.691871481692168e-33, -0.03731832280755043, 0.0761033445596695, 0.013911730609834194, 0.04070568084716797, 0.02758898213505745, 0.0559697225689888, 0.014772150665521622, -0.12414951622486115, 0.002247924217954278, 0.028846006840467453, -0.07427973300218582, -0.03820674493908882, -0.0369110144674778, 0.12856732308864594, -0.008248705416917801, 0.011161291971802711, 0.008970124647021294, 0.03998412564396858, -0.05013849213719368, -0.0004329145303927362, -0.01261363085359335, 0.021678054705262184, 0.020185790956020355, -0.059389375150203705, -0.042458243668079376, -0.017585571855306625, 0.005613344721496105, -0.046047769486904144, -0.00019854541460517794, -0.0408998467028141, -0.02214118465781212, 0.05629095062613487, 0.08593197166919708, 0.03167411684989929, -0.08357108384370804, 0.03856736049056053, 0.11855698376893997, 0.0019018655875697732, -0.009826485067605972, 0.058080967515707016, 0.07065852731466293, 0.09058637171983719, 0.0027979454025626183, -0.045783575624227524, -0.006127301603555679, -0.025032659992575645, 0.010583531111478806, 0.03918350860476494, -0.07522563636302948, 0.028469115495681763, 0.02686215005815029, -0.025020970031619072, -0.03572782129049301, -0.09235706925392151, -0.006395556963980198, -0.025425979867577553, 0.13143299520015717, 0.04219069704413414, 0.03835556283593178, 0.057194191962480545, 0.06367974728345871, 0.001977083273231983, -0.04015498235821724, 0.0835278108716011, -0.00019414146663621068, 0.046769168227910995, -0.035823117941617966, -0.06347700953483582, -0.05159851536154747, -0.00328368810005486, -0.08123954385519028, 0.08547692745923996, -0.0070430380292236805, -0.10499192029237747, 0.04651937633752823, -0.008790578693151474, -0.098117895424366, -0.07609064131975174, -0.0017255126731470227, 0.01978018507361412, -0.06766271591186523, 0.07465828955173492, -0.02102975733578205, -0.05841463431715965, -0.06866960227489471, 0.027551375329494476, 0.02753724716603756, -0.11291708797216415, 0.05034809932112694, -0.010244105942547321, -0.043496664613485336, -0.06633532047271729, -0.006448712665587664, -0.06714627146720886, -0.0002012957411352545, -4.4147670318428174e-33, -0.0211256705224514, 0.14328713715076447, -0.0199109073728323, 0.06952272355556488, -0.07830264419317245, -0.00048034515930339694, 0.06301067769527435, 0.005365468095988035, -0.028509965166449547, 0.012033548206090927, 0.07015649229288101, 0.022886496037244797, 0.01402788795530796, -0.06701579689979553, -0.02712143585085869, -0.05088004469871521, -0.02760769985616207, -0.06663797795772552, 0.0007230024202726781, -0.05237877741456032, 0.05866425111889839, 0.029656626284122467, 0.00727228494361043, 0.04420384392142296, -0.012772133573889732, 0.05144048109650612, 0.004576103761792183, 0.0843137800693512, 0.04036879166960716, -0.013631287030875683, -0.011349868029356003, -0.06380327045917511, 0.01263410598039627, 0.006519364658743143, 0.0552644357085228, 0.03947003558278084, 0.06113745644688606, 0.03147812932729721, -0.027017157524824142, 0.007471940480172634, 0.012718787416815758, 0.005683973431587219, -0.07914326339960098, 0.0073547265492379665, -0.008342858403921127, -0.026020869612693787, -0.0014262543991208076, 0.02210972085595131, 0.020248744636774063, 0.034053172916173935, 0.072562076151371, -0.006825407966971397, -0.05639420449733734, 0.04018412157893181, -0.00379405589774251, 0.05868808180093765, -0.053541358560323715, 0.07471153140068054, 0.11981730908155441, -0.023810025304555893, -0.022097965702414513, -0.1335141509771347, -0.0981404259800911, -0.009753832593560219, 0.02592136524617672, 0.028965767472982407, 0.004895707592368126, 0.04272257164120674, -0.003773326287046075, 0.054213739931583405, 0.0031813322566449642, 0.023924212902784348, -0.009803964756429195, -0.0167019534856081, 0.07885616272687912, -0.08840341866016388, 0.0006812583887949586, 0.07825689762830734, 0.015048148110508919, 0.034763727337121964, -0.034373026341199875, -0.024108262732625008, 0.028852924704551697, 0.0336422473192215, 0.1288186013698578, 0.09978578239679337, -0.08598248660564423, -0.016656797379255295, 0.09300839155912399, 0.004756000358611345, -0.06061357632279396, 0.019663158804178238, 0.011032911017537117, -0.03934843838214874, 0.07254792004823685, -5.177396289468561e-08, -0.03547362983226776, 0.07771928608417511, -0.008936278522014618, 0.005079622846096754, 0.05467225983738899, -0.08259618282318115, 0.02947211265563965, 0.042187824845314026, 0.01681642234325409, -0.011453653685748577, -0.04215484485030174, -0.01437545195221901, -0.05443691089749336, -0.05177846923470497, -0.03329245373606682, 0.10766235738992691, 0.008467947132885456, 0.009657785296440125, 0.01745493896305561, 0.013380730524659157, -0.008258159272372723, 0.00021756149362772703, -0.0601496659219265, 0.04437072575092316, 0.03235700726509094, 0.010411432012915611, -0.09822221100330353, -0.01645924337208271, 0.016192615032196045, 0.03976360335946083, 0.006338720675557852, 0.02051810920238495, 0.060905665159225464, -0.041566312313079834, -0.044056907296180725, 0.022116035223007202, -0.03001825138926506, 0.022053107619285583, -0.046918101608753204, -0.06567085534334183, -0.0664358139038086, -0.056722208857536316, 0.04787486791610718, -0.032425105571746826, -0.020071178674697876, -0.010267717763781548, 0.041714783757925034, -0.011357283219695091, -0.05164369195699692, -0.019996143877506256, 0.0017071128822863102, 0.01247797254472971, -0.03863295912742615, 0.0038432336878031492, 0.031473636627197266, -0.12125266343355179, 0.05043995380401611, -0.02754499763250351, 0.06948795169591904, 0.031278952956199646, -0.0115108797326684, 0.05734535679221153, -0.0010557211935520172, -0.037929926067590714 ] }, { "text": "#### Style Reconstructions\n\nOn top of the original CNN activations we use a feature space that captures the texture information of an\ninput image. The style representation computes correlations between the different features in different layers of the CNN. \nWe reconstruct the style of the input image from a style representation built on different subsets of CNN layers \n- ‘conv1 1’ (a), \n- ‘conv1 1’ and ‘conv2 1’ (b), \n- ‘conv1 1’, ‘conv2 1’ and ‘conv3 1’ (c), \n- ‘conv1 1’, ‘conv2 1’, ‘conv3 1’ and ‘conv4 1’ (d), \n- ‘conv1 1’, ‘conv2 1’, ‘conv3 1’, ‘conv4 1’ and ‘conv5 1’ (e). \n\nThis creates images that match the style of a given image on an increasing scale while discarding information of the\nglobal arrangement of the scene.\" [1]", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_5", "embedding": [ -0.07011137157678604, -0.023313840851187706, 0.11834264546632767, 0.0023498330265283585, 0.04696508124470711, 0.04360929876565933, -0.0060561117716133595, -0.10713909566402435, 0.02408328279852867, -0.10603954643011093, -0.06323627382516861, 0.003449763637036085, 0.06629648804664612, 0.03340602293610573, -0.05180802568793297, 1.004838941298658e-05, 0.022332604974508286, 0.14225026965141296, -0.08811257779598236, -0.027370646595954895, 0.010766899213194847, -0.0008907906012609601, 0.013735981658101082, -0.029278164729475975, 0.08555428683757782, 0.03507924824953079, 0.03713616356253624, 0.021711206063628197, 0.06922885030508041, -0.08969569206237793, 0.052421241998672485, 0.0296800397336483, 0.007543614134192467, 0.010029101744294167, -0.0527287982404232, 0.043946824967861176, -0.02526671439409256, 0.054411452263593674, 0.03144947811961174, 0.03792719915509224, -0.014713349752128124, 0.02844604291021824, 0.02495158463716507, -0.0008499171235598624, 0.05614670366048813, 0.12063106149435043, 0.0013190855970606208, 0.011876407079398632, -0.0505145899951458, 0.020278651267290115, -0.0013940167846158147, -0.026388010010123253, -0.09687173366546631, 0.034935928881168365, 0.0032982993870973587, 0.07096898555755615, 0.08518237620592117, -0.023533636704087257, 0.036545898765325546, 0.047785867005586624, 0.06151343509554863, 0.011497991159558296, -0.023180730640888214, 0.02369941957294941, 0.025882979854941368, -0.0005532211507670581, 0.00753716891631484, 0.002518550492823124, 0.06688614189624786, -0.03544635698199272, 0.027207689359784126, 0.05197962373495102, 0.010180947370827198, -0.01128741167485714, 0.02356027625501156, 0.09032343327999115, 0.0193485077470541, -0.003960472997277975, 0.011356998234987259, -0.11991534382104874, 0.0559995174407959, -0.000840939290355891, 0.07427313923835754, 0.03555990383028984, 0.07522914558649063, -0.018055183812975883, -0.07551164925098419, -0.01724834553897381, -0.020720385015010834, 0.015016414225101471, -0.0833025723695755, -0.05813274160027504, -0.13321813941001892, -0.07819896191358566, 0.04487336054444313, 0.005104118958115578, 0.006318213418126106, -0.050626490265131, 0.05402021482586861, 0.029557455331087112, -0.005239769350737333, -0.08287212252616882, 0.053086504340171814, 0.005849719978868961, 0.12125544250011444, -0.03722546994686127, 0.06936042010784149, 0.019993005320429802, 0.013185023330152035, -0.08569055795669556, 0.0347384437918663, -0.039509885013103485, -0.035147808492183685, -0.022182656452059746, 0.09399629384279251, 0.01597912423312664, -0.002698904601857066, 0.010375753045082092, 0.07434660196304321, -0.03328584507107735, -0.012714797630906105, -0.0456964485347271, -0.0511152558028698, -0.02274852618575096, -0.05195919796824455, -0.023638498038053513, -0.03046579286456108, 8.307433104980131e-33, 0.026450546458363533, 0.008358177728950977, 0.017610318958759308, 0.0545792318880558, 0.0836806669831276, 0.011505862697958946, -0.035003967583179474, -0.07936403900384903, -0.07512134313583374, 0.04046860337257385, -0.061387963593006134, 0.02946063131093979, -0.02410798706114292, 0.14135761559009552, -0.04565242677927017, -0.0032758198212832212, -0.01033781562000513, 0.014351660385727882, -0.028659258037805557, -0.023340435698628426, -0.10411621630191803, 0.017648208886384964, -0.01150586362928152, -0.007260808255523443, -0.06075097993016243, -0.08148662000894547, 0.009614581242203712, -0.00804829690605402, -0.07316605001688004, -0.0661032646894455, -0.038145698606967926, 0.0010962496744468808, -0.021181974560022354, 0.050924450159072876, -0.05149858444929123, -0.01506255753338337, 0.029461434110999107, 0.006495889276266098, 0.044874679297208786, 0.06964551657438278, 0.04174942523241043, 0.1027996689081192, -0.02114277519285679, -0.023279806599020958, -0.049380239099264145, 0.07057573646306992, 0.02193632163107395, 0.016368074342608452, -0.02402610331773758, -0.029659230262041092, 0.13638398051261902, 0.03221455588936806, -0.004393506795167923, -0.05831766501069069, -0.010156121104955673, -0.07165374606847763, 0.07311911135911942, 0.00022291229106485844, 0.053393345326185226, -0.0208111759275198, 0.0337190106511116, 0.022983191534876823, -0.040867775678634644, 0.06079768016934395, 0.0021383233834058046, 0.04162997007369995, 0.022914940491318703, -0.03649338334798813, 0.016812633723020554, 0.046272099018096924, -0.06009776145219803, 0.07692603021860123, -0.037794843316078186, -0.09348317235708237, 0.012142647989094257, 0.01112264022231102, -0.061377864331007004, -0.05574284493923187, -0.03792721778154373, 0.011245273053646088, -0.06777069717645645, 0.049048710614442825, -0.014432388357818127, -0.015639806166291237, -0.11223087459802628, 0.085287906229496, 0.022553985938429832, -0.10320752114057541, 0.05793508514761925, -0.05756136029958725, -0.04079125449061394, -0.06765086203813553, 0.04203376919031143, -0.0314335972070694, 0.017878299579024315, -6.19817453100659e-33, 0.007849016226828098, 0.07558787614107132, 0.04193781688809395, 0.008793278597295284, -0.05328875035047531, -0.016471000388264656, -0.0054891714826226234, 0.004246182274073362, 0.008054260164499283, -0.057153742760419846, 0.06515713036060333, 0.0023171319626271725, -0.038187943398952484, -0.09863747656345367, -0.0690804272890091, -0.07532981783151627, -0.0751853957772255, -0.016882145777344704, 0.012093043886125088, 0.030594954267144203, 0.0700359120965004, 0.031580884009599686, -0.06079657003283501, 0.014971824362874031, -0.11366114765405655, 0.0863177478313446, -0.005361131392419338, 0.038291774690151215, 0.030186651274561882, 0.004113077651709318, -0.042227886617183685, -0.06838919222354889, 0.03592688590288162, 0.03328033536672592, -0.03861548379063606, 0.026265162974596024, 0.0038043425884097815, 0.009408446028828621, -0.07192673534154892, 0.03761738911271095, 0.0524882934987545, -0.0151516143232584, -0.016873260959982872, 0.04125269502401352, -0.02269900217652321, -0.020031612366437912, -0.014075350016355515, 0.034105896949768066, -0.027917198836803436, 0.04700469970703125, 0.011426383629441261, 0.040056854486465454, -0.08173492550849915, 0.026742352172732353, -0.04830092936754227, 0.02855019085109234, -0.039779044687747955, 0.034523483365774155, 0.07590118795633316, 0.03846872225403786, -0.03635165095329285, -0.14703142642974854, -0.09246111661195755, -0.05820522829890251, 0.0009227768750861287, 0.03772195428609848, -0.025675607845187187, -0.047246452420949936, -0.034968968480825424, 0.1092367023229599, 0.014257041737437248, -0.03584155812859535, -0.013296128250658512, 0.009322415105998516, 0.010636648163199425, -0.11283867061138153, 0.04573509842157364, 0.008099003694951534, -0.03883083909749985, 0.04169439896941185, -0.04602047801017761, -0.07832759618759155, -0.018022479489445686, 0.083808034658432, 0.077446848154068, 0.1298927217721939, -0.061340007930994034, 0.02097710594534874, 0.11902745068073273, 0.02137976512312889, -0.021491101011633873, 0.011245611123740673, 0.0256046149879694, 0.017873389646410942, 0.04598306864500046, -6.074763803098904e-08, -0.031667664647102356, 0.03894073888659477, 0.04507308825850487, 0.02095721662044525, -0.005759706720709801, -0.014706402085721493, 0.05443182215094566, 0.062171224504709244, 0.01832239329814911, -0.002468031831085682, 0.04774880409240723, 0.0648382306098938, -0.035232819616794586, -0.019532591104507446, -0.0719483494758606, 0.08564850687980652, -0.0038455710746347904, 0.001698761247098446, -0.003864376340061426, -0.03089137375354767, -0.010962342843413353, -0.0013795268023386598, -0.033880576491355896, 0.03995300084352493, -0.012721806764602661, 0.0023759114556014538, -0.02723320573568344, 0.0745050385594368, 0.031138811260461807, 0.02348857931792736, -0.025958770886063576, 0.002776660956442356, 0.05435388535261154, -0.05983548238873482, 0.034889038652181625, 0.02741415426135063, -0.05657357722520828, -0.01269435789436102, -0.016347285360097885, -0.0291728638112545, -0.04135892912745476, -0.004147385712713003, -0.002984279301017523, 0.025593271479010582, 0.03471628949046135, 0.00030550180235877633, 0.08933457732200623, -0.047817107290029526, 0.03213927522301674, 0.05749282240867615, -0.004463884048163891, -0.045311298221349716, -0.02370288223028183, 0.09195485711097717, -0.024492831900715828, -0.016658399254083633, -0.05311502143740654, 0.07142321020364761, 0.06890896707773209, 0.06427859514951706, -0.010597814805805683, 0.07601762562990189, 0.006119114812463522, -0.13407407701015472 ] }, { "text": "## Content\n\n- Conv_Layer output is the content representation of the input. \n- Next when it sees the style image it will extract features from multiple layers that represent the style of the image. \n\nTarget image can be started from blank canvas or copy of the content image. Target image's content should be close to content image and\nits style should be close to the style image. \n\nWe need to compare content representation od content image and content representation of target image. \n\nHow? \n\n**Content Loss**\n \n Tc: target content rep, Cc: content content rep\n CONTENT LOSS = 1/2 * Sum (Tc - Cc)^2\n \nThe only value that change is Tc. We are not training CNN, but we are using backpropagation to min the loss function.", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_6", "embedding": [ -0.04075552895665169, 0.05589956045150757, 0.09202155470848083, 0.04951750487089157, 0.09791366010904312, 0.043510567396879196, 0.010133539326488972, -0.04306008666753769, 0.03956117480993271, -0.09840339422225952, -0.07645044475793839, -0.037954770028591156, 0.07644974440336227, -0.01692897267639637, -0.07333946973085403, -0.02192057855427265, 0.08162909001111984, 0.09821967035531998, -0.05856921523809433, -0.07673996686935425, -0.03213382512331009, -0.006784402299672365, 0.048598889261484146, -0.005296651273965836, 0.042526889592409134, 0.04722515493631363, -0.021456431597471237, 0.02598222717642784, 0.09808647632598877, -0.07649926096200943, 0.02817222848534584, -0.01882736198604107, -0.025072455406188965, 0.04617279767990112, -0.07395093142986298, 0.09562947601079941, -0.038698676973581314, -0.031071292236447334, 0.02078874409198761, -0.019396454095840454, -0.01700720377266407, 0.028862444683909416, -0.05959406867623329, 0.018453489989042282, 0.05330079421401024, 0.07518667727708817, -0.04155038669705391, -0.012202786281704903, -0.006334587465971708, -0.023397795855998993, 0.004115553107112646, 0.0134440828114748, -0.0919160321354866, 0.050050366669893265, -0.011115116067230701, 0.02777150273323059, 0.017453599721193314, 0.001783473533578217, -0.01762554422020912, 0.03380027413368225, 0.02690650150179863, -0.01769036240875721, 0.0029325527139008045, -0.03394142538309097, 0.084609754383564, 0.014862479642033577, -0.0477297268807888, 0.017817232757806778, 0.015637002885341644, -0.07921678572893143, 0.03821031376719475, 0.04597824811935425, 0.03584829345345497, 0.04285195469856262, 0.014115980826318264, 0.03627535700798035, 0.08835354447364807, 0.009333322755992413, -0.05807499587535858, -0.10257791727781296, 0.021084874868392944, -0.029599212110042572, 0.0031677877996116877, -0.01948307454586029, 0.04137888178229332, 0.015572795644402504, -0.06308554112911224, -0.0065778447315096855, -0.06590971350669861, 0.015978733077645302, -0.03471359610557556, 0.03296828269958496, -0.049114394932985306, 0.006976349279284477, 0.0918770283460617, 0.02642197534441948, -0.005205149296671152, -0.056307874619960785, 0.021564291790127754, 0.02702527493238449, 0.005318978801369667, -0.06230785325169563, 0.03861289098858833, -0.043035659939050674, 0.09842617064714432, -0.007310501299798489, 0.049614835530519485, 0.032829973846673965, 0.046400487422943115, -0.0648619532585144, 0.06574435532093048, 0.020775752142071724, -0.058500874787569046, -0.017771447077393532, 0.06880143284797668, 0.01030539907515049, -0.026721740141510963, -0.014797997660934925, 0.0031341833528131247, -0.024533525109291077, -0.07897042483091354, -0.029620898887515068, -0.07462664693593979, -0.04285815358161926, -0.0415225513279438, -0.10400091111660004, -0.0013192732585594058, 6.122528163453314e-33, -0.017951376736164093, -0.026914823800325394, -0.004079726058989763, -0.006615960039198399, 0.03630858287215233, 0.026594791561365128, 0.0306430421769619, -0.10300762951374054, -0.07875534892082214, -0.027721820399165154, -0.06839273124933243, -0.05188027769327164, -0.09625764191150665, 0.08305799216032028, -0.017025230452418327, -0.09781894832849503, -0.0500258207321167, -0.0217910073697567, 0.02772250957787037, 0.022193128243088722, -0.038971077650785446, -0.019138339906930923, -0.01898990198969841, 0.02815900556743145, -0.024202153086662292, -0.08661846816539764, -0.05859861522912979, -0.04896370321512222, -0.08114708214998245, -0.031031567603349686, -0.0007895451271906495, 0.02199132740497589, 0.02064482308924198, 0.01025641430169344, -0.0729873850941658, -0.05969544127583504, 0.021312110126018524, 0.08762215822935104, 0.021358048543334007, -0.019877109676599503, -0.036640703678131104, 0.10747241973876953, -0.0022125523537397385, 0.0069287726655602455, -0.04584462568163872, -0.031448960304260254, 0.05653044953942299, -0.012290403246879578, -0.04568159207701683, -0.029772533103823662, 0.11372268199920654, -0.004163986537605524, 0.014371536672115326, -0.04978307709097862, 0.030832068994641304, -0.06146283075213432, 0.07031731307506561, 0.04447972774505615, 0.06090489774942398, 0.0006285779527388513, 0.15502524375915527, 0.04591074958443642, -0.05048622563481331, 0.02460043504834175, -0.018520209938287735, 0.021663766354322433, 0.022523099556565285, -0.039758361876010895, -0.06827478110790253, 0.03385678678750992, -0.02888328954577446, 0.08347003906965256, -0.025200985372066498, -0.08514615893363953, 0.1117088720202446, -0.026384105905890465, -0.05769502371549606, -0.06976096332073212, 0.009489007294178009, 0.005377324763685465, -0.044337280094623566, 0.09428082406520844, 0.02319088578224182, -0.09057005494832993, -0.11712765693664551, 0.08460236340761185, 0.06373361498117447, -0.10743152350187302, 0.027042707428336143, 0.03271979093551636, -0.02333824150264263, 0.00017442980606574565, -0.0026400850620120764, 0.005469850264489651, 0.04272954538464546, -5.539600514880541e-33, -0.05185266584157944, 0.1737094521522522, 0.005993824917823076, 0.01674126461148262, -0.05372302979230881, -0.020873572677373886, -0.007384549826383591, 0.03651100769639015, 0.03190013766288757, 0.010625878348946571, 0.11074521392583847, -0.03186333552002907, -0.11803056299686432, -0.01421792060136795, -0.07644493132829666, -0.05458860099315643, -0.0583963617682457, -0.036853037774562836, -0.013050741516053677, -0.01306538563221693, -0.004756547044962645, 0.07753174006938934, -0.02981833554804325, 0.02220498025417328, -0.07161498069763184, 0.04174407199025154, 0.04606951028108597, 0.04379833862185478, 0.06227731704711914, -0.03768102824687958, -0.025929449126124382, -0.005274641327559948, 0.0025320134591311216, 0.07859467715024948, -0.00390127906575799, -0.014373483136296272, 0.03296324983239174, -0.03839586302638054, -0.026245206594467163, 0.0823056697845459, 0.08406495302915573, 0.016908057034015656, -0.04035568609833717, 0.008444135077297688, -0.05042621120810509, 0.03330232575535774, -0.013312400318682194, -0.012611898593604565, 0.0189991295337677, 0.032459817826747894, 0.09251901507377625, -0.038326237350702286, -0.07225607335567474, 0.02568192407488823, 0.012316329404711723, 0.04153349995613098, -0.028705766424536705, 0.03594818338751793, 0.015806658193469048, -0.007348521146923304, -0.016277683898806572, -0.06301310658454895, -0.07002665847539902, -0.006115610245615244, 0.01464233361184597, 0.04608801752328873, -0.05174504593014717, 0.041088979691267014, 0.003658345201984048, 0.0921538770198822, 0.03615367040038109, 0.024906300008296967, 0.019210267812013626, 0.007367919199168682, 0.025777064263820648, -0.0585927851498127, -0.02169465273618698, 0.07892553508281708, 0.0041495272889733315, 0.04509396106004715, -0.0390545055270195, -0.008929348550736904, -0.05312536284327507, 0.02879149094223976, 0.07243602722883224, 0.206904798746109, -0.03643317148089409, -0.013479524292051792, 0.03823227435350418, 0.009562591090798378, -0.0454249307513237, -0.023049570620059967, 0.06296767294406891, -0.022827569395303726, 0.02778744138777256, -4.8298332444574044e-08, -0.044970009475946426, -0.08811831474304199, -0.002902111504226923, 0.0343414768576622, -0.006859040819108486, 0.00615118071436882, 0.03513983637094498, -0.00839149858802557, 0.0417456328868866, 0.01632842794060707, -0.02687874063849449, 0.01767132245004177, -0.03249741345643997, -0.043891169130802155, -0.04156972095370293, 0.04767240956425667, -0.0059861354529857635, -0.01142821367830038, 0.07161697000265121, -0.06305287778377533, -0.0002946574240922928, -0.02036209963262081, -0.02459050342440605, 0.0546785406768322, -0.01119698490947485, -0.006370265502482653, 0.00864621251821518, 0.07550279051065445, -0.013560827821493149, 0.0106416717171669, 0.026857838034629822, -0.035728223621845245, -0.047991521656513214, -0.04318445175886154, 0.03433519974350929, 0.04652395099401474, -0.0010774300899356604, -0.03627195209264755, -0.009100268594920635, 0.08222253620624542, -0.05477232113480568, 0.00011836666089948267, 0.03966253623366356, -0.014054495841264725, 0.02189761772751808, 0.0021427322644740343, 0.1327313631772995, -0.06357254087924957, 0.010413909330964088, -0.015437721274793148, 0.05170730501413345, -0.07998640835285187, -0.05998145043849945, 0.051772065460681915, 0.009600343182682991, -0.13018934428691864, -0.03211532533168793, 0.03281538933515549, 0.02534663677215576, 0.04567664861679077, -0.05920335277915001, 0.04570544511079788, 0.07102005928754807, -0.07155251502990723 ] }, { "text": "## Style\n\nWe need to calculate the difference btw target image and style image. We\nfind the similarities btw features in multiple layers in the network. \n\n- Include correlations btw multiple layers of different sizes\n- we can obtain multiscale style representation of te input image. \n\n**Style representation calculation:**\n\nIt is calculated by using all conv layers first channel: conv1_1, conv2_1 ...\nThe correlations at each layer are given by a GRAM MATRIX.\n \n**GRAM MATRIX**\n\n- Input image 4*4\n- Use 8 filters for conv layer\n- Output: 4*4 in height and weight and 8 in depth. --> It has 8 features maps that we want to find relationships between.", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_7", "embedding": [ 0.03980349004268646, -0.0034536246675997972, 0.03375845402479172, -0.04079629108309746, 0.035156041383743286, 0.02900092303752899, -0.053563881665468216, -0.03889339789748192, 0.004925927612930536, -0.10483672469854355, -0.03953830525279045, -0.0634675994515419, 0.08596893399953842, 0.012817170470952988, -0.04286852851510048, 0.006657282821834087, 0.01882828399538994, 0.07285432517528534, -0.07079271227121353, -0.04771945998072624, 0.03524618595838547, -0.06431464850902557, 0.004299608059227467, -0.07610020786523819, 0.03638070076704025, 0.045541297644376755, 0.06576739996671677, 0.01437448151409626, 0.04237763211131096, -0.079262875020504, 0.05430135503411293, 0.021472914144396782, 0.014701717533171177, -0.0017769807018339634, -0.11865632981061935, 0.011460689827799797, 0.01400624867528677, 0.016467129811644554, -0.00849206279963255, -0.004053823184221983, -0.06126929074525833, 0.04119231924414635, 0.03181399032473564, -0.0017501438269391656, 0.09136093407869339, 0.12808717787265778, -0.06360691785812378, 0.02383778989315033, -0.05244617164134979, -0.011493148282170296, -0.04388017579913139, -0.038992222398519516, -0.05933209881186485, 0.03634169325232506, 0.06291062384843826, 0.06808817386627197, 0.018482506275177002, -0.051144905388355255, -0.0062825633212924, 0.030278513208031654, 0.009932483546435833, -0.01635674759745598, -0.04131269454956055, 0.0021871996577829123, 0.08453284204006195, 0.034719981253147125, -0.018882721662521362, 0.0002932184434030205, 0.039095405489206314, -0.06255535781383514, 0.01696735806763172, -0.00032043864484876394, 0.0018142135813832283, 0.005805507767945528, -0.023974085226655006, 0.11224542558193207, 0.004496149718761444, 0.009263787418603897, 0.028870971873402596, -0.16519488394260406, 0.04897138848900795, -0.004227359779179096, 0.02301730588078499, -0.0038687961641699076, 0.07050205767154694, 0.028927268460392952, -0.06327833235263824, -0.04284496232867241, -0.07229944318532944, 0.02851405367255211, -0.019760331138968468, 0.014513005502521992, -0.10829517990350723, -0.05872334539890289, 0.026571784168481827, 0.0051811146549880505, -0.03590184822678566, -0.051195330917835236, 0.0664423406124115, 0.009823341853916645, 0.00698108458891511, -0.07813839614391327, 0.04794089123606682, -0.008434414863586426, 0.07550016045570374, 0.06298461556434631, 0.07246068120002747, 0.059491708874702454, 0.0327112041413784, -0.09249071776866913, -0.022597409784793854, -0.05836886540055275, -0.11970043927431107, -0.012711523100733757, 0.08454195410013199, -0.010342472232878208, 0.023397285491228104, 0.005327168386429548, 0.10345036536455154, -0.03336935117840767, -0.025477077811956406, -0.04378340020775795, -0.0523279532790184, -0.04212869331240654, -0.06878361850976944, -0.04713466763496399, -0.0947776809334755, 5.818118105602543e-33, 0.0071408613584935665, 0.018373487517237663, -0.02554173953831196, 0.05470515787601471, 0.057979125529527664, -0.04504465311765671, -0.033732641488313675, -0.08868781477212906, -0.07757371664047241, 0.04998495802283287, -0.0611872561275959, 0.022119833156466484, -0.06532930582761765, 0.10469496250152588, 0.016432253643870354, -0.03485887870192528, 0.013609849847853184, -0.007259026635438204, -0.045653317123651505, -0.01555528212338686, -0.011164320632815361, 0.019633540883660316, -0.015261361375451088, 0.07173964381217957, 0.010146919637918472, -0.06581123173236847, -0.01217553298920393, -0.017581162974238396, -0.02587936632335186, -0.04282945767045021, 0.058262452483177185, -0.0026262030005455017, -0.012096849270164967, -0.023554395884275436, -0.04756351560354233, -0.06904682517051697, 0.06091426685452461, -0.00516947777941823, 0.046077799052000046, -0.008799349889159203, 0.02313709445297718, 0.043743424117565155, 0.005128109361976385, -0.03408479690551758, -0.08189360797405243, 0.10200303792953491, -0.002482022624462843, -0.02463231049478054, 0.0021544371265918016, 0.035912178456783295, 0.12061183899641037, 0.03223777562379837, 0.004091646987944841, -0.003962452989071608, 0.0425492599606514, -0.04757535457611084, 0.02211781218647957, 0.046148862689733505, 0.08768422901630402, 0.046569790691137314, 0.02267325296998024, 0.037701983004808426, 0.018973050639033318, 0.001278418698348105, 0.01775217056274414, 0.02320452779531479, -0.005842647515237331, -0.058082837611436844, -0.018981974571943283, 0.03656407818198204, -0.013035401701927185, 0.09296420216560364, -0.010034404695034027, -0.1092941090464592, 0.009502660483121872, -0.026470309123396873, -0.10269422084093094, -0.0821644589304924, -0.00032501324312761426, 0.08504762500524521, -0.1399088203907013, 0.11832408607006073, 0.03761909902095795, -0.03514827787876129, -0.11143726855516434, 0.0710735097527504, 0.016787881031632423, -0.06112004071474075, 0.006950049661099911, 0.04606445133686066, 0.03471188247203827, 0.025416530668735504, 0.002302397508174181, 0.003965016920119524, 0.016641821712255478, -5.038376335845641e-33, -0.0272216759622097, 0.1608530580997467, 0.07063755393028259, -0.005761264357715845, -0.012068352662026882, -0.023021958768367767, 0.013522910885512829, 0.02543940395116806, 0.09700626134872437, 0.03261186555027962, 0.05804891511797905, -0.029357410967350006, -0.04150265455245972, -0.09311357140541077, 0.024575291201472282, -0.03097711317241192, -0.06287197023630142, -0.04007037729024887, 0.006884631235152483, 0.019754035398364067, 0.0444803461432457, 0.03933849185705185, -0.019995853304862976, 0.008675672113895416, -0.07449699193239212, 0.030223820358514786, 0.04706215858459473, -0.026171285659074783, 0.02407093532383442, -0.026253066956996918, -0.012742285616695881, -0.0776207447052002, 0.035809338092803955, 0.06505430489778519, -0.02167813666164875, -0.02624596282839775, -0.00768492603674531, -0.00637448113411665, 0.0266566202044487, -0.03956908360123634, 0.028355218470096588, -0.019624892622232437, -0.02900732308626175, -0.035576555877923965, -0.046028729528188705, 0.001672001788392663, 0.018248677253723145, 0.011758223176002502, 0.015239741653203964, -9.897827840177342e-05, 0.0600784569978714, -0.010678009130060673, -0.06542260199785233, 0.010559420101344585, -0.01714278943836689, 0.008174560964107513, -0.011796759441494942, 0.05635092407464981, 0.07380915433168411, 0.03282086178660393, 0.0049590421840548515, -0.15976014733314514, -0.055087439715862274, -0.014122659340500832, 0.012381322681903839, 0.03617164120078087, -0.032047662883996964, -0.05234278738498688, -0.005250371526926756, 0.09451264888048172, 0.031996455043554306, 0.06067831814289093, 0.007110282778739929, 0.04247532784938812, 0.0003755466314032674, -0.1383771449327469, 0.043968118727207184, 0.020847823470830917, 0.02889319323003292, 0.015948643907904625, -0.09351924061775208, 0.003802977502346039, -0.007829219102859497, 0.036562152206897736, 0.039356451481580734, 0.14308160543441772, -0.0049117859452962875, 0.012594489380717278, 0.10083798319101334, 0.02322646789252758, -0.00894338358193636, 0.022367162629961967, 0.024786928668618202, -0.04710967093706131, 0.014901168644428253, -4.7829200156002116e-08, -0.019203029572963715, -0.09988608211278915, 0.006260491907596588, 0.007120300550013781, -0.016908030956983566, 0.0639185756444931, 0.08727946877479553, 0.03521236777305603, 0.001520578982308507, 0.06559651345014572, 0.042591989040374756, 0.02714444510638714, -0.03731328994035721, 0.024124449118971825, -0.07999639213085175, 0.003355293534696102, -0.02032425068318844, 0.0007128025172278285, 0.019989531487226486, -0.04093809798359871, 0.030379462987184525, -0.009642931632697582, -0.029539987444877625, 0.10991541296243668, -0.0061378926038742065, 0.0038518973160535097, -0.06867522746324539, 0.013449753634631634, 0.02301286906003952, -0.012865124270319939, 0.003199102357029915, -0.01978926733136177, -0.01712397299706936, -0.055026013404130936, 0.07962906360626221, 0.033036455512046814, -0.06917843222618103, 0.028301728889346123, -0.04970916733145714, 0.06570247560739517, -0.0590348020195961, -0.04082835093140602, 0.028487982228398323, 0.020657427608966827, 0.09914106130599976, 0.004268620163202286, 0.0339525081217289, -0.044798098504543304, -0.041045404970645905, 0.06535835564136505, 0.034280791878700256, -0.013950059190392494, -0.06392981857061386, 0.042305562645196915, -0.05061408132314682, -0.1016768217086792, -0.03177922964096069, 0.007088329177349806, 0.0933755412697792, 0.02813965082168579, 0.026907023042440414, -0.002943524159491062, -0.022339286282658577, -0.10461030155420303 ] }, { "text": "Operations:\n- Vectorize the values in this layer: 8 * 4 * 4 -> 4*4=16 (one feature map): `8*16`\n- Take the transpose of this matrix : `8*16`\n- Multiply these two matrices: `8*8`\n\nResult of the gram matrix contains non localized information about the layer. \n\n**What is nonlocalized info??**\n\nIt is information that would still be there even if an image was shuffled around in space. Even if the content of a filtered image\nis not identifable, you should be able to see the prominent colors and textures ie. the style!\n\nMatrix(8 * 16) * Matrix(16 * 8) = Gram Matrix(8 * 8) --> its values indicates the similarities btw the layers. \n\n- Ref: https://en.wikipedia.org/wiki/Gramian_matrix", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_8", "embedding": [ 0.042155664414167404, 0.033233992755413055, 0.02899114042520523, -0.06513741612434387, 0.07264288514852524, 0.029922090470790863, 0.016482383012771606, -0.08224048465490341, -0.02403213642537594, -0.10234484821557999, 0.042468808591365814, -0.045206569135189056, -0.010008053854107857, 0.02366659976541996, -0.16445335745811462, 0.0005866920109838247, 0.03361441195011139, 0.07922004908323288, -0.11643093079328537, -0.07595913857221603, 0.03296899050474167, -0.05553493648767471, -0.041029397398233414, -0.028848296031355858, 0.08453050255775452, 0.14826615154743195, 0.055140383541584015, 0.028432074934244156, 0.03743651136755943, -0.02392655424773693, -0.0038795010186731815, 0.05635907128453255, 0.028546947985887527, 0.052835818380117416, -0.061692751944065094, 0.07187392562627792, -0.029770193621516228, 0.021509483456611633, -0.019475562497973442, -0.006444891449064016, -0.008514244109392166, -0.0034447736106812954, -0.028558526188135147, 0.002959297737106681, 0.03153497353196144, 0.06349226832389832, -6.39173376839608e-05, -0.005234003998339176, -0.03813712298870087, -0.019637437537312508, -0.06305740773677826, 0.04446862265467644, -0.11122100800275803, 0.013981807045638561, 0.012409034185111523, -0.027515919879078865, 0.035501521080732346, -0.048434846103191376, 0.02321910671889782, 0.0025043643545359373, -0.06163439154624939, -0.004208275582641363, 0.04100916162133217, 0.07789228856563568, 0.0914745032787323, 0.05115743726491928, -0.017587529495358467, -0.047963399440050125, 0.09757280349731445, -0.11832962930202484, 0.04676835238933563, 0.04493582621216774, 0.09419060498476028, 0.027100373059511185, -0.00526421656832099, 0.03753294795751572, -0.003179373685270548, -0.0035282643511891365, 0.017468322068452835, -0.04009455442428589, 0.04415016993880272, -0.014790850691497326, 0.06180862709879875, 0.039311014115810394, 0.047249626368284225, -0.01408559549599886, -0.03195691108703613, -0.05067770928144455, -0.04152212664484978, -0.0058141411282122135, -0.02915962040424347, -0.009188414551317692, -0.13977718353271484, -0.06526964902877808, 0.0815281793475151, -0.05279270187020302, 0.03129374608397484, -0.061587341129779816, 0.03397708386182785, 0.02958400547504425, 0.03130216896533966, -0.05812292546033859, 0.033023882657289505, 0.04907911643385887, 0.03816099837422371, -0.011851929128170013, 0.015956798568367958, -0.00437141302973032, -0.017342275008559227, -0.052355505526065826, 0.008660544641315937, 0.008117591962218285, -0.08325985074043274, -0.028600815683603287, 0.005050850100815296, -0.04891708865761757, 0.04312900826334953, 0.030431898310780525, -0.027358781546354294, -0.013072827830910683, -0.045265812426805496, -0.04425833746790886, -0.01646498776972294, -0.03091818280518055, -0.06532442569732666, 0.0471322126686573, -0.03798268362879753, 4.558885210647522e-33, 0.011172964237630367, -3.687096977955662e-05, 0.001415058271959424, 0.019382331520318985, -0.014956347644329071, -0.025177080184221268, -0.00978955626487732, -0.09189256280660629, 0.017968367785215378, 0.03370439261198044, -0.030491212382912636, 0.04903621971607208, -0.004091628361493349, 0.10453253984451294, -0.013209723867475986, 0.009862626902759075, 0.01711912453174591, -0.03465545177459717, -0.026316313073039055, -0.047756802290678024, -0.04082770645618439, 0.07259007543325424, 0.0007447270909324288, -0.05968448519706726, -0.028544986620545387, -0.06132354214787483, -0.039491407573223114, -0.042391423135995865, -0.02052055299282074, -0.006221660412847996, -0.021285653114318848, 0.04271906614303589, -0.042281799018383026, 0.006442933809012175, 0.015771716833114624, -0.018521977588534355, 0.020766103640198708, -0.055660031735897064, 0.0821768045425415, -0.008471298962831497, 0.041355885565280914, -0.0012718498473986983, -0.01074220985174179, -0.0530870258808136, -0.01711135543882847, 0.06299510598182678, 0.02263437956571579, -0.050550539046525955, 0.041280873119831085, -0.011414960026741028, 0.12687595188617706, 0.015455302782356739, -0.045519813895225525, -0.05270415171980858, 0.027758872136473656, -0.02914537489414215, 0.10139074176549911, -0.01767483726143837, 0.05264212191104889, 0.06231281906366348, 0.04733114689588547, 0.04230640456080437, 0.022768687456846237, 0.002739495597779751, 2.212602794315899e-06, -0.013181683607399464, -0.0024659004993736744, -0.030858831480145454, -0.009977355599403381, -0.008647628128528595, 0.014059588313102722, 0.062019091099500656, 0.06338547170162201, 0.013799084350466728, 0.01601240411400795, -0.002441923599690199, -0.01854155771434307, -0.0698712170124054, -0.03591598570346832, -0.007155689876526594, -0.0468093603849411, 0.015443758107721806, -0.017370084300637245, -0.04411565884947777, -0.1358291655778885, 0.07735177129507065, 0.03764564171433449, -0.03957192599773407, 0.01334344781935215, 0.00910609308630228, 0.01851598173379898, 0.014896822161972523, -0.022300537675619125, -0.03526322543621063, -0.001256089424714446, -6.397086542264952e-33, -0.013297485187649727, 0.02209586650133133, 0.02137327939271927, -0.01827552355825901, -0.043247807770967484, -0.10004395991563797, 0.012518694624304771, 0.11675910651683807, 0.04350994527339935, 0.051376260817050934, 0.03850419074296951, -0.003428678959608078, -0.048663653433322906, -0.11092858016490936, 0.006557540502399206, 0.0553569495677948, -0.025894397869706154, 0.014320467598736286, -0.042981259524822235, -0.01567058078944683, -0.04489772021770477, 0.042054299265146255, -0.019412634894251823, 0.0662573054432869, -0.10979143530130386, 0.028728283941745758, 0.025733334943652153, -0.04687907546758652, 0.05111107975244522, -0.048104554414749146, 0.024569755420088768, -0.07227123528718948, -0.008871826343238354, 0.045485109090805054, 0.008650407195091248, 0.031057626008987427, -0.027996119111776352, -0.026943709701299667, -0.0009717592038214207, 0.01955035887658596, -0.038563430309295654, 0.006956156343221664, -0.0766506940126419, 0.0015838375547900796, -0.05168241262435913, -0.005328155122697353, 0.015529047697782516, 0.024941259995102882, -0.009090335108339787, -0.007443943526595831, 0.09151199460029602, 0.03447771444916725, -0.0371580645442009, -0.016653940081596375, -0.05675313249230385, 0.1105775535106659, -0.05930973216891289, 0.03505750000476837, 0.05697435140609741, 0.04872138798236847, 0.03552926331758499, -0.16832683980464935, -0.052808310836553574, -0.07861186563968658, 0.022878674790263176, 0.008528115227818489, -0.030917348340153694, -0.0661727786064148, -0.009661858901381493, 0.07071241736412048, 0.015530039556324482, -0.055414699018001556, -0.08933733403682709, -0.06387842446565628, 0.06380639970302582, -0.08527321368455887, 0.034220729023218155, 0.049301352351903915, 0.058330513536930084, -0.02479400299489498, -0.006338408682495356, 0.03583238273859024, -0.00042431565816514194, 0.08479711413383484, 0.07059618830680847, 0.17534533143043518, -0.029574725776910782, -0.0450679212808609, 0.09085831046104431, -0.031590916216373444, 0.04575995355844498, 0.018681121990084648, -0.06419039517641068, 0.004341281484812498, 0.014107310213148594, -6.105217664753582e-08, 0.008454646915197372, -0.0415542908012867, 0.06435905396938324, -0.05277673155069351, -0.07263202220201492, -0.06092467159032822, 0.07779541611671448, 0.07229822129011154, -0.027566859498620033, 0.01971476338803768, 0.02700182795524597, 0.013346637599170208, -0.10479717701673508, -0.04214799031615257, 0.03282587230205536, -0.01126430556178093, -0.012687885202467442, 0.057498998939991, -0.026001986116170883, 0.0002496434608474374, -0.005185748916119337, 0.0169519055634737, -0.04403725638985634, 0.09019265323877335, -0.0751739963889122, 0.014433234930038452, -0.00621170736849308, 0.04469441622495651, 0.09366652369499207, -0.0060661230236291885, 0.04808386042714119, 0.006319394335150719, 0.010905269533395767, -0.027053186669945717, -0.014703430235385895, 0.05039022117853165, -0.019827213138341904, 0.0016768787754699588, -0.07309512048959732, -0.004543584771454334, -0.021208761259913445, -0.08518441766500473, 0.01840079389512539, 0.05538881570100784, 0.08131308108568192, 0.07427844405174255, 0.035425957292318344, -0.06078396365046501, -0.02997569926083088, 0.0766138881444931, 0.04312686249613762, 0.013112368993461132, -0.07839290052652359, 0.12570179998874664, -0.02462013065814972, -0.157703697681427, -0.052827462553977966, 0.04834727197885513, 0.09927646815776825, -0.0037116988096386194, -0.04145629703998566, 0.0014548812760040164, -0.05973220244050026, -0.03306082263588905 ] }, { "text": "- Ref: https://en.wikipedia.org/wiki/Gramian_matrix\n\nAn important application is to compute linear independence: a set of vectors are linearly independent if and only if the\nGram determinant (the determinant of the Gram matrix) is non-zero.\n\n- Ref: https://stackoverflow.com/questions/55546873/how-do-i-flatten-a-tensor-in-pytorch\n\nHow to reshape the tensor?\n\n import torch\n input = torch.rand(3, 8, 8)\n print(input.shape) # torch.Size([3, 8, 8])\n print(input.flatten(start_dim=1, end_dim=2).shape) # torch.Size([3, 64])\n reshape_input = input.flatten(start_dim=1, end_dim=2)\n reshape_input.shape # torch.Size([3, 64])", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_9", "embedding": [ -0.02449563518166542, -0.14091169834136963, 0.0026634419336915016, -0.014966001734137535, 0.004266856703907251, 0.018320638686418533, -0.01979176327586174, -0.006013461388647556, -0.06661085039377213, -0.05993000417947769, -0.025974711403250694, 0.051026664674282074, -0.08848028630018234, 0.049159467220306396, -0.025185896083712578, 0.056613434106111526, -0.10532074421644211, 0.1526491791009903, -0.09055919945240021, -0.03739646449685097, 0.04869107902050018, -0.012227318249642849, 0.007092588115483522, 0.005829349160194397, 0.08865121752023697, 0.024581337347626686, 0.11910354346036911, -0.030723271891474724, 0.0013091834262013435, 0.045164186507463455, 0.03853912651538849, -0.015213923528790474, -0.025708956643939018, -0.001609998638741672, -0.004385047126561403, -0.0333094522356987, -0.04866521805524826, 0.02509646862745285, 0.021341409534215927, 0.08980979025363922, 0.04552711546421051, -0.018170256167650223, -0.02543308027088642, 0.02084900252521038, -0.006681387312710285, 0.005288379266858101, 0.04508677124977112, -0.005245565436780453, 0.02441025711596012, -0.07600916922092438, 0.057615939527750015, -0.03130223602056503, -0.06442108005285263, 0.04504568502306938, -0.06238603964447975, -0.04026905819773674, 0.02863815426826477, -0.03001916967332363, 0.02196233905851841, -0.04619210958480835, 0.015777627006173134, 0.013440631330013275, 0.033311933279037476, -0.024751752614974976, -0.027621706947684288, 0.011283247731626034, 0.012551798485219479, 0.025434322655200958, -0.006740030366927385, -0.008196858689188957, -0.0598907433450222, 0.026687541976571083, -0.030540574342012405, 0.06201489642262459, -0.020806875079870224, -0.07032719999551773, 0.1414993703365326, 0.03629538044333458, 0.037790197879076004, 0.051437798887491226, 0.006214880384504795, 0.03439415246248245, 0.09949018061161041, 0.039599400013685226, 0.0072356052696704865, -0.09347837418317795, -0.0038637856487184763, 0.0723441019654274, 0.060263343155384064, -0.017480578273534775, -0.003968945238739252, 0.036273662000894547, -0.03194263204932213, -0.03123447299003601, 0.04375693202018738, 0.008432600647211075, 0.05949315428733826, 0.00023552804486826062, -0.04050104320049286, 0.025657430291175842, 0.09765338152647018, -0.11267175525426865, -0.029025224968791008, 0.031793441623449326, -0.025085242465138435, 0.11530008167028427, -0.04490813985466957, 0.03922917693853378, 9.685835539130494e-05, -0.07508329302072525, 0.07678486406803131, -0.03165654465556145, 0.06065557897090912, 0.030358510091900826, 0.029748782515525818, 0.004520921502262354, -0.029208483174443245, 0.0701991394162178, 0.07092287391424179, 0.0325542576611042, -0.036772195249795914, 0.04175778105854988, 0.06175520271062851, 0.017487330362200737, -0.06341259926557541, 0.006570587866008282, -0.020977739244699478, 1.946574931265537e-33, -0.08321846276521683, 0.12025734037160873, -0.05439060553908348, -0.013227659277617931, -0.04843622073531151, -0.028244255110621452, 0.04983217641711235, -0.016439737752079964, -0.01740584336221218, 0.007816710509359837, -0.038534510880708694, 0.04415184259414673, -0.011075987480580807, -0.038817454129457474, -0.10832497477531433, 0.03321968391537666, 0.05141717568039894, 0.03499767556786537, 0.009131071157753468, -0.05894714966416359, -0.03180268034338951, 0.09631021320819855, 0.06340010464191437, -0.01910858415067196, -0.09210271388292313, -0.0679398775100708, -0.022530803456902504, -0.04906764253973961, -0.05056465044617653, 0.0012188750552013516, -0.03373856842517853, 0.0035005873069167137, -0.05063831806182861, -0.03462619706988335, -0.006760622374713421, -0.08586747199296951, 0.0292208269238472, -0.03931432217359543, -0.04377002641558647, -0.10713896155357361, 0.027010831981897354, 0.11526578664779663, 0.02018558792769909, -0.08843842148780823, -0.04485281929373741, 0.04851940646767616, -0.04866928607225418, 0.05752618610858917, 0.03513523191213608, 0.002551045035943389, -0.010904869996011257, -0.019939769059419632, 0.04097207635641098, 0.07275179028511047, 0.015483271330595016, -0.030048904940485954, 0.030528921633958817, -0.005439744796603918, 0.11207810044288635, -0.03612764924764633, 0.02841392159461975, 0.06308668851852417, -0.012235970236361027, 0.06189980357885361, -0.029758552089333534, -0.01335452776402235, -0.020332466810941696, 0.02622324228286743, -0.0028224496636539698, 0.03809797391295433, -0.06075305864214897, 0.09374641627073288, -0.07795940339565277, -0.008713756687939167, -0.10711035877466202, -0.06996732950210571, 0.07594171911478043, -0.07940317690372467, -0.04034484550356865, 0.013840146362781525, -0.047056645154953, 0.10255680233240128, 0.01431075856089592, -0.11346641927957535, -0.11126352846622467, -0.025539807975292206, -0.04446396231651306, -0.0400567390024662, -0.0233830027282238, -0.02579018473625183, -0.027728231623768806, -0.035833489149808884, 0.04230479151010513, -0.008303042501211166, -0.011860479600727558, -1.5586296530705267e-33, 0.015325870364904404, 0.014767661690711975, -0.0565730482339859, -0.01356873381882906, -0.05013261362910271, -0.04491811990737915, 0.03204500302672386, 0.03588739037513733, 0.02838228829205036, -0.030828580260276794, -0.05073712393641472, -0.029850993305444717, 0.013116368092596531, -0.008701857179403305, 0.12156833708286285, 0.012107600457966328, -0.059077080339193344, 0.03592727333307266, -0.052827417850494385, -0.029837260022759438, 0.013965174555778503, 0.03111955150961876, -0.07089763134717941, 0.02973218448460102, -0.13148309290409088, 0.008920998312532902, -0.017013588920235634, 0.024252543225884438, 0.0030511331278830767, -0.01959299109876156, 0.06294512003660202, -0.04964497312903404, -0.021551959216594696, 0.011202485300600529, -0.018828416243195534, 0.015031924471259117, 0.027427850291132927, -0.05143361911177635, -0.019862011075019836, -0.008523479104042053, 0.046954747289419174, 0.08932836353778839, -0.038928158581256866, 0.03953303024172783, -0.0628407672047615, 0.09119029343128204, -0.01458481140434742, 0.005496137775480747, 0.0030042405705899, -0.02537091076374054, -0.015722503885626793, -0.04616039618849754, -0.04776376485824585, 0.00024494988610967994, -0.041883684694767, 0.017091797664761543, 0.017006343230605125, 0.027435708791017532, 0.01596653275191784, 0.011647474020719528, -0.06268005073070526, -0.10721635073423386, -0.04433122277259827, -0.04821707680821419, 0.016427455469965935, 0.002103041857481003, -0.022655276581645012, 0.05036827176809311, 0.03467756137251854, 0.003270860994234681, 0.016953779384493828, 0.07027577608823776, 0.030537163838744164, 0.006768195424228907, -0.012721702456474304, 0.015561552718281746, 0.08877389132976532, -0.042050063610076904, 0.001176855992525816, -0.042664993554353714, 0.012459448538720608, -0.0635627880692482, -0.0024985666386783123, 0.03057928942143917, 0.04689370095729828, 0.08531203120946884, 0.04982343688607216, 0.059267330914735794, 0.07314623147249222, -0.0455695316195488, 0.05740536376833916, -0.026985496282577515, 0.06968802958726883, 0.06449759006500244, 0.08958856761455536, -4.8095113669432976e-08, -0.007087059319019318, 0.023785024881362915, -0.03130241483449936, 0.031572822481393814, -0.09554221481084824, -0.05774117633700371, 0.1025400385260582, 0.07626080513000488, -0.008753344416618347, -0.043495260179042816, -0.023188328370451927, -0.07140535116195679, 0.03325812518596649, -0.002606043592095375, 0.03724663332104683, 0.11633532494306564, -0.09498652815818787, 0.06398167461156845, 0.009279869496822357, 0.013257727958261967, 0.054980259388685226, -0.07026012241840363, -0.019959868863224983, 0.10250247269868851, -0.05106940120458603, -0.05414840951561928, -0.00619988888502121, 0.05950465425848961, 0.013950402848422527, -0.013260879553854465, 0.031171686947345734, 0.0063917674124240875, 0.04990138113498688, 0.07239960134029388, 0.012270377948880196, 0.06497413665056229, -0.0005686624790541828, -0.00010420980834169313, -0.035656485706567764, 0.02406499907374382, -0.07956432551145554, 0.05453016236424446, -0.02481347881257534, -0.007817485369741917, 0.03988104686141014, -0.04655270278453827, 0.015165533870458603, -0.0070480117574334145, 0.012111849151551723, -0.00119076541159302, 0.02897489443421364, 0.023413391783833504, -0.03889507055282593, 0.04217648133635521, 0.05219770595431328, -0.06287523359060287, -0.07504381239414215, 0.13500940799713135, 0.010439124889671803, -0.004326083697378635, 0.014143295586109161, 0.02207282744348049, -0.08645093441009521, -0.09575952589511871 ] }, { "text": "How to reshape the tensor? --> In the solution\n \n # get the batch_size, depth, height, and width of the Tensor\n _, d, h, w = tensor.size()\n \n # reshape so we're multiplying the features for each channel\n tensor = tensor.view(d, h * w)\n \n # calculate the gram matrix\n gram = torch.mm(tensor, tensor.t())\n \n\n**Style Loss**\n\n- Ss = Style image style\n- Ts = Target image style\n\nLoss = a * Sum(wi (Tsi - Ssi)^2 --> a is a constant that accounts for the number of values in each layer.", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_10", "embedding": [ 0.02035379968583584, -0.06842323392629623, 0.023437127470970154, 0.010921201668679714, -0.0341540165245533, 0.05057062953710556, -0.020480716601014137, 0.04972172528505325, -0.08531350642442703, -0.0707346573472023, -0.06718563288450241, -0.0185749102383852, -0.05271260812878609, 0.045196522027254105, -0.05068041756749153, 0.034768104553222656, -0.07061481475830078, 0.17910867929458618, -0.1079726591706276, -0.05915576219558716, 0.03590011224150658, 0.004389673937112093, 0.01862376183271408, -0.022661814466118813, 0.04906954616308212, -0.003154261503368616, 0.049396250396966934, -0.024896947667002678, 0.008682147599756718, 0.0007699631387367845, 0.03290629759430885, 0.06030429154634476, -0.010452100075781345, 0.019882716238498688, -0.009969981387257576, -0.0473436675965786, -0.03716977685689926, -0.022341322153806686, 0.01997116394340992, 0.04587453231215477, 0.015693670138716698, 0.042872704565525055, -0.038783784955739975, 0.01549810916185379, -0.02313920110464096, 0.033621180802583694, 0.026192618533968925, 0.0556749664247036, 0.04740213230252266, -0.04619365185499191, 0.027423212304711342, -0.020375968888401985, -0.07992525398731232, 0.08760427683591843, -0.051949143409729004, 0.024282822385430336, 0.01732996664941311, -0.04792947694659233, -0.006322321016341448, -0.03244125843048096, 0.02201010473072529, 0.015033630654215813, 0.020932545885443687, -0.04016154259443283, 0.0036446861922740936, 0.03449788689613342, -0.03130797669291496, -0.034247130155563354, 0.04450952634215355, 0.03279956430196762, -0.026943540200591087, -0.03083975799381733, 0.018962301313877106, 0.020837796851992607, -0.04093712940812111, -0.07055971026420593, 0.1420852541923523, 0.012390424497425556, 0.06581070274114609, -0.01603492721915245, 0.04328618943691254, 0.01148937363177538, 0.04163096472620964, -0.0062608965672552586, 0.027096020057797432, -0.06554610282182693, 0.02676846832036972, 0.03698323667049408, 0.008103784173727036, -0.015146417543292046, -0.05123024061322212, -0.017358148470520973, -0.09781505167484283, -0.01964784972369671, 0.012906872667372227, -0.026700032874941826, 0.004473707173019648, -0.0015519578009843826, -0.038882624357938766, 0.014661123976111412, 0.03048473596572876, -0.08346624672412872, -0.020439842715859413, -0.00791965238749981, -0.02844861149787903, 0.061348821967840195, -0.002288643503561616, 0.10696890205144882, -0.02971959486603737, -0.031256698071956635, 0.0497855469584465, 0.022228753194212914, 0.028612205758690834, 0.015773266553878784, 0.09195296466350555, 0.03458147123456001, 0.00285789230838418, 0.0600665807723999, -0.005414806772023439, 0.016218360513448715, -0.037436146289110184, 0.05856012925505638, 0.02561742253601551, -0.0045027644373476505, -0.05838008224964142, -0.0019770488142967224, -0.02328188344836235, 3.647631704314515e-33, -0.055865202099084854, 0.07160531729459763, -0.078466035425663, 0.007883568294346333, 0.016981912776827812, 0.007192328572273254, 0.01587221398949623, -0.06755822151899338, -0.015633292496204376, -0.012349647469818592, -0.07548113912343979, 0.01797216199338436, -0.03966328129172325, 0.020335132256150246, -0.1035868376493454, -0.03169536218047142, -0.0005610279622487724, 0.05510731786489487, -7.80339541961439e-06, -0.030045146122574806, -0.027308082208037376, 0.08924780040979385, 0.04085730016231537, 0.013868249021470547, -0.08169384300708771, -0.05368465930223465, -0.024696415290236473, -0.0029695064295083284, -0.04020611196756363, -0.0065597062930464745, -0.008095171302556992, -0.07525010406970978, -0.030307110399007797, -0.06192518398165703, -0.04777348414063454, -0.036070965230464935, 0.07828383147716522, 0.020822785794734955, 0.045878518372774124, -0.07242307811975479, -0.030418487265706062, 0.12976787984371185, -0.004815985914319754, -0.0801471546292305, -0.09162920713424683, 0.05549046769738197, -0.0032406155951321125, 0.034223541617393494, 0.0064104897901415825, 0.00785166583955288, 0.03332715108990669, -0.07688634097576141, 0.03387214615941048, 0.030258076265454292, 0.04852985218167305, -0.05078303813934326, 0.05427262932062149, 0.05982270464301109, 0.1493004411458969, -0.012212548404932022, 0.0140541335567832, 0.027555590495467186, -0.004755666013807058, 0.021187786012887955, 0.01876818761229515, -0.034181997179985046, 0.03445164114236832, 0.02763897180557251, -0.04803693667054176, 0.03976897522807121, -0.07599585503339767, 0.08097221702337265, -0.023665960878133774, 0.0008527773316018283, -0.06163400784134865, -0.061054375022649765, 0.07438930124044418, -0.06038402020931244, -0.02910616621375084, 0.06596999615430832, -0.06415630131959915, 0.13464617729187012, 0.047905951738357544, -0.09266123175621033, -0.06957757472991943, 0.005128669086843729, -0.009658783674240112, -0.06371632218360901, 0.009845810011029243, -0.05579051002860069, -0.012768274173140526, -0.021098511293530464, 0.08652164041996002, -0.020549530163407326, 0.003637102432549, -2.3429744015658594e-33, -0.010913795791566372, 0.07804368436336517, -0.03260815888643265, -0.022547997534275055, -0.06987421959638596, -0.02563612535595894, 0.010623018257319927, 0.07876761257648468, -0.017078520730137825, -0.023038381710648537, 0.017444901168346405, -0.050376009196043015, -0.0883064717054367, -0.07774823158979416, 0.06096364185214043, -0.051220014691352844, 0.013085225597023964, -0.01414151955395937, -0.014070224016904831, -0.07524857670068741, 0.0007717398111708462, 0.03225728124380112, -0.06766627728939056, 0.05709589645266533, -0.1470334231853485, 0.030173160135746002, 0.037932466715574265, 0.04231477528810501, 0.06326822191476822, -0.049941860139369965, 0.08745318651199341, -0.10083139687776566, -0.0320209302008152, 0.06246605142951012, -0.0016317921690642834, 0.039006780833005905, 0.03264378756284714, 0.013888329267501831, -0.03264555335044861, 0.01339665986597538, 0.03093106672167778, 0.03797183930873871, -0.040443796664476395, 0.005234838463366032, -0.05955551564693451, 0.05108964070677757, 0.011390005238354206, -0.02756601572036743, -0.010644631460309029, -0.053296301513910294, 0.041331782937049866, -0.0915401503443718, -0.06573794782161713, 0.0008722286438569427, -0.044941242784261703, 0.03939005360007286, 0.03977557644248009, -0.0008471847395412624, 0.023913169279694557, 0.028672588989138603, -0.03919116035103798, -0.14820420742034912, -0.007685421966016293, -0.08174387365579605, -0.02562551386654377, 0.01682371459901333, -0.02157539129257202, -0.0061003221198916435, 0.006156529299914837, 0.06802557408809662, 0.05051928386092186, 0.051888786256313324, 0.011159059591591358, 0.07027457654476166, 0.026433957740664482, -0.056202929466962814, 0.01701347716152668, 0.07531089335680008, 0.06410075724124908, 0.012953952886164188, -0.014234841801226139, -0.022292790934443474, -0.038977645337581635, 0.06193605437874794, 0.08884350210428238, 0.10786992311477661, 0.008283481001853943, 0.11126494407653809, 0.07327061146497726, -0.008437899872660637, 0.023681214079260826, -0.04353662207722664, 0.09601984173059464, 0.020037783309817314, 0.09236080944538116, -4.426073729746349e-08, -0.048219431191682816, -0.013666451908648014, 0.026936255395412445, 0.02819771319627762, -0.09675169736146927, -0.06778635084629059, 0.07456624507904053, 0.09267841279506683, 0.017632104456424713, -0.00814017653465271, 0.0005914085195399821, -0.013775646686553955, 0.006730486173182726, 0.0377890020608902, -0.0512365847826004, 0.054550107568502426, -0.08236793428659439, 0.052940044552087784, 0.03545242175459862, -0.02506762370467186, 0.047983184456825256, -0.02881842851638794, 0.026639411225914955, 0.07511714100837708, -0.028657641261816025, -0.041732702404260635, 0.026394059881567955, 0.06970033794641495, -0.007971595041453838, -0.03487871587276459, -0.008618280291557312, -0.01673826016485691, 0.0426652655005455, 0.04709026962518692, -0.014847338199615479, -0.00550474226474762, 9.850505739450455e-05, -0.016897596418857574, -0.03451107069849968, 0.05050579831004143, -0.1268114596605301, -0.030207442119717598, 0.09433163702487946, -0.006188406143337488, 0.07393407821655273, -0.019372396171092987, 0.020951373502612114, 0.03687484934926033, 0.0048470147885382175, -0.026551641523838043, 0.07324554026126862, 0.014242623932659626, -0.06321028620004654, 0.07850859314203262, 0.02147711254656315, -0.054560575634241104, -0.08623187988996506, 0.06625792384147644, 0.06294433027505875, -0.04495802894234657, -0.017918938770890236, -0.008656282909214497, -0.14386726915836334, -0.10348476469516754 ] }, { "text": "## Loss\n\nTotal Loss =Loss_content + Loss_style\n\nBy using backpropagation we change the target image to minimize the loss.\n\nSince these two losses can have very different values: (0.1 + 102) we need to treat them equally:\n\nTotal Loss = α * Loss_content + Β * Loss_style\n\n**Effect of Alpha & Beta Ratio:**\n\n- α / Β = 1/10 ---> more content + less style (we can see the shape pf house clearly)\n- α / Β = 1/10000 ---> less content + more style (we loose the shape of house)\n\nThe more small α / Β ratio the more style you see!", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_11", "embedding": [ 0.06514979153871536, 0.042440615594387054, 0.06785548478364944, -0.011174468323588371, 0.05896155536174774, 0.007161897607147694, -0.0034299050457775593, -0.0035719675943255424, 0.004441774450242519, -0.022099720314145088, -0.05410114675760269, -0.007342712488025427, 0.07323575764894485, -0.03466561809182167, -0.02008504420518875, 0.0251369159668684, -0.03665876016020775, 0.12845350801944733, -0.06734153628349304, -0.0046219597570598125, -0.05019322782754898, -0.07958007603883743, 0.017738614231348038, 0.03150155395269394, 0.020903654396533966, 0.022214680910110474, 0.0006817221874371171, 0.05259671434760094, 0.05639040842652321, -0.08403410017490387, 0.016163675114512444, -0.014086377806961536, 0.005509465467184782, -0.025424519553780556, -0.060013819485902786, 0.010437154211103916, -0.06206638738512993, 0.0016507476102560759, -0.030878379940986633, 0.010151754133403301, -0.008027251809835434, 0.03016473352909088, -0.016926083713769913, -0.031592097133398056, -0.05084637552499771, 0.05785004049539566, -0.0513603612780571, -0.017610762268304825, 0.05212400108575821, -0.023171043023467064, 0.04785779118537903, -0.00944568496197462, -0.05987296253442764, -0.01697547920048237, -0.036362212151288986, 0.06811265647411346, 0.050976116210222244, -0.024397626519203186, -0.005935752298682928, -0.029198242351412773, 0.0832553282380104, -0.005414711311459541, 0.0022717963438481092, -0.040537942200899124, 0.07346618175506592, -0.019509848207235336, -0.035849425941705704, -0.07567977160215378, 0.0075849443674087524, 0.03190089017152786, 0.057623255997896194, -0.0029439684003591537, 0.07376473397016525, -0.04968301206827164, -0.02474110573530197, -0.04943523183465004, 0.08410105854272842, 0.06388476490974426, -0.016213737428188324, 0.0021672258153557777, 0.03243105113506317, -0.017859887331724167, -0.05525505542755127, 0.006896775681525469, -0.034456100314855576, -0.007139894645661116, 0.0017081830883398652, -0.11243048310279846, -0.045468520373106, 0.028958015143871307, 0.010331076569855213, 0.018453795462846756, -0.04583151265978813, 0.06165545433759689, 0.025699416175484657, -0.03639815375208855, -0.05362258851528168, -0.08933103829622269, -0.0004106343840248883, 0.0375332273542881, -0.009943423792719841, -0.06450779736042023, 0.07545376569032669, -0.007172821089625359, 0.0030484404414892197, 0.011405962519347668, 0.07075747102499008, 0.07015608996152878, 0.05802454426884651, 0.04005488008260727, 0.007393074221909046, -0.0038428218103945255, -0.005200214218348265, 0.05729310214519501, 0.039479780942201614, -0.019694514572620392, 0.047204840928316116, -0.04539219290018082, -0.018924443051218987, -0.04577116295695305, -0.018422063440084457, 0.01150216069072485, -0.08633139729499817, -0.056060951203107834, 0.004572323989123106, -0.0661991611123085, -0.05660663917660713, 2.4470995074907054e-33, -0.032977715134620667, 0.04834079369902611, -0.05377022176980972, -0.018316952511668205, 0.06848472356796265, 0.05637986212968826, -0.03336929529905319, -0.05541976913809776, -0.006481710821390152, -0.0024339696392416954, -0.025079896673560143, -0.0791487991809845, -0.13319499790668488, 0.07890719175338745, 0.024624213576316833, -0.1816754788160324, 0.000578240433242172, 0.05561614781618118, 0.01657913811504841, -0.024103336036205292, -0.04587443172931671, 0.002259299159049988, -0.054579854011535645, 0.0010168052976951003, -0.039288681000471115, -0.03581073135137558, 0.012467918917536736, 0.013049532659351826, -0.08926045149564743, -0.014816517010331154, 0.03285611420869827, 0.0019138464704155922, -0.01690586842596531, -0.07053834944963455, -0.07335593551397324, -0.035664550960063934, 0.0018557717557996511, 0.06280551105737686, 0.030670860782265663, -0.02320936508476734, -0.07313060760498047, 0.08194322139024734, 0.009024196304380894, -0.012674503028392792, 0.011921645142138004, -0.00029436906334012747, 0.12041764706373215, 0.06466884166002274, -0.0467601902782917, 0.019634347409009933, 0.040700044482946396, -0.05114520341157913, -0.01517620962113142, 0.006741398014128208, 0.05200239270925522, -0.03650220111012459, 0.03642391785979271, -0.017786970362067223, -0.0019231021869927645, -0.007102002389729023, 0.103422150015831, 0.03135346993803978, 0.0478619709610939, -0.006302076391875744, -0.03780999779701233, 0.010399676859378815, 0.038926467299461365, -0.01579524762928486, -0.10004870593547821, 0.03610491752624512, -0.030945347622036934, 0.08189086616039276, 0.0489862784743309, -0.054223280400037766, 0.053702518343925476, -0.014700631611049175, -0.0262119323015213, -0.0018996555591002107, 0.01639225147664547, -0.04380921646952629, -0.1271999329328537, 0.14907370507717133, 0.0002989352506119758, -0.07856058329343796, -0.07721041142940521, 0.04668258875608444, 0.08645939826965332, -0.024946028366684914, -0.04615052044391632, 0.010881994850933552, -0.035210225731134415, -0.0449751615524292, 0.05342956632375717, 0.05150492116808891, 0.00391007773578167, -3.176763197521662e-33, -0.09767848998308182, 0.1063069999217987, 0.008122925646603107, -0.01330114621669054, -0.04788640886545181, 0.0536726713180542, 0.04784536734223366, 0.029667843133211136, 0.03158754110336304, 0.04849666357040405, 0.03308490663766861, 0.05613560602068901, -0.12974593043327332, -0.09832944720983505, -0.02966802939772606, -0.03447660431265831, 0.04046127200126648, 0.014608527533710003, -0.0315837487578392, -0.05558706820011139, 0.041669849306344986, 0.11213173717260361, -0.029373208060860634, 0.028483273461461067, -0.021703282371163368, -0.0024424795992672443, 0.03521158918738365, 0.13025625050067902, 0.05157408490777016, -0.04439060762524605, -0.05834023281931877, -0.020404377952218056, -0.00876893661916256, 0.07675975561141968, -0.05904323607683182, -0.012495295144617558, -0.03791230916976929, -0.02996421605348587, -0.0842834860086441, -0.031672291457653046, 0.05884366109967232, -0.007736431434750557, -0.03645416349172592, -0.061952169984579086, -0.027176208794116974, 0.0003042315074708313, 0.04578205198049545, -0.08530811965465546, 0.0527176670730114, 0.021560978144407272, 0.0743020623922348, -0.05500476062297821, -0.04577692970633507, 0.08248548209667206, -0.01824449747800827, 0.05992157384753227, -0.026006551459431648, 0.055501651018857956, -0.010678836144506931, 0.09372331202030182, -0.07852789014577866, -0.016568437218666077, -0.05191372334957123, 0.026516186073422432, -0.03756662458181381, 0.006379903759807348, -0.0545300655066967, -0.024385137483477592, 0.07086379826068878, 0.0729164257645607, 0.01600503921508789, 0.09212060272693634, 0.04241218790411949, 0.07572443783283234, 0.014763394370675087, -0.060356222093105316, -0.024270547553896904, 0.06751313805580139, 0.03494596853852272, 0.03028331696987152, -0.058318350464105606, -0.04651642218232155, -0.04908376187086105, 0.06413259357213974, 0.02253693901002407, 0.04063079133629799, -0.07341808080673218, 0.007510034367442131, 0.03782682120800018, 0.06481028348207474, -0.013180652633309364, 0.013065576553344727, 0.10215507447719574, -0.07938767224550247, 0.05833766236901283, -4.520705942923087e-08, -0.011105838231742382, -0.029577946290373802, 0.04456371068954468, 0.023757316172122955, -0.032031383365392685, -0.04770427569746971, 0.03155042603611946, -0.02836722508072853, -0.03767513111233711, -0.05350130796432495, -0.004642452113330364, 0.05192724987864494, -0.008798669092357159, 0.0594894178211689, -0.07246444374322891, -0.012004255317151546, -0.018064633011817932, 0.044212307780981064, 0.05171903967857361, -0.004246685188263655, -0.0452420674264431, -0.04870379716157913, -0.04509669914841652, 0.06294485926628113, -0.016198789700865746, -0.030246498063206673, 0.03900092467665672, 0.07395121455192566, -0.03023570589721203, -0.013357424177229404, 0.10260508209466934, -0.027865959331393242, -0.03416033834218979, 0.004282566253095865, -0.03542809933423996, 0.06661639362573624, 0.012324344366788864, 0.015092178247869015, -0.031032128259539604, 0.10950421541929245, -0.1128845140337944, -0.07892686873674393, 0.04753441363573074, -0.022899115458130836, -0.0009892649250105023, 0.012631197459995747, 0.08920368552207947, -0.07934612035751343, 0.00648257602006197, -0.0386013425886631, 0.1204913929104805, -0.03148173168301582, -0.046852823346853256, 0.0023325160145759583, 0.08055240660905838, -0.1237880289554596, -0.018712706863880157, 0.03670663386583328, -0.02261342480778694, 0.03645126149058342, -0.006765394937247038, 0.013146773912012577, -0.03898143395781517, -0.061695974320173264 ] }, { "text": "## Coding Tips\n\n- Load VGG features, not classification part\n \n \n vgg = models.vgg19(pretrained=True).features\n \n- Freeze all VGG parameters since we're only optimizing the target image\n\n \n for param in vgg.parameters():\n param.requires_grad_(False)\n \n- Features of Vgg19:", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_12", "embedding": [ -0.03575378656387329, 0.006737079471349716, 0.013731773011386395, 0.054085902869701385, 0.08473504334688187, -0.01680167391896248, 0.006680007092654705, -0.027339860796928406, -0.11528874933719635, -0.09892897307872772, -0.023657096549868584, -0.05531865358352661, -0.06378170102834702, -0.04355869069695473, -0.024117708206176758, -0.03480033949017525, 0.021615171805024147, 0.021261809393763542, -0.013846533372998238, -0.04139363765716553, 0.007430752739310265, 0.016291365027427673, 0.039030350744724274, -0.026077566668391228, 0.00883220974355936, -0.03163328394293785, 0.0073899561539292336, 0.06846920400857925, 0.07664331048727036, -0.04357045888900757, -0.009287874214351177, 0.0062249223701655865, -0.1153884157538414, 0.09700313210487366, 0.006995086092501879, 0.09986728429794312, -0.09001722186803818, -0.0727877989411354, -0.03198060393333435, -0.014004685916006565, 0.025201842188835144, -0.06094387546181679, -0.03890082240104675, -0.05549544841051102, 0.066096231341362, 0.05205712467432022, -0.005036452319473028, 0.027824601158499718, 0.022073883563280106, -0.018443383276462555, -0.0015350934118032455, -0.06745418161153793, -0.07506658136844635, -0.015149133279919624, 0.0007911709253676236, -0.02109840139746666, 0.021524200215935707, -0.04310981556773186, 0.023812362924218178, -0.02791428007185459, -0.043897081166505814, -0.023237621411681175, -0.03172273933887482, 0.014107472263276577, -0.024602117016911507, 0.02451961487531662, 0.054935384541749954, -0.05249257758259773, 0.06758634001016617, 0.02596912533044815, -5.9689031331799924e-05, 0.05788847431540489, 0.022410858422517776, -0.023161208257079124, -0.04997572675347328, 0.016825828701257706, 0.061939116567373276, 0.05867062509059906, 0.1184111014008522, -0.09732964634895325, 0.02004178799688816, -0.07755640894174576, -0.01129206269979477, 0.009895260445773602, 0.03318973258137703, 0.00478530116379261, -0.018652254715561867, -0.04073058441281319, 0.032606348395347595, -0.011444182135164738, 0.05050865560770035, -0.04852018132805824, 0.0019771025981754065, 0.04798809438943863, -0.029737090691924095, 0.03308553248643875, 0.0054118093103170395, -0.07634799927473068, -0.09851883351802826, 0.025019342079758644, -0.07570799440145493, -0.03699036315083504, 0.16659191250801086, 0.10876619815826416, 0.0649440735578537, -0.0076343948021531105, 0.059630073606967926, 0.06765624135732651, -0.025972511619329453, -0.018707958981394768, -0.015580136328935623, 0.07581471651792526, 0.025776756927371025, -0.019274462014436722, 0.05460512265563011, 0.05321090295910835, -0.017232181504368782, 0.0032445224933326244, -0.0057821013033390045, -0.005313632544130087, -0.012140272185206413, 0.03174388408660889, -0.03162126988172531, -0.06743476539850235, -0.0298586655408144, -0.0991067960858345, -0.08741404116153717, 4.630455184197337e-33, -0.00024341193784493953, -0.024259762838482857, 0.015204919502139091, -0.04880308359861374, -0.07505236566066742, 0.05578381195664406, 0.021722352132201195, 0.008213857188820839, -0.06610556691884995, 0.06246102228760719, -0.11577413976192474, -0.06037403270602226, -0.038832832127809525, 0.12071314454078674, 0.03647805377840996, 0.010029995813965797, -0.035601627081632614, 0.03835051506757736, -0.018079455941915512, 0.023894380778074265, 0.07585691660642624, -0.11698301881551743, -0.04772045090794563, -0.06484424322843552, -0.06392314285039902, -0.004304991103708744, -0.027721449732780457, -0.028025971725583076, -0.04626097530126572, 0.014118119142949581, -0.052339304238557816, 0.022769270464777946, 0.062298718839883804, 0.03459100425243378, -0.03580445423722267, -0.05465876683592796, 0.05610150098800659, 0.0005519988480955362, 0.04442305490374565, -0.021101394668221474, -0.02268843911588192, 0.06450557708740234, 0.025686882436275482, -0.019387926906347275, 0.0052749463357031345, -0.034866102039813995, 0.010177366435527802, 0.08209855854511261, -0.013772418722510338, 0.073285773396492, 0.011932702735066414, -0.045015137642621994, -0.02928553894162178, -0.0700339525938034, -0.06551067531108856, 0.00831771269440651, 0.06784825026988983, 0.08155075460672379, -0.012658016756176949, -0.09149225056171417, 0.06973132491111755, -0.017911333590745926, -0.013183904811739922, 0.02050793170928955, 0.06469259411096573, -0.028007255867123604, -0.014790275134146214, -0.006887887604534626, -0.03760384023189545, 0.028096478432416916, -0.03257817402482033, -0.005018336232751608, -0.04404950886964798, -0.13306772708892822, 0.08045382797718048, -0.08851677179336548, 0.0013841597829014063, -0.02606356143951416, -0.05855217203497887, 0.04216716066002846, 0.0024387179873883724, 0.06472110748291016, -0.04721279814839363, -0.14652906358242035, 0.008749895729124546, -0.012491941452026367, 0.057868607342243195, -0.05452584847807884, -0.016320671886205673, -0.03452986478805542, -0.03394513577222824, 0.02622288092970848, -0.016636667773127556, -0.0022988219279795885, -0.0307143684476614, -3.6381722808682575e-33, 0.04879125580191612, 0.09885172545909882, 0.017695341259241104, 0.0628761351108551, 0.04472219571471214, 0.029411720111966133, 0.06286704540252686, 0.027611931785941124, -0.03248756378889084, -0.02182459458708763, 0.06768089532852173, -0.028103629127144814, -0.04117865487933159, -0.06276882439851761, 0.013523571193218231, 0.012336228974163532, -0.11555681377649307, 0.031453125178813934, 0.030226605013012886, 0.01878226362168789, -0.07917257398366928, 0.044253863394260406, -0.057789355516433716, 0.03530609980225563, -0.08440712839365005, -0.011909975670278072, 0.015941176563501358, 0.06161635369062424, 0.029064027592539787, 0.031780220568180084, -0.02886006608605385, 0.07302845269441605, -0.04453209787607193, 0.01489883754402399, 0.08522959053516388, -0.006959469523280859, 0.07086389511823654, -0.009559907019138336, 0.042359087616205215, 0.08614654093980789, 0.08121176064014435, 0.04318296164274216, -0.0944216325879097, 0.033052194863557816, 0.0077926842495799065, -0.004109880421310663, 0.07813514024019241, -0.016878295689821243, -0.0005263862549327314, -0.005123634357005358, 0.0370633639395237, -0.033767007291316986, -0.03325968608260155, 0.07636424154043198, -0.005451492965221405, -0.00710258586332202, -0.04620565474033356, -0.02259698696434498, 0.04405387118458748, -0.0077157532796263695, -0.024669881910085678, -7.43090349715203e-05, -0.02498343586921692, -0.13561460375785828, 0.06049640476703644, 0.009025073610246181, -0.03551224619150162, 0.05395956709980965, 0.008407744579017162, 0.0608980618417263, -0.06432314962148666, 0.02308555319905281, 0.060091033577919006, -0.05334177613258362, -0.04075273126363754, -0.015976140275597572, -0.015448224730789661, 0.020234867930412292, 0.06589466333389282, -0.08502963185310364, 0.013393828645348549, 0.0016839253949001431, -0.02042849175632, 0.10816048830747604, 0.01241203211247921, 0.10655765980482101, -0.002323330845683813, 0.05842351168394089, 0.05150756984949112, -0.028548160567879677, 0.002851565834134817, -0.02749474346637726, 0.09095199406147003, 0.11936218291521072, 0.017778685316443443, -3.87731553530557e-08, 0.025142310187220573, 0.08368568122386932, -0.029510444030165672, -0.0012377360835671425, 2.9885208277846687e-05, 0.030759358778595924, 0.017446523532271385, 0.0719672366976738, 0.01076584868133068, 0.10712902992963791, -0.035516321659088135, 0.0725632831454277, -0.004827533382922411, 0.07532147318124771, 0.0054581924341619015, 0.05774053558707237, -0.02591780386865139, 0.12633885443210602, -0.03661182522773743, -0.013186216354370117, 0.028928130865097046, -0.06938486546278, -0.035980574786663055, 0.0036714773159474134, 0.026241576299071312, -0.09744345396757126, 0.039906855672597885, -0.010791675187647343, 0.03275555744767189, 0.018137119710445404, -0.04001661390066147, -0.009400643408298492, -0.027232816442847252, -0.03004494681954384, -0.01241336576640606, 0.10114825516939163, -0.03895863890647888, -0.003847928252071142, 0.041480861604213715, 0.027732744812965393, -0.060595788061618805, -0.024374011904001236, 0.0027602175250649452, -0.06934233009815216, -0.05005330219864845, 0.042292069643735886, 0.006190984044224024, -0.05991313233971596, -0.020219625905156136, 0.13424038887023926, -0.03297370299696922, -0.011417658999562263, -0.06205565854907036, 0.05324718356132507, -0.012368999421596527, -0.0367216095328331, 0.05523695424199104, -0.014096856117248535, 0.036871593445539474, -0.04383394122123718, 0.039430756121873856, 0.0067301588132977486, -0.016601115465164185, 0.008633354678750038 ] }, { "text": "Sequential(\n (0): Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (1): ReLU(inplace=True)\n (2): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (3): ReLU(inplace=True)\n (4): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n (5): Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (6): ReLU(inplace=True)\n (7): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (8): ReLU(inplace=True)\n (9): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n (10): Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (11): ReLU(inplace=True)", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_13", "embedding": [ -0.0118663739413023, -0.019199104979634285, -0.004113109782338142, -0.08322583884000778, 0.03705891966819763, -0.09100264310836792, -0.041482824832201004, -0.01388204749673605, -0.05107003450393677, -0.05754302069544792, 0.036321159452199936, 0.00860228855162859, -0.02693943679332733, 0.011181986890733242, -0.07094365358352661, 0.009919456206262112, -0.04263516142964363, 0.07886223495006561, -0.047527965158224106, -0.04164975881576538, 0.08610900491476059, 0.031245674937963486, -0.045393768697977066, -0.03654390946030617, 0.03218263015151024, 0.04851068928837776, -0.005658365320414305, 0.05901956185698509, 0.045440658926963806, -0.09234798699617386, 0.047187790274620056, 0.0725034847855568, -0.06662952899932861, 0.01127797830849886, -0.004409318324178457, 0.03146175667643547, -0.02429770678281784, -0.015577208250761032, -0.0381288155913353, 0.044132597744464874, -0.009409986436367035, 0.022302620112895966, 0.017297692596912384, 0.0588071346282959, 0.05591338500380516, 0.09806816279888153, 0.024010831490159035, 0.01517640333622694, 0.07297070324420929, -0.07124926149845123, -0.020917875692248344, 0.03900029510259628, 0.012434539385139942, 0.026410358026623726, -0.0034481091424822807, 0.012063561007380486, -0.0634051188826561, -0.026661576703190804, 0.026635630056262016, 0.006876416504383087, 0.06582251191139221, 0.00024198977916967124, 0.044530611485242844, 0.03394918888807297, -0.017827367410063744, -0.10391617566347122, -0.0031223082914948463, -0.02305341698229313, -0.02042900212109089, 0.1090821921825409, -0.023416170850396156, 0.08558928966522217, -0.042296186089515686, -0.022314531728625298, 0.03417075052857399, 0.014824618585407734, 0.0381881445646286, -0.0017469682497903705, -0.03165765106678009, -0.08440420031547546, 0.03461853414773941, 0.025273708626627922, 0.03133055940270424, -0.03140275552868843, 0.016896091401576996, -0.058509230613708496, -0.026738299056887627, 0.029586520045995712, 0.016925537958741188, -0.018808839842677116, 0.032331909984350204, 0.10147591680288315, -0.09530551731586456, -0.023434944450855255, -0.021741516888141632, 0.021803034469485283, 0.03001570887863636, 0.015337531454861164, -0.00802113488316536, 0.05484124273061752, 0.0012069052318111062, -0.0846211165189743, -0.02542993798851967, 0.019844194874167442, 0.059894636273384094, -0.021250516176223755, 0.05816793069243431, 0.1276826709508896, -0.04270714521408081, -0.06914441287517548, 0.0917077288031578, -0.06892397254705429, 0.10490298271179199, 0.01764541305601597, 0.11595133692026138, 0.0562116801738739, -0.023684313520789146, 0.07486286759376526, 0.07051390409469604, 0.005461159627884626, -0.03955615684390068, 0.026946453377604485, -0.0016713908407837152, 0.010275391861796379, -0.0592842772603035, 0.003715170081704855, -0.03986310586333275, 5.9506337878226475e-33, -0.02396596409380436, -0.03933977708220482, -0.040365662425756454, -0.003875731024891138, -0.012912523001432419, 0.04740603640675545, -0.009436397813260555, -0.04373670741915703, -0.03395257145166397, -0.010385853238403797, -0.06218758597970009, -0.1172948107123375, -0.06046802178025246, 0.051692452281713486, -0.004492395091801882, -0.0726175531744957, 0.014318426139652729, 0.04382805898785591, -0.038335878401994705, -0.057030387222766876, 0.03511488065123558, 0.04933447763323784, -0.02195184864103794, -0.06905809044837952, -0.011303005740046501, -0.07772355526685715, -0.03658425062894821, -0.08550682663917542, 2.108684930135496e-05, 0.022725369781255722, -0.019007902592420578, 0.02130732871592045, -0.02405928634107113, 0.04768849164247513, -0.05163188651204109, 0.03609132394194603, 0.017619723454117775, -0.0004410807741805911, -0.002620852319523692, -0.06064664199948311, -0.0007472612196579576, 0.07253684103488922, 0.020153742283582687, -0.04586802050471306, -0.05798523128032684, -0.10989316552877426, 0.0803399458527565, 0.10594064742326736, -0.023048920556902885, -0.012000133283436298, 0.05036546289920807, 0.03650058060884476, 0.00547005794942379, -0.08920562267303467, -0.018220534548163414, -0.023662909865379333, 0.0723983496427536, 0.04559570178389549, 0.006500522140413523, 0.13799448311328888, -0.06544854491949081, 0.0033663534559309483, -0.07720225304365158, 0.0054921372793614864, -0.011678746901452541, 0.007126780692487955, -0.01252040546387434, -0.01705307513475418, 0.03465040773153305, 0.06358198821544647, -0.08915268629789352, 0.028929175809025764, 0.04189258813858032, -0.059111833572387695, -0.0062835910357534885, -0.06432098150253296, 0.01843651756644249, -0.05873394384980202, -0.08795613050460815, -0.054151441901922226, -0.04350920394062996, 0.09893593937158585, -0.024790648370981216, -0.04959724098443985, -0.06332983076572418, -0.09783058613538742, 0.009001176804304123, -0.052434857934713364, -0.06461577862501144, -0.04937243089079857, -0.049445413053035736, -0.06751781702041626, 0.11826753616333008, -0.014071892015635967, -0.04396340623497963, -5.217811875078817e-33, -0.01282111182808876, 0.07699797302484512, 0.045328035950660706, 0.07164107263088226, -0.010322029702365398, 0.05624639242887497, 0.08487585932016373, -0.0204168651252985, -0.045842673629522324, -0.13367857038974762, 0.0008467232692055404, 0.024022428318858147, 0.0005544456071220338, 0.022021519020199776, 0.06529033929109573, -0.041594360023736954, -0.04603093862533569, 0.006055525038391352, -0.013388772495090961, -0.018819401040673256, 0.019656507298350334, 0.0903480127453804, 0.09223117679357529, 0.03926394507288933, -0.009765593335032463, 0.02209448628127575, 0.0001416693557985127, 0.009082885459065437, 0.016044272109866142, 0.005782437976449728, -0.013538460247218609, -0.022021012380719185, -0.07589224725961685, 0.10312321782112122, 0.005407116841524839, -0.037393294274806976, 0.010827379301190376, 0.006495131645351648, -0.004368301946669817, 0.03724190592765808, 0.10439896583557129, 0.025948019698262215, -0.0948866680264473, 0.022284647449851036, -0.01572740077972412, 0.02539086900651455, 0.06261264532804489, -0.02064335346221924, -0.03978933021426201, -0.013191313482820988, -0.08713534474372864, -0.029068654403090477, -0.03767653554677963, 0.06753157824277878, 0.040646739304065704, 0.007127022836357355, -0.08468148857355118, 0.009093496017158031, 0.06877758353948593, -0.04003037512302399, -0.061886388808488846, -0.0636383518576622, 0.024879494681954384, -0.04209863021969795, 0.08918961137533188, 0.01517411507666111, -0.07599029690027237, 0.04614409804344177, -0.02574758417904377, 0.06394363939762115, -0.007596390787512064, 0.04603225737810135, -0.02483178675174713, -0.03259402513504028, -0.044243406504392624, -0.0876154974102974, 0.033538173884153366, -0.020861545577645302, 0.006865932606160641, 0.0249330997467041, -0.11028001457452774, 0.01763262040913105, 0.04887352138757706, 0.09990398585796356, 0.014291674830019474, 0.017229925841093063, 0.026092806831002235, 0.05813727527856827, 0.061063140630722046, -0.014328156597912312, 0.012813418172299862, 0.05655185133218765, 0.10848881304264069, 0.039269257336854935, 0.0619962178170681, -4.450012269785475e-08, -0.015443403273820877, -0.0823092833161354, -0.011450161226093769, 0.0405203253030777, 0.09449722617864609, -0.07455244660377502, -0.0003512678958941251, 0.08282973617315292, -0.041253264993429184, -0.05039098858833313, 0.026767194271087646, -0.004996660631150007, -0.005869887303560972, -0.07687589526176453, -0.005946548655629158, 0.08850011229515076, -0.0054758042097091675, -0.05192193761467934, -0.01328393816947937, -0.05079895257949829, -0.049026958644390106, -0.03829117864370346, -0.056790392845869064, 0.08192704617977142, -0.04694109782576561, -0.06629476696252823, -0.04569777846336365, -0.05124847963452339, 0.10058487951755524, -0.013955507427453995, -0.057961635291576385, -0.030113868415355682, 0.07797421514987946, -0.0025306104216724634, -2.2219468519324437e-05, -0.004919981583952904, -0.03852006047964096, 0.0682719498872757, -0.012423296459019184, -0.004501828458160162, -0.0839490070939064, 0.08738673478364944, 0.05290576443076134, -0.005680661648511887, 0.07233409583568573, -0.008238358423113823, 0.01692925952374935, -0.0054699936881661415, -0.01734030991792679, -0.0230009313672781, -0.012543385848402977, 0.05638226121664047, 0.0567874051630497, 0.05285585671663284, 0.03574228659272194, -0.08816960453987122, -0.08114919066429138, 0.05179830640554428, 0.007640622556209564, 0.03746218606829643, -0.007251701783388853, 0.035096097737550735, 0.013064614497125149, -0.025386448949575424 ] }, { "text": "(10): Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (11): ReLU(inplace=True)\n (12): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (13): ReLU(inplace=True)\n (14): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (15): ReLU(inplace=True)\n (16): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (17): ReLU(inplace=True)\n (18): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n (19): Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (20): ReLU(inplace=True)\n (21): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (22): ReLU(inplace=True)", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_14", "embedding": [ -0.007684656418859959, -0.0003863501187879592, -0.023632610216736794, -0.08772708475589752, 0.055561602115631104, -0.11255564540624619, -0.02766873873770237, -0.01835150085389614, -0.05206746608018875, -0.05365210026502609, 0.030444016680121422, 0.010036290623247623, -0.012442129664123058, 0.001675813808105886, -0.07092797011137009, 0.017558984458446503, -0.03665582835674286, 0.08921211957931519, -0.08714775741100311, -0.03369177505373955, 0.08967357128858566, -0.0023861238732934, -0.06495818495750427, -0.03853719308972359, 0.01194696594029665, 0.03686807304620743, -0.015383255667984486, 0.0483650267124176, 0.0361897312104702, -0.07839677482843399, 0.06918168812990189, 0.0949864462018013, -0.060917556285858154, 0.025710012763738632, -0.009478467516601086, 0.052142806351184845, -0.013558577746152878, -0.042603813111782074, -0.02668757177889347, 0.0017905265558511019, -0.022864995524287224, 0.014669290743768215, 0.025250783190131187, 0.06279319524765015, 0.07008475810289383, 0.10313443839550018, 0.0004034116573166102, 0.009232980199158192, 0.07662492990493774, -0.06202974542975426, -0.02578345313668251, 0.0472615510225296, 0.02079264633357525, 0.029052747413516045, 0.0004961310769431293, -0.00015834231453482062, -0.061132848262786865, -0.015122519806027412, 0.034991201013326645, 0.005277419462800026, 0.05579257011413574, -0.007813960313796997, 0.03098585456609726, 0.04974674805998802, -0.017506759613752365, -0.09784567356109619, 0.006176462396979332, -0.051295410841703415, -0.03977055102586746, 0.10563568025827408, -0.02287844941020012, 0.07102426141500473, -0.04000507667660713, -0.022254109382629395, 0.03182809799909592, 0.018920773640275, 0.025712953880429268, -0.002519920002669096, -0.020144684240221977, -0.0825071707367897, 0.02585229091346264, 0.03811098262667656, 0.05273555964231491, -0.03820781782269478, 0.027700284495949745, -0.06704402714967728, -0.020100567489862442, 0.03046412020921707, 0.017809072509407997, -0.0016850285464897752, 0.028741857036948204, 0.08176229149103165, -0.09105774015188217, 0.021316008642315865, -0.0213996022939682, 0.005979107692837715, 0.0397697351872921, 0.0032557949889451265, -0.015482227317988873, 0.059015367180109024, -0.01554846577346325, -0.0707777738571167, 0.0027207580860704184, 0.025376364588737488, 0.04056580737233162, -0.026502106338739395, 0.061371155083179474, 0.11112374812364578, -0.03152603656053543, -0.047866638749837875, 0.09111252427101135, -0.04772697016596794, 0.09957017004489899, 0.019158413633704185, 0.10685581713914871, 0.06284736841917038, -0.053116220980882645, 0.08059205859899521, 0.0605863556265831, 0.0026651632506400347, -0.03387759253382683, 0.026397451758384705, -0.0041733235120773315, 0.011205564253032207, -0.054599422961473465, -0.005020674783736467, -0.04190812632441521, 6.068757011084871e-33, -0.01465430948883295, -0.024374155327677727, -0.0656704232096672, -0.00637222221121192, 0.002196222310885787, 0.06542189419269562, 0.004772822838276625, -0.020110584795475006, -0.04019380733370781, -0.029590070247650146, -0.06805167347192764, -0.1037958636879921, -0.05143654718995094, 0.06529109925031662, 0.024122649803757668, -0.04482705891132355, 0.006200809963047504, 0.02951331064105034, -0.03421172499656677, -0.053320884704589844, 0.01958385296165943, 0.03773290291428566, -0.02562435157597065, -0.0759839415550232, -0.018061647191643715, -0.07986590266227722, -0.0383097380399704, -0.07918070256710052, -0.016596173867583275, 0.027639083564281464, -0.03393547236919403, 0.0004943987587466836, -0.01246415264904499, 0.044993430376052856, -0.04523373395204544, 0.03368529677391052, 0.038800012320280075, 0.004009811673313379, -0.008035608567297459, -0.06616333872079849, -0.012950326316058636, 0.07747691869735718, 0.028227057307958603, -0.06585656851530075, -0.048343271017074585, -0.0854143425822258, 0.08295420557260513, 0.09523888677358627, -0.07020999491214752, -0.017131539061665535, 0.023883970454335213, 0.03846890106797218, 0.007833310402929783, -0.10221318900585175, -0.027809755876660347, -0.03732464835047722, 0.0800737738609314, 0.04547976329922676, -0.000129115825984627, 0.14562547206878662, -0.07522182166576385, -0.006539695430546999, -0.0543595552444458, 0.022451680153608322, -0.011957795359194279, 0.016243187710642815, 0.010904449038207531, -0.019380373880267143, 0.04217655956745148, 0.06231996417045593, -0.07761336863040924, 0.039064835757017136, 0.05694253370165825, -0.06946756690740585, -0.013489319011569023, -0.07071481645107269, 0.05136508867144585, -0.0643835961818695, -0.09295541793107986, -0.0683697834610939, -0.04043905436992645, 0.11366172134876251, -0.017304882407188416, -0.06930240243673325, -0.07182589173316956, -0.10593605041503906, -0.028522655367851257, -0.06160598620772362, -0.05919535830616951, -0.02847084403038025, -0.04009260982275009, -0.08804134279489517, 0.13317932188510895, -0.02247060276567936, -0.05058689042925835, -5.162841718472536e-33, -0.007231373805552721, 0.08301045745611191, 0.0378231517970562, 0.06504618376493454, -0.017900122329592705, 0.05579255148768425, 0.08968113362789154, 0.00960143655538559, -0.018325453624129295, -0.13556812703609467, 0.021471984684467316, -0.0023355563171207905, 0.0009946950012817979, 0.007472454570233822, 0.046261657029390335, -0.028801079839468002, -0.07892266660928726, 0.018861956894397736, -0.015036990866065025, -0.03439037874341011, 0.007314719259738922, 0.12182632833719254, 0.0744313970208168, 0.055078841745853424, -0.0018915155669674277, 0.0291622094810009, -0.0016364951152354479, 0.007277242373675108, -0.0007651541964150965, 0.003298630937933922, -0.0002267497475259006, -0.034552983939647675, -0.07556807994842529, 0.10581685602664948, 0.026674915105104446, -0.018774932250380516, 0.020577693358063698, 0.017157798632979393, -0.010777534916996956, 0.04493110254406929, 0.10999137908220291, 0.03743483126163483, -0.07798963785171509, 0.016897695139050484, -0.02224387787282467, 0.032104477286338806, 0.045062221586704254, -0.022912295535206795, -0.0017654594266787171, -0.020148146897554398, -0.06422218680381775, -0.03479031100869179, -0.024591391906142235, 0.05809765309095383, 0.03465915471315384, 0.0035335018765181303, -0.10237324237823486, 0.012826895341277122, 0.04450984299182892, -0.049099333584308624, -0.05161551386117935, -0.07090949267148972, 0.019161788746714592, -0.03196636214852333, 0.08639409393072128, 0.006379390601068735, -0.08122704923152924, 0.029791444540023804, -0.004147745668888092, 0.0932716578245163, -0.01639951579272747, 0.03194086626172066, -0.024218076840043068, -0.024404950439929962, -0.05323367938399315, -0.05426732450723648, 0.059709638357162476, -0.03949292004108429, -0.001405744580551982, 0.026286611333489418, -0.10461624711751938, 0.02168995328247547, 0.03437158465385437, 0.08513229340314865, 0.010923987254500389, 0.03846509009599686, 0.005374678410589695, 0.0679057389497757, 0.050530288368463516, -0.01363584864884615, 0.004343735985457897, 0.06146970018744469, 0.10335995256900787, 0.01964596100151539, 0.06492730230093002, -4.096552430610245e-08, -0.009858470410108566, -0.0747036561369896, -0.04137897863984108, 0.02379034459590912, 0.08508538454771042, -0.06824330240488052, 0.021945832297205925, 0.07440454512834549, -0.024829549714922905, -0.03433748707175255, 0.0569959431886673, -0.011080373078584671, -0.03960816189646721, -0.0750776082277298, -0.009173025377094746, 0.07824164628982544, -0.03417961671948433, -0.04887308552861214, -0.019231576472520828, -0.05278678238391876, -0.0355738028883934, -0.031367648392915726, -0.05194924771785736, 0.08814835548400879, -0.0473853200674057, -0.07610966265201569, -0.02003992721438408, -0.026691298931837082, 0.08391739428043365, 0.010958625003695488, -0.06978047639131546, -0.03740860894322395, 0.07669787108898163, 0.0007610446191392839, 0.017031285911798477, -0.0040833475068211555, -0.03967685252428055, 0.08822134882211685, 0.005178133957087994, 0.0043638162314891815, -0.0703081414103508, 0.054139863699674606, 0.054715629667043686, -0.01552857831120491, 0.0617387630045414, -0.029897013679146767, 0.028299756348133087, 0.003664672141894698, -0.012229273095726967, -0.017987702041864395, -0.004930129740387201, 0.047938086092472076, 0.05438196286559105, 0.035224657505750656, 0.03346778079867363, -0.06299357116222382, -0.0887802466750145, 0.054666608572006226, 0.015192212536931038, 0.0505816712975502, -0.0016167528228834271, 0.029321247711777687, 0.0099922064691782, -0.018387718126177788 ] }, { "text": "(20): ReLU(inplace=True)\n (21): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (22): ReLU(inplace=True)\n (23): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (24): ReLU(inplace=True)\n (25): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (26): ReLU(inplace=True)\n (27): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n (28): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (29): ReLU(inplace=True)\n (30): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (31): ReLU(inplace=True)\n (32): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (33): ReLU(inplace=True)", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_15", "embedding": [ -0.01161100622266531, -0.01634654402732849, -0.028295891359448433, -0.07229991257190704, 0.05547619238495827, -0.10718695819377899, -0.0011787619441747665, -0.007507042959332466, -0.05058201402425766, -0.0564720593392849, 0.01877056248486042, 0.019835392013192177, 0.007498864084482193, -0.0017959428951144218, -0.07134734094142914, 0.01678560860455036, -0.026970641687512398, 0.07377714663743973, -0.07427185773849487, -0.03571794927120209, 0.07979276031255722, 0.011303050443530083, -0.06416760385036469, -0.02184235490858555, 0.02498604543507099, 0.036555368453264236, -0.01029284205287695, 0.043093472719192505, 0.02095763199031353, -0.09330130368471146, 0.06378217041492462, 0.07314451783895493, -0.07137885689735413, 0.015485651791095734, 0.004734725691378117, 0.05259435996413231, -0.04740280658006668, -0.022736309096217155, -0.034454021602869034, -0.0020851101726293564, -0.008837681263685226, -0.01321490854024887, 0.012367823161184788, 0.06123391166329384, 0.056705426424741745, 0.10961541533470154, 0.0012574297143146396, 0.014560828916728497, 0.07908211648464203, -0.06262391060590744, -0.03387347236275673, 0.04773000627756119, 0.008788171224296093, 0.033069904893636703, 0.0054876478388905525, 0.0031282054260373116, -0.04298881068825722, -0.032261915504932404, 0.03325587138533592, 0.015738902613520622, 0.05065108463168144, -0.011723333038389683, 0.028766212984919548, 0.022799799218773842, -0.009786544367671013, -0.09680155664682388, 0.007684799376875162, -0.03546332195401192, -0.033916816115379333, 0.09143521636724472, -0.008636463433504105, 0.07907947897911072, -0.05356663838028908, -0.024230778217315674, 0.040790311992168427, 0.020736997947096825, 0.03207577392458916, 0.006744214799255133, -0.023908447474241257, -0.0789230540394783, 0.025990046560764313, 0.05167939513921738, 0.052631180733442307, -0.044488660991191864, 0.02518058940768242, -0.06361031532287598, -0.03268171474337578, 0.02962145395576954, 0.052810367196798325, -0.018562084063887596, 0.038136932998895645, 0.0871744304895401, -0.10581840574741364, 0.0056328242644667625, -0.021933993324637413, 0.01619461365044117, 0.009331678040325642, 0.010844576172530651, -0.01852686144411564, 0.06909677386283875, -0.016778873279690742, -0.06532517075538635, 0.0015315019991248846, 0.021747130900621414, 0.03853515163064003, -0.018018942326307297, 0.07421047985553741, 0.11052363365888596, -0.044134706258773804, -0.06497250497341156, 0.09085319936275482, -0.05711047723889351, 0.10840849578380585, 0.02088489569723606, 0.10298649221658707, 0.060939475893974304, -0.0190519317984581, 0.07103882730007172, 0.04817931354045868, -0.0036078316625207663, -0.025805458426475525, 0.031990788877010345, 7.34566492610611e-05, 0.005384197924286127, -0.06869956105947495, 0.018038133159279823, -0.05764815956354141, 5.765510692641415e-33, -0.035462070256471634, -0.018378490582108498, -0.05031954124569893, -0.007868096232414246, -0.016670754179358482, 0.05062378942966461, 0.014314744621515274, -0.043374013155698776, -0.026221591979265213, -0.02441105619072914, -0.06095026433467865, -0.10462276637554169, -0.04966520145535469, 0.055111080408096313, 0.003558321623131633, -0.06117665767669678, -0.0031035756692290306, 0.03650392219424248, -0.03577745333313942, -0.06420818716287613, 0.009655462577939034, 0.056077856570482254, -0.021696632727980614, -0.0805344507098198, -0.01682092249393463, -0.08914700895547867, -0.03515676036477089, -0.11072315275669098, -0.011655490845441818, 0.03938886523246765, -0.026238903403282166, 0.00264452351257205, -0.014863262884318829, 0.0427081361413002, -0.047268096357584, 0.016921991482377052, 0.026294978335499763, 0.004124991595745087, -0.023117348551750183, -0.07145227491855621, -0.012830291874706745, 0.08248058706521988, 0.022904282435774803, -0.05858011916279793, -0.05208338797092438, -0.07954829186201096, 0.09030257165431976, 0.10240717977285385, -0.06572030484676361, -0.01877189427614212, 0.02897047810256481, 0.031553708016872406, 0.006766576319932938, -0.09868372976779938, -0.04673400893807411, -0.0270366370677948, 0.05511889234185219, 0.04609329253435135, 0.010965393856167793, 0.14434164762496948, -0.053723037242889404, 0.006142438855022192, -0.0660012811422348, 0.013939537107944489, -0.0031024152413010597, 0.020664164796471596, 0.0011493366910144687, 0.010183429345488548, 0.06415090709924698, 0.07905420660972595, -0.07430913299322128, 0.03529728576540947, 0.05534449964761734, -0.0559517927467823, -0.022624870762228966, -0.0759425163269043, 0.0683317482471466, -0.05259523540735245, -0.0935647040605545, -0.05548812076449394, -0.05402473360300064, 0.09777279943227768, -0.017526278272271156, -0.0621832013130188, -0.07250025123357773, -0.10280999541282654, -0.013663781806826591, -0.06630279123783112, -0.07351312041282654, -0.03899678960442543, -0.04831526055932045, -0.07887276262044907, 0.12362751364707947, -0.011697804555296898, -0.057634755969047546, -4.5633564972844625e-33, 0.0055810147896409035, 0.072838693857193, 0.044918470084667206, 0.038749516010284424, -0.014543429017066956, 0.04085404798388481, 0.08709482103586197, 0.00523015670478344, -0.03434549644589424, -0.08980754017829895, -0.00828320998698473, 0.008003699593245983, 0.0074156345799565315, 0.0033675411250442266, 0.05208174139261246, -0.04761442542076111, -0.07434742152690887, 0.011636313982307911, -0.01929393783211708, -0.011178131215274334, -0.0012209058040753007, 0.13913822174072266, 0.09084533154964447, 0.04956740885972977, -0.013599460944533348, 0.04538969323039055, -0.01608928292989731, 0.02439543418586254, 0.012273594737052917, -2.598214450699743e-05, -0.0069442084059119225, -0.04705871641635895, -0.06524074077606201, 0.10158985108137131, 0.025632895529270172, -0.024832988157868385, 0.015472770668566227, -0.0028945119120180607, 0.006909070070832968, 0.03638334944844246, 0.10761161893606186, 0.04066033661365509, -0.08614851534366608, 0.031241558492183685, -0.016549546271562576, 0.02832815982401371, 0.03720764070749283, -0.03837013617157936, -0.012275607325136662, -0.04301803931593895, -0.07475844770669937, -0.038285110145807266, -0.043157752603292465, 0.07374665141105652, 0.030706947669386864, -0.008089950308203697, -0.08407781273126602, 0.01302250288426876, 0.0453154593706131, -0.05269678682088852, -0.06755106896162033, -0.059849269688129425, 0.028257668018341064, -0.027333350852131844, 0.10716363042593002, -0.0013295208336785436, -0.06255034357309341, 0.01932692341506481, -0.014755765907466412, 0.10441553592681885, -0.01713527925312519, 0.05320173129439354, -0.022082390263676643, -0.03210502862930298, -0.04070765897631645, -0.0277548860758543, 0.036564476788043976, -0.03120448626577854, 0.0030774646438658237, 0.0064276475459337234, -0.1278122067451477, 0.015928907319903374, 0.03538617119193077, 0.09409582614898682, 0.01966364122927189, 0.023776698857545853, 0.008660427294671535, 0.06388450413942337, 0.06211485713720322, -0.016560189425945282, -0.0008546803728677332, 0.03344517573714256, 0.11157940328121185, 0.050174862146377563, 0.05072799324989319, -4.0589156924397685e-08, 0.001161054358817637, -0.05760021507740021, -0.026967735961079597, 0.047067806124687195, 0.08612170815467834, -0.08238768577575684, 0.004002904985100031, 0.09070519357919693, -0.037529755383729935, -0.012364005669951439, 0.04621228203177452, -0.020687229931354523, -0.02748902700841427, -0.06124461814761162, -0.019902924075722694, 0.07108479738235474, -0.04302450269460678, -0.022812623530626297, -0.024897802621126175, -0.0632672980427742, -0.03341679647564888, -0.024786463007330894, -0.04668314382433891, 0.09325924515724182, -0.03758571669459343, -0.07685288786888123, -0.02076445147395134, -0.03751663118600845, 0.09019723534584045, 0.012686559930443764, -0.0574692003428936, -0.04467092826962471, 0.0812959223985672, 0.011919702403247356, 0.017832888290286064, 0.0008766521932557225, -0.055150602012872696, 0.0787460058927536, -0.012061052955687046, 0.0006199921481311321, -0.0784904882311821, 0.06911738216876984, 0.06376992911100388, -0.00375356525182724, 0.07237567752599716, -0.021204259246587753, -0.0005417651263996959, -0.00576968677341938, -0.018810167908668518, -0.013791954144835472, -0.010982091538608074, 0.034879833459854126, 0.06271453946828842, 0.05058632045984268, 0.02495005540549755, -0.06825178861618042, -0.08185438066720963, 0.054550256580114365, 0.012721299193799496, 0.026772048324346542, 0.02188883349299431, 0.039789702743291855, 0.0050555020570755005, -0.015740839764475822 ] }, { "text": "(31): ReLU(inplace=True)\n (32): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (33): ReLU(inplace=True)\n (34): Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n (35): ReLU(inplace=True)\n (36): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n )", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_16", "embedding": [ 0.0022684535942971706, -0.0029053993057459593, -0.02916048653423786, -0.059165094047784805, 0.05922211334109306, -0.1467042863368988, -0.017393717542290688, 0.028086628764867783, -0.06381765007972717, -0.07666116207838058, 0.03537426516413689, 0.008355973288416862, -0.0166943296790123, 0.00981089472770691, -0.056951772421598434, 0.007657016161829233, -0.02681916020810604, 0.04514670744538307, -0.03285503759980202, -0.03572051227092743, 0.08506425470113754, -0.0060872770845890045, -0.04495657607913017, -0.028007490560412407, 0.011675531975924969, 0.04578009992837906, -0.023937148973345757, 0.03630603477358818, 0.025586485862731934, -0.09785644710063934, 0.0669160783290863, 0.09769481420516968, -0.08804598450660706, 0.009659549221396446, 0.02902989462018013, 0.017516078427433968, -0.03882486745715141, -0.04831479862332344, -0.03749600797891617, -0.02964455634355545, 0.009137533605098724, -0.012056357227265835, -0.002673014998435974, 0.0644739493727684, 0.03754875436425209, 0.12019981443881989, 0.01921134442090988, 0.026691662147641182, 0.08630825579166412, -0.05872024595737457, -0.00953458808362484, 0.03959497809410095, 0.022037213668227196, 0.02737503871321678, -0.00014855868357699364, 0.020371362566947937, -0.07490461319684982, -0.008841424249112606, 0.029298990964889526, 0.02006606012582779, 0.06716781109571457, -0.006718314718455076, 0.04002499580383301, 0.042742833495140076, 0.0002588774368632585, -0.11425313353538513, 0.010432712733745575, -0.03835142403841019, -0.027235545217990875, 0.08398978412151337, 0.008922151289880276, 0.09817318618297577, -0.04093645140528679, -0.03027135692536831, 0.06609757989645004, 0.0006659184582531452, -0.00020815295283682644, -0.003853738075122237, -0.02458018623292446, -0.07464930415153503, 0.020219361409544945, 0.031249139457941055, 0.05572030693292618, -0.027733026072382927, 0.04478248953819275, -0.03315585106611252, -0.03763240948319435, 0.012339143082499504, 0.015417071990668774, -0.037768956273794174, 0.026590926572680473, 0.07425644993782043, -0.12087049335241318, 0.026215121150016785, -0.046370137482881546, 0.014777891337871552, 0.00657080952078104, 0.005966331344097853, -0.05392831563949585, 0.04066155105829239, -0.03332146629691124, -0.07393605262041092, 0.018748024478554726, 0.05055383965373039, 0.0442066565155983, -0.040365394204854965, 0.06086135283112526, 0.12562929093837738, -0.053630996495485306, -0.04218919202685356, 0.10186520963907242, -0.037142302840948105, 0.09411224722862244, 0.006356468424201012, 0.11174818873405457, 0.0760069489479065, -0.01780732348561287, 0.06238231435418129, 0.04240145534276962, 0.005854323040693998, -0.05254550278186798, 0.052125997841358185, -0.03856224566698074, -0.022762488573789597, -0.07999082654714584, 0.038537006825208664, -0.04440948739647865, 6.620109412026619e-33, -0.007480332627892494, -0.04691580682992935, -0.050229959189891815, 0.02444097027182579, 0.00014568910410162061, 0.058073319494724274, 0.008577433414757252, -0.03225412964820862, -0.019769394770264626, -0.028119808062911034, -0.03572572022676468, -0.11635015904903412, -0.0601799339056015, 0.06644405424594879, -0.016753222793340683, -0.08692178875207901, -0.004918628837913275, 0.035631559789180756, -0.024158772081136703, -0.047158706933259964, 0.00844042282551527, 0.09318514913320541, -0.0350722000002861, -0.07332190871238708, 0.00500124366953969, -0.05809364095330238, -0.048232220113277435, -0.09344369173049927, 0.019248224794864655, 0.0625310018658638, -0.021085789427161217, -0.006947276648133993, 0.0009254395845346153, 0.03443752974271774, -0.06951156258583069, 0.040747933089733124, -0.00938539206981659, 0.013386677950620651, -0.04682610556483269, -0.055756472051143646, -0.016359146684408188, 0.09045489132404327, 0.021361753344535828, -0.042854148894548416, -0.08620209991931915, -0.07858628779649734, 0.08393635600805283, 0.08025043457746506, -0.044303398579359055, -0.007538221310824156, 0.026527397334575653, 0.04701532796025276, -0.0003580492630135268, -0.09201063215732574, -0.010610620491206646, -0.05315890163183212, 0.05125640332698822, 0.046233370900154114, -0.0017596613615751266, 0.10894092172384262, -0.03642825409770012, 0.021111946552991867, -0.08205077797174454, 0.018747124820947647, -0.004652063362300396, -0.004187980201095343, 0.024778228253126144, 0.013269941322505474, 0.011019629426300526, 0.06582934409379959, -0.08065298944711685, 0.034273337572813034, 0.035281650722026825, -0.019783498719334602, -0.023155679926276207, -0.08476850390434265, 0.04952513054013252, -0.05690670758485794, -0.07088596373796463, -0.04642747715115547, -0.03518669307231903, 0.07834634184837341, 0.004860695451498032, -0.051484137773513794, -0.07593173533678055, -0.08806806057691574, -0.0003530152316670865, -0.04536709934473038, -0.029136398807168007, -0.04785306006669998, -0.033855874091386795, -0.06999941915273666, 0.13811399042606354, -0.051810987293720245, -0.05237381532788277, -5.8650563297148464e-33, -0.0031730341725051403, 0.05916007235646248, 0.03772301599383354, 0.04425482451915741, -0.03618014231324196, 0.06973492354154587, 0.08143416792154312, 0.02921375259757042, -0.027517614886164665, -0.10060622543096542, 0.008496874012053013, 0.030249545350670815, -0.012733595445752144, 0.004298916086554527, 0.03715309128165245, -0.05043578892946243, -0.09998992085456848, -0.005767626687884331, -0.02158627286553383, -0.0029119588434696198, -0.0066997092217206955, 0.1167060062289238, 0.13302043080329895, 0.05523001030087471, 0.0021255819592624903, 0.0015326777938753366, -0.015492190606892109, 0.012085066176950932, 0.009842571802437305, -0.016444195061922073, -0.017270425334572792, -0.019365759566426277, -0.06440579891204834, 0.09282386302947998, 0.010372991673648357, -0.04193993657827377, -0.003958727233111858, 0.01009681262075901, 0.0066963606514036655, 0.007905625738203526, 0.09896770119667053, 0.040985893458127975, -0.08597398549318314, 0.04114028438925743, -0.026661669835448265, 0.012458963319659233, 0.056299179792404175, -0.05400807783007622, -0.008276784792542458, -0.027723193168640137, -0.09735362231731415, -0.050143659114837646, -0.03106856904923916, 0.06908180564641953, 0.044847965240478516, -0.020573394373059273, -0.06258530169725418, 0.03310990706086159, 0.024266302585601807, -0.03030448593199253, -0.03237651661038399, -0.059405066072940826, 0.02041669562458992, -0.0795832946896553, 0.09077188372612, -0.0037201782688498497, -0.08751581609249115, 0.053587570786476135, -0.01839328370988369, 0.08410580456256866, -0.00948103703558445, 0.040780194103717804, -0.02268962562084198, -0.01617066189646721, -0.061612553894519806, -0.05147524178028107, 0.026838021352887154, -0.023202205076813698, 0.03628697991371155, 0.012631657533347607, -0.12447908520698547, 0.0315123125910759, 0.047664690762758255, 0.08727273344993591, 0.05854460224509239, 0.004051513038575649, -0.0112666180357337, 0.060340531170368195, 0.0375949926674366, -0.0063417148776352406, 0.0004954154719598591, 0.026854410767555237, 0.09660233557224274, 0.06977933645248413, 0.05356297269463539, -4.581653456625645e-08, 1.1561010069272015e-05, -0.04422308877110481, -0.019570114091038704, 0.03748990222811699, 0.06155659630894661, -0.07232604920864105, 0.007246729917824268, 0.09659213572740555, -0.013373695313930511, -0.004468583967536688, 0.012854906730353832, -0.01188665721565485, -0.01833292655646801, -0.07580217719078064, 0.00810896698385477, 0.08048593252897263, -0.006994547322392464, 0.011271705850958824, -0.017586788162589073, -0.06127685308456421, -0.03996797278523445, -0.035199835896492004, -0.03601047024130821, 0.08650340139865875, -0.04041409119963646, -0.06419528275728226, -0.012742120772600174, -0.04832268878817558, 0.07180996239185333, -0.038236312568187714, -0.054673224687576294, -0.03919052332639694, 0.05263834819197655, 0.00015773178893141448, 0.009356305003166199, 0.02428697794675827, -0.055723194032907486, 0.08842220157384872, -0.0028956541791558266, -0.006663674023002386, -0.0704345554113388, 0.05398525670170784, 0.07972818613052368, -0.01805678941309452, 0.06031128019094467, -0.010124105960130692, 0.02876344509422779, 0.013231988064944744, -0.05409082770347595, -0.010740287601947784, -0.007859952747821808, 0.04307389259338379, 0.05022319033741951, 0.051063116639852524, 0.012120989151299, -0.07681415230035782, -0.08733443915843964, 0.08266071230173111, -0.02212272770702839, 0.014673946425318718, 0.013856705278158188, 0.04368607699871063, 0.00997062399983406, -0.006518753245472908 ] }, { "text": "- Classifier of Vgg19:\n\n\n Sequential(\n (0): Linear(in_features=25088, out_features=4096, bias=True)\n (1): ReLU(inplace=True)\n (2): Dropout(p=0.5, inplace=False)\n (3): Linear(in_features=4096, out_features=4096, bias=True)\n (4): ReLU(inplace=True)\n (5): Dropout(p=0.5, inplace=False)\n (6): Linear(in_features=4096, out_features=1000, bias=True)\n )\n \n- How to use cuda?\n\n\n device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n vgg.to(device) \n\n- Load image with image path\n\n\n image = Image.open(img_path).convert('RGB')\n\n- Use tranformation to resize normalize and turn to tensor:", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_17", "embedding": [ -0.04181397706270218, -0.021119695156812668, -0.034679774194955826, 0.03245258331298828, 0.03487221151590347, -0.030003663152456284, -0.006051177624613047, 0.024396993219852448, -0.09672962129116058, -0.10680955648422241, 0.013504055328667164, -0.05236145481467247, -0.04949433356523514, -0.016581658273935318, -0.027995973825454712, -0.0093886349350214, 0.008348810486495495, 0.04570956155657768, -0.05134933441877365, -0.08407709747552872, 0.054991401731967926, -0.01108510047197342, 0.0047423215582966805, -0.013605188578367233, 0.007347633596509695, -0.05150756612420082, 0.05569092184305191, -0.013091275468468666, 0.061679109930992126, -0.0561150386929512, 0.05063663795590401, 0.04999978467822075, -0.05754604935646057, 0.06367961317300797, 0.05329248681664467, -0.005206508561968803, -0.14266979694366455, -0.058131977915763855, -0.09815278649330139, -0.019011113792657852, 0.040705177932977676, -0.030488932505249977, -0.017046580091118813, -0.025505708530545235, 0.038272831588983536, 0.02458612434566021, 0.07650072127580643, 0.010359039530158043, 0.05180864781141281, -0.09458286315202713, 0.021307310089468956, 0.008504682220518589, -0.0719815120100975, 0.07085666805505753, -0.024269433692097664, -0.01823516935110092, 0.057578813284635544, -0.12919119000434875, 0.03463740646839142, -0.07615023106336594, 0.048647698014974594, -0.018369467929005623, -0.03612659126520157, 0.011278626509010792, -0.03478653356432915, -0.011767278425395489, 0.04901302978396416, -0.05908224731683731, 0.04657238721847534, -0.008780330419540405, 0.02202601358294487, 0.05660497769713402, 0.013625574298202991, 0.027649611234664917, -0.04990895465016365, -0.003076104214414954, 0.0908115953207016, 0.02718181163072586, 0.07792570441961288, -0.05350739136338234, 0.0016420752508565784, 0.003225845517590642, 0.09478222578763962, -0.009672070853412151, 0.10640189796686172, -0.06561138480901718, 0.016021186485886574, 0.06019265577197075, 0.0024323828984051943, -0.045754581689834595, 0.02628663182258606, 0.04666942358016968, -0.04573848843574524, 0.057825967669487, 0.00958071369677782, -0.029526229947805405, 0.034945297986269, -0.07732552289962769, -0.05600198730826378, 0.05794643610715866, -0.01823420450091362, -0.03255448862910271, -0.012852455489337444, 0.07237496227025986, 0.016064275056123734, 0.054318320006132126, -0.0015859956620261073, 0.08025827258825302, -0.03305757790803909, -0.0010553608881309628, 0.031333379447460175, 0.05675375089049339, 0.016509991139173508, -0.012278336100280285, 0.10006668418645859, 0.0279692355543375, -0.05880114808678627, 0.06689348816871643, -0.011033988557755947, 0.003693351987749338, -0.04036968946456909, 0.03798500820994377, -0.06291384994983673, -0.03486672416329384, -0.07585232704877853, -0.030456362292170525, -0.048305120319128036, 6.653274515767131e-33, -0.057859111577272415, -0.0049600726924836636, -0.031216947361826897, -0.05630244314670563, 0.001809383975341916, 0.05444582924246788, 0.0361461378633976, -0.017320891842246056, -0.060072049498558044, 0.042460400611162186, -0.0606144443154335, 0.00883638858795166, -0.04796339571475983, 0.08817528188228607, -0.029281388968229294, -0.03212278336286545, 0.02981201931834221, 0.06692997366189957, 0.038804300129413605, 0.01853807456791401, 0.01899656467139721, 0.021424178034067154, -0.036270417273044586, -0.03968043997883797, -0.05407705530524254, 0.01639985665678978, -0.07743991166353226, -0.006292310543358326, -0.0017681131139397621, 0.009445113129913807, -0.027550116181373596, -0.008699430152773857, 0.038651324808597565, -0.011074240319430828, -0.021259797737002373, -0.060193564742803574, 0.01294663641601801, 0.013737768866121769, 0.03423692286014557, -0.026705335825681686, 0.009526736102998257, 0.08542583137750626, -0.011629616841673851, -0.10676760971546173, -0.06131116673350334, -0.0015089085791260004, -0.012323412112891674, 0.04920735955238342, -0.047509245574474335, 0.02274440787732601, -0.00560299726203084, -0.02339639700949192, -0.026197383180260658, -0.02227168343961239, 0.016628071665763855, -0.061385877430438995, 0.08991838246583939, 0.08509766310453415, 0.12162607908248901, -0.035435937345027924, 0.04652271047234535, 0.042515840381383896, -0.01949235238134861, 0.02309250831604004, -0.004704423248767853, -0.008717847988009453, 0.009545156732201576, 0.025703420862555504, -0.07512353360652924, 0.002937892684713006, -0.0846981555223465, 0.09029825776815414, -0.0848233699798584, -0.1145906150341034, 0.043053191155195236, -0.07938279956579208, 0.003990571480244398, -0.09023462235927582, -0.14064890146255493, 0.0007440253393724561, -0.0696026012301445, 0.10940078645944595, 0.018886616453528404, -0.12221068888902664, -0.0721130520105362, -0.05351278930902481, -0.01962929219007492, -0.019168589264154434, -0.01182904839515686, -0.0264416616410017, -0.06333427876234055, -0.03592939302325249, 0.06966041773557663, 0.01038694754242897, -0.04089855030179024, -5.180361727087573e-33, 0.02103758230805397, 0.07708398997783661, 0.044516582041978836, 0.043941058218479156, 0.008370636962354183, 0.004289049655199051, 0.08452336490154266, -0.0057784030213952065, -0.015706483274698257, -0.04983505979180336, 0.07777488976716995, -0.05420796945691109, -0.050592802464962006, -0.04998679459095001, 0.03601118177175522, -0.0007248682668432593, -0.09107198566198349, 0.015062679536640644, -0.06222580000758171, 0.03950995206832886, -0.06960494816303253, 0.08609513193368912, -0.04398219287395477, 0.014808662235736847, -0.09415654093027115, 0.020684512332081795, 0.039494678378105164, 0.01460797619074583, 0.02945874072611332, -0.04275504872202873, -0.0008032954065129161, -0.002599539700895548, -0.06164129823446274, 0.06671711057424545, 0.026796787977218628, 0.0010048578260466456, 0.10859865695238113, 0.0015373204369097948, 0.0035398995969444513, 0.07710964232683182, 0.14732494950294495, 0.10033377259969711, -0.0699695497751236, 0.04747030511498451, -0.07061517238616943, 0.037123411893844604, 0.023444324731826782, 0.0383014939725399, 0.009441704489290714, 0.03409497067332268, 0.02414759062230587, -0.021631324663758278, -0.0400811992585659, 0.12214972078800201, -0.001858532545156777, 0.046588681638240814, 0.051930151879787445, -0.008467543870210648, -0.003410202683880925, -0.0038784181233495474, -0.012940744869410992, -0.11239026486873627, -0.012481591664254665, -0.08197661489248276, 0.026727357879281044, 0.003748469753190875, -0.07819308340549469, 0.12017175555229187, 0.01728687807917595, 0.02751973457634449, -0.05021288990974426, 0.06260601431131363, 0.047633931040763855, -0.03757549822330475, -0.0371122807264328, 0.0279124416410923, -0.0035458868369460106, -0.014440325088799, 0.09542092680931091, -0.036016520112752914, -0.04364077001810074, -0.05427898094058037, 0.05633540078997612, 0.06233019009232521, 0.043108873069286346, 0.07285309582948685, 0.009649076499044895, 0.031712401658296585, 0.10202175378799438, -0.024893339723348618, -0.05217832699418068, -0.039213284850120544, 0.10335691273212433, 0.0763963833451271, 0.07351070642471313, -4.8566466404054154e-08, -0.0026392361614853144, -0.028889130800962448, 0.024048980325460434, 0.022851604968309402, -0.030570771545171738, -0.04576846584677696, 0.0358346588909626, 0.022392312064766884, 0.018731586635112762, -0.005269278772175312, 0.034023694694042206, 0.004443738143891096, -0.003819688456133008, -0.00856496300548315, 0.007393667474389076, 0.13464944064617157, 0.028656713664531708, 0.02597009390592575, 0.0796886757016182, -0.012828504666686058, -0.006742055993527174, -0.0814567357301712, 0.0010848380625247955, 0.040071260184049606, -0.07407744228839874, -0.053362488746643066, -0.02007877267897129, 0.04405229166150093, 0.0033662323839962482, -0.00249174190685153, -0.021987780928611755, -0.02524680644273758, 0.028475604951381683, 0.0339609831571579, 0.08540787547826767, 0.05359121412038803, -0.00023551036429125816, 0.009727882221341133, 0.06588595360517502, 0.006752613000571728, -0.040784940123558044, -0.006012531463056803, -0.017643943428993225, -0.06411954015493393, 0.006573366466909647, -0.016619697213172913, 0.012517603114247322, -0.02479734644293785, -0.04247544705867767, 0.08793433010578156, -0.03658365458250046, 0.03054804913699627, -0.049879398196935654, 0.07190946489572525, 0.05552823469042778, -0.05521910637617111, 0.008999545127153397, -0.016053006052970886, -0.03925522044301033, 0.03543666750192642, 0.007916047237813473, -0.009554128162562847, -0.04095415025949478, -0.06771177053451538 ] }, { "text": "- Load image with image path\n\n\n image = Image.open(img_path).convert('RGB')\n\n- Use tranformation to resize normalize and turn to tensor:\n\n\n transforms.Compose([\n transforms.Resize(size),\n transforms.ToTensor(),\n transforms.Normalize((0.485, 0.456, 0.406), \n (0.229, 0.224, 0.225))])\n\n \n # discard the transparent, alpha channel (that's the :3) and add the batch dimension\n image = in_transform(image)[:3,:,:].unsqueeze(0)\n \n \n- Load both style and content image. They may have different shapes. Use content image hegiht and weight for style image.", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_18", "embedding": [ 0.03430642560124397, 0.0010195510694757104, -0.014688343740999699, 0.019847076386213303, 0.001335090259090066, -0.05236850678920746, -0.002096974989399314, 0.023424530401825905, -0.12719450891017914, -0.06357844918966293, -0.043918222188949585, 0.00017004973778966814, 0.013466613367199898, 0.03855588287115097, 0.033594850450754166, 0.02082243748009205, -0.058481138199567795, 0.06315644085407257, -0.055430784821510315, -0.035064466297626495, 0.0003620028728619218, -0.017567772418260574, 0.03390282392501831, -0.057704780250787735, 0.020574472844600677, -0.011038842611014843, 0.07576186209917068, -0.03804083541035652, 0.045758023858070374, -0.04342808574438095, 0.03665946051478386, -0.024536704644560814, 0.03121441788971424, 0.02765609137713909, 0.006813840474933386, 0.033647239208221436, -0.013747937977313995, -0.050730884075164795, 0.022671375423669815, 0.01794644072651863, 0.07978180050849915, 0.022140972316265106, -0.02611098624765873, -0.0494394525885582, -0.03449957072734833, 0.031874485313892365, -0.014164929278194904, 0.011369369924068451, 0.09178225696086884, -0.07371136546134949, 0.02538738213479519, -0.04033816233277321, -0.0844142884016037, 0.03718502074480057, -0.06200769171118736, 0.022794298827648163, 0.07173778861761093, -0.06154420226812363, -0.045466188341379166, -0.052781857550144196, -0.023458031937479973, 0.0471641980111599, -0.012247547507286072, 0.006598416715860367, 0.01919962465763092, 0.008274143561720848, -0.02713879942893982, -0.06537667661905289, 0.026810642331838608, -0.05744482949376106, 0.0328555628657341, -0.01172407902777195, 0.026793308556079865, 0.02009609341621399, -0.03513508290052414, -0.04444843903183937, 0.11222568899393082, 0.03932724893093109, -0.012608909979462624, 0.009791290387511253, 6.389265035977587e-05, -0.05491143837571144, 0.08821364492177963, 0.034127648919820786, 0.03029290772974491, 0.015905624255537987, -0.0624699629843235, -0.005768547300249338, -0.02610693871974945, 0.024183526635169983, 0.0249674990773201, 0.0803455263376236, -0.12156929820775986, 0.04568850249052048, 0.04547686502337456, 0.0007801982574164867, 0.015976877883076668, -0.06247657909989357, -0.010164393112063408, 0.02169397845864296, 0.049401700496673584, -0.05960529297590256, 0.03520854935050011, 0.05877393111586571, 0.021100731566548347, 0.07844549417495728, 0.026377949863672256, 0.056956663727760315, 0.0072078583762049675, -0.03777538985013962, 0.02697158418595791, -0.04298090562224388, 0.016476524993777275, -0.011013036593794823, 0.06943155825138092, 0.018569638952612877, -0.028283514082431793, 0.05837048217654228, -0.028264230117201805, -0.02099747210741043, 0.033644434064626694, 0.09256796538829803, 0.00031886546639725566, -0.00979130994528532, -0.08356425166130066, -0.024827277287840843, -0.05164607614278793, 2.0637871464058735e-33, -0.021106939762830734, 0.026996109634637833, -0.016274331137537956, -0.01207058783620596, 0.007446716073900461, 0.13124790787696838, -0.012064148671925068, -0.10119172185659409, -0.08524564653635025, -0.04813273623585701, -0.05901293829083443, -0.0005930253537371755, -0.06949082016944885, 0.08694551885128021, -0.07034958153963089, -0.03131592273712158, -0.005684070289134979, 0.07187286019325256, 0.048961807042360306, 0.04275435954332352, 0.05871782824397087, 0.037746597081422806, -0.008359953761100769, 0.04057627171278, -0.08472621440887451, -0.08395852893590927, -0.031055809929966927, -0.0019832535181194544, -0.011727800592780113, -0.01915203034877777, -0.034025177359580994, -0.023584887385368347, -0.01803012378513813, 0.01792866922914982, -0.09493625909090042, -0.05070970579981804, 0.011910821311175823, 0.0403379388153553, -0.05916430056095123, -0.02016490139067173, 0.060124531388282776, 0.08867265284061432, 0.04746176674962044, -0.03567177802324295, -0.0997781902551651, 0.06083636358380318, 0.05803549662232399, 0.054017193615436554, 0.03441232442855835, -0.025095922872424126, 0.051931560039520264, -0.03795982897281647, 0.02781050093472004, -0.05982275307178497, 0.007289864122867584, -0.10432694107294083, 0.0991070345044136, 0.0663277879357338, 0.09459773451089859, -0.1243724599480629, 0.10888893157243729, 0.06302785128355026, 0.03425313159823418, 0.04031946137547493, 0.07430724054574966, 0.014255176298320293, 0.045267652720212936, -0.01277179829776287, -0.09917723387479782, 0.013468403369188309, -0.03431368246674538, 0.11306746304035187, -0.015011045150458813, -0.06185391917824745, -0.0006860441062599421, -0.08681283891201019, 0.03531191498041153, -0.041014574468135834, -0.01691681146621704, 0.04792938381433487, -0.09720459580421448, 0.051820725202560425, 0.03696736320853233, -0.15117482841014862, -0.09952063113451004, 0.041023414582014084, 0.07403276860713959, 0.006466673221439123, 0.035279642790555954, -0.10140162706375122, 0.00812425184994936, 0.002708279760554433, 0.016077181324362755, 0.04746415466070175, -0.03470733016729355, -8.34823506491015e-34, 0.015815118327736855, 0.0374317467212677, 0.00963747501373291, 0.0201053936034441, -0.01806078478693962, 0.0028430342208594084, 0.06580115854740143, 0.11889857798814774, 0.028223184868693352, -0.038062985986471176, 0.07885843515396118, 0.026187404990196228, -0.0986490249633789, -0.1122099906206131, 0.04334293305873871, -0.11843244731426239, 0.02165641076862812, 0.07964291423559189, -0.06830479949712753, -0.03723585978150368, -0.07962628453969955, 0.03852809965610504, -0.053571414202451706, 0.05078135058283806, -0.07045270502567291, 0.042444970458745956, 0.0073363520205020905, 0.004781681578606367, -0.04336150735616684, 0.01522203627973795, 0.01159440167248249, 0.008884662762284279, 0.030557898804545403, 0.02913130261003971, -0.010193223133683205, 0.004434992093592882, 0.053474411368370056, 0.013170610181987286, -0.020743975415825844, -0.05406072735786438, 0.012368608266115189, 0.04673321172595024, -0.050329405814409256, 0.04477029666304588, -0.043182630091905594, 0.03151075541973114, -0.006036936771124601, -0.0012240356300026178, 0.006732613313943148, 0.05778096616268158, 0.023108376190066338, -0.066769078373909, 0.022466575726866722, 0.055497653782367706, 0.008468030951917171, 0.0005601689917966723, -0.044216547161340714, 0.00800319854170084, 0.06139998137950897, -0.016742592677474022, -0.042829256504774094, -0.04714343324303627, -0.05130797624588013, -0.12889204919338226, -0.027143165469169617, 0.014389952644705772, -0.07669905573129654, 0.008175156079232693, -0.006749691441655159, 0.07597621530294418, -0.005290458910167217, 0.03535965085029602, 0.0585830882191658, 0.08266300708055496, 0.05492881312966347, -0.024899955838918686, 0.022643595933914185, 0.043412018567323685, 0.016994308680295944, 0.026078632101416588, -0.029216298833489418, -0.011869627051055431, 0.008614919148385525, 0.10358597338199615, 0.09536457806825638, 0.06742826104164124, 0.01988152600824833, 0.039016954600811005, 0.0422060526907444, 0.01133765373378992, -0.02961374819278717, -0.0007804369670338929, 0.0809633657336235, 0.06550773978233337, 0.11817032098770142, -4.721461266399274e-08, 0.01159922406077385, -0.020837198942899704, 0.04482029750943184, 0.008696019649505615, -0.0777229368686676, -0.006026367656886578, 0.05411485955119133, -0.041173964738845825, 0.0669412910938263, 0.006575666833668947, -0.04914770647883415, -0.024572597816586494, -0.015049341134727001, -0.005453695077449083, -0.034459907561540604, 0.040320295840501785, -0.022196786478161812, 0.047461967915296555, 0.0334663949906826, -0.04930340498685837, -0.05295637249946594, -0.07760975509881973, -0.014469755813479424, 0.05811403691768646, -0.04530787095427513, 0.012016057968139648, -0.04388856515288353, 0.008444726467132568, -0.004809926729649305, -0.045551810413599014, 0.01448502205312252, -0.0250123031437397, 0.06560800969600677, 0.03671193867921829, -0.05848073586821556, 0.027409113943576813, -0.029308900237083435, -0.04024602472782135, -0.07116684317588806, 0.01915437914431095, -0.03680885583162308, -0.04271953925490379, 0.06396577507257462, -0.0647502988576889, 0.03378240391612053, -0.04958126321434975, 0.04388567432761192, 0.0026663613971322775, -0.02820083498954773, 0.07656975835561752, 0.10454285144805908, -0.027858132496476173, -0.07154692709445953, 0.05815631523728371, 0.04820163920521736, -0.11590080708265305, -0.03878398984670639, 0.09109701961278915, 0.0009153223363682628, 0.045146338641643524, 0.004750024527311325, -0.020649421960115433, -0.017870770767331123, -0.08629042655229568 ] }, { "text": "style = load_image(path, shape=content.shape[-2:]).to(device)\n \n- Since we turn the image to tensor:\n\n\n print(content)\n \n tensor([[[[-1.8953, -1.9467, -1.9295, ..., -0.1999, -0.1999, -0.3027],\n [-1.9980, -2.0152, -1.9467, ..., -0.4568, -0.3369, -0.1657],\n [-1.9809, -1.9809, -1.9295, ..., -0.8164, -0.5596, -0.3027],\n ...,\n \n- If you want to see the image you should be turn it to numpy array, transpose, normalize it and clip the values, \nthen use plt.imshow(image) to see the image.", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_19", "embedding": [ 0.019153930246829987, 0.015593776479363441, 0.013999108225107193, -0.04884381964802742, 0.02640717662870884, -0.06471522152423859, -0.01864083670079708, 0.04975534975528717, -0.059705257415771484, -0.08434230834245682, -0.013205631636083126, -0.021006664261221886, -0.0028622872196137905, 0.0605781115591526, -0.03478619456291199, 0.004840671084821224, -0.08961889147758484, -0.019539617002010345, 0.05497107282280922, -0.03949437290430069, 0.006232054904103279, 0.06819715350866318, -0.00497608445584774, -0.07343566417694092, 0.003636446548625827, 0.03252512589097023, 0.0934489443898201, 0.03294527903199196, -0.012494477443397045, -0.007603867445141077, 0.034513406455516815, -0.007674119900912046, -0.009780037216842175, 0.042625173926353455, -0.010548434220254421, 0.01651512272655964, -0.013031158596277237, -0.04162738099694252, -0.00926179625093937, 0.02368449606001377, 0.06967538595199585, -0.030223315581679344, 0.022506628185510635, -0.057626619935035706, 0.01571180298924446, 0.021255388855934143, 0.014051038771867752, 0.015689866617321968, 0.11108729988336563, -0.0001046262914314866, 0.0010432521812617779, 0.016590284183621407, -0.10700041800737381, 0.02786402963101864, -0.016811197623610497, -0.012798571027815342, 0.08408934623003006, -0.08436610549688339, -0.013804330490529537, -0.05024820938706398, 0.03353136032819748, 0.05367957055568695, -0.004260661080479622, -0.03624327480792999, 0.0360485315322876, -0.03186213970184326, -0.004015943501144648, -0.0800786018371582, 0.014322678558528423, -0.06258291006088257, 0.03862571716308594, -0.014279496856033802, 0.023883052170276642, -0.033906590193510056, -0.060497209429740906, -0.0794747844338417, 0.10423289984464645, 0.025623207911849022, 0.025678038597106934, -0.04428953304886818, 0.011049184948205948, 0.0005440743989311159, 0.09853480756282806, 0.06555712223052979, -0.00978561770170927, -0.010234004817903042, -0.03325429931282997, 0.05229918658733368, 0.003728566225618124, -0.010377513244748116, 0.04972393438220024, 0.046863920986652374, -0.14866161346435547, 0.039758648723363876, 0.06827586889266968, 0.03753001615405083, 0.022747471928596497, -0.0012264105025678873, -0.03208308666944504, 0.06276138126850128, 0.04077378660440445, -0.10212349891662598, -0.013680191710591316, 0.07056241482496262, 0.039170969277620316, 0.08408572524785995, 0.009628486819565296, -0.01580357924103737, -0.023484736680984497, -0.0032373149879276752, 0.002616649027913809, -0.010809704661369324, -0.049743831157684326, 0.007490275893360376, 0.08237385004758835, -0.07736221700906754, -0.09981940686702728, 0.1201821118593216, -0.006210935767740011, 0.016459932550787926, -0.005351507104933262, 0.01760871708393097, -0.04982265084981918, 0.017682528123259544, -0.018067266792058945, -0.002521976362913847, -0.07359802722930908, -1.8068876314794628e-33, -0.042318981140851974, -0.018769891932606697, 0.07150039076805115, -0.05842037871479988, -0.03556413576006889, 0.042434245347976685, 0.0015777237713336945, -0.04274996370077133, -0.04883810132741928, 0.03400843217968941, -0.05775722861289978, 0.03215840458869934, -0.044015731662511826, 0.0915502980351448, -0.037202395498752594, -0.06480695307254791, 0.025176789611577988, -0.048145491629838943, 0.02594021148979664, 0.03582633659243584, 0.031094927340745926, -0.0354376845061779, 0.007936486043035984, 0.01694147102534771, -0.06691909581422806, -0.03145788237452507, -0.01913493685424328, -0.01159453485161066, 0.025188304483890533, -0.010060577653348446, -0.06941164284944534, -0.03867607191205025, 0.01428627222776413, -0.11598329246044159, -0.039455488324165344, -0.06652867794036865, 0.06525542587041855, 0.005659341346472502, -0.08221045881509781, -0.031855806708335876, 0.0011456727515906096, 0.05317007377743721, 0.035222116857767105, -0.07325796037912369, -0.049388136714696884, 0.049373775720596313, 0.01557016372680664, 0.10815988481044769, -0.045075200498104095, -0.00424590427428484, -0.028886178508400917, -0.07180438190698624, -0.007413710933178663, -0.03546188771724701, -0.04684280976653099, -0.11321384459733963, 0.023210065439343452, 0.018370788544416428, 0.028486549854278564, -0.10339217633008957, 0.07253896445035934, 0.05291841924190521, 0.05888006463646889, 0.06010226532816887, -0.00794659648090601, 0.00485296780243516, 0.05433376878499985, 0.009722511284053326, -0.026377227157354355, 0.11666478216648102, -0.06319913268089294, 0.09178149700164795, -0.011651994660496712, -0.10055091977119446, -0.011081734672188759, -0.005128825083374977, 0.060384053736925125, -0.03495616093277931, -0.03981636092066765, 0.007052298169583082, -0.048050250858068466, 0.04855642840266228, 0.05321013554930687, -0.15637797117233276, -0.06094641238451004, 0.031221594661474228, 0.026835329830646515, -0.08445276319980621, 0.030297962948679924, -0.059004046022892, -0.07851368188858032, 0.002561346860602498, -0.01750323362648487, 0.021617082878947258, -0.10227177292108536, 5.481118936243163e-34, 0.051320090889930725, 0.040165867656469345, 0.045086029917001724, -0.031044822186231613, -0.01449945941567421, -0.006239794660359621, 0.08307542651891708, 0.09652773290872574, 0.007904541678726673, 0.016283024102449417, 0.06805863976478577, 0.018085645511746407, -0.07268788665533066, -0.09359923005104065, 0.09637870639562607, -0.03075196035206318, -0.022728141397237778, 0.031068813055753708, -0.031013373285531998, -0.07358260452747345, -0.10195690393447876, 0.06115921214222908, 0.00894235074520111, 0.027548428624868393, -0.09629138559103012, 0.017263192683458328, 0.023127766326069832, -0.03911107778549194, -0.007582316640764475, -0.0401591919362545, -0.0406763032078743, -0.03368400037288666, 0.03446733206510544, 0.06925911456346512, 0.0423235259950161, 0.08950827270746231, 0.04490728676319122, -0.0011329726548865438, -0.004929313436150551, -0.005838911049067974, 0.045007385313510895, 0.08517507463693619, -0.03492698073387146, 0.08789923787117004, -0.07145199924707413, 0.02250337041914463, -0.016168124973773956, 0.06599811464548111, 0.020495116710662842, 0.02225271426141262, 0.02862350456416607, -0.05309949070215225, 0.012302001006901264, 0.048989538103342056, 0.007734071463346481, 0.06290055811405182, -0.07329748570919037, -0.021781306713819504, 0.025605738162994385, -0.014924069866538048, -0.015539762564003468, -0.09392955154180527, -0.11847873032093048, -0.07469256967306137, -0.015699850395321846, -0.020840195938944817, -0.07499437034130096, -0.0286908857524395, -0.04235832393169403, 0.05648641288280487, -0.028435135260224342, 0.04732344672083855, 0.06818605959415436, 0.027707280591130257, 0.007868659682571888, 0.01997079700231552, -0.03610115870833397, 0.04749390110373497, 0.02059108577668667, 0.02292841300368309, 0.0658230409026146, -0.04084915667772293, -0.007916978560388088, 0.07963912189006805, 0.09598785638809204, 0.01833195611834526, 0.005887501407414675, 0.0309909675270319, 0.07415840029716492, -0.005307195242494345, -0.017381131649017334, 0.001614771201275289, 0.012679551728069782, 0.0828697681427002, 0.05948151275515556, -5.540809766557686e-08, 0.04729936644434929, -0.05206434801220894, 0.09290751814842224, -0.046742405742406845, -0.032329995185136795, -0.012472023256123066, 0.10247822105884552, -0.02423788234591484, 0.04253845289349556, -0.029380669817328453, -0.0011637872084975243, -0.10147871822118759, -0.050355054438114166, 0.014480601996183395, 0.02679353579878807, 0.1031498834490776, 0.011064190417528152, 0.03041418455541134, 0.031216278672218323, -0.02434801682829857, -0.04461280629038811, -0.10558173060417175, -0.013415268622338772, 0.04725126177072525, -0.1062120720744133, 9.071184467757121e-05, -0.06785905361175537, -0.02206895500421524, 0.027986174449324608, 0.021261202171444893, 0.019910963252186775, -0.06649842113256454, 0.06725072115659714, -0.005162626039236784, -0.001706129522062838, 0.0416017547249794, -0.01843544840812683, -0.01343019399791956, -0.01045903004705906, 0.08756281435489655, -0.06667228788137436, 0.026151912286877632, 0.06435348093509674, -0.01561481598764658, 0.06846970319747925, -0.05726155266165733, 0.042472559958696365, -0.008878462016582489, -0.023651830852031708, 0.0741499736905098, 0.04422355443239212, -0.005262949503958225, -0.049039993435144424, 0.055043309926986694, 0.03020675666630268, -0.10816723108291626, -0.032577499747276306, 0.004571277182549238, -0.0005821649101562798, 0.07047539949417114, 0.024021344259381294, 0.024114634841680527, 0.019682327285408974, -0.06217670068144798 ] }, { "text": "image = tensor.to(\"cpu\").clone().detach()\n image = image.numpy().squeeze()\n image = image.transpose(1,2,0)\n image = image * np.array((0.229, 0.224, 0.225)) + np.array((0.485, 0.456, 0.406))\n image = image.clip(0, 1)\n \n \n- Select the layers you would like to use: {'0': conv1_1, '3': conv2_1 ...}\n\n- Take the input image. pass through each layer, store the output of the layer. If this layer is one of out layers, \nstore the output in features dictionary.", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_20", "embedding": [ 0.02223295159637928, 0.0018402972491458058, -0.01119970716536045, 0.020476585254073143, 0.08820583671331406, -0.09678923338651657, 0.015421823598444462, -0.058882080018520355, -0.0924440249800682, -0.05924046039581299, -0.00814694631844759, -0.009867367334663868, 0.015705563127994537, 0.040309496223926544, -0.030717063695192337, 0.01773201674222946, -0.046996135264635086, 0.0560341477394104, 0.006151519250124693, -0.07956184446811676, 0.022661935538053513, 0.006293787620961666, -0.007608243264257908, -0.016299434006214142, 0.05008483678102493, 0.013429876416921616, 0.021576499566435814, -0.03465397283434868, 0.01956051029264927, 0.029333580285310745, 0.015258961357176304, -0.049204789102077484, 0.0022629816085100174, 0.026541344821453094, 0.008238272741436958, 0.05767948180437088, -0.07290667295455933, -0.04634919762611389, 0.0066765230149030685, -0.026370201259851456, 0.06470682471990585, 0.004714522510766983, -0.022799743339419365, -0.10111632198095322, -0.004815359599888325, 0.08023383468389511, -0.028328264132142067, 0.04365113750100136, 0.10568647086620331, -0.017738379538059235, 0.03559700772166252, -0.00021049422502983361, -0.08331556618213654, 0.054039712995290756, -0.013340221717953682, 0.0038408380933105946, 0.09141123294830322, -0.05189303308725357, -0.1147780567407608, -0.012730793096125126, 0.020310644060373306, 0.028692098334431648, 0.015827927738428116, -0.025334568694233894, 0.09092146158218384, -0.0006065092165954411, -0.028331108391284943, 0.02480907179415226, 0.02036886103451252, -0.006897404789924622, -0.01817583665251732, 0.0453178770840168, 0.06805160641670227, -0.09248381108045578, -0.014022241346538067, -0.04897231608629227, 0.08919275552034378, 0.0064432076178491116, 0.003689110977575183, 0.031243931502103806, 0.01274179294705391, -0.03697912395000458, 0.03538360074162483, -0.02913013845682144, -0.007637296803295612, -0.06933458894491196, -0.03047473169863224, 0.04917526617646217, 0.017760489135980606, -0.06551683694124222, -0.04840464144945145, 0.021349582821130753, -0.006900293752551079, -0.0015713999746367335, 0.13418550789356232, 0.015734171494841576, 0.01604488305747509, -0.016234003007411957, -0.014813771471381187, 0.005452239420264959, -0.004600003361701965, -0.09260787069797516, -0.004026716575026512, 0.013165735639631748, 0.0560932531952858, 0.10586707293987274, 0.016858872026205063, -0.016233662143349648, -0.011024526320397854, -0.05618702992796898, 0.022878801450133324, 0.02502775937318802, 0.020737670361995697, -0.023072682321071625, 0.13216669857501984, -0.025386076420545578, -0.019386371597647667, 0.05018052086234093, 0.035605356097221375, 0.028419431298971176, -0.03627204895019531, 0.04032847285270691, 0.020693600177764893, -0.006557800807058811, 0.0008441045647487044, -0.015548222698271275, -0.03616076707839966, -3.8698977577523435e-34, -0.014724207110702991, 0.03452813997864723, -0.0032981429249048233, -0.006442458834499121, -0.007887385785579681, 0.08610929548740387, 0.06584221124649048, -0.03813911974430084, -0.04873121157288551, 0.004359647165983915, -0.0644238144159317, -0.008069128729403019, -0.012255757115781307, 0.07813077419996262, -0.05194869637489319, -0.08581441640853882, 0.06492263078689575, 0.0005880666431039572, 0.07729972898960114, 0.016115624457597733, 0.03390778601169586, 0.029498133808374405, -0.05971754342317581, 0.0680643618106842, -0.08242480456829071, -0.15110255777835846, -0.11830313503742218, -0.024950873106718063, -0.04183065518736839, -0.03142853081226349, -0.06229593977332115, 0.0033478967379778624, -0.03225566819310188, -0.02525133267045021, -0.0770353451371193, -0.06316625326871872, 0.050545018166303635, 0.05713355168700218, -0.024024222046136856, -0.02946207858622074, 0.06455513834953308, 0.09462062269449234, -0.02534031681716442, -0.028511669486761093, -0.051808182150125504, 0.025398187339305878, -0.04304802790284157, 0.03646104782819748, -0.016370315104722977, -0.04760214313864708, 0.021351153030991554, -0.0639428198337555, 0.001342782867141068, -0.0724431499838829, -0.025327619165182114, -0.08166448026895523, 0.08910869061946869, 0.0029692964162677526, 0.0985272005200386, -0.055676475167274475, 0.003468734212219715, 0.054562538862228394, -0.027850357815623283, 0.08146006613969803, 0.009234746918082237, 0.002683263272047043, 0.06020094081759453, 0.05905399098992348, -0.05943458154797554, 0.031208906322717667, -0.1370317041873932, 0.09306156635284424, -0.0851099044084549, -0.07590914517641068, -0.004756700247526169, -0.008830340579152107, 0.008072170428931713, -0.12473537027835846, -0.08402427285909653, -0.004651493392884731, 0.013239405117928982, 0.07522966712713242, -0.04505880922079086, -0.13783353567123413, -0.03134524077177048, 0.08310099691152573, -0.007768658921122551, -0.016015024855732918, 0.038710519671440125, -0.006914949044585228, -0.07146500051021576, 0.03481750935316086, -0.019297370687127113, -0.007491190917789936, -0.04519258067011833, -1.3473402602698564e-34, 0.06546863168478012, 0.032612599432468414, 0.04959005117416382, -0.010778991505503654, -0.02851186878979206, 0.02100946195423603, 0.04366721957921982, 0.03838476911187172, -0.030419213697314262, 0.0017857968341559172, -0.017072372138500214, -0.07300497591495514, -0.030089883133769035, -0.08400686830282211, -0.011888790875673294, -0.025637321174144745, -0.10547880083322525, 0.008444507606327534, 0.015600273385643959, 0.007832108996808529, -0.07922728359699249, 0.012466332875192165, 0.01814359426498413, 0.05028146877884865, -0.13670767843723297, 0.026984089985489845, -0.008539583534002304, 0.021185502409934998, 0.06157660856842995, -0.05630936473608017, -0.09291573613882065, 0.00254929275251925, 0.04413902759552002, 0.08613757789134979, 0.05063333734869957, 0.07110204547643661, -0.0034573685843497515, 0.007318921387195587, 0.004235059954226017, 0.005030593369156122, 0.008104388602077961, 0.022853435948491096, -0.05646274983882904, 0.03583700209856033, 0.0043903230689466, 0.008810000494122505, -0.03126762434840202, 0.018313568085432053, -0.012271800078451633, -0.009290816262364388, 0.019311074167490005, -0.036995790898799896, -0.08254575729370117, 0.05307627096772194, -0.017468946054577827, 0.02848736010491848, -0.05379460006952286, 0.011886795051395893, 0.12499535828828812, -0.04029511287808418, -0.023885108530521393, -0.1399800330400467, -0.035957567393779755, -0.03553690016269684, 0.028064383193850517, 0.02059401199221611, -0.08656962215900421, 0.08206066489219666, -0.060816243290901184, 0.09707573056221008, 0.002334380056709051, 0.05396835878491402, 0.07231869548559189, -0.017496919259428978, -0.04309724643826485, -0.022009843960404396, -0.026665382087230682, 0.03151704743504524, 0.01811523362994194, -0.0052843582816421986, -0.01208530180156231, -0.041688937693834305, -0.02313150465488434, 0.02529548667371273, 0.038282547146081924, 0.05248575285077095, 0.07524429261684418, -0.02459324710071087, 0.05907512083649635, -0.053478024899959564, -0.018664918839931488, -0.015188673511147499, 0.04121693596243858, -0.019400017336010933, 0.1093754917383194, -4.702043554516422e-08, 0.07870741933584213, 0.018190786242485046, 0.07172534614801407, 0.014130658470094204, -0.048722848296165466, 0.028492780402302742, 0.03655217960476875, 0.027212124317884445, 0.08674851059913635, 0.02627892792224884, -0.02800844982266426, -0.016297757625579834, 0.007375883404165506, -0.004510240629315376, 0.011717485263943672, 0.14268118143081665, -0.012426686473190784, 0.009217602200806141, 0.08498165011405945, -0.025907523930072784, 0.04936392977833748, -0.08932945877313614, -0.039484649896621704, 0.08064909279346466, -0.0797775387763977, -0.03250947222113609, -0.0032609382178634405, -0.025186628103256226, 0.0595853365957737, 0.0207525547593832, -0.052746571600437164, -0.06417606770992279, 0.07281767576932907, -0.035419829189777374, 0.10113430768251419, 0.025438163429498672, -0.049924567341804504, -0.05270101875066757, 0.02025442384183407, 0.024969326332211494, -0.07010285556316376, 0.002342459512874484, -0.019405953586101532, -0.05224331095814705, 0.04200094938278198, -0.040706634521484375, 0.037405889481306076, -0.011788335628807545, 0.018810652196407318, 0.07452701777219772, 0.05846216157078743, 0.015832288190722466, -0.0073842983692884445, 0.11580467969179153, -0.011039613746106625, -0.05022427439689636, -0.04299730807542801, 0.014170823618769646, 0.037301164120435715, 0.014048938639461994, 0.030084732919931412, 0.03676028177142143, 0.03529427945613861, -0.03994181379675865 ] }, { "text": "vgg._modules.items()\n odict_items([('0', Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))), ('1', ReLU(inplace=True)), \n \n name, layer in vgg._modules.items():\n \n name = '0'\n layer = Conv2d(3, 64, kernel_size=(3, 3)\n layers['0']= conv1_1 \n \n output = layer(input image)\n \n features = {layers['0']: [output..]}\n features = {'conv1_1': [output..]}\n \n- You can calculate, target, content and style features. \n\n- Calculate gram matrix", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_21", "embedding": [ 7.50123435864225e-05, 0.04264191538095474, -0.021238146349787712, 0.02651447243988514, 0.07124540209770203, -0.045714281499385834, 0.015306402929127216, 0.008923796005547047, -0.06671271473169327, -0.06244632229208946, 0.012429645285010338, -0.07047906517982483, -0.002646299544721842, -0.01972106285393238, -0.0057914783246815205, 0.01970808394253254, -0.015100974589586258, 0.15075720846652985, -0.006757465191185474, -0.10990992188453674, 0.03504687547683716, 0.059018924832344055, 0.06816181540489197, -0.06869164854288101, 0.040768202394247055, 0.09359145909547806, 0.008370989933609962, 0.055632442235946655, 0.06373617053031921, -0.03952974081039429, 0.02836756594479084, 0.039203811436891556, -0.013726742938160896, 0.09207644313573837, -0.03840182349085808, 0.05672527849674225, -0.08764073252677917, -0.030964411795139313, -0.0775969848036766, -0.016385970637202263, 0.06887306272983551, 0.0030012563802301884, -0.05172757804393768, -0.1149817556142807, 0.03991260379552841, 0.028872035443782806, -0.030397607013583183, 0.018469875678420067, 0.04768280312418938, 0.0037737044040113688, 0.0023906975984573364, -0.06549517810344696, -0.05397704616189003, 0.025970425456762314, 0.013091126456856728, -0.03365708887577057, -0.01083107478916645, -0.04130022972822189, 0.03341064229607582, 0.00022115495812613517, 0.03313233703374863, -0.04562322795391083, 0.004875770770013332, -0.011559410020709038, 0.013692677952349186, -0.029305027797818184, -0.0003004196041729301, 0.007683787494897842, 0.0015639547491446137, 0.01560916006565094, -0.04482926055788994, 0.05358495935797691, 0.0574173778295517, -0.023184776306152344, -0.027047283947467804, -0.0010623573325574398, 0.02288549579679966, 0.008563137613236904, 0.09654174000024796, -0.07151331752538681, 0.03164074197411537, 0.009927727282047272, 0.01160119753330946, 0.02297523245215416, 0.01894238591194153, -0.024744555354118347, -0.026694023981690407, 0.05674222856760025, -0.026368815451860428, -0.0604671873152256, -0.024303020909428596, -0.028143106028437614, -0.05799638107419014, -0.008457429707050323, 0.050845008343458176, -0.003396047977730632, 0.023382116109132767, -0.028606463223695755, -0.028998641297221184, 0.023755041882395744, -0.04506441205739975, -0.05473291501402855, 0.018463222309947014, 0.03572825714945793, 0.08248422294855118, 0.053004588931798935, -0.006749169901013374, 0.061922620981931686, -0.014005674049258232, -0.09198160469532013, 0.008090193383395672, -0.003584458725526929, -0.030525971204042435, -0.04486927390098572, 0.07337608188390732, -0.018762318417429924, 0.02038390561938286, 0.022738035768270493, 0.08115742355585098, -0.013789130374789238, 0.019590698182582855, -0.0010696551762521267, -0.017115142196416855, -0.07399608939886093, -0.06197234243154526, -0.04613141715526581, -0.06935373693704605, 4.062361539647973e-33, -0.043508704751729965, 0.023041045293211937, -0.04416685551404953, 0.02476879581809044, -0.013805662281811237, 0.03530958294868469, 0.015921209007501602, -0.07496959716081619, -0.031076084822416306, 0.03090941533446312, -0.06626756489276886, -0.026317501440644264, -0.04762991517782211, 0.08245232701301575, 0.022737136110663414, 0.005571724846959114, 0.004337822087109089, 0.0173044353723526, 0.004837958142161369, -0.01573326624929905, -0.007899852469563484, 0.009866454638540745, -0.001311332220211625, -0.02714027278125286, -0.06402290612459183, -0.10406515002250671, -0.06090419366955757, -0.07245057821273804, -0.041061777621507645, -0.028659796342253685, 0.021330004557967186, 0.03574991226196289, 0.046115942299366, 0.007641790900379419, -0.06359273195266724, -0.041035428643226624, 0.05389745905995369, -0.004446722101420164, 0.03351527824997902, -0.03926665708422661, -0.019894542172551155, 0.08093133568763733, 0.002273240825161338, -0.05531556159257889, -0.09677347540855408, 0.025358598679304123, 0.007249240297824144, 0.0846404880285263, 0.006849126890301704, 0.005801060236990452, 0.06229511275887489, 0.016549192368984222, -0.007180271670222282, -0.030216943472623825, -0.02106337808072567, -0.008066206239163876, 0.07475003600120544, 0.07819098234176636, 0.10468140989542007, -0.010944387875497341, 0.00041942051029764116, 0.08411244302988052, -0.005809969734400511, 0.06992072612047195, -0.012878923676908016, 0.007953748106956482, 0.0536099337041378, -0.0022302360739558935, -0.06188185140490532, 0.07545947283506393, -0.037658676505088806, 0.08346182107925415, -0.05031600594520569, -0.1079813539981842, 0.026994746178388596, -0.07109615206718445, -0.006683758459985256, -0.13261249661445618, -0.08430898934602737, 0.012634873390197754, -0.0020841246005147696, 0.09305445104837418, 0.003900759620591998, -0.11079442501068115, -0.04787363111972809, 0.015716008841991425, 0.0014695809222757816, -0.08096783608198166, -0.001672382582910359, -0.09017752856016159, -0.08563277870416641, -0.0006382030551321805, 0.021747946739196777, -0.04989701509475708, -0.03561856597661972, -3.718095243806619e-33, 0.059571728110313416, 0.15688474476337433, 0.049035996198654175, 0.059789542108774185, 0.008649385534226894, 0.00842808373272419, 0.05964798107743263, 0.03195410221815109, 0.031110398471355438, -0.01212461106479168, 0.04730328544974327, -0.00709948968142271, -0.03584534302353859, -0.059025995433330536, 0.05743739753961563, 0.004083240870386362, -0.16542145609855652, 0.009074960835278034, 0.02014750801026821, -0.05424255132675171, -0.0600135512650013, 0.06399362534284592, 0.030484400689601898, 0.05247725173830986, -0.10775705426931381, -0.00854567438364029, 0.05653797462582588, -0.020099133253097534, 0.005260302685201168, -0.03520875424146652, -0.004160797223448753, 0.006535738240927458, -0.008694175630807877, 0.11980359256267548, 0.05496881157159805, -0.02222108654677868, 0.054456863552331924, -0.04225214943289757, 0.012052725069224834, 0.04079967364668846, 0.011097747832536697, 0.06675758212804794, -0.09104073792695999, -0.006713222246617079, -0.052336178719997406, 0.0018833086360245943, 0.07426826655864716, 0.05107651650905609, -0.01681210845708847, -0.06576741486787796, 0.023671532049775124, -0.016452809795737267, -0.10057298839092255, 0.07041487097740173, -0.027249449864029884, 0.05956682190299034, -0.06729130446910858, -0.007698701694607735, 0.07333464920520782, -0.056906845420598984, -0.08796613663434982, -0.12405924499034882, -0.020567214116454124, -0.10447289049625397, 0.0612516812980175, 0.01045158226042986, -0.07062573730945587, 0.015392140485346317, 0.00029001833172515035, 0.09457596391439438, -0.03165598213672638, 0.03845863416790962, 0.015941433608531952, -0.04928838089108467, -0.0016108828131109476, -0.004893331788480282, -0.0060333916917443275, 0.036148931831121445, 0.07061030715703964, 0.007016459014266729, -0.025724101811647415, -0.004193780943751335, 0.02146574854850769, 0.08426177501678467, 0.07005717605352402, 0.11241040378808975, -0.004800135735422373, 0.11051731556653976, 0.1023123562335968, -0.01152400579303503, -0.024275531992316246, -0.013195890933275223, 0.10530771315097809, 0.10090899467468262, 0.03915439918637276, -5.248811163482969e-08, -0.00013302784645929933, -0.035270046442747116, -0.0008726045489311218, -0.018768135458230972, -0.023666489869356155, -0.0029049122240394354, 0.027356989681720734, 0.0554586760699749, 0.0232817642390728, 0.02138877473771572, -0.018140554428100586, 0.038475096225738525, -0.0654105395078659, -0.043645765632390976, -0.03982009366154671, 0.12245642393827438, -0.038175616413354874, 0.08464928716421127, 0.0047983634285628796, -0.033603642135858536, 0.04699190706014633, -0.04330918937921524, -0.00869316328316927, 0.07606516033411026, -0.0755920335650444, -0.06968636810779572, -0.04238630086183548, -0.012121916748583317, 0.04793662577867508, 0.03028116561472416, 0.019797278568148613, -0.03356859087944031, 0.020603949204087257, 0.00789062213152647, 0.03671791031956673, -0.05955290049314499, -0.02554216794669628, -0.015617169439792633, 0.03534236177802086, 0.017404766753315926, -0.06299315392971039, -0.013537638820707798, 0.03150911629199982, -0.019653446972370148, 0.01007250975817442, 0.027877315878868103, -0.00832026731222868, -0.03678617998957634, -0.05589016526937485, 0.043348219245672226, 0.06011766567826271, -0.014990509487688541, -0.058421116322278976, 0.07323218882083893, 0.0035557709634304047, -0.12999241054058075, -0.002515187719836831, 0.05563727021217346, 0.06054648011922836, -0.05248302221298218, -0.04716566950082779, 0.03242650628089905, 0.05756392702460289, -0.05495472624897957 ] }, { "text": "- Calculate gram matrix\n\n\n # get the batch_size, depth, height, and width of the Tensor\n _, d, h, w = tensor.size()\n \n # reshape so we're multiplying the features for each channel\n tensor = tensor.view(d, h * w)\n \n # calculate the gram matrix\n gram = torch.mm(tensor, tensor.t())\n \n- Calculate the gram matrices for each layer of our style representation\n\n\n- Create target image by cloning the content image and it require gradient\n\n\n target = content.clone().requires_grad_(True).to(device)\n\n- Assign weights to selected style layers. Assign alpha and beta.\n \n \n weighting earlier layers more will result in *larger* style artifacts\n\n- Use optimizer = optim.Adam([target], lr=0.003)", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_22", "embedding": [ -0.014556851238012314, -0.08693788200616837, 0.03702487051486969, -0.02853401191532612, -0.03117353282868862, -0.019687524065375328, 0.005484000314027071, -0.0028588781133294106, -0.10587522387504578, -0.09879616647958755, -0.04167625680565834, -0.017371414229273796, -0.042888157069683075, -0.01828092150390148, -0.019184494391083717, 0.05342016741633415, 0.020318176597356796, 0.09592050313949585, -0.05754593759775162, -0.04615252837538719, 0.04790478199720383, -0.007343144156038761, 0.020078226923942566, -0.03150857985019684, 0.018141742795705795, 0.030771931633353233, 0.07040110975503922, -0.005486141890287399, 0.0796380266547203, -0.023771541193127632, 0.058856647461652756, 0.029345933347940445, -0.008561274968087673, 0.046328939497470856, -0.045495785772800446, -0.003996332176029682, -0.037737369537353516, -0.0038375116419047117, -0.009125356562435627, 0.05893396958708763, 0.01118709146976471, 0.04025420546531677, -0.03008244000375271, -0.00842171162366867, 0.02393033355474472, 0.029695047065615654, 0.057817451655864716, 0.05475958064198494, 0.01254996471107006, -0.04284020513296127, 0.03216250613331795, -0.09244335442781448, -0.015211228281259537, 0.017401782795786858, -0.04265507310628891, 0.007034189999103546, 0.04838045313954353, -0.03933778777718544, 0.02315865457057953, -0.032053522765636444, -0.03415496274828911, 0.02955513820052147, 0.027926327660679817, -0.031266581267118454, 0.020877700299024582, 0.014103981666266918, 0.014562658034265041, -0.024310648441314697, 0.044527728110551834, 0.03146303445100784, 0.029646864160895348, -0.004940069746226072, 0.004699737299233675, 0.07652980089187622, -0.02399297244846821, 0.017553329467773438, 0.1282816380262375, 0.02604483813047409, 0.018069546669721603, -0.11634895950555801, 0.030804479494690895, -0.04189332202076912, 0.056883424520492554, 0.02649615705013275, 0.0038624494336545467, -0.039985693991184235, 0.009511641226708889, 0.03730475530028343, 0.0007654672954231501, 0.021541589871048927, -0.003620665753260255, -0.014000974595546722, -0.12837941944599152, -0.04766670987010002, 0.0366436205804348, 0.006143885664641857, -0.03249206393957138, -0.09579792618751526, -0.07779547572135925, 0.022579271346330643, 0.023511577397584915, -0.08482713252305984, 0.011084713973104954, 0.03172646090388298, -0.028283393010497093, 0.07028411328792572, 0.026075955480337143, 0.10593654960393906, -0.04404465854167938, -0.017080048099160194, 0.04205222800374031, 0.054380327463150024, -0.030349092558026314, 0.013087461702525616, 0.11070393025875092, 0.030814306810498238, 0.04166254773736, 0.08306364715099335, -0.01823820173740387, 0.05180247128009796, -0.03418049216270447, 0.05395636335015297, -0.0258980430662632, -0.00953690055757761, -0.0994671955704689, -0.015709614381194115, -0.04162850230932236, 3.3593633879524425e-33, 0.018510708585381508, 0.10044290125370026, -0.09038956463336945, -0.02160750702023506, -0.003837088355794549, 0.01179252564907074, 0.027382034808397293, -0.05394458770751953, -0.09181143343448639, -0.038891613483428955, -0.039866942912340164, -0.03005584329366684, -0.07222933322191238, 0.06810076534748077, -0.05682867020368576, -0.008026822470128536, -0.004874351900070906, 0.035976242274045944, 0.027510324493050575, 0.04677038639783859, -0.017879387363791466, 0.014848758466541767, -0.001974665792658925, -0.004339452367275953, -0.08762911707162857, -0.017063111066818237, 0.013598623685538769, -0.007505025714635849, -0.05425429344177246, -0.03133218735456467, -0.042930908501148224, -0.05826262757182121, 0.0330449603497982, -0.0005192561657167971, -0.06422857195138931, -0.034389812499284744, 0.08712545782327652, 0.003899150528013706, 0.07595200836658478, -0.053759027272462845, -0.011561726219952106, 0.12330371886491776, 0.03323584794998169, -0.035541560500860214, -0.0977259948849678, 0.10637278854846954, -0.02936079539358616, 0.05741032212972641, 0.03789125382900238, 0.024488238617777824, 0.043480198830366135, -0.020721670240163803, 0.018274245783686638, -0.008609707467257977, 0.03236335515975952, -0.046579644083976746, 0.01673874631524086, 0.0720551609992981, 0.18898355960845947, -0.07536133378744125, 0.09110613167285919, 0.06408582627773285, 0.007742627523839474, 0.040623076260089874, 0.028437430039048195, 0.01111537404358387, 0.004962368868291378, -0.015520666725933552, -0.03968140110373497, -0.005701984278857708, -0.03760794177651405, 0.018810641020536423, -0.008680368773639202, -0.04674416407942772, -0.023834019899368286, -0.06682410836219788, 0.05659335106611252, -0.08700874447822571, -0.007786435540765524, 0.08717956393957138, -0.08813213557004929, 0.12402736395597458, 0.02253827080130577, -0.10472637414932251, -0.08805124461650848, 0.028278673067688942, 0.023547440767288208, -0.024758080020546913, -0.00959472544491291, -0.03725491091609001, -0.04092244803905487, -0.0450717955827713, 0.029209351167082787, -0.013084033504128456, -0.024632366374135017, -2.3389402518906312e-33, 0.011367619037628174, 0.060535695403814316, 0.041270911693573, 0.0009184970986098051, 0.0044280714355409145, -0.027669815346598625, -0.018224665895104408, 0.043817318975925446, -0.0039426423609256744, 0.0040272376500070095, 0.0211180467158556, -0.015900427475571632, -0.10995916277170181, -0.11877187341451645, 0.03170923516154289, -0.09624704718589783, -0.01697213388979435, 0.027648674324154854, 0.019999738782644272, -0.03957072272896767, 0.005906980950385332, 0.06864995509386063, -0.06490644812583923, 0.04836242273449898, -0.1254972219467163, 0.02091825008392334, 0.0019723493605852127, 0.0795903131365776, -0.002415676834061742, -0.04334148392081261, 0.057779256254434586, -0.03646710142493248, -0.022101828828454018, 0.04226293787360191, 0.014220024459064007, 0.08122473955154419, 0.0493878498673439, 0.025082409381866455, -0.013293660245835781, -0.03389986231923103, 0.021720891818404198, 0.0205112062394619, -0.040840476751327515, 0.003028732957318425, -0.03559597209095955, 0.012841747142374516, -0.022782722488045692, 0.009433535858988762, -0.0419817678630352, 0.0049821981228888035, 0.01422104611992836, -0.03502007946372032, -0.07686595618724823, 0.034944191575050354, -0.05344604700803757, -0.030363181605935097, 0.011153127066791058, 0.008065557107329369, 0.06253134459257126, 0.02613198384642601, -0.08350497484207153, -0.10672655701637268, -0.06609854102134705, -0.13196732103824615, -0.045536335557699203, -0.02493157610297203, -0.011383097618818283, 0.040192048996686935, 0.06329361349344254, 0.08456654846668243, -0.0031256438232958317, 0.05542337894439697, 0.059429362416267395, 0.08370085060596466, 0.006439816206693649, -0.00769618758931756, 0.02243015356361866, 0.031168179586529732, 0.04653574898838997, -0.04205067455768585, -0.05154632031917572, 0.02538915164768696, -0.03654049336910248, 0.10042744129896164, 0.06707985699176788, 0.1268404871225357, 0.02147393673658371, 0.13077981770038605, 0.07320822775363922, -0.022917766124010086, 0.03979623690247536, -0.03593175858259201, 0.10707064718008041, 0.0009415646782144904, 0.03292939066886902, -4.774241446625638e-08, 0.0015152284177020192, -0.00654280511662364, 0.04482058063149452, 0.04340420290827751, -0.0779496356844902, -0.048591725528240204, 0.06428322196006775, 0.04487719014286995, 0.05205291882157326, -0.04425467550754547, -0.009520035237073898, 0.028301658108830452, 0.024381481111049652, 0.04625316336750984, -0.07642713189125061, 0.08220822364091873, -0.053688894957304, 0.0703357607126236, -0.015696333721280098, -0.0892534852027893, -0.0010264272568747401, -0.008457607589662075, 0.02396763488650322, 0.04275107383728027, -0.035631392151117325, -0.039303045719861984, 0.01526652555912733, 0.007217894773930311, -0.019833700731396675, 0.0004995361668989062, -0.034561172127723694, -0.02026066556572914, 0.00020364044758025557, 0.005903484765440226, 0.03995672985911369, 0.0030515342950820923, -0.03248870000243187, -0.0007875795708969235, -0.005789091810584068, 0.05066237598657608, -0.08734124153852463, -0.03727446123957634, 0.0802905336022377, -0.03507840260863304, 0.05262303352355957, -0.04530346393585205, -0.0341673381626606, -0.02693958953022957, -0.00530100055038929, 0.03803533315658569, 0.07878226786851883, 0.00751336757093668, -0.09011504054069519, 0.05826663598418236, 0.012928751297295094, -0.09756660461425781, -0.09625422954559326, 0.06814879179000854, 0.045747317373752594, -0.047896724194288254, 0.022747598588466644, 0.01861339434981346, -0.07123467326164246, -0.08820540457963943 ] }, { "text": "- Use optimizer = optim.Adam([target], lr=0.003)\n\n- Decide the number of iterations. It may be 2000 or 5000\n\n- content_loss = torch.mean((target_features['conv4_2'] - content_features['conv4_2'])**2)\n\n- For each layer in layers:\n\n - get the features (output) of target and style\n - calculate gram matrix\n - layer_style_loss = style_weights[layer] * torch.mean((target_gram - style_gram)**2)\n - style_loss += layer_style_loss / (d * h * w)\n \n- Total Loss: content_weight * content_loss + style_weight * style_loss\n\n- Optimization part:\n\n optimizer.zero_grad()\n total_loss.backward()\n optimizer.step()", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_23", "embedding": [ 0.02170783281326294, -0.022466225549578667, 0.019380832090973854, 0.03130495175719261, 0.010320499539375305, -0.02034151740372181, 0.004304062109440565, 0.046135492622852325, -0.05422618240118027, -0.05992592126131058, -0.029184626415371895, -0.04857124760746956, -0.002531960839405656, -0.06774940341711044, -0.07513890415430069, 0.052524082362651825, -0.03718423470854759, 0.1028614193201065, -0.042026735842227936, -0.11483792215585709, 0.07986844331026077, 0.016432123258709908, 0.04987721145153046, -0.023132961243391037, 0.05498041212558746, 0.056195344775915146, -0.05163855478167534, 0.03391583636403084, 0.09646334499120712, 0.01636737585067749, 0.06404831260442734, -0.0010832403786480427, -0.0029845319222658873, 0.016278190538287163, -0.06766308844089508, -0.021541057154536247, -0.07068625837564468, -0.025107087567448616, -0.05552712455391884, 0.07485216110944748, -0.006530774291604757, 0.054144732654094696, -0.04641596972942352, -0.04886932671070099, 0.06479679048061371, 0.026217816397547722, -0.039551347494125366, -0.017682166770100594, 0.030463865026831627, -0.002510898280888796, 0.0303285401314497, -0.05037076771259308, -0.029829349368810654, -0.03032529167830944, -0.0067431130446493626, -0.014842646196484566, 0.028435055166482925, -0.04551391303539276, -0.008741290308535099, -0.021447962149977684, 0.035489361733198166, -0.06322081387042999, 0.02641172520816326, -0.04804691672325134, 0.04733717814087868, 0.004788634367287159, 0.011087682098150253, -0.015704672783613205, 0.004781734198331833, 0.07520045340061188, 0.01795102469623089, 0.004023313522338867, 0.04068226367235184, -0.0034341209102422, -0.025451600551605225, 0.010934283956885338, 0.09548549354076385, 0.015699146315455437, -0.030266795307397842, -0.10872366279363632, 0.03634224459528923, -0.017014671117067337, 0.0324903279542923, -0.009438199922442436, 0.016825448721647263, -0.033547863364219666, 0.056149695068597794, 0.025973312556743622, 0.03083476983010769, 0.026249095797538757, -0.059433579444885254, -0.0330066978931427, -0.10343874245882034, -0.04800630733370781, 0.024445828050374985, 0.05550578981637955, -0.028413990512490273, -0.07371233403682709, -0.04145720973610878, 0.041013091802597046, 0.016010234132409096, -0.06398370862007141, 0.03322269394993782, -0.04191400855779648, -0.007895701564848423, 0.013155950233340263, 0.10213737189769745, 0.11994456499814987, -0.019149135798215866, -0.05517194792628288, 0.024522792547941208, 0.03280200809240341, 0.00516984798014164, 0.024367688223719597, 0.1036817878484726, -0.011353163048624992, 0.09135782718658447, 0.04839799180626869, 0.062325797975063324, 0.07514753937721252, -0.04083132743835449, 0.06898754835128784, 0.013186866417527199, -0.01885582134127617, -0.06915353238582611, -0.038928546011447906, -0.020649351179599762, 1.8462260320660855e-34, -0.0400610975921154, 0.017553143203258514, -0.008736083284020424, -0.040089067071676254, -0.047577910125255585, 0.020717330276966095, 0.05659398436546326, -0.0372372530400753, -0.03384075313806534, -0.009409792721271515, -0.037097226828336716, -0.04320207238197327, -0.07789172232151031, 0.016468025743961334, 0.019784754142165184, -0.05558820441365242, 0.06585441529750824, 0.022134460508823395, 0.045812927186489105, -0.03192409127950668, 0.0416669026017189, -0.047439709305763245, -0.03449542447924614, -0.011840048246085644, -0.07126528024673462, -0.012029485777020454, -0.004091393668204546, -0.04376259073615074, -0.09590810537338257, -0.04519905149936676, -0.00552908843383193, 0.018324164673686028, -0.0270516537129879, -0.03697727993130684, -0.019598595798015594, -0.057719260454177856, 0.09375404566526413, 0.0790666788816452, 0.0682876855134964, -0.07342232763767242, -0.06640700995922089, 0.09155014902353287, 0.05930565670132637, -0.036550991237163544, -0.10367236286401749, 0.05973916873335838, -0.014320140704512596, 0.08768893033266068, 0.02295876108109951, 0.032064471393823624, 0.03433142974972725, -0.005620703566819429, 0.013032001443207264, 0.03233065828680992, 0.006392016541212797, -0.015160462819039822, 0.022763073444366455, 0.08884177356958389, 0.1420924812555313, -0.042436521500349045, 0.07270579785108566, 0.03807973861694336, -0.02850690297782421, -0.03141544759273529, 0.008836896158754826, 0.04372840374708176, 0.004903205204755068, 0.001020479598082602, -0.0417480431497097, 0.057864151895046234, -0.04981102794408798, 0.008144043385982513, 0.0031095596496015787, -0.07535099238157272, 0.056470680981874466, -0.08427833020687103, 0.00688108429312706, -0.1348961442708969, -0.05188474431633949, 0.02180493250489235, -0.06134265288710594, 0.16748292744159698, -0.021095197647809982, -0.13145539164543152, -0.05098501592874527, 0.004914230667054653, 0.020219003781676292, -0.038075391203165054, -0.049035489559173584, -0.022634543478488922, -0.09662627428770065, -0.04327056556940079, 0.05855393409729004, 0.014508013613522053, -0.05134398862719536, -2.2147939057773893e-34, -0.052925094962120056, 0.11055704206228256, 0.06392768025398254, 0.027421411126852036, 0.06605608016252518, 0.01204653736203909, -0.023336483165621758, 0.00069061090471223, 0.008453956805169582, 0.014154113829135895, 0.06231386214494705, -0.08793457597494125, -0.07956615835428238, -0.03239338472485542, 0.07890179008245468, -0.02558388188481331, -0.039081692695617676, 0.03186160698533058, 0.0524350181221962, -0.0218200646340847, -0.04216521233320236, 0.09909762442111969, -0.0767294391989708, 0.0031676827929913998, -0.06767986714839935, 0.0009897974086925387, 0.04766514152288437, 0.08648350834846497, 0.007147572003304958, -0.09514493495225906, 0.00928637944161892, -0.0031847970094531775, -0.07275951653718948, 0.13589629530906677, -0.03895667567849159, 0.034426942467689514, 0.00410419050604105, -0.040806543081998825, -0.052237819880247116, 0.04761713743209839, 0.06692570447921753, 0.025932205840945244, -0.0352407842874527, 0.038380082696676254, 0.0005147279589436948, 0.039340630173683167, -0.015064789913594723, -0.015610434114933014, -0.029363173991441727, -0.03175552189350128, 0.029796412214636803, -0.049383409321308136, -0.13955463469028473, 0.06483881920576096, -0.03350131958723068, 0.019042929634451866, -0.045188531279563904, -0.01935519464313984, -0.02378041297197342, -0.00889365840703249, -0.10129895061254501, -0.1152888759970665, -0.01188900787383318, -0.015628375113010406, -0.02216598205268383, 0.019266340881586075, -0.012760462239384651, 0.043395377695560455, 0.002424923935905099, 0.0713486298918724, 0.004362566862255335, 0.0964561402797699, 0.0714210644364357, 0.021877063438296318, -0.004865530878305435, -0.034333620220422745, -0.003914522938430309, -0.0181317999958992, 0.004994399845600128, -0.05288390442728996, -0.06271415203809738, 0.0034191266167908907, -0.002686578081920743, -0.0046049440279603004, 0.028655851259827614, 0.07860660552978516, 0.013882890343666077, 0.12257488071918488, 0.02715875953435898, -0.01029581855982542, 0.05648253485560417, -0.014245082624256611, 0.12568168342113495, -0.02040119282901287, -0.010623672045767307, -4.0391455513599794e-08, -0.010471456684172153, -0.02449040487408638, 0.019430037587881088, 0.037936847656965256, 0.006597400177270174, 0.03926602751016617, 0.018642177805304527, 0.05051504075527191, 0.002115880139172077, -0.041501957923173904, 0.03630506619811058, -0.02242189645767212, 0.01029184553772211, 0.021444223821163177, -0.08984401077032089, 0.057167164981365204, -0.04762830585241318, 0.052106473594903946, 0.03357997164130211, -0.08572839945554733, 0.018738487735390663, -0.027857525274157524, -0.013592119328677654, 0.05019897595047951, -0.039390385150909424, -0.03004925698041916, 0.0623176172375679, -0.014670494943857193, 0.028683312237262726, 0.007645842619240284, 0.020446738228201866, -0.030900776386260986, 0.01611431874334812, 0.03324378654360771, 0.06354351341724396, 0.016875796020030975, 0.0020701379980891943, 0.06905843317508698, 0.015595297329127789, 0.09956297278404236, -0.08991958945989609, 0.030536724254488945, 0.03268509730696678, 0.002567316172644496, 0.060641832649707794, -0.020186154171824455, -0.03461860492825508, -0.0619959831237793, 0.05927525833249092, -0.021984340623021126, 0.10926048457622528, -0.04221904277801514, -0.06001337990164757, 0.06829827278852463, 0.020266534760594368, -0.11953482031822205, -0.04729070886969566, 0.0466214120388031, -0.010543004609644413, -0.031436752527952194, -0.008230945095419884, -0.03785073757171631, -0.043428756296634674, -0.02339594066143036 ] }, { "text": "## References\n\n- [Udacity_Lecture](https://classroom.udacity.com/courses/ud188/lessons/c1541fd7-e6ec-4177-a5b1-c06f1ce09dd8/concepts/e9180da9-001a-426e-974a-0ef1e87846dc)\n- [Gatys_Image_Style_Transfer_CVPR_2016_paper](https://www.cv-foundation.org/openaccess/content_cvpr_2016/papers/Gatys_Image_Style_Transfer_CVPR_2016_paper.pdf) [1]\n- [Code](https://github.com/udacity/deep-learning-v2-pytorch/blob/master/style-transfer/Style_Transfer_Solution.ipynb)\n\n\n## Key Words\n\n- Pre-trained VGG19, Style Transfer, Gram Matrix, PyTorch, Style Transfer Loss", "source": "2020-10-20-style-transfer.md", "type": "markdown", "chunk_id": "2020-10-20-style-transfer.md_24", "embedding": [ -0.11361497640609741, -0.0033909634221345186, -0.032608870416879654, -0.03029293566942215, 0.053635433316230774, 0.03917489945888519, -0.022477172315120697, 0.0014837620547041297, -0.04776265099644661, -0.029617920517921448, 0.0913999155163765, 0.019686857238411903, 0.04071272164583206, -0.04615302383899689, -0.056213270872831345, 0.018487853929400444, -0.03430301323533058, 0.0941184014081955, -0.11627965420484543, 0.03018234111368656, 0.0568205788731575, 0.0009876303374767303, 0.056269433349370956, -0.05619369074702263, 0.024137204512953758, 0.015132767148315907, 0.011471791192889214, -0.0009778955718502402, 0.058786600828170776, -0.03310985118150711, -0.007370469160377979, 0.023759707808494568, 0.0288546085357666, 0.06702259927988052, -0.006470155902206898, 0.1024874821305275, -0.037249401211738586, 0.023144930601119995, -0.021731922402977943, 0.06733127683401108, -0.006931984797120094, -0.049238674342632294, -0.002794106025248766, -0.006373228970915079, 0.11171550303697586, 0.07672607153654099, -0.06718273460865021, -0.05608692392706871, -0.05044899508357048, -0.021324779838323593, -0.04571910947561264, -0.03466144949197769, -0.07455422729253769, 0.04033374413847923, 0.006048825569450855, 0.024156881496310234, -0.012693891301751137, -0.04072980582714081, 0.001812379457987845, -0.007042495533823967, -0.010211612097918987, -0.007781778462231159, -0.07030569016933441, -0.021441282704472542, 0.006358103360980749, 0.025377633050084114, 0.05698613077402115, 0.050156570971012115, -0.03944749757647514, -0.03552739694714546, -0.07685007899999619, 0.008063054643571377, -0.05117734894156456, 0.010251681320369244, -0.023836521431803703, 0.07119163125753403, 0.05744773894548416, -0.0005372489104047418, 0.026061564683914185, -0.1198170930147171, 0.005518911872059107, -0.018101464956998825, 0.06752315163612366, 0.024350667372345924, 0.04628216102719307, 0.07234752178192139, -0.018963955342769623, -0.014586269855499268, 0.015187017619609833, 0.00513653876259923, -0.004540746565908194, -0.062102582305669785, -0.01974262297153473, -0.007505316287279129, 0.029885007068514824, -0.005928685888648033, -0.05130631849169731, -0.0950266569852829, 0.0434768982231617, 0.027068551629781723, 0.009419475682079792, -0.04515155777335167, 0.034284185618162155, -0.006262683309614658, -0.027399612590670586, 0.0007540161022916436, 0.09279018640518188, 0.06887752562761307, 0.0017148323822766542, -0.017676720395684242, -0.0032805600203573704, 0.027901828289031982, -0.07196104526519775, -0.0499187670648098, -0.006190420128405094, 0.06007034704089165, -0.06481826305389404, -0.010685637593269348, 0.06569668650627136, -0.04113151505589485, -0.003246715059503913, -0.00553416321054101, -0.049499206244945526, -0.002571883611381054, -0.17607250809669495, -0.10811761766672134, 0.004131091758608818, 4.4617981934772325e-33, 0.01792757213115692, 0.04008669778704643, -0.013264783658087254, 0.0011511779157444835, 0.04499699920415878, 0.01291400846093893, -0.0226574819535017, -0.06182573735713959, -0.08157438039779663, -0.014428259804844856, -0.059921253472566605, -0.016233429312705994, -0.08845070004463196, 0.09552351385354996, -0.055859435349702835, -0.05002111569046974, 0.02351221814751625, 0.022023050114512444, 0.05415620282292366, -0.010675125755369663, 0.026151660829782486, 0.06966418027877808, 0.01614456996321678, -0.034291137009859085, -0.05605489760637283, 0.01326795294880867, -0.04295312613248825, -0.09618639945983887, 0.028605477884411812, -0.0008319560438394547, -0.03652144968509674, -0.0008101997664198279, -0.0268010925501585, 0.012837043032050133, -0.03411716967821121, -0.017065759748220444, 0.0019232885679230094, -0.05262059345841408, 0.08699080348014832, -0.07342052459716797, -0.030677374452352524, 0.06694246083498001, 0.03529410436749458, -0.06290997564792633, -0.03752579167485237, 0.020867448300123215, 0.06517291069030762, 0.05973415821790695, 0.05681176856160164, 0.0062307012267410755, 0.03898186609148979, -0.01216945145279169, -0.12057488411664963, -0.015171591192483902, 0.010325082577764988, -0.02553144283592701, 0.020228827372193336, 0.05948431417346001, 0.04541189968585968, 0.04066434130072594, 0.06703711301088333, 0.13727620244026184, 0.020863059908151627, -0.031640663743019104, 0.00824834406375885, 0.0036793015897274017, -0.0610785186290741, -0.043762706220149994, 0.020321257412433624, -0.0265034269541502, -0.024966048076748848, 0.047408584505319595, -0.006908252369612455, -0.036473095417022705, 0.06000278517603874, -0.02662803791463375, -0.01200721226632595, -0.07753410190343857, 0.014658216387033463, -0.021475015208125114, -0.1124279573559761, 0.11483467370271683, -0.053983189165592194, -0.04680314287543297, -0.07542050629854202, 0.02985813468694687, 0.04654219001531601, -0.1070174127817154, 0.0060179755091667175, -0.007378139533102512, -0.0037165640387684107, -0.03876224905252457, -0.03637165576219559, -0.02360706590116024, 0.0014144603628665209, -4.6283488452574575e-33, 0.07138358801603317, 0.07721126824617386, -0.010535173118114471, 0.1225699707865715, 0.00010474820010131225, -0.05975950509309769, 0.05939147248864174, 0.05027294158935547, 0.05733410269021988, -0.0026348442770540714, 0.053024742752313614, -0.0279853492975235, -0.07157588005065918, -0.02769746631383896, 0.06144385412335396, -0.08561728894710541, -0.05708581209182739, 0.03330286592245102, -0.034260343760252, -0.0056650834158062935, 0.043406445533037186, 0.09340883046388626, -0.025112658739089966, 0.04769387096166611, -0.06383273005485535, -0.014445480890572071, 0.031041443347930908, 0.07605716586112976, 0.005046436563134193, 0.047007910907268524, -0.0440906286239624, -0.03180823475122452, -0.09666630625724792, 0.12681542336940765, -0.00942110363394022, 0.03868043050169945, 0.09619218856096268, 0.03331221640110016, -0.05869783088564873, 0.044667910784482956, 0.0686950609087944, -0.00954701378941536, -0.03757825121283531, -0.04077228158712387, -0.047062862664461136, 0.07589713484048843, -0.017689013853669167, 0.021305786445736885, 0.0538146048784256, -0.02478817105293274, 0.10529228299856186, 0.011059457436203957, -0.05186551809310913, 0.061215367168188095, -0.03817661106586456, 0.028889711946249008, 0.04729823023080826, -0.02825392782688141, 0.014422043226659298, -0.010553480125963688, 0.003965003415942192, -0.06034764274954796, -0.08010897040367126, -0.10837098956108093, 0.04354517161846161, -0.025158017873764038, -0.07312453538179398, 0.02081376127898693, 0.005005375482141972, 0.014541054144501686, 0.018558066338300705, 0.005796064157038927, 0.0895986258983612, 0.010209961794316769, 0.020057683810591698, -0.03597389534115791, 0.03700316324830055, -0.034644439816474915, 0.026176221668720245, -0.049418240785598755, -0.025620365515351295, 0.032226815819740295, -0.006129438988864422, 0.15468379855155945, 0.02384292148053646, 0.1632547229528427, 0.010977857746183872, 0.009876550175249577, 0.022211741656064987, -0.033740270882844925, -0.041776031255722046, -0.0297128614038229, 0.12975306808948517, 0.09121385961771011, 0.0014345244271680713, -5.135975911230162e-08, -0.0919932946562767, 0.04858394339680672, 0.025495873764157295, -0.013996406458318233, 0.026299310848116875, -0.013678126037120819, 0.03292638435959816, 0.0024719550274312496, 0.019912058487534523, -0.006402607075870037, 0.01877964660525322, 0.05855900049209595, -0.023006880655884743, -0.058134112507104874, -0.0872233510017395, 0.05381474271416664, -0.040066879242658615, 0.06664282828569412, 0.0004254850500728935, -0.07651127129793167, 0.028559088706970215, -0.056522663682699203, -0.01573925092816353, -0.018671825528144836, -0.07460182160139084, -0.08356668055057526, -0.00144124252256006, 0.07897245138883591, 0.009473676793277264, -0.052729636430740356, 0.033898599445819855, 0.0020866263657808304, 0.07145017385482788, -0.03815822675824165, 0.03489503636956215, 0.03501904010772705, -0.001939315116032958, -0.010456264950335026, 0.04355932027101517, 0.05110032111406326, -0.03919652849435806, -0.023799600079655647, -0.023826777935028076, 0.028558919206261635, 0.0685238465666771, -0.003332952968776226, 0.015191921032965183, -0.05119545757770538, -0.06039906293153763, 0.06928232312202454, 0.018256645649671555, -0.026906166225671768, 0.012230533175170422, 0.09765885025262833, -0.010718672536313534, -0.10011813044548035, 0.00042760989163070917, 0.010801926255226135, 0.08536439388990402, 0.04280915856361389, -0.007319509517401457, 0.06852249801158905, -0.003674680832773447, 0.010038070380687714 ] }, { "text": "---\ntitle: \"Cross-Entropy Loss\"\nid: \"crossentropy\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"dl\", \"loss\", \"cross entropy\", \"medium\"]\nrelated: [\"dl\"]\ndate: \"2023-03-11\"\ndescription: \"Simple example for cross entropy loss\"\n---\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/cross-entropy-loss-5568329c9d3) \n\nI will explain the cross-entropy loss with a very simple example.", "source": "2023-03-11-Cross_Entropy_Loss.md", "type": "markdown", "chunk_id": "2023-03-11-Cross_Entropy_Loss.md_0", "embedding": [ -0.06607480347156525, -0.06404531002044678, 0.06115226820111275, 0.01071044523268938, 0.06391039490699768, -0.003561171470209956, 0.0032653494272381067, -0.021059885621070862, 0.0015977253206074238, -0.06960621476173401, -0.05741921812295914, -0.0863877683877945, 0.001332624931819737, -0.04022793844342232, -0.05336710438132286, -0.019056636840105057, -0.02871371991932392, 0.052242930978536606, -0.1266738772392273, 0.007817698642611504, 0.07028260827064514, 0.038212649524211884, -0.03312274068593979, 0.03692404180765152, -0.003148869378492236, -0.04170981049537659, -0.008974882774055004, 0.04003024473786354, 0.02872110903263092, -0.015549958683550358, 0.04299655556678772, -0.0047694481909275055, -0.07820620387792587, 0.10231566429138184, -0.010024107992649078, 0.07085853815078735, -0.09899848699569702, 0.011564080603420734, -0.021364448592066765, 0.06994274258613586, 0.004348337184637785, 0.057975105941295624, 0.021885866299271584, 0.06368810683488846, -0.019387027248740196, 0.049108438193798065, -0.0703829675912857, -0.08834494650363922, -0.029961924999952316, -0.007113365922123194, 0.010654939338564873, 0.003606172511354089, -0.021283427253365517, 0.11130798608064651, 0.00883999839425087, 0.027291730046272278, -0.020553728565573692, 0.01001129113137722, -0.08386891335248947, 0.04913797602057457, 0.04019219055771828, -0.014271508902311325, -0.0456685870885849, -0.010876095853745937, 0.04546425864100456, -0.04337996989488602, -0.014976548962295055, 0.07000524550676346, -0.033734288066625595, -0.005406645592302084, -0.019560642540454865, 0.0305611751973629, -0.04688042774796486, -0.015138284303247929, 0.06697364896535873, -0.020611293613910675, 0.09545426070690155, 0.044680155813694, -0.035227708518505096, -0.03196801617741585, 0.012098217383027077, 0.07141552120447159, 0.0056448401883244514, -0.0011357885086908937, 0.10759725421667099, -0.10858355462551117, -0.003384800860658288, -0.03289417922496796, -0.040203943848609924, -0.021337611600756645, -0.016191301867365837, -0.0675521194934845, 0.005706722382456064, 0.011274064891040325, 0.04506610706448555, 0.014299142174422741, -0.0052464744076132774, -0.06303594261407852, 0.016091329976916313, 0.0024947854690253735, -0.035440657287836075, 0.019010750576853752, 0.04490067809820175, 0.029620222747325897, 0.03885684162378311, -0.035409700125455856, 0.07527516037225723, 0.03976736217737198, 0.06672337651252747, -0.0367225781083107, 0.04878099635243416, 0.1165468692779541, -0.011323670856654644, -0.011687031015753746, -0.012355277314782143, 0.025636738166213036, -0.012739628553390503, -0.0028677613008767366, 0.060870394110679626, 0.025768166407942772, -0.12404399365186691, 0.03644492104649544, -0.04645972326397896, -0.08745726197957993, -0.05978997424244881, -0.0016985152615234256, 0.028461076319217682, -4.264035044275806e-34, 0.014513674192130566, -0.07340145111083984, -0.05316215008497238, -0.02655208110809326, -0.007172985002398491, -0.00891041848808527, -0.1030692532658577, -0.05048969388008118, -0.02399439364671707, 0.10094117373228073, -0.058627597987651825, 0.05443783849477768, -0.07398004084825516, 0.11585979163646698, -0.02694527991116047, -0.027095437049865723, -0.07431437075138092, 0.034702643752098083, 0.043457500636577606, -0.04434520751237869, -0.0028781830333173275, 0.08578427135944366, 0.03547243773937225, -0.03340878337621689, -0.030366571620106697, 0.056229159235954285, -0.02717910148203373, -0.05145123973488808, 0.057677432894706726, 0.04685750603675842, -0.07677809149026871, 0.012613863684237003, 0.004696948453783989, -0.07691196352243423, 0.013472410850226879, 0.07865062355995178, -0.018491357564926147, 0.04867575690150261, 0.037230003625154495, -0.03952951356768608, 0.02286641299724579, -0.013772024773061275, -0.02110418863594532, -0.11326843500137329, 0.00892291497439146, -0.04420420899987221, 0.08993601053953171, -0.05249917507171631, 0.001993578625842929, -0.0021198682952672243, -0.013429836370050907, -0.08219915628433228, -0.024597622454166412, -0.04374127462506294, 0.07691624015569687, 0.02630891278386116, 0.06794747710227966, 0.04804212972521782, 0.02093423344194889, 0.04058481380343437, -0.0005790276336483657, 0.06687824428081512, 0.0448976531624794, -0.019514527171850204, 3.3195112337125465e-05, 0.0024555171839892864, 0.06204615905880928, 0.009390183724462986, 0.03234761208295822, -0.05443744733929634, -0.08168873190879822, 0.02492029406130314, -0.07686963677406311, -0.0247602928429842, 0.09640689194202423, -0.024639233946800232, -0.07743412256240845, -0.05054594203829765, 0.03828909993171692, 0.07066576182842255, -0.07155925780534744, 0.040001820772886276, -0.018820762634277344, -0.06288587301969528, -0.08597104251384735, 0.07320401817560196, -0.01742732897400856, -0.1187981441617012, -0.07472754269838333, -0.022084826603531837, 0.021186957135796547, 0.007972313091158867, 0.058392785489559174, 0.03049178048968315, 0.006966151297092438, -3.590751369388148e-33, -0.10388121008872986, -0.01650632917881012, -0.08329378813505173, 0.03444971889257431, -0.05074438080191612, -0.04795774817466736, -0.035053517669439316, 0.08378661423921585, -0.05738480016589165, 0.05932579189538956, 0.024815358221530914, -0.04151595011353493, -0.12286863476037979, 0.018010392785072327, 0.020202578976750374, 0.02333969622850418, -0.01923971064388752, 0.0605953186750412, 0.01638781651854515, -0.06796570122241974, 0.0767848864197731, 0.15002162754535675, -0.07546170800924301, 0.03896971791982651, 0.02574942074716091, -0.0414624847471714, 0.047298770397901535, 0.07631273567676544, 0.08898303657770157, -0.09089253097772598, -0.05305788666009903, -0.08068639039993286, -0.01968787983059883, 0.06036681681871414, -0.013675568625330925, 0.012399696744978428, -0.0038280810695141554, -0.07534939050674438, -0.07765483856201172, -0.05579577386379242, 0.0307476669549942, 0.02853243798017502, 0.02137325517833233, -0.04055815935134888, -0.03444633260369301, 0.01545875333249569, -0.1110633835196495, -0.06299029290676117, 0.09944608807563782, 0.049975086003541946, 0.0683828815817833, -0.10087671875953674, -0.037754785269498825, 0.03529193252325058, -0.08107137680053711, -0.008016830310225487, -0.017341570928692818, 0.022139260545372963, -0.05357906594872475, 0.0893203467130661, -0.07219983637332916, -0.0926956981420517, -0.005162856541574001, 0.037408679723739624, -0.011563391424715519, 0.056659139692783356, -0.08313165605068207, -0.020059481263160706, -0.005834653042256832, 0.019297853112220764, 0.0691981390118599, 0.09706182032823563, -0.0466693677008152, -0.02055452950298786, 0.0030763926915824413, -0.031038928776979446, 0.021993935108184814, 0.01759912446141243, -0.03494447097182274, -0.04172621667385101, 0.05027126520872116, 0.0009197337785735726, 0.017047515138983727, 0.13158345222473145, 0.03184938803315163, -0.010993853211402893, -0.00018063718744087964, -0.03624042123556137, -0.06880370527505875, -0.039629146456718445, 0.004313074517995119, -0.032687120139598846, 0.014494211412966251, 0.08775635063648224, -0.045064132660627365, -5.175630590770197e-08, 0.015574192628264427, 0.02481047250330448, 0.05274707078933716, -0.021567242220044136, 0.017113788053393364, -0.044507645070552826, 0.012706616893410683, -0.0025542383082211018, -0.04687371477484703, 0.026932543143630028, 0.013561180792748928, 0.06219886988401413, 0.0021117704454809427, 0.028283771127462387, -0.005841847974807024, 0.00591133302077651, -0.0503075011074543, 0.03568137437105179, 0.0639679804444313, -0.04195547476410866, 0.015256139449775219, -0.03872998058795929, 0.03057354874908924, 0.008154911920428276, 0.040113095194101334, -0.03063928335905075, 0.009592792019248009, 0.06466811895370483, 0.010730748996138573, -0.08320636302232742, -0.016084745526313782, 0.04915091022849083, -0.04506146162748337, 0.023139523342251778, -0.04534009099006653, 0.12157629430294037, 0.030324626713991165, -0.05703521519899368, 0.025983618572354317, 0.0068716565147042274, -0.013039461337029934, 0.016868414357304573, 0.031864117830991745, -0.019953211769461632, 0.028411980718374252, -0.013017909601330757, 0.03169318288564682, 0.01385806966573, -0.005438698455691338, 0.021748987957835197, 0.03493542969226837, -0.02902849018573761, 0.021943725645542145, 0.08331054449081421, 0.02486804686486721, -0.07462972402572632, -0.014080464839935303, -0.01237156055867672, 0.05980478972196579, 0.04768109694123268, 0.0335877425968647, 0.017343949526548386, -0.03987392038106918, 0.07846657931804657 ] }, { "text": "---\ntitle: \"GDG Devfest'24 Notes\"\nid: \"devfest\"\ncategory: \"conference\"\ntags: [\"llmops\", \"google\", \"devfest\"]\nrelated: [\"reinvent\"]\ndate: \"2024-11-09\"\ndescription: \"I've joined GDG devfest'24 event.\"\n---\n\nI've joined GDG devfest'24 event yesterday. There were remarkable speakers. I would like to add my notes.\nYou may find the link of the conference [here](https://devfest.istanbul/)", "source": "2024-11-09-devfest_notes.md", "type": "markdown", "chunk_id": "2024-11-09-devfest_notes.md_0", "embedding": [ -0.037201620638370514, -0.038903430104255676, 0.04548530653119087, 0.002228904515504837, -0.018268156796693802, 0.07024291902780533, 0.0007965564145706594, -0.0751420259475708, 0.018172163516283035, -0.010034909471869469, -0.030694102868437767, 0.0068572694435715675, -0.09114314615726471, -0.010818890295922756, 0.005471964366734028, -0.010979734361171722, 0.04114798083901405, -0.01751149445772171, 0.008684881962835789, -0.1150873452425003, -0.0026348084211349487, 0.014938118867576122, 0.04172023758292198, 0.021690040826797485, 0.06601539999246597, 0.04853097349405289, -0.06560389697551727, 0.013576555997133255, 0.034617625176906586, 0.027304813265800476, 0.0037417279090732336, 0.05640124902129173, 0.02147206850349903, 0.011676357127726078, 0.08918188512325287, 0.024088948965072632, -0.022175103425979614, -0.0069748396053910255, 0.04472033306956291, -0.001969439908862114, 0.030025983229279518, -0.04557071626186371, 0.03742685168981552, 0.007426055148243904, -0.030108582228422165, -0.08359342813491821, -0.1414586901664734, -0.04380502924323082, -0.014044455252587795, 0.13579683005809784, 0.07469175010919571, -0.094991035759449, 0.03609099239110947, -0.08563864976167679, 0.06620565801858902, 0.07726231962442398, -0.012852487154304981, 0.010166183114051819, 0.0036652199923992157, -0.026755014434456825, 0.057723093777894974, -0.013935763388872147, -0.04128047823905945, -0.008388364687561989, -0.1189921423792839, -0.017159512266516685, 0.08419081568717957, 0.16279833018779755, -0.03917347639799118, -0.019837750121951103, 0.04543451964855194, 0.027910422533750534, 0.016940882429480553, -0.04618241637945175, 0.01899024099111557, -0.040196407586336136, -0.06017833575606346, -0.04822029918432236, 0.0020969598554074764, -0.033639248460531235, 0.05548441782593727, -0.008484166115522385, 0.07012031227350235, -0.059544701129198074, 0.0037485233042389154, -0.05560189113020897, 0.007191772107034922, 0.0016054831212386489, -0.010869743302464485, -0.019769927486777306, -0.053554996848106384, 0.014478239230811596, -0.05267408490180969, -0.0014187466586008668, -0.017631303519010544, 0.04207731410861015, 0.007529676891863346, -0.06913571059703827, 0.061254389584064484, 0.08254780620336533, 0.026224037632346153, 0.11900560557842255, -0.007191875949501991, 0.017104580998420715, -0.006669654976576567, 0.06291085481643677, -0.11946232616901398, 0.10405959188938141, -0.010459736920893192, -0.05061645805835724, -0.044156283140182495, 0.06398051232099533, 0.024313082918524742, -0.042269282042980194, -0.006448836997151375, 0.014471246860921383, -0.03798271715641022, 0.017640676349401474, 0.07303111255168915, -0.034304942935705185, 0.06680094450712204, 0.018996914848685265, -0.07781501114368439, 0.04066671058535576, -0.07833465933799744, -0.0002059098333120346, -0.04767446964979172, -2.079321166498746e-34, 0.11888029426336288, -0.05467181280255318, -0.0343756340444088, -0.02267700433731079, 0.0682651698589325, -0.011815318837761879, -0.06105930730700493, -0.02690521441400051, -0.11761561781167984, -0.048593372106552124, -0.033214960247278214, -0.0668322965502739, 0.043869901448488235, -0.04629840701818466, -0.04129200801253319, -0.004358787089586258, -0.03815450891852379, 0.03253644332289696, 0.011041287332773209, -0.022760652005672455, -0.07044989615678787, 0.07523991912603378, 0.03259895369410515, 0.03436029702425003, 0.09508568048477173, 0.13466070592403412, 0.008818761445581913, -0.03903563320636749, 0.07634590566158295, 0.02000039629638195, -0.03529944643378258, -0.009768172167241573, -0.02851465903222561, -0.031934935599565506, -0.04334757477045059, 0.02589629776775837, -0.05143755301833153, -0.0917997658252716, -0.012331156991422176, -0.07840559631586075, 0.05896715819835663, -0.020210200920701027, -0.06700768321752548, -0.08645645529031754, 0.005804512184113264, 0.04246117174625397, 0.013517041690647602, -0.015752557665109634, 0.1970190703868866, -0.00012235622853040695, -0.07925182580947876, 0.071259506046772, -0.058426883071660995, 0.0024944767355918884, 0.034389037638902664, -0.06888115406036377, 0.023493442684412003, 0.008482124656438828, 0.019771022722125053, -0.048728637397289276, 0.016597535461187363, 0.07788872718811035, -0.02775217965245247, -0.03126231208443642, -0.017439931631088257, -0.018286529928445816, -0.07324860244989395, 0.034971047192811966, 0.07462689280509949, -0.023022769019007683, 0.011382263153791428, 0.017492353916168213, -0.029267288744449615, -0.0041025560349226, -0.05272165685892105, -0.0314282551407814, -0.009026746265590191, -0.03936241567134857, -0.011902295984327793, 0.03884923458099365, -0.02810460329055786, -0.02834748476743698, -0.01682714745402336, -0.02842158079147339, 0.01942748762667179, 0.029732365161180496, -0.016931649297475815, -0.07115235924720764, -0.002880616346374154, 0.01814289577305317, -0.0985465720295906, 0.03014175407588482, -0.026074916124343872, 0.03827928006649017, -0.06899970024824142, -2.6816424055614224e-33, 0.04547544941306114, 0.07579921931028366, -0.05228699743747711, 0.05399968475103378, 0.028176618739962578, 0.040316931903362274, -0.028490910306572914, 0.10368454456329346, 0.0188689474016428, 0.031281016767024994, -0.01931247115135193, 0.08417440205812454, -0.03177851065993309, -0.06474408507347107, -0.03798368573188782, -0.03792395070195198, -0.021869054064154625, 0.038418352603912354, -0.015913652256131172, 0.005525505635887384, -0.004710911773145199, 0.050942063331604004, 0.028671160340309143, 0.008973034098744392, 0.009764418937265873, -0.00824468769133091, 0.07945221662521362, -0.08042232692241669, -0.04063793644309044, -0.015350225381553173, 0.04694194346666336, -0.03098776564002037, -0.11436943709850311, -0.0011266196379438043, 0.09849665313959122, 0.0459875613451004, 0.07226716727018356, -0.025961697101593018, -0.07092402130365372, -0.03302011266350746, 0.020435743033885956, 0.09801604598760605, 0.03778378665447235, 0.053589411079883575, 0.008344369009137154, 0.03891393914818764, -0.03525461629033089, 0.021673785522580147, -0.013948892243206501, -0.039634138345718384, -0.022625872865319252, -0.08890825510025024, -0.025006629526615143, -0.0875101163983345, -0.011736065149307251, 0.004428795538842678, 0.05762000009417534, -0.054609574377536774, -0.025450877845287323, 0.004781668074429035, -0.07576342672109604, 0.015453373081982136, -0.017238236963748932, 0.014264276251196861, 0.035170555114746094, -0.012258409522473812, -0.0005339007475413382, 0.11304575204849243, -0.029488539323210716, 0.0321272611618042, 0.003629597369581461, 0.017583070322871208, -0.0911291092634201, -0.021037669852375984, 0.019164254888892174, 0.0029067385476082563, 0.008514020591974258, 0.08085466176271439, 0.009134971536695957, -0.054290883243083954, 0.020659152418375015, 0.036590248346328735, 0.029231751337647438, 0.02218625135719776, 0.054787252098321915, 0.0016367542557418346, 0.02313120663166046, 0.044869352132081985, -0.010878908447921276, 0.08542952686548233, -0.015933159738779068, 0.01868794858455658, 0.09910184890031815, 0.01718217507004738, 0.039166226983070374, -4.779157336542994e-08, -0.0015744607662782073, 0.06141692399978638, -0.1337420493364334, -0.053734228014945984, 0.008843119256198406, -0.07822994887828827, -0.035124100744724274, -0.047530438750982285, -0.017308887094259262, 0.042277466505765915, 0.018285183236002922, -0.046897731721401215, -0.07828279584646225, 0.01716802269220352, -0.01883259415626526, -0.0087888790294528, -0.10490915179252625, 0.05690820887684822, -0.04240027070045471, -0.09581783413887024, 0.028394021093845367, 0.06046133115887642, 0.040168363600969315, -0.03708978369832039, 0.005630175117403269, -0.014699416235089302, 0.019448954612016678, 0.05695877969264984, -0.015500308014452457, -0.03625503182411194, -0.04090927168726921, 0.049706168472766876, -0.09688153862953186, -0.027904655784368515, 0.10044822841882706, -0.02006119303405285, -0.0704805925488472, -0.05223032459616661, 0.011616557836532593, 0.029204482212662697, -0.03682629019021988, -0.005779387895017862, 0.029963495209813118, 0.05149504914879799, 0.04429837688803673, 0.0005291539127938449, 0.025189002975821495, -0.04386178031563759, -0.033012859523296356, -0.00621646735817194, -0.06030772998929024, -0.0638604536652565, -0.0023107437882572412, -0.004899112973362207, -0.022035934031009674, 0.06085431948304176, 0.03003646247088909, 0.035310015082359314, 0.09954293072223663, -0.07362747937440872, 0.04799167439341545, 0.021128563210368156, -0.042584192007780075, 0.006853726226836443 ] }, { "text": "## Devops MLOps LLMOps\n\nI've combined the presentation notes and get a little help from chatgpt to prepare this chart. It shows the differences\nbetween Devops, MLOps and LLMOps Practices. The presentations are: \n\n- From Devops to MLOps fro Majd Jamaah - Beyond Limits, GDE\n- From Ideation to production: GENAI Application Development and LLMOps from Emrah Mete - Microsoft\n\n
\n \n
\n
", "source": "2024-11-09-devfest_notes.md", "type": "markdown", "chunk_id": "2024-11-09-devfest_notes.md_1", "embedding": [ 0.010864118114113808, -0.02155788242816925, 0.10308511555194855, -0.04895143583416939, 0.07072272151708603, -0.05922194942831993, -0.04550660401582718, 0.08105282485485077, 0.04649216681718826, 0.0314178541302681, 0.00501966243609786, 0.008798355236649513, -0.051342353224754333, 0.002354371128603816, 0.014165427535772324, 0.003986797761172056, 0.08141409605741501, -0.10976795852184296, 0.003637590678408742, -0.005157821346074343, 0.07340133935213089, -0.06883803755044937, 0.03466208279132843, -0.016663024201989174, 0.13603730499744415, 0.05300193279981613, 0.0017694765701889992, 0.09072741866111755, 0.027632102370262146, -0.026624144986271858, -0.04089530557394028, 0.009755776263773441, 0.03256535157561302, 0.009780778549611568, -0.047655463218688965, 0.10434137284755707, 0.0933762788772583, 0.020421713590621948, -0.0022756895050406456, 0.008977582678198814, -0.010076498612761497, -0.056787244975566864, 0.021668536588549614, -0.053568195551633835, 0.037252023816108704, -0.027752133086323738, -0.11429097503423691, -0.10313059389591217, -0.08406159281730652, 0.04747343063354492, -0.008928371593356133, -0.0709749385714531, -0.02555927447974682, -0.008906769566237926, 0.025498410686850548, -0.018917705863714218, 0.0700976625084877, -0.025757674127817154, 0.07616916298866272, -0.03946683555841446, -0.040251776576042175, -0.03622432053089142, 0.0004892940050922334, -0.01594473235309124, 0.08026773482561111, -0.0032011009752750397, -0.01987420953810215, 0.04037638008594513, -0.017938224598765373, -0.05172267183661461, -0.04102728143334389, -0.033867571502923965, -0.02587583102285862, -0.03420993313193321, -0.06586946547031403, 0.02317058853805065, -0.016134995967149734, 0.005211148876696825, 0.01789378747344017, -0.09021666646003723, 0.08182470500469208, 0.10540559142827988, -0.03314999118447304, 0.039608657360076904, -0.10567134618759155, -0.0028217609506100416, -0.0012584301875904202, 0.044044654816389084, 0.048587679862976074, -0.022780898958444595, -0.04030532017350197, 0.004381620325148106, -0.07063055783510208, 0.13349471986293793, -5.2015340770594776e-05, -0.01054212637245655, -0.04288339242339134, -0.049478549510240555, -0.02312774397432804, 0.0063275923021137714, 0.04308647662401199, -0.00017573207151144743, 0.03426592797040939, -0.04540928080677986, -0.06741531193256378, -0.038166873157024384, -0.04369162395596504, -0.0017031203024089336, 0.004018475767225027, -0.05410585179924965, -0.03425918519496918, 0.0762331560254097, -0.06506028026342392, 0.03727177530527115, 0.012164630927145481, -0.011430571787059307, -0.05442997068166733, -0.009712610393762589, 0.03397909924387932, 0.0019291668431833386, 0.10543280094861984, 0.03147663548588753, 0.0011470011668279767, -0.03346548229455948, -0.006895098369568586, -0.02778071165084839, -0.07017089426517487, 8.171434286061746e-33, 0.10030427575111389, -0.07381833344697952, -0.06993509083986282, 0.0767105370759964, 0.10844219475984573, 0.0436120368540287, -0.10145113617181778, -0.01163923367857933, -0.02600870281457901, 0.0059301177971065044, -0.0186118446290493, 0.021609080955386162, -0.07529335469007492, 0.029558353126049042, 0.0360025092959404, -0.04548836126923561, 0.022337067872285843, 0.09022264927625656, -0.02779715321958065, -0.03015408106148243, -0.12085699290037155, 0.009871486574411392, -0.01965699903666973, 0.05298195779323578, 0.09294188022613525, 0.11113826185464859, 0.054608963429927826, 0.013642331585288048, -0.059151791036129, 0.0246498491615057, -0.013536105863749981, 0.059923455119132996, 0.04493905231356621, -0.027880102396011353, -0.01897132210433483, -0.007289168890565634, -0.05911526083946228, -0.0810791626572609, 0.011784474365413189, -0.009156998246908188, -0.08110006153583527, -0.022366398945450783, -0.001653751591220498, -0.040614258497953415, 0.006645177491009235, 0.031768202781677246, 0.009275936521589756, -0.05538740009069443, 0.09534797072410583, 0.020109081640839577, -0.007909197360277176, 0.02790384367108345, -0.025787638500332832, -0.03922751918435097, 0.05839948356151581, -0.14119106531143188, -0.005385773256421089, -0.05224647372961044, -0.02009674534201622, 0.01692815311253071, 0.03083575703203678, 0.0402129590511322, 0.003771035000681877, -0.0006246234988793731, 0.01937652938067913, 0.04210634157061577, -0.07985495030879974, 0.006705435924232006, 0.041624680161476135, 0.03317597135901451, 0.009530652314424515, 0.046787213534116745, 0.06963534653186798, -0.004555082879960537, -0.07178910821676254, -0.01058819517493248, -0.026620805263519287, 0.0668950229883194, -0.01593966782093048, 0.0677732303738594, -0.051091987639665604, 0.005688198376446962, -0.06699063628911972, -0.12423676997423172, -0.027989985421299934, -0.028400128707289696, 0.022677047178149223, 0.0376862995326519, 0.021120700985193253, 0.02789376676082611, -0.07596499472856522, -0.017634285613894463, -0.06607390940189362, -0.0013147816061973572, -0.029227884486317635, -7.968597593039576e-33, -0.021485237404704094, 0.134566530585289, -0.07769493013620377, 0.06402918696403503, -0.010330963879823685, 0.0020940175745636225, 0.04547698795795441, 0.007793709635734558, 0.05236252024769783, 0.03855537995696068, -0.045348722487688065, -0.05900365114212036, -0.09539046138525009, -0.07213136553764343, -0.040409401059150696, -0.05463163182139397, 0.02527431771159172, -0.07194803655147552, -0.008436189964413643, -0.002592480508610606, 0.011075944639742374, 0.040349677205085754, -0.0347679927945137, 0.018208784982562065, 0.023423384875059128, 0.018035296350717545, -0.03948698192834854, -0.03245699778199196, -0.04399644210934639, -0.0656462237238884, 0.08131255954504013, -0.05286305770277977, -0.024891266599297523, -0.0024456712417304516, 0.046619314700365067, -0.02528652548789978, 0.04384353756904602, -0.022053299471735954, 0.043761517852544785, -0.026948777958750725, 0.04868040606379509, -0.02668602578341961, -0.030089974403381348, 0.00557249691337347, -0.05601181834936142, 0.04344003275036812, -0.002917626639828086, -0.0734969899058342, 0.10891808569431305, -0.022330202162265778, 0.024061955511569977, -0.0016259182011708617, 0.02587803453207016, -0.07925873249769211, 0.017017299309372902, -0.0844765156507492, 0.021560223773121834, 0.0005500820116139948, -0.14075227081775665, 0.022229241207242012, 0.028845421969890594, -0.013908814638853073, 0.03666241839528084, -0.031909529119729996, -0.049689408391714096, 0.027507126331329346, -0.024520985782146454, 0.005295916460454464, -0.006635358091443777, 0.058453552424907684, -0.003759585553780198, -0.04639922454953194, 0.0068280999548733234, -0.10191161930561066, 0.0260146576911211, -0.01737290434539318, 0.01895144395530224, 0.027405377477407455, 0.02715253457427025, -0.04114101827144623, 0.00043465232010930777, 0.0006272754981182516, 0.013742797076702118, 0.10140702873468399, -0.03896843641996384, 0.09033980220556259, 0.0021335603669285774, 0.048940565437078476, 0.020662033930420876, 0.015460731461644173, -0.0747421532869339, 0.029108503833413124, 0.024910524487495422, 0.08460380136966705, 0.11363378167152405, -5.1827885982902444e-08, -0.012546448037028313, -0.0123574398458004, -0.048494741320610046, -0.04178481921553612, -0.0070647322572767735, 0.01131729781627655, 0.0019121493678539991, 0.10142809897661209, -0.003493956523016095, 0.10433761030435562, 0.013000568374991417, -0.01802811771631241, -0.06915352493524551, -0.04456838592886925, 0.06763798743486404, -0.021526381373405457, -0.010087016969919205, 0.06661292910575867, -0.01636345498263836, -0.054784297943115234, 0.017860528081655502, -0.010804958641529083, 0.04165467992424965, 0.0016237247036769986, -0.06036602333188057, -0.011073547415435314, -0.024303395301103592, 0.08335097134113312, -0.037432923913002014, 0.02652152255177498, 0.05441437289118767, -0.018757633864879608, -0.03221572935581207, 0.03588879480957985, 0.011291523464024067, -0.08084096014499664, -0.09011458605527878, 0.022714076563715935, 0.1132579892873764, 0.07660538703203201, -0.004968287888914347, -0.05924328416585922, 0.0408787801861763, 0.0646028146147728, -0.04494886100292206, 0.043168649077415466, -0.06630298495292664, -0.06939242780208588, -0.08046278357505798, 0.024296991527080536, -0.04705970361828804, -0.04423489421606064, -0.0018915105611085892, 0.047235868871212006, 0.0899803414940834, 0.012523259967565536, 0.08437156677246094, 0.03945164382457733, 0.08698664605617523, 0.03751128539443016, 0.007752949371933937, 0.015901586040854454, 0.017944185063242912, -0.018841750919818878 ] }, { "text": "## Useful Links\n\nGoogle Trainings: https://cloud.google.com/learn/training/machinelearning-ai\n\nAlpha Proteo: https://deepmind.google/discover/blog/alphaproteo-generates-novel-proteins-for-biology-and-health-research/\n\nNobel Prize: https://deepmind.google/discover/blog/demis-hassabis-john-jumper-awarded-nobel-prize-in-chemistry/\n\nGemini Long Context Kaggle Competition: https://www.kaggle.com/competitions/gemini-long-context\n\nAgents:\n- https://haystack.deepset.ai/cookbook/web_enhanced_self_reflecting_agent?utm_campaign=developer-relations&utm_source=devfest-ist-2024&utm_medium=presentation\n- https://github.com/daronyondem/codesamples/tree/main/AutoGen\n- https://lilianweng.github.io/posts/2023-06-23-agent/", "source": "2024-11-09-devfest_notes.md", "type": "markdown", "chunk_id": "2024-11-09-devfest_notes.md_2", "embedding": [ -0.1508382260799408, -0.06490985304117203, -0.04117680713534355, 0.001311899977736175, 0.017650026828050613, 0.04546463489532471, -0.017980674281716347, 0.07247927784919739, -0.10268841683864594, 0.01969580352306366, -0.007898164913058281, -0.030392520129680634, -0.06107652932405472, -0.00455754017457366, -0.0668846070766449, 0.09200078994035721, 0.02765910141170025, 0.04114333540201187, -0.052180081605911255, -0.09697000682353973, 0.055228933691978455, -0.0552351288497448, 0.06262737512588501, -0.01384786982089281, -0.005734043661504984, -0.07040659338235855, -0.01276304293423891, -0.04261917248368263, 0.07100275158882141, -0.04910511523485184, 0.019923517480492592, 0.02385331131517887, 0.052048444747924805, 0.010449445806443691, -0.03722153976559639, 0.07639508694410324, -0.08983714878559113, 0.0022722205612808466, -0.041220713406801224, -0.04884139075875282, 0.07368077337741852, -0.08097536861896515, 0.010206447914242744, 0.0014252561377361417, 0.08411280810832977, 0.016664262861013412, -0.06176863983273506, 0.0059966170229017735, -0.02214002050459385, 0.010743879713118076, -0.12166272103786469, -0.1080867126584053, -0.02360072359442711, 0.01941097341477871, -0.02223055623471737, 0.018379751592874527, -0.044590480625629425, -0.010362609289586544, -0.020210808143019676, -0.04845566302537918, 0.07165556401014328, -0.013729517348110676, -0.04919040948152542, -0.007472265511751175, 0.03450322523713112, 0.029246827587485313, -0.009762837551534176, 0.07907237857580185, 0.07157915085554123, -0.08230699598789215, 0.02243761718273163, -0.059162940829992294, -0.016326773911714554, 0.054156139492988586, 0.10410282015800476, 0.050193436443805695, -0.059659168124198914, 0.015484414994716644, 0.028395045548677444, -0.030071746557950974, -0.02784515544772148, -0.00899957399815321, 0.06768495589494705, 0.08133062720298767, 0.014668261632323265, 0.03233227878808975, 0.028931347653269768, 0.041051141917705536, 0.02275852859020233, 0.03322548046708107, 0.04283023625612259, -0.05186494067311287, 0.008399649523198605, -0.018060283735394478, -0.03397248312830925, 0.07843859493732452, 0.0029926251154392958, -0.09201880544424057, 0.05995636805891991, 0.01843627728521824, -0.0007776212296448648, 0.013897218741476536, -0.027032671496272087, -0.006909373681992292, -0.02327042631804943, -0.010771115310490131, -0.0006375137018039823, 0.01634368486702442, 0.09221208840608597, -0.008260122500360012, -0.05020124092698097, 0.047447770833969116, 0.05292076990008354, -0.03800639510154724, 0.05528637766838074, 0.05657709389925003, -0.019065573811531067, 0.04380740970373154, 0.1360033005475998, 0.04135771840810776, -0.013261462561786175, -0.024406956508755684, -0.05293843895196915, -0.024564865976572037, -0.028118254616856575, 0.0513707734644413, -0.0890362411737442, 2.2951446384568545e-33, 0.0646924152970314, 0.0420549102127552, 0.027808701619505882, 0.07042480260133743, -0.03352038934826851, -0.05453121289610863, -0.01785885915160179, -0.05931989476084709, -0.08747941255569458, -0.0020943707786500454, -0.06543927639722824, 0.0541670136153698, -0.021509993821382523, 0.09299413859844208, -0.032998956739902496, -0.08486459404230118, -0.09941912442445755, 0.03342556953430176, 0.05776870995759964, 0.003859912045300007, 0.020299946889281273, 0.04475517198443413, -0.028272036463022232, -0.015227125026285648, 0.10005559027194977, 0.07776377350091934, 0.014661144465208054, -0.003521264996379614, -0.013157769106328487, 0.0013790481025353074, -0.04679471254348755, 0.05186358094215393, -0.07787183672189713, 0.034854453057050705, -0.023837603628635406, 0.037091758102178574, -0.09587664157152176, -0.10285945236682892, 0.00405599782243371, 0.0469621866941452, 0.015739234164357185, 0.03441968932747841, 0.044526368379592896, -0.07383975386619568, -0.019697654992341995, -0.05419895797967911, -0.02475937455892563, 0.021811015903949738, 0.04176288843154907, -0.02292228303849697, 0.035583216696977615, 0.01353489886969328, -0.017553849145770073, -0.09747281670570374, 0.023273872211575508, 0.0820702463388443, -0.03545916825532913, 0.012655111961066723, 0.031967613846063614, 0.05983666330575943, 0.029766255989670753, 0.039213839918375015, -0.052494436502456665, 0.04186093807220459, -0.024017373099923134, 0.026211392134428024, -0.08248406648635864, -0.08188781142234802, 0.04541601240634918, 0.05698950216174126, -0.01906997710466385, 0.021327253431081772, -0.0007368654478341341, -0.08402077853679657, 0.00790642574429512, -0.05179193615913391, -0.01186212059110403, -0.0459924079477787, -0.08498018234968185, 0.037975333631038666, -0.04216722026467323, 0.05278371274471283, 0.004968175198882818, 0.020834289491176605, -0.08522994816303253, -0.0484221987426281, 0.010653134435415268, -0.1035032719373703, -0.04900200292468071, -0.04327591508626938, 0.04303858429193497, -0.05427749454975128, -0.02760258875787258, 0.02994605526328087, -0.06585204601287842, -2.6308592128959764e-33, 0.011776704341173172, -0.04573773592710495, 0.026852866634726524, 0.08684059977531433, 0.11782044917345047, 0.011278083547949791, 0.00461183674633503, 0.03869173675775528, 0.039478715509176254, 0.055366840213537216, 0.04064129292964935, 0.012828136794269085, 0.05350756272673607, -0.054305125027894974, 0.0007068921695463359, -0.06008530408143997, -0.03532727062702179, -0.012621650472283363, 0.004850557539612055, 0.029158473014831543, 0.03147641941905022, 0.14169470965862274, -0.06107954680919647, -0.03584110736846924, 0.03272630646824837, -0.03393839672207832, 0.026307139545679092, 0.0867898166179657, -0.025478608906269073, -0.0036806664429605007, -0.032740313559770584, 0.022269058972597122, -0.10678346455097198, -0.017089951783418655, -0.06195346638560295, 0.0855802595615387, 0.07946635782718658, -0.01774097979068756, 0.02053983323276043, -0.043655794113874435, 0.07177896797657013, 0.0007332711247727275, -0.04432601481676102, -0.002866383409127593, -0.02999054081737995, 0.0642225444316864, -0.0885872021317482, 0.0857766643166542, 0.0386342778801918, 0.0038425251841545105, 0.04796219617128372, -0.02212441712617874, -0.0654694139957428, -0.04648032784461975, -0.06347604840993881, 0.004061088431626558, 0.037248577922582626, -0.00020586300524882972, 0.0076967389322817326, 0.04268917068839073, -0.09689334034919739, -0.04696964472532272, 0.007118664216250181, 0.028621681034564972, -0.04895441606640816, -0.01958398148417473, -0.015199044719338417, 0.08775249123573303, 0.0005633411929011345, -0.02444453351199627, 0.08358035981655121, 0.056606993079185486, 0.08537960797548294, 0.05525456368923187, 0.024398313835263252, -0.026335958391427994, -0.026458244770765305, 0.004062246531248093, 0.014267107471823692, -0.10691376775503159, -0.08399154245853424, 0.00806061364710331, 0.020001687109470367, 0.09349076449871063, 0.052046261727809906, 0.056444257497787476, -0.013423876836895943, 0.07830453664064407, 0.014224966987967491, 0.05532848462462425, -0.029169775545597076, -0.027693243697285652, -0.018368957564234734, 0.09022698551416397, -0.0026846295222640038, -5.652461609884085e-08, 0.08914142847061157, -0.0067436848767101765, 0.023384617641568184, -0.013414803892374039, -0.04140346124768257, 0.029027024284005165, -0.024787776172161102, 0.041858475655317307, -0.013005136512219906, 0.05274021998047829, 0.0036273382138460875, 0.06773428618907928, -0.05557345971465111, 0.012399496510624886, -0.006822566036134958, 0.011472352780401707, -0.009248092770576477, 0.08193138241767883, -0.0799756869673729, -0.051708001643419266, 0.06594198197126389, 0.03385074809193611, -0.02064114809036255, -0.018095970153808594, 0.03971228748559952, -0.04585336148738861, 0.010422362945973873, 0.018523579463362694, -0.03517940640449524, -0.012368052266538143, -0.07766252756118774, 0.031654585152864456, 0.049526553601026535, -0.10652858018875122, 0.05505290627479553, 0.12406884878873825, -0.033871620893478394, -0.08745936304330826, -0.03190043941140175, 0.019769741222262383, -0.0007314237882383168, 0.03554856777191162, -0.029470520094037056, -0.008828689344227314, 0.015496840700507164, -0.03427660092711449, -0.0031281441915780306, -0.043918460607528687, 0.04364369064569473, 0.05108535662293434, 0.046303264796733856, -0.0636015459895134, -0.011967544443905354, -0.06801223009824753, -0.007212909869849682, 0.047415975481271744, -0.0009135707514360547, -0.0851730927824974, 0.0955573096871376, -0.02119368128478527, 0.012186847627162933, 0.016007522121071815, 0.0331803523004055, 0.024254262447357178 ] }, { "text": "Run Language Models: \n- https://ollama.com/\n- https://lmstudio.ai/\n- https://www.microsoft.com/en-us/research/blog/introducing-autogen-studio-a-low-code-interface-for-building-multi-agent-workflows/", "source": "2024-11-09-devfest_notes.md", "type": "markdown", "chunk_id": "2024-11-09-devfest_notes.md_3", "embedding": [ 0.010601120069622993, -0.08338005840778351, -0.04975741729140282, -0.026056772097945213, -0.04186387360095978, 0.013828095979988575, -0.06550111621618271, 0.05318873003125191, -0.027474040165543556, -0.02748924493789673, -0.07522691786289215, -0.11418239027261734, 0.030404485762119293, -0.0021515232510864735, 0.06828378885984421, 0.060860566794872284, 0.029434684664011, -0.02558453008532524, -0.018803002312779427, -0.09662888944149017, 0.04692649841308594, -0.02070116065442562, -0.0468442365527153, -0.008569174446165562, -0.02650342881679535, -0.006932102609425783, 0.03186384215950966, -0.023866960778832436, 0.02346293069422245, 0.030301610007882118, 0.04022093117237091, 0.058069292455911636, 0.0336204431951046, 0.09171142429113388, 0.06586015224456787, 0.060563165694475174, -0.093004509806633, 0.010910946875810623, 0.007978363893926144, -0.022982241585850716, -0.05656057968735695, 0.031979870051145554, -0.015917496755719185, -0.06456493586301804, 0.035444676876068115, -0.0657033920288086, -0.07163094729185104, -0.04441786929965019, -0.05207534506917, -0.023549914360046387, -0.07960296422243118, -0.08279828727245331, -0.005061320029199123, -0.024260034784674644, -0.02549830451607704, -0.048907890915870667, 0.051417719572782516, 0.0003684679395519197, -0.011644099839031696, -0.08026854693889618, 0.011217620223760605, 0.011738145723938942, -0.0017241856548935175, -0.016478920355439186, -0.06284726411104202, 0.04552202299237251, -0.0358765572309494, 0.05437072739005089, -0.00042079066042788327, -0.06330126523971558, -0.0925721600651741, -0.04719070717692375, -0.022955486550927162, 0.011849970556795597, -0.016762135550379753, -0.054160911589860916, -0.01757415384054184, -0.012551394291222095, 0.022400926798582077, -0.06762444227933884, -0.025643551722168922, -0.0024093426764011383, -0.038203828036785126, 0.09615623950958252, -0.0017463407712057233, 0.034426555037498474, 0.05480555072426796, 0.052986789494752884, 0.07412394881248474, 0.04660662263631821, 0.004853765480220318, 0.002288288436830044, 0.04130827635526657, 0.014133190736174583, 0.09140156209468842, 0.04537535086274147, 0.03148886561393738, -0.06725883483886719, 0.007526935078203678, 0.03199145942926407, -0.059555958956480026, -0.01486387848854065, 0.06837978959083557, -0.008432249538600445, -0.028188925236463547, 0.04044540226459503, 0.12463739514350891, -0.000629758054856211, 0.006497965659946203, -0.09450864046812057, -0.013068174943327904, 0.022157326340675354, 0.0283276978880167, -0.03426460176706314, 0.02543005533516407, 0.03602258861064911, 0.07877698540687561, -0.01894151233136654, 0.004215484019368887, 0.08428612351417542, -0.051077406853437424, -0.028081100434064865, -0.014391602948307991, 0.020548712462186813, 0.07426220923662186, 0.022185994312167168, -0.024513576179742813, -4.59777423719257e-33, 0.04369345307350159, 0.017548175528645515, -0.03257933631539345, 0.06517051160335541, 0.12782223522663116, -0.04872359335422516, 0.06542826443910599, -0.014254649169743061, -0.03358570858836174, -0.04620084911584854, 0.05137668922543526, 0.056339532136917114, -0.10206644982099533, 0.06542646139860153, -0.054923541843891144, -0.07001639157533646, -0.01127745769917965, 0.0675184354186058, 0.06112195923924446, 0.04676324874162674, 0.01600983366370201, -0.05094688758254051, 0.006571395788341761, 0.048945941030979156, 0.05609702691435814, 0.06233826279640198, 0.05891804397106171, -0.03674481436610222, 0.08000687509775162, -0.008131824433803558, -0.03697461262345314, -0.002103309379890561, 0.020404227077960968, 0.06799869984388351, -0.0643414631485939, -0.0028675696812570095, -0.13369494676589966, 0.023092234507203102, 0.07291392982006073, 0.05998491123318672, 0.017697790637612343, 0.030107976868748665, 0.08306214958429337, -0.1060129776597023, 0.0131770558655262, 0.004538459703326225, -0.018106164410710335, -0.007505728397518396, 0.043949831277132034, -0.06588756293058395, 0.10656039416790009, 0.022320762276649475, -0.0341886505484581, 0.0176062174141407, 0.04201773554086685, 0.01745232194662094, -0.043673787266016006, 0.03525794297456741, 0.05995536968111992, 0.033120207488536835, -0.07726198434829712, 0.03320317715406418, -0.05516980588436127, 0.08053918927907944, 0.10073503106832504, -0.03991222009062767, -0.0020613118540495634, 0.0019040002953261137, 0.08405116945505142, -0.026193981990218163, -0.006623989436775446, -0.05543062835931778, 0.0402216874063015, 0.0336013101041317, 0.0011863148538395762, 0.0024677009787410498, -0.001242079888470471, -0.10432252287864685, -0.003128210548311472, -0.02478647790849209, -0.06662972271442413, 0.04041437432169914, 0.007215556222945452, -0.0038165629375725985, 0.07381182163953781, -0.03623097389936447, -0.06105950474739075, 0.021563636139035225, -0.05066205933690071, 0.013123507611453533, -0.02492334134876728, -0.03420887887477875, 0.00042207291699014604, 0.041591692715883255, 0.025449834764003754, 2.1751009512989747e-33, -0.01980896294116974, -0.02348911017179489, -0.06519594043493271, 0.0670451894402504, 0.0018483627354726195, -0.035963889211416245, -0.02744091860949993, -0.04440600797533989, 0.02409612014889717, 0.04766891524195671, 0.024185841903090477, -0.0491383820772171, 0.0481489896774292, 0.006921157706528902, 0.01226178277283907, -0.12591104209423065, 0.07973826676607132, -0.026402128860354424, 0.1006486713886261, 0.0921584963798523, -0.012639769352972507, 0.07235592603683472, -0.05466752126812935, -0.04367554187774658, 0.011272547766566277, 0.017878174781799316, -0.08693227171897888, 0.05099911987781525, -0.016567781567573547, -0.014609797857701778, 0.024372028186917305, 0.006168026477098465, 0.02523992769420147, -0.03829360380768776, -0.03183596953749657, 0.03451524302363396, 0.016521884128451347, -0.0018029443453997374, -0.014343171380460262, 0.03161172196269035, 0.09384238719940186, -0.12353114783763885, -0.07833660393953323, -0.058069370687007904, -0.05867498368024826, 0.05374184250831604, -0.11354227364063263, 0.014575323089957237, -0.020600710064172745, -0.0734163448214531, -0.07771464437246323, -0.011195501312613487, -0.023686368018388748, -0.10499206930398941, -0.03992559760808945, -0.02620013616979122, 0.0923854261636734, -0.017173312604427338, -0.046865854412317276, 0.0023003893438726664, -0.07849021255970001, -0.008740642108023167, 0.09711183607578278, -0.03737308457493782, -0.006570241879671812, 0.011378184892237186, -0.055556170642375946, 0.034418199211359024, -0.0618596151471138, -0.039829764515161514, 0.09285328537225723, 0.012684865854680538, -0.06418898701667786, 0.08898985385894775, 0.02294261008501053, -0.055385880172252655, -0.056788645684719086, -0.03231925144791603, 0.09280652552843094, -0.04473224654793739, -0.015950381755828857, 0.08268222212791443, 0.047296665608882904, 0.002464125631377101, -0.0662115141749382, 0.012525701895356178, -0.053141240030527115, 0.0517219640314579, 0.029393650591373444, 0.04124699532985687, -0.031632840633392334, 0.023587511852383614, 0.027506312355399132, 0.008628198876976967, -0.08757603168487549, -3.595881636897502e-08, 0.009548754431307316, 0.01957670785486698, 0.03903970867395401, 0.0011010827729478478, -0.05957641080021858, -0.04828453063964844, -0.06910133361816406, 0.05626850575208664, 0.10923437029123306, 0.0523512102663517, -0.014876743778586388, -0.06369824707508087, -0.008333799429237843, 0.02186405658721924, 0.0015694393077865243, 0.03217864781618118, 0.006507510785013437, 0.016973180696368217, -0.007088772486895323, -0.05183485522866249, 0.052848007529973984, 0.02738870680332184, -0.0030498900450766087, 0.037922974675893784, 0.03561704233288765, -0.06867662072181702, 0.0456421859562397, -0.015665069222450256, -0.0025146128609776497, 0.03490272909402847, 0.05423891544342041, 0.033212799578905106, 4.939585051033646e-05, 0.0026143137365579605, 0.021436385810375214, 0.01933976262807846, 0.016313347965478897, -0.031599875539541245, 0.018687119707465172, -0.07384568452835083, 0.07777226716279984, 0.03169361501932144, -0.07997142523527145, -0.09360066801309586, 0.05608455836772919, -0.02516648918390274, -0.06975714862346649, -0.13047653436660767, 0.03695106506347656, -0.03360162302851677, -0.048479046672582626, 0.038582466542720795, -0.02343866229057312, 0.08648468554019928, 0.052828919142484665, 0.017716292291879654, 0.000690485117956996, -0.048699941486120224, 0.146462082862854, -0.02640877477824688, -0.06885642558336258, 0.036415357142686844, 0.03708657622337341, 0.013604508712887764 ] }, { "text": "---\ntitle: \"LLM Finetuning\"\nid: \"finetuning\"\ncategory: \"genai\"\ntags: [\"evaluation\", \"llm\", \"medium\", \"finetuning\"]\nrelated: [\"llm\", \"evaluation\"]\ndate: \"2023-09-17\"\ndescription: \"A practical guide to measure the model performance\"\n---\n\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/llm-finetuning-410e8a2738ef) \n\nFinetuning doesn’t have \nto be a mystery anymore! In this article, I’ve created a simple notebook that breaks down the \nprocess in an easy-to-understand way.", "source": "2023-09-17-LLM_Finetuning.md", "type": "markdown", "chunk_id": "2023-09-17-LLM_Finetuning.md_0", "embedding": [ -0.008783216588199139, -0.04547814652323723, 0.008239283226430416, -0.002926739165559411, 0.05958186089992523, -0.03661111369729042, -0.003435263643041253, 0.0228045042604208, -0.01270252000540495, -0.05089062079787254, -0.000748214777559042, 0.017930995672941208, -0.025130607187747955, -0.029500823467969894, -0.06382757425308228, 0.005434188526123762, 0.08014673739671707, 0.022647829726338387, -0.10593143105506897, -0.06900650262832642, 0.03172539919614792, 0.022607309743762016, 0.0806511640548706, -0.012664268724620342, 0.0034423789475113153, 0.0052721030078828335, -0.04581872746348381, 0.0720781460404396, 0.0766802653670311, -0.09122154116630554, 0.015047109685838223, 0.14553330838680267, -0.006764114368706942, 0.024660946801304817, -0.00627343961969018, 0.005947046913206577, -0.029370322823524475, 0.004712667316198349, 0.04218463599681854, -0.042311232537031174, 0.05886422470211983, -0.04268568381667137, 0.03721390292048454, 0.007644362282007933, 0.07791928946971893, -0.05541103333234787, -0.0650188997387886, -0.06231231614947319, -0.08343569934368134, -0.001659258035942912, -0.09447090327739716, -0.00509381340816617, -0.04492562264204025, 0.00790783017873764, -0.01779819466173649, 0.0631800964474678, -0.011165499687194824, -0.075422503054142, -0.004612828604876995, -0.005258114077150822, -0.027392499148845673, -0.004588482901453972, -0.06418868899345398, 0.03970079496502876, 0.062222305685281754, -0.006458330899477005, -0.03299388661980629, 0.09436057507991791, 0.009904262609779835, -0.027534808963537216, 0.012180213816463947, -0.004262943286448717, 0.007566583808511496, 0.03410319983959198, -0.034457236528396606, -0.010000139474868774, -0.038985446095466614, 0.04093135893344879, 0.04259360954165459, -0.04959292337298393, -0.0029210569337010384, -0.021771647036075592, 0.00971301831305027, 0.03635689988732338, 0.05106213316321373, -0.003743954235687852, 0.04687393829226494, -0.02458525449037552, 0.03495510667562485, 0.02675885707139969, 0.01651930995285511, -0.02921656146645546, 0.01274582464247942, 0.033153656870126724, 0.0140750203281641, 0.07734698802232742, 0.02793395146727562, -0.13237419724464417, -0.040744952857494354, 0.10736339539289474, 0.003222987288609147, 0.08166106045246124, 0.053251978009939194, -0.01827401854097843, -0.06445252895355225, -0.0550701767206192, 0.06908466666936874, 0.1125229075551033, -0.008654157631099224, -0.05515424162149429, 0.06577067077159882, 0.0396571010351181, 0.015934238210320473, 0.05506119504570961, 0.06150363013148308, 0.004504224751144648, 0.03472519665956497, 0.02191169373691082, 0.17098593711853027, 0.03002297878265381, -0.05468723922967911, -0.013588867150247097, -0.06352539360523224, -0.029376590624451637, -0.05238049849867821, 0.05762068182229996, -0.06092149764299393, 2.061493830395816e-33, 0.08123810589313507, -0.04640877619385719, -0.06145244091749191, 0.07149398326873779, 0.056239720433950424, 0.02109258435666561, -0.06164901703596115, 0.007233199663460255, -0.028061360120773315, 0.07032962143421173, -0.03131631389260292, 0.01461719535291195, -0.11417046934366226, 0.046738527715206146, -0.0026798390317708254, -0.0725700780749321, -0.09284614771604538, 0.08759815245866776, -0.041710905730724335, 0.0435456708073616, 0.015859805047512054, -0.03899345546960831, 0.0037304710131138563, -0.09163910895586014, 0.08578117936849594, 0.13264667987823486, 0.03191966190934181, -0.010666421614587307, -0.015987515449523926, 0.06026199460029602, -0.04400806128978729, 0.028289256617426872, -0.04820365458726883, -0.06323563307523727, -0.014019954949617386, 0.012337314896285534, -0.08769267052412033, -0.016841523349285126, 0.06648294627666473, -0.03326783329248428, -0.05056086555123329, 0.015217089094221592, -0.04443985968828201, -0.09500747174024582, -0.07312746345996857, 0.06454727798700333, -0.007366550620645285, 0.03759017959237099, 0.016417117789387703, 0.052906911820173264, -0.03136985003948212, -0.02525116130709648, -0.060778290033340454, -0.05091860890388489, -0.06502120941877365, 0.0009890819201245904, 0.03963363170623779, 0.04413409158587456, 0.019307265058159828, 0.05358075350522995, -0.00658527621999383, 0.08719904720783234, -0.08562081307172775, 0.02852228842675686, 0.06354351341724396, 0.04397803172469139, -0.03579976037144661, 0.051442950963974, 0.075357586145401, -0.10286720842123032, -0.06513263285160065, -0.06864873319864273, -0.025708653032779694, -0.03647026792168617, 0.06975674629211426, -0.07669726759195328, -0.02819599211215973, -0.029110603034496307, 0.0029508674051612616, -0.05005767568945885, 0.01059586089104414, 0.09978485852479935, -0.05439251661300659, -0.04909435659646988, -0.02939479798078537, -0.019502433016896248, -0.013948376290500164, -0.03797821328043938, -0.024758493527770042, 0.00793017540127039, 0.03539662063121796, 0.03137360140681267, -0.024212975054979324, 0.06325874477624893, -0.06869205832481384, -2.513014067516119e-33, 0.01875348761677742, -0.01729506067931652, -0.01907387189567089, 0.14984248578548431, 0.06589332967996597, -0.11697466671466827, -0.030962731689214706, 0.06930078566074371, 0.05456876382231712, -0.0010327808558940887, 0.01927272044122219, -0.022475862875580788, -0.13368971645832062, -0.01643594168126583, 0.07339125126600266, -0.05643998831510544, -0.016692453995347023, 0.004181563854217529, 0.005493416450917721, 0.031139938160777092, 0.0005191380623728037, 0.04697573557496071, -0.06546514481306076, 0.006943189539015293, -0.010916735976934433, 0.052039984613657, -0.07149233669042587, -0.017213452607393265, -0.06155122071504593, -0.0007517546764574945, -0.041709136217832565, -0.04750094562768936, -0.06358594447374344, 0.028529344126582146, -0.026450837031006813, -0.0031305206939578056, 0.08321863412857056, -0.026904288679361343, 0.0010670812334865332, 0.008726868778467178, 0.08937912434339523, 0.09685425460338593, -0.06664101779460907, 0.020076816901564598, -0.02365110255777836, 0.02322041429579258, 0.0019527787808328867, -0.06485104560852051, 0.03826870024204254, -0.02736009657382965, 0.012380010448396206, -0.03402786701917648, 0.010107366368174553, -0.03688996285200119, -0.04317249730229378, -0.025446444749832153, 0.08262278884649277, -0.07276450097560883, -0.11234864592552185, 0.019353441894054413, -0.062266379594802856, -0.043626610189676285, -0.053247492760419846, -0.006278637796640396, 0.04924997687339783, -0.025147732347249985, -0.027254419401288033, -0.01142276730388403, -0.024217471480369568, 0.01634596846997738, 0.037750642746686935, -0.02203466184437275, 0.010443616658449173, -0.07172707468271255, 0.010296277701854706, -0.06596194952726364, -0.03256363421678543, -0.01687106303870678, -0.02978277951478958, -0.06885101646184921, -0.012256773188710213, 0.0037454133853316307, -0.039611127227544785, 0.026481464505195618, -0.03417040407657623, 0.002060415456071496, 0.038667917251586914, 0.03493591025471687, -0.018415400758385658, 0.04921289533376694, 0.002137945033609867, 0.04722924903035164, -0.01898992992937565, 0.066676564514637, -0.04298996925354004, -6.249130279911697e-08, -0.08050546050071716, -0.0705803632736206, -0.11521022021770477, 0.06191258132457733, 0.01694328896701336, 0.003007578430697322, -0.04602060094475746, 0.06818310916423798, 0.040351416915655136, -0.01153004914522171, 0.08380835503339767, -0.017468489706516266, -0.11498810350894928, 0.028163010254502296, 0.02663089521229267, -0.006433447822928429, -0.015750790014863014, 0.1286524534225464, -0.07447926700115204, -0.006418711971491575, 0.07003489881753922, 0.06443425267934799, 0.08259723335504532, 0.01044208463281393, 0.07360026240348816, -0.01795002818107605, -0.03213822469115257, 0.06186642125248909, 0.024160610511898994, -0.0024404076393693686, 0.0043620942160487175, 0.06726812571287155, -0.03510279208421707, 0.0190028827637434, -0.005058730952441692, 0.05961623042821884, -0.042085714638233185, -0.02578657492995262, 0.09842587262392044, 0.005221930798143148, -0.01223117858171463, 0.035118866711854935, -0.03956089913845062, 0.062465257942676544, 0.06383103877305984, -0.06553701311349869, -0.034516651183366776, -0.060625966638326645, -0.031246954575181007, -0.046919625252485275, 0.0009269732981920242, -0.020333563908934593, 0.029140576720237732, -0.002052565570920706, -0.0027196952141821384, 0.028023570775985718, 0.018457207828760147, 0.011662352830171585, 0.002562534296885133, -0.004525989759713411, 0.08320604264736176, 0.043950386345386505, -0.005457765888422728, 0.0032982598058879375 ] }, { "text": "---\ntitle: \"Line Chart with Plotly\"\nid: \"chart\"\ncategory: \"visualization\"\ntags: [\"python\", \"visualization\"]\nrelated: [\"python\"]\ndate: \"2025-11-08\"\ndescription: \"How to make scatter plots in Python with Plotly.\"\n---\n\nIn this file I will explain how to use plotly with markers and annotation. It is very easy to plot chart in plotly express!:)\n\nLet's create two datasets: they include sales & anomalies for the first 10 days of Jan 2023.", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_0", "embedding": [ -0.007060997653752565, 0.026210790500044823, 0.03784402087330818, 0.024512814357876778, 0.0435650572180748, 0.0016270253108814359, -0.035076744854450226, -0.005912369582802057, -0.12770770490169525, -0.05585046112537384, 0.01667972281575203, 0.009554694406688213, -0.014099545776844025, 0.018960997462272644, -0.010014078579843044, -0.008415999822318554, -0.02671852335333824, -0.1035866066813469, -0.0036155807320028543, 0.014402294531464577, 0.014714207500219345, -0.031179120764136314, -0.04139428585767746, 0.06563358008861542, 0.07315607368946075, -0.02218988537788391, 0.0046492633409798145, 0.02339712344110012, -0.041913166642189026, 0.025019507855176926, -0.010737299919128418, 0.03496696427464485, -0.052389807999134064, 0.04554000869393349, 0.0224643312394619, -0.05688504874706268, 0.07516511529684067, 0.027365507557988167, 0.05028348043560982, -0.0032366567756980658, 0.022466590628027916, 0.014661679975688457, 0.007055974565446377, -0.07193566858768463, -0.021444067358970642, -0.08783207833766937, -0.06012864038348198, -0.00435506971552968, 0.0051595671102404594, 0.0757957473397255, -0.0530487559735775, -0.024868719279766083, -0.03192207217216492, -0.018150582909584045, 0.045380864292383194, 0.05254777520895004, -0.018022965639829636, -0.11288557946681976, 0.09564798325300217, -0.0767543613910675, -0.029062330722808838, 0.01288456842303276, 0.08557241410017014, -0.01184785459190607, -0.043446995317935944, -0.02486504800617695, 0.0030359718948602676, 0.11027651280164719, 0.02059401012957096, 0.0911756232380867, -0.008187105879187584, -0.027469540014863014, 0.009891962632536888, -0.03128208592534065, 0.02540295012295246, 0.051845286041498184, -0.03229865804314613, -0.010484622791409492, -0.009447298012673855, -0.1384475827217102, -0.05335250869393349, 0.007244439795613289, -0.03548786789178848, 0.03651540353894234, -0.07973358035087585, 0.022014759480953217, -0.0332014262676239, 0.02733192779123783, -0.04258294776082039, -0.024190479889512062, -0.005441116169095039, 0.03630939871072769, 0.0034883131738752127, 0.007366790436208248, -0.02226935140788555, 0.013705733232200146, 0.04004773870110512, -0.00438262801617384, -0.002217091154307127, -0.0012580954935401678, 0.05612670257687569, 0.004208832513540983, -0.018899522721767426, -0.012514136731624603, 0.005183924920856953, -0.01838616095483303, -0.05144133046269417, -0.05949290841817856, -0.054581280797719955, -0.04609733447432518, -0.03405250236392021, -0.06107742339372635, 0.007934261113405228, 0.012923854403197765, 0.037440646439790726, 0.047313984483480453, -0.05121349170804024, 0.015226203016936779, 0.004507169593125582, -0.0269002765417099, 0.0905914381146431, 0.056297268718481064, 0.0043676793575286865, 0.004884388297796249, 0.02356317825615406, 0.03445605933666229, 0.05027688667178154, 4.195924146524278e-33, 0.06392325460910797, -0.046471208333969116, -0.005216630641371012, -0.009482556022703648, 0.010090497322380543, -0.06014586612582207, -0.10903818160295486, -0.03977789729833603, -0.025741714984178543, 0.0775529146194458, 0.003270600689575076, 0.03812865540385246, 0.018633360043168068, 0.04798440635204315, -0.015396689996123314, -0.0006799941183999181, 0.12246133387088776, -0.039697375148534775, 0.0029731341637670994, 0.010733230039477348, -0.08740399032831192, -0.033764638006687164, 0.00018397494568489492, -0.04244094714522362, 0.08260959386825562, 0.008020134642720222, -0.03185692057013512, 0.09965834766626358, 0.05021606385707855, 0.025979142636060715, 0.04575290158390999, 0.03816012665629387, 0.04789086431264877, -0.012738331221044064, -0.05415096506476402, -0.038287047296762466, -0.02130705863237381, -0.04348026216030121, 0.037653032690286636, 0.05975152552127838, -0.002832521917298436, -0.011736607179045677, -0.04959656298160553, -0.015865251421928406, -0.012114050798118114, 0.125523179769516, -0.008459148928523064, 0.04083651304244995, 0.05116957798600197, 0.0011788184056058526, -0.08001334220170975, -0.02642824500799179, -0.017174236476421356, 0.02582329884171486, -0.033915624022483826, -0.00814152229577303, 0.025414057075977325, -0.062003593891859055, -0.02490416169166565, -0.06854014843702316, -0.007449916563928127, -0.028543246909976006, 0.030513335019350052, -0.0928313210606575, -0.041770726442337036, 0.07251454144716263, 0.051779843866825104, 0.046299275010824203, -0.08850958198308945, 0.005021336488425732, -0.04677629843354225, 0.042555537074804306, 0.04119472950696945, 0.0015596607699990273, 0.1025194525718689, -0.027076175436377525, 0.038620661944150925, 0.09382416307926178, -0.028442351147532463, 0.04589536413550377, -0.0013679111143574119, -0.0860806331038475, 0.016807246953248978, 0.005240478552877903, -0.026367900893092155, -0.046840060502290726, 0.023483484983444214, 0.04024035111069679, -0.04165953770279884, -0.04989413917064667, 0.005093782674521208, 0.03729185089468956, -0.042557042092084885, 0.01918506808578968, -0.026748405769467354, -6.1492049057192716e-33, -0.0019821685273200274, 0.13968905806541443, -0.002449554158374667, 0.05815630406141281, -0.013554312288761139, 0.011125613935291767, -0.049091875553131104, 0.07931255549192429, 0.0772269070148468, 0.06371032446622849, -0.08600935339927673, -0.09159121662378311, -0.02858167514204979, -0.0327812023460865, 0.07298646122217178, 0.04511471837759018, 0.022406049072742462, 0.044553667306900024, -0.04989601671695709, -0.0646616742014885, -0.04751613363623619, 0.01298950519412756, -0.08183956146240234, -0.04628005996346474, 0.0722208023071289, 0.037306055426597595, -0.047739557921886444, -0.05107155814766884, -0.06531336158514023, -0.07784504443407059, -0.06636811792850494, -0.05876610800623894, -0.04933330416679382, -0.09661025553941727, 0.01674334518611431, 0.03425173833966255, 0.06882625818252563, -0.09858077764511108, -0.01559598371386528, -0.03575173765420914, 0.030949825420975685, 0.0951286032795906, 0.0385340191423893, 0.020621927455067635, 0.026067042723298073, 0.06370773166418076, -0.0027078816201537848, 0.09006661921739578, 0.06836558878421783, 0.053574249148368835, -0.059161216020584106, 0.08906016498804092, 0.0793692022562027, -0.017831282690167427, -0.015119130723178387, -0.042108532041311264, 0.11220227926969528, 0.03463041037321091, -0.1238153949379921, -0.00434084190055728, -0.09015994518995285, -0.07290871441364288, 0.012210840359330177, 0.006838055327534676, -0.03184031695127487, -0.06684304773807526, 0.012926527298986912, -0.1442439705133438, 0.046264443546533585, -0.038548026233911514, 0.07824558764696121, -0.032743118703365326, -0.03743018954992294, 0.01373040210455656, -0.039163392037153244, 0.04795607924461365, -0.04731431230902672, -0.00720886280760169, -0.021208930760622025, 0.05467592552304268, 0.05479786545038223, -0.02565096504986286, 0.08807692676782608, 0.10709290951490402, -0.010291707701981068, 0.04246704652905464, -0.06557127833366394, 0.05208749696612358, 0.04192184656858444, 0.022254206240177155, 0.026652943342924118, -0.05792880058288574, -0.06636733561754227, 0.035369060933589935, 0.09670563042163849, -4.732600444867785e-08, 0.017723169177770615, -0.05350712314248085, 0.004063543863594532, -0.05340034142136574, 0.033086828887462616, 0.0674906075000763, 0.06152334809303284, 0.06995963305234909, -0.0053557222709059715, 0.04891504719853401, 0.03350288048386574, -0.0010860543698072433, -0.10285723209381104, -0.08878444135189056, -0.12198405712842941, 0.07358726859092712, -0.05016588047146797, 0.04843013733625412, 0.006682843901216984, 0.03702487424015999, -0.010592836886644363, -0.07099955528974533, -0.020381147041916847, 0.021963918581604958, -0.036718107759952545, -0.0225327517837286, 0.0406469851732254, 0.1141788586974144, -0.047197125852108, 0.03325994312763214, -0.021223703399300575, -0.12511126697063446, 0.0253578070551157, 0.052332889288663864, 0.0162363238632679, -0.09952254593372345, -0.03805668279528618, 0.02687220089137554, -0.06125255674123764, 0.07200273871421814, -0.00797298364341259, 0.09590562433004379, -0.060359735041856766, 0.001378265442326665, 0.07392913848161697, -0.012543993070721626, -0.061423420906066895, -0.04762031137943268, -0.00813645776361227, -0.010510072112083435, -0.061499763280153275, -0.053921688348054886, 0.027947207912802696, -0.020293399691581726, -0.026245296001434326, 0.006009482312947512, -0.030054034665226936, 0.04964563995599747, -0.033644482493400574, 0.022263728082180023, -0.022988630458712578, 0.03284543752670288, 0.00739699462428689, -0.03898346424102783 ] }, { "text": "Let's create two datasets: they include sales & anomalies for the first 10 days of Jan 2023. \n\n```python\n# create dataset\nimport pandas as pd\ndf = pd.DataFrame({\"Date\": [\"2023-01-01\", \"2023-01-02\", \"2023-01-03\", \"2023-01-04\", \"2023-01-05\", \"2023-01-06\", \"2023-01-07\", \n \"2023-01-08\", \"2023-01-09\", \"2023-01-10\"],\n \"Analysis\": [\"Normal\", \"Anomaly\", \"Normal\", \"Anomaly\", \"Anomaly\", \"Normal\", \"Normal\", \"Normal\", \"Normal\", \"Normal\"],\n \"Sales\": [120, 30, 115, 10, 5, 100, 99, 123, 134, 96]})\n\n```\n\nWe need to convert the \"date\" to datetime to show it in x axis properly. \n\n```\n# to datetime\ndf.Date = pd.to_datetime(df.Date)\ndf_with_group.Date = pd.to_datetime(df_with_group.Date)\n```\n\nHere is a simple way to plot a animation chart!", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_1", "embedding": [ -0.01760198548436165, -0.012737611308693886, 0.036117736250162125, 0.007722070906311274, 0.009325642138719559, -0.010282358154654503, -0.0065852501429617405, 0.00153453613165766, -0.039058536291122437, -0.007515940349549055, 0.06646042317152023, -0.02570924162864685, -0.07721277326345444, 0.023410839959979057, 0.03743812069296837, -0.03293698653578758, -0.007062789984047413, -0.036237865686416626, 0.057550668716430664, -0.01696363091468811, -0.023023227229714394, 0.06049035117030144, -0.056286074221134186, 0.005687098018825054, -0.02447153627872467, 0.003842472331598401, 0.06624449044466019, -0.04734222590923309, -0.02676437795162201, 0.03859284147620201, -0.06873258203268051, 0.022510023787617683, -0.058194760233163834, 0.05913449823856354, -0.0005881603574380279, 0.00951531995087862, 0.06907983124256134, 0.02139763906598091, 0.03439660742878914, 0.0018062259769067168, 0.03606173023581505, -0.03273417428135872, 0.07612842321395874, -0.057184260338544846, -0.1121525689959526, -0.00883453618735075, 0.006093211472034454, 0.009101903066039085, 0.022674664855003357, 0.05421020835638046, -0.03240647539496422, 0.018185188993811607, -0.0628838837146759, -0.0008848900906741619, 0.03117387741804123, 0.02069377712905407, 0.0001475889584980905, -0.06452856212854385, 0.062020279467105865, -0.01689332164824009, -0.012043436989188194, 0.06803810596466064, 0.015176120214164257, -0.06067562848329544, -0.026559995487332344, -0.03343227505683899, -0.027033731341362, 0.0481586754322052, -0.06250499933958054, 0.0978173017501831, -0.029746953397989273, -0.023872584104537964, -0.05551936477422714, -0.013515296392142773, -0.07702326774597168, -0.009038801304996014, 0.10726357251405716, -0.02644137106835842, -0.017482923343777657, -0.07686972618103027, -0.010799926705658436, 0.03593837097287178, -0.00012324978888500482, 0.04436735436320305, -0.0022267524618655443, -0.060103002935647964, -0.01958145759999752, 0.03083784691989422, -0.041655730456113815, -0.03359982371330261, 0.018267329782247543, 0.09709036350250244, -0.029965613037347794, 0.01813528686761856, 0.003906249301508069, -0.013963975943624973, 0.04077638313174248, 0.07142569124698639, 0.11072012782096863, 0.06670160591602325, 0.016351940110325813, 0.03225291892886162, -0.07137411087751389, -0.04812200739979744, -0.03135107830166817, -0.006087108515202999, -0.07700289040803909, -0.011697332374751568, -0.08656082302331924, -0.003960870672017336, -0.0054714796133339405, -0.02968841791152954, -0.006301257759332657, -0.0880054235458374, 0.054037559777498245, -0.042874179780483246, -0.04461526498198509, -0.05008159950375557, -0.08891795575618744, -0.004002495668828487, 0.012018921785056591, 0.10024211555719376, 0.05524010956287384, -0.005342924501746893, 0.013371606357395649, 0.009287435561418533, 0.038634832948446274, 1.8355952239074585e-33, -0.07259701192378998, -0.07292263954877853, -0.016074297949671745, -0.08198467642068863, -0.030100204050540924, 0.06825871020555496, 0.030736174434423447, -0.0746476799249649, 0.045129261910915375, 0.090622678399086, -0.022467724978923798, -0.013068638741970062, -0.057659879326820374, -0.13170355558395386, -0.014438451267778873, 0.024016980081796646, 0.0607704296708107, 0.011588224209845066, 0.028725609183311462, 0.009563080966472626, 0.007850118912756443, -0.030786843970417976, 0.02671012096107006, 0.02155987173318863, 0.016403667628765106, -0.1096326932311058, -0.02340041846036911, 0.0022027662489563227, 0.02893190085887909, -0.03460920602083206, -0.01871965453028679, 0.0661812573671341, -0.015796689316630363, 0.0011507036397233605, -0.011940494179725647, -0.07328417152166367, 0.08283059298992157, -0.013736599124968052, 0.02593705803155899, 0.012027252465486526, 0.0045191203244030476, -0.002993041882291436, -0.07335513830184937, -0.055681824684143066, 0.000570296251680702, 0.13698065280914307, 0.005526821594685316, 0.010948481038212776, 0.04667619615793228, 0.006867884658277035, -0.09900551289319992, -0.08171965926885605, 0.06727195531129837, -0.01553358230739832, -0.06985627114772797, -0.001937935478053987, 0.02322053350508213, -0.09951584786176682, -0.012261245399713516, -0.0426965206861496, -0.047128722071647644, -0.018858352676033974, 0.030142538249492645, -0.033179871737957, -0.0827900618314743, 0.03351445496082306, 0.14473965764045715, 0.049257516860961914, -0.05549541115760803, -0.011948474682867527, -0.01958215795457363, -0.03889550641179085, 0.018082857131958008, -0.015757812187075615, 0.09849108755588531, -0.03646055981516838, 0.09366050362586975, 0.1132669672369957, 0.021234067156910896, -0.012313153594732285, 0.05123911798000336, -0.00560856843367219, 0.10511376708745956, 0.001981372945010662, -0.0034615453332662582, -0.0012368723982945085, 0.0285632461309433, 0.05731094628572464, -0.0012418972328305244, -0.0840691477060318, -0.14017939567565918, -0.039692651480436325, -0.04664416238665581, 0.04640636965632439, 0.03389865905046463, -4.425085668191129e-33, 0.03858032822608948, 0.02036653272807598, 0.0037884898483753204, 0.018539706245064735, 0.09331344068050385, 0.012493576854467392, -0.13099099695682526, 0.08755246549844742, 0.011507108807563782, 0.044065553694963455, -0.0023365665692836046, -0.07443482428789139, 0.03838273137807846, -0.06955752521753311, -0.011989728547632694, 0.005741852335631847, 0.06222032010555267, 0.013441725634038448, -0.04946184903383255, -0.033278532326221466, 0.029408913105726242, 0.058605365455150604, -0.09272850304841995, -0.012148614041507244, -0.003930523991584778, 0.008778305724263191, 0.021389544010162354, 0.006345582194626331, -0.06288610398769379, -0.0225668977946043, -0.12069334834814072, -0.038852475583553314, 0.022197222337126732, 0.0002405256818747148, -0.0030106203630566597, 0.05176859349012375, 0.06433141231536865, -0.06828638166189194, -0.04759819060564041, -0.03284739702939987, 0.03079710714519024, 0.07597094774246216, -0.023039082065224648, -0.003690542886033654, 0.021243354305624962, 0.146835595369339, 0.01781594194471836, 0.01746748574078083, 0.04415568709373474, 0.030851026996970177, -0.053665436804294586, 0.08336739987134933, 0.04571022465825081, -0.003516178810968995, -0.04452811926603317, 0.016142478212714195, 0.07399919629096985, -0.021404707804322243, -0.09382318705320358, 0.016982119530439377, -0.04966234415769577, -0.11811768263578415, -0.03818599134683609, 0.009616026654839516, 0.012498629279434681, -0.047293029725551605, 0.022529752925038338, -0.07922457903623581, 0.0750403180718422, -0.03423277661204338, 0.016214584931731224, -0.013032123446464539, -0.03714332729578018, -0.039172425866127014, -0.08310187608003616, 0.03814816474914551, 0.006974412593990564, -0.02658168226480484, -0.009309406392276287, 0.05654316768050194, -0.015849914401769638, 0.002965868217870593, 0.10437660664319992, 0.09188903123140335, -0.06977491080760956, 0.038508448749780655, -0.01200520247220993, 0.015366912819445133, 0.0006898173596709967, 0.002317136852070689, -0.05380737781524658, -0.0976124107837677, -0.03733886033296585, 0.036696165800094604, 0.04656386375427246, -5.816902159949677e-08, 0.009331843815743923, 0.025371074676513672, 0.018689684569835663, -0.05097263306379318, -0.014063096605241299, -0.06234151870012283, -0.006785638630390167, 0.0020186833571642637, 0.02845740132033825, 0.037096284329891205, 0.0787372887134552, -0.05174892395734787, -0.058490365743637085, 0.0003252814640291035, -0.06488021463155746, 0.06074009835720062, -0.02541150152683258, 0.070336252450943, 0.02016461081802845, -0.013321880251169205, 0.03907482698559761, -0.06729017198085785, 0.10129109770059586, -0.04279645159840584, -0.028280459344387054, 0.03152494877576828, 0.05899050086736679, 0.07766439765691757, 0.053881771862506866, 0.07429899275302887, -0.05323798581957817, -0.06399399042129517, 0.04418250918388367, -0.020106660202145576, -0.056557632982730865, -0.11566141247749329, -0.048041123896837234, 0.01524343527853489, -0.03313649445772171, 0.021125152707099915, -0.059745918959379196, 0.03551200404763222, -0.09509194642305374, 0.07556605339050293, 0.010727199725806713, 0.04070287570357323, 0.015537789091467857, -0.033866748213768005, 0.05294015631079674, 0.015362757258117199, 0.04768912494182587, -0.026524653658270836, 0.08982997387647629, -0.08262120932340622, 0.06069807708263397, 0.08556622266769409, -0.019713159650564194, 0.02933771163225174, 0.004204078111797571, -0.0697416216135025, -0.06392718106508255, 0.06457192450761795, 0.012076400220394135, -0.00978051871061325 ] }, { "text": "Here is a simple way to plot a animation chart!\n\n```python\nimport plotly.express as px\nfig = px.line(df, x=\"Date\", y=\"Sales\", title='Daily Sales')\nfig.show()\n```\n\n
\n\n
\n\n\n\nNow it is time to mark the anomalies! We will use Graph objects for this. Start with mark the anomaly dates:\n\n```python\nanomaly_date = df[df.Analysis == \"Anomaly\"]\n```\n\nIt is required to import graph objects to mark \"anomalies\".", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_2", "embedding": [ 0.004872491583228111, -0.018932629376649857, 0.026450112462043762, 0.024745307862758636, -0.010708355344831944, -0.024398421868681908, -0.014007074758410454, 0.025643425062298775, -0.02505202405154705, -0.08631101995706558, 0.020141523331403732, 0.04080389440059662, 0.012760560028254986, 0.0027467787731438875, -0.042897164821624756, -0.02515314519405365, -0.019573448225855827, -0.04864898696541786, 0.06117301434278488, -0.0117340087890625, 0.0035083936527371407, -0.038729049265384674, -0.022626284509897232, -0.011030498892068863, 0.021416328847408295, -0.0013523154193535447, 0.023595541715621948, 0.043489038944244385, 0.008996243588626385, -0.02752167172729969, -0.06927935779094696, -0.005053320899605751, -0.004001072607934475, 0.029696928337216377, 0.05939313769340515, -0.03563495725393295, 0.0496036522090435, 0.04985528066754341, 0.05706923082470894, -0.003250787267461419, 0.032387424260377884, 0.031110696494579315, 0.057088032364845276, -0.04267290607094765, -0.06084362044930458, -0.08803543448448181, -0.07492156326770782, -0.00971926748752594, 0.01898004859685898, 0.07065337896347046, -0.03917406126856804, -0.059503450989723206, 0.02987956814467907, -0.06271734088659286, -0.0037336081732064486, -0.014394768513739109, -0.02307038940489292, -0.12686152756214142, 0.09399790316820145, -0.09635385125875473, 0.0010357509599998593, 0.06955878436565399, 0.10833264142274857, -0.01343869511038065, -0.027905024588108063, 0.011074349284172058, 0.00749650364741683, 0.07961434870958328, -0.013793107122182846, 0.11572814732789993, -0.008657318539917469, -0.04131147265434265, -0.047303035855293274, -0.05463358759880066, -0.04992561787366867, 0.002669659908860922, 0.0022765027824789286, -0.024984002113342285, -0.043147340416908264, -0.07450208067893982, -0.007816166616976261, -0.055436477065086365, -0.008454304188489914, 0.021180206909775734, -0.018239865079522133, 0.016482139006257057, 0.02199692837893963, -0.006116985809057951, 0.010911806486546993, -0.006171973887830973, -0.020740903913974762, 0.07410138845443726, 0.023489676415920258, 0.02878786250948906, 0.06983434408903122, 0.05221325904130936, 0.033192768692970276, 0.010930279269814491, 0.08531661331653595, 0.03491693362593651, 0.05638972669839859, -0.03201406076550484, 0.008840822614729404, 0.029786624014377594, -0.05059409514069557, -0.03012474998831749, -0.04966814070940018, 0.0008034564671106637, -0.03275679051876068, -0.008118708617985249, -0.07508862018585205, -0.016895797103643417, 0.03574734926223755, -0.002768685109913349, 0.037595365196466446, 0.018193064257502556, -0.014159469865262508, -0.022050976753234863, -0.03187048062682152, -0.03050743229687214, 0.10247746855020523, 0.0957573801279068, 0.02187439054250717, 0.007050232030451298, 0.042894262820482254, 0.03378867730498314, 0.018407931551337242, 4.906927782090893e-33, 0.0029247456695884466, 0.010387587361037731, -0.012179001234471798, -0.026904193684458733, 0.03297974914312363, 0.026585327461361885, -0.09419675916433334, -0.05842077359557152, 0.018129412084817886, 0.07898871600627899, -0.036762211471796036, 0.04105982556939125, 0.024839498102664948, -0.04607325419783592, -0.011807436123490334, -0.01094733364880085, 0.14073878526687622, -0.027579426765441895, 0.08966445922851562, -0.014106702990829945, -0.050248779356479645, -0.0764414370059967, -0.006383081898093224, 0.02154303900897503, -0.004969692789018154, 0.044561900198459625, 0.028706545010209084, 0.11063991487026215, -0.0031998176127672195, -0.011996395885944366, 0.06991513073444366, 0.012541002593934536, -0.012681274674832821, -0.037623994052410126, -0.017991241067647934, -0.10514441877603531, -0.006182710640132427, -0.022786930203437805, 0.02207956463098526, 0.0007438519969582558, -0.08763330429792404, -0.08202014118432999, -0.06865819543600082, -0.019862346351146698, -0.0033670642878860235, 0.13138993084430695, 0.049641624093055725, 0.05476217344403267, 0.029953032732009888, 0.02040122076869011, -0.11549555510282516, -0.006343511864542961, 0.021993381902575493, -0.02365131489932537, -0.06087801232933998, -0.004177662078291178, 0.017897769808769226, -0.10117469727993011, -0.04238620772957802, -0.06205729767680168, 0.040747616440057755, -0.02185850776731968, 0.07434333860874176, -0.10897549986839294, -0.07437281310558319, 0.05324922502040863, 0.016709091141819954, 0.030495427548885345, -0.06987271457910538, 0.09061063826084137, -0.016395358368754387, 0.010473120957612991, 0.037816330790519714, -0.03135289251804352, 0.06421542167663574, 0.0010389919625595212, 0.016431273892521858, 0.10041431337594986, -0.016520781442523003, 0.016781797632575035, -0.009191262535750866, -0.1360677182674408, 0.1177108958363533, 0.008754651062190533, 0.0020347426179796457, -0.029262252151966095, 0.02193942666053772, 0.11203634738922119, -0.0027569590602070093, 0.017415868118405342, -0.025261491537094116, -0.017665153369307518, -0.03360209986567497, 0.07859776169061661, 0.011074589565396309, -5.910186863920776e-33, 0.00969406496733427, 0.11923632025718689, -0.02402016706764698, 0.024165134876966476, 0.01711815968155861, 0.011971049942076206, -0.037903811782598495, 0.11655722558498383, 0.032796118408441544, 0.006060728337615728, -0.07295206189155579, -0.045305896550416946, -0.029920775443315506, -0.06542513519525528, 0.024898584932088852, 0.048459772020578384, 0.04911717027425766, 0.059343136847019196, -0.06643830239772797, -0.015838755294680595, -0.03528424724936485, -0.017869386821985245, -0.11145658046007156, -0.03772922605276108, 0.016607267782092094, 0.1231338307261467, -0.05119432136416435, -0.03382240980863571, -0.09973030537366867, -0.027288805693387985, -0.08003479987382889, -0.0159075278788805, 0.010701228864490986, -0.026280412450432777, 0.024221546947956085, 0.04138503968715668, 0.04269509017467499, -0.11965630948543549, -0.004234147723764181, -0.058181606233119965, -0.04300764948129654, 0.09571612626314163, 0.030332980677485466, 0.016806090250611305, 0.04690350964665413, 0.09232203662395477, 0.0056333718821406364, 0.049365971237421036, 0.018462173640727997, 0.05901385098695755, -0.08117328584194183, 0.13711991906166077, 0.0445542074739933, -0.04668809846043587, -0.052150726318359375, 0.027297336608171463, 0.04482534900307655, 0.024037249386310577, -0.1042628362774849, 0.062105219811201096, -0.07607173174619675, -0.08714929968118668, -0.014140977524220943, 0.005566150415688753, -0.020769117400050163, -0.06698091328144073, -0.014880046248435974, -0.12038403749465942, 0.05433352664113045, -0.03680212423205376, 0.06907515972852707, -0.014973442070186138, -0.11155670881271362, -0.028793975710868835, -0.0212941262871027, 0.02331939898431301, 0.018824173137545586, -0.027945758774876595, 0.001288557075895369, 0.019534196704626083, 0.04857848212122917, -0.00226372922770679, 0.09146071970462799, 0.03984658792614937, -0.07336948812007904, 0.07935973256826401, -0.05510707572102547, 0.032496172934770584, 0.009926894679665565, -0.003798514371737838, -0.023296480998396873, -0.0424024723470211, -0.07678597420454025, 0.028006788343191147, 0.10624448210000992, -5.326388574644625e-08, -0.01203235611319542, -0.019989987835288048, 0.05484727397561073, -0.06405890733003616, 0.05680643394589424, 0.007020019926130772, 0.04889454320073128, 0.06642596423625946, 0.004799177870154381, 9.4279479526449e-05, 0.047635577619075775, -0.07804702967405319, -0.052920419722795486, -0.012548889964818954, -0.07510032504796982, 0.06499660015106201, -0.02179463393986225, 0.08944299817085266, -0.015145969577133656, -0.03309441730380058, 0.006060480140149593, -0.04296860098838806, 0.008192373439669609, 0.022622698917984962, -0.06589137017726898, -0.05353192985057831, 0.014955509454011917, 0.039575353264808655, 0.009814534336328506, 0.014864708296954632, -0.04834119975566864, -0.09867066890001297, 0.10900251567363739, -0.0016735770041123033, -0.026258591562509537, -0.007925037294626236, -0.053451377898454666, -0.0400589220225811, -0.07220546901226044, 0.038185663521289825, 0.008616075851023197, 0.04099376127123833, -0.023694775998592377, 0.030303701758384705, -0.009350965730845928, 0.009659642353653908, -0.07460590451955795, -0.12285356968641281, 0.05732991546392441, 0.02731705829501152, 0.016185089945793152, -0.05376361683011055, -0.0036324989050626755, 0.00793121661990881, -0.0056417533196508884, 0.0005872827605344355, -0.009542795829474926, 0.004890883807092905, -0.03174106404185295, 0.02757348120212555, 0.00914771854877472, 0.021565904840826988, -0.005749872885644436, -0.06364172697067261 ] }, { "text": "```python\nanomaly_date = df[df.Analysis == \"Anomaly\"]\n```\n\nIt is required to import graph objects to mark \"anomalies\".\n\n```python\nimport plotly.graph_objects as go\nfig = px.line(df, x=\"Date\", y=\"Sales\", title='Daily Sales')\nfig.add_traces(go.Scatter(x=anomaly_date[\"Date\"], y=anomaly_date[\"Sales\"], mode=\"markers\", name=\"Anomaly\", \n hoverinfo=\"skip\"))\nfig.show(renderer='notebook')\n```\n\n
\n\n
\n\nIf you want to see the \"Anomaly\" as a string on the chart, you should use \"add_annotation\":", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_3", "embedding": [ 0.016544003039598465, 0.0019348713103681803, 0.023327913135290146, 0.03594067692756653, 0.03384847193956375, 3.776502489927225e-05, 0.0370883010327816, 0.009345334023237228, -0.01876222714781761, -0.07301998138427734, 0.07088165730237961, 0.06900925934314728, -0.03348071873188019, 0.015293839387595654, -0.00909717008471489, -0.00583011144772172, -0.030720073729753494, -0.07847365736961365, 0.07203071564435959, -0.006162549369037151, 0.0002545446914155036, -0.018555985763669014, -0.00314692803658545, 0.016179148107767105, 0.004925705026835203, 0.010127349756658077, 0.019479110836982727, 0.05231013894081116, -0.0032234955579042435, 0.01117243804037571, -0.04446350038051605, 0.008697601035237312, -0.055031873285770416, 0.042443256825208664, 0.05763024464249611, -0.042717330157756805, 0.03092486597597599, 0.047406166791915894, 0.1109342947602272, 0.019039908424019814, 0.05125868320465088, -0.042380087077617645, 0.035104501992464066, -0.04247285798192024, -0.04560217261314392, -0.08063109964132309, -0.016073670238256454, -0.005945539101958275, 0.07131051272153854, 0.054467685520648956, -0.037725839763879776, -0.04378575459122658, -0.029849084094166756, -0.09021921455860138, 0.0071466960944235325, 0.06036698445677757, -0.010603144764900208, -0.10253363847732544, 0.08399780839681625, -0.10388242453336716, -0.009481845423579216, -0.0003123963833786547, 0.10165977478027344, -0.014033449813723564, 0.027584975585341454, -0.013213568367064, -0.032682184129953384, 0.06710795313119888, -0.033232420682907104, 0.15061718225479126, -0.002546231960877776, -0.012625137344002724, -0.020997947081923485, -0.0005793791497126222, -0.0051767402328550816, 0.004934360738843679, -0.05002447962760925, -0.00823066383600235, -0.013695589266717434, -0.09622378647327423, -0.04476676508784294, -0.03642303869128227, 0.021477816626429558, 0.07774273306131363, 0.02782439813017845, 0.024143051356077194, -0.012507683597505093, -0.01057952269911766, -0.02324403077363968, -0.05756640434265137, 0.004514308646321297, 0.022919101640582085, -0.010241243056952953, 0.038938257843256, -0.03633909672498703, 0.011274800635874271, 0.03348102048039436, 0.040413860231637955, 0.04239080846309662, 0.03419728949666023, 0.055959302932024, -0.01571003906428814, 0.008554075844585896, 0.051108408719301224, -0.04062453284859657, 0.026467429473996162, -0.057500243186950684, -0.02386796660721302, -0.03786025196313858, -0.013186657801270485, -0.0865492895245552, 0.04853621497750282, 0.023099049925804138, -0.013956827111542225, -0.017626410350203514, 0.010457908734679222, 0.04890196770429611, 0.007579592987895012, -0.047481101006269455, -0.036159031093120575, 0.08271809667348862, 0.09043055027723312, -0.0032525239512324333, 0.05003427341580391, -0.03611961007118225, 0.01797967031598091, 0.036277394741773605, 2.992027464463224e-33, 0.008543496020138264, -0.027548804879188538, -0.001848772051744163, -0.09012556076049805, 0.005209770984947681, 0.026505153626203537, -0.08243893086910248, -0.060227975249290466, 0.003751093288883567, 0.0863412395119667, -0.054537151008844376, 0.005711417645215988, 0.007421386893838644, -0.02717374637722969, 0.025429174304008484, 0.04196501523256302, 0.07844435423612595, -0.01903660036623478, 0.09793836623430252, -0.02253652736544609, -0.005065112374722958, -0.07359622418880463, 0.008083302527666092, 0.01745389774441719, 0.028885817155241966, 0.052980244159698486, 0.01480956468731165, 0.10370488464832306, -0.0338219478726387, -0.013071355409920216, 0.05030281841754913, 0.0032180151902139187, 0.04645523801445961, -0.037727199494838715, -0.025358036160469055, -0.09252988547086716, -0.0291947890073061, -0.018244531005620956, 0.027423689141869545, -0.04447781294584274, -0.05825738236308098, -0.0811452865600586, -0.031872767955064774, -0.054879914969205856, -0.022837193682789803, 0.14185649156570435, 0.02763497456908226, 0.081882543861866, 0.0032759171444922686, 0.015128753148019314, -0.13914743065834045, -0.041873954236507416, 0.0014389173593372107, 0.014432046562433243, -0.09285356849431992, -0.0016550428699702024, -7.280083536898019e-06, -0.04452039673924446, -0.020515577867627144, -0.08047190308570862, 0.06533639878034592, 0.039474986493587494, 0.06253115087747574, -0.061859775334596634, -0.06185024231672287, 0.1013224795460701, 0.07130211591720581, 0.04251764342188835, -0.055921949446201324, 0.0582917183637619, -0.04171860218048096, 0.04699869453907013, 0.04505564272403717, -0.010685183107852936, 0.08017680048942566, -0.05343718081712723, -0.01683606579899788, 0.03850189596414566, 0.020968234166502953, -0.013141565024852753, -0.036427032202482224, -0.1184755265712738, 0.06655028462409973, -0.010498843155801296, -0.021895989775657654, -0.02237795852124691, 0.027490239590406418, 0.05949203297495842, -0.01795254647731781, -0.002209933241829276, 0.0054596541449427605, -0.057100340723991394, -0.09328292310237885, 0.053361907601356506, -0.06932064145803452, -4.0591987251602916e-33, 0.045498497784137726, 0.09278926998376846, 0.0002864248235709965, 0.04969825968146324, 0.018893690779805183, -0.00812377966940403, 0.006848779506981373, 0.06709825992584229, 0.020416587591171265, 0.061410777270793915, -0.07084965705871582, -0.035417698323726654, -0.05578506365418434, -0.05642249062657356, 0.08411461114883423, 0.07188364118337631, -0.031091589480638504, 0.08567381650209427, -0.07213211059570312, -0.09126484394073486, -0.08000735193490982, -0.0019099125638604164, -0.05458300560712814, -0.012292728759348392, 0.027248376980423927, 0.07172735035419464, -0.0038319178856909275, -0.029084432870149612, -0.10100427269935608, -0.042477115988731384, -0.07193727046251297, -0.006727882195264101, -0.04890470579266548, -0.009931368753314018, 0.04052725061774254, 0.02056778036057949, 0.06854795664548874, -0.10271886736154556, 0.021353498101234436, -0.024731071665883064, -0.024277035146951675, 0.0841931700706482, 0.020204560831189156, 0.03009200654923916, 0.02582627907395363, 0.1251469999551773, -0.008575694635510445, 0.07274630665779114, 0.017046045511960983, 0.023347824811935425, -0.057170480489730835, 0.12684498727321625, 0.054491713643074036, -0.007527830079197884, -0.05297176167368889, 0.03850141167640686, 0.044617824256420135, 0.005028179381042719, -0.09662730991840363, 0.01975085772573948, -0.07046801596879959, -0.09502864629030228, -0.10809988528490067, 0.02114231139421463, 0.022233642637729645, -0.09913540631532669, -0.04089663177728653, -0.05184336379170418, 0.07965563237667084, -0.0038061565719544888, 0.020793123170733452, -0.02691676840186119, -0.07166900485754013, -0.048780523240566254, -0.03360975161194801, 0.08864738792181015, -0.00019780303409788758, -0.029796060174703598, -0.006103653460741043, 0.045489486306905746, 0.008573380298912525, -0.02373233251273632, 0.07036247104406357, 0.0812125876545906, -0.0352775976061821, 0.04218553379178047, -0.0862182080745697, 0.07726544141769409, 0.008299206383526325, -0.03334638103842735, 0.031569547951221466, -0.06325938552618027, -0.07445955276489258, 0.046977851539850235, 0.05402349680662155, -5.551659043590007e-08, -0.028373567387461662, -0.007719418965280056, 0.04644787684082985, -0.05981380492448807, 0.04947935789823532, 0.018551884219050407, 0.09738312661647797, 0.076971136033535, 0.007181649561971426, 0.030408941209316254, 0.05242190882563591, -0.09076667577028275, -0.08986667543649673, -0.003302078926935792, -0.08738739788532257, 0.026511123403906822, -0.07507757097482681, 0.09278464317321777, -0.03685237467288971, -0.011608012020587921, 0.015153546817600727, -0.06783031672239304, -0.024217143654823303, 0.048902999609708786, -0.029045499861240387, -0.07604614645242691, -0.01015943568199873, 0.06394751369953156, -0.0072522577829658985, 0.03365315496921539, -0.008764718659222126, -0.08023256808519363, 0.07436618953943253, 0.023631539195775986, -0.0357135534286499, -0.008460815995931625, 0.02353505790233612, -0.00036287124385125935, -0.005983676295727491, 0.08746237307786942, -0.03228378668427467, 0.032781220972537994, -0.03837345913052559, 0.0302252359688282, 0.031386975198984146, 0.019039686769247055, -0.05301861837506294, -0.1095176711678505, 0.06028285622596741, -0.027833668515086174, 0.02169838920235634, -0.04736886918544769, 0.010846560820937157, -0.020332887768745422, -0.05531316250562668, -0.03557547181844711, -0.02299140766263008, 0.050287533551454544, -0.051076848059892654, -0.013304237276315689, 0.025206493213772774, 0.00429200753569603, -0.005306502804160118, -0.04847366735339165 ] }, { "text": "```python\nfig = px.line(df, x=\"Date\", y=\"Sales\", title='Daily Sales')\nfig.add_traces(go.Scatter(x=anomaly_date[\"Date\"], y=anomaly_date[\"Sales\"], mode=\"markers\", name=\"Anomaly\", \n hoverinfo=\"skip\"))\nfor idx in range(len(anomaly_date)):\n fig.add_annotation(dict(font=dict(color='rgba(0,0,200,0.8)',size=12),\n x=anomaly_date[\"Date\"].iloc[idx],\n y=anomaly_date[\"Sales\"].iloc[idx],\n showarrow=False,\n text=anomaly_date[\"Analysis\"].iloc[idx],\n textangle=0,\n xanchor='auto', #['auto', 'left', 'center', 'right']", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_4", "embedding": [ 0.00961441919207573, 0.015160520561039448, 0.037528980523347855, 0.013451884500682354, 0.03372206166386604, 0.008779884316027164, 0.10404656827449799, 0.00557223055511713, -0.014622051268815994, -0.06287378817796707, 0.07166878134012222, 0.04616190865635872, -0.03170834109187126, -0.012675650417804718, -0.01058771088719368, 0.025120163336396217, -0.07959840446710587, -0.028620239347219467, 0.05806168168783188, -0.03304706886410713, 0.040143050253391266, 0.04179444909095764, -0.0013255865778774023, -0.0026666284538805485, -0.02262907475233078, 0.08283045142889023, 0.09378530085086823, 0.04355940595269203, -0.02834695763885975, 0.012961039319634438, -0.06413215398788452, 0.03740387409925461, 0.007793979253619909, 0.04415595903992653, 0.04484401270747185, -0.04368222877383232, 0.035456154495477676, 0.05091207101941109, 0.0841827243566513, 0.03381835296750069, 0.04490192234516144, -0.058219097554683685, 0.0690913200378418, -0.005260113161057234, -0.02636188641190529, -0.0765005499124527, -0.010467060841619968, 0.011398591101169586, 0.06869906932115555, 0.04596081003546715, -0.0385759212076664, -0.0215019378811121, -0.03584709018468857, -0.03415638580918312, 0.011744231916964054, 0.053102217614650726, 0.010124909691512585, -0.14313319325447083, 0.06673474609851837, -0.09007856994867325, 0.013241264037787914, 0.004187151324003935, 0.11351803690195084, -0.0018304279074072838, 0.00997108407318592, -0.007069404702633619, -0.04936162009835243, 0.09926483035087585, -0.03918207064270973, 0.07773786038160324, -0.029029326513409615, -0.010714573785662651, -0.07087274640798569, -0.01891178824007511, -0.052345044910907745, 0.03575358912348747, 0.01894289441406727, -0.06513621658086777, 0.02923891507089138, -0.07469324767589569, -0.08964715898036957, 0.02233409322798252, 0.02972688339650631, 0.11004924774169922, 0.023206399753689766, -0.027125976979732513, 0.00631418963894248, 0.004059399012476206, -0.039899103343486786, -0.03804383426904678, 0.0640794113278389, 0.02384794130921364, -0.024390585720539093, -0.01725015603005886, -0.017636865377426147, 0.0034612775780260563, 0.024738449603319168, 0.00769188953563571, 0.10375665873289108, 0.055554766207933426, 0.044539958238601685, -0.006911990232765675, -0.04158274084329605, 0.014084277674555779, -0.10644398629665375, -0.0034081288613379, 0.0009564419742673635, -0.03804677352309227, -0.06786332279443741, -0.009975560940802097, -0.0649188905954361, -0.02261258102953434, -0.012785099446773529, -0.05920017510652542, -0.015184902586042881, 0.017987050116062164, 0.01932515949010849, 0.017157891765236855, -0.012279984541237354, -0.05779406055808067, 0.06630344688892365, 0.02728622406721115, -0.00019513825827743858, 0.07873649150133133, -0.0396355465054512, 0.010404637083411217, -0.00291687180288136, 3.541728846855043e-33, -0.05796639993786812, -0.03204294666647911, 0.010253646411001682, -0.07809660583734512, -0.02561207488179207, 0.006231397856026888, -0.05291716381907463, -0.10645101219415665, -0.0446639358997345, 0.09574799239635468, -0.07787219434976578, 0.013237368315458298, -0.032139867544174194, -0.06254536658525467, 0.0035668150521814823, 0.001437041093595326, 0.040585439652204514, 0.061706334352493286, 0.03344491496682167, 0.010821403935551643, 0.02207786962389946, -0.04330877959728241, 0.04818320646882057, -0.02144540473818779, 0.00893299002200365, -0.01862373575568199, 0.003694957122206688, 0.06443685293197632, -0.0013762335292994976, -0.030975133180618286, 0.08827042579650879, 0.0062017240561544895, 0.08337865769863129, 0.024007011204957962, -0.05003419890999794, -0.06314719468355179, -0.016608959063887596, -0.00962627399712801, 0.03544870764017105, -0.007851013913750648, -0.06100798398256302, -0.018959173932671547, 0.014123104512691498, -0.04317326843738556, 0.007700126618146896, 0.12265447527170181, -0.016590090468525887, 0.06731867790222168, 0.010338113643229008, 0.044998493045568466, -0.09364911913871765, -0.05797157436609268, -0.0006899143336340785, 0.00409567030146718, -0.07635106146335602, 0.0014411603333428502, -0.02779144048690796, -0.06647848337888718, 0.04725820943713188, -0.04101694002747536, 0.029446521773934364, 0.06103980913758278, 0.018827665597200394, -0.02258995547890663, -0.01969865709543228, 0.09916938841342926, 0.09709084033966064, 0.01655498892068863, -0.045583877712488174, 0.09753860533237457, -0.011980387382209301, 0.011855896562337875, -0.0049160621128976345, -0.016097234562039375, 0.0747079849243164, -0.034092191606760025, 0.008528763428330421, 0.04471430554986, 0.028779426589608192, -0.04529087617993355, -0.015663286671042442, -0.08132530003786087, 0.07095668464899063, -0.01915675587952137, 0.005888370331376791, -0.017533419653773308, -0.0030897664837539196, 0.05745013803243637, -0.06708849221467972, -0.03478137031197548, -0.08691725134849548, -0.052583348006010056, -0.13640570640563965, 0.04730725288391113, -0.0461287721991539, -4.50757414755016e-33, 0.029647551476955414, 0.03287845477461815, 0.0035570701584219933, 0.031129229813814163, 0.0399833507835865, -0.004078584257513285, 0.00018601746705826372, 0.06708647310733795, 0.06080833822488785, 0.044419314712285995, -0.05477811023592949, -0.025035174563527107, -0.023487919941544533, -0.03163043409585953, 0.08061033487319946, 0.028645740821957588, 0.019688738510012627, 0.06448663026094437, -0.05093327537178993, -0.009470276534557343, -0.05382278189063072, 0.02985144965350628, -0.05924643203616142, -0.016876518726348877, -0.04639376699924469, 0.05401727184653282, 0.05526771768927574, 0.024661049246788025, -0.12427012622356415, -0.07950898259878159, -0.08131081610918045, -0.0423392616212368, -0.06229964271187782, 0.04279468208551407, -0.014619817957282066, 0.01936819963157177, 0.06630472838878632, -0.11581555753946304, -0.0395178496837616, -0.025026926770806313, 0.008251038379967213, 0.051941946148872375, -0.0023594244848936796, 0.05038467422127724, 0.03028319962322712, 0.10420416295528412, -0.011466475203633308, 0.10374941676855087, 0.03997131437063217, 0.0313296765089035, -0.07446333765983582, 0.11337042599916458, 0.007428775541484356, 0.025433845818042755, -0.03919067978858948, 0.0415448397397995, 0.03180833160877228, -0.0286562480032444, -0.14917221665382385, 0.0024439406115561724, -0.06765355169773102, -0.06436262279748917, -0.059649329632520676, 0.015379724092781544, 0.06719261407852173, -0.11159272491931915, -0.03758823871612549, -0.08298970013856888, 0.011432720348238945, -0.008385594002902508, 0.05496669560670853, -0.0031695414800196886, -0.1166732907295227, -0.07380162179470062, -0.056321144104003906, 0.037825413048267365, -0.0305482167750597, -0.05892088636755943, -0.026917599141597748, 0.08073818683624268, -0.023238319903612137, -0.01970592886209488, 0.12369973957538605, 0.13021543622016907, -0.05064999684691429, 0.07858141511678696, -0.05830591171979904, 0.06742381304502487, 0.049534812569618225, 0.0021853474900126457, -0.03363660350441933, -0.059831403195858, -0.056516408920288086, 0.02321462146937847, -0.008754922077059746, -5.521575729972028e-08, -0.014547623693943024, -0.01284906268119812, 0.05057262256741524, -0.055297110229730606, 0.03160994127392769, -0.02625553496181965, 0.020511271432042122, 0.05073979124426842, 0.018236525356769562, -0.00997185055166483, 0.09623899310827255, -0.06185710430145264, -0.10621020942926407, -0.024513669312000275, -0.06882036477327347, 0.039342477917671204, -0.033277448266744614, 0.06830419600009918, -0.03200095146894455, -0.05648503080010414, 0.025327762588858604, -0.023970235139131546, 0.013728647492825985, -0.013373109512031078, -0.03953961655497551, -0.05975637957453728, 0.02489720843732357, 0.06835529208183289, 0.02342390827834606, 0.016829734668135643, 0.023167628794908524, -0.08673420548439026, 0.06426796317100525, -0.018453871831297874, -0.014331283047795296, -0.04291035234928131, -0.0032985182479023933, 0.04350458085536957, 0.029828891158103943, 0.017100177705287933, -0.07730178534984589, 0.02714207023382187, -0.03702732175588608, 0.03506213054060936, 0.028076047077775, 0.028353901579976082, -0.06612195819616318, -0.09250282496213913, 0.08475714921951294, -0.04664326459169388, 0.03309206664562225, -0.0576329380273819, 0.0007423528586514294, -0.0050935689359903336, -0.0066431802697479725, -0.022123316302895546, -0.029984386637806892, 0.08481265604496002, -0.022008759900927544, 0.024581102654337883, -0.00624773558229208, 0.014919807203114033, 0.021653657779097557, -0.04355882108211517 ] }, { "text": "textangle=0,\n xanchor='auto', #['auto', 'left', 'center', 'right']\n xref=\"x\",\n yref=\"y\"))\nfig.show()\n```", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_5", "embedding": [ 0.013682683929800987, 0.04778958112001419, -0.012084217742085457, -0.013592205941677094, 0.003546798834577203, 0.03513321280479431, 0.0335981622338295, 0.03549209609627724, -0.008967297151684761, -0.011879433877766132, 0.08441238105297089, -0.01853814348578453, -0.008199775591492653, 0.07137797772884369, 0.049731794744729996, 0.029385343194007874, -0.07283858209848404, -0.07409760355949402, 0.025351012125611305, -0.06469955295324326, 0.029284557327628136, -0.010489354841411114, 0.05405549705028534, 0.024577543139457703, 0.09108445048332214, 0.028145506978034973, 0.0266251303255558, 0.054814063012599945, -0.033058617264032364, 0.004441381432116032, -0.10472974181175232, -0.026603735983371735, 0.06116225942969322, 0.03313950449228287, -0.019429979845881462, 0.023052215576171875, -0.035230543464422226, 0.019549399614334106, 0.0761265903711319, 0.03315538540482521, 0.034529682248830795, -0.0622277595102787, 0.10062917321920395, -0.09192688763141632, 0.046742696315050125, -0.017549514770507812, -0.020910928025841713, 0.06856430321931839, 0.13691867887973785, 0.032545894384384155, -0.0493183434009552, -0.008937033824622631, -0.07251264899969101, -0.026515163481235504, 0.034971632063388824, 0.02812289446592331, 0.10764241218566895, -0.10396842658519745, 0.11730808019638062, -0.04848048463463783, 0.02699819579720497, 0.07200635969638824, 0.027785813435912132, 0.004712823312729597, 0.010012546554207802, -0.089642733335495, 0.0017367351101711392, 0.03267773613333702, -0.06014779210090637, 0.09436152875423431, -0.009885667823255062, -0.011739801615476608, 0.008408189751207829, -0.09012263268232346, -0.041925039142370224, -0.04781824350357056, -0.04715878516435623, -0.07574476301670074, 0.05873929709196091, 0.08014316856861115, -0.1137898862361908, 0.04054025560617447, 0.09708438068628311, 0.1654057800769806, -0.07536262273788452, -0.0013506091199815273, -0.04603646323084831, -0.015191784128546715, -0.03484247624874115, -0.014337307773530483, -0.025456244125962257, -0.03574113920331001, -0.05225507915019989, 0.06165848672389984, -0.12027430534362793, 0.044937748461961746, 0.10445837676525116, 0.008705053478479385, -0.05559813603758812, -0.031404875218868256, 0.0877748504281044, -0.11627241224050522, 0.0846828818321228, -0.025181546807289124, -0.044319603592157364, 0.03033699095249176, 0.06272493302822113, -0.08557864278554916, 0.06659968197345734, 0.004583560861647129, -0.07739494740962982, -0.07457190752029419, -0.09782233089208603, 0.017390092834830284, -0.08806521445512772, 0.04141887277364731, -0.05652454495429993, 0.011253857053816319, 0.02210196666419506, -0.029141735285520554, 0.04955688863992691, 0.038395971059799194, 0.02409764751791954, 0.05859299749135971, 0.01786717213690281, 0.012780082412064075, 0.005143273156136274, -2.174107107559553e-34, -0.09173844009637833, -0.00936062354594469, 0.04081623628735542, -0.010777498595416546, -0.02161245606839657, 0.008299550972878933, -0.11027693748474121, -0.04644998535513878, -0.03543976694345474, 0.003601020434871316, -0.026337414979934692, 0.0653998926281929, -0.06499908119440079, -0.04795365035533905, -0.06766682118177414, -0.042278703302145004, -0.015715325251221657, -0.03830045089125633, -0.03759961575269699, -0.036902427673339844, -0.010614407248795033, 0.06233546882867813, -0.029499655589461327, 0.023221535608172417, -0.11018542945384979, -0.00969503354281187, -0.017207320779561996, -0.004239694215357304, -0.09048530459403992, 0.02128940261900425, -0.01601474918425083, -0.010879816487431526, 0.05272911861538887, -0.03848689794540405, -0.058595649898052216, -0.011652220971882343, -0.023731643334031105, 0.00920919980853796, -0.021630289033055305, 0.029041122645139694, 0.034964919090270996, 0.018076539039611816, 0.022236766293644905, -0.05440400168299675, 0.05518557131290436, 0.020703379064798355, -0.00576931843534112, 0.0985080823302269, -0.005801847670227289, 0.005822281818836927, -0.009032483212649822, -0.00872038584202528, -0.022705450654029846, 0.021912241354584694, 0.019448041915893555, 0.010874244384467602, 0.034036558121442795, 0.02755371853709221, -0.017307331785559654, -0.04779640585184097, -0.003949875943362713, 0.008505198173224926, 0.06309552490711212, -0.005214829929172993, -0.0354933999478817, 0.020643850788474083, 0.06604287028312683, -0.08109336346387863, 0.011984968557953835, 0.041338805109262466, -0.07372812926769257, -0.006703001447021961, -0.0068865069188177586, 0.03776177391409874, -0.0434798039495945, -0.010292391292750835, -0.042827825993299484, -0.008910342119634151, -0.09967145323753357, -0.033280856907367706, 0.012032130733132362, -0.011749804951250553, 0.05360889434814453, -0.08035524934530258, 0.013368758372962475, -0.08199052512645721, 0.06961430609226227, -0.017610138282179832, 0.0009082350879907608, -0.040163200348615646, -0.06649473309516907, -0.0754711851477623, -0.0363149531185627, 0.008837003260850906, -0.023263264447450638, -2.28616845339138e-33, 0.01096008624881506, 0.044637393206357956, 0.0451783612370491, 0.027354218065738678, -0.053082291036844254, -0.009323322214186192, 0.11047597974538803, 0.013560842722654343, 0.0068435873836278915, -0.0071830181404948235, -0.0532340332865715, 0.01812589354813099, -0.015417810529470444, -0.03142936900258064, 0.07886569201946259, 0.043769802898168564, 0.037393659353256226, 0.07595084607601166, -0.05802077054977417, -0.07970454543828964, -0.06475657224655151, -0.03576795756816864, -0.03118099458515644, 0.04201895371079445, -0.01913926750421524, -0.010104955174028873, 0.03138375282287598, -0.01222273800522089, -0.04129787161946297, -0.008866229094564915, -0.03815043717622757, -0.018033422529697418, 0.004428028594702482, 0.09888257831335068, 0.012357275001704693, -0.06599599123001099, 0.007151400670409203, -0.006397950928658247, -0.025996560230851173, 0.009261338971555233, 0.06538978219032288, 0.03734379634261131, -0.0558740459382534, 0.07715354114770889, -0.004886914044618607, 0.0995938777923584, -0.01572655886411667, 0.04304364323616028, -0.012638655491173267, 0.005925621371716261, -0.037557341158390045, 0.0002434053603792563, 0.07178646326065063, -0.026266178116202354, -0.019230715930461884, 0.020095905289053917, -0.035346660763025284, 0.049646489322185516, -0.006681228522211313, 0.022017164155840874, -0.07028860598802567, -0.07023368030786514, 0.019922081381082535, -0.008925143629312515, 0.04242321103811264, -0.0516098253428936, -0.03770352527499199, -0.017735330387949944, 0.032125167548656464, -0.024998195469379425, 0.14164325594902039, 0.03575870394706726, -0.04661870375275612, -0.027297822758555412, -0.0275267343968153, 0.06745792925357819, -0.048430245369672775, -0.0014410156290978193, -0.0839051604270935, 0.018365269526839256, 0.03091811202466488, -0.013887169770896435, 0.021656882017850876, 0.05756208300590515, -0.08056328445672989, 0.03210822492837906, -0.011575574055314064, 0.10920392721891403, 0.02796884998679161, -0.009964226745069027, 0.028605299070477486, 0.014314445666968822, -0.007028616964817047, 0.04703816771507263, 0.08150683343410492, -3.2203352873239055e-08, -0.08567863702774048, 0.012929817661643028, 0.07782887667417526, -0.060144808143377304, -0.07169266045093536, 0.04189577326178551, 0.01644105650484562, 0.026580221951007843, 0.005921768955886364, 0.019394079223275185, 0.0534890741109848, 0.0033149721566587687, -0.04323866590857506, -0.007072367239743471, -0.055383630096912384, 0.0759386494755745, 0.024892732501029968, 0.08239292353391647, 0.0162163395434618, 0.005539658013731241, -0.01358338538557291, -0.0847712829709053, -0.012497919611632824, 0.024360621348023415, -0.15725606679916382, -0.053834185004234314, -0.1053168922662735, 0.050459980964660645, -0.010829918086528778, 0.018033944070339203, 0.021163780242204666, -0.03713185340166092, 0.0826159343123436, 0.040835294872522354, -0.045868225395679474, -0.03270741552114487, -0.013296389020979404, -0.00016227948071900755, 0.05083485692739487, 0.054840438067913055, 0.0017005017725750804, -0.02234252355992794, -0.03753683716058731, -0.04818928614258766, 0.013688340783119202, 0.032027386128902435, 0.04180776700377464, -0.05342873930931091, 0.012155055068433285, -0.07299008220434189, 0.025641733780503273, -0.002725492464378476, -0.003020819742232561, -0.05551610514521599, -0.03262855485081673, 0.003830431727692485, 0.06429523229598999, 0.11132964491844177, -0.04266393929719925, 0.03862043097615242, -0.05272897705435753, 0.10039156675338745, 0.013752237893640995, -0.029814813286066055 ] }, { "text": "
\n\n
", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_6", "embedding": [ 0.01803223416209221, 0.09503529220819473, -0.044390156865119934, -0.03842026740312576, 0.15111476182937622, -0.03156952187418938, -0.004891354124993086, 0.02670636586844921, 0.018641119822859764, -0.06471625715494156, -0.002258043736219406, 0.1001836508512497, -0.0936826691031456, 0.06669463962316513, -0.027416657656431198, 0.016882561147212982, -0.005552356131374836, -0.042041752487421036, 0.014942457899451256, 0.004213043488562107, -0.015482103452086449, -0.12807142734527588, 0.06059548631310463, 0.011725347489118576, 0.024229833856225014, 0.0036961273290216923, -0.04401326924562454, 0.12745587527751923, 0.012814220041036606, -0.04778799042105675, 0.006429519038647413, -0.03188016265630722, 0.0511462539434433, -0.05993570014834404, -0.020649584010243416, -0.017915166914463043, 0.008697539567947388, 0.020207632333040237, 0.0020854566246271133, -0.02371946908533573, 0.007868187502026558, 0.05002085492014885, 0.06962350755929947, -0.0035449599381536245, 0.0128896189853549, -0.03510696813464165, 0.0005749888368882239, -0.0015960874734446406, 0.05828183516860008, 0.03550184145569801, -0.05969734117388725, -0.06754078716039658, 0.05291730538010597, -0.07772296667098999, -0.03467477485537529, -0.0035637563560158014, -0.004683431703597307, -0.07971040159463882, 0.05917095020413399, -0.029823003336787224, -0.001001559547148645, 0.03891846537590027, 0.07585079222917557, 0.04061158746480942, -0.005211467854678631, -0.006625760812312365, 0.0009868484921753407, 0.01813160628080368, -0.06580189615488052, 0.052038077265024185, 0.007715654093772173, -0.02267307974398136, 0.011173469945788383, -0.04911426082253456, 0.05055311694741249, 0.033293385058641434, -0.1039021760225296, 0.05280691012740135, -0.008561779744923115, -0.09019771963357925, -0.011609972454607487, -0.03431810811161995, 0.027659354731440544, 0.029481587931513786, -0.009547029621899128, 0.06829190999269485, 0.05219979211688042, -0.052523210644721985, 0.051212918013334274, -0.008775279857218266, -0.016873715445399284, 0.06618449836969376, -0.00783068872988224, 0.08170606940984726, -0.06923232227563858, -0.01206613052636385, -0.03704139590263367, -0.015588359907269478, -0.0921645313501358, 0.05812099203467369, 0.0718032717704773, 0.009945889003574848, 0.012670069932937622, -0.00024440392735414207, -0.02806026302278042, -0.018146485090255737, 0.0005311112035997212, 0.07263732701539993, -0.0033817901276052, 0.012399129569530487, -0.018163293600082397, 0.029071001335978508, 0.06548476964235306, 0.05814081430435181, -0.03842125087976456, -0.039755772799253464, 0.02519896812736988, -0.002554677426815033, 0.09805645048618317, -0.06667701154947281, 0.04763239249587059, 0.02043312042951584, -0.0877349004149437, 0.001901102950796485, 0.06103720888495445, 0.013878937810659409, 0.06274396181106567, 5.956373138990537e-33, 0.08586569875478745, 0.00452479999512434, -0.041915327310562134, -0.02851056680083275, 0.00036964722676202655, -0.007835608907043934, -0.1325901597738266, -0.04069547355175018, -0.06529580056667328, -0.02628451958298683, 0.042857054620981216, -0.010700690560042858, 0.01696944050490856, 0.06777126342058182, 0.0014133201912045479, -0.05959177389740944, 0.04614463075995445, 0.015901802107691765, 0.05604242905974388, -0.015558389946818352, -0.05645028129220009, 0.00629989942535758, -0.038529641926288605, -0.012778184376657009, 0.00761373620480299, 0.1780453473329544, 0.02208884246647358, 0.0893397405743599, -0.08505437523126602, 0.03053625114262104, 0.01946096494793892, -0.03591736778616905, 0.05781027302145958, -0.06793437153100967, 0.04079309478402138, -0.020688127726316452, -0.0012306952849030495, 0.011525623500347137, 0.05841047689318657, 0.07261006534099579, -0.006285426206886768, -0.12459821999073029, -0.04729209840297699, -0.04900914058089256, -0.07475242763757706, 0.08605507761240005, 0.050171494483947754, 0.07499924302101135, -0.014036757871508598, -0.03696411848068237, -0.07065854221582413, -0.012303827330470085, -0.015237982384860516, -0.04409129545092583, -0.04863617941737175, 0.03055429458618164, -0.04466881603002548, -0.04547511041164398, -0.061421483755111694, -0.06683960556983948, 0.039918504655361176, 0.035362280905246735, 0.032129429280757904, -0.10333607345819473, -0.036317840218544006, 0.009416986256837845, -0.03208978846669197, 0.040229469537734985, -0.018227627500891685, -0.013132346794009209, -0.05934607610106468, -0.013338027521967888, 0.1296381950378418, 0.03751266002655029, -0.07530345022678375, -0.0275062695145607, -0.017133794724941254, 0.02497272752225399, 0.007440576329827309, 0.049085263162851334, -0.08631313592195511, -0.08214397728443146, -0.0035542480181902647, -0.031152375042438507, 0.04449581727385521, -0.06074874848127365, 0.009559391066432, 0.024405520409345627, 0.04701749607920647, -0.01029177289456129, 0.07882404327392578, -0.011741961352527142, 0.00046122801722958684, -0.05303606018424034, -0.10846135020256042, -4.6182487773900017e-33, -0.008425313979387283, 0.08007034659385681, -0.05377332121133804, 0.09399671852588654, -0.023951102048158646, 0.04213903471827507, 0.057574041187763214, 0.10379236191511154, 0.10920589417219162, 0.07667618244886398, -0.001162066007964313, -0.05973409488797188, 0.0013174555497244, -0.031301841139793396, 0.027145616710186005, 0.08436615020036697, -0.013855122961103916, 0.1019853875041008, -0.07804761081933975, -0.05966123938560486, -0.05311938747763634, -0.04073558747768402, -0.040390197187662125, 0.0688321441411972, 0.06876915693283081, 0.06512824445962906, -0.025457043200731277, -0.04253219813108444, -0.030004307627677917, -0.051254723221063614, -0.03993718698620796, -0.03127994388341904, -0.04354153200984001, -0.08703252673149109, 0.03973211720585823, 0.020328441634774208, 0.04171636328101158, -0.05875522270798683, 0.007440953049808741, -0.029268132522702217, -0.00012017100380035117, 0.036600511521101, -0.058273930102586746, 0.001939259236678481, -0.02147918939590454, 0.044295549392700195, 0.04965320602059364, 0.019884107634425163, -0.0067488146014511585, 0.0654132068157196, -0.07762867957353592, 0.024680597707629204, 0.15873442590236664, -0.0677235797047615, -0.06702101975679398, -0.0478120818734169, 0.005518857389688492, 0.05447027459740639, -0.014472920447587967, 0.04739191755652428, -0.012587308883666992, -0.026135364547371864, -0.03381038457155228, 0.042271263897418976, 0.06590165942907333, -0.003023821394890547, 0.02320457063615322, 0.05898468196392059, -0.005133897066116333, 0.05313289165496826, 0.07569049298763275, 0.04477747529745102, 0.03605804592370987, 0.005972275510430336, 0.029829299077391624, 0.060611072927713394, 0.05406362935900688, 0.000405389437219128, 0.010831932537257671, -0.027337633073329926, 0.06783212721347809, -0.02177048847079277, -0.06900815665721893, -0.004432516638189554, 0.018794221803545952, 0.002707935171201825, -0.11647363007068634, 0.09723291546106339, -0.050359372049570084, -0.033930763602256775, 0.00991860218346119, -0.001538173179142177, 0.0038994932547211647, 0.06340844184160233, 0.05531112477183342, -4.3512986991345315e-08, 0.03175165504217148, -0.09876659512519836, -0.007109430618584156, -0.04470152035355568, -0.029125560075044632, 0.039099253714084625, 0.09235130995512009, 0.020720671862363815, -0.051317472010850906, -0.014315149746835232, 0.05357759818434715, 0.008129747584462166, -0.05066539719700813, -0.07548034191131592, -0.07122126966714859, 0.07323528826236725, -0.06075501814484596, 0.09239189326763153, -0.014418719336390495, 0.006879882421344519, -0.01547407079488039, -0.046352796256542206, -0.03400018438696861, 0.023777009919285774, -0.04043746367096901, -0.005758265499025583, -0.0655570924282074, 0.04688906669616699, -0.06649143248796463, -0.0019768793135881424, -0.04597039520740509, -0.018048176541924477, -0.04218452796339989, -0.03782236576080322, 0.01955907791852951, 0.0035918448120355606, -0.03155337646603584, 0.0051177311688661575, -0.0380675308406353, 0.013206095434725285, 0.019099144265055656, 0.03931340575218201, -0.005189507268369198, -0.016643719747662544, 0.032742202281951904, 0.055762551724910736, -0.01806650310754776, -0.08259785175323486, -0.03404103219509125, -0.08787916600704193, 0.0022857696749269962, -0.0009291282622143626, 0.041543539613485336, 0.009423526003956795, -0.05764716491103172, -0.051441043615341187, -0.010589233599603176, 0.05205491930246353, -0.04801201447844505, 0.030995884910225868, 0.007041951175779104, 0.09914068877696991, 0.03264784812927246, -0.03437419980764389 ] }, { "text": "### How to embed plotly chart to md file?\n\nIt is a bit tricky when you want to publish your plotly express plots as md file. I prefer\nto convert my jupyter notebooks to html and publish them directly. However, when it comes to publish plotly there are many erros \nin github deployment. For example: Liquid syntax error\n\nI used jupyter notebook to create the plots and save the charts. Following function is used for saving plotly express as html file:\n\n```python\nimport plotly.express as px\nimport plotly.io as pio\nfig = px.line(df, x=\"Date\", y=\"Sales\", title='Daily Sales')\nfig.show()\npio.write_html(fig, file='plotly_simple.html', auto_open=False)\n```\n\nThen you can add the html in .md file:", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_7", "embedding": [ 0.03851010650396347, 0.0257585346698761, -0.026338864117860794, -0.0026895503979176283, 0.053177736699581146, -0.008288385346531868, -0.11473116278648376, 0.03034459426999092, -0.0693395733833313, 0.04855363070964813, -0.0003988971875514835, 0.12676338851451874, 0.06343473494052887, -0.023377688601613045, 0.004363488871604204, -0.0059733157977461815, 0.005095310974866152, -0.02720530331134796, 0.011267412453889847, 0.05732833221554756, 0.009921465069055557, -0.009124990552663803, 0.07184381783008575, 0.024036940187215805, 0.08852788805961609, -0.06732261925935745, -0.04986816272139549, 0.08750104159116745, 0.010676397942006588, 0.008958679623901844, 0.020246149972081184, -0.02694365754723549, -0.007508374284952879, -0.012644117698073387, 0.057770803570747375, 0.05757254734635353, 0.0256920475512743, 9.964872879208997e-05, 0.027327850461006165, -0.0019912461284548044, 0.10161571204662323, 0.047148559242486954, -0.016538122668862343, -0.09876865893602371, -0.022451158612966537, -0.1227300688624382, 0.020323680713772774, -0.06722915917634964, 0.022491322830319405, 0.0825439915060997, -0.08073309808969498, 0.03671550750732422, -0.047225221991539, -0.04336211085319519, -0.009201660752296448, -0.004115089774131775, -0.031551264226436615, -0.08385616540908813, 0.03384031355381012, -0.08619589358568192, -0.0640120804309845, 0.050050366669893265, 0.07589171826839447, 0.001888068625703454, -0.03561026230454445, -0.005612985696643591, -0.027354301884770393, 0.10941630601882935, -0.01863047480583191, 0.048637621104717255, -0.038293998688459396, -0.05320270359516144, -0.0224053543061018, -0.04755067080259323, -0.013754264451563358, 0.00149701873306185, 0.003601721255108714, -0.01835128851234913, -0.0032742517068982124, -0.047876469790935516, -0.03431539610028267, -0.09253089874982834, 0.003921747673302889, 0.035273004323244095, -0.05825301632285118, -0.007949179969727993, 0.07014317810535431, 0.0254079420119524, -0.007069021929055452, -0.1060112789273262, 0.0500611737370491, 0.008032095618546009, -0.014774864539504051, -0.004946607165038586, -0.022819507867097855, -0.044959571212530136, 0.05114567652344704, 0.08636780828237534, -0.053370922803878784, 0.004523701965808868, 0.08316495269536972, -0.04409603774547577, 0.045321594923734665, -0.06453432142734528, -0.029870158061385155, -0.0437532439827919, 0.03823418542742729, 0.017306260764598846, -0.006884125992655754, -0.03943570703268051, -0.06334345042705536, -0.002161953365430236, -0.031222350895404816, -0.0006770718027837574, 0.020154453814029694, 0.053181905299425125, -0.03701132535934448, -0.01468496024608612, 0.022072788327932358, -0.027286238968372345, 0.0611703097820282, 0.07568097114562988, -0.0062569319270551205, -0.009714774787425995, 0.06888165324926376, 0.04363851994276047, 0.06519544869661331, 1.8031354167774396e-33, 0.014778034761548042, -0.017039043828845024, 0.06768351048231125, -0.0019396578427404165, 0.1055651381611824, -0.01981901377439499, -0.08529211580753326, -0.11454004794359207, -0.030602892860770226, 0.044579315930604935, 0.004597426857799292, 0.06628309935331345, -0.0065780458971858025, 0.08169684559106827, -0.1159946620464325, -0.03415603190660477, 0.07393922656774521, -0.042260266840457916, 0.05259913578629494, -0.01837805286049843, -0.012132025323808193, -0.05045919865369797, -0.03420354425907135, -0.012419559061527252, -0.04277453571557999, 0.05828388035297394, 0.029031334444880486, 0.1404687613248825, -0.023198675364255905, 0.012969913892447948, 0.002979879267513752, -0.03847862407565117, 0.015706434845924377, -0.06306742131710052, -0.03278779610991478, -0.06834982335567474, -0.051183562725782394, -0.030969163402915, 0.0175868459045887, 0.02275496907532215, -0.022172436118125916, -0.051225196570158005, -0.0013455234002321959, 0.00845777802169323, -0.054681695997714996, 0.1225479394197464, -0.04839935153722763, 0.025854067876935005, 0.09517423063516617, 0.003391274716705084, -0.06423204392194748, -0.06659100204706192, 0.018193431198596954, 0.010590332560241222, -0.050652120262384415, -0.004731097258627415, -0.023667223751544952, -0.09878425300121307, 0.012114525772631168, -0.05108176916837692, -0.024059301242232323, -0.00486027542501688, -0.005617040675133467, -0.08186693489551544, -0.01639222726225853, 0.05858699232339859, 0.032312918454408646, 0.02755863219499588, -0.00899167824536562, 0.006891743279993534, -0.036290243268013, 0.06124655902385712, 0.04151226952672005, -0.007407499942928553, 0.07112693786621094, -0.04550881311297417, 0.02808336168527603, 0.05121789872646332, 0.0015965623315423727, 0.05647911876440048, -0.018718181177973747, -0.0609116367995739, -0.062066175043582916, 0.011652461253106594, 0.015081847086548805, -0.04590738192200661, -0.008473419584333897, 0.012461578473448753, 0.019452858716249466, 0.008529547601938248, 0.04397394135594368, -0.025445137172937393, -0.03098711185157299, -0.04371171072125435, -0.11053385585546494, -3.5770326156300826e-33, -0.0062174671329557896, 0.049144942313432693, -0.006161616649478674, 0.07641663402318954, -0.04916229471564293, 0.05255366861820221, 0.010122518055140972, 0.055230312049388885, 0.0970480889081955, -0.02377241849899292, -0.07913647592067719, -0.06306420266628265, -0.012844755314290524, -0.0395858995616436, 0.033726971596479416, 0.051988326013088226, 0.03414998576045036, 0.056699808686971664, -0.0352451354265213, -0.06386999785900116, -0.04923122003674507, -0.0379464216530323, -0.004997339565306902, 0.05460581183433533, 0.08949172496795654, 0.044913288205862045, -0.060609783977270126, 0.009285402484238148, -0.022704437375068665, -0.06844452768564224, 0.002148000057786703, 0.03482288122177124, -0.09813344478607178, -0.08112002909183502, -0.019901582971215248, 0.023657510057091713, 0.013989686965942383, -0.03010670095682144, -0.009805267676711082, 0.006580564193427563, 0.02807679958641529, 0.056063469499349594, 0.018570881336927414, 0.07276678830385208, 0.06175084784626961, 0.05444797873497009, -0.006647617090493441, -0.018366843461990356, 0.04942028969526291, 0.08997583389282227, -0.09477891027927399, -0.0014976068632677197, 0.06375188380479813, -0.017262376844882965, 0.007087953854352236, -0.02474704198539257, 0.010975330136716366, 0.0674409419298172, -0.1321856677532196, 0.02716224268078804, -0.0382833331823349, -0.05164048448204994, -0.05068095400929451, -0.06526080518960953, -0.057072628289461136, -0.04136890918016434, -0.0097962012514472, -0.05676575377583504, 0.044011201709508896, 0.007141391281038523, 0.015724528580904007, -0.049460895359516144, 0.02974279783666134, -0.015146948397159576, 0.013792555779218674, 0.10458427667617798, -0.05157458409667015, -0.0036361697129905224, -0.057375743985176086, 0.010712544433772564, 0.06195054203271866, 0.06768936663866043, 0.01191791519522667, -0.015123426914215088, 0.005832125898450613, -0.05838422477245331, -0.027010653167963028, 0.05733608081936836, -0.011456779204308987, -0.044148318469524384, 0.007403791416436434, -0.06746259331703186, -0.014659656211733818, 0.09817130118608475, 0.04321380704641342, -4.031221223499415e-08, 0.009601160883903503, -0.011149157769978046, 0.014950868673622608, -0.08159720152616501, -0.09065184742212296, 0.0903024673461914, 0.1003999337553978, 0.008007703348994255, 0.013136775232851505, 0.0416327565908432, 0.0470755472779274, -0.0740678682923317, -0.04886369779706001, -0.036802925169467926, -0.14622895419597626, 0.1419251561164856, -0.03394428640604019, 0.06435901671648026, 0.025289826095104218, -0.013673217967152596, -0.03228718787431717, -0.0365251861512661, 0.00887329876422882, 0.041879501193761826, 0.015431481413543224, 0.0341578833758831, -0.0389079675078392, 0.00041816962766461074, -0.13215230405330658, 0.02669619582593441, 0.025232689455151558, -0.06349160522222519, 0.014801912009716034, 0.0722445622086525, -0.03696231171488762, -0.12305716425180435, 0.004486375954002142, 0.03933623805642128, -0.01025307085365057, 0.06398646533489227, 0.004179439507424831, 0.05585796386003494, -0.08547382056713104, -0.036590710282325745, 0.055438604205846786, 0.019587330520153046, -0.03911469504237175, -0.002391279209405184, -0.008917158469557762, 0.042204879224300385, 0.02546101063489914, -0.04188324883580208, 0.05510639399290085, -0.06773418933153152, -0.011326819658279419, 0.014186921529471874, 0.004354424774646759, 0.07819164544343948, 0.051018837839365005, -0.03137785941362381, -0.03803236037492752, 0.05241366848349571, 0.10139243304729462, -0.05230103060603142 ] }, { "text": "Then you can add the html in .md file: \n\n
\n \n
\n\nHappy learning! :)\n\n# References\n- https://raw.githubusercontent.com/plotly/plotly.py/master/doc/python/line-and-scatter.md\n- https://stackoverflow.com/questions/60513164/display-interactive-plotly-chart-html-file-on-github-pages\n- https://stackoverflow.com/questions/64241461/plotly-how-to-add-markers-at-specific-points-in-plotly-line-graph-python-pan\n- https://stackoverflow.com/questions/68731627/plotly-express-line-chart-mark-specific-points-and-retain-hover-data\n- https://davistownsend.github.io/blog/PlotlyBloggingTutorial/", "source": "2023-01-29-Line_Chart_with_Plotly.md", "type": "markdown", "chunk_id": "2023-01-29-Line_Chart_with_Plotly.md_8", "embedding": [ -0.008001855574548244, 0.012468294240534306, -0.06210334599018097, 0.004899432882666588, 0.09831912070512772, 0.019378529861569405, -0.01993020623922348, 0.026171809062361717, -0.09023146331310272, -0.03122199885547161, -0.0033140683081001043, 0.08249779045581818, -0.019689597189426422, 0.02784450352191925, 0.026981795206665993, 0.028306705877184868, -0.005001360084861517, -0.07308386266231537, 0.030973320826888084, 0.046412933617830276, 0.030852211639285088, -0.08183299005031586, 0.07522483170032501, 0.07838573306798935, 0.015058684162795544, -0.059318359941244125, 0.0045815096236765385, 0.09284770488739014, -0.01819055713713169, 0.029124867171049118, -0.007246190216392279, -0.02053338848054409, 0.004126130137592554, -0.01854211464524269, 0.023178327828645706, 0.008881130255758762, 0.05810631439089775, 0.037474099546670914, 0.012429680675268173, -0.007580254226922989, 0.06088472902774811, 0.009737055748701096, 0.010021931491792202, -0.07976850867271423, 0.009503088891506195, -0.0759536549448967, -0.005547956097871065, -0.08597337454557419, -0.010546332225203514, 0.06617867201566696, -0.043516892939805984, -0.03929617628455162, -0.0035328282974660397, -0.021417787298560143, -0.008780055679380894, 0.008372035808861256, -0.01038273423910141, -0.10916686058044434, 0.06850624829530716, -0.09858493506908417, -0.07929175347089767, 0.04043179005384445, 0.11888637393712997, 0.008820757269859314, 0.0009327455190941691, -0.014629487879574299, 0.008005581796169281, 0.07046716660261154, -0.008871241472661495, 0.06650234013795853, -0.03518364578485489, -0.08071742206811905, 0.037425074726343155, -0.05851443484425545, 0.041035789996385574, 0.034786712378263474, -0.0455595925450325, 0.04999515041708946, -0.029844535514712334, -0.09095870703458786, -0.03238283097743988, -0.01220726314932108, 0.06906550377607346, 0.02740982547402382, -0.0498620867729187, -0.013416755013167858, 0.028209159150719643, -0.02825973369181156, 0.036696869879961014, -0.07573821395635605, -0.00574334803968668, 0.015533034689724445, -0.09256619215011597, 0.005757165141403675, 0.02417995035648346, 0.013175037689507008, 0.01946367509663105, -0.01604127325117588, -0.10967438668012619, -0.022885600104928017, 0.07383421063423157, -0.06101308390498161, -0.026725126430392265, -0.011476828716695309, 0.027258669957518578, 0.055825408548116684, -0.023994864895939827, -0.003990558907389641, -0.01100086234509945, -0.012553545646369457, -0.04674922302365303, -0.013635937124490738, 0.04149811342358589, 0.024482788518071175, 0.013561847619712353, 0.0092648109421134, -0.015115267597138882, 0.03781990334391594, 0.06677728146314621, -0.04645539075136185, 0.07476000487804413, 0.0251879021525383, -0.033619415014982224, -0.006589367985725403, 0.05636920779943466, 0.08026052266359329, 0.05573621764779091, 1.4000037617602632e-33, 0.11248905211687088, 0.007826401852071285, 0.015148520469665527, -0.03654469922184944, 0.030954912304878235, -0.05414873734116554, -0.13010555505752563, -0.04912540689110756, -0.04123316705226898, -0.004397477023303509, 0.04884793609380722, -0.010275355540215969, 0.04778007045388222, 0.05660028010606766, -0.029819341376423836, -0.02202155813574791, 0.034180302172899246, -0.10285387188196182, 0.042494844645261765, -0.0003898705181200057, -0.11211703717708588, 0.004908509086817503, -0.018896320834755898, -0.014874634332954884, 0.04583979398012161, 0.07824414223432541, -0.016001595184206963, 0.09801481664180756, -0.06657151132822037, 0.024185730144381523, -0.0028873379342257977, -0.06459725648164749, 0.009372440166771412, -0.0500945970416069, -0.022801565006375313, -0.02621900849044323, -0.05278577655553818, -0.027032848447561264, 0.004228746518492699, 0.06660720705986023, 0.0354200042784214, -0.061767175793647766, 0.004319126717746258, 0.00989749375730753, -0.09010659158229828, 0.08678203076124191, -0.024454178288578987, 0.078964464366436, -0.011911476962268353, 0.0038763731718063354, -0.07700693607330322, -0.02409053035080433, -0.026717955246567726, -0.07408735901117325, -0.047560546547174454, 0.05621251091361046, -0.04648605361580849, -0.040841080248355865, 0.01036057434976101, -0.06433336436748505, 0.010691908188164234, -0.00550401397049427, 0.03100387379527092, -0.1171848252415657, 0.008480527438223362, 0.036199700087308884, 0.0017361263744533062, 0.022989198565483093, -0.027310220524668694, -0.039516251534223557, -0.07236998528242111, 0.057515598833560944, 0.07544751465320587, 0.03593936935067177, 0.012715665623545647, -0.045576635748147964, 0.007681905757635832, -0.009578847326338291, 0.04307837039232254, 0.023879224434494972, -0.008797048591077328, -0.08136042952537537, -0.007250364404171705, -0.025369739159941673, -0.0005980075220577419, -0.11112914234399796, 0.046952877193689346, -0.01560141146183014, -0.02077966369688511, -0.08097954094409943, 0.04874808341264725, -0.05026556923985481, 0.005398482084274292, -0.0464327372610569, -0.06117778643965721, -3.675438757867186e-33, 0.07948102056980133, 0.06161237135529518, 0.016695158556103706, 0.08696194738149643, -0.029287846758961678, 0.03250274807214737, 0.01579791121184826, 0.051501642912626266, 0.05115698277950287, 0.05117916315793991, -0.056794337928295135, -0.07082422822713852, -0.05277162417769432, -0.03996540606021881, 0.05703656002879143, 0.07289823144674301, -0.06186952441930771, 0.12677764892578125, 0.02347422018647194, -0.08361548185348511, 0.023828497156500816, -0.08579561114311218, -0.02871008776128292, 0.02921880967915058, 0.06158933788537979, 0.007195528130978346, -0.04998327046632767, -0.024051908403635025, -0.024342209100723267, -0.07359163463115692, -0.041489481925964355, 0.026347901672124863, -0.05418120324611664, -0.10405684262514114, 0.02339486964046955, 0.02778567560017109, 0.04448933154344559, -0.04370014742016792, -0.0289319921284914, 0.011856628581881523, 0.05317261815071106, 0.016551829874515533, 0.008536039851605892, 0.017763175070285797, 0.050715722143650055, 0.07544086873531342, -0.026506755501031876, 0.07102656364440918, 0.0041657802648842335, 0.07050707936286926, -0.0796893835067749, 0.02796659618616104, 0.1073482558131218, 0.029755646362900734, -0.0482989177107811, -0.0451214425265789, 0.05594706907868385, 0.048108577728271484, -0.07756289094686508, -0.022945819422602654, -0.04676621034741402, -0.057057518512010574, -0.052353259176015854, 0.03499029949307442, 0.031286437064409256, -0.005019457545131445, -0.017468491569161415, -0.09212388843297958, 0.02331305667757988, 0.03498250991106033, 0.01066337525844574, -0.032893188297748566, 0.03878697752952576, 0.0010108602000400424, 0.019085995852947235, 0.11294590681791306, 0.006003750953823328, -0.01657499559223652, -0.019893329590559006, -0.04210255295038223, 0.06726466119289398, -0.018619656562805176, 0.0011317712487652898, 0.04396169260144234, -0.0036994118709117174, 0.05521998554468155, -0.048844072967767715, 0.11681180447340012, 0.013378730975091457, -0.049541108310222626, -0.016001980751752853, -0.041160814464092255, -0.029186002910137177, 0.009741454385221004, 0.05659489706158638, -4.9680526359452415e-08, 0.0012181298807263374, -0.06939692795276642, 0.029282014816999435, -0.04563461244106293, -0.05772295594215393, 0.1265648752450943, 0.05580907315015793, 0.0020318864844739437, 0.005500901490449905, 0.04389113932847977, 0.015607683919370174, 0.03963194414973259, -0.04115065932273865, -0.06714751571416855, -0.12331043183803558, 0.13561709225177765, -0.03232327476143837, 0.09997990727424622, -0.007150343619287014, 0.055820636451244354, -0.01428388711065054, -0.02956601418554783, -0.055818043649196625, 0.0793893039226532, -0.05140697583556175, 0.01941932551562786, -0.012878702022135258, 0.069844551384449, -0.11820348352193832, -0.013021843507885933, -0.01395742129534483, -0.09432701766490936, 0.023258628323674202, 0.06344668567180634, 0.027378175407648087, -0.09062108397483826, -0.03562318533658981, -0.015213740058243275, 0.021696630865335464, 0.07694284617900848, -0.027595169842243195, 0.05069170147180557, -0.04823112115263939, -0.05646588280797005, 0.11708927899599075, 0.023356245830655098, -0.06101157143712044, -0.029203690588474274, -0.08848658949136734, 0.013032390736043453, -0.0018380292458459735, -0.039635997265577316, 0.00986042432487011, -0.02513108216226101, -0.0564558170735836, 0.0064410800114274025, 0.012292339466512203, 0.07259178161621094, -0.03631269186735153, 0.005590434186160564, -0.02889566496014595, 0.07832397520542145, 0.03203533962368965, -0.02720271237194538 ] }, { "text": "---\ntitle: \"Image Processing\"\nid: \"imageprocess\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"dl\", \"image\"]\nrelated: [\"dl\"]\ndate: \"2020-10-19\"\ndescription: \"Loading an image with PIL and processing it with PyTorch and Numpy\"\n---\n\nIn this notebook, I will explain how to load an image with PIL and explain some operations with PyTorch and Numpy. \nThese processes are part of Style Transfer in Convolutional Neural Networks, there are two images: content and style. \nThe next post defines how to transfer the style of one image to the content of the other image.\n\nThis document is prepared by using Google Colab and the lecture notes from: https://classroom.udacity.com/courses/ud188\n\n**First of all; make sure that you are in the right content in drive.**", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_0", "embedding": [ -0.12574240565299988, -0.028931014239788055, 0.04919090494513512, 0.004742427729070187, -0.0069822873920202255, -0.01754167303442955, -0.04260170832276344, -0.042735397815704346, 0.016102632507681847, -0.09288991242647171, -0.060757048428058624, 0.022906731814146042, 0.03910043463110924, -0.030246520414948463, -0.010671665892004967, 0.04672619700431824, -0.028462069109082222, 0.041093673557043076, -0.10370334982872009, -0.045782096683979034, 0.017594195902347565, -0.046262599527835846, 0.02465413697063923, -0.06785186380147934, 0.014656824991106987, 0.04778367280960083, 0.041509199887514114, -0.04869377985596657, 0.05593814700841904, -0.09199818968772888, 0.07496769726276398, 0.012915054336190224, -0.03875795006752014, 0.03594439476728439, -0.02403244748711586, 0.09582701325416565, -0.012842514552175999, -0.016554392874240875, 0.011845584958791733, -0.05255540832877159, 0.07886560261249542, -0.06295298039913177, -0.031095396727323532, -0.05484606325626373, 0.03235367313027382, 0.07789327204227448, -0.01363462582230568, -0.03030538186430931, 0.0599706657230854, -0.03396555781364441, -0.0643443912267685, -0.02976997382938862, -0.09188298881053925, 0.025136256590485573, -0.020272156223654747, 0.11280083656311035, 0.1101696714758873, -0.022734753787517548, -0.015759341418743134, 0.017505330964922905, -0.05626701936125755, 0.03070402890443802, -0.04499930888414383, -0.003474443918094039, 0.009568179957568645, -0.01890645921230316, -0.007513465825468302, -0.03733859211206436, 0.028430771082639694, -0.10153018683195114, 0.042672332376241684, -0.01115487702190876, -0.015105623751878738, 0.018169818446040154, -0.02205521985888481, -0.03092462196946144, 0.04581861197948456, 0.024806328117847443, -0.07807742804288864, -0.09876058995723724, 0.020578008145093918, -0.016655895859003067, 0.07484880089759827, 0.027015320956707, 0.07913056761026382, 0.03528826683759689, -0.11329469829797745, 0.027971360832452774, -0.03126993402838707, 0.003285811049863696, -0.007635036017745733, -0.02514497935771942, -0.08678501844406128, 0.009432580322027206, 0.05586378648877144, -0.0011507044546306133, -0.01835048384964466, -0.06081165373325348, -0.03261161595582962, 0.031153572723269463, 0.03540823236107826, -0.04823468625545502, 0.023684421554207802, -0.018873928114771843, 0.016111815348267555, -0.02601962722837925, 0.06941727548837662, 0.03148919716477394, -0.04737746715545654, -0.08447563648223877, 0.06457646191120148, -0.01977180503308773, -0.040590912103652954, 0.009836746379733086, 0.061361126601696014, 0.010380680672824383, -0.007560856640338898, 0.01890316605567932, 0.059892479330301285, -0.08176606893539429, -0.028085114434361458, 0.009546544402837753, -0.051291294395923615, 0.012392558157444, -0.08839375525712967, -0.10010045021772385, -0.039774440228939056, 5.289946820600996e-33, 0.008738053031265736, -0.033510804176330566, 0.03042893297970295, 0.04590192437171936, 0.006597875151783228, 0.022266065701842308, -0.008872981183230877, -0.12578777968883514, -0.05688733607530594, -0.046085529029369354, 0.023717820644378662, -0.0349007211625576, -0.10050299763679504, 0.09263944625854492, -0.06579849123954773, -0.030220570042729378, -0.005961600691080093, 0.018026815727353096, 0.04869535192847252, 0.040734294801950455, -0.012824654579162598, 0.047472380101680756, -0.017465751618146896, 0.0420750230550766, -0.06630942970514297, 0.004065150395035744, -0.024563018232584, -0.04159609228372574, 0.02247592993080616, -0.017746655270457268, -0.013875463046133518, -0.018063480034470558, 0.022988013923168182, 0.016330445185303688, -0.07871148735284805, -0.03430935740470886, -0.004352189134806395, 0.051066454499959946, 0.029604028910398483, 0.02255910448729992, 0.016336143016815186, 0.049636051058769226, 0.0009273893665522337, 0.01273381058126688, -0.10526902973651886, 0.10299353301525116, 0.014506937935948372, 0.0645255446434021, -0.049671292304992676, 0.01994859054684639, 0.06433456391096115, -0.022841965779662132, 0.004983052611351013, -0.015088499523699284, 0.006354114506393671, -0.056652139872312546, 0.06716850399971008, 0.02434733510017395, 0.04607956483960152, -0.047966260462999344, 0.15829622745513916, 0.10475841164588928, 0.01514155138283968, 0.04813937097787857, 0.06973390281200409, 0.03621703013777733, 0.022330662235617638, 0.02981880120933056, -0.05419623479247093, 0.0646490827202797, -0.048808593302965164, 0.12103580683469772, 0.0007606922299601138, -0.025186076760292053, 0.08672924339771271, -0.05538257583975792, 0.01797286979854107, -0.054292336106300354, -0.03116159327328205, 0.07736023515462875, -0.037860769778490067, 0.08593245595693588, 0.0053109596483409405, -0.05989573523402214, -0.11850402504205704, 0.09629295021295547, 0.07249429821968079, -0.059579819440841675, -0.0020588282495737076, -0.042434994131326675, -0.028636738657951355, -0.030894383788108826, -0.0019522253423929214, 0.035327423363924026, -0.02282673865556717, -6.1107026902840415e-33, 0.06440532207489014, 0.04929922893643379, -0.013459647074341774, 0.0612153485417366, -0.029576973989605904, -0.03426988050341606, 0.003212044481188059, -0.030858119949698448, 0.06342636793851852, 0.024884892627596855, 0.01863889954984188, -0.006361767649650574, -0.09885059297084808, -0.04476826265454292, -0.009711682796478271, -0.06779157370328903, -0.020565325394272804, 0.009447627700865269, -0.09329525381326675, -0.009688826277852058, -0.08101306110620499, 0.07319051027297974, 0.02156207151710987, 0.03054198995232582, -0.09955926239490509, 0.027997849509119987, -0.045672863721847534, 0.004794005770236254, -0.031401894986629486, 0.009518196806311607, -0.03127158433198929, -0.02677721157670021, 0.005419893190264702, -0.0023765673395246267, -0.031870730221271515, 0.0600346177816391, 0.03706897795200348, -0.018422268331050873, -0.04222907871007919, -0.0018791184993460774, 0.04959704726934433, 0.005496999714523554, -0.002262089168652892, 0.008005634881556034, -0.041480205953121185, 0.0026884591206908226, -0.03355874866247177, -0.04457962140440941, -0.03736599534749985, 0.07285460829734802, 0.06824123114347458, 0.014158206060528755, -0.039470791816711426, 0.022408993914723396, 0.023233095183968544, 0.005983243230730295, 0.004161237273365259, 0.04871869832277298, 0.0028776167891919613, -0.0028889284003525972, -0.08920899778604507, -0.12656164169311523, -0.10976821929216385, -0.10518426448106766, -0.02571263164281845, 0.009682451374828815, -0.05650603398680687, -0.004509750287979841, 0.004547766409814358, 0.05439923331141472, 0.016072265803813934, 0.02595139481127262, 0.08996258676052094, 0.08378326892852783, -0.008724188432097435, -0.062170401215553284, 0.07574450224637985, 0.02021496742963791, -0.02911810390651226, -0.023449936881661415, -0.043224263936281204, -0.05282905697822571, -0.06325070559978485, 0.05866272374987602, 0.02587204985320568, 0.09143742173910141, 0.04040659964084625, -0.011149014346301556, 0.07805584371089935, -0.07166881114244461, -0.007378264795988798, 0.019258081912994385, 0.0898221954703331, 0.04739049822092056, -0.004882951732724905, -5.463721564069601e-08, 0.001738357008434832, 0.01834164373576641, 0.030246969312429428, 0.03903007507324219, 0.026643872261047363, 0.02468402124941349, 0.03586765378713608, 0.03023039922118187, 0.02873135171830654, 0.009919334203004837, -0.04234079271554947, 0.025296835228800774, 0.04265770688652992, -0.06156685948371887, -0.05181923508644104, 0.1590818464756012, 0.011947497725486755, 0.024932390078902245, 0.06985553354024887, -0.11708200722932816, 0.019396696239709854, -0.05789543315768242, 0.004803178366273642, 0.030067062005400658, -0.08407231420278549, -0.023345403373241425, 0.012333615683019161, -0.005488544702529907, -0.054147329181432724, -0.019717464223504066, -0.00578538840636611, -0.0014841672964394093, 0.011294201016426086, -0.029263563454151154, 0.09989876300096512, 0.012050493620336056, 0.011902626603841782, -0.027601730078458786, 0.008540470153093338, 0.0455084890127182, -0.07433319836854935, 0.0651492178440094, -0.0006255107000470161, 0.020443188026547432, 0.027757704257965088, -0.047407567501068115, 0.034630775451660156, -0.08060673624277115, -0.00527825765311718, 0.14971524477005005, 0.057378608733415604, 0.0011760912602767348, 0.03605138882994652, 0.07432322949171066, 0.0072478544898331165, -0.05237956717610359, -0.0011127643520012498, 0.041901905089616776, 0.04651400074362755, 0.10961415618658066, -0.003585070138797164, 0.07062993198633194, 0.021823130548000336, -0.04005870968103409 ] }, { "text": "**First of all; make sure that you are in the right content in drive.**\n\n\n```python\nfrom google.colab import drive\ndrive.mount('/content/drive')\n```\n\n Mounted at /content/drive\n\n\nUse GPU if available\n\n\n```python\n# move the model to GPU, if available\ndevice = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n```\n\nImport libraries\n\n\n```python\n# import resources\n%matplotlib inline\n\nfrom PIL import Image\nfrom io import BytesIO\nimport matplotlib.pyplot as plt\nimport numpy as np\n\nimport torch\nimport requests\nfrom torchvision import transforms, models\n```\n\n**Load Image**", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_1", "embedding": [ -0.03585369512438774, -0.13128487765789032, 0.0010383744956925511, 0.013851669616997242, -0.002085387473925948, -0.04041812941431999, -0.048907436430454254, 0.06061027944087982, -0.011783291585743427, -0.0721743181347847, -0.009462964721024036, -0.04872886463999748, -0.0569915808737278, 0.020066773518919945, -0.03114558383822441, -0.00761615252122283, -0.015371420420706272, -0.09369676560163498, -0.05979236960411072, -0.09145887196063995, 0.06735597550868988, -0.0671868696808815, 0.07057104259729385, -0.042532969266176224, -0.013165499083697796, -0.03591470047831535, 0.058380939066410065, 0.00923624075949192, 0.028576966375112534, -0.014751523733139038, 0.022187726572155952, -0.012359121814370155, -0.06782945990562439, 0.022238420322537422, 0.052912637591362, -0.0006830714992247522, -0.008783220313489437, -0.035670626908540726, -0.0559021532535553, -0.04433736205101013, 0.05867377668619156, -0.013143480755388737, -0.00033282910590060055, -0.03494875505566597, 0.01687977835536003, 0.008704819716513157, 0.09440251439809799, -0.054370880126953125, 0.08642090111970901, -0.05323910713195801, -0.05345591902732849, 0.0013913384173065424, -0.03092951700091362, 0.026174603030085564, -0.015756305307149887, 0.011294491589069366, 0.054639603942632675, -0.13683585822582245, 0.06419387459754944, -0.09505746513605118, -0.006088080815970898, 0.022505953907966614, 0.015455669723451138, -0.024084920063614845, -0.007430633530020714, -0.012460911646485329, 0.02456524781882763, -0.03618847578763962, -0.014161116443574429, -0.007280649151653051, 0.045882828533649445, 0.03311467170715332, -0.02082512341439724, 0.041447144001722336, -0.08725719898939133, -0.04872334003448486, 0.06839132308959961, 0.02306884154677391, 0.032159071415662766, -0.02000683732330799, -0.03922441601753235, 0.016583170741796494, 0.09328459203243256, 0.060207877308130264, 0.012565338052809238, -0.03330099210143089, 0.0004106719861738384, 0.06889285147190094, -0.019637495279312134, -0.09184999018907547, -0.033360522240400314, 0.0028704809956252575, -0.08398345112800598, 0.06537845730781555, -0.00628571305423975, -0.033809054642915726, 0.05325623229146004, -0.013120432384312153, -0.059821538627147675, 0.009894296526908875, -0.024012230336666107, -0.021664796397089958, 0.008775899186730385, 0.03708257898688316, -0.06732941418886185, 0.07340998202562332, 0.012465598061680794, 0.10142254829406738, -0.0390339270234108, 0.018901165574789047, 0.076651431620121, 0.09030230343341827, -0.06026756390929222, 0.05145827308297157, 0.0989735797047615, -0.055656686425209045, -0.08775422722101212, 0.06838225573301315, -0.08329769223928452, 0.05244634300470352, -0.020653117448091507, 0.06986589729785919, -0.02953619323670864, 0.03421085327863693, -0.0687539130449295, -0.07583840191364288, -0.016022903844714165, 8.624342708541973e-33, 0.024000635370612144, -0.017312627285718918, 0.009528476744890213, -0.04359346255660057, 0.01038425974547863, -0.006253694649785757, -0.005739576183259487, -0.05675332248210907, -0.08809994906187057, 0.04851590842008591, 0.008413122966885567, 0.034848254173994064, -0.04385307803750038, 0.07811529189348221, -0.07379314303398132, -0.009540273807942867, 0.06232494115829468, -0.03186829388141632, 0.016953488811850548, -0.02400907129049301, 0.07073409855365753, 0.06238953396677971, -0.020700734108686447, 0.018029633909463882, -0.10304249823093414, 0.08433109521865845, -0.04449837654829025, 0.056352388113737106, 0.05165202543139458, 0.013881076127290726, 0.005998353473842144, 1.9608003640314564e-05, 0.017056306824088097, -0.02461969293653965, -0.0012225225800648332, -0.060708992183208466, -0.018036261200904846, -0.004267197567969561, -0.036126941442489624, 0.008957342244684696, 0.034185584634542465, 0.031725089997053146, -0.016758877784013748, -0.03927687555551529, -0.06923963874578476, 0.07351433485746384, -0.023235343396663666, 0.04569685831665993, -0.014377557672560215, 0.026531796902418137, -0.0868159681558609, -0.030878182500600815, -0.021298134699463844, 0.018753450363874435, 0.02482599765062332, -0.021234041079878807, 0.054330673068761826, -0.014872093684971333, 0.07505901157855988, -0.09153436124324799, 0.08837829530239105, 0.06796687841415405, 0.035409219563007355, 0.022242652252316475, -0.0388324074447155, -0.0032867309637367725, -0.045143455266952515, 0.06548066437244415, -0.05498730391263962, 0.03722820430994034, -0.1072060838341713, 0.09110669791698456, -0.03057827055454254, 0.0104533014819026, 0.039570026099681854, -0.06177902966737747, -0.009175660088658333, -0.034640584141016006, -0.11705679446458817, 0.054885149002075195, -0.09025085717439651, -0.03438930585980415, 0.01780184544622898, -0.10319451987743378, -0.047011010348796844, 0.0007172534242272377, 0.021094398573040962, 0.05231783166527748, -0.030800089240074158, -0.07590410858392715, -0.06400486826896667, -0.05182083696126938, 0.044636089354753494, -0.016262993216514587, -0.07440804690122604, -8.81476618121946e-33, 0.03357936441898346, 0.043647486716508865, 0.08791185170412064, 0.027228526771068573, 0.03201849386096001, 0.009410994127392769, 0.06692372262477875, -0.05516502261161804, -0.005874043330550194, -0.02258814312517643, -0.052179329097270966, -0.009638319723308086, -0.06438722461462021, -0.012431037612259388, 0.06714513897895813, 0.010632099583745003, 0.015610200352966785, -0.046251971274614334, -0.09198480099439621, -0.02552754245698452, -0.12073514610528946, 0.10593034327030182, -0.028697054833173752, -0.041959259659051895, -0.06342196464538574, 0.044410340487957, 0.014037884771823883, -0.020820245146751404, -0.020206253975629807, -0.01029251515865326, 0.0273238867521286, 0.052758049219846725, -0.07699943333864212, -0.007559416815638542, -0.04332972690463066, 0.09011939913034439, 0.07540524750947952, -0.07518620789051056, -0.0372457392513752, -0.002636561868712306, 0.06724651157855988, 0.045511648058891296, -0.03929060697555542, 0.01326762791723013, -0.06739156693220139, 0.040188610553741455, 0.01504852157086134, -0.012096831575036049, -0.01231884304434061, 0.03276587277650833, 0.01841944456100464, -0.023597082123160362, 0.005059396382421255, 0.0362323559820652, 0.04990720376372337, -0.03464202582836151, 0.018226737156510353, -0.01762853004038334, -0.027151882648468018, -0.07819181680679321, -0.053764957934617996, -0.10520410537719727, 0.01237823162227869, -0.04125368967652321, -0.022167006507515907, -0.043644171208143234, -0.08284890651702881, 0.05610869452357292, 0.06714476644992828, 0.03933082893490791, -0.015131302177906036, 0.08725897967815399, 0.1051008552312851, 0.05470402538776398, 0.005260745994746685, 0.047483690083026886, -0.026541074737906456, 0.022850798442959785, 0.06346135586500168, 0.011515716090798378, 0.04989175125956535, -0.022304512560367584, 0.029052723199129105, 0.05827973037958145, 0.044831130653619766, 0.01517493650317192, 0.031839512288570404, 0.046152498573064804, 0.062056463211774826, -0.05726053565740585, -0.02124517597258091, -0.028296789154410362, 0.10421162098646164, 0.07892312109470367, 0.07162263244390488, -4.8688015397146955e-08, 0.022772643715143204, 0.03218237683176994, -0.016644518822431564, 0.06519625335931778, -0.047838907688856125, -0.0014353967271745205, 0.03005017340183258, -0.012988685630261898, 0.006057149264961481, 0.005359764210879803, 0.03524012863636017, -0.03715423494577408, 0.07365651428699493, -0.003075007349252701, -0.06822165101766586, 0.13524129986763, 0.040509164333343506, 0.024490756914019585, 0.09922458976507187, -0.0457366518676281, -0.015340064652264118, -0.07572749257087708, 0.02120237983763218, 0.04536507651209831, -0.06442604213953018, -0.027115287259221077, -0.03194662928581238, -0.07928100973367691, -0.09123832732439041, -0.02375846356153488, -0.02523011714220047, -0.05552169308066368, 0.041372641921043396, 0.03358704224228859, 0.12584885954856873, -0.012892094440758228, -0.010319299064576626, 0.06285161525011063, 0.05901161581277847, -0.0037752040661871433, -0.0029650332871824503, 0.06151697039604187, -0.025317547842860222, -0.017181288450956345, 0.020000874996185303, 0.011641176417469978, -0.02482043020427227, 0.014304698444902897, -0.0364467017352581, 0.14379161596298218, -0.01573614776134491, 0.018621599301695824, -0.04580969735980034, 0.06018140912055969, 0.06360939145088196, -0.029575861990451813, -0.0354996919631958, 0.028681298717856407, -0.0692184567451477, 0.00749115739017725, 0.01612772047519684, 0.005205804947763681, -0.05610186606645584, -0.09582623839378357 ] }, { "text": "import torch\nimport requests\nfrom torchvision import transforms, models\n```\n\n**Load Image**\n\nThe function below is useful for loading images. \n- img_path should be the path the image in your drive. \n- Since the large images slow down the process, max_size is defined as 400. \n- transforms from torchvision i used to crop, resize, normalize the image and we can turn it to tensor. \n\n\nSimply you can use following code: \n```\nimage = Image.open(img_path).convert('RGB')\n```", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_2", "embedding": [ 0.039040155708789825, -0.054563336074352264, 0.01609870418906212, 0.036743298172950745, 0.05209736153483391, -0.05261509120464325, -0.02548193372786045, 0.05446089431643486, -0.09392767399549484, -0.07593332976102829, -0.0323142483830452, 0.030693000182509422, -0.08325427025556564, 0.09877931326627731, -0.0022342256270349026, 0.056947533041238785, -0.042430274188518524, 0.04482647776603699, -0.08813107013702393, -0.03203129023313522, 0.043680861592292786, -0.06315927952528, 0.04512755572795868, -0.040789272636175156, -0.0438726544380188, -0.02903316169977188, 0.031991854310035706, -0.08245822787284851, 0.03129953518509865, -0.00810933206230402, -0.019338717684149742, -0.011833194643259048, -0.043486207723617554, 0.016638442873954773, 0.045998115092515945, 0.0292157381772995, -0.06516540795564651, -0.11214902997016907, -0.002305511152371764, -0.005662969313561916, 0.0698038712143898, 0.017127523198723793, -0.0131067568436265, -0.04662548005580902, 0.0127868065610528, 0.055665887892246246, 0.09815949946641922, 0.03227965906262398, 0.06665903329849243, -0.06450117379426956, -0.026866432279348373, 0.01236824132502079, -0.09443948417901993, 0.06037532538175583, 0.012297711335122585, -0.03402268886566162, 0.07368943840265274, -0.09372586756944656, -0.02546042390167713, -0.05124121904373169, -0.034195031970739365, 0.03858167305588722, 0.008987845852971077, -0.023028455674648285, -0.04266325384378433, 0.035707324743270874, 0.015072379261255264, -0.06897475570440292, 0.02851720154285431, -0.052207112312316895, -0.03379962220788002, -0.004268849268555641, -0.0385998860001564, 0.07859885692596436, -0.012658289633691311, -0.0849844217300415, 0.12395594269037247, 0.03221646696329117, 0.04710545390844345, -0.07466882467269897, 0.004536856431514025, -0.04420695826411247, 0.09483616799116135, -0.0014292284613475204, 0.05824633315205574, -0.03092905879020691, 0.00307402852922678, 0.07170252501964569, 0.01825796253979206, -0.02635892666876316, -0.0020957891829311848, -0.03235408291220665, -0.05555172637104988, 0.06562265008687973, 0.011191164143383503, 0.00234181503765285, 0.035200465470552444, -0.016846807673573494, -0.06986138969659805, 0.0021266373805701733, 0.022341640666127205, -0.03230705112218857, 0.01895120181143284, 0.0658465325832367, -0.03203097730875015, 0.028529316186904907, 0.02239093743264675, 0.06922604143619537, -0.033718232065439224, -0.0001850356929935515, 0.05071550980210304, 0.026469212025403976, -0.001996676903218031, -0.05924810841679573, 0.04626677185297012, -0.034098073840141296, -0.07463400810956955, 0.0864761546254158, -0.07053583115339279, 0.04611221328377724, 0.004260788206011057, 0.08998299390077591, -0.01808207482099533, 0.013815228827297688, -0.011242939159274101, -0.020204976201057434, -0.02513405680656433, 2.9419286299151475e-33, -0.05854812264442444, 0.012795314192771912, 0.03761470317840576, -0.017520444467663765, -0.034035712480545044, 0.045763272792100906, 0.04986982420086861, -0.026451067999005318, -0.0593254417181015, -0.03111589327454567, -0.02841206081211567, 0.012550690211355686, -0.022834384813904762, 0.0701218843460083, -0.07381332665681839, -0.02201555296778679, 0.061068590730428696, 0.006491560023277998, 0.06979949027299881, 0.07234010100364685, 0.03182567283511162, 0.00559611339122057, -0.006458060350269079, 0.05998260900378227, -0.095091812312603, -0.06833625584840775, -0.010753457434475422, 0.009014126844704151, 0.05808448791503906, -0.021846886724233627, -0.04502878338098526, -0.04848281666636467, -0.022953029721975327, 0.0038282833993434906, -0.01583096943795681, -0.08321993798017502, 0.011778237298130989, 0.02018171362578869, -0.07285113632678986, -0.045381851494312286, 0.0500115342438221, 0.09410209953784943, -0.018590282648801804, -0.03678131103515625, -0.10054033994674683, 0.029830951243638992, -0.03632356971502304, 0.0473967045545578, -0.0284047219902277, -0.0016012880951166153, -0.02180572785437107, -0.04476427286863327, 0.021210653707385063, -0.0007057875627651811, -0.012067212723195553, -0.06909105181694031, 0.09498528391122818, 0.013354477472603321, 0.09231525659561157, -0.13578838109970093, 0.07323934882879257, 0.005127942189574242, 0.029999321326613426, 0.10718470066785812, 0.0420907586812973, -0.061812665313482285, 0.029515519738197327, 0.06089554727077484, -0.10764214396476746, 0.02862456440925598, -0.07321897894144058, 0.08108477294445038, -0.014093190431594849, -0.06111269071698189, -0.006686442997306585, -0.09847518056631088, 0.04003656655550003, -0.007006021682173014, -0.07920647412538528, 0.059933099895715714, -0.1360407918691635, 0.04312523081898689, 0.07596488296985626, -0.13745127618312836, -0.031316109001636505, 0.03604470193386078, -0.005094865802675486, -0.01798354461789131, 0.023318888619542122, -0.06804588437080383, -0.06204713135957718, -0.011328769847750664, 0.03370289131999016, 0.005311123561114073, -0.06157641112804413, -1.1180480337330985e-33, 0.07890845835208893, 0.014998559840023518, 0.0018712265882641077, 0.025212351232767105, -0.04319210350513458, 0.002603396773338318, 0.013271079398691654, 0.05564261972904205, -0.014717129990458488, -0.03322751075029373, 0.059998415410518646, -0.0018703057430684566, -0.04082469642162323, -0.10535301268100739, 0.028185194358229637, -0.08735894411802292, 0.03215887397527695, 0.027286101132631302, -0.0308509711176157, 0.005643888376653194, -0.10074175894260406, 0.05495346337556839, -0.022418426349759102, 0.04069940745830536, -0.12093866616487503, 0.062052469700574875, 0.023665618151426315, 0.050001319497823715, -0.03088962472975254, -0.02067829668521881, 0.006310701835900545, 0.002287153620272875, -0.03742481395602226, -0.008270231075584888, -0.020326882600784302, 0.08538858592510223, 0.07181120663881302, 0.00938369520008564, -0.030060261487960815, 0.04415253922343254, 0.048191435635089874, 0.043178439140319824, -0.0723443254828453, 0.08718395978212357, -0.0661231204867363, -0.0112336790189147, -0.03738539665937424, -0.010202941484749317, 0.007739113178104162, 0.04622701555490494, -0.0014420913066715002, -0.07900653779506683, -0.04808497801423073, 0.03326939046382904, 0.03469746559858322, -0.009305676445364952, -0.0009526672074571252, -0.013155761174857616, 0.07085996121168137, -0.020507780835032463, -0.03356761112809181, -0.06610190123319626, -0.02311832085251808, -0.08041724562644958, -0.02103806473314762, 0.03375835716724396, -0.08256631344556808, 0.017597999423742294, 0.034024953842163086, 0.08116763085126877, -0.011898601427674294, 0.08321280032396317, 0.08558867871761322, 0.13053284585475922, -0.0009859490673989058, -0.049129169434309006, 0.04032748565077782, 0.0541439913213253, 0.08539532124996185, -0.034171056002378464, 0.04887488856911659, -0.031835660338401794, 0.006553807761520147, 0.07378088682889938, 0.04034699872136116, 0.04984758421778679, -0.019823720678687096, 0.0382014662027359, 0.049071457237005234, 0.003621007315814495, -0.014724351465702057, -0.030147649347782135, 0.12783725559711456, 0.026098279282450676, 0.08877076953649521, -4.155543464889888e-08, 0.012834508903324604, 0.024591658264398575, 0.04826121777296066, 0.00523495813831687, -0.05050051212310791, -0.015552302822470665, 0.06507623940706253, 0.07763951271772385, 0.03815411031246185, 0.028524789959192276, 0.03306203708052635, -0.0351189486682415, 0.04832277074456215, -0.015836361795663834, -0.006178853567689657, 0.11454079300165176, 0.03668750450015068, 0.04046178236603737, 0.02402181178331375, -0.040895726531744, 0.028866006061434746, -0.061424754559993744, 0.01712017133831978, 0.03813586011528969, 0.014426996000111103, -0.058927424252033234, 0.017547443509101868, 0.0029783048667013645, -0.05423895642161369, -0.09398341178894043, -0.0064002275466918945, -0.04184328764677048, 0.026436492800712585, 0.025820115581154823, 0.047442831099033356, 0.026803338900208473, -0.031972624361515045, 0.0031988625414669514, 0.002495422260835767, -0.005537979304790497, -0.05309629812836647, 0.01535162515938282, 0.014535711146891117, -0.06445007771253586, -0.007326776161789894, -0.04022219032049179, 0.005245635285973549, 0.03362686559557915, -0.023882422596216202, 0.09546425938606262, 0.07803206890821457, 0.011785055510699749, -0.06136590242385864, 0.11347351223230362, 0.02227526344358921, -0.059414323419332504, 0.01641227863729, 0.04065577685832977, -0.0070611159317195415, 0.0302084032446146, 0.04191094636917114, 0.00142489664722234, -0.04449360445141792, -0.06786929070949554 ] }, { "text": "```python\ndef load_image(img_path, max_size=400, shape=None):\n ''' Load in and transform an image, making sure the image\n is <= 400 pixels in the x-y dims.'''\n if \"http\" in img_path:\n response = requests.get(img_path)\n image = Image.open(BytesIO(response.content)).convert('RGB')\n else:\n image = Image.open(img_path).convert('RGB')\n \n # large images will slow down processing\n if max(image.size) > max_size:\n size = max_size\n else:\n size = max(image.size)\n \n if shape is not None:\n size = shape\n \n in_transform = transforms.Compose([\n transforms.Resize(size),\n transforms.ToTensor(),\n transforms.Normalize((0.485, 0.456, 0.406),", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_3", "embedding": [ 0.05050550028681755, 0.04317891225218773, 0.03239583596587181, -0.0023081779945641756, 0.013201716355979443, -0.14680258929729462, -0.0655222237110138, 0.058068640530109406, -0.03918469697237015, -0.02805658057332039, -0.06969713419675827, 0.04736221581697464, 0.05059671774506569, 0.06937194615602493, -0.003374930936843157, 0.0019746054895222187, -0.007743605878204107, 0.06484728306531906, -0.10110114514827728, -0.03821076452732086, 0.06023328751325607, -0.09133108705282211, -0.0104156993329525, -0.08195824921131134, 0.0004308529896661639, -0.0426798090338707, -0.020479535683989525, -0.07443050295114517, 0.008803692646324635, -0.07952885329723358, -0.027256278321146965, -0.023739276453852654, -0.0298328660428524, 0.013585008680820465, 0.02001078799366951, 0.10192862898111343, -0.032755859196186066, -0.04811691492795944, 0.028702860698103905, -0.07010289281606674, 0.050269871950149536, -0.010285723954439163, 0.03271642327308655, -0.06158698350191116, 0.03071952983736992, 0.06455143541097641, 0.015129625797271729, 0.013317123986780643, 0.042020462453365326, -0.09919711947441101, -0.03386335074901581, -0.0015382319688796997, -0.10361943393945694, 0.10115126520395279, -0.020349571481347084, -0.03326699137687683, 0.06082106754183769, -0.05914362892508507, -0.021115781739354134, -0.028771042823791504, -0.08589575439691544, 0.04686092212796211, 0.04322328791022301, 0.03489423170685768, 2.07777939067455e-05, 0.007006337866187096, 0.036296505481004715, -0.08608635514974594, -0.02475949376821518, -0.009983144700527191, -0.03819567710161209, 0.06077613681554794, -0.02044871263206005, 0.05709962546825409, -0.01954738236963749, -0.10286611318588257, 0.05165098235011101, 0.04540431499481201, 0.014631267637014389, -0.020402085036039352, 0.018504738807678223, -0.016611985862255096, 0.06391159445047379, 0.03469223901629448, 0.09113011509180069, -0.008377778343856335, -0.01999516226351261, 0.016014911234378815, -0.05174066498875618, -0.009891293942928314, -0.00037664026604034007, 0.05066518485546112, -0.05626218393445015, 0.10005927830934525, 0.010662573389708996, -0.01653968170285225, -0.014938406646251678, -0.07520090788602829, -0.04069482907652855, 0.027262791991233826, 0.0675840973854065, -0.056907739490270615, 0.08140828460454941, 0.012302416376769543, 0.0828263983130455, -0.003613477572798729, 0.06451164186000824, 0.0836644098162651, 0.05612129718065262, -0.032103776931762695, 0.020812707021832466, -0.010161321610212326, -0.00915630254894495, 0.016536476090550423, 0.03529161587357521, 0.0021152596455067396, -0.044290345162153244, 0.07548493891954422, -0.09147044271230698, 0.0013818442821502686, 0.02848202921450138, 0.054391685873270035, -0.06810760498046875, -0.060352422297000885, -0.018383031710982323, -0.03399517759680748, -0.041523005813360214, 7.977501228063085e-33, -0.06033843755722046, 0.01546426024287939, 0.05837109684944153, -0.03249375522136688, -0.013390070758759975, 0.1086731106042862, 0.0014678261941298842, -0.02870999090373516, -0.06047431379556656, -0.04180508479475975, -0.05244460329413414, -0.0025532683357596397, -0.0454598031938076, 0.11716111749410629, 0.05120110139250755, -0.014596694149076939, 0.01629888080060482, 0.03765825182199478, 0.0529729463160038, 0.024223050102591515, 0.007832497358322144, -0.07748430222272873, -0.02584032528102398, 0.03724076226353645, -0.10764079540967941, -0.08667793869972229, 0.00437196483835578, 0.002774731256067753, -0.03312992677092552, -0.02456820383667946, -0.049388475716114044, -0.022109825164079666, -0.042828649282455444, 0.022971773520112038, -0.024036020040512085, -0.12344906479120255, 0.01584623195230961, 0.01612929441034794, -0.05979076772928238, 0.017269747331738472, 0.038813162595033646, 0.08836334943771362, 0.015369863249361515, 0.024600310251116753, -0.05612505227327347, 0.029506593942642212, 0.010879885405302048, 0.08233281970024109, -0.060141466557979584, 0.03346800059080124, 0.08781523257493973, -0.051761444658041, 0.02428668551146984, -0.029935332015156746, 0.007621606811881065, -0.05125434324145317, 0.07708749920129776, 0.0018499459838494658, 0.04744992032647133, -0.031722795218229294, 0.08377179503440857, -0.05680830404162407, -0.00893100444227457, 0.07846055924892426, 0.05361613631248474, -0.05614505708217621, 0.09224923700094223, 0.023368915542960167, -0.16193366050720215, 0.033818505704402924, 0.002698552329093218, 0.05449769273400307, 0.03476167097687721, -0.10017874091863632, -0.004756433889269829, -0.08009275048971176, 0.026557819917798042, -0.010541826486587524, -0.09056293219327927, 0.03795722499489784, -0.07828155159950256, 0.07730308175086975, 0.03765249252319336, -0.15328700840473175, -0.018430184572935104, 0.030762096866965294, 0.05836489796638489, -0.012505545280873775, -0.02795347198843956, -0.05351266637444496, -0.03675338253378868, -0.022990712895989418, -0.003628946840763092, -0.007429095916450024, -0.05520332232117653, -4.693764003854764e-33, 0.07724105566740036, 0.02156107872724533, 0.04680370166897774, 0.05063558742403984, 0.0012624397641047835, -0.029192619025707245, 0.054607290774583817, 0.07376676797866821, 0.01161844190210104, -0.1103561744093895, 0.052450042217969894, -0.012055657804012299, -0.022943418473005295, -0.0651748925447464, -0.03005080297589302, -0.06431285291910172, 0.007140319794416428, -0.0018931200029328465, -0.06587744504213333, -0.0014614408137276769, -0.10547904670238495, 0.043431445956230164, 0.010852963663637638, 0.05137787386775017, -0.10306662321090698, 0.09471843391656876, -0.014454087242484093, 0.01123147364705801, -0.047863781452178955, -0.0018882635049521923, -0.07521526515483856, 0.019884377717971802, -0.02033092826604843, -0.004525644704699516, 0.02684301882982254, 0.027388880029320717, 0.07367876917123795, 0.013733165338635445, 0.0021285838447511196, 0.02538505382835865, 0.05438629537820816, 0.005051373969763517, -0.054435573518276215, 0.024910900741815567, -0.02023029327392578, -0.007143367547541857, -0.06510856002569199, -0.020976336672902107, 0.014697548002004623, 0.10684732347726822, -0.003159239422529936, -0.010617026127874851, -0.009977161884307861, 0.07742439210414886, 0.06273351609706879, -0.02317798137664795, -0.10293516516685486, -0.009015718474984169, 0.05073409527540207, -0.05426012724637985, -0.05841858312487602, -0.06674908846616745, -0.057828743010759354, -0.03504670783877373, -0.01892894320189953, 0.06447182595729828, -0.05490054562687874, -0.012548496015369892, 0.007528584450483322, 0.14596253633499146, -0.0001697251427685842, 0.00574133824557066, 0.06100741773843765, 0.04606238752603531, -0.01881122775375843, -0.06105257198214531, 0.024118337780237198, 0.0042864675633609295, 0.0023060699459165335, 0.0334133543074131, 0.002246163785457611, 0.029125990346074104, -0.01787414215505123, 0.006777107249945402, -0.000763017509598285, 0.05622033774852753, -0.0034437431022524834, -0.004880364052951336, 0.06174148991703987, 0.041699159890413284, 0.0009341577533632517, 0.028287118300795555, 0.09019900858402252, 0.004445371218025684, 0.08867217600345612, -5.709395267672335e-08, 0.06460616737604141, 0.0011560359271243215, 0.06189052760601044, -0.008094197139143944, -0.016142159700393677, 0.02904379926621914, 0.040180232375860214, 0.08326586335897446, 0.04669594019651413, 0.01920481026172638, 0.037206172943115234, -0.024552209302783012, 0.007924926467239857, -0.017069248482584953, 0.024465374648571014, 0.046653762459754944, 0.03268253430724144, -0.008206830359995365, 0.03291785344481468, -0.052878253161907196, -0.061096299439668655, -0.05743291229009628, -0.03183412924408913, 0.03388417512178421, 0.007414710707962513, -0.039116669446229935, 0.001414568512700498, -0.04613699018955231, -0.0046283891424536705, -0.08308667689561844, 0.014629863202571869, 0.003702238667756319, 0.00801889132708311, 0.030080150812864304, 0.012388856150209904, -0.008593760430812836, -0.08330046385526657, 0.025548914447426796, -0.03164035081863403, 0.007655956782400608, -0.013466914184391499, 0.02516452595591545, 0.028975049033761024, -0.05541934818029404, 0.05550980567932129, -0.04494206979870796, 0.07167932391166687, 0.03645636513829231, -0.013494832441210747, 0.10977108031511307, 0.10500691831111908, -0.007851138710975647, -0.038712285459041595, 0.03604731336236, 0.015552089549601078, -0.06325388699769974, 0.0664554014801979, 0.04670969769358635, 0.015012717805802822, 0.1149681806564331, 0.010076310485601425, -0.0012744214618578553, -0.005709080025553703, -0.06077563017606735 ] }, { "text": "transforms.ToTensor(),\n transforms.Normalize((0.485, 0.456, 0.406), \n (0.229, 0.224, 0.225))])", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_4", "embedding": [ -0.00241169985383749, 0.04502153396606445, -0.030757570639252663, -0.017186060547828674, -0.07417967915534973, -0.07828860729932785, -0.04308435320854187, 0.030805718153715134, -0.02560056932270527, -0.01931704580783844, -0.0008793917368166149, -0.013341476209461689, -0.029952893033623695, 0.053346339613199234, 0.00528130354359746, -0.02980753593146801, -0.11734946817159653, 0.08864431828260422, -0.12675030529499054, 0.010122903622686863, 0.06793586909770966, 0.08369027823209763, -0.0502457357943058, -0.007409602869302034, 0.13227775692939758, 0.009293809533119202, 0.017179597169160843, -0.0340815931558609, 0.01692846231162548, 0.02798670530319214, -0.07711033523082733, 0.009546937420964241, -0.01413929183036089, -0.026361482217907906, -0.047340456396341324, -0.04075491428375244, -0.015624521300196648, -0.03310995176434517, 0.04691324010491371, 0.020116262137889862, 0.08228078484535217, 0.010028881952166557, -0.007044394500553608, -0.024041200056672096, 0.007511278614401817, 0.01569773629307747, -0.024462593719363213, 0.007322805002331734, 0.055213116109371185, -0.012112921103835106, 0.06053624302148819, 0.11549129337072372, -0.06201735511422157, 0.0004639248945750296, -0.03828977048397064, -0.03298753499984741, 0.0384993739426136, -0.06125323474407196, 0.026055291295051575, -0.07059139013290405, -0.058162882924079895, 0.007557237520813942, 0.04828038066625595, 0.03955801948904991, -0.05359825864434242, -0.10666615515947342, 0.016746923327445984, -0.08793811500072479, -0.005382059141993523, 0.037322428077459335, -0.06850025057792664, 0.022018568590283394, 0.10248199105262756, 0.020501255989074707, 0.06059632822871208, -0.08511356264352798, -0.07108748704195023, 0.01412616204470396, 0.029310042038559914, 0.04731777310371399, 0.014893846586346626, -0.04212605580687523, 0.023320341482758522, 0.08726095408201218, 0.060606278479099274, 0.025364026427268982, -0.03037160448729992, 0.0815650150179863, 0.060166824609041214, 0.10724818706512451, -0.10033559799194336, 0.028911186382174492, -0.0943182185292244, -0.01102283876389265, -0.08282352983951569, 0.004850676283240318, 0.013508588075637817, -0.006096645258367062, -0.03746354579925537, 0.016072528436779976, 0.02147834375500679, -0.060129716992378235, 0.02958008646965027, 0.007919239811599255, 0.02458132989704609, 0.055268339812755585, 0.037932462990283966, -0.007849404588341713, -0.0001943120005307719, -0.010180335491895676, 0.034808844327926636, -0.046606648713350296, 0.012613368220627308, -0.0638522282242775, 0.08244014531373978, -0.016198256984353065, -0.04689090698957443, 0.05695091187953949, -0.04890109598636627, 0.01771767996251583, 0.005143343470990658, 0.07304465770721436, -0.041061077266931534, 0.06971913576126099, -0.04509109631180763, 0.09742210060358047, -0.03627701848745346, -4.344013659524839e-33, -0.043310731649398804, 0.024359406903386116, 0.048759449273347855, 0.036800045520067215, -0.07834120839834213, 0.10341650247573853, -0.06195104494690895, 0.03917504847049713, -0.036813750863075256, 0.01060456782579422, 0.040763970464468, 0.05904807150363922, -0.03149165213108063, -0.008874841034412384, -0.045493319630622864, 0.03104340098798275, 0.07886238396167755, 0.09619339555501938, -0.00195220613386482, -0.040068499743938446, 0.03505273535847664, 0.08340265601873398, -0.01911795139312744, 0.03779172897338867, -0.03760913386940956, -0.05082586407661438, -0.09992673248052597, -0.02092214860022068, -0.07941680401563644, -0.03203531354665756, -0.014456585980951786, 0.012942067347466946, -0.03728875890374184, -0.07581892609596252, 0.027739329263567924, 0.006119745317846537, 0.10540381819009781, 0.06027238070964813, 0.011305284686386585, -0.00859049055725336, 0.026725003495812416, 0.0529179647564888, 0.00413054833188653, -0.013927060179412365, 0.02697077952325344, 0.06554573029279709, 0.11086150258779526, 0.04108838364481926, 0.06422242522239685, -0.029164375737309456, -0.02316177263855934, -0.0005374099710024893, -0.010801361873745918, 0.012428988702595234, 0.0028070583939552307, -0.006609784904867411, 0.13205575942993164, 0.06344150006771088, -0.0043993606232106686, -0.0642377957701683, -0.027888698503375053, -0.024991923943161964, -0.0002538335102144629, -0.01248304732143879, 0.056991852819919586, -0.015131932683289051, 0.05027689412236214, -0.02418190985918045, -0.08131098747253418, 0.05370055511593819, 0.008192963898181915, 0.04849725589156151, -0.026304420083761215, 0.015452993102371693, -0.05612812936306, 0.016590271145105362, 0.029970237985253334, 0.00636533135548234, -0.06617116928100586, -0.07212183624505997, -0.07378695905208588, 0.11831960827112198, -0.014826356433331966, -0.07164636254310608, -0.04457945376634598, 0.02517428621649742, -0.002102551981806755, 0.008945876732468605, 0.036330390721559525, -0.027064751833677292, -0.03756561875343323, -0.06359982490539551, -0.07071114331483841, 0.0005685988580808043, -0.10221777111291885, 3.601359103878365e-33, -0.08521193265914917, 0.04216154292225838, -0.060699161142110825, 0.07980313897132874, -0.04861031472682953, 0.005125836003571749, 0.039919883012771606, 0.046067800372838974, 0.010481476783752441, -0.012041573412716389, 0.09459810703992844, -0.034423090517520905, -0.003938567824661732, -0.06759245693683624, 0.06904563307762146, -0.007474550511687994, -0.0036177663132548332, 0.07176731526851654, -0.08828355371952057, -0.09899522364139557, -0.004921994637697935, 0.09939124435186386, 0.0003577621537260711, 0.06598867475986481, -0.01944424770772457, 0.025865113362669945, -0.10272689908742905, -0.015060014091432095, 0.01554031576961279, -0.027489779517054558, -0.0464828759431839, -0.037121474742889404, 0.05077710747718811, -0.05989140644669533, -0.014430822804570198, -0.03158911317586899, -0.040093645453453064, 0.06659553200006485, 0.0298160407692194, -0.03162248432636261, -0.05676152929663658, 0.05680058151483536, -0.001664541894569993, 0.059583812952041626, 0.015928128734230995, 0.009946171194314957, 0.09355124086141586, -0.027325134724378586, -0.00874727126210928, 0.002131165936589241, -0.02208849787712097, -0.024036787450313568, 0.0013412813423201442, 0.06275404244661331, -0.048919714987277985, 0.06318584084510803, -0.06918451189994812, -0.041844967752695084, 0.0391237810254097, -0.02259713225066662, -0.002014699624851346, -0.009508666582405567, 0.03251931071281433, -0.033417798578739166, -0.05092500150203705, 0.09528284519910812, 0.006925598718225956, 0.0018776344368234277, 0.00667586550116539, -0.01743767224252224, 0.007558460813015699, 0.012722854502499104, 0.10464441776275635, -0.05348515138030052, -0.06444248557090759, -0.15483641624450684, 0.09797652810811996, -0.02091376483440399, 0.03683923929929733, 0.015147941187024117, -0.0243244469165802, -0.014452840201556683, 0.05729290097951889, 0.017447998747229576, 0.002485492965206504, -0.016828082501888275, 0.09462672472000122, 0.024595240131020546, 0.02926153875887394, 0.019920701161026955, -0.07484486699104309, 0.07693853229284286, -0.05278058350086212, -0.015415019355714321, 0.03579625487327576, -3.1577929604509336e-08, -0.06137518957257271, 0.03538472577929497, -0.07131250947713852, 0.03625515475869179, -0.05990240350365639, 0.06050337105989456, -0.03963455930352211, 0.07419382780790329, 0.0028460193425416946, -0.0020617232657969, -0.04583809897303581, -0.06728433817625046, 0.0029777702875435352, -0.02554139867424965, 0.05915963277220726, -0.013987363316118717, 0.049881815910339355, 0.0478905513882637, -0.017042119055986404, -0.055721770972013474, -0.014749149791896343, -0.013636628165841103, -0.04134820029139519, 0.038135919719934464, -0.06289775669574738, -0.025064770132303238, -0.06936915963888168, -0.056793421506881714, 0.12163595855236053, 0.041581153869628906, -0.059029582887887955, 0.006960050202906132, 0.06224910169839859, 0.06035740673542023, 0.028554901480674744, 0.029769208282232285, -0.027143772691488266, 0.01936696656048298, 0.025985391810536385, 0.06364443153142929, -0.002208733232691884, -0.030246330425143242, -0.01120050996541977, 0.010011957958340645, -0.029214560985565186, -0.025549858808517456, 0.04224846884608269, -0.0036074265372008085, 0.04994844272732735, -0.026926064863801003, 0.11635484546422958, 0.10584762692451477, -0.03280225023627281, -0.009089485742151737, -0.04842934384942055, -0.01309078000485897, -0.032533854246139526, 0.042094793170690536, -0.08628270775079727, 0.024791749194264412, -0.034319326281547546, -0.013619869947433472, -0.06886101514101028, -0.019982533529400826 ] }, { "text": "# discard the transparent, alpha channel (that's the :3) and add the batch dimension\n image = in_transform(image)[:3,:,:].unsqueeze(0)\n \n return image\n```\n\nLoad images by file name\n\n\n```python\ncontent = load_image('/content/drive/My Drive/Style_Transfer/images/octopus.jpg').to(device)\nstyle = load_image('/content/drive/My Drive/Style_Transfer/images/hockney.jpg').to(device)\n\nprint(content.shape)\nprint(style.shape)\n```\n\n torch.Size([1, 3, 400, 592])\n torch.Size([1, 3, 360, 263])\n\n\nWhat does it look like? \n\n\n```python\ncontent[0][0]\n```", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_5", "embedding": [ 0.0057377321645617485, -0.016676180064678192, 0.0020237115677446127, 0.05184094235301018, 0.010600381530821323, -0.09867360442876816, 0.03504394739866257, 0.03369850292801857, -0.06582208722829819, -0.11009734123945236, 0.024397999048233032, 0.023679018020629883, -0.014260157942771912, 0.023432597517967224, -0.02099963091313839, 0.023734619840979576, -0.09055698662996292, -0.0030281757935881615, -0.053488194942474365, -0.07591245323419571, 0.0533708892762661, -0.04664137586951256, 0.07235269993543625, -0.041490521281957626, -0.00882588978856802, 0.028301384299993515, 0.03460147604346275, -0.03061545453965664, 0.018517009913921356, -0.05651030316948891, -0.010163932107388973, 0.04082223400473595, -0.046429894864559174, 0.030756894499063492, 0.0775432288646698, 0.01701105199754238, -0.037667401134967804, -0.0370195172727108, 0.012444576248526573, 0.021345749497413635, 0.09828062355518341, -0.018366720527410507, 0.040933091193437576, -0.03178398311138153, -0.09139492362737656, 0.043717339634895325, -0.016496289521455765, 0.005316969007253647, -0.026346072554588318, -0.09157494455575943, -0.0039819395169615746, -0.07934582978487015, -0.10536009818315506, 0.07800157368183136, -0.014244298450648785, 0.011099115945398808, 0.07632633298635483, -0.044441793113946915, -0.01524061243981123, -0.05504505708813667, 0.013469211757183075, 0.03932005167007446, -0.016904490068554878, 0.007601691875606775, -0.003815201111137867, 0.0029045329429209232, -0.013621428981423378, -0.055517010390758514, -0.019989201799035072, -0.03362526744604111, -0.019153431057929993, 0.02801656350493431, 0.03018789552152157, 0.09179360419511795, 0.016445918008685112, -0.10894069075584412, 0.10111550241708755, 0.06505104154348373, -0.028613025322556496, -0.058052875101566315, 0.021431192755699158, -0.04182586073875427, 0.05922061577439308, 0.0671457052230835, 0.05377043038606644, 0.019919482991099358, -0.05774274468421936, -0.0024659906048327684, -0.045474302023649216, 0.019570346921682358, -0.07558690011501312, 0.009053797461092472, -0.10115525871515274, 0.019421853125095367, 0.001624822849407792, 0.02054074965417385, 0.052574895322322845, -0.03314206376671791, -0.029997004196047783, 0.037768419831991196, 0.02703334204852581, -0.05059558153152466, -0.002293219091370702, 0.0540204718708992, -0.008525063283741474, 0.028368188068270683, 0.025825874879956245, 0.05920714884996414, 0.015157590620219707, -0.0213552825152874, 0.051132313907146454, -0.03460930660367012, -0.016558479517698288, -0.02156536653637886, 0.07962421327829361, -0.049841322004795074, -0.02672308310866356, 0.10036773979663849, -0.0355217307806015, 0.015831151977181435, 0.06601710617542267, 0.04980229213833809, -0.013752137310802937, -0.021012552082538605, -0.08787622302770615, -0.020980549976229668, 0.005560230929404497, 3.037394383236264e-33, -0.04902952164411545, 0.016285715624690056, -0.03527645766735077, 0.002181336982175708, 0.023962605744600296, 0.07969357073307037, 0.059517767280340195, -0.08402165025472641, -0.0855170264840126, 0.001848334795795381, -0.07569731771945953, 0.029062695801258087, -0.09017246961593628, 0.10315278172492981, -0.04773082584142685, -0.006401270627975464, 0.03519944101572037, 0.11850292235612869, 0.04452682286500931, -0.04705630987882614, 0.07346970587968826, 0.05803058668971062, -0.007690371945500374, 0.011249549686908722, -0.10495532304048538, -0.058924976736307144, -0.07675999402999878, -0.07520792633295059, 0.026741962879896164, -0.008073672652244568, -0.055571477860212326, 0.028813324868679047, 0.005076841916888952, -0.01581130549311638, -0.03256450966000557, -0.031038587912917137, -0.017316224053502083, -0.040982265025377274, 0.006479096598923206, -0.006939327344298363, 0.03351600468158722, 0.06462880969047546, 0.048696666955947876, -0.055563803762197495, -0.10809813439846039, 0.046252306550741196, -0.017840534448623657, 0.04401625320315361, -0.028272904455661774, 0.015351934358477592, 0.0057899728417396545, -0.04244891554117203, 0.07377513498067856, -0.04599154740571976, 0.05922934412956238, -0.07059138268232346, 0.05545659363269806, 0.019036751240491867, 0.05444246530532837, -0.08941446989774704, 0.13681721687316895, 0.066881462931633, 0.0032356996089220047, 0.04838046431541443, 0.035507816821336746, 0.01722305454313755, 0.09155764430761337, -0.005292688496410847, -0.057276882231235504, 0.026239383965730667, -0.09231453388929367, 0.07771240174770355, -0.040912188589572906, -0.05700494721531868, 0.005222521722316742, -0.07121500372886658, 0.009954387322068214, -0.04609896242618561, -0.0810244008898735, 0.08235658705234528, -0.10373032838106155, 0.05290106311440468, 0.01913340948522091, -0.14737260341644287, -0.06949082762002945, 0.03145291283726692, 0.052311189472675323, -0.020326713100075722, -0.007958767004311085, -0.09390207380056381, -0.04371766000986099, -0.035254620015621185, 0.027874091640114784, 0.019900992512702942, -0.06962480396032333, -2.4442298319067604e-33, 0.043516144156455994, 0.07133364677429199, 0.0541381910443306, 0.02941172756254673, -0.04146997630596161, 0.005604208447039127, 0.028145162388682365, 0.09939586371183395, 0.003069064812734723, -0.043971750885248184, 0.019852232187986374, 0.010201415047049522, -0.11237315088510513, -0.15557962656021118, 0.06167130544781685, -0.06576269119977951, 0.008051238022744656, 0.009086704812943935, -0.052779365330934525, -0.025629118084907532, -0.02705463021993637, 0.05386859551072121, -0.04777359589934349, 0.09753973037004471, -0.10139551013708115, 0.03042902611196041, 0.04225378483533859, -0.02200140804052353, 0.0021541558671742678, -0.018156638368964195, 0.03389167785644531, -0.024558138102293015, 0.012765738181769848, 0.010126117616891861, -0.024783603847026825, 0.03885026276111603, 0.07364597171545029, 0.03428658843040466, -0.049589093774557114, -0.046590592712163925, 0.0132991261780262, 0.010073148645460606, -0.07463099807500839, 0.05923885479569435, -0.07249575108289719, 0.029891548678278923, 0.017920497804880142, 0.03590094670653343, 0.034422263503074646, 0.07381072640419006, 0.04233207926154137, -0.06609403342008591, -0.04266205430030823, 0.03511885926127434, 0.04452633112668991, -0.012584156356751919, -0.027478480711579323, 0.021326398476958275, 0.04435257241129875, -0.03961601108312607, -0.01868937350809574, -0.08918300271034241, -0.021884184330701828, -0.08648573607206345, -0.06376086175441742, 0.012285381555557251, -0.07586197555065155, 0.004281478468328714, -0.021263038739562035, 0.07814408093690872, 0.013395752757787704, 0.0580163411796093, 0.04358190670609474, 0.03007347695529461, -0.009478363208472729, -0.01796017587184906, 0.062035996466875076, 0.013767573051154613, 0.019329285249114037, 0.05517920106649399, -0.059540919959545135, 0.04702671617269516, 0.0008445034618489444, 0.11059505492448807, 0.06721218675374985, 0.05228062719106674, 0.045685239136219025, 0.07063720375299454, 0.05595776066184044, -0.0439591147005558, 0.005013847723603249, 0.01101883314549923, 0.12280464917421341, 0.04749586433172226, 0.08170685917139053, -4.6067590631082567e-08, 0.021067744120955467, -0.028189338743686676, -0.00312657724134624, 0.01458808034658432, -0.10648743063211441, -0.007033669389784336, 0.03694847971200943, 0.011117770336568356, 0.010701602324843407, -0.03146298602223396, 0.03876384720206261, -0.016348809003829956, 0.05413094907999039, 0.027375278994441032, -0.04199088364839554, 0.04600650817155838, 0.025660479441285133, 0.03576686978340149, 0.02542693167924881, -0.042537394911050797, -0.06127260625362396, -0.06130436062812805, 0.012794189155101776, 0.016255153343081474, -0.04772355034947395, -0.000912664458155632, -0.03079982101917267, -0.0014496465446427464, -0.024006135761737823, -0.06254419684410095, 0.05734223127365112, -0.03788718208670616, 0.06848852336406708, 0.07931588590145111, -0.022751659154891968, 0.027509521692991257, -0.04774133861064911, 0.002774589927867055, -0.05314895883202553, 0.02201109007000923, -0.03430946543812752, -0.03631189838051796, 0.04217129573225975, -0.005088179837912321, 0.03136298060417175, -0.05411903187632561, 0.02357880212366581, 0.010919729247689247, -0.05745168402791023, 0.07279377430677414, 0.046499863266944885, -0.02044428139925003, -0.023284027352929115, 0.06938715279102325, 0.06949497014284134, -0.05926278606057167, -0.0027375619392842054, 0.052378177642822266, -0.031951770186424255, 0.06900733709335327, 0.0492059662938118, 0.0057508982717990875, 0.0014780501369386911, -0.05192950740456581 ] }, { "text": "torch.Size([1, 3, 400, 592])\n torch.Size([1, 3, 360, 263])\n\n\nWhat does it look like? \n\n\n```python\ncontent[0][0]\n```\n\n\n\n\n tensor([[-1.8953, -1.9467, -1.9295, ..., -0.1999, -0.1999, -0.3027],\n [-1.9980, -2.0152, -1.9467, ..., -0.4568, -0.3369, -0.1657],\n [-1.9809, -1.9809, -1.9295, ..., -0.8164, -0.5596, -0.3027],\n ...,\n [-1.9809, -1.9809, -1.9809, ..., -1.0904, -1.1075, -1.1589],\n [-1.9809, -1.9809, -1.9809, ..., -1.0733, -1.1418, -1.2103],\n [-1.9638, -1.9638, -1.9638, ..., -1.0562, -1.1760, -1.2445]])\n\n\n\n**Change the shape**\n\nThe shape of two images are different, we can force the style image to be the same size as the content image. \n\n\n```python\ncontent.shape[-2:]\n```\n\n\n\n\n torch.Size([400, 592])", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_6", "embedding": [ -0.020701618865132332, -0.04533630982041359, -0.03908563777804375, 0.0157307181507349, 0.020042559131979942, -0.06397654116153717, 0.02832874283194542, 0.003123002126812935, -0.054189980030059814, -0.0791187509894371, -0.05462009087204933, 0.031346019357442856, -0.09826936572790146, 0.07435233891010284, -0.042249199002981186, 0.05759933218359947, -0.04102025926113129, 0.009781823493540287, -0.005214264150708914, -0.04229512810707092, 0.041037123650312424, 0.037916816771030426, -0.0012626245152205229, -0.014661921188235283, 0.0514262430369854, 0.10163633525371552, 0.03438426926732063, -0.0074767423793673515, 0.05973253399133682, -0.01409707497805357, 0.028694989159703255, 0.028463976457715034, -0.023967478424310684, 0.029740488156676292, 0.028142549097537994, -0.024499937891960144, -0.0636206865310669, 0.04782313480973244, 0.01876067742705345, 0.09316006302833557, 0.07201310247182846, 0.04268740117549896, 0.052191950380802155, -0.037732258439064026, -0.026242641732096672, -0.004269504453986883, 0.02467854507267475, 0.008239527232944965, -0.020765157416462898, -0.08544647693634033, 0.02669677324593067, 0.009188755415380001, -0.11151103675365448, 0.05704883486032486, -0.025958430022001266, -0.03884114325046539, 0.018603084608912468, -0.13579604029655457, 0.03632130101323128, -0.05936267971992493, 0.06268685311079025, 0.06983262300491333, 0.045127157121896744, -0.028740929439663887, 0.012930070981383324, 0.03041691519320011, -0.017735891044139862, -0.10204961895942688, 0.054433129727840424, -0.011166281066834927, -0.05174294486641884, 0.013936495408415794, -0.06716930866241455, 0.07620996236801147, -0.01191757246851921, -0.04122653231024742, 0.10116168111562729, -0.03514506667852402, -0.013265315443277359, 0.0017911361064761877, -0.019882241263985634, 0.015323059633374214, 0.06867093592882156, 0.0504741407930851, -0.013194623403251171, -0.015891920775175095, 0.027322139590978622, 0.042028315365314484, -0.0022373071406036615, -0.012373105622828007, -0.05394896864891052, -0.0014532796340063214, -0.0856902152299881, 0.028182554990053177, -0.056711748242378235, 0.03260209783911705, 0.08933897316455841, 0.02181803248822689, -0.02528085559606552, 0.047495774924755096, 0.07418519258499146, -0.10021562874317169, -0.027325650677084923, 0.034752823412418365, -0.008544696494936943, 0.05094699561595917, 0.013914431445300579, 0.042022839188575745, -0.018138082697987556, -0.043467022478580475, 0.047953326255083084, -0.00018889104831032455, -0.032645583152770996, -0.0721663236618042, -0.004314600024372339, -0.06927957385778427, -0.05337082967162132, 0.1048530787229538, 0.033602047711610794, 0.11367402225732803, 0.07265795022249222, 0.05680590867996216, 0.016394274309277534, 0.05388171970844269, -0.05353904515504837, 0.035114042460918427, -0.0804612785577774, -1.3404914215140078e-33, -0.05959382653236389, 0.06082489714026451, 0.01657155342400074, -0.039726827293634415, 0.0028037824667990208, 0.05741828307509422, 0.041113950312137604, -0.04449497163295746, -0.045575544238090515, 0.05683285742998123, -0.052719004452228546, 0.07138071209192276, -0.0022135998588055372, 0.07336194813251495, -0.09696993231773376, -0.0918879583477974, 0.07477773725986481, 0.024533133953809738, -0.02615162916481495, -0.059707917273044586, -0.022970769554376602, 0.04202369973063469, 0.02993360534310341, 0.012891202233731747, -0.06267120689153671, -0.013580414466559887, -0.05704042315483093, -0.04917840659618378, -0.062048282474279404, -0.022721081972122192, -0.03813331201672554, 0.019933605566620827, -0.016647273674607277, -0.06424041092395782, 0.037487804889678955, -0.013280264101922512, 0.023389337584376335, -0.0506180003285408, 0.016990220174193382, -0.07106626778841019, -0.025274988263845444, 0.06049816682934761, 0.03091246820986271, -0.07556039094924927, -0.054762352257966995, 0.03322058543562889, 0.012761297635734081, 0.05444221571087837, -0.0540512315928936, -0.045153725892305374, -0.050840478390455246, 0.011962749995291233, 0.04386567324399948, 0.037869229912757874, 0.021510861814022064, -0.07218126952648163, 0.10554603487253189, 0.04476844519376755, 0.10159929096698761, -0.045388828963041306, 0.04519094154238701, 0.03808383643627167, -0.03368888050317764, 0.020149147137999535, -0.021574122831225395, -0.005578980315476656, 0.02027338370680809, 0.05224429816007614, 0.011855003423988819, 0.057457126677036285, -0.09089972823858261, 0.10162834823131561, 0.02026284486055374, -0.01592813804745674, -0.04776306450366974, -0.026112711057066917, 0.046335894614458084, -0.07849719375371933, -0.031277917325496674, 0.023781560361385345, -0.09692241251468658, 0.014650500379502773, 0.08413639664649963, -0.15921923518180847, -0.13047786056995392, 0.013285784982144833, -0.03098258748650551, -0.05142882838845253, 0.009639143012464046, -0.12476174533367157, -0.12302330136299133, -0.03937658667564392, 0.0705697238445282, -0.04220938682556152, -0.09228864312171936, 5.008098172762352e-34, -0.018994105979800224, 0.00619148276746273, -7.271840877365321e-05, 0.05972486361861229, 0.01847955398261547, -0.00898827612400055, 0.03255264088511467, 0.08751047402620316, -0.0038595986552536488, 0.017265956848859787, 0.12932880222797394, -0.017828291282057762, -0.017752373591065407, -0.08325164765119553, 0.11311361193656921, 0.02249690517783165, -0.03330249339342117, 0.04635307565331459, 0.03661245107650757, -0.09578976780176163, -0.05901951342821121, 0.07357537746429443, -0.047807492315769196, 0.029244473204016685, -0.07817810773849487, -0.008038327097892761, 0.04305534437298775, -0.09385920315980911, -0.02930966019630432, 0.005217976402491331, -0.0012018106644973159, -0.05664961412549019, 0.021189238876104355, 0.05176578089594841, -0.046828024089336395, 0.014371282421052456, 0.05303065851330757, 0.015590944327414036, -0.020335298031568527, -0.025591712445020676, 0.04096808657050133, 0.021602928638458252, -0.011608822271227837, 0.10256679356098175, -0.08739788085222244, 0.050659116357564926, -0.015130436047911644, 0.06040820851922035, 0.0014103914145380259, 0.013078683987259865, -0.013418629765510559, -0.03793030604720116, -0.018087053671479225, 0.02245255932211876, -0.023376058787107468, 0.009701302275061607, -0.0547916479408741, 0.03577785566449165, 0.04764445498585701, -0.013653714209794998, -0.03142758458852768, -0.059668198227882385, 0.05097397044301033, -0.017873071134090424, 0.030048899352550507, -0.002135734772309661, -0.06926266849040985, -0.02763557806611061, -0.023117732256650925, 0.036776840686798096, 0.0813029557466507, 0.06272371113300323, 0.017886050045490265, 0.0020398935303092003, -0.01843237318098545, -0.04997195303440094, 0.07982936501502991, 0.032206419855356216, 0.020418666303157806, 0.035429999232292175, 0.005488417111337185, -0.018006153404712677, 0.00616053631529212, 0.0953788086771965, 0.07804574072360992, 0.014836789108812809, -0.01806734874844551, 0.1068517342209816, -0.020666537806391716, -0.014967960305511951, -0.031058330088853836, 0.025789771229028702, 0.05915626510977745, -0.017456961795687675, 0.10127054154872894, -6.003015329270056e-08, -0.04153834283351898, -0.05784422904253006, -0.040547799319028854, -0.021862821653485298, -0.04529572278261185, -0.02738736756145954, 0.10240156203508377, 0.02717282436788082, -0.03900019824504852, -0.04901361092925072, 0.06737910211086273, -0.05835036188364029, -0.016591036692261696, -0.015878906473517418, 0.03583920747041702, 0.08449143171310425, -0.05007464438676834, 0.012449895963072777, 0.004909435287117958, -0.02119631879031658, 0.003199842292815447, 0.0050511653535068035, 0.05900294706225395, 0.0032365676015615463, -0.09857970476150513, -0.015149748884141445, 0.010065478272736073, 0.03210264444351196, 0.03639879822731018, 0.03565746545791626, -0.012177701108157635, -0.055138226598501205, 0.06917939335107803, -0.014549105428159237, 0.010128489695489407, 0.06901310384273529, -0.061234746128320694, -0.013167737051844597, -0.030664080753922462, 0.025309398770332336, -0.08909361809492111, -0.02620363049209118, 0.04497237503528595, 0.010470266453921795, 0.048424459993839264, -0.022613579407334328, -0.06370656937360764, -0.015978921204805374, -0.01004014816135168, -0.02421267144382, 0.05565035343170166, 0.039239462465047836, -0.05488903075456619, 0.035931073129177094, 0.025950977578759193, -0.024851595982909203, -0.10340675711631775, 0.053472813218832016, -0.03533128648996353, -0.04677148908376694, 0.05983460694551468, -0.0019858975429087877, 4.5686498197028413e-05, -0.043350573629140854 ] }, { "text": "```python\ncontent.shape[-2:]\n```\n\n\n\n\n torch.Size([400, 592])\n\n\n\n\n```python\nstyle = load_image('/content/drive/My Drive/Style_Transfer/images/hockney.jpg', \n shape=content.shape[-2:]).to(device)\nprint(style.shape)\n```\n\n torch.Size([1, 3, 400, 592])\n\n\n**Display the image**\n\n\n```python\n# helper function for un-normalizing an image \n# and converting it from a Tensor image to a NumPy image for display\ndef im_convert(tensor):\n \"\"\" Display a tensor as an image. \"\"\"\n \n image = tensor.to(\"cpu\").clone().detach()\n image = image.numpy().squeeze()\n image = image.transpose(1,2,0)\n image = image * np.array((0.229, 0.224, 0.225)) + np.array((0.485, 0.456, 0.406))\n image = image.clip(0, 1)\n\n return image\n```", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_7", "embedding": [ 0.009667027741670609, -0.02218709886074066, -0.012457696720957756, 0.03854736313223839, 0.05369095504283905, -0.0934654250741005, -0.02934993989765644, 0.02675270475447178, -0.08599583059549332, -0.09750547260046005, -0.00020677028805948794, 0.005933254491537809, -0.012900074943900108, 0.09236506372690201, -0.03899984434247017, 0.03771563246846199, -0.0654800683259964, 0.04645109921693802, -0.04454444721341133, -0.04699383303523064, 0.011632239446043968, 0.015407443046569824, 0.04708515480160713, -0.07486589252948761, 0.0251498781144619, -0.019791176542639732, 0.04147489741444588, -0.0402815006673336, 0.005456404760479927, -0.02053012140095234, -0.02072685770690441, -0.023514937609434128, -0.016914712265133858, 0.0055471244268119335, 0.06424431502819061, 0.04111363738775253, -0.05598759651184082, -0.03282095864415169, 0.00048399195657111704, -0.03229595348238945, 0.08165522664785385, -0.03686557337641716, -0.009153422899544239, -0.04787198454141617, -0.029056528583168983, 0.06479200720787048, 0.05248270928859711, -0.001706218346953392, 0.07693903893232346, -0.042670056223869324, -0.024803705513477325, 0.02043083868920803, -0.14191511273384094, 0.02691526710987091, -0.003932385705411434, 0.015833107754588127, 0.08033952116966248, -0.06682368367910385, -0.07807144522666931, -0.059605732560157776, -0.0360720194876194, 0.06184419244527817, 0.01219363696873188, -0.029253628104925156, 0.04065693914890289, 0.014529284089803696, -0.009522337466478348, -0.06485971063375473, -5.581144432653673e-05, -0.05873633921146393, -0.035519443452358246, -0.020513227209448814, 0.003428257070481777, 0.03851645067334175, -0.023335104808211327, -0.0756482407450676, 0.08387687057256699, 0.07272248715162277, 0.01481480523943901, -0.013319003395736217, -0.030500125139951706, -0.010634149424731731, 0.07293207198381424, 0.013446756638586521, 0.07962039858102798, -0.006935962941497564, -0.04704037308692932, 0.04297441244125366, 0.018578914925456047, -0.029390456154942513, -0.06592737883329391, 0.016602450981736183, -0.0824858546257019, 0.018139269202947617, 0.03363075852394104, -0.009483489207923412, 0.03754490613937378, 0.029269637539982796, -0.05500287562608719, 0.05834038183093071, 0.057631101459264755, -0.051573745906353, -0.02676207944750786, -0.007050040643662214, 0.015633735805749893, 0.06955654919147491, 0.05879931524395943, 0.049070533365011215, -0.013660394586622715, -0.009707849472761154, 0.042698267847299576, 0.008310605771839619, -0.029203956946730614, -0.027572067454457283, 0.09536981582641602, -0.04355232045054436, -0.05052364245057106, 0.09045714139938354, -0.029336942359805107, 0.04060295224189758, -0.0007106325356289744, 0.05974472686648369, -0.009254326112568378, 0.03299519792199135, -0.050449080765247345, 0.011413289234042168, -0.025411684066057205, 3.105386078513779e-33, -0.09555306285619736, 0.004984742030501366, 0.03275091201066971, 0.0190040972083807, -0.03153631463646889, 0.08861010521650314, 0.001125913579016924, -0.07578202337026596, -0.030269837006926537, -0.00012997891462873667, -0.018034175038337708, 0.011196664534509182, -0.050706829875707626, 0.07748158276081085, -0.05440836772322655, -0.04883375018835068, 0.0716024786233902, 0.032537855207920074, 0.05299755930900574, -0.003287503495812416, 0.059392720460891724, 0.08887140452861786, -0.038351498544216156, 0.038271863013505936, -0.12751926481723785, -0.05653393268585205, -0.05040201172232628, -0.0016481946222484112, 0.025134656578302383, -0.03708234429359436, -0.10344116389751434, -0.04257269576191902, -0.00960408616811037, -0.04598867520689964, -0.0472283810377121, -0.06755983829498291, 0.014916328713297844, -0.006046172231435776, -0.06393749266862869, -0.006515716668218374, 0.01080804318189621, 0.08604799211025238, 0.028651630505919456, -0.07366297394037247, -0.07999486476182938, 0.07401242852210999, -0.03975272923707962, 0.06163283810019493, -0.05100855976343155, -0.04125251993536949, -0.03695867210626602, -0.06079259142279625, 0.05919533222913742, -0.036911096423864365, -0.0025280111003667116, -0.09425134211778641, 0.11321231722831726, -0.016362274065613747, 0.05907483026385307, -0.11167309433221817, 0.06834141910076141, 0.04350011423230171, 0.037987805902957916, 0.04186506196856499, 0.0041095358319580555, -0.006754771340638399, 0.059105150401592255, 0.011338667012751102, -0.10491297394037247, 0.04375908151268959, -0.08139855414628983, 0.11906030774116516, -0.06330703943967819, -0.05744679644703865, -0.030271630734205246, -0.06465305387973785, 0.032432761043310165, -0.07343363016843796, -0.07234857231378555, 0.023569345474243164, -0.061133891344070435, 0.10397297888994217, 0.013058008626103401, -0.14270788431167603, -0.053191013634204865, 0.012162083759903908, -0.021521450951695442, -0.04109963774681091, -0.0066609978675842285, -0.05489179119467735, -0.024844098836183548, -0.001709663076326251, 0.014536934904754162, 0.00659484276548028, -0.09125320613384247, -2.0387425045776354e-33, 0.026783932000398636, 0.017518067732453346, 0.0030648077372461557, 0.027304712682962418, -0.04304293170571327, 0.007751534227281809, 0.08729243278503418, 0.04374605044722557, -0.005445487797260284, -0.03294558823108673, 0.04515989497303963, -0.01921936310827732, -0.04640989750623703, -0.14721329510211945, 0.029157103970646858, -0.033567022532224655, 0.03179142251610756, 0.05102148279547691, -0.00987259205430746, -0.01799493283033371, -0.06614772975444794, 0.10736329853534698, 0.00031094413134269416, 0.03932508826255798, -0.12715448439121246, 0.07513909786939621, -0.007519620470702648, 0.041101474314928055, 0.01462096069008112, -0.006496214307844639, 0.006424791645258665, -0.009095434099435806, 0.016006773337721825, 0.02964795008301735, 0.008601621724665165, 0.05419936403632164, 0.0623382031917572, 0.016542883589863777, -0.027303148061037064, 0.035091739147901535, 0.02814100868999958, 0.05929466336965561, -0.03799066320061684, 0.09813988953828812, -0.049875907599925995, 0.007938280701637268, -0.0028129681013524532, -0.03019806742668152, 0.024365687742829323, 0.04145107790827751, 0.03890249878168106, -0.07962266355752945, -0.05414040759205818, 0.002970025409013033, -0.020005708560347557, 0.02504667453467846, -0.0028818626888096333, 0.028730791062116623, 0.054651763290166855, -0.008507582359015942, -0.014663404785096645, -0.1053418293595314, -0.06840034574270248, -0.08923831582069397, -0.03535408526659012, 0.026353785768151283, -0.07565788179636002, 0.03218969702720642, -0.03708143159747124, 0.08248183876276016, 0.0224005114287138, 0.08677776157855988, 0.08986641466617584, 0.03786599263548851, 0.017109664157032967, -0.03256012871861458, 0.10210470855236053, 0.044644687324762344, 0.0773720070719719, -0.019016264006495476, -0.024322208017110825, -0.04813217744231224, 0.020437385886907578, 0.06209570914506912, 0.05648237094283104, 0.028209442272782326, 0.017423944547772408, 0.027360886335372925, 0.053600892424583435, -0.026645930483937263, -0.018876194953918457, -0.005924929399043322, 0.07948096841573715, 0.03682604059576988, 0.05093211680650711, -5.083603227262756e-08, 0.009184828028082848, -0.024430066347122192, 0.038714949041604996, 0.017128553241491318, -0.07985388487577438, -0.004660109989345074, 0.05311581492424011, -0.034876175224781036, 0.03625227510929108, -0.023726752027869225, 0.007801925763487816, -0.0739913284778595, 0.007036920636892319, -0.02454238012433052, -0.0137449000030756, 0.12298189103603363, 0.02629527822136879, 0.06485999375581741, 0.0526803694665432, -0.053996797651052475, -0.0027278705965727568, -0.052087098360061646, -0.03838622197508812, 0.030263489112257957, -0.0527983121573925, -0.023806026205420494, -0.0040604835376143456, 0.01802372746169567, 0.05151322856545448, -0.08420822769403458, -0.014212622307240963, -0.03217734396457672, 0.08420092612504959, 0.0479506254196167, 0.021157585084438324, -0.0008726558880880475, -0.03781472146511078, 0.01562507264316082, -0.009451615624129772, 0.04584268853068352, -0.059482477605342865, 0.03086172230541706, -0.013718836009502411, -0.02187177911400795, 0.04143914580345154, -0.07206052541732788, 0.06289061903953552, 0.01508582103997469, -0.040841780602931976, 0.09138350188732147, 0.09750254452228546, 0.03180895000696182, -0.010387982241809368, 0.07548009604215622, 0.0723499283194542, -0.08769305795431137, 0.02913031168282032, 0.08673406392335892, -0.019996358081698418, 0.0894843190908432, 0.049926407635211945, 0.02063734270632267, -0.01789630949497223, -0.0502944141626358 ] }, { "text": "return image\n```\n\n\n```python\n# display the images\nfig, (ax1, ax2) = plt.subplots(1, 2, figsize=(20, 10))\n# content and style ims side-by-side\nax1.imshow(im_convert(content))\nax2.imshow(im_convert(style))\n```\n\n\n
\n \n
\n
\n\n\n**See the explanation for each step of the function:**\n\n**Copy content image & detach**\n\nRef: https://stackoverflow.com/questions/63582590/why-do-we-call-detach-before-calling-numpy-on-a-pytorch-tensor", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_8", "embedding": [ -0.0607142299413681, -0.03479039669036865, 0.04261091351509094, 0.045264434069395065, 0.13724052906036377, -0.07374926656484604, -0.03996840864419937, 0.026054007932543755, 0.02266574837267399, -0.018011271953582764, 0.06251873821020126, 0.06396105140447617, 0.03087138570845127, 0.0355486199259758, 0.03678170591592789, 0.04624112695455551, -0.08913035690784454, 0.021235525608062744, -0.032319940626621246, -0.04807192087173462, 0.010860946960747242, -0.03151646628975868, 0.04004513844847679, -0.07493110001087189, 0.07758723199367523, 0.014391818083822727, -0.027429480105638504, 0.05672755092382431, 0.04443974792957306, -0.05191566422581673, 0.014000947587192059, -0.027598734945058823, 0.02195286564528942, 0.003567415988072753, -0.01507897675037384, 0.15460731089115143, 0.023043407127261162, 0.043045494705438614, 0.02852315455675125, 0.05404265224933624, 0.048578523099422455, -0.047005727887153625, -0.023110786452889442, -0.10826639086008072, 0.029896728694438934, 0.03644401580095291, -0.03024754300713539, -0.03663983941078186, 0.03594683110713959, 0.03815474361181259, -0.003997389227151871, 0.02752353996038437, -0.15270036458969116, 0.07070530205965042, 0.06186559423804283, 0.003330437233671546, 0.12596453726291656, -0.06795031577348709, 0.05789249390363693, -0.04158703237771988, -0.014534621499478817, 0.07979415357112885, 0.012666000984609127, -0.009770995937287807, 0.09563631564378738, -0.049439411610364914, -0.00951318722218275, -0.03398509323596954, -0.05599216744303703, -0.010840079747140408, -0.03722308576107025, -0.04934542253613472, 0.007787908427417278, -0.0176983755081892, 0.003746443660929799, -0.03525599092245102, 0.07194247841835022, -0.03118944726884365, -0.0717238336801529, -0.023360375314950943, 0.004125452134758234, 0.03453432768583298, 0.09456085413694382, 0.02269000932574272, -0.007680677343159914, -0.03979580104351044, -0.027347927913069725, -0.0004717456758953631, 0.017390405759215355, -0.11931732296943665, -0.05664447695016861, 0.027348797768354416, -0.04086011275649071, 0.1179644763469696, 0.04940234497189522, 0.00022227500448934734, -0.017545614391565323, 0.007025040686130524, -0.040827177464962006, 0.0022170653101056814, 0.06251204013824463, -0.0339621901512146, 0.02998843602836132, -0.016396988183259964, 0.07246541976928711, 0.015754537656903267, 0.04398355633020401, -0.03467690199613571, 0.004775885492563248, 0.018058672547340393, 0.001859026262536645, 0.020801620557904243, -0.08571766316890717, 0.07699970155954361, 0.07685992866754532, -0.004419590346515179, -0.0152885178104043, 0.07356541603803635, 0.05207699164748192, -0.02077266201376915, 0.05920245125889778, 0.09445144981145859, 0.06524410843849182, 0.05518684536218643, 0.037665076553821564, -0.06764589995145798, -0.07906711846590042, 5.461422426369182e-33, -0.04815347492694855, -0.017838886007666588, 0.022360198199748993, 0.0559413768351078, 0.03199752792716026, -0.04199516028165817, -0.03588021546602249, -0.07458358258008957, -0.022620713338255882, 0.013415382243692875, -0.03696135804057121, 0.027498168870806694, -0.0445592999458313, 0.062704898416996, -0.02464435063302517, -0.06137898564338684, 0.06925804167985916, -0.017037786543369293, 0.02935246378183365, 0.00039003940764814615, 0.0008496458758600056, 0.018801875412464142, 0.002739944262430072, 0.06121278181672096, -0.0919702872633934, -0.05376894399523735, -0.022838052362203598, 0.008829119615256786, 0.0022161384113132954, -0.036637935787439346, -0.07862542569637299, 0.017189063131809235, -0.006455700844526291, -0.05625539273023605, -0.04012257233262062, -0.05113540589809418, 0.004976461175829172, -0.007840987294912338, -0.04242057353258133, 0.01791674643754959, -0.05323367565870285, 0.0444459430873394, -0.022085804492235184, -0.059324488043785095, -0.0125723360106349, -0.01336592622101307, -0.030324164777994156, 0.16384941339492798, 0.0032062313985079527, -0.02985340543091297, -0.03972315415740013, 0.002038736594840884, -0.011435264721512794, -0.009407428093254566, -0.003722423454746604, -0.07674319297075272, 0.018732210621237755, -0.050018660724163055, 0.04484972730278969, -0.05604221671819687, 0.08291830867528915, 0.04514744132757187, -0.028987694531679153, 0.03529016301035881, -0.010535862296819687, 0.06329835206270218, 0.03402005508542061, -0.0073670195415616035, -0.06376072764396667, 0.05006234347820282, -0.08011820912361145, 0.10713894665241241, -0.048822421580553055, -0.056167226284742355, 0.0025928097311407328, -0.052771423012018204, -0.01040586642920971, -0.018274815753102303, -0.009103438816964626, 0.03336488828063011, -0.040085986256599426, 0.05230946093797684, -0.0014491846086457372, -0.1617426872253418, -0.07024066895246506, 0.0005978091503493488, 0.030457479879260063, -0.06238942965865135, -0.0104214483872056, -0.05268153175711632, -0.01370635349303484, -0.013508803211152554, -0.03730301558971405, -0.05743664130568504, -0.02430659346282482, -4.751466817484722e-33, 0.07165347784757614, 0.06889814883470535, 0.008777265436947346, 0.05807216465473175, -0.06262650340795517, -0.011140546761453152, -0.0071517364121973515, -0.007348607759922743, 0.015276414342224598, 0.00914427638053894, -0.06322771310806274, -0.03325338661670685, -0.06531364470720291, -0.16399209201335907, -0.022731252014636993, -0.008041661232709885, 0.013896030373871326, 0.0316341295838356, -0.08233422040939331, -0.035349950194358826, -0.032885223627090454, 0.08937813341617584, 0.042815569788217545, 0.001999958185479045, -0.12399347126483917, 0.08079284429550171, -0.012239070609211922, 0.004616654012352228, 0.007916145958006382, -0.01704389788210392, -0.06913312524557114, -0.0011512844357639551, 0.010454297997057438, 0.03678552433848381, 0.039520829916000366, 0.03271736949682236, -0.010951083153486252, 0.000955092313233763, -0.050642210990190506, 0.043500784784555435, 0.012111273594200611, 0.012234630063176155, -0.026293952018022537, 0.011175515130162239, -0.0510685108602047, 0.025699686259031296, -0.022677231580018997, 0.055848605930805206, 0.03835756704211235, 0.0005588092608377337, -0.011831612326204777, -0.002090080641210079, 0.0062558469362556934, 0.002664712956175208, 0.0018470195354893804, -0.012007789686322212, -0.07887978851795197, 0.07163114100694656, 0.036192890256643295, 0.005582692567259073, -0.00020695826970040798, -0.06084901839494705, -0.1211729422211647, -0.08767667412757874, 0.00989946722984314, -0.007544972933828831, -0.07371246069669724, -0.04339931905269623, 0.020673727616667747, 0.08053451031446457, 0.05114177614450455, 0.028496235609054565, 0.08853869140148163, -0.06844504177570343, -0.0007060891948640347, 0.0524807944893837, 0.02300241030752659, 0.03170083835721016, -0.004509334918111563, -0.05352114886045456, 0.002377977827563882, -0.059388671070337296, -0.028094831854104996, 0.031031616032123566, -0.062106840312480927, 0.05305411294102669, 0.020268110558390617, -0.0012383819557726383, 0.07416775077581406, -0.11319547146558762, 0.0017861939268186688, -0.06244722381234169, 0.10380658507347107, 0.07975637912750244, 0.10564228892326355, -5.5854936675814315e-08, 0.05396167188882828, -0.022825194522738457, 0.034234147518873215, -0.009108531288802624, -0.061015766113996506, 0.035891979932785034, 0.002724568359553814, 0.008187349885702133, 0.022837191820144653, 0.02796054258942604, 0.008456030860543251, 0.047382425516843796, 0.037443891167640686, -0.028924008831381798, -0.08490034937858582, 0.1046401634812355, 0.025069991126656532, 0.024866389110684395, 0.07841277122497559, -0.04345501959323883, -0.051646605134010315, -0.13887707889080048, -0.00561029277741909, 0.06158505380153656, -0.14285121858119965, 0.00843847170472145, -0.03639327734708786, 0.007622187025845051, 0.014441914856433868, -0.05403686314821243, 0.0211237333714962, -0.04408194497227669, 0.0765632838010788, 0.055621419101953506, 0.07672800123691559, -0.004013518802821636, -0.007309471257030964, -0.006724989973008633, -0.002501735696569085, 0.0477432943880558, -0.0288250595331192, -0.002219157526269555, 0.03422015160322189, 0.00785402487963438, 0.0239741001278162, 0.007998097687959671, 0.008035904727876186, -0.021184803918004036, -0.03440374881029129, 0.04350471869111061, 0.0672198012471199, -0.01761545240879059, 0.003582315519452095, 0.040467049926519394, 0.03265499323606491, -0.06217359006404877, 0.020844455808401108, 0.054970309138298035, 0.05189105123281479, 0.08664005994796753, 0.0017660845769569278, 0.03586540371179581, 0.01782219298183918, -0.07653219252824783 ] }, { "text": "**Copy content image & detach**\n\nRef: https://stackoverflow.com/questions/63582590/why-do-we-call-detach-before-calling-numpy-on-a-pytorch-tensor\n\ntorch.tensors are designed to be used in the context of gradient descent optimization, and therefore they hold not only a tensor with numeric values, but (and more importantly) the computational graph leading to these values. This computational graph is then used (using the chain rule of derivatives) to compute the derivative of the loss function w.r.t each of the independent variables used to compute the loss.", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_9", "embedding": [ -0.05105642229318619, -0.04800344631075859, 0.023820457980036736, 0.04633103683590889, 0.1033921018242836, -0.036681752651929855, 0.019564945250749588, -0.01316854264587164, 0.0362953320145607, -0.031170032918453217, 0.00811750814318657, 0.08305162936449051, -0.05173763632774353, 0.05261072516441345, -0.03186316043138504, 0.03542429953813553, -0.11168050765991211, 0.06683371216058731, -0.055200234055519104, -0.06593663990497589, -0.02558485046029091, 0.03590761125087738, -0.05242941156029701, -0.027975119650363922, 0.07883656024932861, -0.007621992379426956, -0.0010703877778723836, -0.009420168586075306, 0.07029840350151062, 0.029456745833158493, 0.02123645320534706, -0.013705667108297348, -0.02384452521800995, 0.003607197431847453, -0.07199058681726456, 0.014201262965798378, -0.07955080270767212, -0.018551696091890335, -0.013221627101302147, 0.07124785333871841, 0.023255128413438797, 0.006426732521504164, -0.039404794573783875, 0.015974506735801697, -0.03406508266925812, 0.05516411364078522, 0.0032582166604697704, -0.004840929992496967, 0.05067971348762512, 0.002866752678528428, 0.04979874938726425, -0.0007731382502242923, -0.14281734824180603, 0.03557473048567772, -0.013314470648765564, -0.007512963376939297, 0.054633978754282, -0.08201642334461212, -0.08998669683933258, 0.02071538008749485, 0.052131861448287964, 0.01419071201235056, -0.015835383906960487, -0.01262175478041172, 0.07059560716152191, -0.02335277758538723, 0.04391244053840637, -0.08894506841897964, 0.05366957187652588, 0.001312813488766551, -0.011809559538960457, -0.026379866525530815, -0.04688870534300804, 0.014712082222104073, -0.020984722301363945, -0.054660946130752563, 0.1575423926115036, 0.05456327646970749, -0.04922119528055191, 0.008398775942623615, 0.005412425380200148, 0.024822790175676346, 0.06824301928281784, -0.04528104513883591, 0.0375923328101635, -0.03829775005578995, -0.013944455422461033, 0.005992773454636335, 0.055144116282463074, -0.027058005332946777, -0.010231553576886654, -0.0005055797519162297, -0.05105096846818924, 0.03771711513400078, 0.04306454584002495, -0.036966852843761444, 0.029983846470713615, 0.007024770602583885, -0.05364690721035004, 0.015454698354005814, 0.036915503442287445, -0.0689636692404747, -0.03807639703154564, 0.04733287915587425, 0.01954459212720394, -0.004582663532346487, 0.020983591675758362, -0.007980656810104847, 0.015415513888001442, 0.015978978946805, 0.023832542821764946, 0.08689901977777481, 0.03482452780008316, 0.03614809364080429, 0.03156694769859314, -0.0371837355196476, -0.044859133660793304, 0.08727297931909561, 0.057087335735559464, 0.04788779467344284, -0.09717704355716705, 0.04750552028417587, 0.008108604699373245, 0.056154895573854446, -0.06437183916568756, -0.010267193429172039, -0.06716618686914444, -1.3864845665353492e-33, -0.05102696269750595, 0.018299682065844536, -0.004882374778389931, -0.022659320384263992, -0.014074819162487984, -0.001658708555623889, 0.028769182041287422, -0.056895285844802856, 0.022024640813469887, 0.006595842074602842, -0.04919452592730522, 0.01388483215123415, 0.002889477415010333, 0.0759652853012085, -0.04235256463289261, -0.05721329152584076, 0.05760990083217621, -0.01612839661538601, 0.0598374679684639, 0.02140693925321102, 0.03579460084438324, 0.06968861073255539, 0.018661433830857277, 0.07267729938030243, -0.08156180381774902, 0.02862429991364479, -0.07627370208501816, -0.012572395615279675, -0.0214051716029644, 0.017968304455280304, -0.0867629274725914, -0.02063564956188202, -0.08283455669879913, -0.060050856322050095, 0.03890231251716614, -0.03210821375250816, 0.02566055953502655, -0.02631164714694023, -0.004923700354993343, -0.07524219900369644, -0.039882395416498184, 0.08574070036411285, -0.015757868066430092, -0.06660839170217514, -0.08078350871801376, -0.015599397011101246, 0.01614876464009285, 0.08252261579036713, -0.007508305832743645, -0.09908520430326462, -0.08139991760253906, -0.06340386718511581, 0.005757687147706747, 0.0179122481495142, 0.03706967830657959, -0.06095641851425171, 0.07003206014633179, -0.04845932126045227, 0.04195426031947136, -0.0533328652381897, 0.026576820760965347, 0.05113539099693298, 0.05057546868920326, 0.07406529784202576, -0.0598381944000721, 0.014877586625516415, -0.021326987072825432, 0.024900751188397408, -0.04424367845058441, 0.016879064962267876, -0.0838278979063034, 0.1676822453737259, -0.06566288322210312, -0.08962142467498779, 0.004834894090890884, -0.025566061958670616, 0.02072155475616455, -0.08496936410665512, 0.0641900897026062, 0.026020754128694534, -0.07652914524078369, 0.11028464138507843, -0.025267962366342545, -0.1058080717921257, -0.042782943695783615, -0.006647989619523287, 0.010470829904079437, -0.11450080573558807, -0.01488332450389862, -0.013841486535966396, -0.05585678666830063, 0.018333738669753075, 0.015082260593771935, -0.03212587535381317, -0.010005089454352856, -1.4657569668189272e-33, -0.03170168027281761, 0.02586173638701439, -0.07480470091104507, 0.030838361009955406, -0.06270211189985275, -0.019361209124326706, -0.007149586919695139, 0.016449473798274994, -0.030091291293501854, -0.01670246757566929, -0.034635864198207855, 0.008111211471259594, -0.11488565802574158, -0.037386372685432434, 0.06522712856531143, 0.026450982317328453, -0.03498115763068199, -0.04208865016698837, -0.0899943858385086, -0.1276189237833023, -0.034885916858911514, 0.10881658643484116, -0.022012125700712204, 0.007528965827077627, -0.13047321140766144, -0.015342955477535725, -0.02233939804136753, 0.0115883257240057, 0.032809846103191376, -0.005441624205559492, -0.024710258468985558, 0.004644958768039942, -0.05561826750636101, 0.08216588944196701, 0.0064186700619757175, 0.1033460944890976, 0.0060921418480575085, 0.025374073535203934, -0.017712591215968132, 0.015477200970053673, 0.033692616969347, 0.08079271763563156, -0.027654793113470078, 0.04405587539076805, -0.030360065400600433, 0.03898206353187561, -0.05505495145916939, -0.01951240748167038, 0.011620075441896915, -0.01495183166116476, 0.04861900955438614, -0.056578461080789566, -0.029152842238545418, 0.004329565446823835, -0.07073226571083069, 0.03750971332192421, -0.0037456697318702936, 0.042551811784505844, 0.05534128099679947, 0.05457528308033943, -0.019396381452679634, -0.0830335021018982, -0.05951286479830742, -0.02751428261399269, -0.05544392764568329, 0.005775925237685442, -0.02084272913634777, 0.05169306695461273, 0.05360100045800209, 0.017798589542508125, 0.06160953640937805, 0.11036654561758041, 0.047446176409721375, 0.0010821340838447213, -0.042062919586896896, -0.02205064706504345, 0.021504653617739677, 0.018831174820661545, -0.011511387303471565, -0.03728555515408516, 0.03140611946582794, -0.06530765444040298, 0.012209388427436352, 0.05962062254548073, 0.013369833119213581, 0.03069222718477249, 0.01468697376549244, 0.019876426085829735, 0.020696716383099556, -0.03168865293264389, 0.028344348073005676, -0.02283691056072712, 0.05609385669231415, 0.02971142716705799, 0.05431307479739189, -4.625193383844817e-08, -0.05150632560253143, 0.014271830208599567, 0.013187653385102749, 0.004499990958720446, -0.048148903995752335, -0.026861198246479034, 0.08861863613128662, 0.06988223642110825, 0.02653883583843708, 0.010195815935730934, 0.015041752718389034, -0.08017048984766006, -0.0023496849462389946, 0.04321398586034775, -0.027329521253705025, 0.12541842460632324, 4.980689845979214e-05, -0.018340857699513435, 0.07497937232255936, -0.000489827012643218, 0.012828689999878407, -0.07374217361211777, -0.011660558171570301, 0.044483765959739685, -0.07506842166185379, -0.06956133246421814, 0.07927850633859634, 0.07906275242567062, -0.015961380675435066, -0.017426174134016037, 0.0013759788125753403, -0.013309319503605366, 0.026091448962688446, 0.11175866425037384, 0.022971782833337784, 0.11017825454473495, 0.051118988543748856, -0.03816307708621025, 0.019640926271677017, 0.05890485271811485, -0.15038849413394928, 0.0352884903550148, 0.016497565433382988, 0.005460837390273809, 0.016105784103274345, 0.01245193276554346, -0.001868197345174849, 0.0023850167635828257, -0.04643576592206955, 0.01602032408118248, 0.04988803341984749, 0.03160839155316353, -0.0342024601995945, 0.11741939932107925, 0.11777404695749283, -0.10065728425979614, -0.028060469776391983, 0.035499848425388336, 0.016684142872691154, 0.043943148106336594, -0.03302080184221268, 0.002547819633036852, -0.03525073826313019, -0.1210273802280426 ] }, { "text": "As mentioned before, np.ndarray object does not have this extra \"computational graph\" layer and therefore, when converting a torch.tensor to np.ndarray you must explicitly remove the computational graph of the tensor using the detach() command.\n\n\n```python\nimage = content.to(\"cpu\").clone().detach()\nprint(image.shape)\nprint(image.type)\n```\n\n torch.Size([1, 3, 400, 592])\n \n\n\n**Turn to numpy**\n\n\n```python\nimage = image.numpy()\nprint(image.shape)\nprint(image.dtype)\n```\n\n (1, 3, 400, 592)\n float32\n\n\n**Use squeeze**\n\nnumpy.squeeze() : Remove single-dimensional entries from the shape of an array.\n\n\n```python\nimage = image.squeeze()\nprint(image.shape)\n```\n\n (3, 400, 592)\n\n\n**Transpose**", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_10", "embedding": [ 0.016260499134659767, -0.044982101768255234, -0.028077298775315285, 0.01785578392446041, 0.01914883963763714, -0.08462223410606384, -0.037536006420850754, -0.031505752354860306, -0.09461822360754013, -0.026323216035962105, -0.08232596516609192, -0.01943979039788246, -0.0985775738954544, 0.06531670689582825, -0.005966697819530964, 0.061984289437532425, -0.08193764090538025, -0.049409326165914536, 0.012748323380947113, -0.04385637119412422, 0.017544515430927277, 0.01068323478102684, 0.03109661675989628, -0.011643660254776478, 0.02033131755888462, 0.010489709675312042, 0.03643530607223511, -0.02588113397359848, 0.022633546963334084, 0.04087536409497261, -0.008160619996488094, -0.015763482078909874, -0.04698227718472481, 0.013159893453121185, 0.04409348964691162, 0.00428398884832859, -0.09615582227706909, -0.00807543471455574, 0.00018464076856616884, 0.05917198583483696, 0.04152737185359001, 0.02319337986409664, -0.05437280237674713, -0.004205556586384773, -0.0120921079069376, 0.06111877039074898, 0.04523371905088425, 0.013942483812570572, 0.040884364396333694, -0.052491556853055954, 0.010129095055162907, 0.025407034903764725, -0.06991469860076904, 0.012267517857253551, 0.01018975768238306, -0.033575475215911865, 0.045803751796483994, -0.0955381989479065, -0.013824725523591042, -0.041539642959833145, 0.0191278625279665, 0.02202707901597023, 0.05891402065753937, -0.05203242227435112, 0.05177265405654907, 0.009540602564811707, -0.0026896086055785418, -0.05362852290272713, 0.0263151153922081, -0.015308773145079613, 0.03939153254032135, -0.015471179969608784, -0.009392908774316311, 0.0714007019996643, -0.019414810463786125, -0.1010349690914154, 0.12788306176662445, 0.03962013125419617, 0.029914675280451775, -0.006815657950937748, -0.009856061078608036, 0.0004750516964122653, 0.05543515086174011, 0.002508444245904684, -0.02480120211839676, -0.02437368966639042, -0.05215545371174812, 0.0532347597181797, 0.022619644179940224, -0.054614774882793427, -0.0417899414896965, 0.0009647590923123062, -0.08873336762189865, 0.030118588358163834, 0.04247400164604187, -0.05988340079784393, 0.06757881492376328, 0.03535644710063934, -0.06616980582475662, -0.0021560348104685545, 0.08449193835258484, -0.07098536193370819, -0.04537266492843628, 0.05857579782605171, -0.01158696785569191, 0.09257004410028458, 0.049277350306510925, 0.0776587575674057, -0.051761236041784286, 0.02616337686777115, 0.020855126902461052, 0.08678346127271652, 0.0148191899061203, -0.02331521175801754, 0.05934268236160278, -0.026881517842411995, -0.09231414645910263, 0.09067077934741974, -0.03629865497350693, 0.11721988022327423, -0.07879417389631271, 0.07992055267095566, 0.028256995603442192, 0.06893187761306763, -0.041125260293483734, 0.040407441556453705, -0.06848558038473129, 1.878820355239102e-33, -0.04805786907672882, 0.06936973333358765, -0.01490757055580616, -0.05887738615274429, 0.007987882010638714, 0.08216369897127151, 0.03775414079427719, -0.06785836070775986, -0.013812493532896042, 0.013809774070978165, -0.06326133757829666, 0.001859323587268591, 0.008127284236252308, 0.07785873860120773, -0.062089186161756516, -0.03768017143011093, 0.09996677190065384, -0.010397312231361866, 0.03952492028474808, -0.0019544335082173347, 0.05362440273165703, 0.07015955448150635, -0.025607110932469368, 0.06871134042739868, -0.14720219373703003, -0.04250878095626831, -0.0713481679558754, 0.0029285589698702097, 0.008323876187205315, -0.02645457163453102, -0.10270419716835022, -0.011921764351427555, 0.04244676232337952, -0.04940294474363327, -0.006412090267986059, -0.09371230751276016, 0.04515412077307701, -0.019251594319939613, -0.05482327565550804, -0.12556199729442596, -0.020200222730636597, 0.12873224914073944, 0.011789041571319103, -0.06820879131555557, -0.06841232627630234, 0.06518637388944626, -0.051885537803173065, 0.040583837777376175, 0.006962993182241917, -0.031139694154262543, -0.07020624727010727, -0.014560682699084282, 0.05757530406117439, 0.04295821115374565, 0.026308275759220123, -0.1073654517531395, 0.1159643605351448, 0.015257060527801514, 0.0877072885632515, -0.10872218757867813, 0.08587099611759186, -0.003167463932186365, 0.01163578126579523, 0.019438540562987328, -0.014447443187236786, -0.006314652506262064, 0.04267007112503052, 0.08532360196113586, -0.032885968685150146, 0.014991255477070808, -0.08907584846019745, 0.13948900997638702, -0.06003527715802193, -0.022338049486279488, -0.011646667495369911, -0.07287776470184326, 0.02756534330546856, -0.07653304189443588, -0.06341204047203064, -0.004931911360472441, -0.040050771087408066, 0.057084761559963226, 0.035253044217824936, -0.17141017317771912, -0.050218287855386734, 0.00133121432736516, 0.003306788858026266, -0.0018597685266286135, 0.002925923792645335, -0.019644713029265404, -0.001184601685963571, -0.04883692413568497, 0.028569936752319336, -0.0054674954153597355, -0.04551419988274574, -2.8501776224136216e-33, -0.03432552516460419, 0.04997313767671585, -0.036022480577230453, -0.0335906445980072, -0.026978563517332077, 0.0079683568328619, 0.002350044436752796, -0.01591900922358036, -0.029154645279049873, -0.020893173292279243, 0.02652018889784813, -0.05983307212591171, -0.01635602116584778, -0.0784677267074585, 0.06000768393278122, -0.04492111876606941, -0.047434382140636444, 0.08186951279640198, 0.03515680879354477, -0.0643700435757637, -0.04737233743071556, 0.0387694276869297, -0.0526103638112545, 0.0023745503276586533, -0.10028490424156189, 0.0131315216422081, -0.012926129624247551, 0.003803783096373081, 0.03800167888402939, -0.05497382581233978, 0.01029756385833025, 0.008266134187579155, -0.05909864604473114, 0.07319921255111694, 0.06625659018754959, 0.040615033358335495, 0.06192762404680252, -0.005557764787226915, 0.0004465522652026266, -0.04841223359107971, 0.04329298809170723, 0.026164565235376358, -0.04816306754946709, 0.06324928998947144, -0.0701419785618782, 0.04739030823111534, -0.031323231756687164, 0.0186040960252285, 0.027375970035791397, -0.012054027058184147, 0.01475786417722702, -0.08209171891212463, -0.0010953493183478713, -0.008853469975292683, 0.025658538565039635, 0.003770459908992052, 0.0212591253221035, 0.048578351736068726, 0.0653972178697586, -0.026470689103007317, -0.05306067317724228, -0.09783725440502167, -0.02906983532011509, -0.05879669636487961, -0.03205849230289459, -0.015042700804769993, -0.0914391577243805, 0.08200736343860626, 0.03579411655664444, 0.06270209699869156, -0.06740470230579376, 0.09544357657432556, 0.03955167904496193, 0.021300548687577248, -0.05339060723781586, -0.00037187535781413317, 0.05561814829707146, 0.05941801518201828, 0.06354686617851257, -0.03128489479422569, 0.01980576105415821, -0.014329567551612854, 0.02698594145476818, 0.06349198520183563, 0.026867179200053215, 0.032135698944330215, 0.09049833565950394, 0.004685836844146252, -0.05178056284785271, 0.008210837841033936, 0.06686284393072128, -0.0294773168861866, 0.036772556602954865, 0.04145057499408722, 0.044798143208026886, -4.656804009073312e-08, 0.03247811272740364, -0.0007211927440948784, 0.025303861126303673, -0.00036405641003511846, -0.004127665888518095, 0.0017636966658756137, 0.05222074314951897, 0.044991474598646164, 0.02854245901107788, 0.03128954768180847, -0.006312561221420765, -0.05883374810218811, 0.0577767975628376, 0.011091968975961208, -2.0485182176344097e-05, 0.07060644775629044, -0.022609662264585495, -0.014513314701616764, 0.08187311142683029, -0.037978604435920715, -0.052394479513168335, -0.11256663501262665, -0.033020880073308945, 0.02188836969435215, -0.0886373370885849, -0.05862882360816002, 0.013865449465811253, 0.0053029488772153854, 0.009678121656179428, -0.01762145757675171, -0.06576097011566162, -0.051143575459718704, 0.08488669246435165, 0.0317763052880764, 0.05439040809869766, 0.01778709888458252, 0.022095773369073868, -0.030672863125801086, -0.013911805115640163, 0.02779165655374527, -0.06874064356088638, 0.04603121057152748, 0.012196538038551807, -0.031712811440229416, 0.036196496337652206, -0.03102070279419422, 0.007394305430352688, 0.012226982973515987, -0.022998500615358353, 0.058197539299726486, 0.07214143872261047, 0.021151231601834297, -0.003650289261713624, 0.034877993166446686, 0.05253554508090019, -0.014606544747948647, -0.10304773598909378, 0.045868679881095886, 0.0346280075609684, 0.028751542791724205, 0.024122226983308792, 0.04845976456999779, -0.02071322873234749, -0.09272435307502747 ] }, { "text": "```python\nimage = image.squeeze()\nprint(image.shape)\n```\n\n (3, 400, 592)\n\n\n**Transpose**\n\nTranspose the dimension such that: Height, Width, Channel\n- Original: 3, 400, 592\n- Transpose(1,2,0) --> 400, 592, 3 \n\n\n```python\nimage = image.transpose(1,2,0)\nimage.shape\n```\n\n\n\n\n (400, 592, 3)\n\n\n\n**Normalize**\n\nRef: https://pytorch.org/docs/stable/torchvision/models.html\n\nAll pre-trained models expect input images normalized in the same way, i.e. mini-batches of 3-channel RGB images of shape (3 x H x W), where H and W are expected to be at least 224. The images have to be loaded in to a range of [0, 1] and then normalized using mean = [0.485, 0.456, 0.406] and std = [0.229, 0.224, 0.225]. \n\nYou can use the following transform to normalize:", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_11", "embedding": [ 0.033392928540706635, -0.07543215155601501, 0.0019436137517914176, 0.016327915713191032, -0.012270821258425713, -0.04717988520860672, -0.054965704679489136, 0.046312279999256134, -0.03211964666843414, -0.07399241626262665, -0.015095806680619717, 0.034752462059259415, -0.0016502969665452838, 0.06486521661281586, -0.047606658190488815, 0.027326272800564766, -0.048538751900196075, 0.02775541879236698, -0.14393958449363708, -0.07768076658248901, 0.05218888446688652, -0.04380084574222565, 0.04344460740685463, -0.03190246596932411, -0.01250291895121336, -0.027481749653816223, 0.01641201041638851, -0.006853296421468258, 0.07748489081859589, -0.0029122603591531515, -0.026969732716679573, -0.009300935082137585, 0.013714933767914772, 0.03555583581328392, 0.020268764346837997, -0.018753238022327423, -0.07155199348926544, -0.02733398787677288, -0.0043678293004632, 0.03464827686548233, 0.05726467818021774, -0.03641040623188019, -0.04601733386516571, -0.04011591896414757, -0.007565896492451429, 0.056070227175951004, 0.04876000061631203, -0.04178083315491676, -0.01053068321198225, -0.1673610359430313, 0.013832630589604378, 0.016151847317814827, -0.06228020042181015, 0.07650753110647202, -0.009592975489795208, -0.0010522344382479787, 0.03507992625236511, -0.09006447345018387, 0.027351906523108482, -0.12079689651727676, -0.027485255151987076, 0.03130478039383888, 0.015917034819722176, -0.045428887009620667, 0.0493769571185112, -0.018058788031339645, -0.014711527153849602, -0.023449435830116272, 0.05723678320646286, -0.035362064838409424, -0.025000743567943573, 0.02651604823768139, 0.006135340314358473, 0.041991401463747025, 0.003890042891725898, -0.06089993193745613, 0.11496590822935104, 0.09695734083652496, -0.010655534453690052, -0.07755938172340393, 0.02572488784790039, -0.013318045996129513, 0.0728507786989212, 0.009351720102131367, 0.057694002985954285, 0.057831890881061554, -0.04443477466702461, 0.07815974950790405, 0.005142484325915575, 0.0011070737382397056, -0.09664098173379898, -0.001957954838871956, -0.16668440401554108, 0.06081778556108475, -0.02220521867275238, -0.03270813822746277, 0.06763184070587158, -0.06042021885514259, -0.051534079015254974, 0.048821598291397095, 0.05725840479135513, -0.05773504450917244, 0.0691751167178154, 0.06063311919569969, 0.0834616869688034, 0.043607015162706375, 0.05030841752886772, 0.11076461523771286, 0.030356381088495255, -0.04285946115851402, 0.041720181703567505, -0.02860809862613678, -0.02508770488202572, 0.0016945626121014357, 0.04840611666440964, -0.027745578438043594, -0.05962140113115311, 0.07074405997991562, -0.034142497926950455, -0.01014245580881834, -0.017193634063005447, 0.0708862766623497, -0.05372927710413933, 0.004261737689375877, -0.027524778619408607, -0.02971513569355011, -0.0466165766119957, 3.094633243939632e-33, -0.05971259996294975, 0.012393258512020111, -0.03778618574142456, 0.0070990268141031265, -0.014652998186647892, 0.09068715572357178, 0.025358619168400764, -0.04665354639291763, 0.021253244951367378, 0.00677892379462719, -0.019811343401670456, -0.0458255372941494, -0.06974945217370987, 0.07548171281814575, -0.02908584289252758, -0.011003346182405949, 0.016108117997646332, 0.09158388525247574, -0.02626694180071354, 0.01907784678041935, 0.06762555241584778, 0.015756236389279366, -0.009792329743504524, -0.0018057753331959248, -0.11154523491859436, -0.03562501072883606, -0.06086555868387222, -0.029319453984498978, 0.0017743377247825265, -0.03468526899814606, -0.0010800454765558243, 0.01824003830552101, 0.02981152944266796, -0.04088805615901947, -0.04706268385052681, -0.03884286433458328, 0.05748111382126808, 0.01643802411854267, -0.018761098384857178, -0.031055625528097153, 0.012415159493684769, 0.12405030429363251, 0.04781230539083481, -0.027035268023610115, -0.0346161387860775, 0.03367210552096367, 0.0106626246124506, 0.07473614066839218, -0.056524451822042465, -0.00791025161743164, -0.02522565796971321, -0.022936442866921425, 0.0004530989390332252, -0.002734197536483407, 0.04815016686916351, -0.06899487227201462, 0.12265241891145706, 0.001188619644381106, 0.05611680448055267, -0.08228211849927902, 0.035565685480833054, 0.015038677491247654, -0.016598090529441833, 0.08316897600889206, 0.027586793527007103, -0.0026315811555832624, 0.01520937867462635, 0.03364197164773941, -0.06551367789506912, 0.06381260603666306, -0.10130289196968079, 0.08580879867076874, -0.05728874355554581, -0.023497993126511574, -0.01054278016090393, -0.05626937374472618, 0.04174608737230301, -0.03992687910795212, -0.04731425270438194, 0.06502274423837662, -0.07992776483297348, 0.11888109892606735, -0.012409931980073452, -0.08542189747095108, -0.09163904935121536, 0.03676982969045639, -0.009753428399562836, -0.066133514046669, -0.04520677402615547, -0.030415445566177368, -0.027012398466467857, 0.028543740510940552, 0.03450232371687889, 0.028187554329633713, -0.05362774059176445, -1.874438883717404e-33, 0.026363376528024673, 0.11776546388864517, -0.037837401032447815, 0.05273113399744034, -0.03976743295788765, 0.022755974903702736, 0.034312326461076736, 0.038808226585388184, -0.01681370846927166, -0.07000548392534256, 0.04826817288994789, -0.032472241669893265, -0.07481351494789124, -0.08336151391267776, 0.03627307340502739, -0.061823293566703796, 0.009989653714001179, 0.018693765625357628, 0.03553377464413643, -0.01694858819246292, 0.01367047056555748, 0.1088804379105568, -0.1305263489484787, 0.07267310470342636, -0.08523508161306381, 0.05815465748310089, 0.012667297385632992, 0.03939606249332428, -0.03315803408622742, -0.020974887534976006, 0.024978093802928925, -0.058040887117385864, -0.012090505100786686, -0.0005686135264113545, -0.04829471930861473, 0.02989884838461876, -0.0065458654426038265, 0.011121570132672787, 0.002531631151214242, 0.015309461392462254, 0.07660941779613495, 0.039136819541454315, -0.11312895268201828, 0.05074412375688553, -0.06187690049409866, 0.043905481696128845, 0.007391489576548338, -0.07292404025793076, 0.03662332892417908, 0.030626440420746803, -0.02409924939274788, -0.04226433113217354, -0.07700607180595398, -0.011830688454210758, 0.004719397518783808, -0.003518833080306649, -0.050135694444179535, 0.008274623192846775, 0.0801105722784996, -0.035699743777513504, -0.04537436366081238, -0.0732191801071167, -0.01893395371735096, -0.017452312633395195, -0.06751666218042374, 0.0008645811467431486, -0.0193024892359972, 0.01419302262365818, 0.02926495485007763, 0.0718846544623375, 0.007094420026987791, 0.061045411974191666, 0.0736260712146759, 0.028469685465097427, -0.016644205898046494, -0.06337761878967285, 0.03054668940603733, 0.025914255529642105, 0.04721904173493385, -0.02727366052567959, -0.07524906098842621, -0.013223648071289062, 0.026953119784593582, 0.07394593209028244, 0.06929142773151398, 0.09499941021203995, 0.028598271310329437, 0.016483239829540253, 0.03148222714662552, 0.01774449832737446, 0.0447017140686512, 0.025812460109591484, 0.10603690147399902, 0.014988087117671967, 0.06822052597999573, -5.769415523104726e-08, -0.025442831218242645, 0.020248856395483017, -0.011963787488639355, 0.046573348343372345, -0.0722954124212265, -0.05743623152375221, 0.057891830801963806, 0.051966097205877304, -0.009460065513849258, -0.017124338075518608, -0.009874935261905193, -0.04408373311161995, -0.03822501003742218, -0.05443570017814636, 0.030275410041213036, 0.05554712563753128, 0.005593031644821167, 0.018034553155303, 0.0324411503970623, -0.008828765712678432, -0.03791100159287453, -0.059261418879032135, -0.02514941617846489, -0.0021796938963234425, -0.021532351151108742, -0.01834080182015896, -0.009210435673594475, 0.011683422140777111, 0.011684669181704521, -0.06682365387678146, 0.07172965258359909, -0.01134461909532547, 0.14117196202278137, 0.08901603519916534, 0.04040657356381416, 0.010088752023875713, -0.08773522078990936, 0.03205752745270729, -0.05389035865664482, -0.008612440899014473, -0.05144118145108223, -0.01800716295838356, 0.02934536337852478, -0.05106080323457718, 0.03473737835884094, -0.00448538176715374, 0.046047765761613846, -0.034436311572790146, -0.002649192698299885, 0.05209903419017792, 0.10567266494035721, 0.06249772757291794, 0.010409791953861713, 0.06868021190166473, 0.0945773720741272, -0.029535962268710136, 0.042289361357688904, 0.042895447462797165, -0.01199293415993452, 0.017670882865786552, 0.022188851609826088, -0.01774800941348076, -0.10817079246044159, -0.04151131957769394 ] }, { "text": "You can use the following transform to normalize:\n\n normalize = transforms.Normalize(mean=[0.485, 0.456, 0.406],\n std=[0.229, 0.224, 0.225]) \n\n\n```python\nimage = image * np.array((0.229, 0.224, 0.225)) + np.array((0.485, 0.456, 0.406))\nimage.shape\n```\n\n\n\n\n (400, 592, 3)\n\n\n\n**Clip the values**\n\nRef: https://numpy.org/doc/stable/reference/generated/numpy.clip.html\n\nGiven an interval, values outside the interval are clipped to the interval edges. For example, if an interval of [0, 1] is specified, values smaller than 0 become 0, and values larger than 1 become 1.\n\n\n\n```python\nimage = image.clip(0, 1)\nimage\n```", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_12", "embedding": [ 0.021981650963425636, 0.030660882592201233, 0.04138505086302757, -0.06933709979057312, -0.018021976575255394, -0.09680256992578506, -0.04934507608413696, -0.02611454203724861, -0.051058877259492874, -0.04021001607179642, -0.058475252240896225, -0.006696857046335936, 0.032014138996601105, 0.061245910823345184, -0.00562960933893919, -0.012854153290390968, -0.05928541347384453, 0.030481578782200813, -0.04678770899772644, -0.05298250913619995, 0.0382239855825901, 0.11788492649793625, -0.054567962884902954, -0.024184035137295723, 0.07022737711668015, -0.02097451314330101, 0.02166425809264183, -0.004961182828992605, 0.03931860625743866, 0.04917822405695915, 0.012844298966228962, -0.015132112428545952, 0.11022453755140305, -0.022333569824695587, -0.02970941551029682, -0.05308490991592407, -0.043532051146030426, 0.04979228228330612, -0.00860761571675539, -0.0035492407623678446, 0.04519856348633766, 0.012562982738018036, -0.007694643456488848, -0.053154606372117996, -0.03313502296805382, 0.06718068569898605, -0.0335974246263504, -0.04419960454106331, 0.03525622561573982, -0.02176421508193016, 0.05008692666888237, 0.024161813780665398, -0.08874239772558212, 0.009633985348045826, -0.03552158176898956, 0.006465165410190821, 0.08145426958799362, -0.10818438977003098, 0.01257806271314621, -0.06280922889709473, 0.011327743530273438, 0.004924603272229433, 0.029148614034056664, -0.020252294838428497, 0.04175378382205963, -0.04713943600654602, 0.0102538475766778, -0.024926401674747467, 0.03582434728741646, 0.04463951662182808, 0.004330000374466181, 0.03871483355760574, 0.03472466394305229, -0.024082042276859283, -0.043800607323646545, -0.058413997292518616, 0.03426409512758255, 0.015072103589773178, -0.02587081864476204, 0.04252620041370392, 0.02732028067111969, 0.006271656136959791, 0.1022569090127945, 0.012509114108979702, -0.040572937577962875, 0.016412189230322838, -0.032116085290908813, 0.12205331772565842, 0.0594123937189579, 0.042180076241493225, -0.036185696721076965, 0.05566535145044327, -0.1320141702890396, -0.0030037551186978817, 0.006523120682686567, -0.027730794623494148, -0.0073881312273442745, -0.0180425513535738, 0.0351574569940567, 0.0076661924831569195, 0.058139216154813766, -0.11636234074831009, -0.017347728833556175, -0.004098943434655666, 0.09546985477209091, 0.10540013015270233, 0.057156600058078766, -0.028501778841018677, -0.0006867604097351432, 0.0008860668749548495, -0.005161135457456112, -0.06879422813653946, 0.006515138316899538, -0.03131425008177757, 0.08459430932998657, 0.037043485790491104, -0.00844804011285305, 0.0748584046959877, -0.06400832533836365, -0.007909080013632774, -0.07394896447658539, 0.02923336625099182, -0.014334486797451973, 0.04654107987880707, 0.025063127279281616, 0.059065233916044235, 0.01948271133005619, 9.332663829265813e-34, -0.0596935860812664, 0.006628731265664101, 0.0026423882227391005, -0.030144162476062775, 0.03181292489171028, 0.12529118359088898, -0.012739782221615314, -0.08402101695537567, -0.015960467979311943, -0.011222942732274532, 0.025800127536058426, 0.0242286529392004, -0.029921377077698708, 0.003878112882375717, -0.015587393194437027, -0.0306854285299778, 0.10072019696235657, 0.04503239691257477, 0.022495606914162636, -0.06740421801805496, -0.006978690158575773, -0.002801088849082589, 0.0029261175077408552, 0.08068014681339264, -0.021890796720981598, -0.11893383413553238, -0.10975322127342224, -0.025924284011125565, 0.02327980287373066, -0.034828878939151764, -0.06282162666320801, 0.09593451768159866, -0.003809381742030382, -0.0692756325006485, 0.021569261327385902, 0.020169449970126152, 0.0900910496711731, 0.05446993559598923, -0.02553502283990383, 0.0012833861401304603, 0.02906559593975544, 0.10481095314025879, 0.032430440187454224, -0.019207701086997986, 0.007790144067257643, 0.01134959701448679, 0.04457255080342293, 0.1293601244688034, -0.009671238251030445, 0.014587749727070332, -0.023235591128468513, -0.04843150079250336, 0.035656627267599106, -0.09644357115030289, -0.027069224044680595, -0.080311119556427, 0.14607460796833038, -0.012443219311535358, -0.07247179746627808, -0.07273240387439728, 0.030816081911325455, -0.023257918655872345, 0.008995524607598782, 0.010894695296883583, 0.046786222606897354, 0.005489572416990995, 0.03331223875284195, 0.05307500809431076, -0.0593976154923439, 0.09268239140510559, -0.07992680370807648, 0.08712264895439148, -0.061073172837495804, -0.04293069615960121, -0.12144233286380768, -0.0003497953002806753, 0.04377691447734833, 0.023856183513998985, -0.019271058961749077, -0.05766190588474274, -0.005117090884596109, 0.05791911855340004, -0.03129689767956734, -0.14786911010742188, 0.01274015475064516, 0.01574358530342579, 0.009188254363834858, 0.0057678124867379665, -0.03558268025517464, -0.12477990239858627, -0.04612181335687637, -0.022365372627973557, -0.020491810515522957, 0.06810342520475388, -0.0713714212179184, -1.2974948687323018e-33, 0.011089980602264404, 0.08303855359554291, -0.014552676118910313, 0.07337572425603867, 0.014756170101463795, 0.051103416830301285, 0.010389570146799088, 0.04790620505809784, -0.007622989825904369, -0.04078906029462814, -0.0044397697784006596, -0.057166676968336105, 0.021245041862130165, -0.06492593884468079, -0.02797137014567852, -0.0654129609465599, 0.035068780183792114, 0.004894969519227743, -0.03920761123299599, -0.07374350726604462, -0.03456106781959534, 0.0005087142926640809, 0.008630671538412571, 0.013048703782260418, -0.11132625490427017, 0.04707422852516174, -0.06375238299369812, -0.02376226708292961, 0.006746343802660704, -0.03122631460428238, -0.07665759325027466, -0.035828519612550735, 0.006418977864086628, -0.05077177286148071, 0.040187932550907135, 0.04970989003777504, -0.025640107691287994, 0.02047307789325714, -0.008661401458084583, -0.08361520618200302, -0.006008015479892492, 0.05689064785838127, -0.03863969072699547, 0.024068143218755722, -0.006672928109765053, 0.040217455476522446, 0.017642593011260033, 0.0022510222624987364, -0.08497531712055206, -0.01888313889503479, -0.04461263492703438, 0.006984163541346788, 0.0007528421119786799, 0.10459034889936447, -0.04425184801220894, 0.049556341022253036, -0.10895446687936783, -0.003926383797079325, 0.048374637961387634, -0.0220488291233778, -0.01536889374256134, -0.03670100122690201, -0.10886159539222717, 0.03435637429356575, -0.009887078776955605, 0.032377105206251144, -0.005645377095788717, 0.01467481255531311, -0.07189252227544785, 0.03926924988627434, 0.04739435762166977, 0.05782056972384453, 0.08753250539302826, -0.04856368154287338, -0.05048764869570732, -0.1195330023765564, 0.026155104860663414, -0.00012458290439099073, -0.04568227007985115, 0.03679348900914192, -0.01833905093371868, -0.014647139236330986, 0.0782734751701355, 0.03031822107732296, -0.011120416224002838, 0.0230125542730093, 0.031189721077680588, -0.024253077805042267, 0.07508867233991623, 0.02721165493130684, -0.03653683140873909, 0.03586703538894653, -0.021595241501927376, -0.003455652855336666, 0.047091349959373474, -4.240633799668103e-08, 0.04916495457291603, 0.010233240202069283, -0.028094056993722916, 0.003831491805613041, 0.0010731307556852698, 0.03165704011917114, -0.03285089135169983, 0.008806295692920685, 0.03402594476938248, 0.01262535247951746, -0.019222745671868324, -0.058466099202632904, -0.034601882100105286, -0.058562982827425, -0.019552651792764664, 0.08093057572841644, 0.009962682612240314, -0.0005149956559762359, 0.0722457692027092, -0.0010345358168706298, -0.0503372848033905, -0.06924048066139221, -0.016725054010748863, 0.03180571645498276, -0.11494547128677368, 0.0069715846329927444, -0.04192669317126274, -0.032180823385715485, 0.11912327259778976, -0.007833970710635185, -0.010327603667974472, -0.048063866794109344, 0.1501835733652115, 0.039242565631866455, 0.08408739417791367, 0.0024230920244008303, -0.06277585029602051, 0.013853027485311031, -0.04042563959956169, 0.03329164907336235, -0.037803202867507935, -0.0013545636320486665, 0.04924415796995163, -0.029593614861369133, -0.0027226440142840147, 0.0015610434347763658, 0.13684004545211792, 0.004852282349020243, 0.05590485781431198, 0.028679337352514267, 0.09094839543104172, 0.04501914978027344, 0.002075656084343791, 0.046501997858285904, 0.0029019650537520647, -0.04110699146986008, -0.023096848279237747, 0.08479217439889908, 0.015676792711019516, 0.026083730161190033, -0.014733062125742435, -0.08009663969278336, -0.046186260879039764, -0.037891700863838196 ] }, { "text": "array([[[0.05098039, 0.0509804 , 0.05882353],\n [0.03921567, 0.03921569, 0.04705882],\n [0.04313724, 0.04313725, 0.0509804 ],\n ...,\n [0.43921568, 0.43921569, 0.40000002],\n [0.43921568, 0.43921569, 0.40000002],\n [0.41568626, 0.41568628, 0.37647061]],\n \n [[0.02745098, 0.02745099, 0.03529412],\n [0.02352938, 0.02352943, 0.03137254],\n [0.03921567, 0.03921569, 0.04313725],\n ...,\n [0.38039215, 0.37254903, 0.33725492],\n [0.40784313, 0.40392158, 0.3647059 ],\n [0.44705881, 0.43921569, 0.40392159]],\n \n [[0.03137252, 0.03137255, 0.03529412],\n [0.03137252, 0.03137255, 0.03529412],\n [0.04313724, 0.04313725, 0.04313725],", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_13", "embedding": [ 0.08449263125658035, -0.030918695032596588, -0.04965256154537201, -0.030088217929005623, -0.06453665345907211, -0.1222555935382843, 0.038052789866924286, -0.03219642862677574, 0.004870284348726273, 0.008737627416849136, -0.059951625764369965, 0.01080143079161644, -0.0023790833074599504, 0.0019964755047112703, -0.04032458737492561, -0.026835743337869644, -0.11086706072092056, -0.0296858549118042, -0.022832611575722694, -0.056691136211156845, -0.021047409623861313, 0.038511406630277634, -0.05946265161037445, -0.06636624783277512, 0.062477778643369675, 0.06813664734363556, 0.05981332063674927, 0.07561194896697998, -0.04040561616420746, -0.03330458328127861, 0.0041830469854176044, 0.008039642125368118, 0.00871316995471716, -0.029775816947221756, -0.03435135260224342, -0.05120900645852089, -0.03131173923611641, 0.08472662419080734, 0.07788095623254776, 0.07748658955097198, 0.06596989929676056, 0.07849423587322235, 0.06251059472560883, -0.058539628982543945, 0.02630096673965454, -0.04973505809903145, -0.0853210836648941, -0.06722401082515717, 0.0033107849303632975, -0.05243935436010361, -0.03420843556523323, 0.03445873409509659, 0.05346047878265381, 0.01587066985666752, -0.00228730496019125, -0.09934297204017639, 0.038015641272068024, -0.11402822285890579, 0.05049165338277817, 0.005596339236944914, -0.013614710420370102, 0.05925345420837402, 0.012132534757256508, -0.013031263835728168, 0.03768580034375191, -0.005443587899208069, -0.008350891061127186, -0.034545402973890305, 0.033561017364263535, 0.09108688682317734, -0.03899975121021271, 0.011249554343521595, 0.014972187578678131, 0.015505227260291576, 0.02051975578069687, -0.015108022838830948, 0.02671176753938198, -0.04771063104271889, -0.001989634009078145, 0.028320658951997757, -0.053327277302742004, 0.026251645758748055, -0.024232644587755203, -0.07493047416210175, -0.08284022659063339, 0.009540431201457977, -0.006149378605186939, 0.037913013249635696, 0.0503573939204216, -0.006104905623942614, -0.06495184451341629, 0.03623417392373085, -0.1702849417924881, 0.030028287321329117, 0.01473925169557333, 0.04191790148615837, 0.10969022661447525, -0.02685636840760708, -0.005835351999849081, 0.026376262307167053, 0.005286957137286663, -0.09968666732311249, -0.021490976214408875, 0.03928149864077568, 0.04954845458269119, 0.035093918442726135, 0.0737331360578537, -0.0029868287965655327, -0.010345681570470333, -0.018008897081017494, -0.0367366187274456, -0.00718695018440485, 0.017057152464985847, 0.013410278595983982, -0.0158506128937006, -0.04521332308650017, -0.05810447037220001, 0.09265521168708801, 0.05367438122630119, 0.07315273582935333, 0.033759262412786484, 0.009704147465527058, 0.028821926563978195, 0.06614945828914642, -0.05576987937092781, -0.0053784409537911415, -0.06253931671380997, 5.7970635324113775e-33, -0.03414657339453697, 0.030399387702345848, 0.12130369991064072, -0.10072698444128036, -0.0010589848970994353, 0.0273179542273283, -0.04317085072398186, -0.04448869824409485, -0.0009226900874637067, 0.01859181933104992, -0.04871778562664986, -0.0034829501528292894, -0.0024565712083131075, 0.021084820851683617, -0.009863555431365967, -0.05201798304915428, 0.0656377300620079, 0.011660926975309849, -0.07749621570110321, -0.05325588211417198, -0.02796347811818123, -0.053642358630895615, 0.04709586873650551, 0.020207250490784645, -0.018836772069334984, 0.024485545232892036, -0.004953613970428705, -0.027682676911354065, -0.060672882944345474, 0.0011073627974838018, 0.03193505108356476, 0.16656120121479034, -0.09227398037910461, -0.04812256619334221, 0.097845658659935, -0.07332990318536758, 0.018777908757328987, 0.08823651820421219, 0.03338879719376564, -0.012798096984624863, 0.005053432658314705, 0.0030325381085276604, 0.06822768598794937, 0.018746038898825645, 0.054011937230825424, -0.030378319323062897, 0.06465102732181549, 0.016125617548823357, -0.0088576041162014, 0.0055104573257267475, -0.07178879529237747, -0.03647337853908539, -0.018441874533891678, 0.033914972096681595, 0.0015577359590679407, -0.06378965824842453, 0.07935620099306107, 0.034606751054525375, 0.04028133675456047, 0.02316252514719963, -0.03948449715971947, -0.003615586319938302, -0.016225382685661316, -0.037898655980825424, 0.029219571501016617, 0.012500818818807602, -0.011540436185896397, 0.048504285514354706, 0.02777751162648201, 0.07996577024459839, 0.05151353403925896, 0.08365096896886826, 0.036849379539489746, -0.03771723061800003, -0.05866425856947899, 0.02513713948428631, 0.05078287422657013, -0.03437649458646774, -0.0028953684959560633, -0.025687633082270622, -0.01118484977632761, -0.0018969617085531354, -0.045622386038303375, -0.17456527054309845, -0.025327613577246666, 0.014017541892826557, -0.05984262377023697, -0.042897023260593414, -0.060130730271339417, -0.06754513829946518, -0.1533259153366089, 0.012729452922940254, 0.03658022731542587, -0.06784270703792572, -0.12886404991149902, -8.091256020444066e-33, 0.031153826043009758, 0.09434441477060318, 0.12464579194784164, 0.012581280432641506, 0.0225211251527071, 0.0046411193907260895, 0.04924315959215164, 0.019999761134386063, 0.04798128828406334, 0.0727139413356781, 0.07572844624519348, 0.0036078779958188534, 0.019452549517154694, -0.028895189985632896, 0.050792183727025986, -0.010341883637011051, 0.01579470932483673, 0.030007148161530495, -0.00432142149657011, -0.09289567917585373, -0.00924295000731945, 0.04894604533910751, -0.020807676017284393, 0.05776296555995941, -0.09720184653997421, -0.013319474644958973, 0.02105848863720894, -0.015161337330937386, -0.030298054218292236, 0.005935062654316425, -0.04610671103000641, -0.03715449944138527, -0.039686307311058044, 0.0627388060092926, 0.0355670303106308, 0.033246930688619614, 0.020106475800275803, 0.003247862448915839, -0.03486277908086777, -0.055978212505578995, -0.003673601895570755, -0.008849532343447208, -0.03517523407936096, -0.004777831956744194, -0.02028178982436657, -0.034655869007110596, 0.043721411377191544, 0.021549439057707787, -0.06477031856775284, 9.984942153096199e-05, -0.03946208953857422, 0.05775149166584015, -0.07995649427175522, 0.06696905940771103, 0.03371099755167961, -0.017295988276600838, -0.06399417668581009, 0.008312257938086987, 0.06375738978385925, -0.09037702530622482, -0.04206068441271782, 0.01266215369105339, 0.11540254205465317, 0.02710220403969288, 0.060051560401916504, 0.008445793762803078, -0.09044451266527176, -0.0384509339928627, -0.02791672572493553, 0.07029091566801071, 0.03733334690332413, 0.04486572742462158, -0.021066689863801003, -0.059422221034765244, -0.045403338968753815, -0.07334142178297043, 0.016498664394021034, -0.03943988308310509, -0.01393918041139841, 0.007315387949347496, -0.014715991914272308, -0.02855648472905159, 0.026531882584095, 0.07646244019269943, -0.00834097620099783, -0.017154065892100334, 0.03257402405142784, -0.04884213209152222, -0.042174868285655975, -0.027409473434090614, 0.008319558575749397, 0.049408819526433945, 0.05383128672838211, -0.004693623166531324, 0.03162139281630516, -5.784216838833345e-08, -0.03404704108834267, -0.07076402008533478, -0.049235958606004715, 0.032882411032915115, 0.10540637373924255, -0.024679195135831833, -0.025102563202381134, -0.012732865288853645, -0.04224332794547081, -0.09505284577608109, 0.0834595188498497, -0.08744247257709503, 0.032497406005859375, 0.03346448391675949, 0.04176860302686691, -0.031053215265274048, -0.04163143038749695, 0.019979653880000114, -0.007614471018314362, -0.059724509716033936, -0.05061040446162224, 0.0314948670566082, -0.022922327741980553, -0.0049274992197752, -0.035934969782829285, -0.008221992291510105, 0.0007973891915753484, -0.027969520539045334, 0.04509351775050163, 0.04551055282354355, -0.0737767219543457, -0.07554294914007187, 0.12136285752058029, 0.004171317908912897, 0.02968023158609867, 0.06784819066524506, -0.023627443239092827, 0.020091794431209564, -0.07251010835170746, 0.01264928374439478, -0.05774727836251259, 0.03404281288385391, 0.027362560853362083, 0.03526381403207779, 0.02197233960032463, -0.00045889971079304814, -0.05761881172657013, 0.05800691246986389, 0.08463030308485031, -0.09036656469106674, -0.016721544787287712, 0.09070127457380295, -0.015663575381040573, -0.03751078248023987, 0.007150982040911913, -0.042371947318315506, -0.1309230476617813, 0.00014724872016813606, -0.011112472042441368, 0.021012501791119576, 0.05655434727668762, -0.047776058316230774, -0.033646874129772186, -0.012099050916731358 ] }, { "text": "[[0.03137252, 0.03137255, 0.03529412],\n [0.03137252, 0.03137255, 0.03529412],\n [0.04313724, 0.04313725, 0.04313725],\n ...,\n [0.29803922, 0.28627453, 0.25098042],\n [0.35686274, 0.34509805, 0.30980394],\n [0.41568626, 0.40392158, 0.36862747]],\n \n ...,\n \n [[0.03137252, 0.02352943, 0.02745099],\n [0.03137252, 0.02352943, 0.02745099],\n [0.03137252, 0.02352943, 0.02745099],\n ...,\n [0.23529412, 0.21568628, 0.14117649],\n [0.23137252, 0.21176472, 0.13333336],\n [0.21960783, 0.20000002, 0.12156863]],\n \n [[0.03137252, 0.02352943, 0.02745099],\n [0.03137252, 0.02352943, 0.02745099],", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_14", "embedding": [ 0.07108067721128464, -0.06052420288324356, -0.022380424663424492, -0.020638590678572655, -0.05223701149225235, -0.11330553144216537, 0.025501366704702377, -0.006789162755012512, 0.023649917915463448, 0.025507155805826187, 0.005822158884257078, -0.03830870985984802, 0.009070416912436485, 0.004641316365450621, -0.05751090124249458, -0.016164734959602356, -0.10925718396902084, -0.03567848727107048, -0.02033422887325287, -0.04794803634285927, -0.005927768535912037, 0.05959819629788399, -0.020437436178326607, -0.06485065817832947, 0.07581164687871933, 0.06010660156607628, 0.01564287208020687, 0.07663688063621521, -0.058375198394060135, -0.0467681959271431, -0.004183088429272175, 8.16231404314749e-05, -0.013739924877882004, -0.034759555011987686, 0.048503559082746506, -0.0531318224966526, -0.016194995492696762, 0.05121811479330063, 0.06092539429664612, 0.04912460595369339, 0.0936017706990242, 0.03967902064323425, 0.12525874376296997, -0.0364425890147686, 0.002365057822316885, -0.040931835770606995, -0.11604425311088562, -0.06397506594657898, 0.01614837907254696, -0.06315203756093979, -0.025520192459225655, 0.01773686334490776, 0.028890222311019897, 0.010715287178754807, -0.010297643952071667, -0.06561321765184402, 0.00708320178091526, -0.10572631657123566, 0.05592239275574684, 0.0031208591535687447, -0.0038188216276466846, 0.060935571789741516, -0.01490272581577301, -0.006789024919271469, 0.04083164408802986, -0.011867341585457325, -0.0666690468788147, -0.0562308095395565, 0.007928273640573025, 0.08412633836269379, -0.02151665650308132, 0.010599547997117043, -0.020221229642629623, -0.025863777846097946, 0.01633945293724537, -0.02215675450861454, -0.0042091961950063705, -0.012580983340740204, 0.013178698718547821, 0.002695690607652068, -0.06443192064762115, -0.008409420028328896, -0.02977825701236725, -0.048627663403749466, -0.08260274678468704, -0.016539229080080986, 0.023135358467698097, 0.019219188019633293, 0.03086363896727562, 0.011896753683686256, -0.0738607794046402, 0.046540021896362305, -0.13300538063049316, 0.008868979290127754, -0.017512017861008644, 0.07371219247579575, 0.08638826012611389, -0.016830503940582275, 0.025652950629591942, 0.0278816819190979, -0.02035277523100376, -0.05594823881983757, -0.025518963113427162, 0.010858939029276371, -0.007186745293438435, 0.011241313070058823, 0.024768898263573647, 0.029859742149710655, 0.04960612580180168, -0.01598469354212284, -0.046754710376262665, -0.016619643196463585, 0.01202489249408245, -0.007945947349071503, -0.005769640207290649, -0.04095768928527832, -0.06784944981336594, 0.054033733904361725, 0.02691854164004326, 0.06915250420570374, 0.045324672013521194, 0.02275889366865158, -0.02082616090774536, 0.09879869967699051, -0.07398983836174011, 0.002252232749015093, -0.04880456626415253, 4.2755646234764574e-33, -0.013421174138784409, 0.0019559955690056086, 0.1180189773440361, -0.06142100319266319, -0.0027695996686816216, 0.04175693541765213, -0.06520578265190125, -0.0504075288772583, -0.026045670732855797, 0.054429903626441956, -0.061751190572977066, 0.008073888719081879, -0.036375660449266434, 0.02504994533956051, -0.03129721060395241, -0.07887447625398636, 0.05532533675432205, 0.011856683529913425, -0.10153964906930923, -0.04930103197693825, -0.01603781059384346, -0.06278058886528015, 0.04096241295337677, 0.03128015249967575, 0.012745583429932594, 0.03030461259186268, -0.00014828592247795314, -0.004787503741681576, -0.07002422213554382, 0.014811883680522442, 0.06288724392652512, 0.1558251678943634, -0.1251894235610962, -0.031506940722465515, 0.03948718681931496, -0.04847167804837227, 0.05242479592561722, 0.08828840404748917, 0.04517572373151779, 0.006449148058891296, 0.004964311141520739, 0.017160192131996155, 0.05904452130198479, 0.007349149323999882, 0.07625813037157059, -0.020875077694654465, 0.08732912689447403, 0.016087021678686142, -0.012701236642897129, 0.0004560629604384303, -0.08800477534532547, -0.016575701534748077, -0.019751397892832756, 0.04181719198822975, 0.0111126359552145, -0.031241169199347496, 0.04921191558241844, 0.037713341414928436, 0.028823265805840492, 0.016305331140756607, -0.015782004222273827, 0.03448314964771271, -0.004890408832579851, -0.0337635800242424, 0.06268013268709183, 0.04336543381214142, 0.008974363096058369, 0.029904944822192192, 0.02748561091721058, 0.08196032047271729, 0.027497244998812675, 0.02058541402220726, 0.07571784406900406, -0.04335152730345726, -0.039741188287734985, 0.03220616281032562, 0.037510666996240616, -0.043211545795202255, -0.013461650349199772, 0.029600754380226135, -0.03148878365755081, -0.008823803626000881, -0.06683973968029022, -0.18591049313545227, -0.0197740588337183, -0.0017518328968435526, -0.030119694769382477, -0.04955381900072098, -0.02668142504990101, -0.08812717348337173, -0.15344876050949097, -0.012100269086658955, 0.0387919545173645, -0.05062824487686157, -0.1547025591135025, -7.303674805393133e-33, 0.027725601568818092, 0.1081143245100975, 0.1259346455335617, -0.004468564409762621, 0.032860852777957916, 0.012418541125953197, 0.039133220911026, 0.02093466930091381, 0.0511433444917202, 0.07267068326473236, 0.08017419278621674, 0.005852219182997942, 0.027957715094089508, -0.01400915626436472, 0.006354568991810083, 0.020893143489956856, 0.03314049541950226, 0.04548192396759987, -0.06082955002784729, -0.0850672721862793, -0.04698245972394943, 0.0692109614610672, -0.04711153730750084, 0.0881442129611969, -0.08048798888921738, 0.04108132794499397, 0.01950913481414318, -0.028507238253951073, -0.07629495114088058, 0.01666523888707161, -0.08664249628782272, -0.009902392514050007, -0.03341609239578247, 0.06490551680326462, 0.011330997571349144, 0.016258781775832176, 0.044935569167137146, 0.02713971771299839, -0.04547629877924919, -0.05277799069881439, 0.015392606146633625, -0.01815483160316944, -0.03519149869680405, -0.0181990098208189, -0.034735824912786484, -0.051633071154356, 0.06083817034959793, -0.0076141031458973885, -0.07168474048376083, 0.04519760236144066, -0.039576735347509384, 0.06078629568219185, -0.10604739934206009, 0.07803428173065186, 0.01804116927087307, 0.0073831588961184025, -0.02579658478498459, 0.00569593720138073, 0.025278763845562935, -0.10696172714233398, -0.022858107462525368, 0.04355441406369209, 0.09290635585784912, 0.014416608959436417, 0.05545619875192642, -0.005508717615157366, -0.10288060456514359, -0.049872785806655884, -0.01986520364880562, 0.031063927337527275, 0.023268794640898705, 0.04502077028155327, 0.004152732435613871, -0.09284146130084991, -0.020163701847195625, -0.07641169428825378, 0.016392331570386887, -0.014472756534814835, 0.015992455184459686, -0.02955499105155468, -0.03710487112402916, -0.011531215161085129, 0.029681511223316193, 0.05069528520107269, 0.024704692885279655, -0.0557260662317276, 0.011735695414245129, -0.036384500563144684, -0.03130583092570305, -0.0035055584739893675, -0.009675305336713791, 0.0332786850631237, 0.07315362244844437, 0.007843852043151855, 0.029190123081207275, -5.574361949811646e-08, -0.03275951370596886, -0.024464542046189308, -0.055734097957611084, 0.05053479224443436, 0.09685976803302765, 0.031277451664209366, -0.04265524819493294, 0.02050674706697464, -0.03990354761481285, -0.09193573892116547, 0.08099571615457535, -0.05637053772807121, 0.00474610086530447, 0.023072320967912674, 0.017072685062885284, -0.02571311593055725, -0.02860821597278118, 0.05536089092493057, -0.03321214020252228, -0.09803418070077896, -0.03001151606440544, 0.05838136747479439, -0.017931567505002022, 0.026988981291651726, -0.049223680049180984, 0.0004946327535435557, -0.005886336788535118, 0.015550057403743267, 0.009358611889183521, 0.0406457744538784, -0.08526061475276947, -0.07333476096391678, 0.08230229467153549, -0.04109406843781471, 0.013074677437543869, 0.07873693108558655, -0.030786480754613876, 0.001154557103291154, -0.04943808540701866, 0.011750013567507267, -0.07324419170618057, 0.009780876338481903, 0.003956241067498922, 0.054074667394161224, 0.014415644109249115, 0.0007301185978576541, -0.07220565527677536, 0.055491749197244644, 0.09880691021680832, -0.06431848555803299, -0.03266837075352669, 0.06827405840158463, -0.01283957064151764, -0.05233696475625038, 0.022471053525805473, -0.020476100966334343, -0.12440691143274307, 0.020619921386241913, -0.08551812916994095, 0.013663736172020435, 0.06618136912584305, -0.06201754882931709, -0.02676643803715706, -0.023423099890351295 ] }, { "text": "[[0.03137252, 0.02352943, 0.02745099],\n [0.03137252, 0.02352943, 0.02745099],\n [0.03137252, 0.02352943, 0.02745099],\n ...,\n [0.23921566, 0.21960786, 0.14117649],\n [0.2235294 , 0.2039216 , 0.12549024],\n [0.20784311, 0.18823531, 0.10980393]],\n \n [[0.0352941 , 0.02745099, 0.03137254],\n [0.0352941 , 0.02745099, 0.03137254],\n [0.0352941 , 0.02745099, 0.03137254],\n ...,\n [0.24313724, 0.22352942, 0.14509807],\n [0.21568625, 0.19607846, 0.11764705],\n [0.19999996, 0.1803922 , 0.10196077]]])", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_15", "embedding": [ 0.06560623645782471, -0.04630981758236885, -0.007336944807320833, 0.0034463584888726473, -0.039196766912937164, -0.08422824740409851, 0.007347645238041878, -0.013348786160349846, 0.008675490505993366, 0.022120924666523933, 0.013884680345654488, -0.029017191380262375, 0.022854601964354515, -0.007910744287073612, -0.05182404816150665, -0.026245571672916412, -0.09940464049577713, -0.05973225459456444, -0.010832463391125202, -0.078558050096035, -0.032477933913469315, 0.07401187717914581, -0.007591777015477419, -0.03268512710928917, 0.08966799080371857, 0.061354875564575195, -0.0020269567612558603, 0.06343742460012436, -0.063039131462574, -0.044539473950862885, -0.01341614406555891, -0.0023177885450422764, -0.01122744008898735, -0.032286446541547775, 0.041129738092422485, -0.06025570631027222, 0.008590368553996086, 0.06746631115674973, 0.0797172486782074, 0.046388015151023865, 0.10246504098176956, 0.023840339854359627, 0.13534130156040192, -0.03838858753442764, 0.003938381094485521, -0.037813179194927216, -0.14122629165649414, -0.037662144750356674, 0.019384900107979774, -0.028958139941096306, -0.02180209569633007, 0.019966421648859978, 0.044463761150836945, 0.029301108792424202, -0.006934152916073799, -0.04921860992908478, -0.0029241377487778664, -0.12339601665735245, 0.0548902228474617, 0.0017508376622572541, -0.013379963114857674, 0.0625816211104393, -0.026732351630926132, -0.02953140065073967, 0.020457955077290535, 0.001018448849208653, -0.07306354492902756, -0.059923622757196426, 0.0359022319316864, 0.06267575174570084, 0.009565932676196098, 0.02443590760231018, -0.04341128468513489, -0.010498495772480965, -0.0008792956941761076, -0.014043421484529972, -0.022038262337446213, -0.010634622536599636, -0.015505933202803135, -0.010292386636137962, -0.05827710032463074, -0.05290522798895836, -0.031896136701107025, -0.06914250552654266, -0.05504694953560829, -0.012210069224238396, 0.028077250346541405, 0.0001912523730425164, 0.026395784690976143, -0.0014062997652217746, -0.05682636797428131, 0.03976048156619072, -0.11303669214248657, 0.0242869071662426, 0.014275018125772476, 0.07026156783103943, 0.06940746307373047, -0.00736456923186779, 0.012691580690443516, 0.03392000496387482, -0.006181919947266579, -0.05014743283390999, -0.03382711112499237, 0.011775980703532696, -0.014696046710014343, 0.020380856469273567, 0.02070370875298977, 0.015349973924458027, 0.034543029963970184, -0.025050710886716843, -0.01653769612312317, -0.0231921449303627, 0.02482284978032112, -0.010918286629021168, -0.01809738203883171, -0.036270398646593094, -0.055491164326667786, 0.047440238296985626, 0.0028113657608628273, 0.06731685996055603, 0.035899627953767776, 0.05375790596008301, -0.024735696613788605, 0.11252458393573761, -0.054565295577049255, 0.004452612716704607, -0.05693695694208145, 5.8777483626258654e-33, 0.021085156127810478, 0.013862598687410355, 0.08494509011507034, -0.06672059744596481, 0.0003498005971778184, 0.02320583164691925, -0.10225383937358856, -0.06977827847003937, -0.02262079156935215, 0.05040372163057327, -0.07527372986078262, 0.016389744356274605, -0.03652539476752281, 0.011338746175169945, -0.01747206598520279, -0.0759783461689949, 0.0696231946349144, 0.010033589787781239, -0.11655904352664948, -0.04591275006532669, -0.03071081079542637, -0.06808318197727203, 0.027736306190490723, 0.0031780684366822243, 0.001911155879497528, 0.053992655128240585, -0.012012947350740433, -0.013981704600155354, -0.07330462336540222, 0.024072913452982903, 0.0399620495736599, 0.15945078432559967, -0.12350641191005707, -0.03161981329321861, 0.021359017118811607, -0.03482462465763092, 0.05880521982908249, 0.08238013088703156, 0.03891539201140404, 0.023051248863339424, 0.015692099928855896, 0.029499348253011703, 0.02742823399603367, 0.01091444119811058, 0.074452705681324, 0.00509265623986721, 0.09253409504890442, 0.04152766615152359, -0.013109315186738968, 0.0016428973758593202, -0.09838561713695526, -0.019417276605963707, -0.04072674736380577, 0.020289946347475052, 0.016066132113337517, -0.0599525161087513, 0.060448143631219864, 0.03724724426865578, 0.04263754561543465, 0.02437259629368782, 0.014435363002121449, 0.04213036224246025, -0.007197612430900335, -0.03071466274559498, 0.036894235759973526, 0.010697332210838795, 0.025356626138091087, 0.04670621082186699, 0.020824698731303215, 0.11198816448450089, 0.045934680849313736, 0.030980857089161873, 0.0755889043211937, -0.03237469866871834, -0.030180316418409348, 0.01835041493177414, 0.04397685080766678, -0.029219545423984528, 0.00229192734695971, 0.04586900398135185, -0.025977585464715958, -0.017595699056982994, -0.06202971562743187, -0.16004253923892975, -0.012780789285898209, -0.026122046634554863, -0.016069473698735237, -0.02754289284348488, -0.007383327465504408, -0.08726006001234055, -0.15303049981594086, 0.021756332367658615, 0.04305686801671982, -0.05255943536758423, -0.16201554238796234, -7.73446556697867e-33, 0.023077193647623062, 0.11399316787719727, 0.11425747722387314, -9.766592120286077e-05, 0.02229338325560093, 0.00169640954118222, 0.04573342949151993, 0.02309238351881504, 0.05154979228973389, 0.0793679729104042, 0.07917674630880356, -0.005846037995070219, 0.0498712956905365, -0.011021578684449196, 0.028669491410255432, -0.00035668571945279837, 0.04737483710050583, 0.040945496410131454, -0.06395577639341354, -0.08922488242387772, -0.05658174678683281, 0.06333135068416595, -0.08011119812726974, 0.07007071375846863, -0.08546803891658783, 0.04863192141056061, 0.005661396775394678, -0.044784341007471085, -0.09753842651844025, 0.020651740953326225, -0.10874385386705399, -0.031060168519616127, -0.043045978993177414, 0.055220916867256165, -0.024567877873778343, 0.046822067350149155, 0.054520320147275925, 0.046459123492240906, -0.048400819301605225, -0.05649028718471527, 0.0320097990334034, -0.002576675498858094, -0.0321119986474514, -0.013179603964090347, -0.03512653708457947, -0.04557380825281143, 0.08908704668283463, -0.0019921676721423864, -0.08375851809978485, 0.04120101034641266, -0.020360948517918587, 0.05833486467599869, -0.08703222125768661, 0.0835653766989708, 0.011660410091280937, -0.009571990929543972, -0.016110500320792198, 0.006148889660835266, -0.014573149383068085, -0.09833317250013351, -0.019099833443760872, 0.05595315992832184, 0.08262592554092407, 0.039602603763341904, 0.054232120513916016, -0.03218541666865349, -0.09074769169092178, -0.03688706457614899, -0.032336000353097916, 0.023198310285806656, 0.013552488759160042, 0.027091100811958313, 0.011320961639285088, -0.07546232640743256, -0.014434807002544403, -0.05581110715866089, 0.028392579406499863, 0.02460688166320324, 0.014600944705307484, -0.016758600249886513, -0.0478985570371151, -0.018425624817609787, 0.0007526557892560959, 0.05451231822371483, 0.02275894582271576, -0.02661692164838314, -0.0052793086506426334, -0.04037419706583023, -0.024912381544709206, 0.010560340248048306, -0.011367633007466793, 0.03156420961022377, 0.04920411482453346, 0.00577731104567647, 0.024989863857626915, -5.7344653470181584e-08, -0.032683733850717545, 0.01400817558169365, -0.08145536482334137, 0.05965171381831169, 0.09082170575857162, 0.0036910942289978266, -0.012240653857588768, 0.03724370524287224, -0.05831059440970421, -0.06781748682260513, 0.06511937826871872, -0.061872225254774094, 0.01570211537182331, 0.01839977130293846, 0.014422362670302391, -0.019207611680030823, -0.028524767607450485, 0.06654638797044754, -0.03655494004487991, -0.09706451743841171, -0.004299340769648552, 0.07046390324831009, 0.0011197919957339764, 0.014847821556031704, -0.0694141685962677, 0.015566147863864899, -0.0007005691877566278, 0.014996382407844067, -0.011244180612266064, 0.045924168080091476, -0.08526261150836945, -0.07779300212860107, 0.0613621287047863, -0.0658232644200325, 0.015127495862543583, 0.06603729724884033, -0.034843459725379944, 0.016146665439009666, -0.037647537887096405, 0.02406744845211506, -0.0797022357583046, 0.01071622408926487, -0.03086123615503311, 0.05453157052397728, 0.03404918313026428, -0.020948322489857674, -0.06649995595216751, 0.02659568004310131, 0.09955275058746338, -0.03407154604792595, -0.033713988959789276, 0.05281965434551239, 0.03317577391862869, -0.05804598703980446, 0.029184401035308838, -0.011622448451817036, -0.09413406252861023, -0.008434966206550598, -0.08101000636816025, 0.0028211718890815973, 0.09347197413444519, -0.08207836002111435, -0.03876359760761261, -0.019350910559296608 ] }, { "text": "Use matplotlib imshow to show the image\n\n\n```python\nplt.imshow(image)\n```\n\n\n\n\n \n\n
\n \n
\n
\n\n\n\n**Summary:**\n\n- Load the image by using PIL\n- Turn it to Tensor\n- Change the shape\n- Visualize the image\n - Why are we using constant terms when we normalize the image?\n - What is squeeze?\n - Transpose the 3 dimensional numpy array.\n - How can we use clip?", "source": "2020-10-19-image-operations.md", "type": "markdown", "chunk_id": "2020-10-19-image-operations.md_16", "embedding": [ 0.0021585107315331697, -0.02542048692703247, -0.016310857608914375, -0.07884684205055237, 0.07591203600168228, -0.09345301985740662, -0.026614265516400337, -0.01036297157406807, 0.01678958535194397, -0.009163770824670792, 0.053900908678770065, 0.006946250330656767, -0.000988711486570537, 0.11072827130556107, -0.003630218794569373, 0.02235022746026516, -0.10075090825557709, 0.03205736726522446, -0.055891141295433044, -0.0318903774023056, 0.055585186928510666, -0.03748249262571335, -0.019645128399133682, -0.0480734184384346, 0.03727813810110092, 0.015355218201875687, 0.05780010297894478, 0.02897680550813675, 0.018458476290106773, 0.022169122472405434, 0.028939681127667427, -0.022288020700216293, 0.12084401398897171, -0.01849271170794964, -0.043586745858192444, 0.06648313999176025, -0.005032319109886885, -0.034532397985458374, -0.021809488534927368, 0.021183153614401817, 0.018091674894094467, 0.00843944400548935, 0.003304560435935855, -0.048410411924123764, -0.01933300867676735, 0.04341524466872215, -0.010619369335472584, -0.053864315152168274, 0.07637343555688858, -0.036535684019327164, -0.022227728739380836, -0.02291908860206604, -0.10470259934663773, 0.03166738152503967, 0.029567383229732513, -0.014546050690114498, 0.06862609088420868, -0.07481653243303299, 0.0013757968554273248, -0.09582632780075073, -0.028198713436722755, 0.05851127952337265, 0.002271805889904499, -0.004763293545693159, 0.08320733159780502, -0.054915592074394226, -0.013738392852246761, -0.07928121834993362, -0.016597097739577293, 0.011465795338153839, -0.07900305092334747, -0.04657973349094391, 0.0012602423084899783, -0.05029981955885887, -0.055296577513217926, -0.03787299245595932, 0.06293022632598877, -0.030143868178129196, -0.02245420776307583, 0.010368069633841515, -0.006999786011874676, 0.009770018979907036, 0.09000419080257416, 0.0027276158798485994, -0.035397306084632874, 0.06708802282810211, -0.04643338546156883, 0.03497906029224396, 0.04952485114336014, -0.011610683985054493, -0.001737767131999135, 0.011339164339005947, -0.12435726076364517, 0.10317965596914291, 0.08392153680324554, -0.045100484043359756, -0.030416442081332207, 0.0014324409421533346, -0.04559377580881119, 0.017333483323454857, 0.10751832276582718, -0.0835496336221695, 0.01717699132859707, 0.02247803658246994, 0.028593672439455986, 0.041686464101076126, 0.07062254846096039, 0.01297963596880436, 0.04086415097117424, 0.04197721183300018, 0.007987314835190773, -0.020852962508797646, -0.010484674014151096, 0.024065343663096428, 0.04461748152971268, 0.01231806818395853, -0.04956074804067612, 0.059159863740205765, -0.003091132268309593, -0.02902386523783207, 0.0029928614385426044, 0.07093716412782669, -0.016197292134165764, 0.08596653491258621, 0.023576980456709862, 0.011854501441121101, -0.08182977139949799, 4.8604707759784576e-33, -0.04531154781579971, 0.04182551056146622, -0.006074136588722467, 0.0015197849133983254, -0.0662630945444107, 0.034360747784376144, -0.021228846162557602, -0.10881698876619339, -0.028623059391975403, 0.0056868200190365314, -0.009236546233296394, 0.07995636761188507, 0.006040981505066156, 0.0809706300497055, -0.014947020448744297, -0.09117252379655838, 0.02388705313205719, 0.0637117549777031, -0.001859266427345574, 0.05583702400326729, -0.015913886949419975, 0.01317688636481762, -0.002623385051265359, 0.053879618644714355, -0.08241159468889236, -0.10703395307064056, -0.08157823234796524, 0.008985071443021297, 0.06477963179349899, -0.003247816814109683, -0.03888482227921486, 0.0159296952188015, -0.006019886117428541, -0.06933113187551498, -0.04647928103804588, -0.016903547570109367, 0.02482457458972931, 0.0021170300897210836, -0.06930218636989594, 0.013391836546361446, -0.011134106665849686, 0.019392017275094986, 0.02018124796450138, -0.005476666614413261, -0.04903225600719452, 0.014088929630815983, 0.018166866153478622, 0.1442701667547226, -0.0635041743516922, -0.0001400013716192916, 0.006272161845117807, -0.06244173273444176, -0.0029744894709438086, -0.02466558665037155, -0.01441790722310543, -0.056715987622737885, 0.034652628004550934, -0.05264722928404808, -0.023245228454470634, -0.04409226030111313, 0.01965068280696869, -0.009012970142066479, 0.05581871420145035, 0.06000661104917526, 0.012224972248077393, 0.025412900373339653, 0.002340003615245223, 0.052750732749700546, -0.05750244855880737, 0.165452241897583, -0.1325647085905075, 0.1265583634376526, -0.04758638143539429, -0.006965082138776779, -0.0010245771845802665, -0.026654541492462158, 0.037053633481264114, -0.0026564965955913067, -0.09106477349996567, 0.03680931404232979, -0.08258531987667084, 0.03646701201796532, 0.03801586106419563, -0.13904836773872375, -0.13047584891319275, 0.007378728594630957, 0.10139130800962448, -0.012615488842129707, -0.03158828243613243, -0.13292473554611206, -0.04590887203812599, 0.021488899365067482, 0.00884944386780262, 0.06154167652130127, -0.0595024898648262, -5.3365393759057606e-33, 0.05527041479945183, 0.061035167425870895, -0.006726366933435202, 0.03451764956116676, -0.042969949543476105, 0.010172289796173573, 0.031597886234521866, 0.03496400639414787, -0.04806692898273468, -0.047062650322914124, -0.0005275820731185377, -0.04957989230751991, -0.04781220480799675, -0.10093069076538086, 0.031084982678294182, -0.037297215312719345, -0.032179735600948334, -0.008633466437458992, -0.07157620787620544, -0.0285129826515913, -0.05595700442790985, 0.043718233704566956, 0.0010358943836763501, 0.00520593486726284, -0.1226421445608139, 0.0829838216304779, -0.06066156178712845, -0.06103730946779251, -0.06284047663211823, -0.010167393833398819, -0.07947883754968643, -0.030580194666981697, -0.04932752624154091, 0.002166546881198883, 0.020674698054790497, 0.04601477459073067, -0.014564801007509232, -0.0146752605214715, 0.010974367149174213, -0.03359057381749153, 0.014038190245628357, 0.07911676913499832, -0.043932151049375534, 0.06089634820818901, -0.06978403776884079, 0.017141634598374367, 0.0546104833483696, 0.054693832993507385, 0.03142157569527626, 0.03475368395447731, -0.030149009078741074, -0.013414597138762474, 0.08165065199136734, 0.019984213635325432, 0.00877958070486784, 0.02430601604282856, -0.08915022015571594, -0.008701762184500694, 0.02338380180299282, -0.005440507084131241, -0.06273923814296722, -0.051247913390398026, -0.054188698530197144, -0.009633406065404415, -0.016286175698041916, 0.005514329299330711, -0.04599420726299286, -0.025450285524129868, 0.028755052015185356, 0.07119617611169815, 0.04302595928311348, 0.07516348361968994, 0.0972638726234436, -0.0011427922872826457, -0.008235788904130459, -0.07816917449235916, -0.005716229323297739, 0.03341713920235634, -0.04098187014460564, 0.026462266221642494, 0.06113814562559128, -0.04688475281000137, 0.04256466403603554, 0.0369601733982563, -0.004126931075006723, 0.03290150314569473, 0.0003905532357748598, -0.0032141078263521194, 0.080553337931633, -0.03029066137969494, -0.005675466265529394, -0.03445134311914444, 0.027968503534793854, 0.062489867210388184, 0.08541058003902435, -5.3175430281271474e-08, 0.02846687287092209, -0.003741440363228321, 0.01185807678848505, -0.022695139050483704, -0.021695898845791817, 0.03995489701628685, 0.04522255063056946, 0.0037032978143543005, 0.024921514093875885, 0.048857301473617554, 0.007049900479614735, -0.040631286799907684, -0.07758117467164993, 0.020458156242966652, -0.05116370692849159, 0.10090748965740204, -0.010795939713716507, 0.0014124292647466063, 0.09261060506105423, 0.034674905240535736, -0.06264499574899673, -0.10204288363456726, -0.013749184086918831, 0.06057772785425186, -0.10040826350450516, -0.012147262692451477, -0.057549841701984406, 0.03764115646481514, 0.02593984268605709, 0.015765169635415077, 0.030909625813364983, -0.0352385975420475, 0.07934273034334183, 0.01696198061108589, 0.011930355802178383, 0.0004877421597484499, -0.08757264167070389, -0.038592055439949036, -0.035660818219184875, 0.09465406835079193, -0.034567996859550476, 0.023901186883449554, 0.13744387030601501, -0.041870806366205215, 0.029553275555372238, 0.02291412279009819, 0.06965988129377365, -0.036853741854429245, -0.006710924208164215, 0.03569444268941879, 0.048143964260816574, 0.05394679307937622, 0.0044195326045155525, 0.07974383980035782, 0.06716343760490417, -0.06408710032701492, -0.001912351930513978, 0.04691021144390106, 0.03950278088450432, 0.06882109493017197, -0.01980430632829666, -0.041625216603279114, 0.015470013953745365, -0.0671636164188385 ] }, { "text": "---\ntitle: \"Motion Classifier with Edge Impulse\"\nid: \"edge-motion\"\ncategory: \"edge-ml\"\ntags: [\"edge machine learning\", \"arduino\", \"motion\", \"classification\", \"tensorflow\"]\nrelated: [\"arduinodeploy\"]\ndate: \"2021-01-01\"\ndescription: \"A motion classifier project with Edge Impulse & Arduino\"\n---\n\n\nHello! Happy new year everyone:) On the very first day of the year, I completed a motion classifier project with Edge Impulse & Arduino. \nI would like to tell you the steps of the project, some problems I've faced with and how to solve them.\n\nI would like to thank Coursera and Edge Impulse to give us a chance to learn embedded machine learning. \nFind more about the lecture: [Coursera](https://www.coursera.org/learn/introduction-to-embedded-machine-learning)", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_0", "embedding": [ -0.10880014300346375, -0.06108758598566055, -0.02384859509766102, -0.040011607110500336, 0.01803748868405819, -0.04443839192390442, -0.049208998680114746, -0.04500538855791092, -0.1399608701467514, -0.020919183269143105, 0.030012691393494606, -0.02793857268989086, -0.04076949134469032, -0.020732900127768517, -0.05547022446990013, 0.0718165934085846, 0.03804876282811165, 0.03738095983862877, -0.031933002173900604, 0.038297683000564575, 0.030305033549666405, -0.013503982685506344, 0.012855242937803268, -0.024875104427337646, -0.008984144777059555, 0.0854712426662445, 0.02643698826432228, 0.042168665677309036, 0.05297473818063736, -0.08699704706668854, 0.09577690064907074, 0.0331776961684227, 0.0523221381008625, 0.03993000462651253, 0.004904926288872957, 0.030234798789024353, -0.01753496378660202, -0.024930035695433617, -0.03368913009762764, 0.0018823078135028481, 0.00020681406022049487, -0.004483718890696764, 0.004889017902314663, -0.05626200884580612, 0.11630845069885254, 0.06845706701278687, 0.022709114477038383, -0.08629675954580307, -0.004036326427012682, 0.00460355868563056, -0.05950357764959335, -0.09083551913499832, -0.0637848898768425, -0.029577331617474556, -0.08342619985342026, -0.03661341220140457, 0.014888755977153778, 0.010528014041483402, 0.040465448051691055, 0.007617518771439791, 0.04121479019522667, -0.01555070374161005, -0.007321891840547323, 0.02111012674868107, -0.06338682025671005, 0.0020697712898254395, 0.018131611868739128, 0.07338215410709381, 0.01554561872035265, -0.009610549546778202, 0.0374470129609108, -0.029245803132653236, -0.016458699479699135, 0.022520434111356735, 0.014270258136093616, -0.06447421759366989, 0.026624929159879684, 0.018700096756219864, -0.02832937054336071, -0.04180847108364105, -0.024401243776082993, -0.12242855131626129, -0.0870526060461998, 0.02582383342087269, 0.04336763545870781, 0.03010842576622963, -0.02738381177186966, 0.07624118775129318, -0.05095314607024193, -0.013261206448078156, 0.04935423284769058, -0.05309562012553215, -0.026379473507404327, -0.03370653837919235, 0.13251753151416779, 0.033343251794576645, -0.09064304828643799, -0.08407539874315262, 0.014264583587646484, 0.05549204722046852, -0.1204364076256752, -0.09991781413555145, -0.0721328854560852, 0.033433668315410614, -0.07094171643257141, 0.02453616075217724, 0.01461212057620287, 0.06726552546024323, 0.10478611290454865, 0.005122588947415352, 0.005531562492251396, -0.006525547243654728, -0.04645178094506264, -0.038285546004772186, 0.00011478766828076914, -0.05551856383681297, -0.019866526126861572, -0.0019015257712453604, 0.12867644429206848, -0.047884393483400345, -0.04713877663016319, 0.0384635403752327, -0.03470725938677788, -0.0060514966025948524, 0.011246759444475174, -0.09582654386758804, -0.08558672666549683, 2.19062390521456e-33, 0.030401339754462242, 0.027336787432432175, 0.0012497197603806853, -0.04227963835000992, 0.06512870639562607, -0.021277636289596558, 0.008210595697164536, 0.013154515996575356, -0.021682823076844215, 0.04156546667218208, -0.027058210223913193, -0.037077803164720535, 0.008392234332859516, 0.04621269926428795, -0.01986059546470642, -0.10152658820152283, -0.013632156886160374, -0.08931267261505127, -0.008971341885626316, 0.013122927397489548, 0.0864647924900055, 0.023915695026516914, -0.022050481289625168, 0.03491980582475662, -0.058493345975875854, 0.1217551901936531, 0.04444437101483345, -0.011160800233483315, 0.10090669989585876, 0.03517797961831093, -0.05958525463938713, -0.021055404096841812, -0.06922157853841782, 0.005250372923910618, 0.025041330605745316, 0.09074638038873672, -0.02245248295366764, -0.025419319048523903, -0.04754725843667984, -0.055583417415618896, 0.003973929211497307, 0.018493928015232086, -0.005143528338521719, -0.1064910739660263, -0.06409858167171478, -0.03480314835906029, 0.11556706577539444, 0.021210411563515663, 0.042670976370573044, 0.047260966151952744, -0.052402399480342865, -0.06987937539815903, 0.03356862813234329, -0.05876018851995468, -0.0017479154048487544, -0.002444120589643717, -0.02856314554810524, 0.06934124231338501, 0.012975838966667652, 0.0001456727768527344, 0.016645723953843117, -0.006200085859745741, 0.018753211945295334, -0.03604608401656151, -0.006818728055804968, 0.03475312143564224, -0.049250438809394836, 0.0627128928899765, 0.10348283499479294, -0.055424582213163376, -0.03629474714398384, 0.0026730436366051435, -0.013810916803777218, -0.018271872773766518, 0.037201810628175735, -0.010792967863380909, -0.04585853964090347, -0.007025642320513725, -0.0414588637650013, -0.005314419977366924, -0.1096748560667038, -0.00034391129156574607, 0.08754383027553558, -0.07527822256088257, 0.0029831663705408573, 0.05421476811170578, 0.004663681145757437, -0.04402337595820427, -0.01613634079694748, 0.07875829190015793, -0.021457184106111526, 0.015244399197399616, -0.045817770063877106, 0.11530350148677826, 0.005439988803118467, -4.110994679677368e-33, 0.0361027792096138, 0.09340201318264008, -0.0028275942895561457, 0.07187993079423904, 0.014349100179970264, 0.03104667365550995, -0.021516552194952965, 0.028633886948227882, 0.014013713225722313, 0.027158360928297043, -0.0416853129863739, 0.003144096350297332, -0.0007787086069583893, -0.022702857851982117, -0.01537853293120861, -0.010076609440147877, -0.006585713475942612, -0.07493726164102554, -0.027145886793732643, 0.01944712921977043, -0.04959586635231972, 0.1623193621635437, -0.04486415535211563, -0.05883590877056122, 0.012485412880778313, 0.01567111536860466, 0.04546400159597397, 0.09447745978832245, 0.03933626413345337, -0.029838595539331436, 0.03732970729470253, -0.04751018062233925, -0.09517446160316467, -0.030868634581565857, -0.004181738942861557, 0.06966378539800644, 0.040850378572940826, -0.03199794515967369, -0.020862065255641937, -0.0144727174192667, 0.05841236189007759, 0.00465807318687439, -0.07466339319944382, -0.01821034774184227, 0.03972747176885605, 0.02066616527736187, -0.020870128646492958, 0.10535158962011337, -0.06891250610351562, -0.03826795890927315, -0.04339132457971573, 0.012556728906929493, -0.020112767815589905, -0.048641007393598557, 0.048044826835393906, -0.015474045649170876, 0.13000817596912384, 0.02727874182164669, -0.011890645138919353, 0.023178117349743843, -0.019838431850075722, -0.03896232321858406, -0.016888735815882683, 0.005823200568556786, 0.008232325315475464, 0.04282394051551819, -0.030997056514024734, -0.019747963175177574, -0.05930766835808754, 0.03793903812766075, -0.043187063187360764, 0.1226501539349556, -0.035745929926633835, -0.021780643612146378, -0.0035601321142166853, -0.05693728104233742, -0.011102312244474888, 0.0393386110663414, 0.048463787883520126, -0.07020436972379684, -0.000870336836669594, -0.019447099417448044, -0.012966830283403397, 0.10960158705711365, -0.04082240164279938, 0.0653623715043068, 0.0059395432472229, -0.017347561195492744, -0.006425478495657444, -0.01676737330853939, -0.061254967004060745, 0.04740138351917267, 0.03616887703537941, 0.06620637327432632, -0.061271943151950836, -5.331668972985426e-08, -0.0958888903260231, 0.05162753537297249, -0.00988250132650137, -0.036683350801467896, 0.03950348496437073, 0.028907494619488716, -0.008188371546566486, 0.06855493038892746, 0.011866437271237373, -0.03114430606365204, 0.06431464105844498, -0.051714301109313965, -0.0443192757666111, 0.05028805881738663, -0.01827586069703102, 0.04753789305686951, -0.02463575080037117, 0.05706118792295456, 0.012342676520347595, 0.0076058912090957165, 0.10352645814418793, -0.053609609603881836, 0.048786766827106476, 0.005666953977197409, 0.019037500023841858, -0.09350637346506119, 0.010829481296241283, -0.0005317017203196883, 0.03358187526464462, 0.0022000321187078953, -0.11831034719944, 0.05178041011095047, 0.07197517156600952, -0.06611726433038712, 0.007596260402351618, 0.004778190515935421, 0.0314931645989418, -0.026507757604122162, 0.014870960265398026, 0.05776968598365784, 0.001272487686946988, 0.08225198835134506, -0.02593817748129368, -0.020845768973231316, -0.012406839057803154, 0.005105103366076946, 0.014837946742773056, -0.10078249126672745, -0.04039645195007324, 0.05482540652155876, 0.05145967751741409, 0.015159917995333672, -0.03214822709560394, 0.09478355944156647, 0.09146744757890701, 0.048379961401224136, 0.01297392975538969, -0.11204297840595245, 0.00827236007899046, 0.044191621243953705, 0.023838678374886513, -0.004598729312419891, -0.08968408405780792, 0.07810988277196884 ] }, { "text": "### 1. Connection\n\nAfter creating a new project on Edge Impulse, I plugged in my Arduino board to my laptop, \nthen **update the firmware** ---> this is very important do not skip this step. \n\nThen I open the command prompt and write:\n\n edge-impulse-daemon --clean\n\nI can connect my Arduino board with my new project in Edge Impulse. Go back to your project on the Edge Impulse website \nand check if the Arduino is connected. If you encountered with a problem, you can read my previous [post](https://pelinbalci.com/tinyml/2021/11/22/Arduino-Edge-Impulse.html)", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_1", "embedding": [ -0.04614880681037903, -0.057193461805582047, -0.0257410891354084, -0.028201285749673843, -0.007774537894874811, -0.07527169585227966, -0.056873515248298645, -0.011738980188965797, -0.08011945337057114, 0.008336837403476238, 0.10361645370721817, -0.012979602441191673, -0.06109306588768959, 0.025162775069475174, -0.019813721999526024, 0.07979455590248108, 0.03103412128984928, -0.09859183430671692, 0.05115818232297897, 0.014678611420094967, -0.027523215860128403, -0.07910304516553879, -0.03284002095460892, -0.0689287930727005, 0.06946523487567902, -0.014148017391562462, 0.07172901928424835, 0.05715012177824974, -0.006096798460930586, -0.031897854059934616, 0.09150005877017975, 0.017312174662947655, 0.07969185709953308, -1.3562757885665633e-05, 0.0975860059261322, 0.023645464330911636, 0.01786506548523903, 0.02626645378768444, 0.01765267178416252, -0.06280699372291565, 0.027836084365844727, -0.03885086625814438, -0.028069665655493736, -0.012256480753421783, 0.052800267934799194, 0.03522038087248802, -0.008208220824599266, -0.01663726568222046, 0.035803329199552536, -0.050690434873104095, 0.0077973403967916965, -0.019287142902612686, -0.05070236325263977, -0.06525719165802002, -0.03885982930660248, -0.004753402899950743, 0.017191797494888306, 0.08993781358003616, 0.047946132719516754, -0.032839495688676834, 0.0038028392009437084, -0.018741682171821594, 0.011340231634676456, -0.028131987899541855, -0.10108358412981033, 0.04379086196422577, 0.05844370275735855, 0.04567806422710419, -0.08822324126958847, 0.028162043541669846, 0.11445615440607071, 0.06454434990882874, -0.07593201100826263, -0.02933354489505291, 0.010467380285263062, -0.01828012801706791, 0.04275704547762871, 0.01072278805077076, -0.06076974421739578, 0.0022803295869380236, -0.04879036918282509, -0.07874946296215057, -0.039769645780324936, 0.054574765264987946, 0.008567274548113346, 0.08993040770292282, -0.05459803342819214, 0.037125688046216965, -0.05542216822504997, -0.025718525052070618, 0.03200102224946022, -0.011900132521986961, -0.024466536939144135, 0.0037799242418259382, -0.0005735335289500654, 0.09346047043800354, -0.00958078820258379, -0.04543323442339897, -0.08882344514131546, 0.004709761124104261, -0.0931771770119667, -0.08506549894809723, -0.04778904840350151, 0.0021418798714876175, -0.03494837507605553, -0.013295616023242474, 0.006607605144381523, 0.034422412514686584, 0.06923459470272064, -0.029274052008986473, 0.030997566878795624, 0.0012742920080199838, -0.037293560802936554, 0.006752649787813425, -0.03733197972178459, -0.03777732700109482, -0.07596241682767868, 0.0256593506783247, 0.038248252123594284, -0.10599717497825623, -0.032811205834150314, 0.0858849585056305, -0.04698806628584862, -0.0275427158921957, -0.012111317366361618, 0.00826692208647728, -0.025650186464190483, -5.927563884668295e-34, 0.06246095523238182, -0.018851762637495995, -0.04075499624013901, -0.039029575884342194, -0.002394764218479395, -0.05314050242304802, 0.019194453954696655, 0.007736807689070702, -0.005486856680363417, 0.00585471885278821, -0.1091284528374672, -0.09502170979976654, 0.024797774851322174, -0.014444902539253235, -0.06081782653927803, -0.08463740348815918, 0.0335201770067215, -0.05922107771039009, 0.009957216680049896, 0.03610954061150551, 0.05944859981536865, -0.0005027370643801987, -0.019513092935085297, 0.016428856179118156, -0.031791482120752335, 0.10418978333473206, 0.006356879137456417, 0.06033289432525635, 0.1594611555337906, 0.04596824198961258, -0.06604830920696259, 0.04474301636219025, -0.022333331406116486, -0.03731311485171318, -0.03400466591119766, 0.048221807926893234, -0.04937536269426346, -0.005297506228089333, -0.056430231779813766, -0.002606185618788004, 0.06063952296972275, 0.01862551085650921, -0.08318427950143814, -0.0572565458714962, -0.018653864040970802, -0.09742160886526108, 0.026894237846136093, -0.003139182459563017, 0.03864553943276405, 0.05719370022416115, -0.09937413036823273, -0.055440351366996765, 0.11701913177967072, 0.015898041427135468, -0.011947959661483765, -0.004018676467239857, -0.06396641582250595, 0.07738903909921646, 0.04840967804193497, -0.02166406251490116, 0.14847558736801147, -0.05637732893228531, -0.022476080805063248, -0.016756104305386543, 0.06905253231525421, 0.1076069176197052, -0.0343741774559021, 0.07231232523918152, 0.07598839700222015, -0.01946123316884041, -0.08173328638076782, 0.00752982497215271, -0.004210653714835644, 0.007758186664432287, -0.030810842290520668, -0.03791574016213417, -0.06678543239831924, 0.06793181598186493, 0.0033709409181028605, -0.03484079986810684, -0.01895393803715706, -0.028569532558321953, 0.06648167967796326, -0.025963010266423225, 0.06599968671798706, 0.08800972998142242, 0.016380151733756065, -0.003742094850167632, -0.0050346036441624165, 0.09907187521457672, 0.010905953124165535, 0.006906801834702492, -0.03971708193421364, 0.10543088614940643, -0.004925885703414679, -1.2501993127044478e-33, -0.010102021507918835, 0.0325808972120285, 0.023647820577025414, 0.021578216925263405, -0.040553320199251175, 0.03087451122701168, 0.014211677014827728, -0.017021145671606064, -0.07125803083181381, 0.007957140915095806, 0.02049981616437435, 0.0694795623421669, -0.04429178312420845, -0.07195313274860382, -0.017707042396068573, -0.014576603658497334, -0.010888515040278435, -0.058463480323553085, 0.0012742419494315982, 0.0018932363018393517, -0.048037488013505936, 0.015211425721645355, 0.049527041614055634, -0.03663548454642296, -0.03601808845996857, -0.005951493512839079, 0.03021160699427128, 0.022506240755319595, 0.03402793034911156, -0.008425386622548103, 0.10873435437679291, 0.035133808851242065, -0.06014542281627655, -0.04535400867462158, 0.02710997872054577, 0.06959745287895203, 0.00449841283261776, -0.015754202380776405, 0.017439432442188263, -0.10473611950874329, 0.021094199270009995, -0.015299794264137745, -0.053205281496047974, 0.006635185331106186, 0.06381822377443314, 0.03085259348154068, -0.01951555348932743, -0.003237223019823432, -0.11505649983882904, -0.061416346579790115, -0.05664464086294174, 0.0688953623175621, 0.040627460926771164, 0.007220488507300615, 0.03480301797389984, -0.007314496673643589, 0.10183881223201752, 0.06444051116704941, -0.027059677988290787, -0.015547188930213451, -0.012945685535669327, -0.06384547054767609, -0.03669123724102974, 0.02084093540906906, 0.030161498114466667, 0.06299909204244614, -0.011759815737605095, 0.0003623236552812159, 0.004256217274814844, 0.018819905817508698, -0.08192328363656998, 0.08814626932144165, -0.0006069712108001113, -0.0068678236566483974, -0.038013800978660583, -0.042250920087099075, -0.08879736810922623, -0.051829367876052856, 0.029258333146572113, 0.05584891140460968, -0.004800929222255945, 0.05045970156788826, -0.08124129474163055, 0.02215535193681717, -0.09298967570066452, 0.0023655560798943043, 0.04372105002403259, 0.03641404211521149, 0.0016686131712049246, -0.06916140019893646, -0.10842476040124893, -0.039428502321243286, -0.0427839495241642, 0.13292130827903748, -0.063343845307827, -4.8945043573667135e-08, -0.031120849773287773, 0.11227290332317352, 0.0017084483988583088, 0.012274028733372688, 0.0534202978014946, 0.005539807491004467, -0.009919780306518078, 0.013429323211312294, 0.007225945591926575, -0.0172579362988472, -0.056860510259866714, -0.029874201864004135, -0.038822390139102936, 0.11069851368665695, 0.024101804941892624, -0.009185255505144596, 0.009046459570527077, 0.017261719331145287, 0.07335466891527176, -0.014277542941272259, 0.059597548097372055, -0.010542476549744606, 0.017933771014213562, 0.021694157272577286, 0.05183491110801697, -0.023622754961252213, 0.01604025810956955, 0.007592306938022375, -0.011840781196951866, -0.02991597168147564, -0.06336894631385803, 0.03288690000772476, 0.06377021223306656, 0.02085215412080288, -0.056589655578136444, 0.03178224340081215, -0.022308791056275368, 0.06582862883806229, 0.09092802554368973, 0.024707244709134102, 0.07435133308172226, 0.0867081731557846, -0.02944369800388813, -0.05764200910925865, -0.06249738112092018, 0.02387048676609993, 0.037921980023384094, 0.0781073346734047, -0.03472251817584038, 0.02164597623050213, 0.06581971794366837, -0.006311281584203243, -0.018092431128025055, -0.030965587124228477, 0.030053362250328064, -0.005736732855439186, -0.03684379160404205, -0.08346454054117203, 0.031556420028209686, -0.005617426708340645, 0.12255169451236725, -0.06456515938043594, -0.06737978756427765, 0.032909441739320755 ] }, { "text": "### 2. Collect Data\n\nThis is the funny part. You need to choose an item in your home that you can collect motion data. \nI wish to have a remote-controlled car :( Anyway, I decided to use my hairdryer and taped the board to the hairdryer \nas you can see below.\n\n--\n\n
\n \n
Setup
\n
\n\n--\n\nSelect Data- Acquisition, write the label name, and start sampling! There are 4 classes in my project, off, light, light_move, and heavy.\n\n off: not working\n light: working in mode 1\n light_move: working in mode 1 and waving\n heavy: working in mode 2\n\nHere is a short video of the collecting data process:\n\n--", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_2", "embedding": [ -0.024826621636748314, -0.001492455368861556, 0.0257940124720335, 0.03477226197719574, 0.09632567316293716, 0.019170038402080536, 0.026313280686736107, 0.03960632532835007, 0.025355951860547066, -0.024631598964333534, 0.09837600588798523, -0.007597035728394985, -0.012970312498509884, 0.0072975740768015385, 0.04806511849164963, 0.06453029066324234, 0.02178867720067501, 0.025367336347699165, -0.0700230747461319, 0.04452268406748772, 0.050846219062805176, -0.06890281289815903, 0.10180949419736862, -0.010794783011078835, -0.0046524107456207275, 0.03940350189805031, 0.04843606427311897, 0.0007182167028076947, -0.00472377659752965, -0.09375125914812088, 0.07872431725263596, 0.02951112948358059, -0.07199198752641678, -0.01674572192132473, 0.04137948527932167, -7.936875044833869e-05, 0.012941219843924046, -0.021095003932714462, -0.02192254550755024, 0.00582741666585207, 0.03436188027262688, -0.060176972299814224, 0.06249170005321503, -0.013708295300602913, -0.018228866159915924, 0.05341900512576103, 0.08068250119686127, -0.03418421000242233, 0.03818487003445625, 0.04359445720911026, -0.03734831139445305, -0.03191261738538742, 0.04606515169143677, 0.0017818418564274907, -0.04496919363737106, 0.019542960450053215, 0.0935809388756752, -0.07569871842861176, 0.06326831132173538, -0.03545084223151207, 0.03653166815638542, 0.0019057135796174407, 0.003937998786568642, -0.06536245346069336, 0.00560419075191021, -0.013631281442940235, -0.0614703968167305, 0.08433341979980469, 0.01395855937153101, -0.042062390595674515, -0.04954154044389725, 0.022699961438775063, 0.044962260872125626, 0.06508976966142654, -0.015365236438810825, -0.11961009353399277, -0.10009977221488953, -0.045693669468164444, -0.015244769863784313, -0.06974638998508453, 0.017713187262415886, -0.09980206936597824, -0.034486960619688034, 0.11738092452287674, 0.05615516006946564, 0.04670443385839462, 0.034090396016836166, 0.09248735755681992, -0.012817789800465107, -0.0025495823938399553, -0.13978765904903412, 0.04815028980374336, -0.010378816165030003, 0.02451498806476593, -0.051257673650979996, 0.00404460821300745, -0.024808557704091072, -0.021778834983706474, 0.02022315375506878, 0.04505711421370506, 0.023107999935746193, -0.020705722272396088, 0.025269733741879463, 0.05503023415803909, -0.06855858117341995, -0.09823808819055557, -0.04032446816563606, 0.026126202195882797, 0.012054555118083954, 0.02986897900700569, 0.00593874417245388, 0.027189170941710472, -0.11586157977581024, 0.001493158983066678, 0.022458504885435104, -0.0049372282810509205, -0.008412906900048256, -0.011987967416644096, -0.041190337389707565, 0.008724876679480076, 0.10528949648141861, 0.01416002120822668, -0.05189424380660057, 0.05679718032479286, 0.09072330594062805, -0.03711887449026108, 0.010019432753324509, 7.692706130165708e-33, 0.08197292685508728, -0.02186555415391922, -0.009431683458387852, 0.03657819330692291, 0.04309520125389099, 0.0013168035075068474, -0.009263390675187111, 0.02130989544093609, -0.01553643774241209, 0.06612712889909744, 0.047977421432733536, 0.06523969769477844, -0.012323343195021152, 0.005466324742883444, 0.009462709538638592, -0.06259962171316147, 0.0005909695173613727, -0.002366535598412156, 0.02042263001203537, -0.0003303186967968941, -0.04848432540893555, -0.042232315987348557, 0.03370235115289688, 0.0013009661342948675, 0.03184022009372711, 0.05637097731232643, -0.01405945885926485, 0.09581867605447769, 0.07346057146787643, 0.003739811247214675, 0.08140727877616882, -0.03781748190522194, 0.03409593552350998, -0.0004822334449272603, -0.0048634991981089115, -0.007519205566495657, -0.050555068999528885, -0.01947515271604061, -0.03969960659742355, -0.0011355829192325473, 0.015338687226176262, -0.002906528767198324, 0.014388740994036198, -0.012114563956856728, -0.0927046537399292, -0.01632823422551155, 0.012841521762311459, 0.012036934494972229, -0.05669071152806282, 0.020877446979284286, 0.012780328281223774, -0.07715456932783127, -0.08473874628543854, -0.05883297696709633, 0.038007814437150955, -0.024084722623229027, -0.049748603254556656, -0.003440359840169549, -0.01278188917785883, 0.008502225391566753, 0.016271289438009262, 0.11729149520397186, 0.04064955189824104, -0.022764742374420166, 0.04414337873458862, 0.03463471680879593, 0.06951628625392914, -0.012591654434800148, 0.0407954677939415, -0.0560835562646389, -0.031893059611320496, -0.026343444362282753, 0.04912406578660011, -0.018849845975637436, 0.11727958917617798, 0.02375565655529499, -0.07034289091825485, -0.03823939338326454, -0.117948018014431, 0.031049197539687157, -0.011937043629586697, -0.06513059139251709, 0.02253897488117218, 0.006393431685864925, -0.014257663860917091, -0.04010280966758728, -0.03342993184924126, -0.050851985812187195, -0.09363461285829544, 0.03969116136431694, -0.03489626571536064, 0.030099788680672646, -0.09292390197515488, -0.028097497299313545, -0.04710935056209564, -6.93177998420364e-33, 0.06034194678068161, 0.06404324620962143, 0.017016125842928886, 0.07139867544174194, 0.08002312481403351, 0.03264891728758812, 0.024395832791924477, -0.051249127835035324, 0.017696045339107513, 0.029838958755135536, -0.03846222162246704, -0.04183799400925636, -0.11246447265148163, -0.07006838172674179, 0.008218970149755478, 0.03569933772087097, -0.05211922153830528, -0.05429067462682724, -0.03847725689411163, -0.0011429035803303123, -0.06561972945928574, 0.08868903666734695, 0.03497108444571495, 0.06453720480203629, -0.08843405544757843, 0.05292244255542755, 0.03850680962204933, 0.0239942017942667, 0.03586520627140999, -0.02739749662578106, -0.059012074023485184, -0.08398900181055069, 0.018669484183192253, -0.054704271256923676, -0.04153863713145256, 0.014910307712852955, 0.04299726337194443, 0.03935921937227249, -0.04014456272125244, -0.04096255451440811, 0.03976122662425041, -0.059990983456373215, -0.08275248110294342, -0.03209330514073372, -0.09230893105268478, -0.08477718383073807, -0.05382664129137993, 0.06099032238125801, -0.020449219271540642, 0.0513644814491272, 0.012361533008515835, -0.024480827152729034, -0.06501403450965881, 0.018018506467342377, 0.06414977461099625, 0.04564807936549187, 0.07336536794900894, -0.009622563607990742, -0.0370665080845356, 0.11532522737979889, -0.010849734768271446, -0.0731196254491806, -0.06839682906866074, 0.02327861823141575, -0.024036908522248268, -0.06280104070901871, -0.01577381044626236, -0.052218761295080185, 0.03410233557224274, 0.05046262592077255, 0.005651559680700302, 0.07739123702049255, 0.11982396245002747, -0.054235752671957016, 0.01742084138095379, -0.00858091190457344, -0.03817179426550865, -0.019290534779429436, 0.012331959791481495, -0.031197864562273026, -0.013005022890865803, -0.026217162609100342, -0.0066665587946772575, 0.020269256085157394, 0.08141646534204483, 0.002771456725895405, -0.05803680792450905, -0.009203817695379257, 0.04882233589887619, -0.038640961050987244, -0.010263790376484394, 0.046247582882642746, 0.13212627172470093, 0.06268470734357834, 0.010776328854262829, -5.7993172930537185e-08, -0.061716560274362564, 0.021354664117097855, 0.047495223581790924, -0.03221618011593819, -0.038368482142686844, 0.007841285318136215, -0.013948535546660423, 0.029979843646287918, -0.01777624525129795, -0.0339985229074955, 0.10027016699314117, -0.018779369071125984, 0.06216392666101456, 0.044281940907239914, 0.003461901331320405, -0.0147966668009758, 0.1334671676158905, 0.05513061210513115, -0.0314575619995594, 0.03599720075726509, -0.008507424965500832, -0.04552517086267471, -0.0009895284892991185, -0.0194841455668211, 0.04312834516167641, -0.01573784276843071, -0.02629036270081997, 0.03606933727860451, 0.05251191928982735, -0.019124159589409828, 0.04812013357877731, -0.012727554887533188, 0.014425801113247871, 0.02476828172802925, -0.05267206206917763, -0.09286049008369446, -0.10211918503046036, -0.04645327478647232, -0.009947584010660648, 0.0046661472879350185, -0.03474903479218483, -0.03020557574927807, -0.1653769165277481, 0.021645033732056618, 0.057210683822631836, -0.009592579677700996, 0.013073508627712727, -0.16448722779750824, -0.0573699027299881, 0.07566937059164047, -0.022053590044379234, -0.06286461651325226, 0.018774045631289482, 0.04310417175292969, 0.08329374343156815, 0.031166590750217438, 0.0559857077896595, -0.007110730744898319, -0.025152012705802917, 0.01832461915910244, -0.013508164323866367, -0.028084242716431618, -0.14548876881599426, 0.014698667451739311 ] }, { "text": "Here is a short video of the collecting data process:\n\n-- \n\n\n\n--\n\nI've collected 8 minutes of data (2 minutes for each class) and 2 minutes for test data.", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_3", "embedding": [ 0.03985120356082916, -0.005932061932981014, -0.048194099217653275, 0.007314314134418964, 0.0741414800286293, -0.054566532373428345, -0.07169637084007263, -0.022965537384152412, 0.031095145270228386, 0.0042384895496070385, 0.08902936428785324, -0.01237788051366806, -0.056102730333805084, -0.03415805473923683, -0.041483912616968155, 0.016427751630544662, 0.004739529453217983, -0.02379738725721836, -0.07962284982204437, -0.03143725544214249, 0.005866906139999628, -0.14193594455718994, 0.030846821144223213, -0.02818521298468113, -0.010546752251684666, 0.07409310340881348, 0.0072872815653681755, -0.006388360634446144, 0.0765329971909523, -0.06026887521147728, -0.0015440548304468393, -0.013571655377745628, 0.039592500776052475, 0.062100425362586975, 0.03172704949975014, 0.03938864916563034, 0.04640883207321167, 0.008747806772589684, -0.07178893685340881, 0.014712590724229813, 0.02768784761428833, 0.015789341181516647, 0.03767688572406769, -0.023833414539694786, -0.04112451151013374, 0.029299525544047356, 0.03960731625556946, -0.09672269970178604, 0.0305106732994318, -0.017031341791152954, -0.08263253420591354, 0.026622554287314415, -0.015958119183778763, -0.01383920293301344, -0.047267720103263855, 0.01591474376618862, 0.04779058322310448, -0.024851132184267044, 0.007960659451782703, 0.08781007677316666, 0.003903454402461648, -0.060067545622587204, -0.01731107197701931, 0.02835799939930439, 0.013723833486437798, 0.04437682032585144, -0.007350578438490629, -0.01012734416872263, 0.06133521348237991, -0.05362167954444885, -0.08168377727270126, 0.0661221519112587, -0.014336392283439636, 0.07453899830579758, -0.03805020451545715, -0.11045073717832565, -0.02413835935294628, -0.01979224942624569, 0.04721495881676674, -0.12766151130199432, 0.04165582358837128, -0.027725882828235626, -0.0412050224840641, 0.04300961643457413, 0.0758858472108841, 0.007185644470155239, 0.07156218588352203, 0.12872323393821716, -0.07712732255458832, -0.021902266889810562, -0.06754528731107712, 0.08973842859268188, -0.05124399811029434, 0.015380744822323322, -0.007237376179546118, 0.044379133731126785, 0.021428296342492104, -0.0706469789147377, 0.06942299753427505, -0.011828240007162094, 0.014297883957624435, 0.020007390528917313, -0.010597809217870235, 0.06649018824100494, -0.08561179041862488, -0.09909828752279282, 0.058648400008678436, 0.07059018313884735, -0.02304922603070736, 0.07396768778562546, 0.010369017720222473, 0.0460926853120327, -0.05759881064295769, -0.010244116187095642, 0.04676105082035065, 0.0020086823496967554, -0.11143971234560013, -0.020491495728492737, -0.10155391693115234, 0.0613630935549736, 0.0870610848069191, -0.021415377035737038, -0.06661225855350494, -0.08258174359798431, 0.03186945617198944, -0.0006492121610790491, -0.03238014876842499, 5.386164706635647e-33, 0.022340897470712662, -0.013494023121893406, 0.010639521293342113, 0.03449230641126633, -0.014588328078389168, -0.03456777706742287, 0.030389154329895973, 0.024410350248217583, -0.0035423797089606524, 0.05889979749917984, 0.0304762814193964, -0.06291865557432175, -0.030869998037815094, 0.018487390130758286, 0.01805674284696579, -0.0145766232162714, 0.00013168685836717486, 0.055750537663698196, -0.02214307337999344, 0.007005144841969013, 0.03544514253735542, -0.042939864099025726, 0.03120008111000061, -0.0005480546387843788, 0.005304368212819099, 0.06167859956622124, 0.010546746663749218, 0.0038865446113049984, 0.09433284401893616, 0.01354485284537077, 0.0200805701315403, -0.027593770995736122, -0.05195976048707962, 0.016044920310378075, 0.11168765276670456, 0.014947266317903996, 0.05459768325090408, 0.04480472207069397, 0.009884221479296684, 0.043697115033864975, -0.007568989880383015, 0.015385295264422894, 0.026447854936122894, -0.0831635445356369, -0.14318233728408813, -0.036957643926143646, 0.03707947954535484, 0.02118869684636593, -0.05261404067277908, 0.07673606276512146, 0.06892457604408264, 0.026425819844007492, -0.05089636147022247, -0.05578479915857315, -0.014590383507311344, 0.06775932759046555, 0.036864183843135834, -0.035624910145998, -0.03786471486091614, 0.0817951038479805, 0.016518067568540573, 0.022563977167010307, 0.03451547399163246, -0.01793656498193741, 0.009446483105421066, -0.016861416399478912, 0.026555445045232773, -0.028601298108696938, 0.06661003082990646, 0.00098351517226547, 0.003165898146107793, -0.010177955962717533, 0.031096255406737328, -0.09481097757816315, 0.11361181735992432, -0.06664201617240906, -0.01896432414650917, 0.01963692158460617, -0.1359328329563141, 0.02428305521607399, 0.009487837553024292, -0.06681563705205917, 0.05535005405545235, -0.0517318919301033, -0.031399913132190704, -0.04914224147796631, 0.002092445269227028, -0.0466446578502655, -0.04227673262357712, -0.024342745542526245, -0.08188510686159134, -0.001939324545674026, -0.06938518583774567, -0.055659011006355286, -0.028650781139731407, -4.166023978343175e-33, 0.044803861528635025, 0.046808015555143356, 0.024702591821551323, 0.09486643224954605, 0.055988896638154984, -0.0005004126578569412, 0.05860227346420288, 0.10941360145807266, 0.0046755350194871426, 0.07460778206586838, 0.02340448647737503, -0.12044703215360641, -0.11051015555858612, -0.1251290738582611, -0.01634283736348152, 0.020062310621142387, 0.06508493423461914, -0.1170765683054924, 0.040356654673814774, -0.03239131346344948, -0.007002031896263361, 0.025077328085899353, 0.07812642306089401, -0.03627438843250275, -0.048656363040208817, 0.0505899153649807, 0.03405199199914932, 0.006110819987952709, 0.05831184610724449, -0.025172755122184753, -0.007312159053981304, -0.04464785009622574, -0.10658184438943863, -0.060292214155197144, -0.018962200731039047, -0.01531408354640007, 0.06509949266910553, 0.029442865401506424, -0.010815034620463848, 0.050137441605329514, 0.05702460929751396, 0.0516841821372509, -0.07248938083648682, -0.03133353590965271, -0.029268499463796616, -0.07187250256538391, -0.022611605003476143, 0.05023900046944618, 0.013802297413349152, 0.021034283563494682, 0.019556185230612755, -0.004033458884805441, -0.024689918383955956, -0.003559994511306286, 0.10474313050508499, 0.006338182371109724, 0.052637044340372086, -0.03726363927125931, 0.01708145998418331, 0.045524582266807556, -0.04154163599014282, -0.04985693097114563, -0.08991445600986481, 0.019850296899676323, 0.0386248342692852, 0.09020629525184631, 0.029693277552723885, -0.041593097150325775, -0.06166434660553932, 0.06709358841180801, 0.06454005837440491, 0.04036695882678032, 0.03936055675148964, -0.007874809205532074, -0.022092154249548912, -0.0321938656270504, -0.08629739284515381, 0.03971385210752487, 0.07911191135644913, 0.019773555919528008, -0.003262479789555073, -0.02803741581737995, 0.023202883079648018, -0.03597182780504227, 0.012971481308341026, 0.09413837641477585, 0.0417720191180706, 0.006680877413600683, 0.035188063979148865, 0.006325113121420145, -0.01714741438627243, 0.05404660850763321, 0.08444515615701675, 0.04722459241747856, 0.017523763701319695, -4.180905577300109e-08, -0.06570650637149811, -0.03226933628320694, 0.031843554228544235, 0.00042032048804685473, -0.03671860694885254, -0.011380688287317753, -0.05462073162198067, 0.09524812549352646, 0.06841662526130676, -0.027367107570171356, 0.13809016346931458, 0.0030576479621231556, 0.010467929765582085, -0.00337265245616436, -0.0009943500626832247, -0.04112980142235756, 0.06582275778055191, -0.02963724359869957, -0.008328993804752827, 0.01614237017929554, -0.003243435872718692, -0.014917122200131416, -0.013850444927811623, -0.05769405886530876, 0.027735795825719833, 0.01791234314441681, 0.059120818972587585, 0.06153729185461998, 0.037088390439748764, -0.10777854174375534, -0.03016124665737152, 0.022263076156377792, -0.06283309310674667, -0.07020631432533264, 0.014962430112063885, -0.07304321229457855, -0.042793747037649155, -0.005631611216813326, -0.023117559030652046, 0.023121077567338943, -0.0415775366127491, -0.010507257655262947, -0.01434350199997425, -0.023537106812000275, 0.02581261843442917, 0.01054410170763731, -0.05559566617012024, -0.022575872018933296, 0.059839434921741486, 0.05988359451293945, -0.023671796545386314, -0.02397237718105316, -0.08422373235225677, 0.05741818621754646, 0.06070149689912796, -0.024591855704784393, 0.0932263657450676, -0.028108591213822365, -0.03864867985248566, -0.014132860116660595, -0.015356930904090405, -0.008182534947991371, -0.13240733742713928, 0.003585105761885643 ] }, { "text": "### 3. Train & Test Model\n\nImpulse design is really easy thanks to Edge Impulse. First, you need to create impulse. \nYou will select processing block and learning block. The processing block will help you to generate \nfeatures, and the learning block is the classification model.\n\n-- \n\n
\n \n
Impulse Design
\n
\n\n--\n\nYou can check my previous post about [Fourier Transform](https://pelinbalci.com/2021/12/19/Fast-Fourier-Tranform.html), \nIt is used for generating features, fortunately, the Edge Impulse handles the Fouirer Transform for us.", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_4", "embedding": [ -0.061143793165683746, -0.010121595114469528, 0.006142597645521164, 0.025209899991750717, 0.06912506371736526, 0.04391251876950264, -0.086807981133461, 0.032943375408649445, -0.055219169706106186, -0.009308276697993279, 0.06555265933275223, -0.03300862014293671, -0.017046188935637474, 0.018139123916625977, -0.004087558947503567, -0.01173337735235691, 0.0089842788875103, 0.02523454651236534, -0.05416402965784073, -0.049329206347465515, 0.05465036258101463, -0.09551159292459488, 0.007924306206405163, -0.062052201479673386, -0.005551584996283054, 0.02278280258178711, 0.058004315942525864, 0.03317992016673088, 0.09588666260242462, -0.14045754075050354, 0.10665052384138107, -0.023001188412308693, 0.010165985673666, 0.011181517504155636, -0.05415559187531471, 0.02566469833254814, 0.04114403575658798, 0.04439863935112953, 0.05954073369503021, 0.006692549213767052, 0.019900258630514145, -0.05363785848021507, 0.012852773070335388, -0.08530957996845245, 0.07303128391504288, 0.027445700019598007, 0.049099285155534744, -0.024147963151335716, -0.017493221908807755, 0.005141878966242075, -0.0509459413588047, -0.03607654571533203, -0.03715444356203079, 0.017480233684182167, -0.005594001151621342, -0.0006329965544864535, 0.041874948889017105, -0.03051949478685856, 0.05184834077954292, -0.08498208969831467, -0.05896396562457085, -0.034203168004751205, 0.022619955241680145, -0.07642590254545212, 0.034631405025720596, -0.0031213867478072643, -0.08838272094726562, 0.03372962400317192, 0.03817557170987129, -0.04942188039422035, -0.02006363682448864, -0.013293826952576637, 0.0006358143873512745, -0.005206119269132614, 0.059259042143821716, -0.0476486012339592, -0.003994600381702185, 0.06338616460561752, -0.04408995807170868, 0.02625201642513275, -0.008751306682825089, -0.08334412425756454, -0.014096716418862343, -0.012388397939503193, 0.0426839254796505, 0.1481921523809433, -0.008681361563503742, 0.040684763342142105, -0.10908292233943939, -0.013174916617572308, 7.531005394412205e-05, 0.0383729413151741, -0.05828266218304634, -0.011007225140929222, 0.0019402451580390334, 0.07541635632514954, -0.011069057509303093, -0.06270548701286316, -0.04755842313170433, 0.03378865122795105, -0.0025732952635735273, -0.1099657267332077, 0.027565395459532738, 0.03282186761498451, -0.046458806842565536, -0.04406247287988663, 0.03407609090209007, 0.033717188984155655, 0.05968359112739563, -0.04521846026182175, 0.05040789768099785, 0.004508555866777897, -0.14587946236133575, -0.04826291650533676, 0.009812026284635067, 0.0002486675512045622, -0.10607198625802994, -0.07293161749839783, 0.05044353008270264, -0.013284710235893726, 0.060591261833906174, 0.0708838552236557, -0.08649128675460815, 0.09715590626001358, 0.03895726427435875, -0.07638240605592728, -0.11756663769483566, 6.202750877451135e-33, 0.01717849262058735, 0.07852674275636673, -0.0428524874150753, -0.05799788236618042, 0.04283169284462929, -0.05006828159093857, 0.027941588312387466, -0.007518993224948645, 0.036184124648571014, 0.0258061233907938, -0.0480799674987793, -0.01251197699457407, -0.05291147530078888, 0.06717947870492935, -0.0043444884940981865, -0.11804376542568207, -0.025789255276322365, -0.0224884282797575, 0.005590651649981737, 0.05568737909197807, 0.03803781047463417, -0.007510926574468613, 0.010913499630987644, 0.013841708190739155, -0.06688327342271805, 0.10128434747457504, -0.009047278203070164, 0.05214507877826691, -0.04519054666161537, 0.028518998995423317, -0.02126612327992916, 0.04161442816257477, -0.022924553602933884, -0.019140666350722313, 0.0012416201643645763, -0.023835351690649986, -0.02533201314508915, 0.006047227885574102, -0.022927850484848022, -0.021507004275918007, 0.0019432187546044588, 0.018279222771525383, -0.04518503695726395, 0.019789593294262886, -0.04974014684557915, 0.003485774388536811, 0.09778301417827606, -0.015631597489118576, 0.008516025729477406, 0.05536610633134842, -0.0018636563327163458, -0.08657859265804291, -0.00959858950227499, -0.01664794608950615, 0.05726834386587143, 0.07854364067316055, -0.028726644814014435, 0.017461853101849556, 0.01965971663594246, -0.008290755562484264, 0.06838279962539673, -0.016570784151554108, 0.003759948303923011, 0.029894128441810608, 0.01874898374080658, 0.02041301503777504, -0.007537574507296085, -0.0032743432093411684, 0.10612758994102478, -0.0009481888264417648, -0.025315042585134506, 0.03110048919916153, 0.02373150922358036, -0.06348465383052826, 0.08167367428541183, -0.008018581196665764, 0.03860047832131386, 0.08657468855381012, -0.05509516969323158, 0.004714310169219971, -0.023698223754763603, -0.011154544539749622, 0.02579953335225582, -0.09230971336364746, 0.01741381175816059, 0.0710349977016449, 0.028169143944978714, -0.06168325990438461, -0.05900983884930611, -0.060372937470674515, -0.048556409776210785, 0.05782820284366608, -0.03657977655529976, 0.04345051944255829, 0.019672108814120293, -4.427310658592045e-33, 0.05830997973680496, 0.1724938452243805, 0.012794914655387402, 0.07093358039855957, -0.02843734808266163, 0.049691569060087204, 0.03718464821577072, 0.012577617540955544, -0.01431200746446848, 0.03900114819407463, -0.002177034504711628, -0.016066936776041985, -0.0693923681974411, -0.06268835812807083, -0.08522744476795197, -0.00683839526027441, 0.015882402658462524, -0.07972895354032516, -0.008531383238732815, 0.03227781131863594, -0.0653170496225357, 0.10530862212181091, -0.06581835448741913, -0.0008459092350676656, -0.11274248361587524, 0.05707255378365517, 0.002681230427697301, 0.031013082712888718, 0.005816785153001547, 0.019382094964385033, -0.060284409672021866, -0.01744910329580307, -0.008110111579298973, -0.03949689492583275, -0.03907031565904617, 0.017192494124174118, -0.0008519513066858053, 0.03423835709691048, 0.029550595209002495, -0.02062920294702053, 0.019139878451824188, -0.006277354899793863, -0.038313254714012146, -0.010681736283004284, -0.05941520631313324, 0.03151513636112213, 0.06538091599941254, 0.05916678160429001, 0.016336511820554733, 0.042500369250774384, 0.001184274209663272, 0.018850713968276978, -0.05084317922592163, -0.00963591504842043, -0.034976497292518616, -0.030643412843346596, 0.054616041481494904, -0.00286619714461267, 0.06657876074314117, 0.06703545898199081, -0.10776869207620621, -0.04472682625055313, 0.010949505493044853, -0.04193906858563423, 0.07247394323348999, -0.0023362154606729746, -0.0657796785235405, -0.04397989809513092, 0.038186438381671906, 0.10732580721378326, 0.019449295476078987, 0.10607634484767914, 0.12325851619243622, 0.010920262895524502, 0.003744345623999834, -0.08543293923139572, -0.009560949169099331, -0.003031303873285651, 0.002112171845510602, -0.02305847406387329, -0.06890548020601273, 0.017343079671263695, -0.10483288019895554, 0.06639418751001358, -0.007565868552774191, 0.06846743822097778, -0.004823252093046904, -0.004829299170523882, 0.05659526214003563, -0.0610525980591774, -0.014199893921613693, 0.12954822182655334, 0.08911993354558945, 0.0648055151104927, 0.030752845108509064, -6.119272200066916e-08, -0.06061699613928795, -0.04555667191743851, -0.030032848939299583, -0.0027185988146811724, 0.014521929435431957, 0.01471124030649662, -0.010240626521408558, 0.004873193334788084, -0.03727591782808304, -0.08188707381486893, -0.011049913242459297, 0.02528977021574974, -0.01881595514714718, 0.03765642270445824, 0.0358593687415123, 0.004213594365864992, 0.0658181756734848, 0.12167000025510788, 0.028340492397546768, -0.022671155631542206, 0.018956441432237625, -0.04080089554190636, 0.047431375831365585, 0.027072785422205925, 0.003439129563048482, -0.023957200348377228, -0.05274473503232002, -0.015777600929141045, 0.022901063784956932, 0.0345650389790535, 0.01682353764772415, 0.022130632773041725, 0.049140412360429764, -0.0018042518058791757, 0.013670832850039005, 0.009812800213694572, -0.08749232441186905, -0.03457380831241608, -0.07020262628793716, 0.047460395842790604, 0.06159794703125954, 0.07625448703765869, -0.002514146501198411, -0.03390489146113396, -0.036008186638355255, 0.03880717232823372, 0.06266183406114578, -0.19683164358139038, 0.0113119101151824, 0.09332188218832016, 0.03998088836669922, 0.0160747691988945, -0.05019819736480713, -0.00841580145061016, 0.05800143629312515, 0.00599002605304122, 0.04443766921758652, -0.04609552025794983, -0.02783927507698536, -0.012077433057129383, 0.07924900203943253, 0.04901871457695961, -0.0172492116689682, 0.022981412708759308 ] }, { "text": "After feature generation, I designed a neural network with 2 hidden layers and dropout layer with probability of 0.2", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_5", "embedding": [ -0.06514520198106766, -0.025836901739239693, 0.023671170696616173, 0.07568817585706711, 0.0017325904918834567, -0.02311795763671398, -0.0286775641143322, -0.041414253413677216, -0.01358124054968357, -0.13586263358592987, 0.10156573355197906, -0.08145304769277573, 0.024507632479071617, -0.07187166810035706, -0.04299609363079071, 0.05123692750930786, 0.005825866479426622, -0.04565184563398361, -0.04641006514430046, -0.009772399440407753, 0.04837607964873314, -0.0006383906584233046, -0.006883320398628712, -0.03176551312208176, 0.08879894018173218, -0.039491575211286545, 0.05923711881041527, 0.028842393308877945, 0.030780142173171043, -0.006772172171622515, 0.06951174885034561, -0.029694989323616028, -0.0736541822552681, -0.07657898962497711, -0.039384305477142334, -0.046988364309072495, -0.05410882085561752, 0.017796408385038376, -0.0039058055263012648, -0.0039925905875861645, 0.014727630652487278, 0.05415712296962738, 0.004738378804177046, 0.016589216887950897, 0.06881510466337204, 0.0038023381493985653, -0.018045494332909584, 0.03284768760204315, 0.0029159539844840765, 0.004805345553904772, -0.0024368013255298138, 0.043282732367515564, 0.015013120137155056, -0.016939153894782066, 0.0177485141903162, 0.03278422728180885, -0.041604869067668915, 0.04241803660988808, -0.14100998640060425, 0.007280431687831879, 0.034090835601091385, -0.03826214000582695, -0.036760807037353516, -0.018816635012626648, 0.08770356327295303, -0.00530745554715395, -0.029919980093836784, -0.029219262301921844, 0.06977850198745728, 0.03148866817355156, -0.020393410697579384, 0.024974379688501358, -0.031901583075523376, 0.06693627685308456, 0.008379733189940453, 0.0393819585442543, 0.01718420721590519, 0.011183471418917179, 0.016353853046894073, -0.030991073697805405, 0.04387323930859566, -0.056709326803684235, 0.025311708450317383, -0.0035093713086098433, -0.033216189593076706, 0.0020897435024380684, 0.03182769566774368, -0.00516092823818326, -0.10055013000965118, -0.042285606265068054, -0.06761046499013901, 0.02343704365193844, 0.005951416213065386, -0.02018558792769909, 0.027542922645807266, 0.01527372095733881, 0.005144580267369747, -0.05360066518187523, -0.029450569301843643, 0.030733700841665268, -0.04854215681552887, -0.07358353585004807, 0.07323313504457474, -0.005768923554569483, 0.05481328070163727, 0.020070791244506836, 0.029247835278511047, -0.02090354636311531, 0.04039199650287628, -0.017114292830228806, 0.07769042253494263, 0.016354771330952644, -0.005585404112935066, 0.00745021365582943, 0.03693840280175209, 0.039425767958164215, 0.04487799480557442, 0.008759642951190472, -0.038844432681798935, 0.05394679307937622, -0.1181374192237854, 0.043534055352211, -0.048299454152584076, -0.05862463265657425, -0.11446110904216766, 0.005697509739547968, -0.023510504513978958, -2.639369837913678e-34, -0.039618369191884995, -0.054875995963811874, -0.08331217616796494, 0.026398083195090294, 0.07262031733989716, -0.0299884881824255, 0.03978448361158371, -0.023493191227316856, 0.06796783208847046, 0.016781289130449295, -0.09838663041591644, -0.09566313773393631, -0.07359764724969864, 0.06891421228647232, 0.07437814772129059, -0.06158732622861862, 0.043045636266469955, 0.026525143533945084, 0.12564048171043396, -0.009988796897232533, -0.028797753155231476, -0.0033375746570527554, -0.024173486977815628, -0.02473623864352703, 0.06883567571640015, 0.08769971877336502, 0.007264185696840286, -0.07333657890558243, -0.06688033044338226, 0.003134468337520957, 0.01965753175318241, 0.0478028878569603, 0.0019090662244707346, -0.07529272884130478, 0.015222384594380856, -0.032042816281318665, -0.012502046301960945, -0.01857198216021061, 0.055880095809698105, 0.0059439269825816154, 0.004784546792507172, 0.014425523579120636, 0.02075931802392006, 0.014461519196629524, -0.05498666316270828, -0.07745561003684998, 0.06669910252094269, 0.007847657427191734, -0.028638547286391258, -0.023043984547257423, -0.013080685399472713, 0.036000315099954605, -0.05329030379652977, 0.0028701259288936853, 0.007261377293616533, -0.0158469770103693, 0.03197603300213814, 0.047542307525873184, 0.04208141937851906, 0.07128206640481949, 0.014964251779019833, 0.07139932364225388, -0.011057483032345772, -0.021446729078888893, 0.023966465145349503, 0.00881457980722189, -0.029727447777986526, -0.00981118157505989, 0.013983650133013725, -0.025736292824149132, 0.04695465415716171, 0.039372242987155914, 0.041479356586933136, -0.07401611655950546, -0.019208844751119614, 0.026110820472240448, -0.022809097543358803, -0.0978366881608963, 0.04859412834048271, 0.009929914958775043, -0.004419643897563219, 0.09292419254779816, -0.06397916376590729, -0.04432864114642143, 0.007127093616873026, 0.07409363985061646, 0.08802954107522964, 0.04022790119051933, -0.07873617112636566, 0.06614766269922256, -0.02075272426009178, -0.00861898809671402, 0.04608273506164551, -0.0352923721075058, 0.05652708187699318, -5.961334551670473e-34, -0.1213468536734581, 0.1541687548160553, -0.019504310563206673, 0.027186624705791473, 0.016583586111664772, 0.04011931270360947, -0.012870113365352154, 0.03487108647823334, 0.050520751625299454, 0.11303158849477768, 0.040295060724020004, 0.07198157161474228, -0.011015564203262329, -0.05420323833823204, -0.01196611113846302, 0.006828577257692814, -0.06792578846216202, -0.026947686448693275, 0.06267999112606049, -0.012871152721345425, 0.06630740314722061, 0.060194846242666245, -0.11368771642446518, 0.07331599295139313, -0.03999420255422592, -0.020820656791329384, -0.043412864208221436, 0.0034008980728685856, 0.04834923893213272, -0.017384255304932594, -0.07915937155485153, -0.003352156840264797, 0.013085059821605682, -0.023566484451293945, 0.02267983742058277, -0.03557196259498596, -0.0006022367160767317, -0.02059122361242771, -0.009986642748117447, -0.03974134847521782, -0.06758006662130356, -0.0036331976298242807, -0.08243097364902496, 0.054880790412425995, 0.024586543440818787, -0.02021750807762146, 0.05104612559080124, 0.00488998694345355, -0.045888498425483704, 0.008270781487226486, 0.00435783201828599, 0.024885600432753563, -0.03343967720866203, 0.03101269155740738, -0.07768590748310089, 0.04354190081357956, 0.0058371443301439285, 0.03234396129846573, 0.06976133584976196, 0.11878159642219543, -0.01863270066678524, -0.10996944457292557, 0.01854003220796585, -0.06792845577001572, 0.05402520298957825, 0.031225021928548813, -0.08696488291025162, 0.1849815845489502, -0.03510264307260513, 0.009628305211663246, 0.05020926892757416, 0.06258700042963028, 0.10341799259185791, -0.04862084612250328, -0.023402728140354156, -0.08901889622211456, -0.015375466085970402, 0.01771569810807705, 0.09237510710954666, 0.004962494131177664, -0.07559233903884888, 0.0016019543400034308, -0.04455690458416939, 0.0734192430973053, 0.14203593134880066, 0.006755196489393711, -0.009569700807332993, -0.02552250400185585, -0.0038074811454862356, 0.008688203059136868, -0.0009598101605661213, 0.07232329994440079, 0.005255349911749363, 0.006482848897576332, -0.07734742015600204, -2.4479545501776556e-08, 0.05215562507510185, -0.0068222773261368275, 0.07144127041101456, 0.003433826845139265, 0.052010320127010345, -0.007498959545046091, -0.021502535790205002, 0.030289994552731514, -0.0208281297236681, -0.1360737681388855, -0.06029198318719864, -0.001294148387387395, -0.05284789577126503, 0.033663008362054825, 0.06415151059627533, -0.005819633137434721, 0.017281919717788696, 0.10286085307598114, 0.025516720488667488, -0.05645056068897247, 0.08931108564138412, -0.034885894507169724, -0.07799697667360306, 0.013279791921377182, -0.03098115138709545, -0.034490976482629776, -0.0327056385576725, -0.02234676480293274, -0.017134036868810654, 0.05306562781333923, -0.017129996791481972, -0.03961498290300369, 0.005688217934221029, 0.0157509483397007, 0.09555727988481522, 0.14034956693649292, 0.03769160062074661, -0.0049644047394394875, -0.006613507866859436, 0.017145676538348198, -0.03618713095784187, -0.036720748990774155, 0.03814160078763962, 0.01769636943936348, -0.033394090831279755, -0.03680942580103874, 0.023783672600984573, -0.14642378687858582, 0.05884159356355667, -0.040769368410110474, -0.011845331639051437, 0.011395067907869816, -0.002319023245945573, 0.03012234717607498, 0.04697592929005623, 0.010643568821251392, -0.05148298293352127, -0.035793524235486984, -0.07703817635774612, 0.03242771700024605, -0.05813257023692131, 0.03392220661044121, -0.09813202917575836, 0.0065515125170350075 ] }, { "text": "import tensorflow as tf\n from tensorflow.keras.models import Sequential\n from tensorflow.keras.layers import Dense, InputLayer, Dropout, Conv1D, Conv2D, Flatten, Reshape, MaxPooling1D, MaxPooling2D, BatchNormalization, TimeDistributed\n from tensorflow.keras.optimizers import Adam\n \n # model architecture\n model = Sequential()\n model.add(Dense(64, activation='relu',\n activity_regularizer=tf.keras.regularizers.l1(0.00001)))\n model.add(Dense(32, activation='relu',\n activity_regularizer=tf.keras.regularizers.l1(0.00001)))\n model.add(Dropout(0.2))\n model.add(Dense(classes, activation='softmax', name='y_pred'))\n \n # this controls the learning rate\n opt = Adam(lr=0.0005, beta_1=0.9, beta_2=0.999)", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_6", "embedding": [ 0.01698826625943184, -0.09557471424341202, 0.03343925252556801, 0.012643362395465374, -0.00020564711303450167, 0.034291911870241165, 0.006594493985176086, -0.01457506138831377, -0.021518852561712265, -0.09334768354892731, -0.022555498406291008, -0.019321680068969727, -0.055785614997148514, 0.032541193068027496, -0.06785230338573456, 0.03126896545290947, 0.036249883472919464, 0.03191370144486427, -0.12521886825561523, -0.08918138593435287, 0.08736255019903183, 0.0120698232203722, 0.00019052826974075288, -0.04902319610118866, 0.0485098622739315, -0.01627257466316223, -0.03116973303258419, -0.050968021154403687, 0.054832566529512405, -0.009894647635519505, 0.04280657321214676, -0.009758464992046356, -0.006070713512599468, 0.0061228107661008835, -0.048968732357025146, -0.023383062332868576, -0.07303013652563095, -0.023609284311532974, -0.02338879369199276, 0.00881194043904543, 0.02228156104683876, -0.03471485897898674, -0.03485828638076782, -0.018801353871822357, 0.06919603794813156, 0.018274934962391853, -0.0006914795376360416, -0.0067582037299871445, 0.07590309530496597, 0.03215562924742699, 0.0045487405732274055, 0.002833916340023279, 0.0436253622174263, -0.053832653909921646, -0.023638848215341568, 0.03953893110156059, -0.03162677586078644, -0.0034208581782877445, 0.012153762392699718, -0.0227257888764143, -0.030768368393182755, -0.07152614742517471, 0.022748297080397606, -0.031500495970249176, 0.014477431774139404, -0.031077023595571518, -0.000349006470059976, 0.022687379270792007, -0.021261390298604965, 0.04520636796951294, 0.07135747373104095, 0.09109887480735779, -0.04704467952251434, -0.01158704049885273, 0.0467584952712059, -0.04642220959067345, 0.09539570659399033, 0.033183783292770386, 0.034197937697172165, -0.04283207282423973, 0.02680002711713314, -0.028213106095790863, 0.018002735450863838, -0.04910793900489807, 0.009941810742020607, -0.04388558492064476, 0.08714251220226288, 0.03509521484375, -0.01354987919330597, -0.035890061408281326, 0.021742969751358032, 0.04598049819469452, -0.09494878351688385, -0.019778022542595863, 0.10527057200670242, 0.04837712273001671, -0.0537993498146534, -0.014524205587804317, -0.11786502599716187, 0.057413436472415924, -0.03732401132583618, -0.042005982249975204, 0.021814703941345215, 0.04375893995165825, -0.013909016735851765, 0.029272500425577164, 0.07628146559000015, 0.05516098067164421, 0.017384247854351997, -0.04416477307677269, 0.04620902240276337, 0.020620349794626236, 0.05822860077023506, 0.07265397906303406, 0.11124268919229507, 0.03337135165929794, 0.02406708523631096, 0.017024733126163483, 0.03350698947906494, 0.05512186139822006, -0.05504249036312103, 0.058581575751304626, -0.03345700353384018, -0.01621382124722004, -0.05159397050738335, 0.016782373189926147, -0.03246426209807396, 7.903608183802458e-33, -0.03251797333359718, 0.0018567659426480532, -0.03928098827600479, -0.10651662945747375, 0.0021760256495326757, -0.04234699159860611, -0.02614462934434414, 0.03619301691651344, -0.02320639230310917, -0.05051993206143379, -0.14816142618656158, -0.08720121532678604, -0.04886789247393608, 0.09282542765140533, -0.04550103470683098, -0.10210096836090088, 0.039909955114126205, 0.054089415818452835, 0.09974664449691772, -0.021789120510220528, 0.03064107522368431, -0.038330741226673126, -0.0442652627825737, -0.020460844039916992, -0.028751442208886147, -0.0012692336458712816, 0.04789377376437187, -0.00899164192378521, -0.03967459499835968, -0.012195401825010777, -0.022120095789432526, 0.001687002251856029, -0.03531936928629875, -0.0267574954777956, -0.02131744660437107, -0.028443334624171257, 0.0710069015622139, 0.12964293360710144, 0.0340876504778862, -0.11805626004934311, -0.014025792479515076, 0.08719253540039062, -0.020708687603473663, 0.0022789256181567907, -0.08535131067037582, -0.08038481324911118, 0.05232078954577446, -0.01641491800546646, 0.008621947839856148, -0.010149084031581879, 0.04122764617204666, -0.0423075295984745, -0.04604818671941757, -0.1179484874010086, -0.07416235655546188, -0.0005401051021181047, 0.03140510991215706, 0.13281644880771637, 0.03524432331323624, 0.02218649908900261, 0.03739437833428383, 0.020214732736349106, -0.0064825937151908875, 0.01058864127844572, 0.030290227383375168, 0.019246485084295273, 0.005776058882474899, 0.003975000232458115, 0.0735926553606987, -0.026611827313899994, -0.0683305487036705, 0.02629796415567398, 0.016346845775842667, -0.05977080017328262, 0.04601819068193436, -0.08977508544921875, 0.09042799472808838, -0.10039389878511429, -0.04474875330924988, 0.016036225482821465, -0.01893698424100876, 0.06420999020338058, -0.04404062032699585, -0.0842786431312561, -0.06908217072486877, -0.03336946293711662, 0.04663076624274254, 0.020731331780552864, 0.034964874386787415, -0.008518621325492859, -0.010101480409502983, -0.017650125548243523, 0.042425867170095444, -0.003536570118740201, 0.022667670622467995, -6.099898427832046e-33, 0.059526171535253525, 0.003959201741963625, -0.024235207587480545, 0.058400820940732956, 0.10045736283063889, 0.025160865858197212, -0.015167850069701672, 0.02543102763593197, 0.011649839580059052, -0.068935826420784, 0.05389929562807083, -0.02934376895427704, 0.007956163957715034, -0.07057330012321472, 0.06286608427762985, -0.08417194336652756, -0.008167478255927563, 0.026013320311903954, -0.004313248209655285, 0.022691383957862854, 0.006909506395459175, 0.0773005560040474, -0.06740543246269226, 0.015308980830013752, -0.0410759262740612, -0.00647433428093791, -0.06084178388118744, 0.1335911601781845, 0.07411368936300278, -0.024317225441336632, -0.06680504232645035, -0.009818833321332932, -0.08852904289960861, 0.04320843890309334, 0.052197299897670746, 0.07444638013839722, -0.034924380481243134, 0.05827959254384041, -0.03693104162812233, 0.08175776898860931, 0.08662757277488708, 0.08273659646511078, -0.07226146012544632, 0.04243730008602142, 0.02125231921672821, 0.06908619403839111, -0.01405805442482233, -0.06334497779607773, -0.10749001801013947, 0.01902647316455841, -0.009919688105583191, 0.01341281272470951, -0.07671604305505753, 0.033738404512405396, -0.00202571670524776, -0.0004598410159815103, 0.046772513538599014, -0.04082810506224632, 0.0163553636521101, 0.06793707609176636, -0.06299522519111633, -0.08662889897823334, 0.0007147593423724174, -0.05140267685055733, 0.0047692530788481236, 0.025258710607886314, -0.06318943202495575, 0.08452296257019043, -0.01892583817243576, 0.0730699822306633, -0.006598745007067919, 0.043129757046699524, 0.039173200726509094, 0.05352277308702469, -0.027954576537013054, -0.07500062882900238, -0.05074793100357056, -0.0240295622497797, -0.012773832306265831, -0.021375108510255814, -0.09366919845342636, 0.04346409812569618, -0.09409572184085846, 0.0511416420340538, 0.04302788898348808, 0.03640946000814438, 0.04096139594912529, 0.112873874604702, 0.08988890051841736, 0.011177376843988895, 0.050088800489902496, -0.0483916737139225, 0.01752946898341179, 0.056040726602077484, -0.07975832372903824, -6.305645428028583e-08, 0.004872125573456287, -0.01391809992492199, 0.0830131322145462, 0.08839143812656403, 0.09193499386310577, -0.008495338261127472, 0.05094892159104347, 0.0654495507478714, 0.0019438252784311771, -0.08107447624206543, 0.019239846616983414, -0.0013227498857304454, 0.0005063203279860318, -0.06302568316459656, 0.08767342567443848, 0.04324770346283913, -0.010255258530378342, 0.043431468307971954, 0.030581247061491013, -0.02774718590080738, 0.030153164640069008, -0.014599100686609745, -0.036303456872701645, 0.0013694760855287313, 0.001965621020644903, -0.06102095544338226, 0.05479495972394943, 0.01007492933422327, -0.01671670749783516, 0.021719375625252724, 0.01474369689822197, 0.03855564445257187, 0.015249320305883884, -0.05312563106417656, -0.012644574046134949, 0.08067110180854797, 0.05083755403757095, 0.055021125823259354, -0.002516460604965687, 0.05451125651597977, -0.07309458404779434, 0.03540649637579918, -0.052898723632097244, -0.07839576154947281, -0.003727103816345334, -0.02763645350933075, -0.02363353595137596, -0.06621208786964417, 0.0736415758728981, -0.026977775618433952, 0.06497601419687271, 0.016786282882094383, -0.019130052998661995, 0.07355348765850067, 0.01290762610733509, -0.08608578890562057, -0.06743234395980835, -0.05610783025622368, -0.009003903716802597, 0.03189790993928909, -0.022571228444576263, 0.04800385981798172, -0.06162557005882263, -0.01864142157137394 ] }, { "text": "# this controls the learning rate\n opt = Adam(lr=0.0005, beta_1=0.9, beta_2=0.999)\n # this controls the batch size, or you can manipulate the tf.data.Dataset objects yourself\n BATCH_SIZE = 32\n train_dataset = train_dataset.batch(BATCH_SIZE, drop_remainder=False)\n validation_dataset = validation_dataset.batch(BATCH_SIZE, drop_remainder=False)\n callbacks.append(BatchLoggerCallback(BATCH_SIZE, train_sample_count))\n \n # train the neural network\n model.compile(loss='categorical_crossentropy', optimizer=opt, metrics=['accuracy'])\n model.fit(train_dataset, epochs=30, validation_data=validation_dataset, verbose=2, callbacks=callbacks)", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_7", "embedding": [ 0.05494002625346184, -0.04222683608531952, -0.008993996307253838, 0.015608785673975945, -0.01931794360280037, 0.01193423941731453, -0.019639113917946815, 0.029355106875300407, -0.1174207329750061, -0.05138687789440155, -0.01909199357032776, -0.07321923226118088, -0.06811842322349548, -0.06308326125144958, -0.07525306195020676, 0.010615134611725807, -0.00941494107246399, 0.03261590376496315, -0.045943450182676315, -0.07224898040294647, -0.015987973660230637, 0.06268404424190521, 0.04822450876235962, 0.07187505066394806, -0.015418577939271927, -0.030197493731975555, -0.07460026443004608, -0.03255760669708252, 0.002294214442372322, 0.012476509436964989, 0.04850250855088234, 0.001858192146755755, -0.03800574690103531, 0.03700174018740654, 0.014043785631656647, -0.06916065514087677, -0.07552297413349152, -0.016381122171878815, 0.03328666463494301, 0.05637379363179207, 0.042386218905448914, -0.019317541271448135, -0.05719617381691933, -0.013890234753489494, 0.04264015331864357, 0.037524670362472534, -0.010362918488681316, -0.019720202311873436, 0.0470154769718647, 0.007097369525581598, -0.004194685723632574, 0.008309212513267994, 0.0028988239355385303, -0.05621350556612015, -0.03636585548520088, 0.0036331515293568373, 0.04149044677615166, 0.01806856319308281, -0.07553984224796295, 0.0470256544649601, -0.057920705527067184, -0.07532618939876556, 0.030886776745319366, -0.01657971926033497, 0.002689977642148733, 0.026226157322525978, -0.097148098051548, 0.005848290398716927, 0.013240559957921505, 0.021764656528830528, 0.07206928730010986, 0.06550050526857376, -0.021857229992747307, 0.007237691897898912, -0.04792936518788338, 0.007452624384313822, 0.13700690865516663, 0.014072911813855171, 0.039852529764175415, -0.05062846094369888, -0.06845538318157196, -0.01617189683020115, 0.07619787752628326, -0.02825218252837658, 0.004838087595999241, -0.08594239503145218, 0.11224111169576645, 0.009884369559586048, 0.01008364837616682, -0.0003636942128650844, 0.06405434757471085, 0.01272217370569706, -0.020190754905343056, 0.010298207402229309, 0.05778117850422859, 0.03183729574084282, -0.06611026078462601, -0.03265616297721863, -0.06946899741888046, -0.0108059486374259, -0.04099220782518387, -0.0419672355055809, 0.038488421589136124, 0.05422873795032501, 0.012668497860431671, 0.05811655521392822, 0.08589979261159897, 0.023933935910463333, 0.05994865298271179, -0.04294620826840401, 0.08789683878421783, 0.08225509524345398, -0.005364192184060812, 0.008862398564815521, 0.11172989010810852, 0.03568321093916893, -0.03212063014507294, 0.020782243460416794, -0.007173121441155672, 0.07523910701274872, -0.04847032204270363, 0.05980377271771431, -0.04785637557506561, -0.03315984085202217, -0.03479199483990669, -0.02378622069954872, -0.037224557250738144, 5.93740653764002e-33, 0.012150817550718784, 0.019130783155560493, -0.02134276181459427, -0.07700860500335693, 0.03684628754854202, 0.05112380534410477, -0.0010583475232124329, 0.0076484945602715015, -0.059808842837810516, -0.0014252359978854656, -0.15317320823669434, -0.036617256700992584, -0.02540038339793682, 0.056258559226989746, -0.025998206809163094, -0.09845510125160217, 0.02096317894756794, 0.02068912796676159, 0.07759542018175125, -0.03604662045836449, 0.09489306807518005, -0.021262619644403458, -0.0351531021296978, 0.0006895620608702302, -0.02188526652753353, -0.005424086935818195, 0.010101071558892727, 0.004048246890306473, -0.09826307743787766, 0.020295074209570885, -0.13384421169757843, 0.00495322747156024, -0.011078364215791225, -0.0033861487172544003, 0.05963214859366417, -0.06712091714143753, 0.037207987159490585, 0.13913245499134064, 0.06264698505401611, -0.025899536907672882, 0.009878462180495262, 0.028169874101877213, -0.0056994762271642685, 0.01144520752131939, -0.10055553168058395, -0.08271358162164688, 0.08217137306928635, 0.029399340972304344, 0.02299020253121853, 0.05657733231782913, 0.03386906906962395, -0.083656907081604, -0.0029284455813467503, -0.050923656672239304, -0.007029596716165543, 0.009515417739748955, 0.02980341948568821, 0.05674047768115997, 0.11523504555225372, 0.010923346504569054, 0.027822688221931458, -0.028154054656624794, 0.0030300216749310493, 0.023662053048610687, 0.012054667808115482, 0.007815674878656864, -0.009769007563591003, -0.07501780241727829, -0.0011661711614578962, -0.03348613902926445, -0.06317038089036942, 0.05620972439646721, -0.019136754795908928, -0.015272538177669048, 0.04458438977599144, -0.08828596770763397, 0.03165389969944954, 0.01390515174716711, -0.08226365596055984, 0.0256540235131979, -0.03276260197162628, 0.05978059396147728, -0.03149058669805527, -0.08829011768102646, 0.027777429670095444, -0.0735093355178833, 0.031378425657749176, 0.02954971417784691, 0.02688579261302948, -0.033509593456983566, -0.040730588138103485, -0.04780464991927147, 0.045416995882987976, -0.011531476862728596, -0.017483437433838844, -5.451359460042174e-33, 0.021471748128533363, 0.05468878149986267, 0.008631223812699318, 0.027062537148594856, -0.011079274117946625, 0.013039807789027691, -0.008742867968976498, 0.06642318516969681, -0.05406736955046654, 0.004451821092516184, 0.04345143213868141, -0.07121195644140244, 0.0010954212630167603, -0.1532004028558731, 0.04421280324459076, -0.1059565618634224, -0.025456665083765984, 0.0976177304983139, 0.02935774251818657, -0.026820138096809387, -0.0228277575224638, 0.017229126766324043, -0.107513926923275, 0.013377062045037746, -0.02437276393175125, -0.02128092385828495, -0.03735840693116188, 0.08836273103952408, 0.07657428085803986, -0.06125366687774658, -0.07097858935594559, -0.0048579019494354725, -0.04942386969923973, 0.06921663880348206, 0.09251099079847336, 0.062141209840774536, 0.05723093822598457, -0.004972793161869049, -0.0002443506382405758, 0.0957663282752037, 0.07243127375841141, 0.03991856053471565, -0.09181370586156845, 0.02560240589082241, -0.0208029393106699, 0.06474167853593826, -0.08068646490573883, -0.02335956133902073, -0.07739502191543579, 0.0142919160425663, 0.017046980559825897, -0.04476160556077957, -0.02157687395811081, -0.006792397703975439, 0.0032190082129091024, -0.05266342684626579, 0.07580381631851196, -0.02727527543902397, -0.03238264098763466, 0.05672821030020714, 0.018286073580384254, -0.07464338839054108, 0.0020210910588502884, -0.041926298290491104, 0.00454309768974781, 0.030486002564430237, -0.09283065795898438, 0.06281322240829468, 0.04145355150103569, 0.04340207576751709, -0.025634057819843292, 0.023233510553836823, 0.05857088416814804, 0.02667703479528427, -0.05603489279747009, -0.054770395159721375, -0.04729696735739708, -0.028746401891112328, 0.07635057717561722, 0.013291297480463982, -0.021243030205368996, 0.010042128153145313, 0.06013576313853264, 0.04872678220272064, 0.033165495842695236, 0.10301237553358078, 0.05348726361989975, 0.1351965367794037, 0.010525058954954147, 0.006816496141254902, 0.010246713645756245, -0.028041897341609, 0.0621422678232193, 0.1315564066171646, 0.006724638398736715, -5.326201346633752e-08, -0.02394505776464939, 0.007479659281671047, 0.07492193579673767, 0.10776332765817642, 0.036852627992630005, 0.004476196598261595, 0.029517173767089844, 0.06265032291412354, 0.03360968455672264, -0.016222381964325905, -0.008539203554391861, 0.03242683410644531, -0.0333896279335022, 0.0062917014583945274, 0.01953335851430893, -0.01927594654262066, -0.03738125413656235, -0.027585327625274658, 0.05981330946087837, 0.03206437826156616, 0.03077738918364048, -0.05791427195072174, 0.027218619361519814, -0.01750342547893524, 0.05456290766596794, -0.10952316224575043, -0.014752513729035854, 0.09068912267684937, -0.0709131509065628, -0.03270970657467842, 0.014023837633430958, -0.04229301959276199, -0.014052527025341988, 0.033426787704229355, -0.014139304868876934, 0.050159428268671036, 0.0032275384292006493, 0.02509809285402298, 0.02273927815258503, 0.03497408330440521, -0.11269614100456238, 0.02774367295205593, -0.03342428803443909, -0.07639294117689133, -0.023807767778635025, -0.037263523787260056, -0.005639687180519104, -0.031514622271060944, 0.04933466389775276, -0.007487180642783642, 0.06005244702100754, 0.06836295872926712, -0.050406407564878464, 0.08732827752828598, -0.013168745674192905, -0.042037155479192734, -0.050510477274656296, -0.026064613834023476, -0.04813848063349724, -0.014350423589348793, -0.05849072337150574, -0.012051992118358612, -0.052586257457733154, -0.11370190978050232 ] }, { "text": "Here is the validation score:\n\n
\n \n
Validation Accuracy :)
\n
\n\n--\n\nThen I choose model testing. The test score is 71.45%. I am happy with this result.\n\n--\n\n
\n \n
Test Accuracy :)
\n
", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_8", "embedding": [ 0.058347657322883606, 0.023268897086381912, -0.0028448926750570536, 0.0768856555223465, 0.13508901000022888, 0.01927747018635273, -0.06081147491931915, 0.05611050873994827, 0.03137851879000664, 0.036324642598629, 0.060950230807065964, -0.04877467826008797, 0.07009746134281158, 0.08733692765235901, -0.02882503718137741, -0.03011035919189453, -0.014283626340329647, 0.004303577356040478, -0.07145413756370544, 0.006624768488109112, -0.061513178050518036, -0.10876483470201492, 0.0679546520113945, -0.01510685496032238, -0.011367919854819775, -0.011761271394789219, -0.008724701590836048, 0.03311524912714958, 0.012351258657872677, -0.09897349774837494, 0.03625154495239258, -0.022393178194761276, 0.0018657600739970803, -0.01403519045561552, 0.05045101046562195, 0.04379544034600258, 0.03781193867325783, -0.08174577355384827, 0.02767297998070717, -0.010964810848236084, 0.0023347209207713604, -0.07350463420152664, 0.09849844127893448, -0.0655292198061943, 0.03043552115559578, 0.012554721906781197, 0.004334053955972195, -0.049272309988737106, 0.031072746962308884, -0.004330660216510296, -0.06384354084730148, -0.0014130005147308111, -0.02182486094534397, -0.01366647332906723, -0.04328696057200432, 0.013125219382345676, 0.05220275744795799, -0.10968529433012009, 0.04187871888279915, -0.03553994372487068, 0.009375755675137043, -0.011235701851546764, -0.022570408880710602, 0.04815900698304176, 0.042136743664741516, -0.014369373209774494, -0.08922908455133438, -0.09845288097858429, -0.046693891286849976, 4.8736630560597405e-05, 0.0023497133515775204, 0.02255772054195404, 0.07383297383785248, 0.015602638013660908, -0.009675467386841774, 0.019636111333966255, -0.06326082348823547, -0.02615997940301895, 0.05687203258275986, 0.02853361889719963, -0.04719437658786774, -0.06335247308015823, -0.006985435262322426, -0.020005924627184868, 0.08229808509349823, 0.10099399834871292, 0.05278525874018669, 0.003851511050015688, -0.016577130183577538, -0.07469865679740906, 0.033786896616220474, 0.07146599888801575, -0.06628794968128204, 0.16266600787639618, 0.0004951359005644917, 0.03941123187541962, -0.06808366626501083, -0.04868827015161514, -0.05119642615318298, 0.07680187374353409, -0.02772979624569416, -0.006854003295302391, 0.014028397388756275, -0.0006343737477436662, 0.03389490395784378, 0.020167045295238495, 0.1039213165640831, 0.07458256930112839, 0.05598367005586624, 0.03496723249554634, 0.04529851675033569, 0.06060696393251419, -0.01663714088499546, 0.03675639256834984, -0.011892959475517273, 0.04039416462182999, 0.010044427588582039, 0.017850171774625778, -0.023311996832489967, 0.007033263333141804, 0.026015911251306534, 0.06651400029659271, 0.018856557086110115, -0.06048784404993057, 0.11292529106140137, -0.037187330424785614, -0.057743243873119354, 5.6925697988049534e-33, 0.0009057917050085962, -0.0028415662236511707, 0.040074728429317474, 0.0037184511311352253, -0.010842930525541306, 0.023089798167347908, -0.05764233320951462, 0.017622550949454308, -0.06489598006010056, -0.04301854595541954, -0.03421596810221672, -0.046710338443517685, -0.06777225434780121, -0.015484602190554142, 0.06044945493340492, 0.03910982236266136, -0.05410151183605194, -0.008288522250950336, -0.00014823094534222037, 0.035155244171619415, 0.008765184320509434, -0.10652952641248703, -0.020276198163628578, 0.03244287893176079, -0.08270403742790222, 0.044393330812454224, 0.05913572758436203, 0.055957019329071045, -0.09570585936307907, 0.00469091534614563, -0.0034845201298594475, -0.04253760725259781, 0.047964293509721756, -0.010892174206674099, 0.029076306149363518, 0.009823798201978207, -0.0164199061691761, 0.07553746551275253, -0.01872345432639122, 0.03452064469456673, -0.045705389231443405, -0.014589671976864338, -0.009928792715072632, -0.0035892578307539225, -0.06685928255319595, -0.029211679473519325, 0.0031735061202198267, 0.0014624311588704586, 0.0073676942847669125, 0.02768312208354473, -0.0075973025523126125, 0.0001981352106668055, -0.03327858820557594, 0.00974317453801632, -0.08202677220106125, 0.02841527760028839, 0.004229911603033543, 0.00684339739382267, -0.017978791147470474, -0.06615772843360901, 0.05742773413658142, -0.0157186109572649, -0.027427250519394875, -0.02312007173895836, 0.015112507157027721, 0.03915943205356598, 0.0026581271085888147, -0.01923076994717121, -0.016083383932709694, -0.010188540443778038, -0.028824133798480034, -0.03255457431077957, 0.03512115404009819, 0.012620855122804642, 0.02638184279203415, -0.09952094405889511, 0.018833601847290993, 0.062251295894384384, -0.025020500645041466, -0.01586734503507614, 0.025666657835245132, 0.005002948455512524, -0.07520723342895508, -0.06068745255470276, -0.016815807670354843, 0.0011508662719279528, 0.01853833720088005, -0.003230229252949357, -0.05091170594096184, -0.01740996353328228, 0.03725834935903549, 0.013180200010538101, -0.0397823229432106, -0.06278447806835175, -0.037283118814229965, -3.9304218496597715e-33, 0.00048672687262296677, 0.0665741115808487, -0.02267155796289444, 0.12313414365053177, 0.02733447588980198, -0.06774038821458817, 0.13066798448562622, -0.019578520208597183, -0.03834730386734009, 0.010859881527721882, 0.062765933573246, -0.06377679109573364, -0.14180241525173187, -0.0973457619547844, -0.03582705557346344, -0.008432070724666119, -0.028978845104575157, -0.05703321471810341, 0.051500748842954636, 0.009747124277055264, 0.07365016639232635, 0.09483098983764648, -0.015228189527988434, 0.05888926237821579, -0.08400779962539673, 0.06678466498851776, -0.005258982069790363, -0.0036086193285882473, -0.034442637115716934, 0.0376146174967289, 0.029930023476481438, 0.04697862267494202, -0.05818178132176399, 0.006767459213733673, 0.03536428138613701, -0.07239006459712982, -0.042202163487672806, -0.07339301705360413, 0.05780802667140961, 0.1588078737258911, 0.03600083664059639, 0.02351243793964386, -0.11718745529651642, -0.022950680926442146, -0.028027191758155823, 0.012902751564979553, 0.1102091372013092, -0.04911697283387184, 0.03474598750472069, -0.008939632214605808, 0.004537141881883144, -0.024831948801875114, -0.005238857585936785, 0.050711311399936676, 0.039856165647506714, 0.003852924332022667, -0.08826043456792831, 0.024792641401290894, -0.024263931438326836, 0.11444943398237228, -0.006926740985363722, 0.07892736047506332, -0.061527546495199203, 0.03399696201086044, -0.009686313569545746, 0.06926374137401581, -0.05429506301879883, 0.029340721666812897, 0.04392266646027565, 0.054032668471336365, -0.038300544023513794, 0.009147295728325844, 0.12030228227376938, 0.01794547215104103, -0.010910140350461006, -0.018356334418058395, 0.006001084111630917, 0.07036442309617996, 0.07305128872394562, -0.07568105310201645, -0.02734016254544258, -0.04713119566440582, -0.051702238619327545, -0.010134187527000904, -0.015818674117326736, 0.05857868492603302, -0.024181483313441277, -0.01344552543014288, -0.0386105440557003, 0.032313406467437744, -0.02051415480673313, 0.07662240415811539, 0.12186423689126968, -0.08554934710264206, -0.01757624000310898, -5.0143192709128925e-08, -0.08613764494657516, -0.056580062955617905, 0.015185384079813957, -0.017421146854758263, -0.11814375966787338, 0.030681496486067772, -0.0017170073697343469, -0.06353303045034409, 0.012028123252093792, -0.013336729258298874, 0.08371029794216156, 0.017237287014722824, -0.08975764364004135, 0.023972412571310997, -0.0600716657936573, -0.03813454508781433, 0.009739581495523453, 0.13109348714351654, -0.008953086100518703, 0.05273226648569107, -0.004302892368286848, 0.020462533459067345, 0.006982899736613035, 0.02680514007806778, 0.021208690479397774, 0.03061373345553875, -0.06006458029150963, 0.07109734416007996, -0.05584510415792465, -0.0365496426820755, 0.09426465630531311, -0.02504747547209263, -0.0005875971401110291, -0.035257745534181595, -0.02078045718371868, 0.06746366620063782, -0.06684242933988571, -0.009858155623078346, 0.010439736768603325, 0.06424377858638763, -0.002703453414142132, 0.005604623816907406, -0.0237888116389513, -0.042907122522592545, -0.033719148486852646, -0.02350887656211853, -0.00010232981003355235, -0.06812392175197601, 0.0020069649908691645, 0.008202895522117615, 0.030480945482850075, -0.05792614817619324, -0.1036955937743187, -0.00020136148668825626, -0.009968156926333904, -0.0977621003985405, 0.07988026738166809, 0.024483047425746918, -0.07987455278635025, -0.01236158050596714, 0.09998998045921326, -0.062174540013074875, 0.011515973135828972, -0.025039304047822952 ] }, { "text": "### 4. Deployment\nYou can read my previous [post](https://pelinbalci.com/tinyml/2021/11/28/Deploy-To-Arduino.html) about deployment. Click Deployment, select Arduino, and the quantized version of the project (Please read more about Tensorflow Lite). Click build --> this will give you a zip file.\n\nNow please close the terminal if it still opens. (I got \"port is busy\" error during uploading before I close the terminal)\n\nOpen Arduino IDE.\n\n- Sketch --> Include library --> Add Zip Library\n- File --> Examples --> motion_classifier_inferencing --> nano_ble33_sense_accelerometer --> upload --> this will take around 10 minutes.", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_9", "embedding": [ 0.03020447865128517, -0.12938208878040314, -0.018747035413980484, -0.013202222995460033, 0.050729528069496155, -0.027397334575653076, -0.049268972128629684, -0.011417434550821781, -0.10970280319452286, 0.07760313898324966, 0.02680785395205021, -0.03559427708387375, -0.07978777587413788, 0.015703219920396805, 0.019837377592921257, 0.06825745105743408, 0.016494575887918472, -0.04882775992155075, -0.03711575269699097, 0.020055297762155533, 0.04151785746216774, -0.020792974159121513, 0.019240064546465874, 0.01739388145506382, 0.0055436138063669205, -0.024016788229346275, 0.007124795578420162, -0.04748319089412689, -0.0311873946338892, -0.015164297074079514, -0.02151726558804512, 0.0577838234603405, 0.0205376073718071, -0.03130427002906799, 0.11445622891187668, 0.08676330000162125, -0.0006191618740558624, -0.03698708489537239, -0.05702788382768631, -0.032650578767061234, 0.02058083936572075, -0.041501689702272415, -0.05473104119300842, -0.0005131142679601908, 0.014490376226603985, -0.007089677732437849, 0.10869760811328888, -0.02204294688999653, 0.05481458082795143, 0.011177324689924717, -0.08153464645147324, -0.029653912410140038, -0.01950165256857872, -0.03342699259519577, -0.04345137998461723, -0.0323479026556015, 0.057811859995126724, -0.051998719573020935, 0.052755896002054214, -0.09762123227119446, 0.003008792642503977, 0.03442048653960228, -0.018293486908078194, 0.010453855618834496, -0.02150435373187065, 0.008777243085205555, 0.03851814195513725, -0.029573259875178337, 0.0683656558394432, -0.0804993286728859, 0.06308320164680481, 0.0438922718167305, -0.08876051008701324, 0.05999530851840973, -0.055057041347026825, -0.048134371638298035, 0.09726618230342865, 0.0370224304497242, 0.044777460396289825, -0.019981512799859047, -0.036385320127010345, -0.05080360546708107, 0.039117056876420975, 0.03388844057917595, 0.0031426253262907267, 0.002049380447715521, 0.02948550507426262, 0.06870436668395996, -0.005043017212301493, -0.06426474452018738, 0.012836933135986328, 0.009347306564450264, -0.0921487808227539, -0.007414101157337427, 0.03364500775933266, -0.012602643109858036, -0.035130489617586136, 0.0437212809920311, -0.09924741089344025, 0.027764376252889633, -0.004311731550842524, -0.0843343511223793, -0.012525614351034164, 0.07683725655078888, -0.03778356686234474, 0.004144991282373667, 0.0862509235739708, 0.019517578184604645, 0.006226127035915852, 0.06759321689605713, 0.03910257667303085, -0.02697864919900894, 0.0006776964291930199, -0.020040974020957947, -0.00804547592997551, 0.1378522366285324, -0.0704621896147728, 0.08014311641454697, 0.03227943927049637, 0.07750849425792694, 0.014878679998219013, 0.05358884483575821, -0.022631000727415085, -0.025499848648905754, -0.03803952783346176, -0.00815948098897934, -0.03244945779442787, -1.9713391534062566e-34, 0.01240559946745634, -0.0238193329423666, -0.03251119330525398, 0.11101369559764862, 0.056578267365694046, -0.10301824659109116, 0.034443747252225876, -0.035195112228393555, 0.03647385165095329, -0.02070745825767517, -0.06759866327047348, 0.01865062490105629, 0.008021829649806023, 0.1176556870341301, -0.07037363201379776, -0.1162085011601448, 0.030922986567020416, -0.007214088924229145, 0.05027260631322861, 0.0615457147359848, 0.06907908618450165, -0.15150505304336548, -0.08082322031259537, 0.059476323425769806, -0.02431664988398552, 0.08203145861625671, 0.07250198721885681, 0.08264411985874176, 0.04274851456284523, 0.04255775362253189, -0.051577553153038025, -0.01518081221729517, -0.026199718937277794, -0.0816478431224823, 0.011963392607867718, -0.12301060557365417, 0.03471755236387253, 0.04668847844004631, -0.04093281179666519, -0.021109212189912796, 0.017689047381281853, 0.00723061989992857, -0.06458817422389984, -0.06677316874265671, 0.02996811456978321, -0.05172353982925415, -0.017210830003023148, 0.0406617596745491, 0.10472461581230164, 0.0364190973341465, 0.020603537559509277, -0.08106053620576859, -0.020686225965619087, -0.006166388280689716, 0.0385657474398613, -0.02189391292631626, 0.0010054330341517925, -0.07304982095956802, -0.004614512901753187, -0.0016650253674015403, 0.018133260309696198, 0.05951583385467529, 0.019429195672273636, 0.028266815468668938, 0.047889649868011475, -0.05902336165308952, -0.06735780090093613, 0.04065882787108421, 0.03192025050520897, -0.0032409930136054754, -0.10105510801076889, -0.009221778251230717, 0.043400686234235764, -0.05550427734851837, 0.04501376301050186, -0.06764042377471924, 0.00957053154706955, 0.013693534769117832, -0.05904408544301987, 0.018848419189453125, -0.028878087177872658, -0.05534466356039047, 0.007444125600159168, -0.029034005478024483, 0.03180217370390892, -0.031082825735211372, 0.01696876995265484, 0.007827436551451683, -0.10507810115814209, 0.007741752080619335, -0.008687695488333702, 0.054998356848955154, -0.06430269777774811, -0.023063717409968376, -0.0841439813375473, -7.3920186241517015e-34, 0.003928672522306442, 0.020055189728736877, -0.008953738957643509, 0.00875042099505663, -0.025881893932819366, 0.004348135087639093, 0.04483310133218765, 0.06043591722846031, 0.05704546347260475, -0.01076575368642807, -0.04512457177042961, 0.009171680547297001, 0.04429572820663452, -0.06105653569102287, 0.0028968029655516148, 0.030971314758062363, 0.009178126230835915, 0.013254589401185513, 0.04294914752244949, 0.004094881005585194, -0.08655629307031631, 0.010498663410544395, -0.01283110212534666, -0.016641506925225258, -0.02867557294666767, -0.0153735326603055, -0.014636408537626266, 0.06089372932910919, 0.0007552916649729013, -0.045019470155239105, -1.2501984201662708e-05, -0.01764284260571003, -0.09520317614078522, 0.048498909920454025, 0.03763613849878311, 0.0645863264799118, 0.055611059069633484, -0.0028286296874284744, -0.012942244298756123, -0.025241265073418617, 0.03760168328881264, 0.0224161297082901, -0.0986461192369461, -0.016582245007157326, 0.012681900523602962, -0.009737551212310791, -0.01780845783650875, -0.022468365728855133, -0.030880378559231758, -0.0661197155714035, 0.006321219727396965, -0.0181434229016304, 0.03277222812175751, -0.0460825078189373, 0.03540078550577164, -0.0031573937740176916, 0.0913696140050888, 0.04194595292210579, -0.03488844633102417, 0.052550267428159714, 0.03826194256544113, -0.00844651460647583, 0.04688344523310661, -0.10710825771093369, -0.029393577948212624, 0.019291458651423454, -0.05368199944496155, 0.08103449642658234, -0.016869671642780304, 0.11973147094249725, -0.06346718221902847, 0.07746519148349762, 0.013620961457490921, 0.06206774711608887, -0.006311964243650436, 0.022871989756822586, 0.023529572412371635, 0.04274794086813927, 0.035316888242959976, -0.0801415890455246, 0.09613780677318573, 0.04164505749940872, -0.029065610840916634, -0.012456651777029037, 0.01919390633702278, 0.03857237473130226, 0.061694368720054626, -0.009968847967684269, 0.07623785734176636, 0.03916649892926216, -0.010385655798017979, 0.02098802477121353, 0.04659624397754669, 0.05714285373687744, -0.019291432574391365, -5.81361874196773e-08, -0.009727691300213337, 0.10518072545528412, -0.0008573499508202076, -0.04370395466685295, -0.0036363168619573116, 0.06896598637104034, 0.0772397592663765, 0.009255802258849144, 0.0737871453166008, -0.04391125217080116, 0.013376151211559772, 0.0007220107363536954, -0.014922278001904488, 0.10247493535280228, 0.007747110445052385, 0.03665103390812874, -0.09664323180913925, 0.04423543065786362, 0.0058596390299499035, -0.044605400413274765, 0.0905301421880722, -0.015705782920122147, 0.01399754174053669, -0.005647384095937014, 0.02992631494998932, -0.07987204939126968, 0.018302779644727707, -0.07326745986938477, -0.05895425006747246, -0.03498019278049469, -0.08387473225593567, -0.0026451456360518932, 0.006036740727722645, 0.012307766824960709, 0.019634826108813286, 0.06581196933984756, -0.05183917284011841, 0.02910573035478592, 0.0631328821182251, 0.02052103914320469, -0.07674554735422134, 0.13076151907444, -0.005026086699217558, -0.09736018627882004, -0.0035382374189794064, -0.11997423321008682, -0.05300023779273033, -0.03975503891706467, -0.07102833688259125, 0.09506053477525711, 0.03726835921406746, 0.038064900785684586, -0.07155803591012955, 0.06675418466329575, 0.0045081134885549545, 0.021134281530976295, -0.06154816970229149, -0.09972250461578369, 0.011046163737773895, 0.01348128728568554, 0.0034646897111088037, 0.05120432749390602, -0.08687584102153778, -0.008283373899757862 ] }, { "text": "Then you can open Serial Monitor for live classification. Here is a short video for live classification. \nThere are some errors between the targets light and heavy but that's ok :)\n\n\n\n--\n\n
\n \n
Live Classification
\n
", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_10", "embedding": [ 0.07290690392255783, -0.04981819540262222, -0.07352977991104126, -0.011767859570682049, 0.18686634302139282, 0.039044372737407684, -0.06157612428069115, -0.027980351820588112, -0.03660551831126213, 0.0231703519821167, 0.02759077027440071, -0.04126345366239548, -0.04802493005990982, 0.037983182817697525, -0.025179440155625343, -0.056249476969242096, 0.027070315554738045, 0.06498898565769196, -0.04204040765762329, 0.01659972034394741, 0.06930641084909439, -0.1542266607284546, 0.019269675016403198, -0.028372226282954216, -0.048655156046152115, 0.02217908948659897, 0.015486315824091434, 0.0984724685549736, -0.001997383078560233, -0.05592858046293259, -0.0033256765455007553, -0.03237678110599518, -0.0045120129361748695, -0.030148932710289955, -0.03163333237171173, 0.017759723588824272, 0.03675716370344162, -0.08626954257488251, -0.041832081973552704, -0.010970651172101498, -0.006226395256817341, 0.0008681142353452742, 0.06223549693822861, -0.04360277205705643, -0.004658880177885294, 0.0185344647616148, -0.018621183931827545, -0.051704518496990204, -0.007605560123920441, -0.03542159125208855, -0.06736201047897339, -0.052311524748802185, 0.05110332742333412, 0.025121141225099564, -0.030500691384077072, -0.029910137876868248, 0.07601447403430939, -0.06887288391590118, 0.09789764136075974, -0.01171349547803402, 0.011067167855799198, 0.012244828045368195, 0.07811162620782852, -0.033366668969392776, 0.018484974279999733, 0.06837034970521927, -0.04249701648950577, 0.0047750091180205345, 0.11398901045322418, -0.02956913225352764, -0.028418486937880516, -0.011156758293509483, 0.021108973771333694, 0.007371042855083942, -0.060486067086458206, -0.07184424251317978, -0.03310825675725937, -0.03362447768449783, -0.06600984930992126, -0.013702192343771458, 0.021083569154143333, -0.05781598016619682, -0.06469251960515976, 0.007567036431282759, 0.1043657585978508, 0.06359687447547913, 0.0036628383677452803, 0.07374827563762665, -0.024080023169517517, 0.020062193274497986, -0.10734543949365616, 0.07697170972824097, 0.006054516416043043, -0.0019790667574852705, -0.06343230605125427, -0.06115879863500595, -0.012867903336882591, -0.05360566824674606, -0.013805024325847626, 0.016733143478631973, 0.023874670267105103, -0.09799171984195709, -0.004648853559046984, 0.07170773297548294, 0.022586775943636894, 0.006613297387957573, 0.04827411472797394, 0.07677889615297318, 0.06585956364870071, 0.07158541679382324, 0.011640142649412155, 0.03637338802218437, -0.059165261685848236, -0.016864977777004242, -0.032817136496305466, 0.04856447875499725, -0.06042144075036049, 0.027553098276257515, -0.023374954238533974, -0.011645949445664883, 0.11621133238077164, -0.027422474697232246, -0.04760834947228432, -0.05162613093852997, 0.1641104519367218, -0.015880037099123, -0.05787959322333336, 5.061971813544506e-33, 0.061406202614307404, -0.045280877500772476, -0.02168559469282627, -0.006745775230228901, -0.0076646688394248486, -0.06506670266389847, 0.03523360192775726, -0.012388788163661957, -0.014506165869534016, -0.03118506260216236, 0.040209561586380005, 0.06819547712802887, -0.06048373505473137, 0.07809843868017197, 0.033828020095825195, -0.11342205852270126, -0.0053505925461649895, 0.033706020563840866, 0.016100529581308365, 0.06535793840885162, -0.09673237800598145, -0.045170631259679794, -0.011497902683913708, 0.03888314589858055, 0.029195033013820648, 0.0991072729229927, 0.02965269610285759, 0.03239766135811806, 0.006975725758820772, 0.020844217389822006, 0.0173077080398798, 0.016098368912935257, 0.05662183091044426, -0.03589564934372902, 0.04231967031955719, -0.06618517637252808, -0.1039060428738594, 0.09291417896747589, -0.019175997003912926, -0.013249880634248257, 0.012325594201683998, -0.030240222811698914, -0.010789405554533005, -0.046753160655498505, -0.06413969397544861, 0.02022610604763031, 0.00753391208127141, 0.02284018136560917, 0.0029533300548791885, 0.013424480333924294, 0.07367338985204697, -0.04658924788236618, -0.08313034474849701, -0.034026265144348145, -0.04650851711630821, 0.043924927711486816, -0.04675845056772232, -0.019706353545188904, -0.027752278372645378, -0.04445976763963699, 0.06190383434295654, -0.013014291413128376, 0.03506506234407425, 0.04096712917089462, 0.026062801480293274, -0.013620859943330288, 0.06446917355060577, -0.05536098778247833, -0.009324625134468079, -0.0027253814041614532, -0.0624333880841732, -0.02269604429602623, 0.12713022530078888, -0.021950557827949524, 0.030494514852762222, 0.04254734516143799, -0.016455713659524918, 0.05911682918667793, -0.10813969373703003, 0.06551352143287659, -0.01901210844516754, -0.03880449756979942, 0.06221848353743553, -0.037050116807222366, -0.010931516997516155, -0.030919287353754044, -0.03329814225435257, 0.002663615858182311, -0.11239194124937057, 0.014991886913776398, -0.019216839224100113, 0.023168964311480522, -0.08262276649475098, -0.010886804200708866, -0.0458715558052063, -4.885014730681642e-33, -0.006901788059622049, 0.07021960616111755, 0.03684934973716736, 0.021601177752017975, -0.06460937857627869, 0.03309187293052673, -0.021619047969579697, -0.006510869134217501, 0.02555651217699051, 0.07762880623340607, 0.020809229463338852, -0.04556383192539215, -0.18485544621944427, -0.06825666129589081, -0.05003776773810387, -0.015526522882282734, -0.01441784668713808, -0.014989417977631092, -0.020371461287140846, 0.03809797763824463, 0.024472985416650772, 0.05401613190770149, -0.027993692085146904, -0.025234008207917213, 0.0038384273648262024, 0.04120495915412903, 0.0942501574754715, 0.07930801808834076, -0.013600073754787445, -0.07559575885534286, 0.020292822271585464, -0.02813059836626053, -0.05242840200662613, 0.026920834556221962, 0.041428226977586746, -0.01944277621805668, 0.039201151579618454, -0.05585448443889618, -0.007048833183944225, 0.05800690874457359, 0.04211973771452904, 0.027723142877221107, -0.10080140084028244, -0.03950923681259155, -0.04780583828687668, -0.05281339958310127, 0.006909953895956278, 0.06483718752861023, 0.04995495826005936, 0.023770589381456375, 0.02927219308912754, 0.03949183225631714, -0.018957646563649178, -0.035578351467847824, 0.04274621233344078, -0.02861073426902294, 0.006339750252664089, 0.06604281812906265, 0.0038910459261387587, 0.07163334637880325, 0.03698344528675079, 0.014401673339307308, -0.07488922029733658, 0.009365398436784744, 0.0076048593036830425, 0.08285626769065857, -0.03896702826023102, -0.043219685554504395, -0.035027265548706055, 0.07705321907997131, 0.07457082718610764, 0.02388381026685238, 0.06223567947745323, 0.015307839959859848, 0.004414738155901432, -0.05911559239029884, -0.0936320498585701, 0.026767944917082787, -0.016611093655228615, -0.06519658863544464, 0.014938447624444962, -0.08521981537342072, 0.04879086837172508, 0.022395389154553413, 0.04252845048904419, 0.1439289152622223, -0.03762026131153107, 0.02814360335469246, 0.07813523709774017, -0.0065881055779755116, -0.008388704620301723, 0.07534391433000565, 0.07203368097543716, -0.03240780904889107, -0.015405611135065556, -4.671897357866328e-08, -0.0033717257902026176, -0.01091738697141409, 0.02667159028351307, -0.058465197682380676, -0.07408807426691055, 0.03436383232474327, 0.007293004542589188, -0.0031877814326435328, 0.014725792221724987, -0.011506395414471626, 0.04554086551070213, -0.027888458222150803, 0.030661772936582565, 0.03885675594210625, -0.029391048476099968, -0.02913765422999859, 0.00026412412989884615, 0.03364177793264389, -0.021083932369947433, 0.07974831759929657, -0.03290383890271187, -0.006691996939480305, -0.0015013494994491339, -0.010468312539160252, -0.019841613247990608, -0.039421446621418, -0.004316382575780153, 0.0963580310344696, -0.013210390694439411, -0.007239288650453091, 0.06725110858678818, 0.030368901789188385, -0.03166002780199051, -0.04840228706598282, 0.043448202311992645, 0.01570155657827854, -0.0864153802394867, 0.01186696533113718, -0.03031446598470211, 0.04929833486676216, -0.044512856751680374, -0.041222114115953445, -0.07062868773937225, -0.0026453775353729725, 0.006294065620750189, 0.04364830255508423, -0.018747955560684204, -0.18462906777858734, -0.01008910033851862, 0.031871672719717026, 0.021219393238425255, 0.004760110750794411, -0.05224349722266197, 0.022394755855202675, -0.01955447532236576, -0.0019294816302135587, 0.09101463854312897, 0.015771035104990005, -0.03366376459598541, 0.057252295315265656, 0.0671420618891716, -0.011327446438372135, -0.024289371445775032, 0.07984212785959244 ] }, { "text": "### 5. Improvement\n\nI tried to increase the test accuracy for all classes. First I changed the model architecture:", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_11", "embedding": [ 0.026416730135679245, -0.042635731399059296, 0.035586945712566376, -0.022674977779388428, -0.03808208182454109, -0.05079149827361107, -0.06518763303756714, -0.02611492946743965, -0.10396338254213333, -0.010954081080853939, 0.039753567427396774, -0.060411278158426285, -0.03258290886878967, -0.01053516287356615, -0.05634887516498566, -0.008177644573152065, 0.05314178392291069, -0.017902541905641556, -0.07543790340423584, 0.014409651048481464, -0.006188466213643551, 0.010150298476219177, 0.12066897004842758, 0.05852457880973816, -0.015630602836608887, -0.006236356683075428, -0.03690442070364952, 0.015222260728478432, 0.02426171489059925, -0.055725954473018646, -0.0021534780971705914, 0.04070071503520012, -0.01713997684419155, 0.05260448530316353, 0.06835286319255829, -0.06301465630531311, 0.02221369743347168, 0.018454477190971375, 0.08518467843532562, 0.05541004613041878, 0.03834640979766846, -0.024952765554189682, 0.08463723957538605, 0.019301187247037888, 0.05475545674562454, 0.014417232945561409, 0.011601079255342484, -0.012526622973382473, 0.0711677148938179, -0.07280413061380386, -0.05056237056851387, -0.021338053047657013, -0.0034789794590324163, -0.07584542036056519, -0.12850074470043182, -0.02040717750787735, 0.02395952120423317, -0.012806542217731476, 0.020969349890947342, -0.06943082064390182, 0.02625780925154686, 0.007636698894202709, -0.0030923685990273952, 0.04019039869308472, -0.06802577525377274, 0.03257608786225319, 0.003800339065492153, -0.008998862467706203, 0.01657850854098797, 0.020608922466635704, 0.07297129184007645, 0.1280653476715088, 0.007209033239632845, 0.052095554769039154, 0.047109611332416534, 0.04510360211133957, -0.04795099049806595, 0.016096122562885284, 0.09646473079919815, -0.07377012819051743, -0.09643717110157013, -0.07794099301099777, -0.017857464030385017, -0.010743441060185432, 0.07373445481061935, 0.020568840205669403, 0.056982506066560745, -0.07245537638664246, -0.09125787764787674, -0.02206648327410221, 0.08339878916740417, 0.013035964220762253, -0.05599389225244522, 0.04696733504533768, -0.00687194149941206, 0.035775091499090195, 0.05757615715265274, -0.00824551098048687, -0.03180716931819916, 0.0347231924533844, -0.03988154977560043, -0.03525450453162193, 0.002210261533036828, 0.05475541949272156, -0.022582681849598885, 0.04525589570403099, 0.10544507205486298, 0.014964205212891102, -0.04224603250622749, -0.055150456726551056, 0.023051239550113678, 0.035209331661462784, -0.0699821338057518, 0.0027905390597879887, 0.03731274977326393, 0.06552325934171677, -0.031329426914453506, 0.01996765285730362, -0.04244399443268776, 0.07787659019231796, -0.035063236951828, 0.038770951330661774, -0.04129677638411522, -0.018944965675473213, -0.03299984335899353, 0.03157932683825493, -0.05762500315904617, -1.8014550797453628e-34, 0.014877955429255962, 0.032370131462812424, 0.04548821598291397, 0.002132940338924527, -0.0019862561021000147, 0.022288214415311813, -0.037200041115283966, 0.07613615691661835, -0.024424169212579727, -0.016715647652745247, -0.06510274112224579, -0.06941443681716919, -0.008619015105068684, -0.0032253656536340714, 0.059129390865564346, 0.01298508606851101, -0.09436957538127899, 0.003721788991242647, -0.019285447895526886, 0.09467867016792297, 0.07501029968261719, -0.06230534613132477, -0.008153097704052925, -0.13309571146965027, -0.06444846093654633, 0.12530381977558136, 0.02607429027557373, 0.03729913383722305, -0.08960915356874466, 0.037527311593294144, 0.02383972704410553, -0.009442178532481194, -0.0066690705716609955, 0.07964647561311722, 0.004137726034969091, -0.029211312532424927, 0.08596653491258621, 0.07129495590925217, -0.0368717685341835, -0.07071319222450256, -0.0787011981010437, 0.017003634944558144, 0.012529557570815086, -0.016217520460486412, -0.01152230054140091, 0.017516788095235825, -0.0289362370967865, -0.004876862280070782, 0.06682918220758438, 0.038203440606594086, 0.006488604936748743, 0.002837756182998419, -0.06409714370965958, -0.002808253513649106, -0.05890149250626564, -0.0516117662191391, 0.07099302858114243, 0.10628519207239151, 0.010232160799205303, 0.03447946906089783, -0.024398198351264, 0.010202065110206604, 0.010430887341499329, -0.02239450439810753, 0.048219118267297745, 0.003148101968690753, -0.054396532475948334, -0.05701207369565964, 0.058966659009456635, -0.002343325177207589, 0.0633784607052803, -0.007484759669750929, 0.0015844367444515228, 0.05584762617945671, 0.03129793331027031, -0.07226508855819702, 0.03593878820538521, -0.008509349077939987, -0.06484103947877884, -0.0370296873152256, 0.030998962000012398, 0.015439151786267757, 0.02270534820854664, -0.07466326653957367, -0.06116452068090439, -0.030842429026961327, 0.036706190556287766, -0.0018986969953402877, -0.01699855923652649, 0.029996754601597786, 0.0504152774810791, 0.030674051493406296, 0.05820532888174057, 0.011724265292286873, -0.024753864854574203, 6.037267239341895e-35, 0.02422865480184555, 0.06275145709514618, 0.01371714100241661, 0.0826042965054512, 0.031209483742713928, -0.04169444367289543, 0.03164378181099892, 0.05395762249827385, -0.04227451980113983, 0.013455812819302082, 0.11432888358831406, -0.043107278645038605, -0.07917431741952896, 0.0033247063402086496, -0.06725458055734634, -0.05206552520394325, -0.015150131657719612, -0.08652167022228241, 0.0689982995390892, -0.02296483889222145, -0.04141231253743172, 0.16581040620803833, -0.055942341685295105, 0.014866187237203121, -0.05783733353018761, 0.03412255644798279, -0.060979630798101425, 0.08962760120630264, 0.0911579355597496, -0.06159592047333717, -0.0071087987162172794, 0.07718102633953094, -0.0628095418214798, 0.025284921750426292, 0.013387840241193771, 0.04151022806763649, 0.026881728321313858, -0.030995657667517662, 0.06088855862617493, 0.10024763643741608, 0.01666945219039917, 0.020761672407388687, -0.0818633958697319, 0.007712655700743198, 0.042090125381946564, -0.009171517565846443, 0.0318039245903492, -0.005204868968576193, 0.0026355874724686146, 0.0353606753051281, -0.01286345161497593, -0.03949810564517975, -0.014291093684732914, 0.035095084458589554, 0.08406438678503036, 0.042538031935691833, 0.05171426385641098, -0.08659331500530243, -0.024479879066348076, 0.039695654064416885, -0.10010220855474472, 0.0610390342772007, -0.036330971866846085, 0.024924801662564278, 0.06800205260515213, -0.01832500845193863, -0.05183394253253937, 0.06472255289554596, 0.06549401581287384, 0.03686843812465668, -0.11732450872659683, -0.01653188467025757, -0.02017633430659771, -0.015538625419139862, 0.03637222945690155, -0.04608142375946045, -0.013167883269488811, 0.07894845306873322, 0.0828910768032074, 0.008962475694715977, -0.09505979716777802, -0.05699189752340317, -0.020097952336072922, 0.0843944177031517, 0.002466259291395545, 0.07810446619987488, 0.09472224116325378, 0.005233532749116421, -0.03266121819615364, 0.04652099683880806, -0.01890634559094906, 0.02825036831200123, 0.03764839842915535, 0.000988427666015923, -0.03132209926843643, -2.642921970164025e-08, -0.03605490177869797, -0.028134100139141083, -0.025997046381235123, 0.1141490489244461, -0.023130400106310844, -0.043083298951387405, -0.09077797830104828, 0.07848986238241196, -0.02879927307367325, -0.04858417436480522, -0.043418120592832565, 0.005540467333048582, -0.04219537973403931, 0.05641789361834526, 0.017395129427313805, -0.08826921880245209, -0.06654740124940872, 0.07544554024934769, -0.016681604087352753, -0.05065198615193367, 0.0006864519673399627, -0.017365265637636185, 0.029922598972916603, -0.04398392513394356, 0.005473931785672903, 0.00799478031694889, 0.02715671807527542, 0.021410612389445305, -0.0019571951124817133, -0.00014721456682309508, -0.007572233211249113, -0.018742332234978676, -0.04439694434404373, -0.05703563988208771, -0.0005654722335748374, 0.10699900984764099, 0.014853880740702152, 0.005721985828131437, 0.02837340347468853, 0.07163362950086594, -0.07739605754613876, -0.05076389014720917, -0.10101595520973206, -0.03280160203576088, 0.04145314171910286, -0.06530943512916565, -0.016518380492925644, -0.07595811784267426, 0.03462321683764458, -0.04076870530843735, -0.03912005200982094, 0.04810856655240059, -0.0814533457159996, -0.032443102449178696, -0.026169782504439354, -0.014274570159614086, 0.0022962121292948723, -0.06422210484743118, -0.012575115077197552, -0.01062886230647564, 0.06780795007944107, -0.08142681419849396, -0.10233046859502792, 0.018255069851875305 ] }, { "text": "import tensorflow as tf\n from tensorflow.keras.models import Sequential\n from tensorflow.keras.layers import Dense, InputLayer, Dropout, Conv1D, Conv2D, Flatten, Reshape, MaxPooling1D, MaxPooling2D, BatchNormalization, TimeDistributed\n from tensorflow.keras.optimizers import Adam\n \n # model architecture\n model = Sequential()\n model.add(Dense(128, activation='relu',\n activity_regularizer=tf.keras.regularizers.l1(0.00001)))\n model.add(Dense(64, activation='relu',\n activity_regularizer=tf.keras.regularizers.l1(0.00001)))\n model.add(Dropout(0.25))\n model.add(Dense(classes, activation='softmax', name='y_pred'))\n \n # this controls the learning rate\n opt = Adam(lr=0.0001, beta_1=0.9, beta_2=0.999)", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_12", "embedding": [ 0.01709596998989582, -0.09526149183511734, 0.03432023152709007, 0.00965774804353714, -0.0012538324808701873, 0.032730866223573685, 0.008244500495493412, -0.013482103124260902, -0.020563924685120583, -0.09307745844125748, -0.023136572912335396, -0.020580708980560303, -0.05453374981880188, 0.03306538611650467, -0.06798078119754791, 0.030201606452465057, 0.03614892438054085, 0.031709346920251846, -0.12623266875743866, -0.08837136626243591, 0.08438274264335632, 0.01267380453646183, 0.00025385632761754096, -0.049007464200258255, 0.04781048372387886, -0.0187684353441, -0.03119008243083954, -0.053603820502758026, 0.053846489638090134, -0.008801176212728024, 0.042621321976184845, -0.008879520930349827, -0.004773256368935108, 0.007658290211111307, -0.050004858523607254, -0.023304594680666924, -0.07522112876176834, -0.02459293231368065, -0.020600032061338425, 0.009190307930111885, 0.022666603326797485, -0.03307437524199486, -0.03401139751076698, -0.01825464703142643, 0.06973206251859665, 0.017520830035209656, -0.0020373868755996227, -0.006301502231508493, 0.07692542672157288, 0.03332394361495972, 0.005057869479060173, 0.0037469046656042337, 0.044461775571107864, -0.05442154034972191, -0.025446217507123947, 0.037460099905729294, -0.03178626671433449, -0.005709871184080839, 0.012645001523196697, -0.023562081158161163, -0.03091396577656269, -0.07182960957288742, 0.0226101316511631, -0.03214937448501587, 0.013792416080832481, -0.0327068455517292, -0.001437799190171063, 0.021915264427661896, -0.022108545526862144, 0.04419614374637604, 0.07155484706163406, 0.09158564358949661, -0.04673945531249046, -0.01136308815330267, 0.044269122183322906, -0.044101424515247345, 0.09760935604572296, 0.033911146223545074, 0.03410268574953079, -0.04095792770385742, 0.027615804225206375, -0.024914976209402084, 0.01892644539475441, -0.05025528371334076, 0.01046762615442276, -0.044281791895627975, 0.09014701098203659, 0.03764031454920769, -0.01404004730284214, -0.03533293306827545, 0.021116148680448532, 0.045571859925985336, -0.09568389505147934, -0.019813360646367073, 0.10542508959770203, 0.05004645138978958, -0.053706757724285126, -0.014803300611674786, -0.11983398348093033, 0.05723755806684494, -0.03618782386183739, -0.039398353546857834, 0.02393021620810032, 0.043127574026584625, -0.01637524925172329, 0.030301451683044434, 0.07671578228473663, 0.0562574602663517, 0.016214555129408836, -0.044147659093141556, 0.04557571932673454, 0.020081698894500732, 0.059241488575935364, 0.07281389087438583, 0.11194948852062225, 0.03218511492013931, 0.021891383454203606, 0.01824996992945671, 0.03320067375898361, 0.05695264786481857, -0.05645224079489708, 0.05983891710639, -0.03410864248871803, -0.014387466013431549, -0.05237836018204689, 0.016498412936925888, -0.03272230550646782, 7.889720452731462e-33, -0.031773727387189865, 0.002841309178620577, -0.03908746317028999, -0.10776326805353165, 0.0032712076790630817, -0.04096275568008423, -0.027805134654045105, 0.037247028201818466, -0.024238573387265205, -0.05199328437447548, -0.14811570942401886, -0.08809562027454376, -0.0504898875951767, 0.09236208349466324, -0.048511166125535965, -0.09969279170036316, 0.03946738690137863, 0.05303756520152092, 0.09867028146982193, -0.020437344908714294, 0.030010255053639412, -0.040579285472631454, -0.04707923159003258, -0.02014380320906639, -0.02996150590479374, -0.0009850873611867428, 0.04707043617963791, -0.007446336094290018, -0.04090345650911331, -0.012891448102891445, -0.024521689862012863, 0.002223318675532937, -0.0340847410261631, -0.0284886434674263, -0.01920175552368164, -0.027953315526247025, 0.0729888528585434, 0.13084383308887482, 0.034015364944934845, -0.11730685085058212, -0.01613675430417061, 0.08827003836631775, -0.02088760770857334, 0.002595923375338316, -0.08475570380687714, -0.07861058413982391, 0.05202192813158035, -0.017484335228800774, 0.0066612460650503635, -0.008551571518182755, 0.03978489339351654, -0.04217975586652756, -0.046912409365177155, -0.11829182505607605, -0.07390105724334717, -0.00030885337037034333, 0.03348861262202263, 0.13355609774589539, 0.034209564328193665, 0.022136472165584564, 0.03844320401549339, 0.01746971160173416, -0.006341202650219202, 0.01011208351701498, 0.030414540320634842, 0.01939871534705162, 0.006207834463566542, 0.00563391949981451, 0.07418512552976608, -0.02433486469089985, -0.06944847851991653, 0.025320321321487427, 0.016583362594246864, -0.06038535013794899, 0.04471953958272934, -0.08871039003133774, 0.09110937267541885, -0.10051354020833969, -0.043564323335886, 0.015955429524183273, -0.020889444276690483, 0.06526363641023636, -0.04487983509898186, -0.08454374223947525, -0.06672708690166473, -0.03330490365624428, 0.04493061080574989, 0.02399859018623829, 0.03517201542854309, -0.00758638558909297, -0.0100757647305727, -0.018418116495013237, 0.04399758577346802, -0.0043103694915771484, 0.01973387971520424, -6.097381400553348e-33, 0.05864962935447693, 0.00278710899874568, -0.026211146265268326, 0.05857709422707558, 0.10031265765428543, 0.024356145411729813, -0.014891993254423141, 0.026361750438809395, 0.011189755983650684, -0.06773118674755096, 0.05283673107624054, -0.029395530000329018, 0.005785252433270216, -0.07148043066263199, 0.06255382299423218, -0.08447922766208649, -0.006279824301600456, 0.025479136034846306, -0.0025235391221940517, 0.021317878738045692, 0.005546609405428171, 0.07710900157690048, -0.06616274267435074, 0.015497020445764065, -0.03986668586730957, -0.005070875398814678, -0.06275272369384766, 0.13364507257938385, 0.07300778478384018, -0.02452671341598034, -0.06908989697694778, -0.010027303360402584, -0.08650773763656616, 0.043310072273015976, 0.05227474123239517, 0.0747617706656456, -0.03345149755477905, 0.057184647768735886, -0.03508339077234268, 0.0803786888718605, 0.08765742927789688, 0.08140955120325089, -0.07059785723686218, 0.04135765880346298, 0.020248115062713623, 0.06930631399154663, -0.015429257415235043, -0.06481657177209854, -0.10653669387102127, 0.02073817327618599, -0.009284996427595615, 0.013297539204359055, -0.07398431748151779, 0.032582566142082214, -0.002869189251214266, -0.0001304360484937206, 0.046340156346559525, -0.03968818485736847, 0.016652002930641174, 0.06859514117240906, -0.06250038743019104, -0.08533225208520889, -0.0015185897937044501, -0.050549980252981186, 0.003587914863601327, 0.02527780272066593, -0.062173496931791306, 0.08550867438316345, -0.018665801733732224, 0.07279639691114426, -0.00808764062821865, 0.04311675578355789, 0.04095173999667168, 0.053735796362161636, -0.02785981073975563, -0.07615018635988235, -0.0491035096347332, -0.024592185392975807, -0.01155521348118782, -0.02200235053896904, -0.09349045157432556, 0.04381057247519493, -0.09575124830007553, 0.050007838755846024, 0.044062305241823196, 0.037294261157512665, 0.04008033499121666, 0.11121107637882233, 0.08979993313550949, 0.014041656628251076, 0.04951285198330879, -0.0479123517870903, 0.01705632358789444, 0.05389568209648132, -0.08034421503543854, -6.313404554703084e-08, 0.004798491485416889, -0.011806015856564045, 0.08143188804388046, 0.08913270384073257, 0.09100610017776489, -0.007458122912794352, 0.050442907959222794, 0.06424076855182648, 0.002069156151264906, -0.08038859814405441, 0.022692689672112465, -0.001297301729209721, -0.0015333847841247916, -0.06093810498714447, 0.08779698610305786, 0.04017253965139389, -0.01248053926974535, 0.04245193302631378, 0.031185533851385117, -0.02520088106393814, 0.030600640922784805, -0.012640781700611115, -0.036781493574380875, 0.001487915636971593, 0.001974373124539852, -0.06020912155508995, 0.056622039526700974, 0.012768271379172802, -0.01740669086575508, 0.0203029103577137, 0.01328727975487709, 0.03738803789019585, 0.014005547389388084, -0.052352745085954666, -0.011676054447889328, 0.08089134097099304, 0.049728427082300186, 0.05468887463212013, -0.000983936944976449, 0.05295324698090553, -0.07427003234624863, 0.03433050960302353, -0.05264820531010628, -0.08105861395597458, -0.005246332846581936, -0.02723555825650692, -0.024447917938232422, -0.06440982967615128, 0.07478310167789459, -0.025533176958560944, 0.06520731747150421, 0.019359905272722244, -0.020598456263542175, 0.07467710226774216, 0.013406227342784405, -0.08673608303070068, -0.06587378680706024, -0.05664888024330139, -0.008865387178957462, 0.03193558380007744, -0.024470727890729904, 0.046240177005529404, -0.06254204362630844, -0.019588813185691833 ] }, { "text": "# this controls the learning rate\n opt = Adam(lr=0.0001, beta_1=0.9, beta_2=0.999)\n # this controls the batch size, or you can manipulate the tf.data.Dataset objects yourself\n BATCH_SIZE = 32\n train_dataset = train_dataset.batch(BATCH_SIZE, drop_remainder=False)\n validation_dataset = validation_dataset.batch(BATCH_SIZE, drop_remainder=False)\n callbacks.append(BatchLoggerCallback(BATCH_SIZE, train_sample_count))\n \n # train the neural network\n model.compile(loss='categorical_crossentropy', optimizer=opt, metrics=['accuracy'])\n model.fit(train_dataset, epochs=30, validation_data=validation_dataset, verbose=2, callbacks=callbacks)", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_13", "embedding": [ 0.055756717920303345, -0.04249229654669762, -0.010725682601332664, 0.01629374362528324, -0.01970010995864868, 0.011745527386665344, -0.019078563898801804, 0.03051387518644333, -0.11687520891427994, -0.0531473234295845, -0.018429242074489594, -0.07347118109464645, -0.06675294786691666, -0.06308246403932571, -0.07486460357904434, 0.01039805170148611, -0.009587811306118965, 0.03298104181885719, -0.04425625875592232, -0.070908322930336, -0.01653551682829857, 0.06350328773260117, 0.04749738425016403, 0.07147746533155441, -0.014991829171776772, -0.031204449012875557, -0.0755695030093193, -0.03278804570436478, 0.0022381749004125595, 0.011963131837546825, 0.04924776777625084, 0.000824582006316632, -0.03672158718109131, 0.0387660413980484, 0.015245942398905754, -0.06982135027647018, -0.07501106709241867, -0.01662280410528183, 0.03212234750390053, 0.056872300803661346, 0.042865313589572906, -0.0175324659794569, -0.05637206882238388, -0.01577913761138916, 0.042008448392152786, 0.03784274309873581, -0.009367616847157478, -0.018515342846512794, 0.0467604361474514, 0.0076529053039848804, -0.0023339618928730488, 0.008623680099844933, 0.002822499256581068, -0.054907724261283875, -0.035404022783041, 0.003712061094120145, 0.040404610335826874, 0.019303064793348312, -0.0763232558965683, 0.04778722673654556, -0.058328304439783096, -0.07462829351425171, 0.031678590923547745, -0.01727055385708809, 0.00267274072393775, 0.025716697797179222, -0.0974060446023941, 0.006140994839370251, 0.013220101594924927, 0.02159903012216091, 0.07166489213705063, 0.0650947242975235, -0.02313556894659996, 0.007200103253126144, -0.04838878661394119, 0.007062672637403011, 0.1368657648563385, 0.015101605094969273, 0.039363693445920944, -0.050470832735300064, -0.06815658509731293, -0.01743544638156891, 0.07648861408233643, -0.029164640232920647, 0.004966737702488899, -0.0856173112988472, 0.11372514814138412, 0.010033491998910904, 0.01058883499354124, -0.0007613999187014997, 0.06428934633731842, 0.013418331742286682, -0.018834305927157402, 0.010403483174741268, 0.0585540309548378, 0.03099408559501171, -0.06502488255500793, -0.031687840819358826, -0.06793060153722763, -0.010276447981595993, -0.04208281636238098, -0.04189303517341614, 0.03825360909104347, 0.05440311133861542, 0.012539440765976906, 0.05819644033908844, 0.0855017900466919, 0.023850087076425552, 0.0605505146086216, -0.041880834847688675, 0.08884452283382416, 0.08173659443855286, -0.004990160930901766, 0.009183625690639019, 0.11118786782026291, 0.034747619181871414, -0.030918996781110764, 0.020547818392515182, -0.006725871004164219, 0.07544288039207458, -0.04945391044020653, 0.05837300047278404, -0.047184523195028305, -0.033488646149635315, -0.03413534536957741, -0.024073079228401184, -0.03702136501669884, 5.928323272386025e-33, 0.012236521579325199, 0.019360249862074852, -0.022517884150147438, -0.07887078076601028, 0.03724049776792526, 0.051322925835847855, -0.001343456911854446, 0.008233691565692425, -0.059567127376794815, -0.001980752684175968, -0.15377359092235565, -0.0359366238117218, -0.02516017109155655, 0.05645614117383957, -0.02674827352166176, -0.0988258421421051, 0.021554652601480484, 0.019838418811559677, 0.07895982265472412, -0.03732705116271973, 0.09339777380228043, -0.021586332470178604, -0.0344039723277092, 0.0008257307927124202, -0.022286441177129745, -0.007563733030110598, 0.010434262454509735, 0.004237895365804434, -0.09857089817523956, 0.01952502690255642, -0.13356523215770721, 0.0049702259711921215, -0.011888944543898106, -0.0035930017475038767, 0.05845853313803673, -0.06785451620817184, 0.03673078119754791, 0.13921654224395752, 0.06368866562843323, -0.025891056284308434, 0.008512397296726704, 0.02839748188853264, -0.00515403039753437, 0.00970858708024025, -0.10052001476287842, -0.08443187922239304, 0.08233214169740677, 0.030012842267751694, 0.021782031282782555, 0.056839533150196075, 0.0338456965982914, -0.0836484357714653, -0.0038081977982074022, -0.05080803856253624, -0.006697959266602993, 0.009423555806279182, 0.029468882828950882, 0.056145455688238144, 0.11477658152580261, 0.010604428127408028, 0.026758790016174316, -0.028480082750320435, 0.002655728254467249, 0.02426900714635849, 0.0120031563565135, 0.006959681399166584, -0.009851306676864624, -0.07400908321142197, -0.0018500296864658594, -0.033865418285131454, -0.06406935304403305, 0.054715536534786224, -0.020316218957304955, -0.016541633754968643, 0.04440394043922424, -0.08836942166090012, 0.031859930604696274, 0.01431457418948412, -0.08220899850130081, 0.02501542679965496, -0.03213459253311157, 0.060709916055202484, -0.031309157609939575, -0.08819060027599335, 0.027315931394696236, -0.0736648216843605, 0.03142812103033066, 0.029632441699504852, 0.025799235329031944, -0.03387674316763878, -0.04153076559305191, -0.046420708298683167, 0.04477769881486893, -0.012152031995356083, -0.016092224046587944, -5.448759413474949e-33, 0.021045126020908356, 0.055366743355989456, 0.009421939961612225, 0.026432553306221962, -0.010845180600881577, 0.012965177185833454, -0.009436518885195255, 0.06582390516996384, -0.053675245493650436, 0.0043239290826022625, 0.041934892535209656, -0.07126510888338089, 0.0010600801324471831, -0.15372484922409058, 0.04446565359830856, -0.1072632372379303, -0.02532355673611164, 0.09807094186544418, 0.027932073920965195, -0.02636537328362465, -0.022691169753670692, 0.017889490351080894, -0.1081286072731018, 0.012782061472535133, -0.027053769677877426, -0.022192714735865593, -0.03664282709360123, 0.08972151577472687, 0.07644261419773102, -0.060445915907621384, -0.07050467282533646, -0.004867364186793566, -0.04881074279546738, 0.06941933184862137, 0.09250716120004654, 0.06259787827730179, 0.057650692760944366, -0.005817914381623268, 0.0006151071866042912, 0.0958368256688118, 0.07365921884775162, 0.039010316133499146, -0.09259002655744553, 0.025932706892490387, -0.020465314388275146, 0.06483950465917587, -0.07998012751340866, -0.022744566202163696, -0.07783141732215881, 0.013460977002978325, 0.01621880754828453, -0.04394860193133354, -0.021099595353007317, -0.006018063053488731, 0.004074167925864458, -0.053336162120103836, 0.07477207481861115, -0.026927027851343155, -0.03232675790786743, 0.05599168315529823, 0.01874459534883499, -0.07426435500383377, 0.0014540068805217743, -0.04079967364668846, 0.004176734946668148, 0.029869413003325462, -0.09301912784576416, 0.06252803653478622, 0.041668809950351715, 0.04490789398550987, -0.023398157209157944, 0.024446828290820122, 0.05886760354042053, 0.025804895907640457, -0.056385308504104614, -0.05485941097140312, -0.048712849617004395, -0.029717912897467613, 0.07540757954120636, 0.012985381297767162, -0.02060389705002308, 0.010675443336367607, 0.060139235109090805, 0.048507142812013626, 0.03461701050400734, 0.10381491482257843, 0.05361692234873772, 0.1351216584444046, 0.009771736338734627, 0.0055072978138923645, 0.01065635122358799, -0.028277816250920296, 0.06251782923936844, 0.13201038539409637, 0.005503867287188768, -5.328774577151307e-08, -0.023543279618024826, 0.007172354497015476, 0.0753059908747673, 0.10806996375322342, 0.03565878048539162, 0.004320851061493158, 0.02904120273888111, 0.06225443631410599, 0.032312218099832535, -0.01652352325618267, -0.008982716128230095, 0.03283882513642311, -0.033538300544023514, 0.0053620911203324795, 0.02061629854142666, -0.018387243151664734, -0.036778658628463745, -0.028670236468315125, 0.05953999608755112, 0.033123720437288284, 0.030970295891165733, -0.05760933831334114, 0.027834927663207054, -0.017404137179255486, 0.05387163907289505, -0.10879196971654892, -0.014988603070378304, 0.09144409000873566, -0.07039688527584076, -0.03166559711098671, 0.015735629945993423, -0.04203934594988823, -0.012976708821952343, 0.032914623618125916, -0.0133278276771307, 0.04805174469947815, 0.003918497357517481, 0.025587374344468117, 0.024110684171319008, 0.032594479620456696, -0.11165420711040497, 0.028453243896365166, -0.033799003809690475, -0.07575544714927673, -0.0234422255307436, -0.03645304962992668, -0.005332549102604389, -0.031179634854197502, 0.048363469541072845, -0.008320347405970097, 0.06060057505965233, 0.06835880130529404, -0.05024341121315956, 0.08789599686861038, -0.014328512363135815, -0.04250973463058472, -0.052036985754966736, -0.025206461548805237, -0.0479915589094162, -0.013880430720746517, -0.05781380832195282, -0.012125976383686066, -0.05226881057024002, -0.11375405639410019 ] }, { "text": "Then, I've changed the parameters in Spectral features.\n\nDefault filter value is low. Let's try \"heavy\" filter. The features separates the classes well but the test accuracy is worse than the low filter:\n\n
\n \n
Heavy Filter
\n
\n\n--\n\n
\n \n
Heavy Filter Test Accuracy
\n
\n\n--\n\nFilter None gives very good result for test data :)", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_14", "embedding": [ 0.07067764550447464, 0.025596030056476593, 0.09242565184831619, 0.06294991821050644, 0.08817160129547119, -0.0477488674223423, -0.03764258325099945, -0.03774230182170868, -0.028930796310305595, -0.013907949440181255, 0.022261090576648712, -0.06812399625778198, -0.02591710165143013, 0.01166938804090023, 0.029190443456172943, 0.02931724116206169, 0.028268257156014442, 0.027660071849822998, -0.09820661693811417, -0.0026711539831012487, -0.0028729175683110952, -0.1285237967967987, 0.024731360375881195, -0.02336995117366314, 0.004822928924113512, 0.006296976003795862, -0.06472624838352203, 0.0057205758057534695, 0.03980584815144539, -0.09631165117025375, 0.056211572140455246, 0.03292518109083176, -0.06790375709533691, -0.0017621751176193357, -0.022790655493736267, 0.05378730595111847, 0.027717681601643562, 0.0019310687202960253, -0.008416915312409401, -0.008936280384659767, 0.004694127012044191, 0.030081115663051605, 0.029254591092467308, -0.07388708740472794, -0.002821109490469098, 0.03274087980389595, 0.013880587182939053, -0.07037871330976486, 0.017674116417765617, -0.05343162640929222, -0.09136047214269638, 0.027624040842056274, -0.009656060487031937, -0.008179381489753723, -0.04475269466638565, -0.013281377032399178, 0.05448842793703079, -0.0665099173784256, 0.13959985971450806, -0.036793943494558334, 0.009806009009480476, -0.03662434220314026, 0.035555217415094376, -6.381670391419902e-05, 0.07186655700206757, -0.0026918414514511824, -0.028627164661884308, -0.0804535448551178, 0.02822977863252163, -0.009411230683326721, -0.06230263039469719, 0.02368311770260334, 0.005116334650665522, 0.05186287686228752, -0.025205140933394432, 0.011610249988734722, -0.05523556098341942, -0.03913581743836403, 0.014192762784659863, 0.05536743625998497, 0.01577983796596527, -0.08681618422269821, -0.014057910069823265, 0.0018747970461845398, 0.11510780453681946, 0.10601590573787689, 0.015286327339708805, -0.034565478563308716, -0.1228473111987114, -0.059450287371873856, 0.013397661969065666, 0.016527824103832245, -0.04996528849005699, 0.11019416898488998, -0.03209567815065384, 0.025231633335351944, 0.017319850623607635, -0.03732462599873543, -0.035485222935676575, 0.09581093490123749, 0.017747145146131516, -0.06524654477834702, -0.0007379632443189621, 0.07270791381597519, -0.04341069236397743, -0.006759243085980415, 0.11472202092409134, 0.046234991401433945, 0.0058427173644304276, 0.04051142558455467, 0.040101829916238785, 0.0647103562951088, -0.11660780757665634, -0.01305612362921238, -0.015607776120305061, 0.09359545260667801, 0.04518819972872734, 0.015370713546872139, -0.02700849436223507, -0.0120054567232728, -0.014867770485579967, 0.030617166310548782, -0.05037260055541992, 0.0009906806517392397, 0.1362968236207962, 0.008687261492013931, -0.049371179193258286, 8.08101158717665e-33, 0.004236028995364904, -0.00981346145272255, -0.01076839305460453, -0.05527066811919212, -0.01480596512556076, -0.035270340740680695, -0.01647532358765602, 0.0017818204360082746, 0.005302549339830875, 0.00467926450073719, 0.011346942745149136, -0.006901952903717756, -0.06930264085531235, -0.018148256465792656, 0.03364185243844986, -0.022315755486488342, -0.06737904995679855, -0.042342398315668106, -0.017487216740846634, 0.00229665357619524, -0.028307190164923668, -0.05083497241139412, 0.0038387274835258722, -0.015471454709768295, -0.06956174969673157, 0.04784563556313515, 0.041039254516363144, 0.05353883281350136, -0.059168338775634766, 0.020716572180390358, 0.008317939005792141, -0.016881480813026428, 0.03868564963340759, 0.045781441032886505, 0.01437853742390871, -0.037745554000139236, -0.01215395424515009, 0.07966014742851257, 0.029993653297424316, -0.005173244513571262, -0.07106662541627884, 0.06700233370065689, 0.004850500263273716, 0.000715175992809236, -0.03604495897889137, -0.014210321940481663, -0.011148693040013313, 0.01022969651967287, -0.005748395342379808, 0.03382548689842224, -0.026809224858880043, -0.018304388970136642, -0.09527077525854111, -0.006679559126496315, -0.013541677966713905, -0.004782380070537329, 0.0656103864312172, -0.020221475511789322, -0.021697664633393288, -0.0339469388127327, 0.046221934258937836, -0.02567393146455288, 0.024107497185468674, -0.0029726941138505936, 0.0476008802652359, 0.027687763795256615, 0.06650667637586594, 0.04945649579167366, -0.01095648668706417, -0.05909508839249611, -0.03266983851790428, -0.020366529002785683, 0.0798502191901207, -0.016947954893112183, 0.07899664342403412, -0.02781611680984497, 0.029848024249076843, 0.0315939262509346, -0.03847657889127731, 0.04307788982987404, 0.02167152613401413, 0.05220839008688927, 0.02980402670800686, -0.04320339113473892, -0.09029076993465424, -0.030996162444353104, -0.01047517266124487, -0.015163064002990723, -0.040094733238220215, -0.03604620322585106, -0.009514957666397095, 0.06571026146411896, -0.03493499383330345, -0.02590949833393097, -0.004818096291273832, -5.866472800407587e-33, 0.03053678758442402, 0.103761687874794, 0.050381436944007874, 0.13104860484600067, 0.002284298650920391, -0.03856310620903969, 0.11763966083526611, -0.005510674323886633, 0.05414966121315956, 0.03751178830862045, 0.052808236330747604, -0.06679897755384445, -0.16650822758674622, -0.13257089257240295, -0.001064383890479803, 0.01766437664628029, -0.007123542949557304, -0.04931420460343361, 0.029618125408887863, 0.019145989790558815, -0.059032272547483444, 0.11660846322774887, 0.024063335731625557, 0.06399353593587875, -0.034251436591148376, 0.0427442342042923, -0.016952333971858025, -0.0433032363653183, 0.043270498514175415, -0.06737536936998367, -0.02349466271698475, 0.042619697749614716, -0.029210340231657028, 0.03457650542259216, 0.03887562081217766, -0.034229639917612076, -0.0776096060872078, -0.03816218301653862, 0.008001415058970451, 0.06235366314649582, 0.021917255595326424, 0.026946574449539185, -0.09367439895868301, -0.04521719738841057, -0.050846949219703674, -0.01496152114123106, 0.05976167693734169, 0.00913907214999199, 0.06647074967622757, 0.06772095710039139, 0.017050597816705704, 0.024301478639245033, -0.03494982048869133, 0.08178237825632095, 0.04642099887132645, 0.0049096145667135715, -0.04182180017232895, 0.041084300726652145, -0.01339328195899725, 0.12944377958774567, -0.031703487038612366, 0.029554054141044617, -0.06985143572092056, 0.0015772602055221796, 0.007553106639534235, 0.11917416006326675, -0.06745938956737518, 0.03622041642665863, 0.07836885750293732, 0.0687810555100441, -0.036857813596725464, -0.04866447672247887, 0.09648863226175308, -0.048224665224552155, -0.008453408256173134, -0.03890809416770935, -0.0053194183856248856, 0.04847371205687523, 0.02343183197081089, -0.007370756007730961, -0.022610435262322426, 0.03971971943974495, -0.09524830430746078, 0.07618407905101776, 0.039687253534793854, 0.11694028228521347, -0.09083250910043716, -0.06588055938482285, 0.023175902664661407, -0.017301129177212715, 0.03613630309700966, 0.04027361795306206, 0.04834694042801857, -0.027934333309531212, 0.02589808963239193, -5.000130443022499e-08, -0.06191069260239601, -0.060924749821424484, -0.019259009510278702, -0.0019107948755845428, -0.06429348140954971, -0.011288139037787914, -0.01365577057003975, 0.054138459265232086, -0.0684560015797615, -0.02468208037316799, 0.09528342634439468, 0.06556572765111923, -0.04128202423453331, 0.013830543495714664, -0.016249163076281548, -0.09104679524898529, -0.00984051451086998, 0.12738218903541565, -0.004763144999742508, 0.03459323197603226, -0.04903501644730568, -0.010431457310914993, 0.02353334054350853, 0.0006954878335818648, -0.06590375304222107, 0.03011166676878929, -0.023466655984520912, 0.020540684461593628, 0.05376848205924034, -0.03540368750691414, 0.05821392312645912, -0.0007221647538244724, -0.04814896732568741, -0.034048035740852356, 0.0013814192498102784, 0.05281705781817436, -0.08788633346557617, -0.00835734698921442, -0.05101940035820007, 0.04384949430823326, -0.02031504176557064, 0.02177092432975769, -0.007931776344776154, -0.005239931866526604, -0.03490573540329933, -0.025320909917354584, 0.04263300076127052, -0.10679616779088974, 0.05003291368484497, 0.06284588575363159, 0.03400128707289696, 0.0022954519372433424, -0.07598929107189178, -0.03805771470069885, -0.022804684937000275, -0.11318682879209518, 0.06294756382703781, 0.01917247846722603, -0.10231032967567444, -0.013924635946750641, 0.08913306891918182, -0.11193527281284332, -0.01961350254714489, -0.016675328835844994 ] }, { "text": "--\n\nFilter None gives very good result for test data :) \n\n
\n \n
None Filter
\n
\n\n
\n \n
None Filter Test Accuracy
\n
", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_15", "embedding": [ 0.07486739754676819, 0.06175252050161362, 0.08496654778718948, 0.07564268261194229, 0.15394699573516846, -0.03684069961309433, -0.04096544161438942, -0.0616491362452507, 0.05127135291695595, -0.014018301852047443, 0.03847184777259827, -0.039450451731681824, -0.003512839088216424, 0.01821468025445938, -0.017961889505386353, -0.002648415043950081, -0.04406536743044853, -0.016351206228137016, -0.03332294151186943, -0.03862512856721878, -0.02632761560380459, -0.15961793065071106, 0.03864998742938042, -0.047677475959062576, 0.020614637061953545, 0.048588357865810394, -0.02216518111526966, 0.0017469996819272637, 0.004273475147783756, -0.06447673588991165, 0.004121060948818922, -0.004163521807640791, -0.018857097253203392, 0.010733666829764843, 0.005404945462942123, 0.02617812156677246, 0.003893459215760231, -0.0012470543151721358, 0.008962683379650116, 0.011258956976234913, -0.04421136528253555, 0.00644156476482749, 0.040313586592674255, -0.11723653227090836, 0.01511202659457922, 0.05627083405852318, -0.03750842809677124, -0.09169024974107742, 0.01121288351714611, -0.043754592537879944, -0.04944614693522453, 0.026898663491010666, -0.037664733827114105, 0.010162658989429474, 0.02231024205684662, -0.032559625804424286, 0.025760063901543617, -0.09510298073291779, 0.10415297001600266, -0.030968936160206795, -0.010273497551679611, -0.016703594475984573, 0.06105572357773781, 0.004281993024051189, 0.07046768814325333, 0.043690767139196396, -0.09385168552398682, -0.0336107537150383, -0.014770270325243473, 0.006424626335501671, -0.06749255955219269, 0.02114715240895748, 0.02032003365457058, 0.021922674030065536, -0.015498597174882889, -0.027958964928984642, -0.04211092367768288, -0.018186012282967567, 0.035252250730991364, 0.07803357392549515, -0.003744028275832534, -0.09781961143016815, 0.008782745338976383, 0.04911073297262192, 0.058570995926856995, 0.10105587542057037, -0.015230832621455193, -0.03177107498049736, -0.06954803317785263, -0.05452969670295715, -0.06605616956949234, 0.08384842425584793, -0.06166927143931389, 0.1398967057466507, -0.017646584659814835, 0.040992096066474915, -0.05757322907447815, -0.032793134450912476, -0.040417060256004333, 0.05892379954457283, 0.04860257729887962, -0.03541374206542969, 0.034968744963407516, 0.054289545863866806, -0.018408529460430145, 0.05537610873579979, 0.1148742064833641, 0.034936364740133286, -0.004328093957155943, 0.04784497618675232, -0.0059551456943154335, 0.061914172023534775, -0.08740190416574478, -0.012783263809978962, -0.07529722899198532, 0.05950634554028511, 0.0609026663005352, -0.020605016499757767, -0.0216271560639143, -0.020123345777392387, 0.0652889683842659, 0.07914246618747711, -0.021957244724035263, -0.0025360339786857367, 0.12180846184492111, 0.02642105147242546, -0.008390585891902447, 7.558169332346159e-33, 0.00796352606266737, -0.06598000973463058, 0.02318389341235161, -0.051432810723781586, 0.01515827514231205, -0.000922874896787107, -0.003884183708578348, -0.02824123203754425, 0.003968059550970793, -0.0025858457665890455, 0.01984923705458641, -0.004114336334168911, -0.06374455243349075, -0.05991740524768829, 0.06693971157073975, 0.010823089629411697, -0.026965664699673653, -0.04825372248888016, 0.0022020405158400536, 0.005056796129792929, -0.05989895761013031, -0.06526955962181091, -0.027129285037517548, 0.0031159778591245413, -0.06182990223169327, -0.008188354782760143, -0.006744459271430969, 0.015983497723937035, -0.04146231338381767, 0.016622688621282578, -0.03248084336519241, 0.03450632840394974, 0.033753905445337296, 0.005446677096188068, 0.0004897388280369341, -0.023849600926041603, -0.07261122018098831, 0.05042802914977074, 0.02231542393565178, 0.0290079265832901, -0.055276039987802505, 0.0053144702687859535, 0.009095793589949608, -0.047564826905727386, -0.04846978932619095, -0.022627221420407295, -0.006694041658192873, 0.0304410457611084, 0.0020578252151608467, 0.017521698027849197, 0.017021937295794487, 0.03528137505054474, -0.070375457406044, -0.0610349103808403, -0.019367478787899017, -0.008106852881610394, -0.005943199619650841, -0.025289088487625122, -0.057082779705524445, -0.04287052899599075, 0.0780312642455101, -0.01669657789170742, 0.02210387960076332, -0.004713745787739754, 0.042553093284368515, 0.08283169567584991, 0.08812511712312698, 0.03346138820052147, -0.02163822017610073, -0.05768190696835518, -0.021142562851309776, -0.06121378764510155, 0.07565922290086746, 0.0032768864184617996, 0.0426880344748497, -0.051033712923526764, 0.01654357835650444, 0.02092324011027813, 0.00473199225962162, 0.0358344204723835, 0.04688970744609833, -0.008718769066035748, 0.008691556751728058, -0.04072575643658638, -0.03538047522306442, -0.037743180990219116, 0.013098839670419693, 0.019902167841792107, -0.013389765284955502, -0.031200166791677475, 0.016616685315966606, 0.035615552216768265, -0.10111856460571289, -0.05115415155887604, -0.01528890896588564, -6.150607784758581e-33, 0.04739854112267494, 0.11116468161344528, 0.013249470852315426, 0.10956044495105743, -0.04936503991484642, 0.015476805157959461, 0.14139851927757263, -0.03781640902161598, 0.11084669083356857, 0.04587055742740631, 0.04137801378965378, -0.09480681270360947, -0.14735954999923706, -0.15333110094070435, -0.012726136483252048, 0.06606755405664444, -0.020322388038039207, -0.06300917267799377, -0.05991043895483017, 0.02832433395087719, -0.020456261932849884, 0.09266036003828049, 0.030389517545700073, 0.0593579038977623, -0.05721023306250572, 0.043226100504398346, 0.022349227219820023, -0.031641874462366104, 0.028710883110761642, -0.025995448231697083, -0.0103898411616683, 0.06107087805867195, -0.004229018464684486, 0.0019199990201741457, 0.036719050258398056, -0.05164824798703194, -0.06390469521284103, -0.0037650135345757008, 0.05041204020380974, 0.009434087201952934, 0.026929205283522606, 0.001998563762754202, -0.08549479395151138, -0.018917448818683624, -0.04804859682917595, -0.0314343087375164, 0.08566620200872421, 0.02835935540497303, 0.05347992479801178, 0.04601521044969559, -0.05513041466474533, 0.0053449454717338085, -0.003024369478225708, 0.030251430347561836, 0.039074450731277466, 0.012672040611505508, -0.030699437484145164, 0.04098271206021309, 0.014996204525232315, 0.08841153234243393, 0.020595908164978027, -0.014244116842746735, -0.07650124281644821, 0.012356683611869812, -0.034519847482442856, 0.08717099577188492, -0.051239654421806335, 0.0586482398211956, 0.042889825999736786, 0.017033101990818977, 0.050440769642591476, -0.035318247973918915, 0.102576844394207, -0.06608160585165024, -0.0512961819767952, 0.018993062898516655, 0.0003261255333200097, 0.06284614652395248, 0.017239181324839592, -0.031705569475889206, 0.0011708330130204558, 0.03697698190808296, -0.10602213442325592, 0.009932436980307102, 0.027710838243365288, 0.04197557270526886, -0.09452015906572342, -0.04473595321178436, 0.025721294805407524, -0.031905900686979294, -0.0016469662077724934, 0.009652608074247837, 0.05128872022032738, -0.023337915539741516, 0.02930694818496704, -4.3942925742612715e-08, -0.010738491080701351, -0.101622074842453, -0.0004124106781091541, -0.009810221381485462, -0.09143669158220291, 0.060695670545101166, 0.0017535213846713305, 0.05127933621406555, -0.06756485253572464, -0.02825620211660862, 0.13290029764175415, 0.09247035533189774, -0.048570986837148666, -0.009501335211098194, -0.04379846528172493, -0.03975960239768028, 0.01066416036337614, 0.10294400900602341, -0.0021510536316782236, 0.057867009192705154, -0.07979945838451385, 0.023520145565271378, -0.029976099729537964, 0.01171280536800623, -0.0628189966082573, 0.040586020797491074, -0.020446239039301872, -0.013762605376541615, 0.06198108196258545, -0.060507673770189285, 0.06880908459424973, -0.005370055325329304, -0.014324154704809189, -0.0468280091881752, -0.009544952772557735, 0.03809528797864914, -0.03802355378866196, 0.003195007797330618, -0.07206382602453232, 0.0008283405913971364, -0.020620768889784813, 0.010097270831465721, 0.028283337131142616, -0.023499952629208565, -0.06908304989337921, -0.00038215587846934795, 0.043115146458148956, -0.08980652689933777, 0.046457257121801376, 0.059451695531606674, 0.05913897231221199, -0.013075961731374264, -0.07956356555223465, -0.009272878058254719, -0.0021406395826488733, -0.10865038633346558, 0.12109796702861786, 0.062323711812496185, -0.09180949628353119, 0.015943029895424843, 0.07633243501186371, -0.07177734375, -0.017441151663661003, -0.02645842730998993 ] }, { "text": "### Key Words\nTiny ML, Arduino, Edge Impulse, Motion, Classification", "source": "2022-01-01-Motion-Classifier.md", "type": "markdown", "chunk_id": "2022-01-01-Motion-Classifier.md_16", "embedding": [ 0.003828152548521757, -0.10272543132305145, 0.020585378631949425, -0.0515357106924057, 0.028329044580459595, -0.013558431528508663, 0.05854817479848862, -0.000359367550117895, -0.07557254284620285, -0.011020369827747345, 0.06884582340717316, -0.004352825693786144, -0.021138811483979225, -0.058484189212322235, -0.1277574747800827, 0.06175495311617851, 0.04618953913450241, 0.010885989293456078, -0.08203334361314774, -0.011135125532746315, 0.09290862083435059, -0.0023960270918905735, -0.05569380521774292, 0.025849604979157448, 0.03197331726551056, 0.08997280895709991, 0.01319301500916481, 0.0431639663875103, 0.049977220594882965, -0.10637298971414566, 0.021478213369846344, 0.06493828445672989, 0.12891945242881775, 0.028614073991775513, 0.011416695080697536, 0.009012805297970772, -0.016453050076961517, -0.028831757605075836, -0.003941608592867851, 0.01818460412323475, -0.009840632788836956, -0.06488800048828125, 0.03512946516275406, -0.008043764159083366, 0.08215995877981186, 0.07931222021579742, -0.033691976219415665, -0.07986914366483688, -0.05355910211801529, -0.018130142241716385, -0.10667584091424942, -0.07073403894901276, -0.08295737951993942, 0.031672123819589615, -0.04189673438668251, -0.11926323920488358, 0.021123260259628296, -0.04931386560201645, 0.09263110160827637, 0.001982963178306818, 0.03934129700064659, -0.012231124565005302, -0.026413699612021446, 0.01939314976334572, -0.015704894438385963, 0.012738209217786789, 0.010387393645942211, -0.01465292926877737, 0.0325574055314064, 0.04824207350611687, 0.026477279141545296, 0.05155001953244209, 0.020912012085318565, 0.0792984664440155, 0.030413854867219925, -0.04481992498040199, 0.0025101618375629187, -0.043123677372932434, -0.020250104367733, -0.0018724988913163543, -0.09388916194438934, -0.1015356257557869, -0.0919741541147232, 0.07107233256101608, 0.029339317232370377, 0.04623536765575409, -0.05756469815969467, 0.052719540894031525, -0.004907586611807346, -0.0072944918647408485, -0.05394592881202698, -0.047098781913518906, -0.03551586717367172, -0.057320352643728256, -0.016648925840854645, -0.0039193653501570225, -0.00821652915328741, -0.11660468578338623, -0.0202566459774971, 0.05814596265554428, -0.01554279774427414, -0.06762482225894928, -0.003722962224856019, 0.011101116426289082, -0.031687017530202866, -0.03483190760016441, 0.08588609099388123, 0.020466988906264305, 0.1302725076675415, 0.03862268850207329, -0.03413570672273636, -0.04943883791565895, -0.09520720690488815, -0.08804739266633987, 0.06491502374410629, -0.10259976983070374, -0.05730117857456207, -0.0038481527008116245, 0.05905225872993469, -0.02689659409224987, -0.00037506275111809373, 0.014876396395266056, -0.05212259665131569, -0.06545332819223404, -0.009825660847127438, -0.056372854858636856, -0.10928978770971298, -3.165141599153861e-34, 0.010862096212804317, 0.01055067963898182, -0.036029450595378876, 0.025005357339978218, 0.042750995606184006, 0.0004064536187797785, -0.007935590110719204, -0.04221247881650925, 0.03844373673200607, 0.07155849039554596, -0.09494158625602722, 0.03761649504303932, -0.0589832067489624, 0.0708344504237175, 0.03607184812426567, -0.11530095338821411, 0.03023122251033783, -0.004220595583319664, -0.03863980993628502, -0.02610763907432556, 0.022581687197089195, 0.061190757900476456, 0.00833439826965332, 0.009690533392131329, -0.0580565482378006, 0.11950771510601044, -0.008999104611575603, -0.055872153490781784, 0.06040516495704651, 0.06516134738922119, -0.053158052265644073, 0.06320556253194809, -0.03608913719654083, -0.024196641519665718, 0.04140842705965042, 0.026466326788067818, -0.049107443541288376, -0.03907829895615578, 0.008910742588341236, -0.07044286280870438, -0.05728583410382271, 0.010768027044832706, -0.041988302022218704, -0.09182320535182953, -0.008861870504915714, -0.008915365673601627, 0.05568283423781395, 0.0554034560918808, -0.00014176286640577018, 0.05523049458861351, -0.03987724334001541, -0.004946662578731775, 0.057826388627290726, -0.036516059190034866, 0.05310097709298134, 0.007471739314496517, 0.005016184877604246, 0.10280682891607285, 0.0038136474322527647, 0.0488869771361351, -0.012152481824159622, -0.0003894624242093414, 0.05282023921608925, -0.03671688586473465, 0.051883891224861145, -0.004156964831054211, -0.024164758622646332, 0.008517232723534107, 0.04080912843346596, 0.044917941093444824, -0.031287986785173416, 0.07529880851507187, 0.02197353169322014, -0.02313402108848095, -0.011532220989465714, 0.011771248653531075, -0.03186739608645439, -0.038119010627269745, -0.06511428207159042, 0.016126787289977074, -0.13865379989147186, -0.0510265976190567, 0.01820109784603119, -0.0616498626768589, -0.04183051362633705, 0.04730178788304329, 0.06936116516590118, -0.0997254028916359, -0.04687125235795975, -0.021749678999185562, -0.10334125906229019, 0.03896580636501312, -0.06586144864559174, 0.03484046086668968, -0.07865306735038757, -1.0842409080389456e-33, 0.0018592795822769403, 0.08541619777679443, -0.006232805550098419, 0.0690925121307373, -0.0653388649225235, 0.06040587276220322, 0.018769515678286552, 0.030370913445949554, 0.036692604422569275, 0.05745476111769676, -0.0027786309365183115, 0.02074478007853031, -0.01791759766638279, -0.039159178733825684, 0.03470997512340546, -0.027087373659014702, -0.0037419383879750967, -0.02908342517912388, 0.030907997861504555, 0.024097440764307976, -0.033939410001039505, 0.07240316271781921, -0.07582470029592514, 0.027435194700956345, -0.011803191155195236, 0.05391748249530792, -0.025399576872587204, 0.07382149994373322, 0.01651293970644474, -0.010109408758580685, -0.011573481373488903, 0.004336161073297262, 0.014353504404425621, 0.032295115292072296, -0.02544270269572735, 0.015028569847345352, 0.11287856847047806, -0.006654045078903437, -0.0021628255490213633, -0.005014499183744192, 0.07143665105104446, 0.033862557262182236, 0.03698360547423363, -0.020117327570915222, -0.017547115683555603, 0.0015157621819525957, -0.017010722309350967, 0.07673826068639755, -0.03152228519320488, -0.006652881857007742, 0.005866593681275845, 0.0153821911662817, -0.07339470088481903, -0.03883547708392143, 0.010318635031580925, 0.02319204993546009, 0.011029191315174103, 0.023168794810771942, 0.03668297454714775, 0.006248814053833485, -0.04217411205172539, -0.0688520297408104, -0.005259647034108639, 0.03306170925498009, 0.004411294590681791, 0.02203992009162903, -0.016140656545758247, -0.05562125891447067, -0.08032196015119553, 0.01738320104777813, 0.05175935849547386, 0.08498550206422806, 0.02358672209084034, -0.011921470053493977, -0.07986896485090256, -0.07591745257377625, -0.04246015474200249, -0.002146488521248102, -0.005815517622977495, -0.029066268354654312, 0.06955042481422424, -0.019931508228182793, 0.004487757571041584, 0.07375015318393707, -0.00897137075662613, 0.08410024642944336, 0.01916087046265602, 0.007245392072945833, -0.00873343925923109, -0.048499271273612976, -0.03030870109796524, 0.08912229537963867, 0.040132440626621246, 0.07008367776870728, -0.10151460021734238, -2.2612761441109797e-08, -0.08668307214975357, -0.005529341287910938, 0.03972610831260681, -0.031855951994657516, 0.046804435551166534, 0.054374031722545624, -0.052027009427547455, 0.03227199614048004, 0.032659150660037994, -0.015111002139747143, 0.10652533173561096, -0.06906215846538544, -0.053671836853027344, 0.07089903950691223, 0.06398072093725204, 0.03861454874277115, -0.032615792006254196, 0.05152571201324463, 0.01212412491440773, -0.025990204885601997, 0.008957884274423122, -0.02418065071105957, 0.007829444482922554, -0.03146464005112648, 0.04262474924325943, -0.057214949280023575, -0.043211083859205246, 0.0754135474562645, -0.006674371659755707, 0.023452889174222946, -0.018585622310638428, 0.057822249829769135, 0.034311916679143906, -0.0045135184191167355, -0.07617568969726562, 0.08761901408433914, -0.029043452814221382, 0.026673557236790657, -0.012293364852666855, 0.013034065254032612, -0.044622138142585754, 0.07788017392158508, -0.11109216511249542, -0.007038411218672991, -0.003426771378144622, 0.02605297416448593, 0.05758567899465561, -0.13173407316207886, -0.05135805532336235, 0.006456519477069378, -0.00833103246986866, 0.08920006453990936, 0.055903222411870956, 0.045366786420345306, 0.061757054179906845, 0.09121149778366089, 0.049563150852918625, -0.06375101953744888, 0.008536185137927532, 0.03658800944685936, 0.07028733938932419, 0.04682887718081474, -0.02394394390285015, 0.018812356516718864 ] }, { "text": "---\ntitle: \"Langchain Tools\"\nid: \"langchain_tools\"\ncategory: \"genai\"\ntags: [\"agents\", \"llm\"]\nrelated: [\"agentic-architecture\"]\ndate: \"2025-11-25\"\ndescription: \"How LangChain calls the custom functions and how to leverage Tavily Search for internet searching.\"\n---\n\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/getting-started-with-langchain-tools-3beec9e1fb95) \n\nAre you curious about AI agents and ready to build them from scratch? This post will be a great start for you. I will \nshow you how LangChain calls the custom functions and how to leverage Tavily Search for internet searching. In future \nposts, we will dive into how these constructs fit into the agentic architecture. Stay tuned to learn more about AI agents!✨🎉", "source": "2025-01-18-LangChain_Tools.md", "type": "markdown", "chunk_id": "2025-01-18-LangChain_Tools.md_0", "embedding": [ -0.06793630868196487, -0.03326403349637985, -0.015585292130708694, -0.05436454340815544, -0.0532878115773201, -0.021899953484535217, 0.0029598278924822807, 0.03323858976364136, -0.041980303823947906, -0.030023518949747086, -0.005399124696850777, -0.07235123217105865, 0.05180840566754341, -0.0002227099030278623, 0.028374534100294113, 0.02270641177892685, 0.011086184531450272, 0.06874223053455353, -0.00910648051649332, -0.12147209048271179, 0.023754360154271126, -0.01662505231797695, 0.04786057770252228, -0.06073978170752525, -0.07921645045280457, -0.012976884841918945, 0.03907596319913864, -0.08482319861650467, 0.021176345646381378, 0.015194118954241276, 0.06532195955514908, 0.03502683341503143, -0.0005962260765954852, 0.06331665813922882, -0.03022114560008049, 0.09369046241044998, -0.07782083749771118, -0.04639895632863045, 0.039237841963768005, -0.0348755419254303, -0.045147739350795746, -0.0313628688454628, -0.0028800289146602154, -0.06131135672330856, 0.05996399745345116, -0.0022225966677069664, -0.022109651938080788, 0.042695797979831696, -0.0318291075527668, 0.014025000855326653, -0.127481147646904, -0.0700778216123581, 0.023110318928956985, 0.025817492976784706, -0.020803790539503098, -0.01144896075129509, -0.015994612127542496, -0.028877051547169685, 0.019307667389512062, -0.0947440043091774, 0.08013863116502762, -0.0013312374940142035, -0.00626983679831028, 0.026068732142448425, -0.034522347152233124, 0.05718643218278885, 0.017899418249726295, 0.0344284288585186, 0.04173116013407707, -0.04812375456094742, -0.00980798527598381, -0.013578900136053562, -0.010701235383749008, 0.03702676296234131, -0.014531604945659637, 0.01970253512263298, -0.009205378592014313, 0.01302389521151781, 0.022744866088032722, -0.09493931382894516, 0.009552894160151482, 0.056378062814474106, 0.057814739644527435, 0.10051639378070831, -0.05161447823047638, 0.01352823805063963, 0.05206223577260971, -0.0003362570714671165, 0.12909026443958282, 0.012819557450711727, 0.07345299422740936, -0.018010791391134262, 0.042097315192222595, -0.04091309756040573, 0.09382717311382294, 0.08751706033945084, -0.02550000324845314, -0.061968352645635605, -0.018365910276770592, 0.06805893778800964, -0.057759784162044525, 0.013972016982734203, 0.020113546401262283, -0.06273342669010162, -0.10510269552469254, 0.08914656937122345, 0.00283120758831501, 0.017577633261680603, 0.04246584698557854, -0.041667547076940536, -0.05082161724567413, 0.013098523020744324, 0.007828700356185436, -0.05808684229850769, 0.0492820106446743, 0.009640601463615894, 0.02784012071788311, 0.02718217484652996, 0.0895911157131195, 0.07064961642026901, 0.025092653930187225, -0.005354566033929586, -0.05523843318223953, 0.025258144363760948, 0.08515375852584839, 0.09871719777584076, -0.03825201839208603, 1.85347008487965e-33, 0.052870072424411774, 0.058951910585165024, -3.37324345309753e-05, 0.06800072640180588, 0.022944066673517227, -0.0795518159866333, 0.11995119601488113, 0.012751052156090736, -0.11276336759328842, -0.03795167803764343, -0.01812845468521118, 0.07570325583219528, -0.116042859852314, 0.020044835284352303, 0.054471489042043686, -0.06815411150455475, -0.009411475621163845, -0.035539641976356506, 0.07581362873315811, 0.015569374896585941, 0.022617395967245102, -0.029272403568029404, 0.0719892829656601, -0.0004901285865344107, 0.10019028186798096, 0.07188807427883148, 0.001651626080274582, -0.08643164485692978, 0.06773915141820908, 0.006781352683901787, -0.04874798655509949, 0.004161057993769646, -0.07046487182378769, 0.08962961286306381, -0.010218105278909206, 0.04145963117480278, -0.09773530066013336, -0.025508632883429527, -0.006860979832708836, 0.03544183447957039, -0.01786150597035885, 0.06219501420855522, 0.0353127121925354, -0.09504947811365128, -0.03233005478978157, -0.042188018560409546, -0.06231152266263962, -0.019787095487117767, 0.07495617866516113, 0.015919769182801247, 0.022334301844239235, 0.059377167373895645, -0.06034756451845169, -0.007863824255764484, 0.034892693161964417, 0.018701402470469475, -0.055962178856134415, 0.01304472517222166, -0.024542495608329773, 0.03266092762351036, 0.03424390032887459, -0.04154011607170105, 0.04351610690355301, 0.034878481179475784, 0.023113474249839783, 0.009438568726181984, -0.021838374435901642, 0.022027816623449326, 0.09740546345710754, -0.016151728108525276, 0.015883129090070724, -0.033730924129486084, 0.030402766540646553, 0.058357708156108856, -0.006096473429352045, -0.005892391782253981, -0.01727353222668171, -0.16681836545467377, -0.01090220920741558, -0.06404685229063034, -0.04751049354672432, 0.004719817079603672, -0.015101252123713493, 0.05352766439318657, 0.022263092920184135, -0.08348193764686584, -0.03437647596001625, -0.052030663937330246, 0.0009261702070944011, -0.01135854423046112, -0.04379976913332939, 0.01994810253381729, -0.06710313260555267, 0.05056537687778473, -0.050396375358104706, -3.977343543382766e-33, -0.02001519314944744, -0.11731386184692383, -0.051797229796648026, 0.02051510661840439, -0.04973352327942848, -0.09595457464456558, -0.049522385001182556, 0.004548455588519573, 0.030160652473568916, 0.02980220690369606, -0.046231452375650406, 0.0031075545120984316, 0.05581339821219444, -0.00612255884334445, -0.02039562724530697, -0.035131487995386124, 0.04996004328131676, -0.056570351123809814, 0.06303984671831131, 0.05594753473997116, -0.006842344533652067, 0.11010570824146271, -0.12865585088729858, -0.014164183288812637, 0.035089217126369476, -0.005642883479595184, 0.025129368528723717, 0.07260643690824509, -0.00884874165058136, 0.026800524443387985, -0.009397887624800205, -0.028813103213906288, 0.005666365846991539, 0.027656441554427147, -0.016796810552477837, 0.04797043278813362, 0.05958033725619316, -0.004283505491912365, -0.00758669339120388, -0.014503241516649723, 0.09313714504241943, -0.043470725417137146, -0.056170642375946045, -0.05820927396416664, -0.05634523555636406, -0.012940594926476479, -0.14547085762023926, 0.13023439049720764, -0.010962838307023048, -0.07454586029052734, 0.04276830703020096, 0.023721931502223015, -0.02379641681909561, -0.14156994223594666, -0.1031838059425354, 0.021500511094927788, 0.09996805340051651, -0.012279589660465717, 6.745477003278211e-05, -0.0015888328198343515, -0.06796568632125854, -0.03567645326256752, 0.0005995798273943365, 0.026447303593158722, -0.0456136092543602, -0.06082535535097122, -0.06405884027481079, -0.017147928476333618, -0.03552558273077011, -0.06545878201723099, 0.05885116383433342, -0.03980211913585663, -0.024205466732382774, 0.08004530519247055, 0.024395273998379707, -0.028025738894939423, -0.025272611528635025, -0.01580517739057541, 0.09492503851652145, -0.02832837775349617, 0.009305301122367382, 0.054812513291835785, 0.02487708255648613, -9.23544866964221e-05, 0.017726071178913116, 0.07697349041700363, -0.0022868053056299686, 0.07431979477405548, 0.009350614622235298, -0.010065162554383278, 0.02388634905219078, 0.021727945655584335, -0.04191143438220024, 0.09122443944215775, -0.0582515113055706, -5.0498275783184e-08, -0.01268263440579176, -0.06838545203208923, 0.005990820936858654, 0.0289019588381052, -0.030735842883586884, 0.0025136054027825594, 0.02136806957423687, -0.0019110137363895774, -0.03957997262477875, -0.04333886876702309, 0.013934014365077019, 0.03489547595381737, -0.041611358523368835, 0.03372711315751076, 0.043089672923088074, 0.018050184473395348, 0.02442382089793682, 0.004179210867732763, -0.0748094841837883, -0.06828022748231888, 0.03667910024523735, 0.024299804121255875, -0.0034157652407884598, -0.04098182171583176, 0.047324471175670624, -0.037480589002370834, -0.015134138986468315, -0.007929891347885132, -0.03887559846043587, 0.08486208319664001, 0.01684391498565674, 0.016808055341243744, 0.005394968669861555, -0.01851959526538849, 0.05247495695948601, 0.0730375424027443, -0.07098251581192017, -0.09055543690919876, 0.004021910484880209, -0.031769316643476486, 0.05078307166695595, 0.06801781803369522, 0.005923392716795206, -0.061388056725263596, 0.05775593966245651, -0.036209531128406525, -0.024107201024889946, -0.06544261425733566, 0.1008155569434166, -0.0032680979929864407, -0.051670901477336884, -0.029431171715259552, -0.04650396853685379, 0.04031626135110855, 0.049891069531440735, -0.009317988529801369, -0.00859878771007061, -0.06440320611000061, 0.06591363251209259, 0.0331963449716568, -0.021696388721466064, 0.0580662302672863, 0.0007199632236734033, -0.008374671451747417 ] }, { "text": "---\ntitle: \"Quantization 1\"\nid: \"quantization\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"dl\", \"quantization\", \"medium\"]\nrelated: [\"finetuning\", \"dl\"]\ndate: \"2024-05-05\"\ndescription: \"Unlocking the Power of Quantization: From Float32 to Int8\"\n---\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/quantization-1-d05e5a61e0af) \n\nWhy do we need quantization?\n* Shrink models to a small size.\n* DL architectures are bigger and bigger.\n* A model can have 70 billion parameters.\n* NVIDIA T4 GPUs have 16 GB RAM.\n* Running models are still a challenge.\n* The aim is to get a smaller model.", "source": "2024-05-05-Quantization_1.md", "type": "markdown", "chunk_id": "2024-05-05-Quantization_1.md_0", "embedding": [ -0.030962172895669937, 0.012169971130788326, 0.0371885821223259, -0.007283065002411604, 0.019253412261605263, 0.005088933743536472, -0.04006323963403702, 0.0047582220286130905, 0.0424630269408226, -0.020907698199152946, -0.03181695565581322, 0.007773757912218571, -0.09268555045127869, 0.07242263853549957, -0.023914963006973267, 0.0059312633238732815, 0.0034987498074769974, 0.04159919545054436, -0.20252113044261932, -0.036230675876140594, 0.03996333107352257, -0.04196677729487419, -0.04167383536696434, 0.014400468207895756, -0.0010821842588484287, -0.01766161434352398, -0.026457490399479866, -0.06002803146839142, 0.08215368539094925, -0.03132281452417374, 0.012500585988163948, 0.04402241110801697, 0.09457844495773315, -0.015127514488995075, 0.014213817194104195, 0.040069278329610825, 0.024954404681921005, -0.03694900870323181, 0.004573839716613293, -0.05531173199415207, 0.0009140439797192812, -0.0439983494579792, 0.012616187334060669, 0.04137396067380905, 0.06341461837291718, 0.020988009870052338, 0.027142805978655815, 0.003226867178454995, -0.002793707652017474, -0.06823601573705673, 0.011771692894399166, 0.029962141066789627, -0.08299188315868378, 0.07098597288131714, -0.034646328538656235, -0.007344798184931278, -0.019149044528603554, -0.043036773800849915, -0.059151340276002884, -0.003857523901388049, 0.0012807771563529968, -0.018225276842713356, 0.027171418070793152, 0.052714694291353226, 0.02806570567190647, -0.04156086593866348, 0.035113103687763214, 0.0014253804692998528, 0.019023602828383446, 0.06000658497214317, 0.04187733307480812, -0.004952004179358482, -0.086747907102108, 0.08237413316965103, -0.0038920084480196238, -0.012786805629730225, 0.07250244915485382, -0.0028776745311915874, 0.0576811358332634, 0.021819602698087692, 0.029260950163006783, -0.0056617772206664085, 0.01677357405424118, 0.013907795771956444, 0.0909186378121376, -0.04662637785077095, -0.09330675005912781, -0.036202430725097656, -0.035624321550130844, -0.12090840935707092, 0.0005767234833911061, 0.06018965318799019, -0.007314322981983423, 0.03924846276640892, 0.05643053725361824, -0.05212702974677086, 0.002994576236233115, -0.042605210095644, -0.0071964142844080925, 0.07326183468103409, 0.03575213998556137, 0.0034293520729988813, 0.06579408794641495, 0.061624620109796524, -0.020079033449292183, -0.08241532742977142, 0.05021493136882782, 0.07914605736732483, 0.011608009226620197, -0.056430939584970474, 0.026942787691950798, 0.0024347451981157064, -0.0038707489147782326, -0.006736137438565493, 0.011298193596303463, 0.006022189743816853, -0.06815260648727417, 0.027850598096847534, 0.039718661457300186, -0.007218772079795599, -0.13941627740859985, -0.002040962688624859, -0.06273621320724487, 0.013524491339921951, 0.03291750326752663, -0.006812097504734993, -0.13656535744667053, 3.877763008820795e-33, 0.038653090596199036, 0.040466681122779846, 0.026374273002147675, 0.0027176670264452696, 0.06000905856490135, 0.012122048996388912, 0.010235821828246117, -0.03747997060418129, -0.007710415869951248, 0.09763392060995102, 0.0021973061375319958, 0.04512893408536911, -0.07968143373727798, 0.08083274960517883, 0.1263802945613861, -0.02879086509346962, -0.038965195417404175, 0.08500765264034271, -0.02545037865638733, -0.04135126620531082, 0.09002269059419632, -0.032443854957818985, -0.007880421355366707, 0.05016987770795822, -0.018489615991711617, 0.002920951461419463, 0.02860540710389614, 0.02857034280896187, -0.011692453175783157, 0.022133225575089455, -0.12237310409545898, -0.06042070314288139, -0.019096175208687782, -0.035849679261446, 0.03784623742103577, 0.010938734747469425, 0.002213873667642474, -0.03479931876063347, 0.02681107632815838, -0.09487319737672806, 0.0028721631970256567, 0.06294994801282883, 0.03812526538968086, -0.1523229330778122, -0.04114570841193199, 0.04262541979551315, 0.013911230489611626, -0.05459805205464363, -0.08854990452528, -0.026737626641988754, 0.09340646862983704, -0.010440351441502571, -0.09188172221183777, -0.015384308062493801, 0.04696238040924072, -0.0376192107796669, 0.020413711667060852, -0.030553383752703667, 0.003546460997313261, 0.04119126871228218, -0.021426625549793243, -0.08542237430810928, -0.013330445624887943, 0.02316237986087799, 0.02642923593521118, 0.015225877054035664, 0.05019475147128105, 0.03815678507089615, -0.02789430506527424, 0.06078030914068222, -0.09446704387664795, -0.02856575883924961, -0.03574347496032715, -0.048523008823394775, 0.15683422982692719, -0.04538244754076004, 0.029923029243946075, -0.03779357671737671, -0.056906700134277344, 0.020943766459822655, -0.06737583875656128, 0.07247965037822723, -0.02043486200273037, 0.03993906080722809, 0.01452380046248436, -0.050588950514793396, 0.0360930934548378, 0.008473231457173824, -0.042706090956926346, -0.03255424275994301, -0.08138616383075714, -0.00513566704466939, -0.018600447103381157, 0.03749843314290047, -0.09969859570264816, -5.28102445113627e-33, -0.06926257163286209, 0.003980235196650028, -0.05060279369354248, 0.07438722997903824, -0.02805004082620144, -0.04587184637784958, -0.0701310932636261, -0.028929470106959343, 0.05198138207197189, -0.11787206679582596, 0.03194919973611832, -0.004603508859872818, 0.04317203164100647, 0.009408778510987759, -0.051960911601781845, 0.01703045517206192, -0.03846720978617668, -0.08528845012187958, -0.05058674514293671, 0.018280986696481705, 0.05090222880244255, 0.0363767072558403, -0.05528709292411804, -0.050831716507673264, 0.0011561951832845807, -0.009848407469689846, -0.062026798725128174, 0.059677235782146454, 0.06794534623622894, 0.04140368103981018, -0.06816990673542023, -0.06659162044525146, -0.09571374952793121, -0.027965271845459938, -0.01029366534203291, -0.05635477975010872, 0.07667592912912369, 0.07413701713085175, -0.008374609053134918, 0.04490860551595688, 0.05290756747126579, -0.04767562821507454, -0.04176242649555206, -0.007282597944140434, -0.01651553437113762, 0.04334326833486557, 0.021939629688858986, -0.06970042735338211, -0.016323991119861603, 0.0016690079355612397, 0.08853220194578171, 0.0481458455324173, 0.03581042215228081, 0.0350051075220108, -0.04111761227250099, -0.0025573342572897673, -0.003132367506623268, 0.03310397267341614, -0.04835458844900131, 0.03776578605175018, -0.045383960008621216, -0.028257671743631363, -0.033635303378105164, -0.027357067912817, -0.06921780854463577, 0.007296540774405003, -0.05734681338071823, 0.05090794712305069, -0.05436369404196739, -0.002372082555666566, -0.01086338609457016, -0.06990134716033936, -0.009890780784189701, 0.0672345981001854, -0.1284359246492386, -0.03705298900604248, -0.029073113575577736, -0.03266221284866333, 0.06671452522277832, 0.02333003096282482, -0.03441786393523216, 0.01015274878591299, 0.04398506134748459, -0.01670163869857788, 0.0886341780424118, -0.0061421748250722885, 0.053522739559412, 0.013956033624708652, 0.04066130146384239, 0.03282986581325531, -0.05596422031521797, 0.030046263709664345, 0.024287549778819084, 0.0869273990392685, -0.13072781264781952, -5.3021231849470496e-08, -0.01552653405815363, 0.08134270459413528, -0.007383928634226322, -0.03908593952655792, 0.0434257909655571, -0.01871960051357746, -0.045640502125024796, 0.10173435509204865, 0.040093209594488144, 0.033862873911857605, 0.08758807927370071, 0.0073900348506867886, -0.11402824521064758, 0.034639548510313034, -0.0005207984359003603, 0.06191280856728554, -0.03631829097867012, -0.03862791135907173, 0.03548343852162361, -0.019782446324825287, -0.01877673529088497, 0.024305541068315506, -0.041025515645742416, -0.07361345738172531, 0.04044603183865547, -0.07769747078418732, 0.06729835271835327, 0.02706203982234001, 0.04282549396157265, 0.05956468731164932, -0.02118135243654251, 0.09859742969274521, 0.06678275763988495, 0.06342139840126038, 0.034719422459602356, 0.02382413111627102, -0.03573652729392052, -0.010209175758063793, -0.000804518349468708, -0.09710071980953217, -0.02094588428735733, 0.01573633961379528, -0.023168794810771942, 0.002610765630379319, 0.08129789680242538, -0.024537265300750732, 0.016593212261795998, -0.005483571439981461, 0.017908094450831413, 0.12961460649967194, -0.014125324785709381, 0.09067077934741974, -0.010620081797242165, 0.02633574604988098, 0.009268669411540031, 0.07603921741247177, 0.012778853997588158, -0.0412788987159729, -0.03858264163136482, -0.003484792308881879, -0.020497916266322136, -0.08177406340837479, 0.01371908187866211, 0.004891321063041687 ] }, { "text": "---\ntitle: \"Anomaly Detection\"\nid: \"anomaly_numpy\"\ncategory: \"machine-learning\"\ntags: [\"anomaly\", \"numpy\"]\nrelated: [\"ml\"]\ndate: \"2022-11-05\"\ndescription: \"Notebook for anomaly detection with NumPy\"\n---\n\n
\n\n
", "source": "2022-11-05-Anomaly_Detection_with_Numpy.md", "type": "markdown", "chunk_id": "2022-11-05-Anomaly_Detection_with_Numpy.md_0", "embedding": [ -0.08673211187124252, -0.0027455270756036043, -0.00990036129951477, 0.02006872557103634, 0.14954394102096558, -0.08192066103219986, 0.02627752348780632, -0.023531856015324593, -0.017553627490997314, -0.08207831531763077, 0.0245150625705719, 0.025380214676260948, -0.00016532382869627327, 0.022689547389745712, -0.11754073202610016, 0.07327085733413696, -0.06485869735479355, -0.01149011217057705, 0.035728950053453445, -0.07387389242649078, -0.07288583368062973, 0.1009972095489502, 0.010912608355283737, 0.0031726269517093897, -0.03246085345745087, 0.02593350037932396, 0.04734416306018829, 0.038620032370090485, -0.048906002193689346, -0.03985677286982536, 0.05326422303915024, -0.018769286572933197, -0.020963022485375404, -0.008701915852725506, 0.06801411509513855, -0.02208804525434971, -0.0032732118852436543, -0.002889650873839855, 0.013354904018342495, -0.023560473695397377, 0.055009625852108, -0.08564935624599457, 0.06246905028820038, 0.007248294539749622, -0.03939489275217056, 0.01422606036067009, -0.06043790653347969, -0.07593531906604767, 0.08681093901395798, -0.0390988290309906, -0.07456254214048386, -0.11499594897031784, -0.0374581478536129, -0.01932476833462715, -0.05279077589511871, -0.07121454179286957, -0.025610612705349922, -0.07624231278896332, 0.01597612537443638, -0.02375108003616333, 0.062008991837501526, -0.0017642868915572762, 0.021349120885133743, 0.03296276181936264, 0.028267625719308853, 0.014594844542443752, -0.03521367534995079, 0.037932973355054855, -0.009027677588164806, 0.06218380481004715, 0.04266776517033577, 0.06844738870859146, -0.053679171949625015, 0.0032887631095945835, 0.04939936101436615, -0.06614220887422562, -0.026530619710683823, -0.009807895869016647, 0.058028120547533035, -0.04900962859392166, -0.04604291543364525, -0.028739340603351593, 0.05791502445936203, 0.021376650780439377, 0.08890151232481003, 0.003312950022518635, -0.054120320826768875, 0.06539733707904816, 0.034315336495637894, -0.039097175002098083, -0.05402582883834839, 0.01457623764872551, 0.026656681671738625, 0.04254292696714401, 0.00842257309705019, 0.08581771701574326, -0.014919085428118706, -0.03530262038111687, 0.0014644479379057884, 0.087567999958992, 0.014776590280234814, -0.051046472042798996, -0.03974645957350731, 0.04896130785346031, 0.053614914417266846, 0.043544597923755646, 0.06880950182676315, 0.042627815157175064, 0.04287212714552879, -0.01455916091799736, -0.01957288198173046, -0.024198858067393303, 0.008348974399268627, -0.013950069434940815, -0.01883014477789402, -0.035053566098213196, 0.11149689555168152, 0.06982702016830444, -0.002224551746621728, -0.02116512507200241, 0.061528921127319336, 0.01586787961423397, -0.07577534019947052, -0.0342000275850296, -0.06082987040281296, 0.010469812899827957, -0.03546319156885147, 5.317028741076003e-33, 0.03349655866622925, -0.04861384257674217, -0.04357815161347389, -0.033502109348773956, 0.055617060512304306, 0.013525407761335373, -0.0818408876657486, -0.012917683459818363, -0.040302880108356476, 0.0626075267791748, -0.08835430443286896, -0.013727318495512009, -0.020920468494296074, -0.020380664616823196, -0.012681188993155956, -0.021472414955496788, 0.041294801980257034, 0.06273071467876434, 0.013644961640238762, -0.022388098761439323, -0.04507021605968475, -0.033745672553777695, -0.03350992873311043, 0.008671759627759457, -0.025189878419041634, 0.06758654862642288, -0.05551038682460785, -0.004242292605340481, -0.016644097864627838, 0.021099306643009186, -0.030460592359304428, 0.06002470478415489, -0.04862620308995247, -0.08000152558088303, 0.024090245366096497, -0.01731250248849392, -0.019909856840968132, 0.011667824350297451, 0.028187915682792664, -0.05458230525255203, -0.0032512189354747534, -0.048449549823999405, -0.04547828063368797, -0.06416426599025726, 0.010238045826554298, 0.06193791702389717, 0.05879853293299675, 0.028452157974243164, -0.015229539014399052, -0.07063642144203186, -0.12816837430000305, -0.015222671441733837, -0.004654965829104185, -0.057045161724090576, -0.04126117751002312, -0.02818973921239376, -0.0028223921544849873, 0.07707313448190689, 0.001132153905928135, -0.06030254811048508, 0.08892641961574554, 0.030939366668462753, 0.07245990633964539, -0.07156293839216232, 0.03489883989095688, -0.032787222415208817, 0.07199303060770035, 0.11741676181554794, 0.01402713917195797, 0.10724764317274094, -0.014377147890627384, 0.04072791337966919, -0.001449933391995728, -0.015221803449094296, 0.01849638670682907, -0.0676647275686264, 0.044206999242305756, -0.04222704470157623, -0.0033625925425440073, -0.0002823464456014335, 0.002573304809629917, -0.08927442133426666, 0.04320511594414711, -0.0739167332649231, -0.04507528617978096, 0.018713176250457764, -0.014366759918630123, 0.019858555868268013, -0.011524876579642296, 0.004344678949564695, -0.05455032363533974, -0.017043277621269226, -0.0699196606874466, -0.011407742276787758, -0.10384814441204071, -5.732945825703791e-33, 0.0027352722827345133, 0.06534495949745178, -0.07592860609292984, 0.020400486886501312, 0.041016221046447754, 0.0034738618414849043, 0.007506096735596657, 0.12037581205368042, 0.019918467849493027, 0.055302221328020096, 0.04320549964904785, -0.03250599279999733, 0.01137187983840704, -0.02479604259133339, 0.0931001752614975, 0.09604207426309586, -0.08652132749557495, 0.029455816373229027, -0.05527094751596451, -0.016196610406041145, -0.10745062679052353, 0.06193779781460762, -0.0552561990916729, -0.017578449100255966, -0.025645550340414047, 0.08323705196380615, -0.05411267653107643, 0.04591851308941841, -0.05193138122558594, -0.012936723418533802, -0.08626069128513336, 0.05838335305452347, -0.0773848220705986, 0.03696252033114433, 0.056977495551109314, 0.054217737168073654, 0.09532247483730316, -0.08170578628778458, 0.03275022655725479, -0.014966607093811035, 0.03252658247947693, 0.12448924034833908, -0.023180902004241943, 0.05322309583425522, 0.006140511482954025, 0.029802078381180763, 0.09517586976289749, 0.04250325635075569, -0.01831663027405739, -0.038165412843227386, -0.025758633390069008, 0.0035212140064686537, 0.016366509720683098, 0.0014483589911833405, -0.06670698523521423, 0.06840681284666061, -0.038672979921102524, 0.05350310355424881, -0.04716664180159569, 0.04604218900203705, -0.035128746181726456, -0.09710098803043365, -0.08487976342439651, -0.012341166846454144, 0.026564525440335274, -0.04920732602477074, -0.08664610981941223, 0.0858297049999237, -0.030868588015437126, -0.03642479330301285, 0.0757913738489151, 0.09249120950698853, -0.04220646619796753, -0.016122035682201385, -0.09419997036457062, -0.0454941987991333, 0.08427643030881882, -0.038441017270088196, -0.01386116724461317, 0.014111923985183239, 0.026245279237627983, -0.0036825984716415405, 0.03459011763334274, 0.014519521966576576, 0.014752956107258797, 0.03852389380335808, 0.04391593858599663, 0.0541895255446434, -0.014670937322080135, -0.07996559888124466, -0.04260275140404701, -0.007924587465822697, -0.008490605279803276, 0.06619969010353088, -0.0015776270302012563, -4.7770768674126884e-08, -0.01152798905968666, 0.020152157172560692, -0.021295972168445587, -0.029212620109319687, 0.05070006474852562, 0.0713028535246849, -0.030776191502809525, 0.054044920951128006, -0.05116080865263939, 0.00787696335464716, 0.030100280418992043, -0.05275053530931473, -0.02594330534338951, 0.02276759035885334, -0.07529064267873764, 0.08142970502376556, -0.09165610373020172, 0.10448449850082397, -0.02300478145480156, -0.04117758572101593, 0.09779173880815506, -0.016173040494322777, 0.041481733322143555, -0.0024374648928642273, -0.062238700687885284, -0.05144970491528511, -0.06315130740404129, -0.006095589604228735, 0.052243102341890335, -0.026086827740073204, -0.08680643141269684, 0.0007617376977577806, 0.055226050317287445, -0.04561103135347366, 0.018042637035250664, 0.1004793792963028, -0.009863799437880516, -0.04498559981584549, -0.0013620415702462196, -0.04629533737897873, -0.0013451053528115153, 0.05504002794623375, -0.029077278450131416, 0.055346764624118805, -0.019040865823626518, 0.012825924903154373, 0.00602559233084321, -0.09912293404340744, 0.01864723302423954, -0.02267623320221901, 0.03835463151335716, -0.0437457337975502, 0.05360379070043564, 0.08901753276586533, 0.03310893848538399, -0.07564205676317215, -0.02836063876748085, 0.002362158615142107, 0.010956459678709507, 0.03965847194194794, 0.10780216753482819, 0.06343947350978851, 0.03490171208977699, -0.015381859615445137 ] }, { "text": "---\ntitle: \"K-means with Numpy\"\nid: \"kmeans\"\ncategory: \"machine-learning\"\ntags: [\"machine learning\", \"unsupervised learning\", \"numpy\", \"medium\"]\nrelated: [\"ml\"]\ndate: \"2023-03-07\"\ndescription: \"Explanation of K-means algorithm with Numpy\"\n---\n\nIn this post, I will explain the K-means algorithm via Numpy. Continue reading by clicking [here](https://medium.com/@balci.pelin/k-means-with-numpy-3c207398c4d4)", "source": "2023-03-07-K_means_with_numpy.md", "type": "markdown", "chunk_id": "2023-03-07-K_means_with_numpy.md_0", "embedding": [ -0.03579070419073105, -0.014197777956724167, 0.02513715624809265, -0.026338372379541397, 0.031943123787641525, -0.06430596113204956, -0.02552008628845215, -0.06746523082256317, -0.06084223836660385, 0.024273356422781944, 0.03019186295568943, -0.040355533361434937, 0.058794308453798294, -0.02783200331032276, -0.10573308914899826, 0.010667367838323116, -0.03166483715176582, -0.07082109153270721, -0.0018233361188322306, -0.08552800118923187, 0.041803810745477676, 0.059381525963544846, 0.02827962301671505, 0.028795097023248672, 0.041503939777612686, 0.08709318190813065, -0.012065376155078411, -0.006669728551059961, 0.026035325601696968, 0.047675199806690216, -0.04748981073498726, 0.04612772911787033, 0.09032280743122101, -0.013708068057894707, 0.01609954982995987, 0.01247677206993103, -0.026706146076321602, 0.015511258505284786, -0.11918897926807404, 0.06161230802536011, 0.026586763560771942, -0.03650665283203125, 0.034639954566955566, -0.021572144702076912, -0.01779947057366371, 0.134329155087471, -0.051759276539087296, -0.05913006141781807, 0.026932869106531143, -0.03718710318207741, -0.012973874807357788, -0.03778504580259323, -0.11300382018089294, 0.05164523050189018, -0.060071803629398346, -0.0676114559173584, -0.05831458792090416, 0.013836683705449104, 0.07176430523395538, -0.04467674344778061, 0.03485951945185661, -0.04729127138853073, 0.015999579802155495, 0.051427412778139114, 0.014688225463032722, -0.011626145802438259, -0.0038945365231484175, 0.04204670712351799, -0.025617320090532303, -0.02148979902267456, 0.09298831224441528, -0.000774840300437063, -0.02698863483965397, 0.03158542513847351, 0.03460259363055229, -0.03405159339308739, 0.06590145081281662, -0.01085467915982008, -0.03271025791764259, -0.019688120111823082, -0.02255217544734478, 0.01885095052421093, -0.003944364842027426, -0.033593811094760895, -0.004983359947800636, -0.0625317394733429, -0.07638928294181824, -0.01807384192943573, 0.05584850162267685, -0.03581409901380539, -0.011457394808530807, -0.010151227936148643, -0.038383979350328445, -0.05070154741406441, -0.008877350948750973, -0.032583773136138916, -0.023083455860614777, 0.027053704485297203, 0.018626468256115913, 0.029524192214012146, 0.006201501935720444, 0.04610912874341011, -0.03626357018947601, -0.03574574738740921, 0.06527853012084961, -0.016028981655836105, 0.07611776888370514, -0.007922563701868057, 0.04380357265472412, 0.035907451063394547, -0.0264760572463274, -0.03470694273710251, -0.04760037735104561, 0.04975767433643341, 0.02529747039079666, 0.0006650181603617966, 0.08022809028625488, 0.021373312920331955, 0.04035797715187073, -0.01576932705938816, 0.008201966062188148, -0.04105859249830246, -0.00584162725135684, -0.03837408125400543, 0.003510209498926997, 0.03225984796881676, -0.022807667031884193, 2.4878461824520368e-33, -0.0125662162899971, -0.01470278948545456, 0.06169011443853378, -0.08557410538196564, -0.01054210215806961, -0.027736777439713478, -0.03549562767148018, -0.05742325261235237, 0.012022820301353931, 0.00893809087574482, -0.06570367515087128, 0.07438512146472931, -0.04594513028860092, 0.02299809642136097, 0.02580857090651989, -0.004395605996251106, 0.11894930899143219, -0.012344448827207088, 0.010178323835134506, -0.011716790497303009, 0.07434824854135513, 0.007466784678399563, 0.007564476225525141, 0.019602999091148376, -0.10765150934457779, -0.0007631541811861098, -0.006534670013934374, -0.049402397125959396, 0.05022955313324928, 0.02439412847161293, -0.03384668380022049, 0.04837612435221672, -0.056036680936813354, -0.016549937427043915, -0.023556213825941086, 0.02375214174389839, 0.010125497356057167, 8.540927956346422e-05, 0.03639783337712288, -0.042848993092775345, -0.027767404913902283, 0.02986452728509903, -0.003858116688206792, -0.09690164029598236, -0.02985832281410694, 0.079860620200634, 0.006869406905025244, 0.02216603048145771, 0.028436006978154182, 0.027324873954057693, -0.06254185736179352, -0.08277194201946259, 0.028289850801229477, -0.015547024086117744, -0.02248939871788025, 0.07584463059902191, 0.07330789417028427, 0.017214704304933548, -0.04530845582485199, -0.0992487221956253, 0.02640771120786667, -0.06463399529457092, 0.054538413882255554, -0.009710893034934998, 0.01814948208630085, -0.054601799696683884, 0.03183554857969284, 0.11589036136865616, 0.011005393229424953, 0.06457486748695374, -0.08475065976381302, 0.11033950746059418, -0.05872984603047371, 0.021817758679389954, 0.02790019102394581, -0.03221750259399414, 0.04227772355079651, -0.025519834831357002, -0.06424739956855774, 0.028359703719615936, 0.049997735768556595, -0.010600302368402481, -0.07992527633905411, -0.09154190123081207, 0.025099100545048714, 0.05534505844116211, 0.017223557457327843, -0.007546931505203247, -0.07547682523727417, -0.0825560986995697, -0.1092224195599556, 0.046787381172180176, -0.02058759517967701, 0.07876908779144287, -0.11241165548563004, -4.5775946726087975e-33, -1.0599553206702694e-05, 0.08470847457647324, -0.05680876597762108, 0.11687016487121582, 0.07519331574440002, -0.013933728449046612, -0.06549476087093353, 0.08708754181861877, 0.033927131444215775, 0.011125204153358936, 0.03296690434217453, -0.1363784819841385, 0.02731240540742874, 0.0346866250038147, 0.0990636795759201, -0.005613178014755249, -0.008204780519008636, 0.05874687805771828, -0.020997043699026108, -0.03317667171359062, -0.0931641161441803, -0.02453073114156723, -0.027410222217440605, -0.052090391516685486, -0.06634992361068726, 0.029113387688994408, -0.03411638364195824, 0.006846579257398844, -0.05548812076449394, 0.001063087023794651, -0.03767034038901329, -0.02500077150762081, -0.12326458096504211, 0.04733255133032799, -0.005661219358444214, 0.025827428326010704, 0.02892681024968624, -0.059715017676353455, -0.04167524352669716, -0.04802153632044792, 0.04807479679584503, 0.10649796575307846, -0.0035852408036589622, -0.010445005260407925, 0.011126641184091568, -0.0228742565959692, 0.07574484497308731, -0.004328268114477396, -0.006331360433250666, -0.11686176806688309, 0.006291297730058432, -0.016395816579461098, -0.012067293748259544, 0.02503313310444355, -0.04241110011935234, 0.0644426941871643, -0.038796067237854004, 0.09879589080810547, -0.01051238365471363, -0.09026690572500229, -0.0469789020717144, -0.1807555854320526, -0.09426464885473251, 0.019799569621682167, -0.0682535395026207, -0.0275996346026659, -0.01200233493000269, 0.03171294555068016, -0.06383343040943146, 0.03174794465303421, 0.03717885538935661, 0.07087361067533493, 0.04772650822997093, -0.032650139182806015, -0.1236933097243309, -0.05385275185108185, 0.02950432151556015, -0.04425669461488724, 0.01791875809431076, -0.03551256284117699, 0.035262029618024826, -0.04782950133085251, 0.018936701118946075, 0.0703003779053688, 0.092282734811306, 0.02050985023379326, 0.08870203793048859, 0.046207886189222336, -0.007550952490419149, 0.0013355001574382186, -0.0005171939847059548, 0.003780272090807557, 0.007558966055512428, 0.09819301217794418, -0.0530233271420002, -4.8352916337535135e-08, 0.0400724932551384, -0.06276512891054153, -0.07612889260053635, -0.011769293807446957, 0.09279897809028625, 0.06472592800855637, -0.054134223610162735, 0.05442006140947342, -0.034756503999233246, -0.08283267170190811, 0.04691052436828613, 0.005550071131438017, -0.05559670925140381, 0.010142958723008633, -0.05883044749498367, 0.11416326463222504, -0.020091373473405838, 0.06962992250919342, 0.044423364102840424, 0.003302220720797777, 0.051183272153139114, -0.08887781202793121, 0.04827268421649933, 0.028625521808862686, -0.039872538298368454, 0.04097989946603775, 0.01458622794598341, 0.03664567321538925, -0.0014280278701335192, 0.018894949927926064, -0.061066124588251114, -0.038322947919368744, 0.05777265504002571, -0.023129383102059364, 0.052987925708293915, 0.05700916051864624, -0.04177796468138695, 0.020620327442884445, 0.02825273759663105, -0.02210337668657303, -0.05536016821861267, 0.0709574818611145, -0.007869848981499672, 0.0017758418107405305, 0.0037761442363262177, 0.053940534591674805, 0.09237219393253326, 0.04496891424059868, -0.03088919259607792, 0.027532393112778664, 0.0527091883122921, -0.031178129836916924, -0.011760085821151733, 0.012635558843612671, 0.01973431371152401, -0.053928714245557785, 0.010077930986881256, -0.047393135726451874, 0.0953960195183754, -0.022290121763944626, 0.05560816079378128, 0.04052495211362839, 0.03994949534535408, 0.0546487532556057 ] }, { "text": "---\ntitle: \"Review of Arduino TinyML Kit Sensors\"\nid: \"arduinosensor\"\ncategory: \"edge-ml\"\ntags: [\"edge machine learning\", \"sensor\", \"arduino\", \"medium\"]\nrelated: [\"dl\"]\ndate: \"2025-09-03\"\ndescription: \"Getting Started with Tiny Machine Learning\"\n---\n\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/review-of-arduino-tinyml-kit-sensors-b982f00518c7)\n\nBefore jumping into machine learning, it’s fun to simply play with the kit — blink an LED, read motion data, or snap a picture. In this post, we’ll walk through some quick tests (Blink → IMU → Camera) that help you explore the hardware and get comfortable before machine learning applications.", "source": "2025-09-03-ArduinoTinyMLKitSensors.md", "type": "markdown", "chunk_id": "2025-09-03-ArduinoTinyMLKitSensors.md_0", "embedding": [ -0.028101293370127678, -0.028716249391436577, 0.04165087267756462, 0.001038523274473846, 0.06674034893512726, -0.03391025960445404, 0.045574355870485306, 0.002596233505755663, -0.12310119718313217, 0.05419740080833435, 0.07897220551967621, -0.02326795645058155, -0.03791903331875801, -0.03861736133694649, -0.025372080504894257, 0.05344071984291077, 0.011478977277874947, 0.01409110613167286, -0.010251577943563461, -0.07397843152284622, -0.013593355193734169, -0.12922987341880798, 0.00968474056571722, -0.05039940029382706, -0.04547543078660965, 0.06876113265752792, 0.08122245967388153, 0.02031541056931019, -0.009009119123220444, -0.017308255657553673, 0.018427405506372452, -0.0027421803679317236, 0.030909409746527672, -0.004679936449974775, -0.00616983650252223, 0.016310665756464005, 0.07412410527467728, -0.04931977018713951, -0.013326674699783325, -0.04381135478615761, -0.01625976897776127, -0.06490933150053024, 0.045167889446020126, -0.04313971474766731, 0.0802653580904007, 0.053127143532037735, 0.0930238664150238, -0.10272510349750519, -0.056647129356861115, -0.015241630375385284, -0.07241791486740112, -0.09607444703578949, -0.02672461047768593, 0.007908299565315247, -0.037006933242082596, -0.025281092151999474, -0.0551205538213253, -0.010666086338460445, 0.04599863290786743, 0.01229744404554367, 0.04874211177229881, -0.061259735375642776, -0.004247273784130812, 0.013238277286291122, -0.02742968313395977, 0.006340055726468563, 0.05327094346284866, -0.04455601051449776, 0.08622142672538757, -0.10006828606128693, 0.01664559356868267, 0.0552513562142849, 0.042611263692379, 0.09220314025878906, -0.04385438933968544, -0.0846673920750618, 0.046383243054151535, -0.016064027324318886, -0.0250349473208189, 0.044818416237831116, -0.06929139047861099, -0.030683401972055435, -0.05076931416988373, 0.02538043074309826, 0.05889613926410675, 0.056046489626169205, -0.017654893919825554, 0.10592984408140182, -0.045678816735744476, -0.038801588118076324, 0.006068361457437277, -0.028149517253041267, -0.04669219255447388, -0.04279591143131256, 0.0759921595454216, -0.004022657405585051, -0.02288278006017208, -0.11094611138105392, -0.08754611015319824, 0.029384031891822815, -0.013890298083424568, -0.057977527379989624, -0.006558647844940424, 0.042265355587005615, 0.06417704373598099, 0.008805805817246437, 0.010779189877212048, 0.015343124978244305, 0.141482412815094, 0.023699402809143066, -0.05048017203807831, 0.03550262004137039, -0.05033598840236664, -0.0025811470113694668, -0.039202798157930374, -0.06990339607000351, -0.04163062945008278, -0.019321909174323082, 0.0912901908159256, 0.05142996087670326, -0.0017591776559129357, 0.03990049287676811, -0.08883990347385406, -0.01240639016032219, 0.08378952741622925, -0.033304013311862946, -0.09888798743486404, 3.028032305415934e-33, 0.037376031279563904, 0.08900702744722366, -0.015745360404253006, 0.013130745850503445, 0.04644028842449188, -0.03716452419757843, 0.08046227693557739, -0.05505586043000221, -0.006100445985794067, 0.03759433701634407, -0.02103252336382866, -0.02161373756825924, -0.052332427352666855, 0.0863690972328186, 0.052480634301900864, -0.05599580705165863, -0.025635764002799988, -0.07433266937732697, 0.03203172981739044, 0.01855245605111122, 0.0014470696914941072, -0.052470095455646515, 0.017490074038505554, 0.0938829556107521, 0.02932102046906948, 0.11318138241767883, 0.050356969237327576, 0.01760844700038433, 0.05822591111063957, 0.03769296780228615, -0.08170580863952637, 0.06381155550479889, -0.05676424130797386, -0.05342830345034599, 0.07326152920722961, 0.0023572200443595648, -0.007941236719489098, -0.01788567379117012, 0.0037759689148515463, -0.05146880820393562, -0.035403016954660416, 0.07773182541131973, 0.02925894409418106, -0.0861571654677391, -0.007363224867731333, 0.0009631792781874537, -0.0005671213148161769, 0.03368966653943062, 0.013590652495622635, 0.03374544903635979, 0.009304717183113098, -0.08327718079090118, 0.013156176544725895, -0.07944899797439575, 0.00953487679362297, 0.017670851200819016, -0.026217063888907433, 0.017317883670330048, -0.007861560210585594, 0.012106810696423054, -0.0014120821142569184, -0.04412608966231346, 0.06675444543361664, 0.07195200026035309, -0.008682644926011562, 0.053565848618745804, 0.03395161032676697, 0.05488327145576477, 0.020800592377781868, -0.011931889690458775, -0.045688919723033905, 0.014443814754486084, 0.004121406003832817, -0.07482242584228516, 0.07286711782217026, 0.040103696286678314, -0.0006328372401185334, -0.03314005210995674, -0.030398957431316376, -0.0068912566639482975, 0.006526028271764517, -0.004985513631254435, 0.01604451611638069, -0.04472876712679863, -0.0036194503773003817, -0.00021448652842082083, -0.016721118241548538, -0.045321494340896606, -0.107683464884758, -0.01918392814695835, -0.02424330823123455, 0.04730524867773056, -0.027435781434178352, 0.04829896613955498, -0.10001184791326523, -3.54608331874087e-33, 0.03551168367266655, 0.024656418710947037, -0.006800363305956125, 0.09947372227907181, -0.04416284337639809, 0.0032389312982559204, 0.11391738802194595, 0.06226796656847, 0.02826746553182602, 0.041080351918935776, -0.006382967811077833, 0.010491502471268177, -0.05282609537243843, 0.015663685277104378, -0.04519469290971756, 0.04488609731197357, -0.021173087880015373, -0.0989958643913269, 0.058856505900621414, -0.023765932768583298, -0.04179465398192406, 0.04915366694331169, -0.03316072002053261, -0.06060676649212837, -0.031136266887187958, 0.05019349977374077, 0.04625006020069122, 0.048773251473903656, -0.05872342362999916, -0.06794910877943039, -0.01983957178890705, -0.04946719855070114, 0.016683440655469894, -0.026896486058831215, 0.041751135140657425, 0.034052640199661255, 0.06316016614437103, -0.09036312997341156, 0.0002424099948257208, -0.0019422941841185093, 0.0846247747540474, 0.02963743917644024, -0.04083710163831711, -0.05605858191847801, -0.07414868474006653, 0.000764791271649301, -0.012869350612163544, 0.06602507084608078, -0.06746324151754379, -0.02799021638929844, -0.034182917326688766, 0.03295678645372391, -0.05730513483285904, -0.0576753094792366, -0.04502493888139725, -0.015538492240011692, 0.045309990644454956, 0.08123984187841415, 0.030619321390986443, 0.016253717243671417, -0.0420868955552578, -0.09862665832042694, -0.0035788463428616524, -0.011375922709703445, -0.05395015701651573, 0.024572789669036865, 0.026075230911374092, -0.02625385671854019, -0.011539071798324585, -0.009705605916678905, 0.03872166574001312, 0.054913654923439026, 0.09744229912757874, -0.017365919426083565, -0.03953777626156807, -0.042972881346940994, -0.005474289879202843, -0.04953387752175331, 0.003810612019151449, -0.04406718164682388, 0.029400281608104706, -0.12050244212150574, -0.028365137055516243, 0.09712152928113937, 0.0591759979724884, 0.04223978519439697, 0.04015225172042847, -0.0513702854514122, -0.0005392791354097426, -0.006066685542464256, -0.08333562314510345, 0.12224306166172028, 0.07988956570625305, 0.04691126570105553, -0.09932783246040344, -5.454673512872432e-08, -0.06399349123239517, 0.027052011340856552, 0.008654775097966194, -0.018204927444458008, 0.0534408763051033, 0.026525409892201424, -0.03098716400563717, 0.06694062799215317, -0.006842738017439842, -0.01765170320868492, 0.07248476147651672, -0.008237602189183235, -0.049838531762361526, 0.05774730071425438, 0.06478957831859589, 0.04132441431283951, -0.005749513395130634, -0.0361766517162323, 0.011365163139998913, -0.0013233061181381345, 0.02127125672996044, 0.0026834113523364067, 0.02639724500477314, 0.013517938554286957, 0.06679335236549377, -0.058011773973703384, -0.00030666388920508325, 0.044908929616212845, 0.005975039675831795, -0.03781183809041977, -0.10090464353561401, 0.04726539924740791, 0.1333981454372406, 0.019267743453383446, -0.009554683230817318, 0.012745295651257038, -0.01851860247552395, 0.0035918131470680237, 0.03321953862905502, -0.023724447935819626, -0.03601163253188133, 0.020596839487552643, -0.08237488567829132, -0.04313124716281891, -0.08870644122362137, -0.04257596656680107, 0.10237862169742584, -0.10527976602315903, -0.0344739593565464, 0.09440162032842636, 0.06376044452190399, 0.021939581260085106, -0.001544396160170436, 0.012708274647593498, 0.05130332335829735, 0.019996361806988716, 0.08453452587127686, -0.07912153005599976, 0.011181898415088654, 0.06231667473912239, 0.04468164220452309, 0.014860172756016254, -0.08964613825082779, 0.05077424645423889 ] }, { "text": "---\ntitle: \"Fast Fourier Transform\"\nid: \"fft\"\ncategory: \"edge-ml\"\ntags: [\"edge machine learning\", \"fft\", \"audio\"]\nrelated: [\"edge-audio\"]\ndate: \"2021-01-01\"\ndescription: \"A motion classifier project with Edge Impulse & Arduino\"\n---\n\n\n
\n\n
", "source": "2021-12-19-Fast_Fourier_Transform.md", "type": "markdown", "chunk_id": "2021-12-19-Fast_Fourier_Transform.md_0", "embedding": [ -0.07958763092756271, -0.008250633254647255, -0.059454742819070816, -0.03483470156788826, 0.06786148250102997, -0.006929289549589157, -0.051040373742580414, -0.058502040803432465, -0.03296009078621864, -0.08900710940361023, 0.006116344127804041, 0.01670559123158455, -0.10623287409543991, -0.010517922230064869, -0.03247334808111191, 0.03531145676970482, -0.003993517719209194, 0.05698448047041893, -0.03777250647544861, -0.060356561094522476, -0.012296685017645359, -0.016483046114444733, -0.024173937737941742, -0.01797463744878769, 0.02977747656404972, 0.10378611832857132, -0.024229267612099648, 0.04101783037185669, 0.026333335787057877, -0.05815012753009796, 0.091192826628685, 0.02223515696823597, 0.0464729443192482, 0.02244746871292591, -0.03621289134025574, -0.07248562574386597, -0.003947341814637184, 0.03259309008717537, 0.05879011005163193, 0.04178059101104736, 0.03272902965545654, -0.007373570930212736, 0.04357897490262985, -0.05765359848737717, -0.038013920187950134, 0.033285580575466156, -0.05666761100292206, -0.07359244674444199, -0.019338056445121765, 0.0010477096075192094, -0.033694423735141754, -0.08506041020154953, -0.03742247074842453, 0.02945661172270775, -0.06096310541033745, -0.008680591359734535, 0.0118339154869318, -0.0008927881135605276, 0.07651443779468536, 0.01451703067868948, 0.007761090062558651, 0.002535249339416623, 0.040509793907403946, 0.017582638189196587, -0.030762379989027977, 0.05161803588271141, -0.052748218178749084, 0.013491475023329258, -0.07044830173254013, 0.015983685851097107, -0.0021810652688145638, 0.027794186025857925, -0.009439772926270962, 0.0663067027926445, 0.08104437589645386, -0.08941727876663208, -0.0463005006313324, 0.03369284048676491, -0.06593475490808487, -0.002194596454501152, 0.027394553646445274, -0.1211809441447258, -0.037136003375053406, 0.011631260626018047, 0.08985593914985657, 0.084696926176548, -0.054082587361335754, 0.0025830641388893127, -0.11359819024801254, -0.03840767592191696, -0.08758049458265305, 0.017127512022852898, 0.0522998683154583, -0.008126791566610336, -0.0018160253530368209, 0.0796511247754097, -0.10443402826786041, -0.06319354474544525, -0.07819103449583054, 0.04875520244240761, -0.029627539217472076, -0.11155092716217041, -0.035303324460983276, 0.02648336812853813, -0.03904270753264427, -0.015337923541665077, -0.03764699399471283, 0.15054449439048767, 0.039265766739845276, 0.011013000272214413, 0.020008977502584457, 0.00941835530102253, -0.05285533517599106, -0.051366161555051804, -0.019366370514035225, -0.03129975497722626, -0.03926600515842438, -0.010260986164212227, 0.14438354969024658, -0.02274446375668049, 0.020756421610713005, 0.07676605880260468, -0.11473111808300018, 0.02726738154888153, 0.020821405574679375, -0.06784209609031677, -0.06794212013483047, 4.3581846112659866e-33, 0.0013290157075971365, 0.044444456696510315, -0.04188982769846916, -0.05735002085566521, 0.06556913256645203, -1.3859027603757568e-05, -0.06803585588932037, -0.04065023735165596, -0.01771637797355652, 0.016856327652931213, -0.03477099537849426, 0.03475315868854523, -0.034756843000650406, 0.0083039915189147, -0.030383124947547913, -0.09414214640855789, -0.02306266874074936, 0.007311063818633556, 0.031366776674985886, -0.01817619800567627, 0.014263128861784935, -0.0020588859915733337, -0.01782981865108013, 0.05147983133792877, -0.10000761598348618, 0.14063625037670135, -0.017585277557373047, -0.041983917355537415, 0.06569436192512512, 0.05838105082511902, -0.1038726270198822, 0.0137673644348979, -0.007753576617687941, -0.12043526023626328, 0.07092994451522827, 0.0061692348681390285, 0.0028212706092745066, 0.0012496295385062695, -0.040897104889154434, -0.036865245550870895, 0.006357149686664343, -0.05812825262546539, -0.07428231090307236, -0.06665180623531342, -0.030375665053725243, 0.020109493285417557, 0.045893337577581406, 0.05508027970790863, 0.060703590512275696, 0.07434623688459396, -0.033956971019506454, -0.033633530139923096, 0.0073849838227033615, -0.01186120044440031, 0.054079700261354446, 0.015970561653375626, -0.010051126591861248, 0.1415601670742035, 0.0023328315000981092, -0.01764565333724022, 0.08279091864824295, -0.016780691221356392, 0.024369245395064354, -0.05932322517037392, 0.0033189880196005106, -0.037885405123233795, 0.04870990291237831, 0.05930474027991295, 0.06093202903866768, -0.022583631798624992, -0.030861875042319298, 0.022975150495767593, 0.04934180900454521, -0.013473025523126125, 0.03951280191540718, -0.03648822009563446, -0.05247368663549423, 0.051806434988975525, -0.04947832226753235, 0.0295941811054945, -0.06694531440734863, -0.05357534810900688, 0.05425795912742615, -0.06046149134635925, 0.06384800374507904, 0.011754916980862617, -0.020175598561763763, -0.06718821823596954, -0.022417942062020302, 0.012592400424182415, -0.03437862545251846, 0.006640094798058271, -0.04116426408290863, 0.08172903954982758, -0.03321905806660652, -4.314998785526699e-33, 0.031908802688121796, 0.09225156903266907, 0.009757354855537415, 0.0733211413025856, 0.015656838193535805, 0.08165193349123001, 0.06817679852247238, 0.12744638323783875, 0.058754537254571915, 0.07893800735473633, 0.10885101556777954, -0.030690953135490417, -0.041671331971883774, -0.04862796142697334, -0.017220696434378624, -0.01629754714667797, -0.014269712381064892, -0.06374088674783707, -0.02084573358297348, 0.011234933510422707, -0.04951666668057442, 0.014937559142708778, -0.01765073649585247, 0.05466795340180397, -0.04290224611759186, 0.07921423017978668, 0.01889270730316639, 0.02501141093671322, 0.001558273215778172, -0.01800885982811451, -0.051739051938056946, -0.013835516758263111, -0.08457649499177933, -0.07346192747354507, 0.007727049756795168, 0.05148051679134369, 0.0737624317407608, -0.003991724457591772, -0.017651505768299103, -0.06772633641958237, -0.02949422039091587, 0.03810203820466995, 0.0005398352514021099, -0.05921041592955589, -0.03987133502960205, 0.05471993237733841, 0.03542519360780716, 0.05354832857847214, -0.028286024928092957, -0.04654877632856369, 0.011858176440000534, 0.03679189458489418, 0.011777784675359726, -0.01339511014521122, -0.02779056318104267, -0.04058092087507248, 0.0012613205472007394, 0.0441494956612587, -0.00497349863871932, 0.06576088815927505, -0.021362368017435074, -0.04308583214879036, -0.0643545389175415, -0.012700420804321766, 0.0672525018453598, 0.04464675113558769, -0.01338061224669218, -0.028572550043463707, -0.005817364435642958, 0.08477307856082916, 0.021621251478791237, 0.0916016697883606, -0.013985840603709221, 0.009002253413200378, -0.049074575304985046, -0.04506310820579529, 0.08699140697717667, -0.0349833220243454, 0.0203128419816494, 0.024886904284358025, -0.026843996718525887, -0.004977768752723932, -0.06289584189653397, 0.011607115156948566, -0.008322623558342457, -0.03960144892334938, -0.012477335520088673, -0.021633056923747063, -0.033171262592077255, -0.005025125108659267, -0.05506402999162674, 0.06595351547002792, 0.04467413201928139, 0.056982964277267456, 0.0064954208210110664, -5.2370257463962844e-08, -0.04733097180724144, 0.04138470068573952, -0.056922540068626404, -0.04568333551287651, 0.04017017409205437, 0.01535989809781313, 0.036583010107278824, 0.01532883383333683, -0.032832756638526917, -0.06623858213424683, 0.05496200546622276, -0.026771027594804764, 0.0014768646797165275, 0.09226436167955399, -0.03354194015264511, 0.0032587461173534393, -0.048615071922540665, 0.12009317427873611, 0.0571008138358593, -0.07459694892168045, 0.06674639880657196, 0.03509887307882309, 0.07508474588394165, -0.0685429647564888, -0.01964084431529045, -0.02805468626320362, -0.021404694765806198, -0.0015920742880553007, 0.07600393891334534, 0.057506706565618515, -0.12413308024406433, 0.03343389928340912, 0.03704291954636574, -0.07314551621675491, -0.003448562230914831, -0.020106393843889236, -0.09490641206502914, 0.015803391113877296, -0.05325055122375488, 0.002823092043399811, 0.052934519946575165, 0.0942804366350174, -0.06481852382421494, 0.021711155772209167, 0.00034959486220031977, 0.03814760223031044, 0.10035654902458191, -0.05649419501423836, -0.018461378291249275, 0.03795085847377777, 0.04466576129198074, 0.025812359526753426, 0.0065489644184708595, -0.0027568533550947905, 0.0547635555267334, 0.04946377873420715, -0.0013925505336374044, -0.0724068135023117, -0.0335695743560791, 0.001055501401424408, 0.0431961789727211, 0.06382520496845245, -0.013300939463078976, 0.08201275020837784 ] }, { "text": "---\ntitle: \"LLM Introduction\"\nid: \"llm\"\ncategory: \"genai\"\ntags: [\"llm\", \"medium\"]\nrelated: []\ndate: \"2023-07-17\"\ndescription: \"LLM Introduction\"\n---\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/llm-introduction-7ededa51b78b)\n\nIf you think that, now that ChatGPT handles everything and you are late to learn it, this article is for you:)", "source": "2023-07-17-LLM_Intro.md", "type": "markdown", "chunk_id": "2023-07-17-LLM_Intro.md_0", "embedding": [ -0.03408751264214516, 0.00023425111430697143, 0.04010273143649101, -0.03914383798837662, 0.05138476565480232, -0.017014317214488983, 0.014230696484446526, 0.05357750877737999, -0.0310972947627306, -0.0037729486357420683, 0.0076120514422655106, 0.01204182393848896, -0.06877446919679642, 0.016959138214588165, 0.05578592047095299, 0.055889327079057693, 0.03057040274143219, -0.040890149772167206, 0.03592744469642639, -0.036623790860176086, 0.020277928560972214, 0.07261978834867477, 0.08365477621555328, 0.013922599144279957, 0.0051185209304094315, 0.011947506107389927, -0.005410601384937763, 0.08256454020738602, 0.04684116691350937, 0.0009979440364986658, 0.006024570669978857, 0.1469232141971588, 0.03999902307987213, 0.06358915567398071, -0.0783592090010643, 0.05366131290793419, -0.008840560913085938, 0.02142195962369442, -0.01103137619793415, 0.007089070975780487, -0.006691822316497564, -0.039399709552526474, 0.016208937391638756, 0.008887591771781445, 0.07628162950277328, -0.023330403491854668, -0.07643701136112213, -0.011287843808531761, -0.08815828710794449, 0.06651020050048828, -0.06771541386842728, -0.03924267739057541, 0.003475948702543974, 0.031181881204247475, 0.02090466395020485, 0.07108932733535767, -0.03374599292874336, -0.012804892845451832, 0.04418336972594261, -0.06943716108798981, -0.013688726350665092, -0.040998101234436035, -0.09168067574501038, 0.010119445621967316, 0.010706868954002857, -0.02271144837141037, 0.0195693951100111, 0.1314789354801178, 0.015704257413744926, -0.043874725699424744, 0.02361937239766121, -0.05154372751712799, -0.04082541912794113, 0.07963530719280243, -0.10720451176166534, 0.06820846349000931, -0.003295718925073743, 0.03517424687743187, -0.010548131540417671, -0.02194611355662346, -0.006454740650951862, 0.045821502804756165, 0.012580566108226776, -0.00797690823674202, -0.0654435083270073, -0.00675213010981679, 0.025636810809373856, 0.02058122307062149, -0.02014625445008278, 0.014025844633579254, -0.004124990664422512, -0.04768240451812744, 0.023108506575226784, 0.12259944528341293, 0.005073984619230032, 0.014063109643757343, 0.011046098545193672, -0.08559215813875198, 0.0012443197192624211, 0.06912590563297272, -0.0017360806232318282, 0.03409646824002266, -0.023533649742603302, 0.0018467921763658524, -0.08893297612667084, -0.0379621647298336, 0.0034880205057561398, 0.035198409110307693, -0.004591125994920731, -0.04117365926504135, -0.03816619887948036, -0.0017243968322873116, 0.015057160519063473, 0.01886601932346821, 0.04345422238111496, -0.025102397426962852, 0.07616083323955536, 0.018832173198461533, 0.10411373525857925, 0.032427817583084106, -0.02112690545618534, -0.04790376126766205, -0.06654664129018784, -0.054963354021310806, -0.06489438563585281, -0.0010643956484273076, -0.03759875148534775, 2.9687387173215268e-33, 0.14419475197792053, -0.05648612603545189, -0.06337923556566238, 0.11442526429891586, 0.012724676169455051, 0.08499462902545929, -0.004536840133368969, -0.006432353984564543, -0.030753299593925476, -0.006213814485818148, -0.03825508430600166, -0.014270337298512459, -0.05494698882102966, 0.003935318905860186, -0.04623778909444809, -0.03201935812830925, -0.05106927454471588, 0.017557179555296898, 0.06352746486663818, -0.004592674784362316, -0.07524287700653076, 0.07381527125835419, 0.032322611659765244, -0.10094348341226578, 0.06289651989936829, 0.14466488361358643, 0.05278649926185608, -0.12344392389059067, 0.0735325738787651, 0.05185103416442871, -0.005603490397334099, -0.018847959116101265, -0.04548978805541992, -0.02929467335343361, 0.021756181493401527, 0.03713410720229149, -0.09159569442272186, -0.06281979382038116, 0.007549194153398275, -0.054840005934238434, 0.007286123465746641, -0.02100263349711895, -0.046502601355314255, -0.12890346348285675, -0.041647396981716156, 0.030841385945677757, 0.014031391590833664, 0.005125643219798803, 0.04276593029499054, 0.03713778778910637, -0.030049961060285568, -0.023432057350873947, -0.12554368376731873, -0.04273105785250664, 0.0027201524935662746, -0.08102152496576309, -0.06498207151889801, 0.0016179961385205388, -0.0563453733921051, -0.026470758020877838, -0.011932430788874626, 0.03765351325273514, 0.000764492666348815, 0.01012820191681385, 0.08580148220062256, -0.0003910888626705855, -0.0643315538764, 0.002629403257742524, 0.03714677318930626, -0.05102322995662689, 0.003915475215762854, -0.01459461823105812, -0.06078118458390236, 0.03780054673552513, -0.024184510111808777, -0.0013356286799535155, 0.008389314636588097, 0.02770877815783024, 0.028327593579888344, 0.04498345032334328, -0.06099995970726013, 0.03789268434047699, -0.05268298462033272, -0.010475383140146732, -0.04366087168455124, -0.05842820182442665, 0.07062754034996033, -0.016404790803790092, 0.02514491230249405, 0.05554744973778725, -0.0887242779135704, -0.0034014019183814526, -0.008948847651481628, 0.10529127717018127, -0.058580432087183, -2.801444198022422e-33, 0.019487012177705765, 0.03930876404047012, -0.047249604016542435, 0.05430489405989647, 0.05673546716570854, -0.0770101323723793, -0.0017429611179977655, 0.11859080940485, 0.04660472646355629, 0.052829496562480927, -0.014686459675431252, -0.06324492394924164, -0.01248372532427311, -0.019840247929096222, 0.04670869931578636, -0.046539612114429474, 0.011050050146877766, -0.010295219719409943, -0.05860205367207527, 0.01582908257842064, -0.029409611597657204, 0.036730993539094925, -0.09369803965091705, 0.0046234275214374065, 0.03273838013410568, 0.03936157375574112, 0.1057281494140625, 0.045459844172000885, -0.08500441163778305, -0.013268396258354187, 0.08120150119066238, -0.03233341500163078, -0.0797458067536354, 0.03433345630764961, 0.0023218446876853704, 0.0517490953207016, 0.13113318383693695, 0.042395275086164474, 0.02550785429775715, -0.008926848880946636, 0.06517487019300461, 0.028182750567793846, -0.021314231678843498, 0.005170579534024, -0.06398414820432663, -0.03741378337144852, -0.0027957307174801826, 0.001787036657333374, 0.031339067965745926, -0.03024335578083992, 0.03898446634411812, -0.08392509818077087, 0.10767823457717896, -0.12979096174240112, 0.009491320699453354, -0.050048261880874634, 0.12236286699771881, -0.01830168627202511, -0.10714658349752426, 0.002144824480637908, 0.023013995960354805, -0.04026932641863823, 0.024223854765295982, -0.027608085423707962, -0.022082770243287086, -0.053249333053827286, -0.03964108228683472, 0.017918959259986877, -0.02131541632115841, -0.021917425096035004, 0.07719389349222183, -0.025517059490084648, -0.06814870238304138, -0.03515848144888878, 0.02444213069975376, -0.03143006190657616, -0.0022328279446810484, 0.020113134756684303, 0.06223149225115776, -0.09670191258192062, 0.03066384047269821, -0.005979962646961212, -0.03452429175376892, 0.100966677069664, 0.050571735948324203, 0.015410037711262703, 0.05420467630028725, 0.058770276606082916, 0.01054970920085907, -0.01407956425100565, -0.01067415066063404, 0.011378438211977482, -0.024929417297244072, 0.05047627165913582, 0.041688814759254456, -5.554115034556162e-08, -0.039124347269535065, -0.15749002993106842, -0.06310654431581497, 0.05874279886484146, -0.02590363658964634, 0.02404206246137619, -0.050956204533576965, 0.027718031778931618, 0.05548308789730072, 0.06114232540130615, 0.017547164112329483, 0.015355300158262253, -0.09098629653453827, -0.008492182940244675, 0.05566179007291794, -0.03957478702068329, -0.02514590322971344, 0.027805376797914505, -0.060461003333330154, -0.033068422228097916, 0.06823942810297012, -0.008909320458769798, 0.035693369805812836, -0.022550858557224274, 0.05156993865966797, -0.05334002152085304, 0.005543020088225603, 0.03522453084588051, -0.018009889870882034, 0.04151463136076927, -0.011727017350494862, 0.02047993615269661, -0.10432509332895279, 0.003096067113801837, -0.004875329788774252, -0.007381709758192301, -0.008939028717577457, -0.07536640763282776, 0.02989129349589348, 0.000612124043982476, 0.09118720144033432, -0.07092761993408203, 0.011221985332667828, 0.05042243003845215, -0.03272199258208275, -0.06026618182659149, -0.009321925230324268, -0.08484748750925064, -0.05141608417034149, -0.05053647235035896, -0.023632481694221497, -0.037943918257951736, 0.0907733365893364, -0.02403171733021736, 0.011330127716064453, 0.053448133170604706, 0.018425866961479187, 0.033906225115060806, 0.04796173423528671, -0.004379554186016321, 0.05196544528007507, 0.0859275609254837, -0.023010820150375366, 0.04371273145079613 ] }, { "text": "---\ntitle: \"Introduction to Deep Learning\"\nid: \"dl\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"neural networks\", \"PyTorch\", \"CNN\", \"RNN\", \"attention\", \"ai-generated\"]\nrelated: [\"transformers\"]\ndate: \"2025-11-24\"\ndescription: \"Comprehensive introduction to deep learning concepts including neural networks, CNNs, RNNs, attention mechanisms, and backpropagation with PyTorch examples\"\n---\n\n# Introduction to Deep Learning\n\n**This article is generated by Claude Opus 4.5**\n\n## Overview\n\nDeep Learning is a subset of machine learning that uses artificial neural networks with multiple layers (hence \"deep\") to learn complex patterns from data. It has revolutionized fields like computer vision, natural language processing, and speech recognition.", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_0", "embedding": [ -0.1318054348230362, -0.05994138866662979, 0.025431746616959572, -0.03021019510924816, -0.003250208217650652, 0.05705750733613968, 0.011980016715824604, -0.048473864793777466, -0.021595004945993423, -0.07770299166440964, -0.04633885622024536, -0.02186901681125164, -0.013792161829769611, -0.0016045555239543319, -0.07666446268558502, 0.04750855267047882, -0.027417821809649467, 0.08592556416988373, -0.16895173490047455, -0.07697233557701111, 0.07056549936532974, 0.013433044776320457, 0.003260193392634392, -0.033931441605091095, 0.018173551186919212, 0.061922650784254074, 0.003443621564656496, -0.0828515961766243, 0.06097493693232536, -0.02054755575954914, 0.05655111372470856, -0.01587012968957424, 0.03321119770407677, 0.07890202850103378, -0.09104946255683899, 0.055835045874118805, -0.11115768551826477, 0.04243279993534088, 0.008837372064590454, 0.02070930041372776, -0.007273436989635229, -0.017095357179641724, -0.014796093106269836, 0.029964018613100052, 0.1168966218829155, 0.09188029915094376, -0.010952068492770195, -0.043038513511419296, 0.023702025413513184, -0.030467282980680466, -0.07802038639783859, -0.04907144978642464, -0.015801630914211273, 0.1044655293226242, 0.002587166614830494, 0.04335504025220871, 0.014575140550732613, 0.002157478127628565, 0.03386211022734642, -0.022118253633379936, 0.05616861209273338, -0.03402223810553551, 0.03280598670244217, -0.05132223293185234, -0.01339675486087799, 0.0122534753754735, -0.022925028577446938, 0.018330540508031845, 0.017382951453328133, -0.05562090873718262, -0.014849087223410606, 0.08885259181261063, -0.009335627779364586, 0.01875860057771206, 0.048903267830610275, 0.008368088863790035, 0.01853589341044426, -0.03407648205757141, 0.04201846942305565, -0.040384404361248016, 0.05100312829017639, 0.013847730122506618, 0.016758831217885017, -0.00713213998824358, 0.1012377142906189, -0.027037987485527992, -0.0667470172047615, -0.025516267865896225, -0.06542893499135971, -0.03424440324306488, -0.06523029506206512, -0.0950869768857956, -0.02325616218149662, -0.03921050205826759, -0.009440861642360687, 0.0284197349101305, -0.025690749287605286, -0.11127018183469772, -0.036466170102357864, 0.03402334079146385, -0.014950789511203766, -0.04735814779996872, 0.038495615124702454, 0.040915682911872864, 0.006927310023456812, -0.03048684448003769, 0.06171761080622673, 0.05639512464404106, 0.052648141980171204, -0.05789310485124588, -0.0014980596024543047, 0.014812360517680645, 0.0032169069163501263, -0.08837699145078659, 0.07818165421485901, -0.033716581761837006, -0.009895591996610165, 0.02910240925848484, 0.015883563086390495, 0.061962634325027466, -0.04078257456421852, 0.019245894625782967, -0.06847437471151352, 0.04499426856637001, -0.0032371615525335073, -0.052695125341415405, -0.03789708390831947, 3.934953747724176e-33, 0.009546296671032906, -0.014944041147828102, 0.012885786592960358, 0.06343056261539459, 0.0382850356400013, -0.04527850076556206, -0.017494024708867073, -0.008361920714378357, -0.018461117520928383, 0.06767895817756653, -0.05309004336595535, 0.029600663110613823, -0.07305285334587097, 0.16548490524291992, -0.050178080797195435, -0.06197866424918175, 0.004983770661056042, -0.016844114288687706, 0.028677145019173622, -0.029440030455589294, 0.030369333922863007, 0.04069986939430237, 0.005719620268791914, -0.013711635023355484, -0.03049282915890217, 0.04439755901694298, 0.04640878364443779, -0.07314441353082657, 0.0364854522049427, 0.0027095333207398653, -0.07575944066047668, 0.057743508368730545, -0.0626436099410057, -0.021954406052827835, 0.0018067093333229423, -0.025794100016355515, -0.021509362384676933, 0.009782212786376476, 0.014434325508773327, -0.03285836800932884, -0.0269455648958683, -0.006941190920770168, -0.08644934743642807, -0.04824931547045708, -0.004218148533254862, -0.006952831055969, 0.042640991508960724, 0.005111567210406065, 0.020824294537305832, -0.07077941298484802, 0.004910918418318033, -0.025280671194195747, -0.09813696146011353, -0.06005951762199402, 0.0773569867014885, 0.008428733795881271, 0.010990913026034832, 0.10136150568723679, 0.015529136173427105, 0.03410307317972183, 0.0630635917186737, 0.049855247139930725, -0.04949517920613289, 0.06340198963880539, 0.03275984153151512, 0.010335410945117474, 0.026568353176116943, 0.07940670102834702, 0.060476820915937424, 0.00625693378970027, -0.01755378767848015, 0.05335131287574768, 0.003207268426194787, -0.04642694815993309, 0.009800739586353302, 0.04751544073224068, -0.0024498540442436934, -0.053600896149873734, -0.013263830915093422, 0.03138616308569908, -0.07362084090709686, 0.024197421967983246, -0.025714028626680374, -0.02143988013267517, -0.047841574996709824, 0.06047148257493973, -0.0014720391482114792, -0.10406924039125443, -0.01636788807809353, -0.0005044288118369877, -0.08139453083276749, -0.002610605675727129, -0.008077564649283886, 0.01633211225271225, -0.05882742628455162, -5.9515510407582735e-33, -0.019071439281105995, 0.1305469572544098, -0.11119124293327332, 0.06644750386476517, 0.007419763598591089, -0.02146558091044426, -0.05295800045132637, 0.05178641155362129, -0.046520642936229706, 0.05958625674247742, 0.009354887530207634, -0.0682959258556366, 0.013062970712780952, -0.03309324383735657, 0.057215042412281036, 0.013255860656499863, -0.05748402699828148, -0.04356585070490837, -0.05138631910085678, 0.018735332414507866, -0.04595138132572174, 0.1182006299495697, -0.11332009732723236, 0.005292162764817476, -0.09574001282453537, -0.008681272156536579, -0.056610289961099625, 0.0823284387588501, 0.03978236764669418, 0.028496501967310905, -0.09421668946743011, -0.02681887149810791, -0.04305846989154816, 0.009188314899802208, -0.033337224274873734, 0.0570807084441185, 0.0332561694085598, -0.04735594615340233, -0.041145019233226776, -0.011985368095338345, 0.09943597763776779, -0.0020649421494454145, -0.029926909133791924, -0.004225030541419983, -0.048160627484321594, -0.0537574328482151, -0.045538634061813354, 0.02064412273466587, -0.012094198726117611, 0.017514251172542572, 0.047784868627786636, -0.041574642062187195, -0.09627185016870499, -0.05315375328063965, -0.03830096870660782, 0.015616392716765404, 0.07067825645208359, -0.008095907047390938, 0.06823364645242691, 0.05531543120741844, -0.06533470004796982, -0.07243598997592926, -0.008089433424174786, -0.012394515797495842, -0.02339564450085163, 0.03770676627755165, -0.059170398861169815, 0.03938056156039238, 0.04239316284656525, -0.01923033781349659, 0.0972248986363411, 0.04214302822947502, 0.08450969308614731, 0.047662146389484406, -0.03648162633180618, -0.06325629353523254, -0.001421288587152958, -0.02628227323293686, -0.029374893754720688, -0.04245356470346451, 0.022804519161581993, -0.06049023196101189, 0.0021187416277825832, 0.08209648728370667, 0.06860563904047012, 0.0939880907535553, 0.0063134850934147835, 0.011472111567854881, 0.049481336027383804, -0.015489215962588787, -0.02547895722091198, 0.07130620628595352, -0.018594445660710335, 0.06384305655956268, -0.029455892741680145, -5.3633982588507934e-08, -0.06361149251461029, 0.054640982300043106, 0.027654049918055534, -0.05446789041161537, 0.07517993450164795, -0.08909185975790024, 0.05210240185260773, 0.10675482451915741, -0.06064668297767639, -0.03225109726190567, 0.06964478641748428, -0.01573512889444828, -0.04732862487435341, -0.002249100711196661, 0.07748331874608994, 0.08900899440050125, 0.00627552904188633, -0.015077181160449982, 0.0557510107755661, -0.05877568945288658, 0.09535367786884308, 0.0012423102743923664, -0.021635744720697403, -0.014057725667953491, 0.035130489617586136, -0.0648704469203949, -0.05298655852675438, 0.031004631891846657, -0.05294268950819969, -0.00932745449244976, 0.018431026488542557, 0.044868048280477524, 0.011661364696919918, -0.07036887854337692, 0.041922904551029205, 0.13420234620571136, 0.05478769913315773, -0.10304632782936096, -0.020492009818553925, -0.01845119521021843, -0.008634830825030804, 0.05739855766296387, -0.026511596515774727, 0.021058829501271248, -0.013238845393061638, 0.019764360040426254, 0.035160139203071594, -0.11379372328519821, 0.02929326519370079, 0.010790911503136158, 0.0042575947009027, -0.003557202173396945, 0.04624740034341812, 0.07833472639322281, 0.03329264745116234, 0.03461145982146263, -0.005468763876706362, -0.06646645069122314, 0.046554964035749435, 0.0558260977268219, 0.00404702965170145, 0.08175651729106903, -0.037324175238609314, -0.025106893852353096 ] }, { "text": "## What Makes Deep Learning Different?\n\nWhile traditional machine learning requires manual feature engineering, deep learning automatically learns hierarchical representations from raw data. Each layer learns increasingly abstract features.\n\n### Key Concepts\n\n- **Neural Network**: A computational model inspired by biological neurons\n- **Layers**: Building blocks that transform input data\n- **Weights & Biases**: Learnable parameters that the network optimizes\n- **Activation Functions**: Non-linear functions that enable learning complex patterns\n- **Loss Function**: Measures how well the model's predictions match the targets\n- **Backpropagation**: Algorithm for computing gradients to update weights", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_1", "embedding": [ -0.04100373387336731, -0.0947023332118988, 0.06525007635354996, -0.003780859289690852, 0.015969911590218544, -0.03044128231704235, -0.07817107439041138, -0.0210812259465456, -0.016674354672431946, -0.048563454300165176, -0.08637255430221558, -0.013403715565800667, -0.014593815430998802, 0.002296469872817397, -0.09293563663959503, -0.039600908756256104, 0.03452548012137413, 0.053224656730890274, -0.14423686265945435, -0.0012087889481335878, 0.05029395595192909, 0.022377124056220055, -0.04631216078996658, -0.0003564054495655, 0.017761658877134323, 0.08298158645629883, 0.009752855636179447, 0.003954419866204262, 0.016995690762996674, -0.06671206653118134, 0.01940559223294258, -0.04235038906335831, 0.025723379105329514, 0.0537605844438076, -0.09496138989925385, 0.007690947037190199, -0.09485828876495361, 0.02806434966623783, -0.005821279250085354, -0.027405859902501106, -0.012220651842653751, -0.014808825217187405, -0.004287299700081348, 0.037896282970905304, 0.10656938701868057, 0.07785609364509583, -0.02450764924287796, -0.057309310883283615, -0.029274923726916313, 0.03805618733167648, -0.05316733196377754, -0.016871377825737, -0.008961876854300499, 0.07347980886697769, 0.00522998021915555, 0.0719163790345192, 0.014720823615789413, 0.08782266080379486, -0.045189518481492996, 0.05148734152317047, 0.003650747239589691, -0.05601074919104576, 0.01168325636535883, -0.009587970562279224, 0.006442972458899021, -0.03288621827960014, -0.026768341660499573, 6.502726319013163e-05, 0.09278585016727448, -0.08794673532247543, 0.043493837118148804, 0.13126814365386963, -0.01915886253118515, -0.0024696639738976955, 0.015786023810505867, -0.0022351376246660948, 0.007933871820569038, 0.06618262827396393, 0.029740087687969208, -0.0637202337384224, 0.009064646437764168, 0.07110828161239624, 0.002138321055099368, 0.020747801288962364, 0.12165682762861252, -0.027345942333340645, -0.005206546746194363, 0.006326928734779358, -0.08187475800514221, -0.04284709319472313, 0.03236931189894676, -0.09267581254243851, -0.027085620909929276, -0.0842096284031868, -0.01485187467187643, -0.009700405411422253, -0.0023111985065042973, -0.0877794548869133, -0.050182949751615524, -0.001972661353647709, -0.03830491378903389, 0.01159158069640398, 0.037186965346336365, -0.01367899589240551, 0.05642548203468323, 0.010499716736376286, 0.04917699098587036, 0.02662539854645729, 0.0885518342256546, -0.0959055945277214, -0.043096061795949936, 0.045041974633932114, 0.004599372390657663, -0.023562341928482056, 0.023189106956124306, -0.042781997472047806, 0.03863762691617012, -0.025143658742308617, -0.020962674170732498, 0.07050489634275436, -0.10904230922460556, -0.022144867107272148, -0.03579656407237053, -0.018544431775808334, -0.028759300708770752, -0.034354619681835175, -0.08940595388412476, 2.4125570549788155e-33, -0.004354044329375029, -0.03777265548706055, -0.049345094710588455, 0.018584564328193665, 0.04133598133921623, -0.07876565307378769, 0.006110146641731262, 0.0009314545895904303, 0.04925848916172981, 0.07168491929769516, -0.04497719556093216, 0.05831780657172203, -0.010917926207184792, 0.16715344786643982, 0.03160901740193367, 0.011641409248113632, -0.03957785293459892, -0.044796496629714966, 0.05710388347506523, -0.04143651947379112, 0.004451925400644541, 0.09578477591276169, 0.010487362742424011, -0.0354374535381794, -0.03733246400952339, -0.0032945992425084114, 0.006793702952563763, 0.034785784780979156, -0.0784817785024643, 0.0030033595394343138, -0.047361958771944046, -0.024681255221366882, -0.009786833077669144, -0.01690526306629181, 0.0051977806724607944, 0.02464796043932438, 0.06377890706062317, -0.04319150373339653, 0.059670887887477875, -0.08692298084497452, 0.05632401257753372, -0.022031597793102264, -0.025471659377217293, -0.018716664984822273, 0.01667221076786518, 0.00822991132736206, 0.008490120992064476, -0.05553865060210228, -0.029026485979557037, -0.04830531030893326, 0.005074128974229097, 0.010031838901340961, 0.013855978846549988, -0.06961684674024582, 0.07450603693723679, 0.02994559146463871, 0.0030921699944883585, 0.0656517967581749, 0.009402877651154995, 0.024141287431120872, 0.11741925030946732, 0.009423294104635715, -0.029149239882826805, 0.06996392458677292, 0.010062090121209621, 0.06211955472826958, 0.03531157970428467, 0.09903804212808609, -0.012600280344486237, 0.041827429085969925, -0.021983450278639793, 0.06529229879379272, -0.050571635365486145, -0.05377516895532608, -0.02549641579389572, -0.010356989689171314, -0.03395376354455948, -0.09836887568235397, -0.002150996821001172, 0.06276929378509521, -0.060217712074518204, 0.11861231923103333, -0.022877700626850128, -0.025287512689828873, -0.06132374703884125, 0.036977168172597885, 0.012048458680510521, -0.05171104520559311, 0.02955646440386772, 0.025157680734992027, -0.0285663865506649, -0.055108442902565, 0.010826515033841133, 0.01291536632925272, 0.04408883675932884, -4.518805996072267e-33, -0.07115263491868973, 0.12066803127527237, -0.10592418164014816, 0.04569822549819946, -0.0012310849269852042, 0.015490595251321793, -0.09371180832386017, -0.00898214615881443, -0.0368766188621521, 0.0009882254526019096, -0.011113742366433144, -0.04326503351330757, -0.0468522273004055, -0.030585041269659996, -0.0006865028408356011, -0.010623757727444172, -0.11501441895961761, -0.007942507043480873, -0.01746801659464836, -0.01612095907330513, -0.005302008707076311, 0.10006772726774216, -0.09839791804552078, 0.046680718660354614, -0.05021177977323532, -0.02499118447303772, -0.053829800337553024, 0.10638684034347534, 0.09680800139904022, 0.00227117957547307, -0.042205680161714554, -0.020313195884227753, -0.025386888533830643, 0.022055108100175858, -0.014899537898600101, 0.06073737516999245, 0.01932419463992119, -0.03219597414135933, 0.010145338252186775, -0.03010716661810875, 0.037123143672943115, -0.02967703528702259, 0.05724170804023743, -0.04565810039639473, 0.015103084035217762, 0.012059589847922325, -0.012878038920462132, -0.052246399223804474, 0.004781482741236687, -0.008214637637138367, 0.10587872564792633, -0.0202683974057436, -0.06748346984386444, -0.0500781275331974, -0.03724575787782669, 0.03743744269013405, 0.0691973939538002, 0.013126151636242867, 0.042908910661935806, 0.0642368495464325, -0.06542250514030457, -0.11335881054401398, 0.008172337897121906, 0.045548487454652786, -0.13544650375843048, 0.026528561487793922, -0.04464835673570633, 0.01445212122052908, -0.030008433386683464, 0.036156315356492996, -0.007034522481262684, -0.030294591560959816, 0.03822142630815506, 0.040229614824056625, -0.056932948529720306, -0.09518775343894958, -0.025621788576245308, -0.02644721418619156, -0.053881291300058365, -0.03849133104085922, 0.08209998905658722, -0.03589647635817528, -0.022065702825784683, 0.059354331344366074, 0.04316341504454613, 0.1870209127664566, -0.00958339124917984, 0.06161036342382431, -0.021651597693562508, -0.023932598531246185, 0.024685319513082504, -0.006290170829743147, -0.07440962642431259, 0.013523361645638943, -0.03496763855218887, -4.7989910711976336e-08, -0.009848917834460735, 0.0169215090572834, 0.08780667930841446, -0.011834672652184963, 0.02009848691523075, -0.056353047490119934, 0.00890375766903162, 0.07899975776672363, -0.03469543904066086, 0.049239300191402435, 0.023251404985785484, 0.03772036358714104, -0.010546861216425896, -0.055185701698064804, 0.05009099468588829, 0.13011705875396729, -0.005821476690471172, -0.010657617822289467, 0.07610850781202316, -0.030020829290151596, 0.036473967134952545, -0.004153480753302574, -0.03584151342511177, -0.014481376856565475, 0.053460944443941116, -0.08677557110786438, -0.030381903052330017, 0.0865996852517128, -0.030893776565790176, 0.0589306578040123, 0.022179674357175827, 0.03184632211923599, -0.020759014412760735, 0.012576678767800331, -0.00013430400576908141, 0.07138856500387192, 0.06288837641477585, -0.06448107957839966, -0.03856367617845535, -0.03156397119164467, -0.04781820997595787, 0.049373891204595566, -0.03565569967031479, -0.015380888245999813, -0.039806075394153595, 0.02641717530786991, 0.03911252319812775, -0.024750880897045135, -0.009648110717535019, 0.03581761568784714, 0.04470544308423996, 0.02823765017092228, 0.01709870994091034, 0.013376637361943722, 0.07823292165994644, 0.022999271750450134, -0.008292335085570812, -0.11661669611930847, 0.06218204274773598, 0.06379037350416183, 0.034720901399850845, 0.05813167244195938, 0.0218361709266901, -0.008502492681145668 ] }, { "text": "## Getting Started with PyTorch\n\nPyTorch is a popular deep learning framework known for its flexibility and Pythonic design.\n\n### Installation\n\n```bash\npip install torch torchvision\n```\n\n### Basic Tensor Operations\n\n```python\nimport torch\nimport torch.nn as nn\nimport torch.optim as optim\n\n# Create tensors\nx = torch.tensor([1.0, 2.0, 3.0])\ny = torch.tensor([4.0, 5.0, 6.0])\n\n# Basic operations\nz = x + y # Element-wise addition\ndot = torch.dot(x, y) # Dot product\n\n# Create a matrix\nmatrix = torch.randn(3, 4) # Random 3x4 matrix\nprint(f\"Matrix shape: {matrix.shape}\")\n\n# GPU support (if available)\ndevice = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\ntensor_gpu = matrix.to(device)\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_2", "embedding": [ -0.026584558188915253, -0.07319609075784683, -0.08423444628715515, -0.0018751425668597221, -0.020327161997556686, -0.06309697031974792, 0.03505240008234978, -0.042364224791526794, -0.09403623640537262, -0.06852548569440842, -0.017720837146043777, 0.02813674509525299, -0.08616431802511215, 0.051770977675914764, -0.03678835555911064, 0.067018523812294, -0.048524003475904465, 0.03548433259129524, -0.09161533415317535, -0.11089197546243668, 0.06940320879220963, -0.055803846567869186, 0.02826174534857273, -0.003987547475844622, -0.042258940637111664, 0.018377570435404778, 0.0830404981970787, -0.017240583896636963, 0.03927377238869667, 0.021676581352949142, 0.04494304209947586, 0.012997652404010296, -0.03860195353627205, -0.014942115172743797, 0.05315485596656799, -0.037746015936136246, -0.0748864933848381, 0.014141062274575233, -0.03658546879887581, 0.08202965557575226, 0.03471773862838745, -0.007460516411811113, -0.012221748940646648, 0.035510554909706116, 0.006021608132869005, 0.022811368107795715, 0.07144976407289505, -0.028674738481640816, 0.01799204759299755, -0.04992220923304558, -0.02318635769188404, 0.00274456012994051, -0.03292785584926605, 0.01089521311223507, -0.015756430104374886, -0.05929024517536163, 0.015490950085222721, -0.10111254453659058, -0.0317806713283062, -0.11202375590801239, 0.07880505919456482, -0.035921916365623474, 0.0186935905367136, -0.050483595579862595, -0.000694819784257561, 0.004112307447940111, -0.03459421545267105, -0.0005428869044408202, -0.006582940928637981, -0.0005449107848107815, -0.001058935304172337, 0.021417535841464996, -0.02339126169681549, 0.048720791935920715, -0.04150382801890373, -0.049871042370796204, 0.14114075899124146, -0.04713185504078865, 0.020215008407831192, 0.0018524411134421825, -0.038819320499897, 0.034814123064279556, 0.07681626081466675, 0.03378663957118988, 0.05173196271061897, -0.023927930742502213, 0.024353954941034317, 0.07049927860498428, 0.03592700511217117, -0.07507792115211487, 0.01166784018278122, 0.01885545812547207, -0.041510939598083496, -0.03382088989019394, 0.03225450590252876, 0.003027352737262845, 0.09060895442962646, -0.09013651311397552, -0.08720104396343231, 0.07388492673635483, 0.02871963568031788, -0.09089921414852142, -0.00011418999929446727, 0.04364432767033577, -0.03244423866271973, 0.14273710548877716, -0.01885211281478405, 0.11737030744552612, 0.0015466519398614764, -0.013333659619092941, 0.04031558707356453, 0.04941244050860405, -0.040382154285907745, 0.012206759303808212, 0.01770184002816677, -0.02518562413752079, -0.04046051576733589, 0.031395476311445236, 0.035323429852724075, 0.08238963037729263, -0.02286970429122448, 0.06974627077579498, -0.01710287109017372, 0.06326037645339966, -0.07054119557142258, 0.013335604220628738, -0.07095414400100708, 8.11911964466237e-33, -0.06360594183206558, 0.024203060194849968, -0.02736128307878971, -0.016372542828321457, 0.004480654373764992, 0.03147674351930618, 0.0971553847193718, -0.020034722983837128, -0.015544605441391468, 0.048803552985191345, -0.02646317519247532, 0.011238268576562405, -0.028850585222244263, 0.08641771972179413, -0.09255723655223846, -0.1029181256890297, 0.070701465010643, 0.014714675024151802, 0.07149888575077057, -0.03521483391523361, 0.03460302948951721, 0.06873217970132828, -0.038198549300432205, 0.030781477689743042, -0.07828371226787567, 0.01033457089215517, -0.04996350407600403, -0.0433056615293026, -0.0031369044445455074, 6.037789717083797e-05, -0.01992710866034031, 0.0344708077609539, -0.002443577628582716, -0.0018887425540015101, -0.022337432950735092, -0.03147011250257492, 0.020391708239912987, -0.018689239397644997, 0.07915092259645462, -0.10997931659221649, 0.024871502071619034, 0.05014950409531593, 0.02160394936800003, -0.08559136837720871, -0.08634279668331146, 0.05395055562257767, -0.05191376432776451, 0.03155236691236496, -0.019923679530620575, -0.0567169263958931, -0.06703197211027145, -0.0025425944477319717, 0.03705529496073723, 0.03411780670285225, 0.07168945670127869, -0.08671007305383682, 0.020093509927392006, 0.024746078997850418, 0.16091248393058777, -0.019366461783647537, -0.0087943896651268, 0.049692992120981216, -0.02559560537338257, 0.03443820774555206, -0.053019359707832336, -0.014793461188673973, 0.03932864964008331, 0.02478734776377678, -0.006556674372404814, 0.03998585417866707, -0.11107756197452545, 0.087472103536129, -0.0225583054125309, -0.035136908292770386, 0.009915863163769245, -0.05180881917476654, 0.01744835451245308, -0.05105392262339592, -0.08300050348043442, 0.002969469176605344, -0.07413104921579361, 0.10237974673509598, 0.01394691038876772, -0.10032036900520325, -0.08323720842599869, -0.012900859117507935, -0.051144786179065704, -0.030937954783439636, -0.0447833314538002, -0.023732373490929604, -0.09624672681093216, -0.04952123016119003, 0.08983787149190903, 0.03167103976011276, -0.03833453357219696, -7.443744508185209e-33, -0.03295852988958359, 0.024794623255729675, 0.009297116659581661, 0.047542184591293335, 0.049820270389318466, -0.06748376786708832, 0.005860257428139448, -0.09953447431325912, 0.0012657195329666138, -0.044738590717315674, -0.031796086579561234, -0.03369930014014244, -0.024005135521292686, -0.024203896522521973, 0.09680190682411194, 0.04547233507037163, -0.053182024508714676, 0.031121477484703064, 0.0322219617664814, -0.018520938232541084, -0.064299076795578, 0.09922484308481216, -0.09731891006231308, -0.04966602101922035, -0.08479145914316177, -0.0030915685929358006, 0.06160467863082886, -0.0025867121294140816, 0.03543251007795334, -0.008968805894255638, -0.046634741127491, -0.03627103939652443, -0.036491408944129944, 0.11023309081792831, -0.014649410732090473, 0.05108372122049332, 0.0067444597370922565, -0.019363468512892723, 0.0034454602282494307, -0.023047178983688354, 0.11227288097143173, 0.02421453222632408, -0.014035257510840893, 0.0834813043475151, -0.05163716897368431, 0.05675675719976425, 0.004194177221506834, 0.014617394655942917, -0.013200484216213226, -0.008646233938634396, 0.023310750722885132, -0.02582811377942562, -0.07099120318889618, 0.0006625210517086089, -0.010674499906599522, 0.007875079289078712, 0.039595723152160645, 0.017209606245160103, 0.004718993324786425, 0.014624928124248981, -0.04871167242527008, -0.15977296233177185, 0.03462852165102959, -0.0033586707431823015, 0.0037754576187580824, -0.024570457637310028, -0.052589595317840576, 0.05646022781729698, 0.05399090424180031, 0.04453436657786369, 0.0421162024140358, 0.10787483304738998, 0.03704239800572395, 0.005261174403131008, -0.014298707246780396, -0.007661751937121153, 0.021560918539762497, 0.013710452243685722, 0.027483630925416946, 0.022360460832715034, -0.04474446550011635, -0.029158152639865875, 0.03982235863804817, 0.04444962739944458, 0.027025749906897545, 0.022261153906583786, 0.07746067643165588, 0.09251569211483002, 0.02955138497054577, -0.0341678261756897, 0.023503700271248817, 0.02621656283736229, 0.08102425932884216, 0.05075269564986229, 0.014007898047566414, -5.075698439327425e-08, 0.02118876948952675, 0.003256575670093298, 0.0006093535339459777, 0.03089689277112484, -0.029856307432055473, -0.0316338874399662, 0.07544844597578049, 0.015894390642642975, 0.0005063846474513412, -0.027355091646313667, 0.07158968597650528, -0.07204171270132065, 0.04042377322912216, -0.013133790343999863, -0.0003861722070723772, 0.13904345035552979, -0.056918442249298096, -0.004776431247591972, 0.059618961066007614, -0.024305574595928192, -0.006244218442589045, 0.0029582572169601917, 0.03337784484028816, 0.03810521587729454, -0.12133720517158508, -0.03425024449825287, -0.0021817218512296677, -0.014112832956016064, 0.002077982760965824, 0.020594479516148567, -0.0043268585577607155, -0.04900941997766495, 0.10603887587785721, 0.018629664555191994, 0.10434728115797043, 0.012336037121713161, -0.01223164051771164, 0.013431689701974392, 0.04665818065404892, 0.001832495559938252, -0.07738202810287476, -0.0028769185300916433, 0.006949469447135925, -0.010409500449895859, 0.0318431556224823, -0.01612565852701664, -0.0660562664270401, -0.09662549197673798, 0.0008736311574466527, 0.033907823264598846, 0.023920388892292976, 0.050115130841732025, 0.02391638606786728, 0.05611085519194603, 0.07363118976354599, -0.007430726662278175, -0.058293990790843964, 0.010023892857134342, -0.007635246030986309, -0.012825028039515018, 0.017860017716884613, 0.022417690604925156, -0.05245821177959442, -0.07581498473882675 ] }, { "text": "## Neural Network Fundamentals\n\n### The Perceptron (Single Neuron)\n\n```python\nimport torch\nimport torch.nn as nn\n\nclass Perceptron(nn.Module):\n def __init__(self, input_size):\n super().__init__()\n self.linear = nn.Linear(input_size, 1)\n self.activation = nn.Sigmoid()\n \n def forward(self, x):\n return self.activation(self.linear(x))\n\n# Create and use perceptron\nperceptron = Perceptron(input_size=3)\ninput_data = torch.tensor([1.0, 2.0, 3.0])\noutput = perceptron(input_data)\nprint(f\"Output: {output.item():.4f}\")\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_3", "embedding": [ -0.005672968924045563, -0.11780917644500732, -0.0007282376172952354, 0.016661055386066437, -0.05270916223526001, -0.004114050883799791, 0.030409015715122223, 0.006360052153468132, -0.009286236017942429, -0.06704047322273254, 0.028897030279040337, -0.020743301138281822, -0.08646837621927261, 0.00284470128826797, -0.07047240436077118, 0.08416809886693954, -0.044733721762895584, 0.04482003673911095, -0.04219396784901619, -0.07135497778654099, 0.07995178550481796, -0.03931320831179619, 0.07861092686653137, 0.0423935241997242, -0.03330355882644653, 0.027903499081730843, -0.004921662621200085, -0.013419652357697487, 0.060999467968940735, -0.0006914520636200905, 0.03566862270236015, -0.0022774150129407644, -0.05484083294868469, 0.07001541554927826, -0.045871954411268234, -0.05165698379278183, -0.10009721666574478, -0.006379617843776941, -0.07124248147010803, 0.062269046902656555, 0.051900528371334076, 0.006363225169479847, -0.00426302058622241, -0.038646239787340164, 0.030601775273680687, 0.06336388736963272, 0.06724775582551956, 0.0077665578573942184, 0.003079388989135623, -0.03619140014052391, 0.0298902690410614, 0.007579015102237463, -0.00961708091199398, 0.01506842765957117, 0.012963276356458664, 0.03410729020833969, 0.027722321450710297, -0.040477775037288666, -0.0418793223798275, -0.034444041550159454, 0.0477590337395668, 0.01924167573451996, 0.03641943261027336, -0.08538208156824112, 0.03705976903438568, 0.03782837465405464, -0.02422557771205902, -0.00976643618196249, 0.0028894657734781504, 0.004684085492044687, 0.06329134851694107, 0.02420670911669731, -0.001912361360155046, 0.015604077838361263, 0.0711713507771492, -0.0929659903049469, 0.11391162127256393, 0.027811553329229355, -0.025759346783161163, -0.04487223923206329, -0.002478409791365266, 0.016209116205573082, 0.04208860173821449, 0.03824305906891823, 0.05220784246921539, -0.02134852297604084, 0.0014306639786809683, 0.049439702183008194, -0.03557652607560158, -0.009464660659432411, -0.08768484741449356, -0.04302226006984711, -0.09012968093156815, -0.03645598515868187, 0.009799250401556492, -0.0062227374874055386, 0.03273555636405945, -0.02499079890549183, -0.04577117785811424, 0.002489887410774827, 0.040086984634399414, -0.03195611760020256, -0.05259835347533226, 0.0481092743575573, 0.032202549278736115, 0.13499467074871063, 0.043116044253110886, 0.06007136031985283, -0.003765297820791602, -0.052984483540058136, 0.019545020535588264, -0.007721278350800276, -0.04266529902815819, -0.030739475041627884, 0.05594926327466965, -0.047033391892910004, -0.012765503488481045, 0.07926701754331589, 0.07760194689035416, 0.06183633580803871, -0.051976706832647324, 0.03929900750517845, -0.0629686713218689, 0.054586850106716156, -0.015642255544662476, -0.017027780413627625, -0.03443802893161774, 6.882301222925622e-33, -0.06742873787879944, 0.06565769016742706, -0.030347054824233055, -0.07715262472629547, -0.037494514137506485, 0.05541376397013664, 0.06978944689035416, -0.06165691092610359, -0.010962668806314468, 0.009763139300048351, -0.04046493023633957, -0.0002804444229695946, -0.010507095605134964, 0.016973989084362984, -0.06862743198871613, -0.06953510642051697, 0.09929202497005463, 0.00801998469978571, 0.04664955288171768, -0.05195961147546768, 0.06959027796983719, 0.05676771700382233, -0.016373464837670326, -0.0707094594836235, -0.09661294519901276, 0.02649303711950779, -0.031253937631845474, -0.017588524147868156, -0.07610233873128891, -0.02318541333079338, -0.017808081582188606, 0.0674256831407547, 0.018695823848247528, -0.10042872279882431, 0.04427863284945488, -0.04352550581097603, 0.08608730137348175, 0.01962973363697529, 0.05936328321695328, -0.0583142526447773, -0.03661505877971649, 0.06070351228117943, 0.029544278979301453, -0.036153968423604965, -0.0719979852437973, 0.003985399845987558, -0.04944903030991554, 0.10884097218513489, 0.004414597060531378, -0.03348568454384804, -0.04042133316397667, -0.013996708206832409, 0.00022422097390517592, -0.00288100796751678, 0.053137440234422684, -0.0748298317193985, 0.07347116619348526, 0.08810804784297943, 0.11258099228143692, -0.04956556856632233, 0.08207139372825623, 0.038606226444244385, -0.02921970747411251, 0.07506113499403, -0.03579613193869591, 0.023876184597611427, -0.009753516875207424, 0.061511699110269547, 0.05481245368719101, -0.05267295241355896, -0.07981811463832855, 0.07549984753131866, -0.07378213852643967, -0.05926457792520523, 0.004030873533338308, -0.025922084227204323, -0.03893034905195236, -0.1122131496667862, -0.0259392186999321, -0.029495887458324432, -0.09558926522731781, 0.04329778626561165, 0.005236680153757334, -0.04784059152007103, -0.03535863757133484, 0.08076826483011246, 0.00861163530498743, 0.0009976504370570183, 0.005692182574421167, -0.03339770436286926, -0.05897052586078644, -0.05743340030312538, 0.051653921604156494, -0.00209777127020061, -0.06903211772441864, -6.478652625900572e-33, 0.0008013979531824589, 0.145809143781662, -0.02376330830156803, 0.04419044405221939, 0.026898806914687157, 0.02276696264743805, -0.0025269482284784317, 0.02706735208630562, -0.013000153936445713, 0.039788711816072464, -0.011302358470857143, -0.0598868764936924, -0.03468857333064079, -0.06102290377020836, 0.09186547249555588, 0.0035785974469035864, -0.030470669269561768, 0.06152599677443504, 0.050034597516059875, -0.04052997753024101, -0.059436116367578506, 0.09214223176240921, -0.12280767410993576, 0.055725738406181335, -0.13286209106445312, -0.021379487589001656, 0.0446256659924984, 0.052501220256090164, -0.014005337841808796, -0.03326789289712906, 0.007213985081762075, -0.011504954658448696, 0.024912450462579727, 0.01248512975871563, 0.0027753121685236692, 0.026420963928103447, 0.03693326190114021, -0.018863428384065628, 0.014797891490161419, -0.022667517885565758, 0.07792221754789352, 0.044465694576501846, -0.0017296054866164923, 0.06604710221290588, -0.06792416423559189, 0.03862306848168373, -0.08809861540794373, 0.024424046277999878, -0.008186944760382175, 0.06852773576974869, -0.004047900438308716, -0.05455696955323219, -0.05055611580610275, -0.05544504150748253, -0.06833256036043167, 0.033331483602523804, 0.02537710778415203, -0.0024165038485080004, 0.0653507187962532, 0.0067724548280239105, -0.05513083189725876, -0.1277473270893097, 0.12018628418445587, 0.011517130769789219, 0.0034693614579737186, -0.023586120456457138, -0.05714169889688492, 0.08954586833715439, 0.06171049550175667, -0.018109912052750587, 0.0017545443261042237, 0.15275603532791138, 0.0521298311650753, -0.009465501643717289, -0.01808982901275158, -0.02002559043467045, 0.0027362219989299774, -0.019612083211541176, 0.07485612481832504, 0.00647669518366456, -0.048911143094301224, -0.04139769822359085, 0.013940917328000069, 0.055805277079343796, 0.008573074825108051, 0.03443010896444321, 0.12155627459287643, 0.0786869004368782, -0.017215987667441368, -0.05443312227725983, 0.05945747718214989, 0.029642023146152496, 0.047637615352869034, -0.0297998134046793, 0.04454395920038223, -5.537446057246598e-08, -0.05949642136693001, -0.040056731551885605, 0.017145449295639992, 0.11127586662769318, -0.0033149991650134325, -6.569360994035378e-05, 0.051646336913108826, 0.01878676749765873, 0.0025324898306280375, -0.05406681075692177, 0.009605138562619686, -0.02445346862077713, 0.041135963052511215, -0.0432484969496727, 0.01625654473900795, 0.0813276395201683, 0.025795362889766693, -0.046301763504743576, 0.03876689448952675, -0.0012788387248292565, -0.05528965964913368, -0.05114194378256798, 0.03242369741201401, -0.03285159915685654, -0.0624314621090889, -0.03283797204494476, -0.053284917026758194, 0.017848564311861992, -0.02834009937942028, -0.021462200209498405, 0.013510250486433506, -0.03872520104050636, 0.05409843102097511, 0.05470874160528183, 0.03300011530518532, 0.052342068403959274, -0.03639544919133186, 0.04670460522174835, -0.008658049628138542, -0.009835953824222088, -0.08310102671384811, 0.009648909792304039, -0.015001020394265652, -0.01475214958190918, -0.030492154881358147, -0.06045502424240112, -0.04443083330988884, -0.15852324664592743, -0.023297447711229324, 0.01828106865286827, 0.04833439737558365, -0.005164034198969603, -0.006264268886297941, 0.03507478907704353, 0.0684131532907486, -0.04376985505223274, -0.0668187290430069, 0.03171742334961891, -0.07156343013048172, 0.029393687844276428, -0.019011612981557846, 0.030072128400206566, -0.03533124551177025, -0.03176301717758179 ] }, { "text": "### Multi-Layer Perceptron (MLP)\n\n```python\nclass MLP(nn.Module):\n def __init__(self, input_size, hidden_size, output_size):\n super().__init__()\n self.network = nn.Sequential(\n nn.Linear(input_size, hidden_size),\n nn.ReLU(),\n nn.Linear(hidden_size, hidden_size),\n nn.ReLU(),\n nn.Linear(hidden_size, output_size)\n )\n \n def forward(self, x):\n return self.network(x)\n\n# Example: Classification with 10 input features, 64 hidden units, 3 classes\nmodel = MLP(input_size=10, hidden_size=64, output_size=3)\nsample_input = torch.randn(1, 10) # Batch size 1\noutput = model(sample_input)\nprint(f\"Output shape: {output.shape}\") # [1, 3]\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_4", "embedding": [ -0.04328364506363869, -0.11750241369009018, 0.0054839481599628925, 0.03684068098664284, 0.03457091003656387, 0.01692841947078705, -0.01603160798549652, -0.017884301021695137, -0.040580060333013535, -0.10603459924459457, 0.0026814944576472044, -0.033932823687791824, -0.035145651549100876, -0.06444671005010605, -0.07954691350460052, 0.04042835906147957, 0.011717797257006168, 0.024340428411960602, -0.04822912812232971, -0.07921716570854187, 0.05593625456094742, -0.005126133561134338, 0.0455460287630558, 0.07732781767845154, -0.030552174896001816, -0.02326585166156292, 0.0027285385876893997, 0.028751717880368233, 0.04818485677242279, -0.026142388582229614, 0.05294209346175194, 0.021927714347839355, -0.08050248771905899, 0.03749123960733414, 0.008283951319754124, 0.021718505769968033, -0.07676936686038971, -0.016572175547480583, -0.041381653398275375, 0.03093097172677517, 0.054020579904317856, -0.011159039102494717, -0.008668440394103527, -0.031165000051259995, 0.07648708671331406, 0.0674498900771141, 0.022596942260861397, -0.02894926443696022, 0.007508536335080862, -0.08190573751926422, 0.012660876847803593, 0.014941408298909664, -0.06903532147407532, 0.016104519367218018, -0.02310684509575367, -0.029371635988354683, 0.03185916319489479, -0.031193073838949203, -0.08701182901859283, -0.025365902110934258, -0.004081177059561014, -0.027102118358016014, 0.016039371490478516, -0.03710139915347099, 0.03628447279334068, 0.029888741672039032, -0.01938682794570923, 0.017242001369595528, 0.027302836999297142, 0.03294316679239273, 0.04471197351813316, 0.03571926802396774, -0.018179483711719513, 0.040195222944021225, 0.05845528468489647, -0.030799677595496178, 0.12213793396949768, 0.029029497876763344, -0.02285522036254406, -0.09489185363054276, -0.003128562355414033, 0.02081017754971981, 0.014805552549660206, 0.003908245824277401, 0.06007831171154976, -0.05510619655251503, -0.0348408967256546, 0.0032551386393606663, -0.003093276871368289, -0.023857101798057556, -0.07064712047576904, -0.013050655834376812, -0.1366298645734787, 0.011882742866873741, 0.004343463573604822, 0.022882869467139244, -0.007197751197963953, -0.010974795557558537, -0.04000041261315346, 0.03716433048248291, -0.000330201699398458, -0.04022911563515663, 0.030691495165228844, 0.048071619123220444, 0.07130366563796997, 0.08990112692117691, 0.03131644055247307, 0.05414499714970589, 0.06368191540241241, -0.09581662714481354, 0.03946836292743683, -0.011332291178405285, -0.055467236787080765, -0.011461002752184868, 0.07630940526723862, -0.01542502362281084, -0.017636872828006744, 0.043864741921424866, 0.04032779857516289, 0.08413800597190857, -0.09042954444885254, 0.06254251301288605, 0.00824420340359211, 0.024135909974575043, 0.01171325333416462, -0.0376875177025795, -0.03412429615855217, 2.5126696844055264e-33, -0.06022704392671585, 0.00041058420902118087, -0.05264982208609581, -0.049736957997083664, 0.03335699811577797, 0.07524598389863968, 0.07885240763425827, -0.09307415038347244, -0.020633894950151443, 0.03158990293741226, -0.09750616550445557, -0.02232852205634117, -0.01904330402612686, 0.019974425435066223, -0.02841791883111, -0.041008658707141876, 0.05412790924310684, 0.07591750472784042, 0.0034083249047398567, -0.07584080100059509, 0.09365326911211014, 0.06988584995269775, -0.027619361877441406, -0.0909389778971672, -0.07955062389373779, 0.054056718945503235, -0.042363133281469345, -0.03066757507622242, -0.08416968584060669, 0.01752709224820137, -0.021270709112286568, 0.07744546234607697, 0.035066764801740646, -0.03317772597074509, 0.0031853271648287773, -0.02953428588807583, 0.04738142713904381, -0.008103782311081886, 0.08046729117631912, -0.0826798751950264, -0.058113452047109604, 0.024820180609822273, 0.008497266098856926, -0.039512861520051956, -0.09548701345920563, -0.00869065523147583, -0.04483021795749664, 0.08379096537828445, -0.06368160992860794, -0.030875487253069878, -0.009292986243963242, -0.03457121178507805, -0.00013707592734135687, -0.03709052875638008, 0.02796204760670662, -0.06723544001579285, 0.06274688988924026, 0.09825490415096283, 0.12997588515281677, 0.022592617198824883, 0.060855284333229065, 0.06556744873523712, -0.06894077360630035, 0.08413847535848618, 0.012214705348014832, 0.022044867277145386, 0.007217541802674532, 0.034530773758888245, 0.08394922316074371, -0.01000068336725235, -0.08357272297143936, 0.05805877596139908, -0.07870020717382431, -0.07396510243415833, 0.04631796479225159, -0.06491592526435852, -0.05129847675561905, -0.09158682823181152, -0.019709540531039238, 0.043776798993349075, -0.07526916265487671, 0.07464779168367386, -0.06265183538198471, -0.06333597004413605, -0.04745568707585335, 0.02234005741775036, 0.0010920671047642827, -0.025638990104198456, -0.00864830520004034, -0.01191135123372078, -0.04135315865278244, -0.04216182231903076, 0.06834455579519272, 0.0034691556356847286, -0.07736343145370483, -4.1008112251794006e-33, 0.005004626698791981, 0.14609506726264954, -0.009271613322198391, 0.04407466575503349, 0.002106468193233013, -0.022329645231366158, -0.01515077706426382, 0.027620859444141388, -0.044889528304338455, 0.015533086843788624, -0.02713785693049431, -0.06616581231355667, 0.010069986805319786, -0.048716384917497635, 0.07150769233703613, -0.00580396456643939, -0.017557403072714806, 0.04080439358949661, 0.06347573548555374, -0.00023635097022634, -0.0671936646103859, 0.09673893451690674, -0.1379346400499344, 0.05503680557012558, -0.10567265748977661, -0.012787515297532082, 0.008973024785518646, 0.055315859615802765, 0.04039799049496651, -0.08146417140960693, -0.050351615995168686, 0.005303381010890007, -0.021527910605072975, 0.028909794986248016, 0.013992591761052608, 0.04565991088747978, 0.014410081319510937, -0.011854172684252262, 0.016138695180416107, 0.034021757543087006, 0.08801858872175217, 0.014588436111807823, -0.09033585339784622, 0.032992348074913025, -0.03636893630027771, 0.06328459084033966, -0.05399462208151817, 0.016521887853741646, -0.007748404052108526, 0.03858767822384834, -0.025505604222416878, -0.03820164129137993, -0.033219583332538605, -0.012987608090043068, -0.04272369667887688, 0.048442915081977844, -0.000153371220221743, 0.04372275620698929, 0.04688239097595215, 0.017622943967580795, -0.03997086361050606, -0.13032974302768707, 0.056877002120018005, 0.00246223877184093, 0.0104383435100317, 0.02129780687391758, -0.04261470213532448, 0.05153074115514755, 0.06613942235708237, 0.009255693294107914, -0.01689848303794861, 0.13305756449699402, 0.03138406202197075, -0.017340071499347687, -0.06616000086069107, 0.01001332513988018, -0.018202725797891617, -0.02071121148765087, 0.04731666296720505, 0.010258768685162067, -0.08256634324789047, -0.03261362761259079, 0.05251149460673332, 0.053411226719617844, 0.046554405242204666, 0.04733700305223465, 0.11842630803585052, 0.11995361000299454, 0.020512785762548447, -0.09390679001808167, 0.08908479660749435, 0.05689702928066254, 0.07285104691982269, 0.04922187328338623, 0.030284594744443893, -5.5843589308324226e-08, -0.03779315948486328, -0.017605021595954895, 0.03960040211677551, 0.05933342128992081, 0.033974725753068924, -0.0032336153090000153, 0.05504218116402626, 0.05184066295623779, -0.0028541977517306805, -0.003242375096306205, 0.021791324019432068, -0.03862150013446808, -0.006450326647609472, -0.03012937493622303, -0.0041543059051036835, 0.03949004411697388, -0.05147910863161087, -0.024384459480643272, 0.022200968116521835, -0.011666457168757915, -0.060230694711208344, -0.06986801326274872, 0.008080024272203445, -0.03587818518280983, -0.06027761846780777, -0.08071979135274887, -0.02495592087507248, 0.014560648240149021, -0.03121139667928219, -0.00951019860804081, 0.004070155322551727, -0.020231688395142555, 0.004649572540074587, 0.07603917270898819, 0.015811584889888763, 0.0800689235329628, -0.005873929243534803, 0.05782788619399071, 0.04006289690732956, 0.008189328946173191, -0.12733854353427887, 0.010604309849441051, 0.001201524049974978, -0.01809477061033249, 0.03352346643805504, -0.03504583239555359, -0.02772192656993866, -0.13959047198295593, -0.01108117401599884, 0.02800869569182396, 0.024919023737311363, -0.017052186653017998, -0.014320527203381062, 0.03732077777385712, 0.07298921048641205, -0.03797409310936928, -0.06574448198080063, -0.016023825854063034, -0.05743808671832085, 0.05351201072335243, -0.04883059486746788, 0.005849605426192284, -0.05263093113899231, -0.03484739363193512 ] }, { "text": "## Backpropagation\n\nBackpropagation is the algorithm used to compute gradients of the loss with respect to each weight. It applies the chain rule of calculus to efficiently propagate errors backward through the network.\n\n### How Backpropagation Works\n\n1. **Forward Pass**: Compute predictions by passing input through the network\n2. **Compute Loss**: Calculate the difference between predictions and targets\n3. **Backward Pass**: Compute gradients using the chain rule\n4. **Update Weights**: Adjust weights in the direction that reduces loss", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_5", "embedding": [ -0.06265932321548462, -0.009559224359691143, -0.010336271487176418, 0.053465764969587326, -0.009491988457739353, 0.008934793062508106, -0.022322101518511772, 0.01623867265880108, -0.03962881863117218, -0.02791091799736023, -0.055680353194475174, 0.033285953104496, 0.10122863203287125, -0.11474809795618057, -0.13532842695713043, 0.04547490179538727, -0.032199110835790634, 0.1678893268108368, -0.05866505950689316, -0.09480619430541992, -0.0010275425156578422, 0.01098036952316761, -0.06496063619852066, 0.032163433730602264, 0.02748151682317257, 0.043616484850645065, -0.047921355813741684, -0.024517688900232315, 0.012971973977982998, -0.0011908950982615352, 0.0007640703697688878, -0.09592215716838837, -0.01674337312579155, 0.01601853221654892, -0.19895011186599731, 0.049264807254076004, -0.05974160134792328, -0.009926261380314827, -0.05322820320725441, 0.03222266584634781, 0.003543816041201353, 0.00029589972109533846, -0.04195660725235939, 0.051346346735954285, 0.029250754043459892, 0.015459426678717136, 0.012897025793790817, -0.013156327418982983, -0.04864135757088661, -0.01521256659179926, 0.05049959942698479, -0.020049607381224632, -0.015714209526777267, 0.04245629906654358, 0.0016646359581500292, 0.03224225342273712, 0.05114249512553215, 0.049897339195013046, -0.04441125690937042, 0.0650288537144661, 0.06139202043414116, -0.11113198846578598, -0.08144176751375198, -0.03661883994936943, 0.08931294828653336, -0.06353557109832764, -0.01085453201085329, -0.06863173842430115, 0.06041361391544342, -0.009850950911641121, 0.012064963579177856, 0.04232334345579147, -0.0006153106805868447, -0.0023292896803468466, 0.01865866407752037, 0.007542314473539591, 0.08674448728561401, 0.08024632185697556, -0.01482371799647808, -0.06375718861818314, 0.07110019773244858, 0.014271769672632217, 0.006033354438841343, -0.00666553620249033, 0.07847614586353302, -0.013826848939061165, -0.06605396419763565, -0.01619066298007965, 0.0383918397128582, 0.026103338226675987, 0.0147330854088068, -0.03045453131198883, -0.0899406149983406, 0.000979914446361363, 0.010173334740102291, 0.014369119890034199, -0.0687365010380745, -0.06317959725856781, 0.014601452276110649, 0.031921181827783585, -0.010678984224796295, -0.007146479096263647, 0.06986141949892044, 0.0029011592268943787, 0.03237394616007805, -0.02932724915444851, 0.06579107791185379, 0.016115544363856316, 0.07341524213552475, -0.05728127807378769, -0.021239470690488815, -0.0044805691577494144, 0.02411430887877941, 0.022683845832943916, -0.00010555615153862163, 0.005679015535861254, 0.041667837649583817, -0.034328289330005646, -0.010973210446536541, 0.020043864846229553, -0.1505487859249115, 0.019695870578289032, 0.019131366163492203, -0.05382224917411804, 0.026440175250172615, -0.07269372791051865, -0.09068969637155533, 2.1666388613409927e-33, -0.046295084059238434, -0.008085031993687153, -0.01103147491812706, 0.0009197384933941066, -0.0026212038937956095, -0.02287539653480053, -0.028053900226950645, -0.090221107006073, 0.011741332709789276, -0.008073261007666588, -0.02934141457080841, -0.003281181212514639, -0.01448154542595148, 0.10955388844013214, 0.06611476838588715, -0.11004788428544998, 0.01578112505376339, 0.033161554485559464, 0.07236161828041077, -0.05201572924852371, 0.0492824949324131, -0.012284982018172741, -0.009185479953885078, -0.014864366501569748, -0.037915199995040894, 0.09663919359445572, 0.045590631663799286, -0.016376443207263947, -0.020186694338917732, 0.03546149656176567, -0.012521939352154732, 0.0032402449287474155, -0.10426836460828781, -0.051506299525499344, 0.051623210310935974, 0.011450758203864098, -0.0067636603489518166, -0.008619922213256359, 0.07717209309339523, -0.0007889870903454721, -0.009572487324476242, -0.013341524638235569, -0.040075238794088364, -0.008008049800992012, -0.04929253086447716, -0.05884573981165886, -0.014742014929652214, 0.04333607479929924, 0.06981270015239716, -0.0046525090001523495, 0.028355104848742485, -0.04779824987053871, -0.00656685559079051, -0.05580355226993561, 0.031035179272294044, 0.0019087556283921003, -0.011426273733377457, 0.048822976648807526, 0.05021074414253235, 0.08011684566736221, 0.10713345557451248, 0.010289893485605717, -0.07050231844186783, 0.06185603141784668, -0.0907188430428505, 0.020334646105766296, -0.05319489538669586, -0.0005631610401906073, 0.00777372345328331, 0.0016586031997576356, -0.018677644431591034, 0.04231894388794899, -0.0014470780733972788, -0.006244382355362177, 0.05549677088856697, 0.022654375061392784, -0.07610006630420685, -0.05025559663772583, 0.03329078480601311, -0.04019277170300484, -0.14146853983402252, 0.08945997059345245, -0.05028216913342476, 0.020526250824332237, -0.05476585775613785, 0.01385923009365797, -0.006079350598156452, -0.062023743987083435, 0.016806336119771004, 0.008403657004237175, -0.07971741259098053, -0.0316961295902729, -0.00432992447167635, 0.06037918105721474, 0.0007718175183981657, -3.945542747773177e-33, -0.12243281304836273, 0.11549411714076996, -0.02488221600651741, 0.056190524250268936, -0.019929811358451843, -0.027719728648662567, -0.04682379215955734, 0.02452162839472294, 0.05241621658205986, 0.06126876175403595, -0.014008830301463604, -0.008845468983054161, -0.07538115978240967, 0.030553460121154785, 0.03871326521039009, -0.0017173598753288388, -0.0695025771856308, -0.030684249475598335, -0.0844215452671051, -0.06050611287355423, 0.005710188299417496, 0.04603932052850723, -0.04499354213476181, 0.01239942666143179, -0.027560019865632057, -0.054193463176488876, 0.08352979272603989, 0.11601648479700089, 0.03231313079595566, -0.02830256149172783, -0.06592205911874771, -0.017425738275051117, 0.018717404454946518, 0.08787756413221359, -0.03019719384610653, 0.04561470076441765, 0.041798342019319534, 0.004589979071170092, -0.012459587305784225, -0.04856612905859947, 0.08246496319770813, -0.0011800177162513137, 0.02500641532242298, -0.05679165571928024, 0.012326421216130257, 0.04679213836789131, -0.09767530858516693, -0.019090550020337105, -0.004263358656316996, -0.028044443577528, 0.07669347524642944, -0.04764638841152191, -0.019451260566711426, 0.019703982397913933, -0.05660504847764969, 0.0490623340010643, 0.041163090616464615, 0.06398201733827591, 0.06521285325288773, 0.021989136934280396, -0.12492593377828598, -0.07797642052173615, 0.052268121391534805, 0.06728734821081161, -0.06024857982993126, 0.027735348790884018, 0.002261427929624915, -0.02729111909866333, 0.0688270777463913, 0.039804816246032715, 0.025044411420822144, 0.11402822285890579, 0.04778065159916878, 0.07039003819227219, 0.041249487549066544, -0.08983433991670609, -0.011100314557552338, -0.03432050347328186, -0.005219579674303532, -0.018682122230529785, 0.05574638769030571, -0.0038564729038625956, 0.056889474391937256, 0.028570059686899185, 0.03247084468603134, 0.0335124209523201, 0.022627539932727814, 0.08556835353374481, -0.05625208839774132, -0.03865897282958031, 0.01912342756986618, -0.007463688496500254, 0.03269602358341217, -0.04098919779062271, -0.0093474006280303, -4.253772800666411e-08, -0.09675905853509903, -0.031779129058122635, 0.032308291643857956, 0.025939540937542915, -0.015042898245155811, 0.008294115774333477, 0.046604376286268234, 0.032409947365522385, -0.007157132960855961, -0.026363110169768333, 0.013543613255023956, -0.00970043707638979, 0.015618294477462769, -0.04650956019759178, 0.004003780893981457, 0.07106267660856247, 0.02056436613202095, 0.0031948809046298265, 0.02085413783788681, -0.03067447431385517, -0.01145123690366745, -0.02956806682050228, 0.006650647614151239, 0.09747711569070816, 0.10264808684587479, -0.03308546170592308, 0.01808062568306923, 0.0728951245546341, 0.015379274263978004, -0.01590951345860958, 0.06841854006052017, 0.03470157831907272, -0.004419914912432432, 0.06464409083127975, -0.024616338312625885, 0.13249391317367554, 0.03685217723250389, -0.025030888617038727, 0.020817948505282402, 0.07515811920166016, -0.06898084282875061, -0.0009823819855228066, 0.049918994307518005, -0.03167695924639702, 0.020701952278614044, 0.030278975144028664, -0.06836261600255966, -0.009365641511976719, -0.04106144607067108, -0.060496725142002106, 0.06861430406570435, -0.010268419981002808, -0.021154455840587616, 0.006505122873932123, 0.01281279418617487, -0.05061188340187073, -0.04563845694065094, -0.10888183861970901, -0.04229617863893509, 0.015264743939042091, -0.0023741554468870163, 0.08162140101194382, 0.03940042108297348, -0.07267280668020248 ] }, { "text": "### Manual Backpropagation Example\n\n```python\nimport torch\n\n# Simple network: y = w2 * relu(w1 * x + b1) + b2\nx = torch.tensor([1.0, 2.0, 3.0], requires_grad=False)\ntarget = torch.tensor([1.0])\n\n# Initialize weights with gradient tracking\nw1 = torch.randn(3, 4, requires_grad=True)\nb1 = torch.zeros(4, requires_grad=True)\nw2 = torch.randn(4, 1, requires_grad=True)\nb2 = torch.zeros(1, requires_grad=True)\n\n# Forward pass\nhidden = torch.relu(x @ w1 + b1)\noutput = hidden @ w2 + b2\n\n# Compute loss (MSE)\nloss = ((output - target) ** 2).mean()\nprint(f\"Loss: {loss.item():.4f}\")\n\n# Backward pass - computes all gradients\nloss.backward()\n\n# Gradients are now available\nprint(f\"w1 gradient shape: {w1.grad.shape}\")\nprint(f\"w2 gradient shape: {w2.grad.shape}\")\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_6", "embedding": [ -0.048171356320381165, -0.11917823553085327, -0.008949242532253265, 0.09901195764541626, 0.025845680385828018, 0.03983622416853905, 0.01195734366774559, -0.03546367213129997, -0.055831778794527054, -0.07931195944547653, -0.04297402873635292, -0.020193299278616905, -0.0019402462057769299, -0.04274885356426239, -0.060024429112672806, 0.10154982656240463, -0.044725220650434494, 0.07716337591409683, -0.06912492960691452, -0.09735153615474701, 0.04437701031565666, -0.03644173964858055, 0.03237885981798172, 0.016997776925563812, 0.007571063470095396, 0.0251038558781147, -0.0305433738976717, -0.009855836629867554, 0.041478920727968216, 0.013623547740280628, 0.03428560867905617, -0.05962401255965233, -0.08842495083808899, 0.017358412966132164, -0.08662401884794235, 0.002382120816037059, -0.06676133722066879, 0.015201047994196415, -0.05420477315783501, 0.033430635929107666, -0.03256794065237045, 0.034370776265859604, -0.02512732334434986, 0.001662779483012855, 0.01902267523109913, 0.016415974125266075, 0.06648634374141693, 0.04909932613372803, -0.01222610380500555, -0.010354362428188324, 0.08172240108251572, -0.06115874648094177, -0.03420242294669151, 0.024089420214295387, 0.024197258055210114, 0.024614956229925156, 0.07093362510204315, 0.000764247146435082, -0.0600944347679615, -0.002579885069280863, 0.025306303054094315, -0.09909920394420624, 0.013871465809643269, -0.1182035505771637, 0.00524479802697897, 0.0056534139439463615, -0.04616091027855873, -0.022074786946177483, 0.04030436649918556, 0.03896947205066681, -0.01228822860866785, 0.02242150902748108, -0.015141211450099945, 0.018270062282681465, -0.007002733647823334, -0.009283444844186306, 0.1349860578775406, 0.06732413172721863, -0.030441971495747566, -0.05198134109377861, 0.07058769464492798, 0.010445799678564072, 0.043971557170152664, 0.022024545818567276, 0.054787687957286835, -0.08103987574577332, 0.0021138049196451902, 0.0010078332852572203, 0.05665729194879532, -0.02071596123278141, -0.003980725537985563, -0.021855348721146584, -0.0529523603618145, 0.00950310006737709, 0.05892329663038254, -0.02385082095861435, 0.01648635044693947, -0.02613932453095913, -0.034097105264663696, 0.03996490314602852, -0.02266438491642475, -0.05739652365446091, 0.04408532753586769, 0.053868021816015244, 0.03566334396600723, 0.04122025519609451, 0.030735142529010773, 0.06188087537884712, 0.012153866700828075, -0.08440030366182327, 0.03515489026904106, 0.038835275918245316, 0.0470520555973053, 0.029594935476779938, 0.05498834699392319, -0.034595273435115814, 0.07148246467113495, 0.005445684306323528, 0.017992665991187096, 0.07277287542819977, -0.10052341222763062, 0.084905706346035, -0.0004200018011033535, -0.02971729263663292, -0.032919880002737045, -0.07024594396352768, 0.00022110466670710593, 8.854390626417741e-33, -0.021898098289966583, 0.0391133651137352, -0.07226762175559998, -0.02653791569173336, 0.025917431339621544, 0.041310325264930725, 0.07295194268226624, -0.06320958584547043, 0.0006707687862217426, -0.0033341520465910435, -0.08255098015069962, -0.016807151958346367, -0.043850600719451904, 0.027808282524347305, -0.0336991548538208, -0.08747100085020065, 0.08352892100811005, 0.006345057860016823, 0.0835152193903923, -0.04538552463054657, 0.051487501710653305, 0.030431928113102913, -0.037106648087501526, -0.07050316780805588, -0.07530377805233002, 0.011537731625139713, 0.045526809990406036, -0.02669426240026951, -0.008194789290428162, -0.004680133890360594, 0.0007344003533944488, -0.03681747242808342, -0.04333348199725151, -0.056101392954587936, -0.004059206694364548, -0.03277846798300743, 0.01999071054160595, 0.01834290474653244, 0.06787288933992386, -0.07938431948423386, 0.02136334776878357, 0.06880132853984833, -0.03248047083616257, -0.01804298907518387, -0.04209745675325394, -0.08654385060071945, -0.04163368046283722, 0.0803925096988678, 0.053665224462747574, -0.018420496955513954, -0.027411773800849915, 0.00245552696287632, -0.02155812829732895, -0.002208175603300333, 0.008789204992353916, -0.05893561989068985, 0.06597083061933517, 0.11140313744544983, 0.09668142348527908, -0.02274322137236595, 0.06617274880409241, 0.05454051122069359, -0.04812304675579071, 0.05835094302892685, -0.05556872487068176, 0.0034589176066219807, -0.024776268750429153, 0.038553036749362946, -0.047387562692165375, 0.005628195125609636, -0.05567500367760658, 0.0362110361456871, -0.012920988723635674, -0.047518737614154816, 0.042369190603494644, -0.021438589319586754, 0.003316478803753853, -0.07369443774223328, -0.0010604088893160224, -0.035757459700107574, -0.13697780668735504, 0.10603975504636765, -0.03530202805995941, -0.014769034460186958, -0.09751064330339432, 0.03707028180360794, 0.009143820963799953, -0.09888450056314468, -0.027003135532140732, -0.017909688875079155, -0.10710307210683823, -0.019343385472893715, 0.03918696194887161, 0.045193057507276535, -0.03636884316802025, -7.596148085453288e-33, -0.04862089455127716, 0.12424937635660172, 0.049631115049123764, 0.01834947057068348, -0.014710566960275173, 0.014513346366584301, 0.015889525413513184, -0.025638045743107796, 0.014645729213953018, 0.03368475288152695, -0.012293040752410889, -0.07398199290037155, -0.08255203813314438, 0.009681662544608116, 0.08721611648797989, -0.002713279565796256, -0.01765773631632328, 0.05288906767964363, 0.018334554508328438, -0.061726149171590805, -0.013343894854187965, 0.12187795341014862, -0.1154409646987915, 0.024399707093834877, -0.0961427092552185, -0.02895432896912098, 0.1060725525021553, 0.0990859642624855, 0.007812103256583214, -0.043259844183921814, 0.0023821243084967136, 0.0375363864004612, 0.012191710062325, 0.09142164885997772, -0.05093517154455185, 0.006692586001008749, -0.015223081223666668, -0.013934049755334854, -0.026194486767053604, 0.020694253966212273, 0.08814617246389389, 0.022965796291828156, -0.027955127879977226, 0.028833461925387383, -0.005005143582820892, 0.05365920439362526, -0.10350112617015839, -0.025725284591317177, 0.007153741084039211, -0.019595544785261154, 0.01393203716725111, -0.06696560233831406, -0.10444201529026031, -0.0029647876508533955, -0.05748170614242554, 0.005385382100939751, 0.010977262631058693, 0.01649630442261696, 0.025901013985276222, 0.02928517386317253, -0.06577833741903305, -0.08545493334531784, 0.08161428570747375, 0.008191857486963272, -0.01948787271976471, 0.039937254041433334, -0.011364010162651539, 0.034979138523340225, 0.08188322186470032, 0.04593176394701004, 0.015336721204221249, 0.15491993725299835, 0.03199224919080734, 0.01618705503642559, 0.04252375289797783, 0.01349973026663065, -0.0023750585969537497, -0.01973901130259037, 0.026748357340693474, -0.0501825250685215, 0.0027182644698768854, -0.019352849572896957, 0.02644537016749382, 0.01276752632111311, 0.0813741385936737, 0.018912989646196365, 0.01736399345099926, 0.10992580652236938, -0.023085810244083405, -0.028509333729743958, 0.047958001494407654, -0.027694320306181908, 0.10663571208715439, -0.05628388747572899, 0.05993929132819176, -5.23215817338496e-08, -0.05385579168796539, 0.02340458147227764, 0.013629707507789135, 0.07981553673744202, -0.06440680474042892, -0.0014213979011401534, 0.02650805376470089, 0.014069430530071259, -0.0038818572647869587, -0.06288377940654755, -0.01629665121436119, -0.06868436932563782, 0.027570296078920364, -0.0060092248022556305, -0.049801889806985855, 0.13680218160152435, -0.04995213449001312, -0.04931437969207764, 0.06213604658842087, 0.010977378115057945, -0.016332905739545822, -0.04398103430867195, 0.022784428671002388, 0.0729157030582428, -0.018727527931332588, -0.03226719796657562, 0.031053980812430382, 0.03253260254859924, -0.0014466167194768786, -0.01658337377011776, 0.04078222066164017, -0.01682683825492859, 0.047453392297029495, 0.09018835425376892, 0.03086014837026596, 0.08138148486614227, -0.005508543457835913, 0.016811206936836243, -0.00524067273363471, 0.08304424583911896, -0.09070169180631638, 0.00655369134619832, 0.04001214727759361, -0.008498350158333778, 0.030246678739786148, -0.04426722973585129, -0.07246682792901993, -0.04809977486729622, -0.00739850802347064, -0.03861263394355774, 0.09252727031707764, -0.05176598206162453, 0.010079183615744114, 0.04504725709557533, 0.04159457981586456, -0.061774756759405136, -0.06959780305624008, 0.008890422992408276, -0.031772129237651825, 0.039518486708402634, 0.0016448895912617445, 0.006542075891047716, -0.09617649763822556, -0.077894426882267 ] }, { "text": "### Training Loop with PyTorch\n\n```python\nimport torch\nimport torch.nn as nn\nimport torch.optim as optim\n\n# Create model, loss function, and optimizer\nmodel = MLP(input_size=10, hidden_size=64, output_size=3)\ncriterion = nn.CrossEntropyLoss()\noptimizer = optim.Adam(model.parameters(), lr=0.001)\n\n# Training loop\ndef train_step(model, X_batch, y_batch):\n model.train()\n \n # Forward pass\n outputs = model(X_batch)\n loss = criterion(outputs, y_batch)\n \n # Backward pass\n optimizer.zero_grad() # Clear previous gradients\n loss.backward() # Compute gradients\n optimizer.step() # Update weights\n \n return loss.item()\n\n# Example training\nX_train = torch.randn(100, 10) # 100 samples\ny_train = torch.randint(0, 3, (100,)) # 3 classes", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_7", "embedding": [ -0.06993614882230759, -0.0750972107052803, -0.01279474701732397, 0.037583522498607635, 0.00919543206691742, -0.008093302138149738, 0.024597827345132828, 0.015289966948330402, -0.06393222510814667, -0.0993708148598671, -0.013790011405944824, -0.021555893123149872, -0.056120432913303375, -0.039227213710546494, -0.03090701252222061, 0.06797196716070175, -0.06612327694892883, 0.06048092618584633, -0.10575034469366074, -0.12198486924171448, 0.07094734162092209, -0.023708108812570572, 0.03417518734931946, 0.023182958364486694, -0.03830225393176079, -0.0002020225510932505, 0.0002781463845167309, 0.015669383108615875, 0.057150956243276596, -0.014681793749332428, 0.07221466302871704, -0.043466150760650635, -0.037413470447063446, 0.040560293942689896, -0.012751291505992413, -0.011841497384011745, -0.09292963147163391, 0.01682445779442787, -0.02810751646757126, 0.06932789832353592, 0.014870204031467438, -0.0028646625578403473, -0.03352634608745575, -0.04610756039619446, 0.06349879503250122, 0.06318676471710205, 0.009725467301905155, -0.018153714016079903, 0.019803060218691826, -0.028970684856176376, 0.0034029833041131496, -0.011783549562096596, -0.017090626060962677, -0.013740220107138157, -0.016958137974143028, -0.003561000106856227, 0.06839854270219803, -0.04507679119706154, -0.06447852402925491, -0.03875768184661865, 0.0008403845713473856, -0.04479166865348816, -0.02034987136721611, -0.06088767200708389, 0.010248771868646145, -0.0369252935051918, -0.00033117193379439414, -0.02372315712273121, 0.03820747137069702, 0.051086701452732086, 0.040074750781059265, 0.04382043331861496, -0.03962639346718788, 0.039237551391124725, -0.007740475703030825, -0.01358911581337452, 0.18606069684028625, 0.03757129982113838, -0.06316744536161423, -0.05098652467131615, -0.014736220240592957, 0.0036283221561461687, 0.05459677800536156, -0.009840617887675762, 0.03808359056711197, -0.04379327967762947, 0.03383259475231171, -0.006529003847390413, 0.05704846605658531, -0.0023995626252144575, -0.021017154678702354, -0.024652045220136642, -0.0804714635014534, 0.0163172148168087, 0.048448048532009125, 0.056720200926065445, 0.018280424177646637, -0.048561982810497284, -0.11883161962032318, 0.050564028322696686, 0.01619626209139824, -0.023286247625947, 0.04422779381275177, 0.01226247288286686, 0.021691739559173584, 0.06249869614839554, 0.09233430027961731, 0.08283819258213043, 0.03446101024746895, -0.047954726964235306, 0.04437722638249397, 0.029330777004361153, 0.009338927455246449, 0.03226551041007042, 0.05938030034303665, -0.009979087859392166, 0.00494086928665638, 0.05325963720679283, -0.02895320951938629, 0.10721859335899353, -0.08019918948411942, 0.09534289687871933, -0.04755326732993126, 0.048036932945251465, -0.06477947533130646, -0.05421990156173706, -0.047273680567741394, 5.790962349388625e-33, -0.0499027781188488, 0.00771365175023675, -0.04166877642273903, -0.0854506567120552, -0.02621312253177166, 0.029859568923711777, 0.05431825667619705, -0.016643863171339035, -0.06162814423441887, -0.002129566390067339, -0.08460796624422073, -0.07211031764745712, -0.03195279464125633, 0.06186272203922272, -0.04453832283616066, -0.056170523166656494, 0.017958706244826317, 0.057598356157541275, 0.07875584810972214, -0.03838254511356354, 0.08519263565540314, -0.028428781777620316, -0.04117865487933159, -0.03664403408765793, -0.0992785170674324, 0.08214055746793747, 0.019533786922693253, -0.026892205700278282, -0.0843086838722229, -0.01624022237956524, -0.05804017186164856, 0.014534316025674343, 0.02635328471660614, -0.035303838551044464, 0.02992253005504608, -0.0184493251144886, 0.0653800368309021, 0.03573824465274811, 0.07105708867311478, -0.05630806088447571, -0.013702783733606339, 0.06194452568888664, 0.03934285789728165, -0.008481430821120739, -0.07131946086883545, -0.004759954754263163, -0.0052119093015789986, 0.0964345782995224, 0.013303028419613838, 0.013743738643825054, -0.058264680206775665, -0.021362658590078354, -0.005844257306307554, 0.015643790364265442, 0.007378166541457176, -0.02066246047616005, 0.05719330906867981, 0.10449554026126862, 0.1297089159488678, -0.04991069808602333, 0.062175169587135315, 0.0595778189599514, -0.03786294907331467, 0.06231988966464996, -0.038226790726184845, 0.024304283782839775, -0.02623693272471428, -0.024126041680574417, 0.014971166849136353, 0.025537211447954178, -0.12137818336486816, 0.03711235895752907, -0.042184460908174515, -0.032585304230451584, 0.0865621343255043, -0.07435601204633713, -0.0026295806746929884, -0.07523095607757568, 0.003404869930818677, -0.006812344770878553, -0.0746079683303833, 0.10870785266160965, -0.09511887282133102, -0.08958645910024643, -0.05746198818087578, -0.02536245994269848, 0.008437680080533028, -0.030577747151255608, -0.003879827680066228, -0.031286079436540604, -0.06764782220125198, -0.07168444246053696, 0.04675997421145439, 0.015622520819306374, -0.020512022078037262, -6.476480165403459e-33, -0.008097228594124317, 0.08188597857952118, 0.003005621023476124, 0.050130147486925125, 0.033366162329912186, 0.0019893553107976913, 0.005553785711526871, -0.0009229185525327921, -0.044177357107400894, -0.005978587549179792, -0.013813496567308903, -0.0650341659784317, -0.04831602796912193, -0.005588881205767393, 0.06611599028110504, -0.018764030188322067, -0.02790943719446659, 0.03974694758653641, 0.056900180876255035, -0.01945711299777031, -0.025006765499711037, 0.13903449475765228, -0.14481587707996368, -0.004957418888807297, -0.0911402776837349, -0.02864677459001541, 0.016628539189696312, 0.1026289090514183, 0.027691233903169632, -0.036105260252952576, -0.0279094185680151, 0.029124468564987183, -0.04753037169575691, 0.08533946424722672, -0.013879646547138691, 0.054413583129644394, 0.02197798155248165, -0.02715265192091465, -0.01996561884880066, 0.06938928365707397, 0.1157020702958107, 0.03849921002984047, -0.014024498872458935, 0.047551754862070084, -0.04005857929587364, 0.05466599017381668, -0.07726190239191055, -0.03974528983235359, -0.0424431674182415, 0.027942419052124023, 0.008795320056378841, -0.060521189123392105, -0.10988820344209671, 0.004344118293374777, -0.02503233775496483, -0.008252190425992012, -0.01839667744934559, 0.007137666456401348, -0.004391838330775499, 0.033907052129507065, -0.08513772487640381, -0.06493296474218369, 0.040083881467580795, -0.006616332568228245, -0.022470900788903236, 0.04349325969815254, -0.04028410091996193, 0.08569667488336563, 0.05872202292084694, 0.05084269493818283, -0.014597566798329353, 0.10943656414747238, 0.07883907854557037, 0.007380220107734203, -0.029831761494278908, -0.010770054534077644, -0.0026159929111599922, -0.008209900930523872, 0.024231072515249252, -0.06117004156112671, -0.0367145761847496, -0.04707759618759155, 0.02103283628821373, 0.05703393742442131, 0.033627308905124664, 0.05116385221481323, 0.06177867576479912, 0.1303577423095703, -0.014281662181019783, -0.06681278347969055, 0.09276077896356583, -0.015058747492730618, 0.10441366583108902, 0.007691190578043461, 0.01020518783479929, -4.888158855465008e-08, -0.04993816837668419, 0.012716004624962807, 0.03083735518157482, 0.11318416893482208, 0.0026009196881204844, -0.014789378270506859, 0.05426369979977608, 0.040511224418878555, -0.018170097842812538, -0.039938606321811676, 0.04962415620684624, -0.043912023305892944, 0.013210169039666653, 0.014770426787436008, 0.013678427785634995, 0.027734365314245224, -0.05276643857359886, 0.026636160910129547, 0.048411525785923004, -0.017829062417149544, -0.020236188545823097, -0.05078904703259468, -0.0036489677149802446, 0.006182993296533823, -0.00975838303565979, -0.06808137148618698, 0.028912167996168137, 0.002675052033737302, -0.018366359174251556, -0.05232836306095123, 0.031007390469312668, -0.01167961023747921, 0.03983244299888611, 0.08217860013246536, 0.03991885483264923, 0.06100916489958763, 0.0023251879028975964, 0.048599448055028915, 0.018702061846852303, 0.012506412342190742, -0.11855646222829819, 0.028884822502732277, -0.03702876344323158, -0.04549843817949295, 0.02615945227444172, -0.033415786921978, -0.024923834949731827, -0.10843226313591003, -0.009894133545458317, -0.012827755883336067, 0.04353336617350578, 0.007909758947789669, 0.00490987254306674, 0.02930980920791626, 0.06284518539905548, -0.08806982636451721, -0.07737360894680023, -0.009709506295621395, -0.06334412842988968, 0.014817241579294205, -0.025756875053048134, -0.03507675603032112, -0.05500222370028496, -0.042942114174366 ] }, { "text": "# Example training\nX_train = torch.randn(100, 10) # 100 samples\ny_train = torch.randint(0, 3, (100,)) # 3 classes\n\nfor epoch in range(10):\n loss = train_step(model, X_train, y_train)\n print(f\"Epoch {epoch+1}, Loss: {loss:.4f}\")\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_8", "embedding": [ -0.022124258801341057, 0.005298502743244171, 0.006806660909205675, 0.03787001967430115, 0.06516392529010773, 0.0008084140717983246, -0.007851566188037395, 0.033302973955869675, -0.07449109107255936, -0.1321292668581009, -0.020174337550997734, -0.02736542746424675, -0.047497037798166275, -0.0524321012198925, -0.006613837089389563, -0.03836056962609291, -0.11595097184181213, 0.030960433185100555, -0.0792122483253479, -0.09587334841489792, 0.12783299386501312, 0.016084391623735428, 0.10155881941318512, 0.0794537290930748, -0.045091673731803894, -0.05946413800120354, 0.026975953951478004, 0.0341084748506546, 0.04576955735683441, 0.02858658693730831, 0.0324016697704792, 0.0028284923173487186, -0.05101839825510979, 0.03156864643096924, 0.0037568339612334967, -0.05294465646147728, -0.018081888556480408, -0.07003495842218399, 0.023222055286169052, 0.07870764285326004, -0.025745930150151253, -0.034002844244241714, -0.008622978813946247, 0.0046517858281731606, 0.02830689586699009, 0.03843361884355545, 0.029427994042634964, -0.0352807343006134, 0.018275238573551178, 0.01261807419359684, 0.04810157045722008, -0.024381939321756363, -0.0461074598133564, 0.024864884093403816, 0.00826016440987587, -0.008225368335843086, 0.08165137469768524, -0.05701387673616409, -0.0696932002902031, -0.01570291444659233, 0.00648809690028429, -0.0240849070250988, -0.047698888927698135, -0.057045500725507736, -0.062282685190439224, -0.04909558594226837, -0.03706439584493637, 0.039455778896808624, 0.06431782245635986, 0.01345134899020195, 0.021244043484330177, 0.009326531551778316, 0.025641683489084244, 0.057796601206064224, -0.036153338849544525, -0.038184937089681625, 0.12822356820106506, 0.05243431031703949, -0.06598663330078125, -0.05922936275601387, -0.06858408451080322, -0.005622467957437038, 0.09066023677587509, 0.0028642602264881134, 0.015427515842020512, -0.06686502695083618, 0.06012899801135063, 0.033040594309568405, 0.032913073897361755, -0.0051627508364617825, -0.05921631678938866, 0.031884267926216125, -0.08891148865222931, 0.013296823017299175, -0.01406419463455677, 0.0343252457678318, 0.12862272560596466, -0.03706742078065872, -0.018785253167152405, 0.047111887484788895, -0.016092520207166672, -0.04321255162358284, 0.008288449607789516, 0.051438458263874054, 0.031057873740792274, 0.03302253410220146, 0.004091743379831314, -0.0007049728883430362, -0.003992418292909861, -0.0313546322286129, 0.06234791874885559, 0.012546420097351074, -0.0046569108963012695, -0.016156703233718872, 0.08335339277982712, -0.0021470561623573303, -0.09304407238960266, 0.019401367753744125, -0.025178857147693634, 0.12224346399307251, -0.09911172091960907, 0.0752011239528656, -0.021799743175506592, 0.03558863699436188, -0.07197433710098267, -0.08189058303833008, 0.007276945747435093, 6.816158635363248e-34, 0.0033103134483098984, 0.00043517493759281933, -0.09169065207242966, -0.05274873226881027, 0.005894291680306196, 0.039769623428583145, 0.05825922265648842, -0.04125938192009926, -0.018609313294291496, 0.020738773047924042, -0.08189438283443451, -0.029116429388523102, -0.007742579095065594, 0.02193775773048401, -0.0458829402923584, -0.04510185122489929, 0.022699523717164993, 0.010384396649897099, 0.10215342789888382, -0.022157814353704453, 0.061334278434515, 0.017287857830524445, -0.023788273334503174, -0.05013063922524452, 0.0034511093981564045, 0.08301851898431778, -0.02968417853116989, -0.032138217240571976, -0.09240573644638062, 0.019434545189142227, -0.003432948375120759, 0.013128086924552917, 0.03350820392370224, -0.0934184193611145, 0.020218266174197197, -0.014827201142907143, 0.06357912719249725, 0.09085453301668167, -0.03209679573774338, -0.12500940263271332, 0.02191794291138649, 0.02928614243865013, 0.021839987486600876, -0.054684512317180634, -0.009102010168135166, 0.004899217747151852, 0.07850762456655502, 0.0580090656876564, 0.03452435880899429, -0.011906984262168407, -0.025770965963602066, -0.07024545222520828, 0.01687166467308998, 0.010781148448586464, 0.04912331700325012, -0.029966898262500763, 0.09807807952165604, 0.05394889414310455, 0.048337094485759735, -0.10273882746696472, 0.09688477963209152, 0.04152339696884155, -0.00999633502215147, 0.06662843376398087, -0.06486854702234268, 0.016652949154376984, 0.001077720313332975, -0.02897479757666588, 0.01762368343770504, 0.06496375799179077, -0.09256329387426376, 0.020588893443346024, -0.0794525146484375, -0.04378432035446167, 0.031120728701353073, -0.025426629930734634, 0.03652680292725563, -0.04054947569966316, -0.02243698574602604, -0.002296996768563986, -0.0643126368522644, 0.07809560745954514, -0.08352748304605484, -0.07491771876811981, -0.062109146267175674, -0.004234340973198414, 0.03444614261388779, -0.022260010242462158, 0.011723877862095833, -0.056778568774461746, -0.13732008635997772, -0.07629584521055222, 0.06191876158118248, 0.0012211771681904793, -0.023308778181672096, -3.6980302899220516e-33, -0.009692113846540451, 0.14357483386993408, -0.022075960412621498, 0.043052494525909424, -0.02708190679550171, -0.0009886404732242227, 0.03161980211734772, 0.08551962673664093, -0.017661361023783684, 0.06525522470474243, -0.006997402291744947, -0.07800980657339096, -0.055120330303907394, -0.015945760533213615, 0.04448934271931648, -0.048902809619903564, -0.042389728128910065, -0.01612182892858982, 0.021580377593636513, -0.04431844875216484, 0.000141324577271007, 0.07869832962751389, -0.08955621719360352, -0.04224786162376404, 0.012595416978001595, -0.04841019958257675, 0.0595400296151638, 0.08086975663900375, 0.04607546329498291, -0.0915338397026062, 0.0004007111710961908, -0.010804717428982258, -0.018175171688199043, 0.09809499979019165, -0.05296268314123154, 0.03401389718055725, 0.059253379702568054, -0.030349034816026688, -0.029571756720542908, 0.03484770655632019, 0.08573280274868011, 0.04176546260714531, -0.041662972420454025, 0.08610668033361435, -0.07306478172540665, 0.06530078500509262, -0.0010716724209487438, 0.007947616279125214, 0.010524793528020382, -0.017453130334615707, 0.024961670860648155, -0.11429710686206818, -0.09018469601869583, 0.022488314658403397, -0.01521057914942503, 0.024015706032514572, -0.015354559756815434, 0.008721497841179371, -0.08239380270242691, 0.09876551479101181, -0.03291308134794235, -0.07933488488197327, 0.026728659868240356, 0.06145182624459267, -0.03888457268476486, -0.019574686884880066, -0.10990317910909653, 0.07261583209037781, 0.05498170852661133, 0.06364443153142929, 0.06252188980579376, 0.13982617855072021, -0.0011068332241848111, 0.0021914152894169092, -0.07309525460004807, -0.02925623580813408, -0.06379508972167969, 0.039470113813877106, 0.02304907888174057, -0.02641887590289116, 0.00870627723634243, -0.013356485404074192, -0.008752860128879547, 0.06639508157968521, 0.016955217346549034, 0.04766591265797615, 0.025239963084459305, 0.08013520389795303, 0.016821077093482018, -0.09905827790498734, 0.06801952421665192, 0.009889905340969563, 0.046610306948423386, 0.007461282890290022, -0.005697018001228571, -3.6885921872453764e-08, -0.05021502822637558, 0.038383256644010544, 0.0677497535943985, 0.08125387132167816, 0.02491670660674572, 0.017800167202949524, 0.008633814752101898, 0.005083308555185795, 0.014432107098400593, 0.02075195126235485, 0.04149602726101875, -0.06694959104061127, -0.026907330378890038, 0.0028795870020985603, -0.016140425577759743, 0.0360984206199646, -0.00848844088613987, 0.03976696729660034, 0.0482686422765255, 0.037049416452646255, 0.020728223025798798, -0.05770636722445488, 0.03253798559308052, -0.032186247408390045, -0.0457938015460968, -0.0763653814792633, 0.035854410380125046, 0.05762545391917229, -0.035176075994968414, -0.05589805543422699, -0.00043513745185919106, -0.03198646754026413, 0.04927370697259903, 0.03658950328826904, -0.015071000903844833, 0.05686163529753685, -0.06386252492666245, 0.026518724858760834, 0.0457516685128212, 0.021969221532344818, -0.06536586582660675, -0.06760188937187195, -0.027664653956890106, -0.04169411212205887, -0.03278515115380287, -0.019911710172891617, 0.02626039832830429, -0.08212745189666748, 0.02981201373040676, 0.014515300281345844, -0.006780774798244238, -0.01744168810546398, -0.013178096152842045, -0.004558983258903027, -0.004332611337304115, -0.0315701849758625, -0.03899868577718735, -0.0029031503945589066, -0.04640331491827965, -0.02589399367570877, -0.02020593173801899, -0.01932092197239399, -0.050844840705394745, -0.03934669494628906 ] }, { "text": "## Convolutional Neural Networks (CNNs)\n\nCNNs are designed for processing grid-like data such as images. They use convolutional layers to automatically learn spatial hierarchies of features.\n\n### Key Components\n\n- **Convolutional Layer**: Applies filters to detect local patterns\n- **Pooling Layer**: Reduces spatial dimensions while retaining important features\n- **Stride**: Step size when sliding the filter\n- **Padding**: Adding zeros around input to control output size", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_9", "embedding": [ -0.06720203906297684, 0.001206672633998096, 0.05227821692824364, -0.024348491802811623, 0.020670605823397636, 0.010300296358764172, 0.0006290057208389044, -0.08809451758861542, -0.0013539339415729046, -0.0635872334241867, -0.028645645827054977, 0.015270731411874294, -0.041967812925577164, 0.03413406014442444, -0.1417427659034729, -0.0009423453011550009, 0.0064855581149458885, 0.08802275359630585, -0.10135021805763245, -0.008345313370227814, 0.034243740141391754, -0.10272137075662613, -0.02514106221497059, -0.03138568997383118, 0.05212770402431488, 0.11288630217313766, -0.04673687741160393, -0.03995158150792122, 0.04690273106098175, -0.027455544099211693, 0.022739145904779434, 0.08679237216711044, -0.003114016493782401, 0.057077959179878235, -0.04418579861521721, 0.00821191631257534, 0.00582828838378191, 0.04984355717897415, -0.010424249805510044, -0.007464995142072439, 0.01842750608921051, -0.04954962059855461, 0.03133605793118477, 0.005816152319312096, 0.06543700397014618, 0.0799887478351593, -0.02293250523507595, -0.035002388060092926, -0.019773997366428375, 0.019928306341171265, -0.05483828857541084, -0.018044685944914818, -0.014516714960336685, 0.064432792365551, 0.038429614156484604, -0.014176657423377037, 0.011716530658304691, -0.003452819772064686, 0.03735268488526344, 0.0038573937490582466, 0.051008373498916626, -0.06405884027481079, -0.05673143267631531, 0.055117495357990265, 0.007179801352322102, -0.05515003576874733, -0.0889783576130867, -0.023180287331342697, 0.09350819885730743, -0.07564074546098709, 0.043706972151994705, 0.11195752024650574, 0.0220537930727005, 0.0423055998980999, 0.05066133290529251, 0.0029030905570834875, -0.030581403523683548, -0.018656663596630096, 0.02903575636446476, -0.056879281997680664, 0.041476521641016006, 0.02347150444984436, 0.00837766658514738, -0.002105737803503871, 0.061681054532527924, -0.015907956287264824, -0.07261878252029419, 0.03709458187222481, -0.038514118641614914, -0.04543541744351387, 0.018918557092547417, -0.023766327649354935, -0.050545401871204376, -0.09142393618822098, -0.03982473909854889, -0.0007336890557780862, -0.023979485034942627, -0.087518110871315, -0.09209737926721573, -0.0023644473403692245, -0.019539011642336845, -0.0551457479596138, 0.08276490867137909, 0.07383878529071808, 0.07900978624820709, -0.02917790785431862, 0.021935874596238136, 0.08986196666955948, 0.044764455407857895, -0.07621126621961594, -0.0160276610404253, -0.04882979765534401, -0.017417024821043015, -0.07744213193655014, 0.029330622404813766, 0.013907517306506634, -0.009180075488984585, -0.018506845459342003, 0.05341514199972153, -0.0637928918004036, -0.07527627050876617, -0.03523518145084381, -0.14600025117397308, -0.04965682327747345, 0.040395211428403854, 0.02519899606704712, -0.10690406709909439, 5.4111975935203766e-33, 0.03184126317501068, -0.00787246972322464, -0.045224595814943314, 0.0029711739625781775, 0.028260929509997368, -0.004244174342602491, 0.045648038387298584, -0.05271584913134575, 0.03302811458706856, 0.06273007392883301, -0.07741907984018326, 0.02470066025853157, -0.0797247439622879, 0.16278959810733795, -0.006310777273029089, -0.06522978097200394, 0.036651186645030975, 0.01808624342083931, -0.004797987639904022, 0.0003533908457029611, 0.0021081676241010427, -0.028117123991250992, 0.0481109544634819, -0.030987579375505447, -0.002985528204590082, -0.020272271707654, -0.04449617862701416, -0.02439546398818493, -0.047116320580244064, 0.017399299889802933, -0.0019137889612466097, 0.07459831237792969, -0.06572246551513672, 0.028421970084309578, -0.05266113951802254, 0.01571151427924633, -0.041510842740535736, -0.01836385950446129, 0.09833414107561111, -0.004444155376404524, -0.0033843459095805883, 0.007737486157566309, -0.04497966170310974, -0.04129154980182648, -0.03952101990580559, 0.028444021940231323, 0.06180546060204506, -0.0029314570128917694, -0.016355127096176147, 0.009166494943201542, 0.1210613027215004, 0.042858052998781204, -0.06249609589576721, -0.07667291909456253, 0.07630415260791779, 0.02901928313076496, 0.07509293407201767, 0.010367770679295063, 0.03317825868725777, 0.061973076313734055, 0.009876466356217861, -0.049641203135252, -0.10660072416067123, 0.04610030725598335, 0.023063616827130318, -0.08591371774673462, 0.10912855714559555, 0.058999937027692795, 0.009738681837916374, 0.02448214404284954, -0.0550798624753952, 0.01964700035750866, 0.002386830747127533, -0.018522150814533234, 0.019190143793821335, -0.005568822845816612, -0.01952417381107807, -0.057256508618593216, -0.05446529760956764, 0.01263259258121252, -0.027277983725070953, 0.015876460820436478, 0.019521906971931458, -0.01711062714457512, -0.06905310600996017, 0.05253719910979271, 0.02345619723200798, -0.062228355556726456, -0.029118841513991356, -0.0831843838095665, -0.021005451679229736, -0.0660388246178627, 0.015664061531424522, 0.007112760562449694, 0.0021087774075567722, -6.542879433177594e-33, 0.004942106083035469, 0.08038154989480972, -0.09509348124265671, 0.02656662091612816, -0.07483352720737457, 0.0295356884598732, 0.005488122347742319, 0.008874685503542423, 0.004658747464418411, -0.027178829535841942, -0.024606890976428986, 0.06269939988851547, 0.021553631871938705, -0.014043050818145275, -0.01705893501639366, -0.025573402643203735, -0.08704109489917755, -0.0552549734711647, 0.0009570066467858851, 0.01195949874818325, -0.06146717444062233, 0.034386277198791504, -0.0389041043817997, 0.0617271289229393, -0.07994057238101959, -0.019103622063994408, -0.008671142160892487, -0.03255443274974823, 0.04900440573692322, 0.0437670573592186, -0.0659153088927269, -0.029272299259901047, 0.036494895815849304, -0.042815618216991425, 0.030894853174686432, -0.001364992349408567, 0.03819514065980911, -0.015578591264784336, -0.00299226981587708, -0.04591204598546028, 0.07722899317741394, 0.002887201029807329, 0.023655205965042114, -0.006461052224040031, -0.02991006337106228, -0.017284533008933067, 0.01629418507218361, 0.09025996923446655, -0.08949847519397736, 0.05471637845039368, -0.033150747418403625, 0.045712895691394806, -0.08042716234922409, -0.023468181490898132, 0.034634411334991455, 0.061572059988975525, 0.035989344120025635, 0.03307870402932167, 0.07870148122310638, -0.03428484499454498, -0.09296450018882751, -0.08855926245450974, -0.033504828810691833, -0.015522082336246967, -0.023271383717656136, 0.08758439123630524, -0.07093583047389984, 0.025650687515735626, -0.00849172193557024, 0.04210749268531799, 0.039605334401130676, -0.005464555695652962, -0.02204388566315174, 0.004206920973956585, -0.059038009494543076, -0.12044363468885422, -0.010985090397298336, -0.005562456790357828, 0.02210839092731476, 0.05979142338037491, -0.023372255265712738, -0.03182134032249451, -0.034069519490003586, 0.09111620485782623, 0.10311654955148697, 0.1119125634431839, 0.004251077305525541, -0.014785629697144032, 0.03190971538424492, 0.005223924294114113, 0.025616437196731567, 0.02735045552253723, -0.01059333048760891, 0.04417596012353897, -0.009348402731120586, -4.918731377756558e-08, -0.06065960228443146, 0.03084997646510601, 0.02811158075928688, -0.027261478826403618, -0.01828167401254177, -0.06702692806720734, 0.08387197554111481, 0.15440675616264343, -0.020891791209578514, 0.03898465633392334, 0.034676309674978256, 0.0338129885494709, -0.035941705107688904, -0.041409894824028015, 0.08943846821784973, 0.02412969432771206, 0.04359164834022522, 0.05537116527557373, -0.01852503977715969, 0.02880658581852913, 0.035741113126277924, -0.046376582235097885, -0.0607014037668705, 0.09006258100271225, 0.029507463797926903, -0.06416690349578857, -0.006778949871659279, 0.037239398807287216, 0.05793879181146622, -0.002505828160792589, 0.04345400258898735, -0.011571703478693962, 0.04254406690597534, -0.006652212236076593, 0.06052921712398529, 0.10965175926685333, -0.039361629635095596, -0.07470641285181046, -0.02722201496362686, -0.054309677332639694, -0.02206009440124035, -0.010034920647740364, 0.00932291615754366, -0.03871094807982445, -0.10537903755903244, 0.05651223659515381, 0.05020003020763397, -0.12974965572357178, 0.014522871933877468, 0.0644136369228363, 0.03969849646091461, 0.037649694830179214, -0.030551964417099953, 0.07164468616247177, 0.03871537372469902, 0.01957850158214569, -0.012056191451847553, -0.055595263838768005, 0.06979528814554214, 0.04770420491695404, -0.023435914888978004, 0.11289598792791367, -0.0007744247559458017, -0.04128190875053406 ] }, { "text": "### CNN Architecture in PyTorch\n\n```python\nimport torch\nimport torch.nn as nn\nimport torch.nn.functional as F", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_10", "embedding": [ -0.05406680330634117, -0.039887186139822006, 0.004888951778411865, 0.04395574331283569, -0.05013088881969452, -0.020383916795253754, -0.0023161470890045166, 0.004457871895283461, -0.03343705087900162, -0.12286892533302307, 0.00407572602853179, -0.009056431241333485, -0.1028614491224289, 0.046807315200567245, -0.05129242688417435, 0.05586182326078415, -0.05816815793514252, 0.02107488550245762, -0.10106576234102249, -0.08505238592624664, 0.07091234624385834, -0.02398613840341568, 0.10760506242513657, 0.027681197971105576, -0.004938618279993534, -0.008819816634058952, 0.01324122492223978, -0.00878447201102972, 0.07445357739925385, -0.0031271472107619047, 0.08187989890575409, 0.04067043215036392, -0.055388081818819046, 0.07745552062988281, 0.03570251539349556, 0.0028503218200057745, -0.08720939606428146, -0.04282825440168381, 0.04495377466082573, 0.03386945649981499, 0.027530988678336143, -0.034610383212566376, -0.012799757532775402, -0.06066873297095299, -0.01690085418522358, 0.0702100321650505, 0.07798318564891815, -0.018272174522280693, 0.03773084282875061, -0.03173859789967537, 0.01212280709296465, 0.027205903083086014, -0.03409288823604584, 0.06175953522324562, 0.023027274757623672, 0.020285718142986298, 0.02819295972585678, -0.035370390862226486, -0.028322633355855942, -0.06552441418170929, 0.03962545096874237, 0.00811761524528265, 0.03522270545363426, -0.03078349307179451, -0.004841563757508993, 0.043266262859106064, -0.019801294431090355, -0.05688302591443062, 0.06488959491252899, -0.06932234019041061, 0.060580894351005554, -0.015170840546488762, 0.006537913344800472, 0.057599954307079315, 0.037702418863773346, -0.07904752343893051, 0.12020544707775116, 0.04941704124212265, 0.07764049619436264, -0.09809829294681549, 0.0373307429254055, -0.028931058943271637, 0.060283858329057693, 0.05252539739012718, 0.07187581062316895, -0.014866032637655735, -0.07746720314025879, 0.04901430383324623, -0.016657358035445213, -0.021931836381554604, -0.07119673490524292, -0.0671304389834404, -0.06318581104278564, 0.036783378571271896, 0.014583940617740154, -0.03191688284277916, 0.0381823405623436, 0.0029273759573698044, -0.13869608938694, 0.019505595788359642, -0.028393713757395744, -0.050038475543260574, 0.015311176888644695, 0.047001034021377563, 0.0074119423516094685, 0.0877336636185646, 0.019496070221066475, 0.09324590861797333, -0.055515188723802567, -0.052651822566986084, 0.041362881660461426, 0.006472822744399309, 0.051045097410678864, -0.05401052162051201, 0.07232777774333954, -0.054401278495788574, -0.06241943687200546, 0.05057384446263313, 0.07601334899663925, 0.06485109031200409, -0.04538710042834282, 0.04985295608639717, -0.1081860139966011, 0.08069270849227905, -0.0725468322634697, -0.050198595970869064, -0.05099547281861305, 4.096012636834153e-33, -0.034912582486867905, -0.008013462647795677, -0.02362508326768875, -0.022869164124131203, -0.014980449341237545, -0.04718818515539169, 0.09308408945798874, -0.06081812456250191, -0.09439314901828766, -0.05591396987438202, -0.07235044240951538, -0.03777191415429115, -0.04959828779101372, 0.058719027787446976, -0.09310703724622726, -0.038032423704862595, 0.05086536332964897, -0.000924434803891927, 0.04659838601946831, -0.01665911078453064, 0.04389046132564545, 0.033519644290208817, -0.03758459538221359, -0.020655646920204163, -0.08300059288740158, -0.008419521152973175, -0.05767960473895073, -0.046627916395664215, -0.041420161724090576, -0.0014142157742753625, -0.02738303877413273, 0.014937888830900192, 0.048612065613269806, -0.0022732745856046677, -0.0166032575070858, -0.039284102618694305, 0.016708698123693466, 0.01217995211482048, -0.024120226502418518, -0.08022201061248779, -0.06002068519592285, 0.10098572820425034, -0.0568622462451458, -0.04340316355228424, -0.008707731030881405, 0.08110776543617249, -0.0041426909156143665, 0.09459539502859116, 0.00465435953810811, -0.009319291450083256, 0.00683239009231329, 0.013109575025737286, 0.008214251138269901, 0.04060324281454086, 0.07092650979757309, -0.06773167103528976, 0.06540724635124207, 0.06294651329517365, 0.09088168293237686, -0.03956811502575874, 0.052500855177640915, 0.0406353622674942, -0.035732973366975784, 0.07744105160236359, 0.011631782166659832, -0.0010937496554106474, 0.00876772589981556, 0.060675833374261856, -0.038049910217523575, 0.03843935206532478, -0.09723394364118576, 0.07718750834465027, -0.020353663712739944, -0.02291528508067131, 0.02589985728263855, -0.019316133111715317, -0.046132929623126984, -0.10327377915382385, -0.08333633840084076, 0.07378388196229935, -0.04761245474219322, 0.02792448177933693, -0.016353897750377655, -0.04063037782907486, -0.09282851964235306, 0.049106415361166, 0.03710317984223366, -0.04895389825105667, 0.027903523296117783, 0.02039826475083828, -0.05941731110215187, -0.09804455190896988, 0.039619434624910355, 0.002531921025365591, 0.0018632863648235798, -4.7641485648201716e-33, 0.015753723680973053, 0.07055798172950745, -0.043135110288858414, -0.00697033666074276, -0.07640661299228668, -0.0008663268527016044, -0.061880968511104584, -0.06740482896566391, -0.000522228772751987, 0.014872674830257893, 0.030653763562440872, -0.0574512779712677, -0.021946782246232033, -0.05176326632499695, 0.043809711933135986, 0.02309252880513668, -0.0403907336294651, 0.013211988843977451, 0.052054375410079956, 0.018184348940849304, -0.029617197811603546, 0.11597896367311478, -0.11911042779684067, 0.02825990878045559, -0.09491514414548874, 0.007945377379655838, 0.008330520242452621, 0.03111576847732067, 0.0352809838950634, 0.002982089063152671, -0.018550394102931023, -0.010150820948183537, -0.027330050244927406, 0.03173631802201271, 0.0137109300121665, 0.029427308589220047, 0.06745043396949768, -0.10515273362398148, -0.012822438962757587, -0.05108548328280449, 0.13486790657043457, 0.0758826807141304, -0.06363857537508011, 0.057308878749608994, -0.04084997996687889, 0.05592190846800804, -0.024160489439964294, -0.026485415175557137, -0.044667262583971024, -0.009163892827928066, 6.084301639930345e-05, -0.05334581434726715, -0.06400510668754578, -0.027926458045840263, -0.02340012975037098, 0.05055459961295128, 0.06014891713857651, 0.032368507236242294, 0.057552192360162735, -0.03495437651872635, -0.03783942759037018, -0.11660150438547134, -0.010740765370428562, -0.05378609150648117, -0.05163665488362312, -0.003147320356220007, -0.11688253283500671, 0.10303860157728195, 0.050884295254945755, 0.022615907713770866, 0.007179783657193184, 0.06739874929189682, 0.07161866128444672, 0.08053286373615265, -0.0395217165350914, 0.0039047328755259514, 0.06826537102460861, 0.01905679702758789, 0.036685761064291, 0.061030611395835876, -0.03710947558283806, -0.04043552652001381, 0.02471008524298668, 0.021321101114153862, 0.07196369767189026, 0.03493138402700424, 0.05606741085648537, 0.09133944660425186, -0.03359589725732803, -0.06665189564228058, 0.07263069599866867, -0.008425958454608917, 0.05822523310780525, 0.03102235496044159, 0.05249703675508499, -3.062981335233417e-08, -0.007835572585463524, 0.041090793907642365, -0.03784911334514618, -0.0021072423551231623, 0.009104786440730095, -0.0130157470703125, 0.07695191353559494, 0.07069510221481323, -0.03227156400680542, -0.010574652813374996, -0.00837965589016676, -0.00965510867536068, 0.022787705063819885, 0.018140969797968864, 0.03211233764886856, 0.10871907323598862, -0.04117308557033539, -0.005258466117084026, 0.05368448421359062, -0.05605024844408035, -0.0018810045439749956, -0.054878223687410355, -0.019677044823765755, 0.011430177837610245, -0.08973567187786102, -0.013376167975366116, 0.021148541942238808, -0.00515790656208992, -0.040014784783124924, 0.02574020065367222, 0.006060758605599403, -0.030784962698817253, 0.051725052297115326, -0.026683583855628967, 0.05188563093543053, 0.07060375064611435, -0.01443946547806263, -0.020460914820432663, 0.02550450526177883, -0.006943019572645426, -0.06421896070241928, 0.008522577583789825, -0.007973572239279747, -0.01591038517653942, 0.021608201786875725, -0.004152913112193346, -0.005275591742247343, -0.06246775761246681, -0.05493222549557686, 0.035473838448524475, 0.041180629283189774, 0.008877232670783997, 0.007238327991217375, 0.04820680990815163, -0.002944959793239832, 0.008076705038547516, -0.006131413858383894, -0.0034376285038888454, -0.047942865639925, -0.058755069971084595, 0.009984917007386684, 0.0493779256939888, -0.0025889622047543526, -0.10646010935306549 ] }, { "text": "class CNN(nn.Module):\n def __init__(self, num_classes=10):\n super().__init__()\n \n # Convolutional layers\n self.conv1 = nn.Conv2d(\n in_channels=1, # Grayscale image\n out_channels=32, # 32 filters\n kernel_size=3, # 3x3 filter\n padding=1 # Same padding\n )\n self.conv2 = nn.Conv2d(32, 64, kernel_size=3, padding=1)\n self.conv3 = nn.Conv2d(64, 128, kernel_size=3, padding=1)\n \n # Pooling layer\n self.pool = nn.MaxPool2d(kernel_size=2, stride=2)\n \n # Batch normalization\n self.bn1 = nn.BatchNorm2d(32)\n self.bn2 = nn.BatchNorm2d(64)\n self.bn3 = nn.BatchNorm2d(128)\n \n # Fully connected layers", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_11", "embedding": [ -0.036520373076200485, -0.040879782289266586, 0.029429327696561813, -0.027146345004439354, -0.022856928408145905, -0.08260077983140945, -0.00919403787702322, -0.012259413488209248, -0.09964022785425186, -0.14352504909038544, -0.033897992223501205, -0.032245177775621414, -0.005312521476298571, 0.0037124573718756437, -0.08706004917621613, 0.02049153670668602, -0.008712800219655037, 0.055052969604730606, -0.1043795645236969, -0.04372919723391533, 0.06851022690534592, 0.018211985006928444, 0.027374066412448883, -4.5192504330771044e-05, 0.02015930786728859, 0.020667901262640953, 0.027938708662986755, -0.04782126098871231, 0.06624466180801392, -0.09199482202529907, 0.03431126847863197, 0.05764930322766304, -0.05647173523902893, 0.06227118521928787, 0.05737096071243286, -0.03597422316670418, -0.0399017371237278, 0.005545651540160179, -0.008162816986441612, -0.008607403375208378, 0.049808938056230545, -0.01651495322585106, -0.02555679902434349, -0.02312859147787094, -0.013054621405899525, 0.12342335283756256, 0.004638732876628637, -0.015471580438315868, 0.09281639754772186, -0.06414899230003357, 0.006941569037735462, 0.04582470282912254, 0.01383692491799593, 0.02986004576086998, 0.0034473324194550514, 0.001553144073113799, -0.011525169014930725, -0.02954992838203907, -0.0580248087644577, 0.007317371666431427, -0.0019210760947316885, -0.011265717446804047, 0.035661228001117706, -0.006750202737748623, 0.02070603519678116, -0.05491470918059349, -0.013046096079051495, 0.01683647930622101, 0.0096821878105402, 0.011774885468184948, 0.06021244078874588, 0.1038043200969696, 0.014772677794098854, 0.025639904662966728, 0.04434943571686745, -0.0257570818066597, 0.083651602268219, 0.05534302443265915, -0.015537086874246597, -0.09784363955259323, 0.023493951186537743, 0.009086632169783115, 0.11424306780099869, -0.018678942695260048, 0.03980241343379021, -0.042020320892333984, -0.06534074246883392, 0.03434459865093231, -0.032677061855793, 0.021201178431510925, -0.007381300907582045, 0.07547026127576828, -0.1379517912864685, -0.014033963903784752, 0.037019386887550354, 0.02307833358645439, -0.03300801292061806, 0.03475204482674599, -0.07450756430625916, 0.03444976359605789, 0.011413202621042728, -0.07799334079027176, 0.02834668569266796, 0.06350395828485489, 0.11633805185556412, 0.04099477455019951, 0.09648971259593964, 0.07990343868732452, 0.015766864642500877, -0.08819058537483215, 0.028355605900287628, -0.035399384796619415, 0.027317969128489494, -0.0010205410653725266, 0.1330697387456894, 0.043174900114536285, -0.0010637716623023152, 0.05786527693271637, -0.011436304077506065, 0.024052593857049942, -0.049745965749025345, 0.02222389355301857, -0.10540878772735596, -0.014904214069247246, -0.020120469853281975, 0.05689183995127678, -0.04255863279104233, 8.810916437220517e-33, 0.0016124284593388438, -0.03335185348987579, -0.0717446506023407, 0.022491231560707092, -0.026323672384023666, 0.03757179528474808, 0.001122019486501813, -0.042375244200229645, -0.07220098376274109, -0.06842385977506638, -0.05796077847480774, -0.06435936689376831, -0.0525800846517086, 0.0617547333240509, -0.07014370709657669, -0.04269113764166832, -0.008901078253984451, 0.01290570106357336, 0.031341906636953354, -0.035940803587436676, 0.029780207201838493, 0.02635515294969082, -0.009758376516401768, -0.03245963901281357, -0.05648147687315941, -0.05184927210211754, -0.012390769086778164, -0.042225878685712814, 0.007975496351718903, -0.0017735216533765197, -0.034193553030490875, 0.02731247805058956, -0.00724628334864974, -0.007952585816383362, -0.041503459215164185, -0.028056977316737175, 0.03742702305316925, 0.08332990109920502, 0.014770968817174435, -0.04907876253128052, -0.061465054750442505, 0.1002468466758728, -0.0009608194231987, -0.07031760364770889, -0.07983202487230301, -0.05420543625950813, 0.022322410717606544, 0.057302024215459824, -0.04206790775060654, 0.020447149872779846, 0.0608917661011219, -0.050075605511665344, -0.018005432561039925, -0.09350466728210449, 0.017717665061354637, -0.027335649356245995, 0.1291065365076065, 0.07890081405639648, 0.04133183881640434, 0.017118755728006363, 0.04659486189484596, -0.03398439288139343, -0.09304653853178024, 0.05952853336930275, 0.049766723066568375, 0.028166193515062332, 0.037568215280771255, 0.02995981276035309, 0.0033404140267521143, 0.009339713491499424, -0.09074292331933975, 0.059593796730041504, -0.012952102348208427, -0.042737722396850586, 0.00793801061809063, -0.07806526124477386, 0.012443257495760918, -0.06370130181312561, -0.0998699888586998, 0.052897971123456955, 0.025113247334957123, 0.1083526685833931, -0.039726827293634415, -0.053845636546611786, -0.1111288070678711, 0.019096046686172485, 0.04679618775844574, -0.059204600751399994, -0.018184402957558632, -0.04146045073866844, 0.025089483708143234, -0.0701240673661232, 0.07678534835577011, -0.032631415873765945, -0.002219162182882428, -8.632434517779446e-33, 0.08908478170633316, 0.10111793130636215, -0.0054087950848042965, 0.028963670134544373, -0.03336223214864731, 0.048343997448682785, 0.014663605019450188, 0.04580836370587349, -0.04923366382718086, -0.0891476422548294, 0.027681084349751472, -0.002570526674389839, 0.0038278757128864527, -0.009090462699532509, 0.04778868705034256, -0.07736049592494965, -0.04801766201853752, 0.046931419521570206, 0.05347174033522606, -0.021683374419808388, -0.03730316832661629, 0.11166884005069733, -0.028895452618598938, 0.04912179335951805, -0.0885310098528862, 0.015924818813800812, -0.11187426000833511, 0.0330016054213047, 0.06691671907901764, -0.03915155306458473, -0.09841211885213852, 0.03307681903243065, -0.030234819278120995, 0.019538629800081253, 0.058717239648103714, 0.04348433017730713, 0.020891832187771797, 0.0033021504059433937, 0.012646082788705826, -0.053636081516742706, 0.08385026454925537, 0.03142168000340462, -0.03247089311480522, 0.011817051097750664, -0.02899029664695263, 0.02757379040122032, -0.026615973562002182, -0.04855303838849068, -0.1298542469739914, 0.03494761511683464, -0.07957471907138824, -0.03653686121106148, -0.06024622172117233, 0.034490916877985, 0.004784149117767811, 0.021590547636151314, 0.008259614929556847, 0.04867612570524216, 0.08593108505010605, -0.012067681178450584, -0.014638463035225868, -0.04970472306013107, -0.07151731103658676, -0.08723863214254379, -0.04562214016914368, 0.048466961830854416, -0.09501103311777115, 0.08661214262247086, 0.0070540327578783035, 0.07767922431230545, -0.06854204833507538, 0.02128264307975769, 0.01654381863772869, -0.027481477707624435, -0.06690721213817596, -0.018188035115599632, -0.0052892849780619144, -0.0039588408544659615, 0.009329050779342651, 0.07057520002126694, -0.08750418573617935, 0.014219824224710464, -0.024009445682168007, 0.05507867410778999, 0.08562994748353958, 0.05419855937361717, 0.0787363350391388, 0.047409821301698685, 0.0223001167178154, -0.04257110506296158, 0.03670947998762131, -0.004270981997251511, 0.039186619222164154, 0.1193869337439537, 0.02261299081146717, -6.045807054988472e-08, 0.029355213046073914, -0.005304996855556965, 0.024988478049635887, 0.052983127534389496, 0.043594103306531906, -0.051299452781677246, 0.011610422283411026, 0.10901021957397461, 0.01812611147761345, 0.03786863014101982, -0.036282870918512344, 0.011525499634444714, -0.04916805401444435, -0.03610843047499657, 0.005039057694375515, 0.05491974577307701, -0.05694970861077309, -0.06162137910723686, 0.037493690848350525, -0.04116165637969971, -0.060193561017513275, -0.07733739912509918, -0.03334597870707512, 0.05573306977748871, -0.06374002248048782, -0.019553039222955704, 0.010760432109236717, -0.043768417090177536, 0.01332909520715475, -0.04278532788157463, -0.01810966059565544, -0.03005916438996792, 0.06068917736411095, -0.013829111121594906, 0.03643292561173439, 0.047432299703359604, -0.04319074749946594, 0.03224997594952583, 0.043523792177438736, 0.01057349145412445, -0.05132674053311348, 0.061419710516929626, 0.039741888642311096, -0.052015163004398346, 0.027932776138186455, -0.012470216490328312, 0.03623347356915474, -0.04425743967294693, 0.010866045951843262, -0.006590608041733503, 0.02695908583700657, 0.02222312241792679, 0.01116647943854332, 0.05075777322053909, -0.029072292149066925, -0.047382429242134094, -0.04728689417243004, 0.03239378333091736, 0.024323608726263046, 0.037904370576143265, -0.055059466511011124, 0.05211758613586426, -0.06051889434456825, -0.049553073942661285 ] }, { "text": "self.bn2 = nn.BatchNorm2d(64)\n self.bn3 = nn.BatchNorm2d(128)\n \n # Fully connected layers\n self.fc1 = nn.Linear(128 * 3 * 3, 256) # After 3 pooling ops: 28->14->7->3\n self.fc2 = nn.Linear(256, num_classes)\n \n # Dropout for regularization\n self.dropout = nn.Dropout(0.5)\n \n def forward(self, x):\n # Conv block 1: [B, 1, 28, 28] -> [B, 32, 14, 14]\n x = self.pool(F.relu(self.bn1(self.conv1(x))))\n \n # Conv block 2: [B, 32, 14, 14] -> [B, 64, 7, 7]\n x = self.pool(F.relu(self.bn2(self.conv2(x))))\n \n # Conv block 3: [B, 64, 7, 7] -> [B, 128, 3, 3]\n x = self.pool(F.relu(self.bn3(self.conv3(x))))\n \n # Flatten: [B, 128, 3, 3] -> [B, 128*3*3]", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_12", "embedding": [ -0.038846731185913086, -0.02357427217066288, -0.0028254324570298195, -0.006091591902077198, -0.018823623657226562, -0.003904295852407813, 0.031574688851833344, -0.08321437984704971, -0.08885672688484192, -0.12198242545127869, -0.04843204841017723, -0.02655905671417713, -0.026393236592411995, -0.00834731012582779, -0.016561495140194893, 0.05019074305891991, -0.03766895458102226, 0.0752893015742302, -0.09088090062141418, -0.05994684249162674, -0.005398652516305447, 0.012386162765324116, 0.004162733443081379, 0.022340944036841393, 0.033736247569322586, 0.01449799444526434, 0.002570893382653594, -0.06181701645255089, 0.06053848937153816, -0.11222654581069946, 0.04550159350037575, 0.04471353814005852, -0.06914805620908737, 0.04998180642724037, 0.032351765781641006, 0.0022121381480246782, -0.029131576418876648, 0.053850866854190826, -0.054300788789987564, 0.030827948823571205, 0.047571584582328796, 0.04629846662282944, 0.02949465624988079, -0.007553621660917997, 0.050781648606061935, 0.10611621290445328, -0.019765527918934822, 0.004691699519753456, 0.08187244832515717, -0.02998378872871399, 0.021759985014796257, 0.06557927280664444, -0.014461643993854523, 0.07393081486225128, 0.06316405534744263, 0.007372135762125254, 0.011142879724502563, -0.05702869966626167, -0.01576823741197586, 0.05881096422672272, 0.049564726650714874, -0.04129613935947418, 0.04695718735456467, -0.049281127750873566, 0.00628920691087842, -0.0301977526396513, -0.011181216686964035, 0.10443700104951859, 0.03690507262945175, 0.07328473776578903, 0.02119455486536026, 0.06994520127773285, -0.0262973103672266, 0.020663131028413773, 0.08096141368150711, -0.004215647000819445, 0.06162215396761894, 0.005045924335718155, -0.07202216982841492, -0.07028836756944656, 0.00958042498677969, -0.0055760471150279045, 0.048614319413900375, 0.0030442269053310156, -0.001896462170407176, -0.13112732768058777, -0.040580667555332184, -0.014153591357171535, 0.04904518276453018, 0.04497130215167999, 0.0011568103218451142, 0.04334590211510658, -0.04865814372897148, -0.011638162657618523, 0.0351913683116436, 0.0029252339154481888, 0.0034781000576913357, -0.06588684767484665, -0.006062846165150404, 0.09119032323360443, -0.0001042002477333881, -0.05002383515238762, -0.02563585340976715, 0.046409305185079575, 0.03781893476843834, 0.03599966689944267, 0.053118474781513214, 0.09513331949710846, 0.0049998885951936245, -0.09551797807216644, 0.07403867691755295, -0.05320115014910698, 0.06796541064977646, 0.04812779650092125, 0.07440756261348724, -0.025575829669833183, 0.06262800097465515, -0.001715893391519785, 0.02840604819357395, 0.039326466619968414, -0.02408929541707039, 0.03903057426214218, 0.03148343414068222, -0.07224319875240326, -0.014379354193806648, -0.01974828913807869, -0.01140956673771143, 4.3925307194870906e-33, -0.015923378989100456, -0.0060465214774012566, -0.056909188628196716, 0.005035134963691235, 0.011609061621129513, 0.011128813028335571, 0.04974303022027016, -0.0850648432970047, -0.07129368931055069, -0.036931198090314865, -0.06382767856121063, -0.056914422661066055, -0.03938388079404831, 0.00800933688879013, -0.022011270746588707, -0.03964506462216377, 0.11145056039094925, 0.033077605068683624, 0.03506448492407799, -0.033892691135406494, 0.06175416707992554, 0.04518723487854004, -0.03938758000731468, -0.09986300766468048, -0.05165063962340355, -0.07587198913097382, -0.011546903289854527, -0.03271111100912094, -0.0007083259988576174, 0.015416601672768593, -0.04261467605829239, 0.05046508088707924, -0.009234818629920483, 0.014898634515702724, 0.02660263143479824, -0.022451067343354225, 0.04680018126964569, 0.02561827376484871, 0.04367326572537422, -0.07474227994680405, -0.02741040289402008, 0.06655632704496384, -0.02391640655696392, -0.031193941831588745, -0.06672103703022003, -0.086497962474823, 0.04306092485785484, 0.08383069187402725, -0.056567829102277756, 0.007685264106839895, 0.03376244008541107, -0.0035588392056524754, -0.06313691288232803, -0.05321349948644638, -0.003904406912624836, -0.05723584443330765, 0.041438184678554535, 0.07685999572277069, 0.06278291344642639, 0.06151702627539635, 0.09920594096183777, 0.034754667431116104, -0.13371336460113525, 0.0626249834895134, 0.033049169927835464, 0.06955279409885406, 0.05503075197339058, -0.004826136864721775, -0.023971296846866608, -0.03673873469233513, -0.105726458132267, 0.06687566637992859, -0.02998962439596653, -0.06149548292160034, 0.017026707530021667, -0.09174753725528717, -0.00038818042958155274, -0.0932580903172493, -0.02854005992412567, -0.03941184654831886, 0.029357314109802246, 0.04878425598144531, -0.08213897049427032, -0.007035438437014818, -0.1599075347185135, -0.0217459537088871, 0.06885609030723572, -0.08149408549070358, -0.002477007918059826, -0.07789761573076248, -0.04204738885164261, -0.09569640457630157, 0.08992136269807816, -0.02947711944580078, 0.0013177412329241633, -3.246590868038368e-33, 0.07371079176664352, 0.09692127257585526, 0.04525306448340416, 0.04744237661361694, 0.013927637599408627, -0.03279882296919823, 0.06515064090490341, 0.009297759272158146, -0.011510440148413181, -0.026554754003882408, -0.02307778224349022, 0.0017651539528742433, 0.017260001972317696, 0.03127722069621086, 0.04315102472901344, -0.02250385656952858, 0.004926970228552818, 0.02099641039967537, -0.016487527638673782, -0.07571353018283844, -0.054997362196445465, 0.03527962416410446, -0.0037288893945515156, 0.024021372199058533, -0.07112526893615723, 0.02157411351799965, -0.08312118798494339, 0.042190004140138626, 0.08231188356876373, -0.020376792177557945, -0.0429818369448185, 0.01932496950030327, -0.02601921372115612, -0.01226269081234932, -0.008672933094203472, 0.051259852945804596, -0.01546568050980568, 0.06799951940774918, 0.005900050979107618, -0.06071535497903824, 0.08106660842895508, 0.005811817478388548, -0.06278790533542633, 0.0034783650189638138, 0.008485749363899231, 0.08070482313632965, -0.06791830062866211, 0.029225075617432594, -0.05509982258081436, 0.03346715122461319, -0.08613292872905731, 0.002821163507178426, -0.03309790790081024, -0.011767168529331684, -0.03171344846487045, -0.008729098364710808, -0.017539260908961296, 0.01917889341711998, 0.014396433718502522, -0.008171936497092247, -0.04001934453845024, -0.12142682075500488, 0.0465974435210228, -0.04222843796014786, 0.06757787615060806, 0.02677561528980732, -0.07661277800798416, 0.0766909122467041, 0.03784821182489395, 0.018808988854289055, -0.006085118744522333, 0.100531205534935, 0.05451230704784393, -0.03547737002372742, 0.0011113194050267339, -0.036494653671979904, -0.010773067362606525, -0.05394943058490753, 0.030936406925320625, 0.0524260550737381, -0.0937047004699707, 0.017597191035747528, -0.01413368433713913, 0.08125632256269455, 0.04122261330485344, 0.001532232854515314, 0.08137932419776917, 0.071107879281044, 0.05551367625594139, -0.012099715881049633, 0.02343629114329815, -0.009433239698410034, 0.088741734623909, 0.06920963525772095, -0.007871424779295921, -4.95219438789718e-08, -0.04409372806549072, -0.07217806577682495, -0.009615912102162838, 0.07226967066526413, 0.021036194637417793, -0.019497081637382507, -0.014601984061300755, 0.05052834376692772, 0.02185438759624958, -0.06138702481985092, -0.018135493621230125, 0.004012156277894974, -0.020759649574756622, -0.008758720010519028, -0.05037107318639755, 0.061659567058086395, -0.00027096187113784254, -0.05149223282933235, 0.008471175096929073, 0.0038403428625315428, -0.04113508015871048, -0.10062339901924133, 0.004384119063615799, 0.07522002607584, -0.08794541656970978, -0.03627665340900421, 0.008202804252505302, -0.06797824054956436, 0.027790453284978867, 0.0003013754612766206, 0.0018814275972545147, -0.026070408523082733, 0.08693347126245499, 0.07564195245504379, 0.0358009897172451, 0.08948532491922379, -0.05255896970629692, 0.054373547434806824, -0.0122897420078516, 0.03856051340699196, -0.08139925450086594, 0.035642772912979126, -0.02198939397931099, 0.0003874838585034013, 0.07437185943126678, -0.09320181608200073, -0.0534018836915493, -0.048231128603219986, 0.005958967376500368, -0.043994154781103134, 0.07059410214424133, 0.0032704267650842667, 0.04767242819070816, 0.06366363912820816, 0.044156190007925034, -0.0071596005000174046, -0.08456073701381683, -0.0007859394536353648, 0.055932577699422836, 0.06614328920841217, -0.053543925285339355, 0.045043785125017166, -0.05890447646379471, -0.007790467236191034 ] }, { "text": "x = self.pool(F.relu(self.bn3(self.conv3(x))))\n \n # Flatten: [B, 128, 3, 3] -> [B, 128*3*3]\n x = x.view(x.size(0), -1)\n \n # Fully connected layers\n x = self.dropout(F.relu(self.fc1(x)))\n x = self.fc2(x)\n \n return x", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_13", "embedding": [ -0.033312536776065826, -0.052521880716085434, -0.03725133091211319, 0.016965528950095177, -0.0003598587936721742, -0.018207035958766937, 0.06067834794521332, -0.04933202266693115, -0.02110903710126877, -0.1437324583530426, -0.04134538769721985, -0.03773194178938866, -0.05320127308368683, 0.05351228639483452, -0.009716237895190716, 0.004059500992298126, -0.0622997060418129, 0.037787631154060364, -0.06774111837148666, -0.008282335475087166, 0.013832409866154194, -0.015012387186288834, -0.008359146304428577, -0.008646627888083458, 0.09838647395372391, -0.02091098204255104, 0.013801549561321735, -0.05549892410635948, 0.04110566899180412, -0.06164180487394333, 0.05105888471007347, 0.06267324835062027, -0.08035405725240707, 0.01143680140376091, 0.016145149245858192, -0.047476403415203094, -0.019311372190713882, 0.008201759308576584, -0.08586819469928741, 0.007971590384840965, 0.03563978895545006, 0.06890536099672318, 0.03148427605628967, -0.032143812626600266, 0.03200702741742134, 0.09284207224845886, -0.015691392123699188, -0.0073774135671556, 0.13798631727695465, -0.023141300305724144, 0.04006239399313927, 0.08676782995462418, -0.06276565790176392, 0.06322946399450302, 0.03842157498002052, 0.01883084885776043, -0.03175061568617821, -0.07588808983564377, -0.07004579156637192, 0.05744080990552902, 0.05680462345480919, 0.0021136999130249023, 0.07563038170337677, 0.013468939810991287, 0.025834105908870697, 0.00959805678576231, -0.015552121214568615, 0.05107581615447998, 0.00652887811884284, 0.0678209587931633, 0.028738543391227722, 0.058811768889427185, -0.037868961691856384, -0.06417873501777649, 0.08539499342441559, -0.011294195428490639, 0.06327823549509048, 0.003374880412593484, -0.018590649589896202, 0.005527656525373459, 0.007570590823888779, 0.02421017922461033, 0.04160819202661514, 0.09562724828720093, -0.02879922464489937, -0.10990443080663681, -0.029117083176970482, -0.007313649170100689, -0.07050815969705582, 0.011505009606480598, -0.011751173064112663, 0.08445124328136444, -0.08540957421064377, 0.020616069436073303, -0.029055437073111534, -0.02277597226202488, 0.03768498823046684, -0.0633319690823555, -0.058712758123874664, 0.04897267371416092, -0.05836347118020058, -0.08236835896968842, 0.012780356220901012, -0.02371710166335106, 4.1319624870084226e-05, 0.04294177144765854, 0.017277555540204048, 0.07446063309907913, -0.004428102169185877, -0.08741438388824463, 0.08452359586954117, -0.09264218807220459, 0.03437172248959541, 0.04625600576400757, 0.0787048265337944, 0.04110274836421013, 0.056679148226976395, 0.03200812637805939, -0.003761960892006755, 0.019023561850190163, -0.0449080653488636, 0.07436306774616241, -0.002441591816022992, -0.045637235045433044, -0.025424940511584282, -0.04143219813704491, -0.053482215851545334, 2.630933415976872e-33, -0.01264359150081873, 0.017523283138871193, -0.023775653913617134, -0.00873718224465847, -0.011615988798439503, -0.006101192906498909, 0.04048992320895195, -0.05773185193538666, -0.10182452201843262, 0.029583536088466644, -0.08947380632162094, 0.014750834554433823, -0.06031714379787445, 0.004859147593379021, -0.02025359682738781, -0.0350407250225544, 0.06718621402978897, 0.023338928818702698, 0.007597234565764666, -0.029153482988476753, 0.033583905547857285, 0.03962479531764984, -0.06049119308590889, -0.07962177693843842, -0.035593729466199875, -0.0679406225681305, -0.02170700766146183, -0.01123983133584261, -0.0346512608230114, 0.02405496872961521, -0.03520666062831879, 0.048680275678634644, 0.02772701159119606, -0.034659493714571, -0.0398063138127327, -0.012072405777871609, 0.018706513568758965, 0.0731009840965271, -0.0403173603117466, -0.06025445833802223, -0.0027815222274512053, 0.07076496630907059, -0.013837255537509918, -0.01686670444905758, -0.0425771065056324, -0.043806545436382294, 0.04572512209415436, 0.0991448238492012, -0.051697030663490295, -0.01504754088819027, 0.014288916252553463, -0.03634535148739815, -0.03502582386136055, -0.02294870838522911, -0.03209296986460686, -0.04041604325175285, 0.04235360771417618, 0.09855108708143234, 0.027000032365322113, -0.02073955535888672, 0.08828677982091904, 0.031136471778154373, -0.1395135521888733, 0.04698730260133743, -0.00926484726369381, 0.07045365869998932, 0.13982124626636505, -0.004482815507799387, -0.08062034100294113, -0.023979756981134415, -0.11454302072525024, 0.08422310650348663, -0.013886655680835247, -0.1052858829498291, -0.024329524487257004, -0.09169065207242966, -0.05573052912950516, -0.08842065185308456, 0.03805968537926674, 0.00782892294228077, 0.04446769133210182, 0.02225962094962597, 0.037368789315223694, -0.02400689385831356, -0.13055087625980377, 0.022034931927919388, 0.08878029137849808, -0.00019803267787210643, 0.008648649789392948, -0.0439748652279377, -0.06048368662595749, -0.07454006373882294, 0.12027746438980103, -0.10158688575029373, -0.026068048551678658, -2.110339477763321e-33, 0.045362863689661026, 0.044099096208810806, 0.030395856127142906, 0.005070854909718037, 8.25755632831715e-05, 0.00897141546010971, 0.07679758965969086, 0.031510576605796814, 0.026041628792881966, 0.01912040263414383, 0.02675131894648075, -0.022028129547834396, 0.0011449186131358147, -0.0006902419263496995, 0.05480023846030235, -0.014184045605361462, -0.030441749840974808, -0.059934016317129135, -0.07759087532758713, -0.08909022808074951, -0.05256108567118645, -0.0015586689114570618, 0.05468296259641647, 0.009388660080730915, -0.07416517287492752, 0.009897695854306221, -0.015257170423865318, 0.034945856779813766, 0.06761316955089569, -0.038050517439842224, -0.03252879157662392, -0.016234753653407097, -0.04157423600554466, -0.04859006777405739, -0.03266853466629982, 0.029715312644839287, 0.02521793730556965, 0.02772395685315132, -0.03794588893651962, -0.0805899128317833, -0.005548924673348665, 0.036931362003088, -0.06298231333494186, 0.06657499819993973, 0.036721471697092056, 0.031440991908311844, -0.024640629068017006, 0.03523816540837288, -0.04341405630111694, 0.03580703213810921, -0.10167023539543152, -0.018274622038006783, -0.0029545542784035206, 0.031081393361091614, -0.01517520286142826, 0.03558890148997307, -0.03446679934859276, -0.03187639266252518, 0.02030516229569912, -0.014733163639903069, -0.021809086203575134, -0.15452159941196442, 0.003662059549242258, -0.017055261880159378, 0.0562882237136364, 0.04254109412431717, -0.11765085905790329, 0.0755143091082573, 0.035291679203510284, 0.025940492749214172, 0.03858712315559387, 0.07712904363870621, 0.09495504200458527, -0.04445526376366615, 0.011279614642262459, -0.006874428130686283, -0.06168841943144798, -0.020281154662370682, 0.09884152561426163, 0.007432423532009125, -0.04085269197821617, 0.008241149596869946, 0.02841304801404476, 0.09926974028348923, 0.10553071647882462, -0.03392583504319191, 0.03583407402038574, 0.09903101623058319, 0.05726689472794533, 0.008870591409504414, -0.010849219746887684, -0.017541777342557907, 0.11634054780006409, 0.05711846053600311, 0.01116231270134449, -4.2789739751469824e-08, -0.009612075053155422, -0.013594024814665318, 0.012020140886306763, 3.533003473421559e-05, -0.032716523855924606, 0.01985306851565838, 0.021450087428092957, 0.07815680652856827, 0.028373993933200836, -0.04006247594952583, -0.06578022986650467, -0.04432302340865135, -0.058302510529756546, -0.013283152133226395, 0.009671485051512718, 0.066111259162426, 0.015518032014369965, 0.035656508058309555, 0.01317327469587326, -0.009432381018996239, -0.020236710086464882, -0.10244418680667877, -0.012289529666304588, 0.06251868605613708, -0.03178924322128296, -0.017901409417390823, -0.032315969467163086, -0.05188167467713356, 0.026098528876900673, 0.03531035780906677, -0.013320773839950562, -0.04711387678980827, 0.05117415264248848, 0.0852494165301323, 0.03780799359083176, 0.05918915569782257, -0.03655663877725601, 0.0792974904179573, -0.02997586503624916, 0.04729876667261124, -0.08702049404382706, 0.0074066645465791225, 0.015623271465301514, -0.00015891344810370356, 0.0725259855389595, -0.03819085285067558, 0.028395770117640495, -0.037351276725530624, 0.0369497574865818, 0.004469103645533323, 0.05038246884942055, -0.017941854894161224, -0.028194498270750046, 0.0304019283503294, -0.005573761183768511, 0.006143760867416859, -0.037160150706768036, 0.024671413004398346, -0.0052916668355464935, 0.02165260910987854, -0.08021227270364761, 0.09558232873678207, -0.025239508599042892, 0.012292054481804371 ] }, { "text": "# Create model and test with random image\ncnn = CNN(num_classes=10)\nsample_image = torch.randn(1, 1, 28, 28) # Batch=1, Channels=1, H=28, W=28\noutput = cnn(sample_image)\nprint(f\"CNN output shape: {output.shape}\") # [1, 10]\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_14", "embedding": [ 0.00047151625039987266, -0.06385482847690582, 0.009277346543967724, 0.06967958807945251, 0.036517057567834854, -0.03311317041516304, 0.03037232905626297, -0.00628436217084527, -0.0451127365231514, -0.10281407833099365, 0.022265153005719185, -0.020852403715252876, -0.006095449440181255, 0.03298136964440346, -0.07013993710279465, -0.043990783393383026, -0.06825872510671616, -0.0009175635641440749, -0.06945686042308807, -0.09904660284519196, 0.08874563872814178, -0.009468250907957554, 0.09511014074087143, 0.02891140803694725, -0.016212593764066696, -0.07111717760562897, 0.08013123273849487, 0.022131361067295074, 0.03713218867778778, -0.061680350452661514, 0.06999598443508148, -0.00035469833528622985, -0.040760260075330734, 0.026081599295139313, 0.09156947582960129, -0.06083883345127106, -0.07684144377708435, -0.03353479877114296, 0.056567925959825516, 0.03168328478932381, 0.03499508276581764, -0.07902391999959946, -0.01542986836284399, -0.04901055246591568, 0.006916389800608158, 0.06829151511192322, 0.046608228236436844, -0.013540620915591717, 0.042222149670124054, 0.01506266463547945, 0.02614213153719902, -0.04957794398069382, -0.06578609347343445, 0.024336131289601326, 0.028176933526992798, -0.03176414966583252, 0.018310213461518288, -0.08996384590864182, -0.049019698053598404, -0.07672599703073502, 0.022811615839600563, 0.0040146964602172375, -0.03602997586131096, -0.02354602888226509, -0.012752220034599304, -0.0009278556099161506, -0.04374413937330246, 0.027500910684466362, 0.05078945681452751, -0.05063583701848984, 0.028557749465107918, 0.03999495506286621, 0.07373049110174179, 0.037363450974226, 0.017244506627321243, -0.08184181153774261, 0.10499157756567001, -0.021900851279497147, 0.04144394397735596, -0.04867822676897049, -0.03866839036345482, -0.02274939976632595, 0.10703074932098389, 0.012687159702181816, 0.027130817994475365, 0.01566445827484131, 0.014021736569702625, 0.09936186671257019, -0.01407620869576931, -0.0426020547747612, -0.11195657402276993, 0.023218540474772453, -0.12537282705307007, 0.030031586065888405, -0.00806878786534071, 0.005547459702938795, 0.12126193195581436, -0.03936290368437767, -0.0545634850859642, 0.017019938677549362, 0.03597573563456535, -0.0856989398598671, 0.0819530189037323, 0.06062791869044304, 0.05971985682845116, 0.04867599159479141, 0.013512512668967247, 0.04321381822228432, 0.008733825758099556, -0.0513659343123436, 0.05720290169119835, 0.061134494841098785, -0.019414234906435013, -0.01475504506379366, 0.1207670122385025, -0.06895168870687485, -0.09564010053873062, 0.016208309680223465, -0.06597523391246796, 0.06582295894622803, -0.034332145005464554, 0.0587117038667202, -0.0532565638422966, 0.02890196442604065, -0.07015664130449295, -0.033753588795661926, -0.013310270383954048, 2.33918361595545e-33, -0.028635401278734207, -0.0243388544768095, -0.08847399055957794, -0.010613708756864071, 0.061309799551963806, 0.0717567577958107, 0.08418120443820953, -0.02986788935959339, -0.04999865964055061, -0.013204339891672134, -0.11292646825313568, -0.07811210304498672, -0.038119837641716, 0.043316662311553955, -0.0667763352394104, -0.007082493044435978, 0.01946105994284153, 0.04785720258951187, -0.009770545177161694, 0.006020198576152325, 0.021642275154590607, 0.04052390530705452, -0.04207780212163925, -0.04331370070576668, -0.08330338448286057, -0.03847801685333252, -0.06729426980018616, -0.006527991499751806, -0.03215407952666283, -0.001463841530494392, -0.040297407656908035, 0.033848538994789124, 0.061189085245132446, -0.006715761031955481, -0.028437701985239983, -0.03372771292924881, 0.05064089968800545, 0.0678376629948616, -0.04606548324227333, -0.11169850081205368, 0.08026653528213501, 0.06719032675027847, 0.000863021588884294, -0.023010389879345894, -0.006191050633788109, 0.05052874982357025, -0.019093699753284454, 0.055345289409160614, 0.01157198753207922, 0.0023251413367688656, 0.02738785371184349, -0.00013726961333304644, -0.011101270094513893, 0.026362013071775436, 0.04198231175541878, -0.043325722217559814, 0.06187485530972481, 0.03841446712613106, 0.06432876735925674, -0.05310231074690819, 0.03577379509806633, 0.042883116751909256, -0.05926697701215744, 0.06945603340864182, -0.00261139590293169, 0.009353620000183582, 0.051097139716148376, 0.0010999958030879498, -0.005286113824695349, 0.053702205419540405, -0.09646713733673096, 0.058083683252334595, -0.10237381607294083, -0.04882710427045822, -0.043185021728277206, -0.028138747438788414, 0.023563873022794724, -0.04778965562582016, -0.06935674697160721, 0.10648763924837112, -0.005004250910133123, 0.06636784970760345, -0.052601415663957596, -0.10395586490631104, -0.0595393106341362, 0.06095311418175697, -0.006280875764787197, -0.0743560940027237, -0.012637658044695854, -0.058195535093545914, -0.04630940034985542, -0.05688801780343056, 0.08406354486942291, -0.007357301656156778, -0.011068278923630714, -3.7979476770839306e-33, -0.015089361928403378, 0.144409641623497, 0.04130127280950546, 0.015196818858385086, -0.034380797296762466, 0.003958557732403278, 0.021903032436966896, -0.020951678976416588, -0.05851126089692116, -0.015095853246748447, 0.004761623218655586, -0.02979598380625248, -0.04061922803521156, -0.041824351996183395, 0.028978560119867325, -0.05744149908423424, -0.03113708086311817, -0.03377741947770119, 0.05599284917116165, 0.026504212990403175, -0.050933029502630234, 0.10103584080934525, -0.11782308667898178, 0.025555144995450974, -0.1290537267923355, 0.06258232891559601, 0.023775674402713776, 0.02318844012916088, 0.07045980542898178, -0.009026845917105675, -0.021478673443198204, -0.022872647270560265, 0.018553229048848152, 0.053199656307697296, -0.01599838025867939, 0.032865259796381, 0.08884342014789581, -0.04020826518535614, 0.01440772507339716, -0.000947907567024231, 0.07398761063814163, -0.015257184393703938, -0.02555486559867859, 0.07441262155771255, -0.09606441855430603, 0.04780816659331322, 0.031387582421302795, -0.03832031786441803, -0.03861813619732857, -0.008351477794349194, 0.002366938628256321, -0.06678509712219238, -0.1271664798259735, 0.010391042567789555, -0.05333327502012253, -0.008016432635486126, -0.07049514353275299, 0.0566999725997448, 0.04993128031492233, 0.04156075045466423, -0.046716079115867615, -0.08419005572795868, -0.017316656187176704, -0.022702692076563835, -0.06190799921751022, 0.0011877291835844517, -0.12701570987701416, 0.02178465947508812, 0.04190465807914734, 0.10029792785644531, -0.006143737118691206, 0.1065259575843811, 0.02094828337430954, 0.04730352386832237, -0.01103296596556902, -0.04050716012716293, -0.023432496935129166, 0.030587101355195045, 0.03149348869919777, 0.0154420742765069, -0.023905141279101372, -0.025404760614037514, -0.020063521340489388, 0.01054171659052372, 0.056917015463113785, 0.031168904155492783, 0.04562222212553024, 0.0119223827496171, 0.03306413069367409, -0.016416283324360847, 0.07444223016500473, 0.019846990704536438, 0.10902020335197449, 0.05238615721464157, 0.06510463356971741, -4.040292722606864e-08, 0.015238495543599129, -0.010307462885975838, 0.07464883476495743, 0.027685735374689102, -0.05323996767401695, 0.011039230041205883, 0.06908292323350906, -0.015223623253405094, 0.005715656094253063, -0.03426041826605797, -0.0027470961213111877, -0.042047664523124695, -0.0258683729916811, 0.04058361053466797, -0.0034193142782896757, 0.03871237486600876, -0.0325288251042366, 0.03781358152627945, 0.06630615890026093, -0.036655865609645844, -0.011530413292348385, -0.07365704327821732, 0.01604674756526947, 0.0004730694636236876, -0.0709960013628006, -0.010985000990331173, -0.00043937659938819706, 0.037401165813207626, -0.032813217490911484, -0.05470551177859306, 0.03628287836909294, -0.028548816218972206, 0.03836829215288162, 0.04510093480348587, 0.038233645260334015, 0.03618645295500755, -0.08748834580183029, 0.0008985772728919983, 0.008411331102252007, 0.013932659290730953, -0.019835300743579865, 0.0047475374303758144, 0.03177780658006668, -0.03950352594256401, -0.00795395765453577, 0.003634477499872446, 0.028050610795617104, -0.11202594637870789, 0.060559649020433426, 0.024625392630696297, -0.01720379665493965, -0.016865575686097145, -0.014587839134037495, 0.022425860166549683, -0.008373584598302841, 0.007487232331186533, 0.01731910929083824, 0.011016590520739555, -0.0054871682077646255, 0.0027397770900279284, -0.0014713996788486838, 0.043841563165187836, -0.05181780457496643, -0.10985810309648514 ] }, { "text": "### Understanding Convolutions\n\n```python\n# Visualize what a convolution does\nimport torch\nimport torch.nn as nn\n\n# Create a simple edge detection filter\nedge_filter = torch.tensor([\n [-1, -1, -1],\n [-1, 8, -1],\n [-1, -1, -1]\n], dtype=torch.float32).view(1, 1, 3, 3)\n\n# Apply to a sample image\nconv = nn.Conv2d(1, 1, kernel_size=3, padding=1, bias=False)\nconv.weight.data = edge_filter\n\nsample = torch.randn(1, 1, 8, 8)\nfiltered = conv(sample)\nprint(f\"Input shape: {sample.shape}, Output shape: {filtered.shape}\")\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_15", "embedding": [ -0.04249248653650284, -0.05197220668196678, 0.05018487945199013, 0.016669156029820442, 0.06657207757234573, -0.07459036260843277, 0.033245693892240524, -0.014509735628962517, -0.05427560955286026, -0.1301092952489853, -0.03323323652148247, -0.04046729579567909, -0.08965064585208893, 0.03993690013885498, -0.08479554951190948, 0.03979036957025528, -0.03612785413861275, 0.009527502581477165, -0.06788923591375351, -0.08027467131614685, 0.07688936591148376, -0.025089334696531296, -0.015944823622703552, -0.020387884229421616, 0.007128605153411627, 0.04144676402211189, 0.017170991748571396, -0.0018353813793510199, 0.07224184274673462, -0.02041560597717762, 0.0642077773809433, 0.006055693607777357, -0.042442671954631805, 0.06743331998586655, -0.00432791979983449, -0.0554104819893837, -0.041095130145549774, 0.04128909483551979, 0.007323144003748894, 0.04575733840465546, -0.00819348730146885, 0.034390076994895935, -0.007741723675280809, -0.06517378985881805, 0.008596236817538738, 0.08409544825553894, 0.05216141790151596, -0.03303860127925873, 0.052499014884233475, -0.016095275059342384, 0.029394609853625298, -0.01788107305765152, -0.023406999185681343, 0.00679756049066782, 0.029993247240781784, -0.021138275042176247, 0.02552625723183155, -0.079501673579216, 0.00407796585932374, -0.04332304000854492, 0.09084715694189072, -0.021800659596920013, 0.013947815634310246, -0.014652087353169918, -0.03278611600399017, -0.02014550194144249, -0.02792893350124359, -0.017000727355480194, 0.01798917166888714, -0.0056462762877345085, 0.04191514104604721, 0.09072395414113998, -0.020882125943899155, 0.021768562495708466, -0.007879838347434998, -0.07675021886825562, 0.08183584362268448, 0.04714407026767731, 0.01731959544122219, -0.021864362061023712, 0.03685308247804642, -0.014982993714511395, 0.08237933367490768, 0.02192998118698597, 0.027195516973733902, -0.005674283020198345, -0.047206077724695206, 0.01270134188234806, 0.004696178250014782, 0.031250834465026855, -0.03486774489283562, 0.026592105627059937, -0.11856818944215775, -0.00942483264952898, 0.03329791501164436, -0.0015153770800679922, 0.04669201374053955, -0.001507858745753765, -0.05575840547680855, 0.06200091540813446, 0.007010789588093758, -0.1211019828915596, -0.02410956658422947, 0.07591010630130768, 0.022235848009586334, 0.060660235583782196, 0.02762080542743206, 0.06126466765999794, 0.0001638732646824792, -0.04088795185089111, 0.047523658722639084, -0.01669938862323761, 0.05465679243206978, -0.010822687298059464, 0.06550738215446472, -0.030203787609934807, -0.04092032089829445, 0.05762879177927971, 0.06643393635749817, 0.027480250224471092, -0.061604663729667664, 0.05971541255712509, -0.1004243865609169, -0.01623578742146492, 0.022063037380576134, 0.03366704285144806, -0.04346485063433647, 5.362640860623785e-33, -0.0021870764903724194, 0.02969863824546337, -0.07527998834848404, -0.04835708439350128, 0.008217548951506615, 0.0233407374471426, 0.021783890202641487, -0.0702156275510788, -0.06124759465456009, 0.03418812155723572, -0.04538813978433609, -0.031737882643938065, -0.0395534448325634, 0.035805076360702515, -0.06883975863456726, -0.01302865520119667, 0.05856124684214592, -0.03354385122656822, 0.013180720619857311, -0.028828809037804604, 0.01706647500395775, 0.04086710512638092, -0.0022937594912946224, 0.028129758313298225, -0.1154739260673523, -0.017229454591870308, -0.0958741307258606, -0.012356827966868877, 0.060283008962869644, -0.0068677994422614574, -0.040269672870635986, 0.03068666346371174, 0.03016246296465397, -0.04611606523394585, -0.034135181456804276, -0.0011691080871969461, 0.07464208453893661, 0.032720718532800674, -0.03884109854698181, -0.13644936680793762, 0.09517456591129303, 0.13750582933425903, 0.043124835938215256, -0.08517612516880035, -0.06389151513576508, 0.0033851254265755415, -0.04915231838822365, 0.04227929562330246, -0.021215446293354034, 0.02666938677430153, -0.009724431671202183, -0.036504145711660385, 0.03363711014389992, -0.0028079983312636614, 0.0620463602244854, -0.03308286517858505, 0.07097668200731277, 0.08758682012557983, 0.09755106270313263, -0.0553198978304863, 0.05575656145811081, -0.017857210710644722, -0.012468350119888783, 0.03082372061908245, -0.052163317799568176, 0.021454282104969025, -0.0005023941048420966, 0.05206773802638054, 0.005681639537215233, -0.005889375694096088, -0.1391446590423584, 0.05803525820374489, -0.06668547540903091, 0.0008969713235273957, -0.01798103004693985, -0.05068293958902359, -0.034479543566703796, -0.06183978170156479, 0.009392255917191505, 0.05986194312572479, -0.047650519758462906, 0.07705425471067429, 0.04193008691072464, -0.11453767120838165, -0.0759163498878479, 0.05505312234163284, -0.0061747971922159195, -0.08033068478107452, -0.027933068573474884, -0.07488377392292023, -0.0709722563624382, -0.07499393820762634, 0.03022068738937378, 0.04769013077020645, -0.03175695240497589, -5.183127812231852e-33, -0.014886581338942051, 0.108592189848423, 0.05453454703092575, 0.031767912209033966, -0.018019739538431168, 0.05979279801249504, 0.008417400531470776, -0.025595493614673615, 0.01763014681637287, -0.0540473498404026, 0.016003169119358063, -0.04034064710140228, -0.03364121913909912, -0.0446016900241375, 0.07163383811712265, -0.07202918827533722, -0.0709577202796936, -0.016332751139998436, -0.011813600547611713, -0.03794829547405243, -0.010307644493877888, 0.07143870741128922, -0.061074286699295044, 0.016482625156641006, -0.12542781233787537, 0.03578885272145271, 0.0393497571349144, 0.01640220731496811, 0.06062594801187515, -0.04192601144313812, 0.011005795560777187, 0.008549978025257587, -0.023536449298262596, 0.07208053767681122, -0.030224528163671494, 0.01950150914490223, 0.049786366522312164, -0.03509989753365517, -0.00805327482521534, -0.04061150923371315, 0.07284118235111237, 0.01926703378558159, 0.0039652553386986256, 0.0752582848072052, -0.10718692094087601, 0.08713886886835098, 0.03430212289094925, 0.021391049027442932, -0.07060681283473969, -0.02355007827281952, -0.05764642730355263, -0.0024622632190585136, -0.09345494210720062, 0.03995347395539284, -0.041088201105594635, -0.00016457807214464992, 0.0032063520047813654, 0.0657128170132637, 0.061276037245988846, 0.04004615172743797, -0.06967869400978088, -0.1142735406756401, -0.0487496443092823, -0.017974039539694786, -0.050415411591529846, 0.0727805495262146, -0.08386313170194626, 0.03257986158132553, 0.019558453932404518, 0.1035359650850296, -0.024450596421957016, 0.07394827902317047, 0.03353019431233406, -0.03613390773534775, -0.026013216003775597, -0.07175035029649734, -0.005207475274801254, 0.0318346731364727, 0.04500496760010719, 0.05015688017010689, -0.093199722468853, -0.05204732343554497, 0.01700982078909874, 0.0653136745095253, 0.0865848958492279, 0.011923624202609062, 0.0053240032866597176, 0.02866896614432335, 0.020933834835886955, -0.012468923814594746, 0.030275780707597733, -0.0440024733543396, 0.0415719673037529, 0.022960446774959564, 0.09753108769655228, -5.520054102703398e-08, 0.017987171187996864, -0.052161071449518204, -0.011302772909402847, 2.5986975742853247e-05, -0.029698720201849937, 0.011845722794532776, 0.08207475394010544, 0.09778182953596115, -0.05345916375517845, -0.04109978675842285, 0.025253748521208763, -0.003933566622436047, -0.05192144215106964, -0.021110042929649353, -0.02794910967350006, 0.1481378674507141, -0.053853731602430344, 0.02250940538942814, 0.06715612858533859, 0.032307229936122894, 0.010796439833939075, -0.09317716211080551, 0.02367817424237728, 0.021324625238776207, -0.0722893625497818, -0.025508638471364975, -0.06476368755102158, 0.026933126151561737, 0.007658615708351135, -0.012071351520717144, -0.0005792994052171707, 0.02116239257156849, 0.10539945960044861, 0.014972476288676262, 0.045562148094177246, 0.00647744070738554, -0.10017441213130951, 0.013240865431725979, -0.045101482421159744, 0.02335403487086296, 0.005922627169638872, 0.09060869365930557, 0.04007301107048988, -0.04645328223705292, -0.02483823150396347, 0.05364688113331795, 0.05772298574447632, -0.0265734251588583, -0.011406561359763145, 0.062261443585157394, 0.07818550616502762, 0.011526132002472878, -0.007509991992264986, 0.052374836057424545, 0.02047749049961567, -0.07724864035844803, -0.051446713507175446, 0.0453096479177475, -0.010589261539280415, 0.04618147015571594, 0.010937971994280815, -0.0014458141522482038, -0.05802876129746437, -0.0626639798283577 ] }, { "text": "## Recurrent Neural Networks (RNNs)\n\nRNNs are designed for sequential data where the order matters (text, time series, audio). They maintain a hidden state that captures information from previous time steps.", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_16", "embedding": [ -0.12366112321615219, -0.1285911649465561, 0.04934212565422058, 0.01449207216501236, -0.029562663286924362, 0.13488724827766418, -0.037893712520599365, -0.05275888741016388, 0.12113042920827866, -0.0939970538020134, -0.06618566066026688, 0.12714619934558868, -0.07028564065694809, 0.03462954983115196, -0.11849518120288849, -0.042111292481422424, -0.06205880269408226, 0.011730317026376724, 0.017744673416018486, -0.06633230298757553, 0.04550117254257202, 0.07228277623653412, 0.024525459855794907, 0.0774940699338913, 0.05293415114283562, 0.04170868545770645, -0.013848641887307167, 0.03642920404672623, 0.08592875301837921, 0.04808253422379494, 0.11461804062128067, 0.01714765466749668, 0.04245533421635628, 0.048998139798641205, -0.11579296737909317, 0.015947381034493446, -0.11264530569314957, -0.018090922385454178, -0.01972830481827259, -0.0042829010635614395, 0.014948951080441475, 0.022798527032136917, 0.024989206343889236, -0.0212456863373518, 0.06488531827926636, -0.00113638024777174, 0.022658459842205048, 0.009993404150009155, -0.045938558876514435, 0.07726972550153732, -0.03893265500664711, 0.00531280180439353, 0.03994908928871155, 0.05315672233700752, 0.008977970108389854, 0.06590268760919571, -0.02582147717475891, 0.0353386364877224, -0.050022974610328674, 0.01112948264926672, 0.029195329174399376, -0.06527207791805267, 0.005973865743726492, -0.0543447770178318, 0.01882416009902954, 0.045360565185546875, -0.04408774897456169, 0.1010323092341423, 0.07469960302114487, -0.012503428384661674, 0.03239891678094864, 0.0422525592148304, 0.03699294477701187, -0.002016206504777074, -0.009681764990091324, 0.018039418384432793, 0.06638546288013458, -0.08282100409269333, -0.016477949917316437, 0.007462580222636461, -0.04238925129175186, -0.08016730844974518, 0.04089270159602165, 0.024562351405620575, 0.00399110047146678, -0.04914836958050728, 0.004639908671379089, 0.020651347935199738, -0.05530870705842972, -0.012314069084823132, -0.03607542812824249, -0.03259092569351196, 0.05831107124686241, -0.04187748581171036, -0.02335817925632, 0.05526129901409149, 0.007611938286572695, 0.0405585840344429, 0.023627936840057373, -0.015869902446866035, 0.022267716005444527, 0.027587326243519783, 0.041955940425395966, 0.03419189900159836, 0.013319753110408783, -0.03219751641154289, 0.034111760556697845, -0.02548363246023655, 0.06175858899950981, -0.023221999406814575, -0.004340703133493662, 0.03999365493655205, -7.971645391080528e-05, -0.060192421078681946, 0.0028944513760507107, -0.0661076009273529, -0.1115896925330162, -0.02521473355591297, -0.00732928654178977, 0.0762917622923851, -0.07643673568964005, 0.0207566786557436, -0.07815120369195938, -0.00011223430192330852, 0.03774291276931763, 0.006795613560825586, 0.01578107662498951, 1.1495962817282532e-33, -0.040138546377420425, -0.04283826798200607, 0.025144213810563087, -0.012182465754449368, 0.07025779038667679, 0.005687704775482416, -0.011391988024115562, -0.0557745024561882, 0.034478962421417236, 0.009433959610760212, -0.08355309814214706, 0.0416393056511879, -0.060230087488889694, 0.07070669531822205, -0.04059557244181633, -0.08190252631902695, 0.005559734534472227, 0.001992671051993966, 0.03255496546626091, -0.014839465729892254, 0.008924540132284164, 0.013716278597712517, 0.047627076506614685, -0.007171424105763435, 0.02354203537106514, 0.0029726179782301188, 0.04723557084798813, 0.002617919584736228, -0.003018495161086321, -0.020874299108982086, -0.031835779547691345, 0.007709088735282421, -0.039742860943078995, -0.015273455530405045, 0.05384695157408714, -0.035048093646764755, 0.04101100564002991, 0.013981369324028492, 0.05856052786111832, -0.0404367633163929, 0.014959616586565971, 0.01826944388449192, -0.09060065448284149, 0.0649455189704895, -0.029946278780698776, -0.07092447578907013, 0.0321025624871254, 0.047419916838407516, 0.011291279457509518, -0.0035314548294991255, 0.006004184950143099, 0.011239588260650635, -0.07351169735193253, -0.10226379334926605, 0.0908455103635788, -0.04951789602637291, 0.014259091578423977, 0.05078045651316643, 0.005529396701604128, 0.06116301193833351, 0.04398341104388237, -0.020113855600357056, 0.05337350443005562, -0.01905880495905876, 0.01975659467279911, 0.011459746398031712, 0.028640151023864746, 0.009886742569506168, 0.1284017711877823, -0.04201048985123634, 0.023506520316004753, 0.058882713317871094, 0.02372778207063675, 0.0631176307797432, -0.00523539399728179, 0.05702690780162811, 0.010230151005089283, -0.057725515216588974, -0.010742769576609135, 0.07160639017820358, -0.03154461085796356, -0.057267263531684875, -0.04555327817797661, 0.018738441169261932, -0.03412748500704765, 0.041001901030540466, 0.05480052903294563, -0.05694715306162834, 2.7275033062323928e-05, -0.0330086350440979, 0.008088720962405205, -0.04284203052520752, 0.038118068128824234, 0.018326684832572937, -0.026523787528276443, -1.2885226325931622e-33, 0.012135117314755917, 0.035897284746170044, -0.1100735068321228, 0.04529833048582077, 0.03236803039908409, -0.04891378805041313, -0.1078701913356781, -0.012515337206423283, 0.053071871399879456, 0.0005724370712414384, -0.030633343383669853, -0.0286603681743145, 0.05489031970500946, -0.01603577844798565, 0.000611728522926569, -0.013943817466497421, 0.055231012403964996, -0.07515710592269897, 0.00729990191757679, -0.03386278077960014, -0.006262080743908882, -0.014481456018984318, -0.1139717623591423, -0.0025711858179420233, -0.022860120981931686, -0.010418587364256382, -0.007503552827984095, 0.0799461305141449, 0.029931416735053062, 0.008788998238742352, 0.028821956366300583, -0.1069040447473526, 0.06359828263521194, -0.0203871950507164, 0.015451698563992977, 0.018872838467359543, 0.0848487839102745, -0.03501789644360542, -0.019531475380063057, -0.038184575736522675, 0.11453232914209366, 0.0032797069288790226, 0.03245328739285469, -0.01939653791487217, -0.062452614307403564, -0.020830444991588593, -0.10972230136394501, 0.09615784883499146, -0.0418269969522953, -0.005450786091387272, 0.0008608082425780594, 0.005073898006230593, -0.016010861843824387, -0.08664047718048096, 0.0005339931813068688, -0.025466565042734146, -0.061388615518808365, 0.02915632165968418, 0.06542100012302399, 0.03593273088335991, 0.042481929063797, -0.09092032164335251, 0.012647735886275768, -0.054337356239557266, -0.0635480135679245, 0.03362574055790901, 0.02306850254535675, -0.02714468166232109, -0.0014543724246323109, -0.07095743715763092, 0.0996866300702095, 0.05193641781806946, 0.03850971907377243, 0.08535917848348618, -0.04844189062714577, -0.060805171728134155, -0.052133429795503616, -0.06015285477042198, -0.05575593560934067, -0.11803443729877472, -0.019106809049844742, -0.03987491503357887, -0.01272489968687296, 0.01936161518096924, 0.03307361900806427, 0.14498862624168396, 0.05922364443540573, -0.005204508546739817, 0.02019103243947029, 0.013035536743700504, 0.039842963218688965, -6.598608888452873e-05, -0.04437355324625969, 0.02700863406062126, -0.07759921252727509, -3.072516818747317e-08, -0.03229022026062012, -0.04917331784963608, 0.07349961251020432, 0.004612371791154146, 0.014424326829612255, -0.04240768402814865, 0.07542245835065842, 0.028425777330994606, 0.011432711966335773, -0.04454159736633301, 0.12366534024477005, -0.028578145429491997, -0.051207732409238815, -0.09478536248207092, 0.03845297172665596, 0.01223946176469326, 0.058439869433641434, -0.035773150622844696, 0.009787223301827908, -0.04548168554902077, 0.03506479784846306, 0.05623069778084755, -0.01915600895881653, -0.032611921429634094, 0.05562952905893326, 0.020828355103731155, -0.03015546128153801, 0.08140198141336441, 0.002220341470092535, -0.03198373317718506, 0.0757010281085968, 0.0524563267827034, 0.08225923031568527, -0.02635308913886547, -0.0420173741877079, 0.0386953167617321, 0.08252578228712082, -0.0004183350538369268, -0.031507402658462524, -0.10185090452432632, -0.05038609728217125, -0.01586097478866577, -0.037537798285484314, -0.009774545207619667, -0.11840077489614487, -0.057573352009058, 0.04077959433197975, -0.130657359957695, 0.07086189836263657, -0.051989659667015076, 0.02229837141931057, -0.03430064767599106, 0.023078016936779022, 0.033757153898477554, 0.05111965537071228, 0.027930838987231255, 0.022398747503757477, -0.014522059820592403, -0.02245408296585083, 0.025944296270608902, -0.047824177891016006, 0.09133636951446533, -0.0012532869586721063, 0.011372105218470097 ] }, { "text": "### Basic RNN\n\n```python\nimport torch\nimport torch.nn as nn", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_17", "embedding": [ -0.06990935653448105, -0.08763285726308823, 0.014768916182219982, 0.046635109931230545, -0.02539898455142975, 0.003044937504455447, 0.041652850806713104, 0.036201395094394684, -0.01582271233201027, -0.0999593734741211, -0.014284499920904636, 0.03960489481687546, -0.08133397996425629, 0.041273728013038635, -0.05721776559948921, 0.05165344476699829, -0.08608148247003555, -0.014217040501534939, -0.02980450913310051, -0.07160724699497223, 0.09365861117839813, 0.005899292882531881, 0.11782647669315338, 0.048001065850257874, 0.00048248926759697497, -0.0242470670491457, 0.06071843206882477, 0.03394370153546333, 0.11735449731349945, 0.0008902243571355939, 0.08025825768709183, 0.04031257703900337, -0.074320487678051, 0.06019120663404465, 0.03011235222220421, -0.01088792271912098, -0.09118203818798065, -0.043851133435964584, -0.025379976257681847, 0.05450839176774025, 0.07315034419298172, -0.009039848111569881, -0.029344534501433372, -0.0459565594792366, 0.0016119946958497167, 0.031410541385412216, 0.049098849296569824, 0.02085399627685547, -0.0007414590218104422, -0.004571843892335892, -0.0005061221891082823, -0.01724276877939701, -0.007716808468103409, 0.026973214000463486, 0.0748843178153038, 0.02219375967979431, 0.006119823083281517, -0.07812114804983139, -0.012431069277226925, -0.12931086122989655, 0.0542726069688797, 0.02052835188806057, 0.02428712509572506, -0.0613742396235466, 0.021187881007790565, 0.02097834087908268, -0.0319044291973114, 0.060862742364406586, 0.0634811595082283, 0.01550854928791523, -0.018566975370049477, -0.0028209902811795473, -0.03159060701727867, 0.0515509769320488, -0.03775201365351677, -0.07075253129005432, 0.0763026550412178, -0.019688516855239868, 0.01578149013221264, -0.026900477707386017, -0.03238256275653839, -0.019721055403351784, 0.052120573818683624, 0.02745114080607891, 0.007270989008247852, -0.023677222430706024, 0.0009324048878625035, 0.08301663398742676, 0.011060553602874279, -0.004795771092176437, -0.11483374983072281, -0.032764170318841934, 0.021034739911556244, 0.0324932262301445, -0.02899615466594696, 0.018894575536251068, 0.06672216206789017, 0.04876646399497986, -0.11468106508255005, 0.024526210501790047, 0.034464024007320404, 0.025295069441199303, -0.05330141261219978, 0.07190356403589249, -0.04130183160305023, 0.04571700841188431, 0.050310634076595306, -0.014037800952792168, 0.013820146210491657, -0.01634785160422325, 0.04141974076628685, 0.0027403037529438734, -0.013651132583618164, -0.07865726202726364, 0.006515965331345797, -0.08881204575300217, -0.0772341713309288, 0.015565001405775547, -0.00770882423967123, 0.1443975865840912, -0.02549191191792488, 0.01965905912220478, -0.10548198223114014, 0.0667833462357521, -0.030786924064159393, -0.0194256529211998, -0.007864924147725105, 1.8457650867519945e-33, -0.03768462315201759, 0.028240887448191643, -0.00736373383551836, -0.0036440612748265266, 0.048725347965955734, 0.023193642497062683, 0.06750736385583878, -0.07160941511392593, -0.08706007152795792, -0.005899300333112478, -0.059100616723299026, 0.03521665185689926, -0.04028060659766197, 0.01540326327085495, -0.11841113865375519, -0.03554006665945053, 0.05628598853945732, -0.0007989943260326982, 0.0342903696000576, -0.003968738950788975, 0.027795474976301193, 0.05788629129528999, -0.018641352653503418, -0.011403139680624008, -0.09893230348825455, -0.013512622565031052, -0.022269494831562042, -0.03144679591059685, 0.07556167989969254, -0.013269560411572456, -0.005593139678239822, -0.015599717386066914, 0.06600641459226608, -0.007204773370176554, 0.06672245264053345, -0.06895757466554642, 0.055980198085308075, 0.007195998914539814, 0.013043827377259731, -0.0663166418671608, 0.008194196037948132, 0.08169633895158768, -0.04284948110580444, 0.003721017623320222, -0.02325495332479477, 0.026569506153464317, -0.012499921955168247, 0.072271928191185, 0.0007130960002541542, -0.004902624990791082, -0.03630104660987854, -0.011046914383769035, 0.009351175278425217, -0.004774666856974363, 0.0907004252076149, -0.07178926467895508, 0.026501066982746124, 0.06390183418989182, 0.08879668265581131, -0.08497357368469238, 0.07094874233007431, 0.011576901189982891, 0.022724444046616554, 0.021698802709579468, 0.00435676658526063, 0.004727705381810665, 0.028263648971915245, 0.04936763271689415, 0.04050765186548233, -0.05722299590706825, -0.1136559322476387, 0.07136073708534241, -0.041968874633312225, 0.046451251953840256, -0.0003767941670957953, -0.007364756893366575, -0.02898014523088932, -0.06325274705886841, -0.03645656630396843, 0.061204783618450165, -0.0542680099606514, 0.05061586573719978, -0.03497616946697235, -0.0727720782160759, -0.025993268936872482, -0.011003642342984676, 0.01304901298135519, -0.045819446444511414, -0.036047738045454025, -0.03978784754872322, -0.016215715557336807, -0.11397403478622437, 0.048307839781045914, -0.052799031138420105, -0.05166611447930336, -2.537974955371861e-33, 0.01144675724208355, 0.09394427388906479, -0.06976794451475143, 0.05591253191232681, -0.07019596546888351, -0.04313042387366295, -0.04678782820701599, -0.037155840545892715, 0.011937606148421764, -0.00179122609551996, -0.0031400418374687433, -0.054407503455877304, 0.03253524377942085, -0.036429718136787415, 0.1050293818116188, -0.003621542127802968, -0.0032003859523683786, 0.07579502463340759, 0.0364808663725853, -0.03460205718874931, -0.07094781845808029, 0.06775737553834915, -0.15789324045181274, 0.0320175476372242, -0.10845854133367538, 0.0408405140042305, 0.0658387839794159, 0.07311881333589554, 0.013154977932572365, -0.017655592411756516, 0.023786164820194244, 0.004381088074296713, -0.08759700506925583, 0.05337340012192726, -0.037203822284936905, 0.030460253357887268, 0.12696346640586853, -0.04929563030600548, -0.019121214747428894, -0.09166199713945389, 0.12865176796913147, 0.01716822199523449, -0.0207382645457983, 0.07373561710119247, -0.09203969687223434, 0.033586591482162476, -0.04280589893460274, 0.008421200327575207, 0.026607448235154152, 0.007943903096020222, 0.02320096641778946, -0.09841896593570709, -0.08166717737913132, -0.03686227649450302, -0.01896432600915432, 0.002448935993015766, 0.036237433552742004, 0.04302036389708519, 0.05469408631324768, -0.0005076252273283899, 0.006790108513087034, -0.10862447321414948, 0.033937957137823105, -0.004204957280308008, -0.09525799006223679, -0.013377253897488117, -0.08879411965608597, 0.0755138248205185, 0.05868023633956909, -0.0695706158876419, 0.014434928074479103, 0.12373743951320648, 0.06296020746231079, 0.023093996569514275, -0.04697687551379204, 0.02157479152083397, 0.03697291016578674, -0.0032480715308338404, 0.015239187516272068, 0.0012259872164577246, -0.08142982423305511, -0.0160108283162117, -0.021000413224101067, -0.04792294278740883, 0.032058775424957275, 0.048032816499471664, 0.11877366155385971, 0.09725303202867508, -0.025580694898962975, -0.04766788333654404, 0.05191103368997574, -0.002897845348343253, 0.06191007047891617, -0.018456097692251205, -0.027146080508828163, -2.1340401445968382e-08, -0.017850516363978386, -0.028932664543390274, 0.030686398968100548, -0.011830691248178482, 0.0002512275823391974, 0.0458279550075531, 0.02874399535357952, 0.005237727425992489, -0.016154881566762924, 0.0004184350254945457, 0.07501474022865295, -0.05449546128511429, 0.01878085546195507, -0.017320943996310234, 0.014172469265758991, 0.13015317916870117, -0.005756757687777281, 0.015540355816483498, 0.020038219168782234, -0.052334606647491455, -0.006540787871927023, 0.005831648595631123, 0.030340049415826797, -0.010112267918884754, -0.010618561878800392, 0.001468466711230576, -0.01828169822692871, 0.03479257598519325, -0.03715456277132034, -0.08208902180194855, 0.058705560863018036, -0.04752713441848755, 0.11895520985126495, -0.019604867324233055, -0.029492147266864777, -0.00041552609764039516, 0.02834765613079071, 0.04249915853142738, 0.039403222501277924, -0.05778631567955017, -0.06617683917284012, -0.04024116322398186, -0.02747519500553608, -0.008360874839127064, -0.06105959042906761, -0.014963801018893719, -0.01909182034432888, -0.03888009488582611, -0.012374814599752426, -0.01918470486998558, 0.0349198654294014, -0.04094099625945091, -0.0020813343580812216, 0.006494082510471344, 0.03724546730518341, -0.0024464144371449947, 0.003645172342658043, 0.029941538348793983, -0.03830951079726219, 0.0012691785814240575, -0.03450428321957588, 0.06280135363340378, -0.031176092103123665, -0.0606909841299057 ] }, { "text": "class SimpleRNN(nn.Module):\n def __init__(self, input_size, hidden_size, output_size):\n super().__init__()\n self.hidden_size = hidden_size\n \n # RNN layer\n self.rnn = nn.RNN(\n input_size=input_size,\n hidden_size=hidden_size,\n num_layers=1,\n batch_first=True # Input shape: [batch, seq_len, features]\n )\n \n # Output layer\n self.fc = nn.Linear(hidden_size, output_size)\n \n def forward(self, x, hidden=None):\n # x shape: [batch, seq_len, input_size]\n \n # Initialize hidden state if not provided\n if hidden is None:\n hidden = torch.zeros(1, x.size(0), self.hidden_size)\n \n # RNN forward pass", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_18", "embedding": [ -0.052871786057949066, -0.0646088644862175, -0.005410607438534498, 0.081828273832798, -0.0069192745722830296, 0.03646661341190338, -0.0029669383075088263, 0.015472987666726112, -0.06958689540624619, -0.09527872502803802, -0.0010058609768748283, -0.03503439202904701, -0.03690173104405403, -0.03583456948399544, -0.05770523473620415, 0.019529512152075768, -0.011687383987009525, 0.027823247015476227, -0.04228244721889496, -0.08516955375671387, 0.024210019037127495, 0.0055371918715536594, 0.0674707442522049, 0.07689603418111801, -0.023575449362397194, -0.02241531014442444, 0.011872956529259682, 0.004349840339273214, 0.07603686302900314, -0.04220706224441528, 0.08259022235870361, 0.008056829683482647, -0.06490103155374527, 0.051617857068777084, 0.024005774408578873, 0.005869126413017511, -0.08441140502691269, 0.006844531279057264, -0.019755493849515915, -0.008082108572125435, 0.056512169539928436, 0.014520234428346157, 0.015350209549069405, -0.04095842316746712, 0.038449641317129135, 0.06989838927984238, -0.0009580501355230808, 0.007350680883973837, 0.012930926866829395, -0.07852275669574738, 0.018996257334947586, -0.0007959063514135778, -0.013053531758487225, 0.04221778362989426, 0.03668426349759102, 0.018234197050333023, 0.016891224309802055, -0.03407907113432884, -0.0911051481962204, -0.04075861722230911, 0.011935999616980553, -0.05223461613059044, 0.04251248389482498, -0.07156343013048172, 0.0009553493582643569, 0.028132356703281403, -0.03458867594599724, 0.03201296925544739, 0.05808191001415253, 0.0429273396730423, 0.039036352187395096, 0.05860431492328644, -0.037340614944696426, 0.04250002279877663, 0.0048491633497178555, -0.05956637114286423, 0.1128055602312088, 0.02460101805627346, -0.05532504618167877, -0.024211067706346512, -0.03341970592737198, -0.010994826443493366, 0.042281221598386765, -0.010590008459985256, 0.030571136623620987, -0.02885587140917778, -0.03433112055063248, 0.005282973404973745, -0.006384503096342087, -0.026359951123595238, -0.04143943265080452, 0.006119770463556051, -0.05788402259349823, 0.020284995436668396, 0.039656903594732285, -0.001246248371899128, 0.0220470130443573, 0.05021679401397705, -0.08480007201433182, 0.029000569134950638, 0.029453126713633537, -0.01466025784611702, 0.042401667684316635, 0.031255196779966354, 0.056017737835645676, 0.120895616710186, 0.058144502341747284, 0.0048407879658043385, 0.04098774865269661, -0.07075309008359909, 0.0309992004185915, -0.018901385366916656, 0.0031394462566822767, -0.015542695298790932, 0.04092302918434143, -0.03864160552620888, -0.008659417741000652, 0.04371907189488411, 0.028161587193608284, 0.07895951718091965, -0.028699547052383423, 0.06702329963445663, -0.055874161422252655, 0.04263586178421974, -0.021040307357907295, -0.02781566046178341, -0.018595870584249496, 2.9206738553423574e-33, -0.01419228594750166, 0.020774157717823982, -0.06247043237090111, -0.04482245445251465, 0.04621919244527817, 0.09242000430822372, 0.12059318274259567, -0.07062229514122009, -0.032717734575271606, 0.006841958034783602, -0.10980955511331558, -0.026413055136799812, -0.04973909631371498, 0.0016446899389848113, -0.03551580384373665, -0.08181759715080261, 0.015880264341831207, 0.04194614663720131, -0.0138237364590168, -0.051936835050582886, 0.0626961886882782, 0.025971919298171997, -0.04520730674266815, -0.04733559116721153, -0.06822456419467926, -0.012069297954440117, -0.021328723058104515, -0.06186266615986824, -0.03854390233755112, -0.013070717453956604, -0.026135656982660294, 0.03322211652994156, 0.012942223809659481, -0.006148174405097961, 0.03751678019762039, -0.07383492588996887, 0.04908785969018936, 0.028503330424427986, 0.06825889647006989, -0.07669961452484131, -0.02620905265212059, 0.022258663550019264, -0.006357047241181135, 0.006982598919421434, -0.08310899883508682, -0.01566312462091446, -0.012119848281145096, 0.10640490055084229, -0.04058019816875458, -0.01357210148125887, 0.021049797534942627, -0.04192977771162987, -0.03622499480843544, -0.07677695155143738, 0.07200737297534943, -0.09594516456127167, 0.046088483184576035, 0.07463957369327545, 0.11970847100019455, 0.0033639702014625072, 0.06261402368545532, 0.02714543789625168, -0.053427718579769135, 0.06005682051181793, -0.045521706342697144, 0.03636115416884422, 0.0011197810526937246, -0.034497424960136414, 0.057029739022254944, -0.039559680968523026, -0.06278806924819946, 0.09530458599328995, -0.07771630585193634, -0.03763000667095184, 0.05620472878217697, -0.03289806470274925, -0.012076483108103275, -0.15585793554782867, -0.02296696975827217, 0.013579451479017735, -0.06700469553470612, 0.07100147753953934, -0.09840018302202225, -0.020104214549064636, -0.034796252846717834, -0.005284138955175877, 0.01953025348484516, -0.016174986958503723, -0.021826112642884254, -0.01466082688421011, -0.037304628640413284, -0.1233411654829979, 0.0622720867395401, -0.03293069079518318, -0.04370388761162758, -2.8963203674582043e-33, 0.024087194353342056, 0.14434278011322021, -0.029083605855703354, 0.04988166689872742, -0.039608463644981384, -0.02260982245206833, 0.008459535427391529, 0.03948346525430679, -0.009816938079893589, 0.010409533977508545, -0.054796088486909866, -0.004316605161875486, 0.020456433296203613, -0.031674597412347794, 0.06546790897846222, 0.019882552325725555, -0.004307762254029512, 0.04679969325661659, 0.04179661348462105, -0.04042919725179672, -0.09264776855707169, 0.07986090332269669, -0.19033846259117126, 0.056750573217868805, -0.09007975459098816, 0.033627450466156006, -0.0026495670899748802, 0.09650670737028122, 0.04839322715997696, -0.037382107228040695, -0.04517800733447075, -0.02926143817603588, -0.03670375049114227, 0.031289853155612946, -0.03482784330844879, 0.07086262106895447, 0.033998679369688034, -0.04035766050219536, 0.01898709125816822, -0.022957587614655495, 0.07678686827421188, -0.019968446344137192, -0.054261766374111176, 0.07665295898914337, -0.06500531733036041, 0.07417457550764084, -0.060130856931209564, 0.015799738466739655, -0.051595982164144516, 0.04511597007513046, -0.031409136950969696, -0.05039754882454872, -0.027872025966644287, -0.015477951616048813, -0.029995720833539963, 0.03600208833813667, -0.004827294964343309, 0.05458536371588707, 0.03917839750647545, 0.01043861173093319, 0.026901975274086, -0.10786478221416473, 0.04992159828543663, -0.027639150619506836, -0.022329125553369522, 0.026077212765812874, -0.06604757905006409, 0.0680510550737381, 0.06212620809674263, -0.017169909551739693, 0.05100065469741821, 0.11206106841564178, 0.0714656338095665, 0.00972694717347622, -0.028693655505776405, 0.022594599053263664, -0.028494587168097496, -0.020651305094361305, 0.017775261774659157, 0.017826903611421585, -0.08461008965969086, -0.023107364773750305, 0.028037404641509056, -0.010289696045219898, 0.07251208275556564, 0.08390948176383972, 0.09786283224821091, 0.08190097659826279, -0.030361590906977654, -0.005580645985901356, 0.052327536046504974, 0.029788248240947723, 0.07689081877470016, 0.049475040286779404, 0.027957037091255188, -4.7950546644415226e-08, -0.013673564419150352, -0.0394502729177475, 0.05327613279223442, 0.05591556802392006, 0.03511006012558937, 0.008824381977319717, 0.0969773381948471, 0.02507682703435421, -0.011632759124040604, -0.03449445590376854, 0.023066315799951553, -0.056990284472703934, 0.017528129741549492, -0.005040351767092943, 0.027808988466858864, 0.055829741060733795, -0.02462460659444332, -0.042495246976614, 0.005346623249351978, -0.0347578339278698, -0.04189344123005867, -0.019798515364527702, -0.04355880245566368, 0.0024627232924103737, -0.06880638748407364, -0.07786116003990173, -0.02320602908730507, 0.032887037843465805, -0.0017094239592552185, -0.05927765369415283, 0.05306733772158623, -0.01386992633342743, 0.10866479575634003, 0.11310993134975433, -0.02229759283363819, 0.061828337609767914, 0.017782745882868767, 0.044340550899505615, -0.011335286311805248, -0.024232815951108932, -0.13249020278453827, -0.004816378466784954, -0.0016897035529837012, -0.03340424969792366, -0.05203704535961151, -0.04189804941415787, 0.02439543604850769, -0.15737585723400116, -0.006611200515180826, 0.02368946745991707, 0.04836900532245636, -0.0185659471899271, -0.024275219067931175, 0.08054451644420624, 0.037348050624132156, -0.02615528553724289, -0.04724753648042679, 0.029280222952365875, -0.05062708631157875, 0.06372105330228806, -0.11619923263788223, 0.030593253672122955, -0.024633517488837242, 0.0008429136360064149 ] }, { "text": "if hidden is None:\n hidden = torch.zeros(1, x.size(0), self.hidden_size)\n \n # RNN forward pass\n output, hidden = self.rnn(x, hidden)\n # output shape: [batch, seq_len, hidden_size]\n # hidden shape: [num_layers, batch, hidden_size]\n \n # Take the last output for classification\n last_output = output[:, -1, :] # [batch, hidden_size]\n prediction = self.fc(last_output)\n \n return prediction, hidden", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_19", "embedding": [ -0.03616975620388985, -0.07661447674036026, -0.022298255935311317, 0.11658585071563721, 0.06586548686027527, 0.0646677315235138, -0.02816450595855713, -0.02857157215476036, -0.04736420139670372, -0.10125720500946045, -0.029169732704758644, -0.05648630112409592, -0.07002666592597961, -0.06670083105564117, -0.07991159707307816, -0.008979643695056438, -0.043452151119709015, -0.004285319708287716, -0.019421719014644623, -0.11934560537338257, 0.07536912709474564, 0.05238310620188713, 0.05912310257554054, 0.09617521613836288, 0.008119243197143078, -0.010610030964016914, 0.02108185552060604, 0.032828524708747864, 0.020544225350022316, -0.03938053175806999, 0.0630483478307724, -0.00348777137696743, -0.015837615355849266, 0.019638437777757645, 0.04407709091901779, -0.07134091109037399, -0.10567332059144974, -0.0014718363527208567, 0.015391074120998383, -0.001189965638332069, 0.02087060734629631, 0.005763504654169083, -0.00784072745591402, -0.04058880731463432, 0.008537900634109974, 0.07413269579410553, 0.010115697048604488, -0.029998980462551117, -0.02110818773508072, -0.024007804691791534, 0.03694405034184456, 0.01273691188544035, -0.040350090712308884, 0.03750764951109886, -0.015752071514725685, -0.027488449588418007, 0.036316122859716415, -0.044899389147758484, -0.12152685970067978, -0.019452065229415894, -0.0034123004879802465, -0.06150465086102486, 0.032269641757011414, -0.07417533546686172, 0.01565634272992611, 0.04776962473988533, -0.03880971670150757, 0.01185100618749857, 0.08634153753519058, 0.06921321153640747, 0.027822859585285187, 0.03893454372882843, -0.005135915242135525, 0.005666718352586031, 0.01105666346848011, -0.035792067646980286, 0.13540425896644592, 0.03153853490948677, -0.052672356367111206, 0.001967125805094838, -0.05567570775747299, -0.036945708096027374, 0.03228147700428963, 0.011163176037371159, -0.011520427651703358, 0.014099353924393654, -0.042508698999881744, 0.06968163698911667, -0.04236217960715294, -0.03435105085372925, -0.06000767648220062, -0.024503160268068314, -0.055130548775196075, 0.03174225613474846, -0.0005792022566311061, -0.004561271518468857, 0.02592172659933567, 0.041715845465660095, -0.06785831600427628, -0.009155072271823883, -0.024517465382814407, -0.015998123213648796, 0.05856722220778465, 0.04841219261288643, 0.07256920635700226, 0.12327636778354645, 0.03681377321481705, 0.006027995143085718, 0.05437799170613289, -0.035902123898267746, 0.058101292699575424, 0.001666818279772997, -0.0021950961090624332, 0.01103879977017641, 0.05259804055094719, -0.018420139327645302, 0.008553335443139076, 0.004680645186454058, -0.03781234472990036, 0.09403315931558609, -0.02305605262517929, 0.06133238971233368, -0.020379409193992615, 0.038622450083494186, -0.01370991300791502, -0.007201998960226774, -0.026111476123332977, 3.0479288330005473e-33, -0.00838665384799242, -0.006762195378541946, -0.05450956150889397, -0.0647888109087944, 0.009857960045337677, 0.09712206572294235, 0.1064886525273323, -0.05866088718175888, -0.01521136611700058, 0.040482889860868454, -0.0891832783818245, -0.0012939705047756433, -0.04376565292477608, 0.033209897577762604, -0.05962091311812401, -0.009629062376916409, 0.057442013174295425, 0.03384385630488396, -0.03243523836135864, -0.06113661453127861, 0.04445670172572136, 0.061968326568603516, -0.05309317633509636, -0.06931902468204498, -0.017971346154808998, 0.0032835251186043024, -0.000884322333149612, -0.09549105167388916, -0.061418063938617706, -0.001901554991491139, -0.05378167703747749, 0.06303770840167999, 0.08468416333198547, -0.06108155474066734, 0.06761228293180466, -0.041275862604379654, 0.001708154915831983, 0.04344423487782478, 0.06841720640659332, -0.02107623964548111, -0.002487219637259841, 0.004479304887354374, 0.014733531512320042, -0.00278226425871253, -0.08183962106704712, -0.0432790145277977, -0.0217412281781435, 0.10538943856954575, -0.03173503652215004, 0.021671727299690247, 0.025558533146977425, -0.04317187890410423, -0.028543321415781975, -0.04896754398941994, 0.04477817565202713, -0.11644964665174484, 0.05796381086111069, 0.0698656439781189, 0.08816864341497421, -0.061539921909570694, 0.06825272738933563, 0.04647872969508171, -0.04709220305085182, 0.03368005156517029, -0.08674489706754684, 0.0073962463065981865, 0.03788848593831062, -0.034440066665410995, 0.035992227494716644, -0.014640981331467628, -0.0375375859439373, 0.05709272250533104, -0.049461156129837036, -0.01452281977981329, 0.026138758286833763, -0.03430217504501343, 0.005769523326307535, -0.11215061694383621, 0.010733352042734623, 0.057264797389507294, 0.002493358915671706, 0.04673164710402489, -0.06627645343542099, -0.047001540660858154, 0.010013271123170853, -0.01735766977071762, 0.0593385323882103, 0.00476096710190177, -0.05669067054986954, 0.010841245763003826, -0.08613598346710205, -0.09259475022554398, 0.07287566363811493, 0.00027705609682016075, -0.09672998636960983, -3.7916117625329985e-33, 0.0034748492762446404, 0.17053446173667908, -0.05540876463055611, -0.014825833961367607, -0.0886286273598671, 0.016187220811843872, -0.025388052687048912, 0.08105688542127609, -0.049499478191137314, 0.02315121702849865, 0.014339140616357327, 0.020950088277459145, -0.011179795488715172, -0.018661074340343475, 0.03480566293001175, 0.01916521228849888, 0.0007793614058755338, 0.014269974082708359, 0.005339937750250101, -0.023774046450853348, -0.060519054532051086, 0.03923351317644119, -0.13782258331775665, 0.0688031017780304, -0.0859709307551384, -0.018713735044002533, 0.07623394578695297, 0.09988027065992355, 0.023921426385641098, -0.08109673112630844, -0.02782561257481575, -0.030621692538261414, -0.004213165026158094, -0.013056853786110878, -0.055887263268232346, 0.024700652807950974, 0.010225496254861355, -0.07268309593200684, 0.03251412510871887, 0.01838676631450653, -0.007548967842012644, 0.02056700736284256, -0.11226873099803925, 0.03811129927635193, -0.03527280315756798, 0.046301208436489105, -0.0468708872795105, 0.043912701308727264, 0.03849418833851814, 0.02490038238465786, 0.01044035330414772, -0.03063586913049221, -0.029234685003757477, -0.03378506377339363, -0.015691544860601425, -0.004107274115085602, -0.03392789140343666, 0.029192570596933365, 0.004366571549326181, 0.02194785326719284, 0.0345180369913578, -0.02564236707985401, 0.050209976732730865, -0.0371275469660759, -0.01758408173918724, 0.02218758873641491, -0.038381561636924744, 0.09693893045186996, 0.059199657291173935, 0.024589357897639275, 0.08003401011228561, 0.1304987221956253, 0.011125479824841022, 0.024008138105273247, -0.03834165260195732, 0.0301069188863039, -0.07010402530431747, -0.016789641231298447, 0.034790799021720886, 0.001692386926151812, -0.07804805040359497, -0.0126235606148839, 0.03158711642026901, 0.001989350188523531, 0.12444084882736206, 0.0682857409119606, 0.08679832518100739, 0.07713069766759872, -0.009140030480921268, -0.015422562137246132, 0.03671731799840927, -0.004378366284072399, 0.049679163843393326, 0.02860751561820507, 0.0002314570447197184, -4.012452237134312e-08, 0.015349925495684147, -0.027823960408568382, 0.053271759301424026, 0.04996855929493904, -0.016952861100435257, 0.028249388560652733, 0.08950430154800415, 0.019620126113295555, -0.009502892382442951, -0.0007593302289023995, 0.07916811108589172, -0.07965226471424103, -0.014204464852809906, 0.016344629228115082, 0.04454991593956947, 0.03569710627198219, -0.0181663166731596, -0.041046034544706345, 0.005904446821659803, -0.039268579334020615, -0.035115450620651245, -0.037694647908210754, -0.045629680156707764, -0.007055289577692747, -0.03316241875290871, -0.07985483109951019, -0.03674614429473877, 0.022104643285274506, -0.02434467151761055, -0.020900744944810867, 0.06923206895589828, -0.005444290582090616, 0.06044892221689224, 0.06916246563196182, -0.01633574441075325, 0.031250324100255966, 0.028217675164341927, 0.05580723658204079, -0.02043387107551098, 0.047335412353277206, -0.10240133106708527, -0.02857559733092785, -0.0032732717227190733, -0.020276205614209175, -0.07050559669733047, -0.04469573497772217, 0.07945247739553452, -0.16682668030261993, -0.03190801292657852, -0.014055787585675716, 0.07122466713190079, -0.027460627257823944, -0.05395220220088959, 0.10198561102151871, 0.041307609528303146, -0.05254974588751793, -0.03895651549100876, 0.05631502717733383, -0.06910255551338196, 0.038926851004362106, -0.06050106883049011, -0.022251250222325325, -0.060283321887254715, 0.027807796373963356 ] }, { "text": "# Example: Sequence classification\nrnn = SimpleRNN(input_size=10, hidden_size=64, output_size=5)\nsequence = torch.randn(32, 20, 10) # Batch=32, SeqLen=20, Features=10\noutput, _ = rnn(sequence)\nprint(f\"RNN output shape: {output.shape}\") # [32, 5]\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_20", "embedding": [ -0.05536620691418648, -0.07407265901565552, 0.007779708597809076, 0.04870559647679329, 0.015591448172926903, 0.05685834959149361, -0.03719368949532509, -0.013432062231004238, -0.06561248749494553, -0.14381417632102966, -0.02732335589826107, -0.025639094412326813, -0.09238012135028839, -0.009633256122469902, -0.08088972419500351, -0.005667736288160086, -0.05924343690276146, 0.03971603140234947, 0.0017507270677015185, -0.12045864015817642, 0.0962146520614624, 0.04377508535981178, 0.06602287292480469, 0.06309150904417038, -0.007525376509875059, -0.0420847050845623, 0.034678004682064056, 0.07932727038860321, 0.0841725766658783, -0.007870619185268879, 0.07909088581800461, 0.02445402555167675, 0.0021590031683444977, 0.018684234470129013, 0.0352332703769207, -0.05453169718384743, -0.12766866385936737, -0.03938940912485123, 0.03762565553188324, 0.011917492374777794, 0.03246365487575531, -0.006912619806826115, -0.02603248693048954, -0.0008253018604591489, 0.02781510166823864, 0.02046515792608261, -0.014808127656579018, -0.030246276408433914, -0.03699979931116104, -0.015437810681760311, 0.010306981392204762, 0.03266191482543945, -0.06620153784751892, 0.0779641717672348, 0.034099359065294266, -0.036051783710718155, 0.011369885876774788, -0.023175867274403572, -0.027529962360858917, -0.0885208323597908, 0.05048922449350357, -0.09557555615901947, 0.025457846000790596, -0.08275844156742096, -0.02002396620810032, -0.0009640139760449529, 0.0011310725240036845, 0.04819300025701523, 0.062156129628419876, -0.0016903241630643606, -0.0021848990581929684, 0.03877990320324898, -0.021798642352223396, 0.034531015902757645, -0.008694055490195751, -0.019520480185747147, 0.1031448096036911, 0.04564788192510605, -0.03959779441356659, -0.016046546399593353, -0.08479789644479752, -0.011265690438449383, 0.11015886813402176, 0.03028477355837822, -0.018311506137251854, -0.0022211747709661722, -0.016592049971222878, 0.05248813331127167, -0.08425889909267426, -0.01161165814846754, -0.04857081174850464, -0.020877940580248833, 0.0016771226655691862, -0.015437643975019455, -0.012345168739557266, 0.05744737386703491, 0.09339015185832977, 0.047508060932159424, -0.06658845394849777, 0.006445553153753281, 0.019505728036165237, -0.010999122634530067, 0.059103693813085556, -0.01454001571983099, 0.014032603241503239, 0.07974936813116074, 0.02718893438577652, -0.039206426590681076, 0.07082699984312057, -0.07809167355298996, 0.045226018875837326, 0.01524134911596775, 0.008572881110012531, -0.06646472215652466, 0.06197136640548706, -0.04491158574819565, -0.08602584153413773, 0.02368738129734993, 0.047812703996896744, 0.1503029316663742, -0.03570425510406494, 0.0378304049372673, -0.084627665579319, 0.06731274724006653, -0.023068752139806747, -0.022886330261826515, -0.03503526747226715, 2.7657808014444277e-33, 0.0029851181898266077, -0.009779497981071472, -0.05986112728714943, -0.08031582832336426, 0.037593334913253784, 0.06500108540058136, 0.0880846381187439, -0.05732625722885132, -0.04722109064459801, 0.006309009622782469, -0.10694649070501328, -0.023151163011789322, -0.030457599088549614, 0.034999389201402664, -0.09279050678014755, -0.0900791734457016, 0.0005185980116948485, 0.032291214913129807, -0.05291220173239708, -0.0026299618184566498, -0.030795350670814514, 0.036472074687480927, -0.025768840685486794, -0.025056419894099236, -0.029302332550287247, -0.019767826423048973, -0.002853678772225976, -0.04371802881360054, -0.023258326575160027, -0.006996611133217812, -0.05616367235779762, 0.04562624916434288, 0.06492263823747635, -0.03994784504175186, 0.0782046690583229, -0.053907282650470734, 0.09227056056261063, 0.028714008629322052, 0.025058157742023468, -0.08501467853784561, 0.013083060272037983, 0.02481609769165516, -0.03065595217049122, 0.06115312874317169, -0.039361827075481415, 0.013925079256296158, 0.016657942906022072, 0.05723213031888008, 0.03737165033817291, -0.019139140844345093, 0.010486672632396221, -0.05402187630534172, 0.010845364071428776, -0.016799047589302063, 0.09102652966976166, -0.07779829204082489, 0.011716258712112904, 0.046948377043008804, 0.08977139741182327, 0.016682777553796768, 0.05303649231791496, 0.06920594722032547, -0.01042220275849104, 0.046487342566251755, -0.01783294416964054, -0.020184557884931564, 0.021894540637731552, 0.01792229153215885, 0.025904642418026924, -0.018584178760647774, -0.0537896454334259, 0.05608566850423813, -0.08817539364099503, -0.03692503646016121, 0.01465251948684454, -0.014976303093135357, 0.0086851567029953, -0.13549606502056122, -0.09939555078744888, 0.07352081686258316, -0.061833545565605164, 0.08012784272432327, -0.04431172087788582, -0.06079931929707527, -0.08541274070739746, 0.006924696732312441, 0.04730789363384247, -0.011333842761814594, -0.011233748868107796, -0.041195228695869446, -0.08919323980808258, -0.07859570533037186, 0.0728486105799675, -0.00901629589498043, -0.04141470417380333, -3.626729578046972e-33, 0.0026867245323956013, 0.12133857607841492, -0.03051566332578659, 0.02770119719207287, -0.055790938436985016, 0.0008995907264761627, -0.004528416786342859, -0.008831578306853771, -0.05535728111863136, 0.016538111492991447, -0.017798960208892822, -0.023601504042744637, 0.0025657329242676497, -0.07654328644275665, 0.019052861258387566, 0.0008904452552087605, -0.048733457922935486, 0.03746261075139046, 0.060293495655059814, 0.052135057747364044, 0.022480826824903488, 0.04018807038664818, -0.16361664235591888, 0.02249111607670784, -0.04743251949548721, 0.013534159399569035, 0.07847917824983597, 0.06088399887084961, 0.05310838297009468, -0.051802847534418106, -0.017423003911972046, -0.051772940903902054, 0.011466709896922112, 0.07175489515066147, -0.045197803527116776, -0.0034942629281431437, 0.08418001234531403, -0.06361235678195953, 0.015759749338030815, -0.012981988489627838, 0.059615906327962875, -0.0065126544795930386, -0.006377820391207933, 0.11783021688461304, -0.05404512584209442, -0.005949710961431265, -0.060953546315431595, 0.05423237383365631, -0.003620724892243743, 0.017154384404420853, 0.01684710569679737, -0.026526518166065216, -0.10810866951942444, 0.025143828243017197, -0.027226392179727554, -0.006837788969278336, -0.029407937079668045, 0.05388670414686203, -0.0030037302058190107, 0.05968203768134117, -0.003608603961765766, -0.0617036297917366, 0.04680567979812622, -0.033726487308740616, 0.027410192415118217, 0.036338482052087784, -0.051135849207639694, 0.019507788121700287, 0.020170731469988823, -0.010525028221309185, 0.050318650901317596, 0.07599116116762161, 0.05065574124455452, 0.07965102791786194, -0.04994815215468407, -0.056783124804496765, -0.03651095926761627, 0.0055116917937994, -0.0375213697552681, 0.001375692430883646, -0.07073083519935608, -0.015595910139381886, 0.01188633218407631, 0.029134342446923256, 0.03729388862848282, 0.09054428339004517, 0.10330270975828171, 0.06421183794736862, 0.008250926621258259, 0.024793006479740143, 0.044243503361940384, 0.04526541009545326, 0.08039096742868423, 0.057108402252197266, 0.028095433488488197, -4.566261324612242e-08, 0.018755219876766205, -0.07280907779932022, 0.07054921239614487, 0.021201346069574356, 0.0342228002846241, 0.004152754787355661, 0.049660757184028625, 0.009281438775360584, -0.012458748184144497, -0.017375659197568893, 0.02615859918296337, -0.04995545372366905, -0.04305802285671234, 0.007710309699177742, 0.058447543531656265, 0.07942535728216171, 0.031097842380404472, 0.0050671095959842205, 0.036133669316768646, 0.009047489613294601, -0.0036045967135578394, -0.017312873154878616, -0.011004865169525146, -0.02103542536497116, -0.05218314006924629, -0.10134277492761612, -0.018444038927555084, 0.07733435183763504, -0.014586623758077621, -0.08784087747335434, 0.04886842146515846, -0.0021908022463321686, 0.07362690567970276, -0.017390867695212364, -0.03421838954091072, 0.026926608756184578, -0.03255288675427437, 0.02094324678182602, -0.013575796037912369, -0.0022792848758399487, -0.07413145899772644, -0.011130904778838158, 0.011933891102671623, -0.05772773548960686, -0.09430377930402756, -0.07402435690164566, 0.02546330727636814, -0.15015436708927155, 0.048960935324430466, 0.007701121270656586, 0.03855845332145691, -0.03671130910515785, 0.00955269020050764, 0.034222036600112915, 0.013434572145342827, 0.04065475985407829, -0.027648841962218285, 0.023550434038043022, -0.04247754439711571, 0.05472426861524582, -0.07433661818504333, 0.03909716010093689, 0.0024203697685152292, -0.03163358196616173 ] }, { "text": "### LSTM (Long Short-Term Memory)\n\nLSTMs solve the vanishing gradient problem in vanilla RNNs using gates that control information flow.", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_21", "embedding": [ -0.03270970284938812, -0.10711930692195892, 0.017768049612641335, 0.05167919397354126, -0.013757934793829918, 0.07028552889823914, -0.0330648198723793, -0.014265394769608974, -0.0009029224165715277, -0.05241852253675461, -0.009733619168400764, 0.05302071198821068, -0.0027220677584409714, -0.022262755781412125, -0.004878660198301077, 0.0749262347817421, -0.05160719156265259, 0.08438830822706223, -0.05561685562133789, -0.07820016890764236, 0.015706004574894905, -0.002600732259452343, -0.006626575719565153, 0.08308283239603043, -0.011366419494152069, 0.013253678567707539, -0.004977360367774963, -0.03154262900352478, 0.1256408393383026, -0.05821001157164574, 0.14945846796035767, 0.026168188080191612, -0.008469786494970322, 0.0502680242061615, -0.11086125671863556, 0.0670224204659462, -0.11074867844581604, 0.008408287540078163, -0.05887536332011223, -0.02721695974469185, 0.004198024515062571, 0.08163157850503922, -0.032536912709474564, 0.007618227042257786, 0.10613074153661728, 0.04056328162550926, 0.02732030302286148, -0.005847514607012272, -0.013265318237245083, 0.019906779751181602, -0.06384815275669098, -0.005077561363577843, 0.006778561510145664, 0.0320170558989048, -0.01871350035071373, 0.009971720166504383, -0.0007107161800377071, 0.01236751489341259, -0.05216061696410179, 0.030989618971943855, -0.05468739941716194, -0.09796670079231262, -0.004250192083418369, -0.07596588879823685, -0.01525266282260418, 0.04740270599722862, 0.021154163405299187, 0.06280466914176941, 0.07279422134160995, 0.06611812859773636, -0.021564148366451263, 0.027783215045928955, -0.06120128557085991, -0.012278144247829914, 0.026398753747344017, 0.013547748327255249, 0.08904062211513519, -0.0381108820438385, 0.024785174056887627, 0.02280622348189354, 0.03018786944448948, 0.0071458956226706505, 0.002190074184909463, 0.01438930258154869, 0.03177311271429062, -0.03340451419353485, -0.04241326078772545, 0.02795299142599106, 0.021232761442661285, -0.009299111552536488, -0.04150238633155823, -0.03938102349638939, -0.013517017476260662, -0.014766297303140163, 0.018057186156511307, 0.012476611882448196, 0.03224118798971176, -0.03400542587041855, -0.05700244754552841, 0.02090131863951683, 0.004863520618528128, 0.02519221417605877, -0.01477742474526167, 0.04717136174440384, 0.0004570985329337418, 0.04091617092490196, 0.11275612562894821, 0.026978759095072746, 0.04369009658694267, -0.05916938558220863, 0.08727560192346573, 0.03391457349061966, 0.057651787996292114, -0.030529117211699486, -0.014916482381522655, -0.12885268032550812, 0.029353143647313118, -0.07136918604373932, -0.041461434215307236, 0.11210139095783234, -0.0838017538189888, -0.03749193623661995, -0.08487281203269958, 0.023684628307819366, -0.031751297414302826, -0.010550460778176785, 0.00944348331540823, 2.8906838720460114e-33, -0.05841534212231636, 0.014229494147002697, 0.0173728596419096, 0.004617282655090094, 0.09378564357757568, 0.04952415078878403, 0.07975360006093979, -0.016767580062150955, -0.03589082881808281, 0.02993745356798172, -0.07316453009843826, -0.02794184908270836, -0.12099906802177429, 0.02783702127635479, -0.023474637418985367, -0.10218089818954468, -0.03256891295313835, 0.0057053714990615845, 0.02622980810701847, -0.023363716900348663, 0.030523059889674187, -0.015334238298237324, -0.02411678619682789, 0.0005869740271009505, 0.011007196269929409, -0.0015790830366313457, 0.07905308157205582, -0.012661519460380077, 0.02208847925066948, 0.00611898023635149, -0.07014458626508713, -0.01621554046869278, -0.058310456573963165, -0.00517059862613678, 0.05250686779618263, 0.007068026810884476, -0.014712699688971043, -0.004508220590651035, 0.06406810879707336, -0.016958795487880707, -0.02221888303756714, 0.03524986281991005, -0.012614976614713669, 0.04221335053443909, -0.11581392586231232, -0.03294866904616356, 0.015355750918388367, 0.046670377254486084, -0.025481177493929863, -0.02744169533252716, -0.03431178256869316, 0.020955229178071022, -0.12589071691036224, -0.11679069697856903, 0.06803666055202484, -0.04241326451301575, -0.005761831533163786, 0.06419552862644196, 0.021616268903017044, 0.1005106195807457, 0.07114412635564804, 0.05076932534575462, 0.024753697216510773, 0.01642935909330845, 0.041128192096948624, -0.006627291440963745, -0.051841504871845245, 0.009813480079174042, 0.031665414571762085, -0.05113957077264786, 0.019901374354958534, 0.0433398112654686, 0.026036884635686874, 0.011949238367378712, 0.022787893190979958, 0.01364093367010355, 0.06576558947563171, -0.06811309605836868, 0.024619095027446747, 0.05080616846680641, 0.007316594943404198, -0.03182128071784973, -0.04727673903107643, 0.021677330136299133, 0.00807801540941, -0.0031952045392245054, 0.07089816778898239, -0.08082708716392517, -0.07246707379817963, -0.024681352078914642, -0.04677755758166313, -0.05398384854197502, 0.07044457644224167, 0.01403828989714384, -0.07659722864627838, -2.6593228902461765e-33, -0.039878617972135544, 0.050882916897535324, -0.08228857815265656, 0.06912433356046677, -0.03527019917964935, -0.07190922647714615, -0.06242339685559273, 0.006737253163009882, 0.027239827439188957, -0.004318942315876484, -0.015102161094546318, 0.017813220620155334, -0.03062577359378338, 0.016455790027976036, 0.014901155605912209, -0.02981502003967762, 0.05790260061621666, -0.028173964470624924, 0.008533744141459465, 0.021853195503354073, -0.026327764615416527, 0.09785190969705582, -0.1313716322183609, 0.02070329710841179, -0.05537596717476845, 0.022294919937849045, -0.028530636802315712, 0.14754712581634521, 0.011670229025185108, 0.041474901139736176, -0.030287647619843483, -0.022808320820331573, 0.029557684436440468, -0.0287975762039423, -0.07775039970874786, 0.018200743943452835, 0.07736338675022125, -0.009726027958095074, -0.02373550459742546, -0.002746060024946928, 0.09004724770784378, -0.04143664985895157, 0.015435432083904743, -0.0068549830466508865, 0.008682500571012497, -0.03844902291893959, -0.10734865069389343, 0.030723445117473602, 0.03125353157520294, 0.07011327147483826, -0.04404919967055321, -0.012171678245067596, -0.05985703691840172, -0.009282629005610943, -0.07669621706008911, -0.0323571041226387, -0.07253614068031311, 0.031628310680389404, 0.12234354764223099, -0.014695186167955399, -0.034894369542598724, -0.0764085128903389, -0.03987504541873932, -0.05484628304839134, -0.018750745803117752, 0.005497185047715902, 0.06017692759633064, 0.012099421583116055, 0.02897181734442711, -0.0012952456017956138, 0.09970550984144211, 0.10141368955373764, 0.010052389465272427, 0.028016764670610428, 0.007872671820223331, 0.028103679418563843, -0.05157754197716713, -0.08955883234739304, -0.036161087453365326, -0.087158203125, 0.059678561985492706, 0.016857163980603218, 0.06697124242782593, -0.005032267887145281, 0.05712773650884628, 0.07749050855636597, 0.04929034784436226, 0.06253214925527573, 0.029204025864601135, -0.019860433414578438, 0.014823093079030514, -0.04306436702609062, 0.02348729409277439, -0.09356991946697235, -0.08198145776987076, -2.9467367212987483e-08, -0.01876327209174633, -0.06427251547574997, 0.07911431789398193, -0.0053648026660084724, 0.04888508468866348, -0.05279901996254921, 0.04060422629117966, 0.043550241738557816, 0.004550447221845388, -0.03203287720680237, 0.07083055377006531, 0.008463581092655659, -0.09751981496810913, -0.05294552072882652, 0.05186621844768524, 0.08659244328737259, 0.0008172356756404042, 0.0642973855137825, -0.00388307380490005, -0.023416172713041306, -0.046311646699905396, 0.02963796630501747, 0.010218842886388302, 0.020772941410541534, 0.04458755627274513, -0.04007788002490997, 0.05479816719889641, 0.04072228819131851, 0.07015246152877808, -0.022143283858895302, 0.030061149969697, 0.020628970116376877, 0.06571151316165924, 0.01988377422094345, 0.01294533722102642, 0.04424102604389191, 0.06684625148773193, 0.04356534034013748, -0.06361537426710129, -0.07880405336618423, -0.10723861306905746, 0.01893141120672226, -0.03497105836868286, 0.008564125746488571, -0.07663160562515259, 0.018497368320822716, -0.009957153350114822, -0.12535400688648224, 0.031067658215761185, -0.032406605780124664, 0.09187261015176773, 0.014041942544281483, 0.0011317316675558686, 0.088828906416893, 0.060816336423158646, -0.03231645002961159, -0.004525318276137114, -0.052674587815999985, -0.015787506476044655, 0.039047688245773315, -0.03168902546167374, 0.09951267391443253, 0.004878591280430555, -0.032609302550554276 ] }, { "text": "```python\nclass LSTMClassifier(nn.Module):\n def __init__(self, vocab_size, embed_dim, hidden_size, num_classes):\n super().__init__()\n \n # Embedding layer for text\n self.embedding = nn.Embedding(vocab_size, embed_dim)\n \n # LSTM layer\n self.lstm = nn.LSTM(\n input_size=embed_dim,\n hidden_size=hidden_size,\n num_layers=2,\n batch_first=True,\n dropout=0.3,\n bidirectional=True # Process sequence both directions\n )\n \n # Output layer (bidirectional doubles hidden size)\n self.fc = nn.Linear(hidden_size * 2, num_classes)\n \n def forward(self, x):\n # x shape: [batch, seq_len] - token indices\n \n # Embed tokens", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_22", "embedding": [ -0.08092056214809418, -0.05246979743242264, 0.006542891263961792, 0.006425508297979832, -0.00391294714063406, 0.047108881175518036, -0.04433050751686096, 0.009465151466429234, -0.026315748691558838, -0.08776664733886719, 0.012345404364168644, -0.027771515771746635, -0.0038721009623259306, -0.07979536801576614, -0.07811414450407028, 0.06433399766683578, 0.018169565126299858, 0.02252797596156597, -0.02279038168489933, -0.025485670194029808, 0.10502467304468155, 0.0887102410197258, -0.0030529359355568886, 0.04688636213541031, 0.00543065695092082, -0.004844298120588064, -0.013397382572293282, 0.052801668643951416, 0.05736401677131653, -0.06699997186660767, 0.089178666472435, 0.05465413257479668, -0.052659694105386734, 0.05022145435214043, 0.0457434244453907, 0.060636989772319794, -0.0742911845445633, -0.032675325870513916, -0.0020672206301242113, 0.041018206626176834, 0.08229194581508636, -0.030673997476696968, 0.032433297485113144, 0.0040240115486085415, 0.07902264595031738, 0.06194482743740082, -0.01071949489414692, -0.02091471292078495, -0.02220880426466465, -0.05274973437190056, -0.014730963855981827, 0.0076788789592683315, -0.06259565055370331, 0.05049353837966919, -0.12258830666542053, 0.02504284866154194, 0.00962668564170599, 0.025363251566886902, -0.05546193569898605, -0.009309892542660236, -0.04135140776634216, -0.020340779796242714, 0.05193352699279785, -0.04333123937249184, -0.03456089645624161, -0.014290900900959969, -0.010972115211188793, 0.10715372860431671, 0.007654107641428709, 0.10405859351158142, -0.003997585736215115, 0.05842188745737076, -0.04779497906565666, 0.05370357632637024, 0.03270877152681351, -0.05203502997756004, 0.06959819793701172, 0.016216667369008064, 0.022604925557971, -0.08284960687160492, -0.012956143356859684, 0.00041397855966351926, 0.03772490471601486, 0.0023700243327766657, 0.06015003100037575, -0.08056378364562988, -0.003388618119060993, -0.000939643126912415, -0.02237868867814541, -0.028902782127261162, -0.010073869489133358, -0.03147163614630699, -0.08785948902368546, 0.011636986397206783, 0.01996268332004547, -0.011638034135103226, -0.035684455186128616, 0.04231591895222664, 0.012936729937791824, 0.030753714963793755, -0.023587999865412712, -0.0009488671785220504, -0.010573122650384903, 0.008355828933417797, 0.02395579032599926, 0.050565749406814575, 0.08161645382642746, -0.007470486685633659, 0.0636502355337143, -0.12301038205623627, -0.002990608336403966, -0.032489415258169174, 0.013748814351856709, -0.025925153866410255, 0.05526108667254448, -0.018691344186663628, 0.005388869903981686, -0.03225914388895035, 0.028944574296474457, 0.02948993816971779, -0.08279302716255188, 0.006321841850876808, -0.03651358559727669, -0.0023174812085926533, -0.08320539444684982, -0.043813277035951614, -0.02021993324160576, 6.69447779681536e-33, 0.0025965117383748293, -0.023436501622200012, -0.03343012183904648, -0.02303449809551239, 0.049112845212221146, 0.06660450994968414, 0.047953635454177856, -0.04895149543881416, -0.07239590585231781, 0.02565888874232769, -0.0697735846042633, -0.05053262040019035, -0.013802740722894669, 0.0493476502597332, -0.04109629988670349, -0.055109888315200806, -0.017386291176080704, 0.046539682894945145, -0.05479877442121506, -0.06366495043039322, 0.037806157022714615, 0.0362030491232872, -0.0029680451843887568, -0.11265783756971359, -0.03985228016972542, 0.014107774011790752, 0.0413755364716053, -0.10653918981552124, -0.06405497342348099, 0.025884587317705154, -0.07956185191869736, -0.018100393936038017, 0.07150093466043472, -0.049732428044080734, 0.036118026822805405, -0.013821900822222233, -0.005623504985123873, 0.027701307088136673, 0.05572054535150528, -0.13019074499607086, -0.06984186917543411, 0.05701260641217232, 0.030238518491387367, -0.039119187742471695, -0.14219042658805847, 0.007507446687668562, -0.02761256881058216, 0.0723479837179184, -0.039436858147382736, 0.011370752938091755, 0.08215155452489853, -0.07333996891975403, -0.03359561040997505, -0.05189737305045128, 0.05345403775572777, -0.07401049137115479, 0.017598655074834824, 0.12395031750202179, 0.034456610679626465, -0.005177576560527086, 0.031133268028497696, 0.07452716678380966, 0.012005578726530075, 0.0760640874505043, 0.0052978163585066795, 0.033881038427352905, 0.008070436306297779, -0.025057291612029076, 0.08743999153375626, -0.061435021460056305, -0.05444439500570297, -0.009903560392558575, -0.06566936522722244, -0.042090535163879395, 0.07678183168172836, -0.045898012816905975, -0.001690628589130938, -0.12376930564641953, -0.053340259939432144, 0.025357790291309357, 0.0017087568994611502, -0.016067354008555412, -0.024388611316680908, -0.08783452957868576, -0.03756043687462807, -0.0782826766371727, 0.0749022513628006, -0.07105560600757599, 0.012014356441795826, 0.024943016469478607, -0.07070203870534897, -0.1114380806684494, 0.05905073136091232, 0.016278984025120735, -0.00790701899677515, -7.161822759291623e-33, 0.04205524921417236, 0.13339152932167053, -0.026744095608592033, 0.024248886853456497, -0.025202831253409386, -0.007170179858803749, 0.017292127013206482, 0.08955073356628418, -0.018837744370102882, 0.05042297765612602, -0.030158869922161102, 0.03400235250592232, 0.03924867510795593, -0.020383385941386223, 0.05329945310950279, 0.012067697010934353, 0.0054037910886108875, 0.05682936683297157, 0.009872321970760822, -0.02220730483531952, -0.03967101499438286, 0.06180891394615173, -0.10914883762598038, 0.0769309252500534, -0.0675332248210907, 0.03793882578611374, 0.0051385508850216866, 0.12232834100723267, 0.030438097193837166, -0.06713802367448807, -0.0843067392706871, -0.0377914123237133, -0.0550185963511467, 0.03805273771286011, -0.06058018282055855, 0.030686236917972565, 0.027839895337820053, -0.03239385411143303, 0.027358876541256905, -0.001350962556898594, 0.11819002777338028, -0.0016632755286991596, -0.07418736815452576, 0.025273127481341362, -0.02989303320646286, 0.009162559174001217, -0.03813253343105316, -0.0018181835766881704, -0.018542487174272537, 0.022460903972387314, -0.04716748371720314, 0.010103702545166016, -0.03204997256398201, 0.040007151663303375, -0.030079152435064316, 0.00960472784936428, -0.03790760785341263, 0.02763484977185726, -0.025085831061005592, 0.006172416266053915, -0.004448203835636377, -0.03154315799474716, 0.0414121076464653, -0.0656454935669899, 0.0691787451505661, -0.008611194789409637, -0.04623565450310707, 0.05628827214241028, 0.015210919082164764, -0.029851507395505905, 0.06688482314348221, 0.12839075922966003, 0.026667235419154167, 0.008813541382551193, -0.03786880895495415, 0.005607308819890022, -0.07051786780357361, -0.0394844152033329, -0.04075652360916138, 0.02768712490797043, -0.08137889951467514, -0.019044069573283195, 0.06539901345968246, 0.07632356882095337, 0.03465593606233597, 0.04611850902438164, 0.08950300514698029, 0.1336943805217743, 0.032516900449991226, -0.036061275750398636, 0.05065057799220085, 0.01893339864909649, 0.03682878240942955, 0.1009216234087944, 0.04514644667506218, -6.147173792214744e-08, -0.08834336698055267, -0.047511644661426544, 0.024386994540691376, 0.061299119144678116, -0.04065984860062599, -0.015659229829907417, 0.028482766821980476, 0.03507886081933975, 0.0031354452949017286, -0.005642340052872896, 0.06905282288789749, -0.03147697448730469, -0.04314296320080757, -0.03592034801840782, 0.003154884558171034, 0.02702915109694004, -0.03159753605723381, -0.0075925798155367374, 0.008248158730566502, -0.0015374231152236462, -0.0033400640822947025, -0.03609061613678932, 0.027105825021862984, 0.04188062623143196, -0.07408010214567184, -0.07665351778268814, -0.023831680417060852, 0.023546066135168076, 0.016934039071202278, -0.03758624568581581, 0.05179295688867569, 0.049735624343156815, 0.03397813066840172, 0.04695703089237213, -0.05088711902499199, 0.10910563915967941, 0.004923532716929913, -0.007175153121352196, 0.023131515830755234, 0.015348970890045166, -0.08510532975196838, 0.05380001291632652, -0.07738225162029266, -0.010375604033470154, 0.054434191435575485, -0.00310494820587337, 0.028713539242744446, -0.14389654994010925, -0.012114857323467731, -0.014021877199411392, 0.0022483982611447573, -0.009965374134480953, -0.045198626816272736, 0.05283482372760773, 0.06035623326897621, -0.0422535166144371, -0.08359947800636292, 0.0348530188202858, -0.0032418551854789257, 0.03690352663397789, -0.09159783273935318, 0.032917413860559464, 0.02987218275666237, -0.012668314389884472 ] }, { "text": "def forward(self, x):\n # x shape: [batch, seq_len] - token indices\n \n # Embed tokens\n embedded = self.embedding(x) # [batch, seq_len, embed_dim]\n \n # LSTM forward pass\n lstm_out, (hidden, cell) = self.lstm(embedded)\n # lstm_out: [batch, seq_len, hidden_size*2]\n # hidden: [num_layers*2, batch, hidden_size]\n \n # Concatenate final hidden states from both directions\n hidden_cat = torch.cat([hidden[-2], hidden[-1]], dim=1)\n \n # Classification\n output = self.fc(hidden_cat)\n return output", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_23", "embedding": [ -0.014506818726658821, -0.09745810180902481, 0.003173386910930276, 0.08333753794431686, 0.025584213435649872, 0.07830718159675598, -0.02411237172782421, -0.008400727063417435, -0.056111931800842285, -0.08686026930809021, 0.03768472746014595, -0.053839582949876785, -0.035922013223171234, -0.053356822580099106, -0.020064759999513626, 0.06239813193678856, -0.008486487902700901, 0.03108936920762062, -0.04196436330676079, -0.06941912323236465, 0.05356881767511368, 0.02749100886285305, 0.04209209606051445, 0.06783393770456314, -0.02762783132493496, 0.02510460652410984, -0.007114284671843052, 0.002651243470609188, 0.04523967579007149, -0.04461831972002983, 0.07065502554178238, 0.019558070227503777, -0.10401482880115509, 0.05601745843887329, -0.014309084042906761, 0.0012912792153656483, -0.097727932035923, -0.013682504184544086, -0.028660377487540245, 0.008309864439070225, 0.06452620029449463, 0.0012455135583877563, 0.017198525369167328, -0.04586362466216087, 0.019410718232393265, 0.09741420298814774, 0.0345880389213562, -0.02063969522714615, -0.04817890003323555, -0.0515633262693882, 0.015379422344267368, 0.02061205357313156, -0.04607667773962021, 0.0755038931965828, -0.0832945927977562, -0.0027827126905322075, 0.030229885131120682, -0.007768680807203054, -0.06997580081224442, -0.0007187977898865938, 0.015063056722283363, -0.046868301928043365, 0.04548754543066025, -0.04573540762066841, -0.0115073686465621, -0.019122160971164703, -0.036621756851673126, 0.02719871513545513, 0.06531370431184769, 0.05169473588466644, 0.006422682199627161, 0.028431633487343788, -0.016384463757276535, -0.010102853178977966, 0.025759508833289146, -0.025702033191919327, 0.10756631940603256, 0.046548549085855484, -0.020498013123869896, -0.08874411135911942, 0.002775135450065136, 0.0036403227131813765, 0.06864545494318008, 0.015547236427664757, 0.04328376427292824, -0.026028677821159363, -0.04923827946186066, 0.036724403500556946, -0.06702008843421936, -0.019310137256979942, -0.01705251820385456, -0.07395677268505096, -0.029460784047842026, 0.007112534716725349, 0.02930140309035778, -0.036243993788957596, 0.03069508634507656, 0.02384389191865921, -0.039844077080488205, 0.01025812141597271, 5.305264130583964e-05, 0.012201409786939621, -0.011724158190190792, 0.056603845208883286, 0.051430635154247284, 0.07520438730716705, 0.03131388872861862, 0.012020963244140148, 0.054154686629772186, -0.06612392514944077, 0.07442869991064072, -0.01327517069876194, 0.011221591383218765, -0.029086997732520103, 0.036919474601745605, -0.048132698982954025, 0.011984879150986671, -0.0036535116378217936, 0.05987822264432907, 0.023153111338615417, -0.026848992332816124, 0.026063520461320877, 0.005279782693833113, 0.03657320514321327, -0.03537006676197052, -0.07273604720830917, -0.06609317660331726, 5.470298878085829e-33, 0.002592157805338502, -0.0003428300842642784, -0.10560472309589386, -0.04448574781417847, 0.02660338208079338, 0.09275487810373306, 0.08100131154060364, -0.039023660123348236, -0.06256338208913803, 0.051628656685352325, -0.07465112209320068, 0.006153372582048178, -0.009353013709187508, 0.052383918315172195, -0.08971124142408371, -0.0429551899433136, 0.02886495180428028, 0.038850538432598114, -0.026953576132655144, -0.09397248923778534, 0.03169125318527222, 0.05910531058907509, -0.0036305906251072884, -0.07530280202627182, -0.035866715013980865, 0.030105896294116974, -0.02198590524494648, -0.11866048723459244, -0.02542121708393097, 0.014857938513159752, -0.025355208665132523, 0.019985178485512733, 0.061132870614528656, -0.049344759434461594, 0.06706885993480682, -0.0084026288241148, -0.007123730145394802, 0.003981553018093109, 0.09888481348752975, -0.07522651553153992, -0.02295757457613945, 0.014434062875807285, 0.02290748432278633, -0.03264526277780533, -0.12547746300697327, -0.017576666548848152, -0.023092782124876976, 0.06210261210799217, -0.034584078937768936, -0.011304817162454128, 0.02658567950129509, -0.06331949681043625, -0.031730297952890396, -0.0892193615436554, 0.06270207464694977, -0.09506519138813019, 0.022243712097406387, 0.10647953301668167, 0.0713229849934578, -0.00040938283200375736, 0.03261398524045944, 0.10720860958099365, -0.04656711220741272, 0.0764862671494484, -0.051423732191324234, -0.004633663687855005, 0.008492954075336456, 0.008830681443214417, 0.03293319419026375, 0.022426258772611618, -0.06478890031576157, 0.06888538599014282, -0.037693675607442856, -0.0374021977186203, 0.046260517090559006, -0.0724819079041481, 0.011647270061075687, -0.11015313118696213, -0.03137168288230896, 0.019673340022563934, -0.026581890881061554, 0.006884692702442408, -0.06339232623577118, -0.009610993787646294, -0.02127491869032383, -0.03441358357667923, 0.022275006398558617, -0.05223914980888367, -0.028817560523748398, 0.029388243332505226, -0.07144472748041153, -0.08738298714160919, 0.08131668716669083, 0.01613764464855194, -0.06284356117248535, -6.185540170787158e-33, 0.013081096112728119, 0.15813082456588745, -0.04708412289619446, -0.01360227819532156, -0.04374302178621292, -0.01010960154235363, 0.010095363482832909, 0.058136843144893646, -0.05520562082529068, 0.06863148510456085, -0.05176307260990143, 0.048226311802864075, -0.013236084021627903, -0.016060030087828636, 0.03568914905190468, -0.001085759373381734, -0.015495731495320797, 0.021694833412766457, -0.011387050151824951, -0.03249906003475189, -0.08194940537214279, 0.08681921660900116, -0.13693416118621826, 0.08144199103116989, -0.07195010781288147, 0.03661597520112991, 0.05491093173623085, 0.08963193744421005, 0.009555059485137463, -0.08889079838991165, -0.04504050314426422, -0.05076594650745392, -0.0028635740745812654, -0.03796049952507019, -0.10180855542421341, 0.03644181787967682, -0.033668555319309235, -0.052243415266275406, 0.034347906708717346, -0.005179295781999826, 0.04470372572541237, 0.02244233340024948, -0.09891101717948914, 0.03350864350795746, -0.036491136997938156, 0.05659309774637222, -0.09441342204809189, 0.037262849509716034, -0.009149638935923576, 0.04035324230790138, -0.027576114982366562, -0.02705717459321022, -0.05766988918185234, -0.02150178886950016, -0.059553273022174835, -0.0018033902160823345, -0.03699793666601181, 0.040407828986644745, -0.021328240633010864, -0.0043259006924927235, 0.0005812604795210063, -0.07037394493818283, 0.12149307876825333, -0.05867861956357956, 0.03671623021364212, -0.006346043199300766, -0.042850200086832047, 0.0435054786503315, 0.0215658787637949, 0.004105256404727697, 0.10346855223178864, 0.13029254972934723, -0.001270317705348134, -0.0034099651966243982, 0.010137850418686867, 0.010138115845620632, -0.04868915304541588, -0.04452621191740036, 0.017391860485076904, -0.008925010450184345, -0.0469987653195858, -0.04033675044775009, 0.062102776020765305, 0.048372041434049606, 0.1128600463271141, 0.08153194189071655, 0.05072428286075592, 0.1377437859773636, -0.013054336421191692, -0.040925078094005585, 0.09263549745082855, -0.001647394965402782, 0.0794585794210434, 0.07276614010334015, 0.07508288323879242, -5.076842057860631e-08, -0.04596135392785072, -0.02707999385893345, 0.018843520432710648, 0.0406811386346817, -0.0633448138833046, 0.01595011167228222, 0.04025043174624443, 0.016322895884513855, -0.005044467747211456, -0.0466960109770298, 0.0546436607837677, -0.06165331229567528, -0.02675776556134224, 0.009322036057710648, 0.010324611328542233, 0.04742304980754852, -0.057438924908638, -0.020927611738443375, 0.010290258564054966, 0.05010031908750534, -0.06188708543777466, -0.03585761785507202, -0.02354586124420166, 0.025396212935447693, -0.05204015597701073, -0.06014036014676094, -0.022641904652118683, -0.012331629171967506, 0.0027177606243640184, -0.02264527976512909, 0.04813714325428009, 0.02353634685277939, 0.046725619584321976, 0.09963294863700867, -0.052297670394182205, 0.053926143795251846, -0.007541218306869268, -0.006022944580763578, -0.029736999422311783, 0.027054497972130775, -0.044139374047517776, 0.02965833619236946, -0.0164395272731781, 0.01359998993575573, -0.03238646313548088, -0.03399877995252609, 0.05298686400055885, -0.16239900887012482, -0.007471979130059481, 0.0007904746453277767, 0.04905172809958458, -0.011341264471411705, -0.03525318577885628, 0.1079498901963234, 0.06960538774728775, -0.050948575139045715, -0.058182332664728165, 0.046724241226911545, -0.01978244259953499, 0.05391440913081169, -0.04860838130116463, -0.007834351621568203, -0.014849387109279633, -0.0026994741056114435 ] }, { "text": "# Example: Text classification\nlstm_model = LSTMClassifier(vocab_size=10000, embed_dim=128, hidden_size=256, num_classes=3)\ntext_input = torch.randint(0, 10000, (16, 50)) # Batch=16, SeqLen=50\noutput = lstm_model(text_input)\nprint(f\"LSTM output shape: {output.shape}\") # [16, 3]\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_24", "embedding": [ 0.030437694862484932, -0.0720798671245575, -0.051311589777469635, 0.0631319060921669, 0.03615497425198555, 0.04309046268463135, -0.0032600255217403173, 0.038838304579257965, -0.05213504657149315, -0.09500245749950409, 0.03539668396115303, -0.04459887742996216, 0.008283445611596107, -0.071292944252491, -0.04671654477715492, 0.04786023125052452, -0.014873664826154709, -0.002151425927877426, -0.05248582735657692, -0.08644489198923111, 0.14805717766284943, 0.014436057768762112, 0.047840919345617294, 0.05223726108670235, -0.01011714618653059, -0.004235132597386837, -0.0022335152607411146, 0.07406341284513474, 0.03398917242884636, -0.006306009832769632, 0.0688374787569046, 0.03368295356631279, 0.0008599115535616875, 0.035979170352220535, 0.04346402361989021, -0.063899926841259, -0.13711406290531158, -0.08880068361759186, 0.025701163336634636, 0.03613220900297165, 0.058224789798259735, -0.054505206644535065, -0.013797473162412643, -4.525183976511471e-05, 0.05796179920434952, 0.03474687039852142, 0.020507078617811203, -0.03709124028682709, -0.06773430854082108, -0.00028394541004672647, 0.022407688200473785, 0.00043162208748981357, -0.07760071009397507, 0.07098962366580963, -0.12440162897109985, -0.02936382405459881, 0.022261004894971848, 0.01175200380384922, -0.031227054074406624, -0.07278530299663544, -0.03085429221391678, -0.019099459052085876, 0.02499162033200264, -0.03467724472284317, -0.0539792962372303, -0.012173805385828018, 0.03450942039489746, 0.06252454221248627, 0.03634127974510193, 0.030750367790460587, -0.0016624401323497295, 0.05417729914188385, 0.016642658039927483, 0.03594822436571121, 0.005281934514641762, -0.06130430847406387, 0.08121351152658463, 0.03230724111199379, 0.02542775310575962, -0.020330900326371193, -0.0636114627122879, 0.023072443902492523, 0.11911558359861374, 0.011353585869073868, 0.016848139464855194, 0.0012498249998316169, -0.0151547035202384, 0.08185125887393951, -0.044134996831417084, -0.03824131190776825, -0.01756678894162178, -0.05240694433450699, -0.08662166446447372, -0.007663543801754713, -0.0736691802740097, 0.005639988463371992, 0.055410075932741165, 0.026997651904821396, 0.0019912561401724815, -0.025698529556393623, -0.015450205653905869, -0.0331725999712944, 0.030938399955630302, 0.04143352434039116, 0.0021706230472773314, 0.07488041371107101, 0.04136268049478531, 0.009358211420476437, 0.0692826434969902, -0.08705372363328934, 0.07179389894008636, 0.020721955224871635, -0.0014460847014561296, -0.015897952020168304, 0.0860569104552269, -0.02492186240851879, -0.018379172310233116, -0.06849703192710876, 0.012215344235301018, 0.14410236477851868, -0.08448164165019989, 0.024006452411413193, -0.03838243708014488, 0.010222372598946095, -0.11596515029668808, -0.010556289926171303, -0.028775017708539963, 5.9392461862990565e-33, -0.0027489184867590666, 0.017121335491538048, -0.09464669227600098, -0.057460132986307144, 0.054077692329883575, 0.0667637512087822, 0.045844875276088715, -0.02193266898393631, -0.047751739621162415, 0.004381984937936068, -0.07417473196983337, -0.0674259141087532, 0.02504870668053627, 0.032205209136009216, -0.0830138772726059, -0.038657523691654205, -0.00592764699831605, 0.035930223762989044, -0.026430994272232056, -0.06393245607614517, 0.02227155677974224, 0.052402809262275696, 0.014520538970828056, -0.05064696446061134, -0.039174459874629974, 0.050489213317632675, 0.024949992075562477, -0.03791104629635811, -0.0489497035741806, 0.015502969734370708, -0.0433228425681591, 0.029424220323562622, 0.13412009179592133, -0.0774841159582138, 0.03878233581781387, -0.02957388013601303, 0.014151128008961678, 0.04388133063912392, 0.005086659453809261, -0.14352189004421234, -0.005221228580921888, 0.02600931189954281, 0.061919525265693665, -0.03748367354273796, -0.09546957910060883, 0.045649878680706024, -0.056089892983436584, 0.029464123770594597, 0.0021188256796449423, -0.00825144350528717, 0.059579864144325256, -0.037697456777095795, -0.006631721742451191, 0.0019506193930283189, 0.0617414265871048, -0.06002389267086983, -0.005797011777758598, 0.040496084839105606, 0.04963403940200806, -0.04133404418826103, 0.02895786054432392, 0.09489903599023819, 0.019099866971373558, 0.04654727876186371, 0.005987318232655525, 0.015400884672999382, 0.03289996460080147, -0.015495078638195992, 0.017698775976896286, 0.000277117476798594, -0.06406145542860031, -0.02006663754582405, -0.07631233334541321, 0.00978873111307621, 0.008022904396057129, -0.02861350029706955, 0.03312816098332405, -0.10599178075790405, -0.0997929498553276, 0.10209618508815765, 0.011028272099792957, 0.006667550187557936, 0.00807789247483015, -0.11247002333402634, -0.03350703790783882, -0.07083429396152496, 0.0627288669347763, -0.09730131179094315, 0.03795313462615013, -0.026019126176834106, -0.11937625706195831, -0.08935486525297165, 0.08680654317140579, -0.0294576995074749, -0.043768033385276794, -6.66583099948582e-33, -0.03303086385130882, 0.08423200994729996, -0.023504028096795082, 0.021979980170726776, -0.015085713937878609, -0.015811502933502197, -0.024513399228453636, 0.04912681132555008, -0.06012395769357681, 0.029633091762661934, -0.00128301908262074, 0.015572368167340755, -0.009540059603750706, -0.06553839147090912, 0.05335921049118042, -0.03743862360715866, -0.01443851925432682, 0.0019163148244842887, 0.03761446475982666, 0.037662114948034286, 0.016804039478302002, 0.0120403952896595, -0.08413305133581161, 0.056135646998882294, -0.08170913904905319, 0.022637564688920975, 0.047836873680353165, 0.06234999746084213, 0.05276428908109665, -0.0766739696264267, -0.050687242299318314, -0.033605899661779404, -0.019070668146014214, 0.06753290444612503, -0.11225905269384384, 0.014288613572716713, 0.058928489685058594, -0.0552094392478466, 0.06121717765927315, 0.008362173102796078, 0.08528918027877808, 0.0018565807258710265, -0.066889688372612, 0.02670079842209816, -0.0687699019908905, 0.022669034078717232, -0.04526745155453682, -0.013148385100066662, 0.0408039316534996, -0.038976602256298065, 0.018738802522420883, -0.04241817817091942, -0.06351771950721741, 0.0497046560049057, -0.02176043577492237, -0.05061860382556915, -0.10426279902458191, 0.017699016258120537, -0.045555487275123596, 0.04254354164004326, -0.03194529190659523, -0.027975212782621384, 0.001690088422037661, -0.03654533252120018, 0.0383194163441658, 0.0010986891575157642, -0.014545253477990627, 0.039971016347408295, 0.015266991220414639, 0.041664931923151016, 0.09857649356126785, 0.13091139495372772, -0.03320617228746414, 0.09544949233531952, -0.06897434592247009, -0.01645597815513611, -0.09498302638530731, 0.006137933116406202, -0.06600000709295273, -0.02544228546321392, 0.02513677440583706, -0.011655972339212894, 0.03643206134438515, 0.07441432029008865, 0.03208063915371895, 0.050831060856580734, 0.016934921965003014, 0.09388130903244019, 0.02858232706785202, -0.05353333055973053, 0.038073182106018066, 0.021010540425777435, 0.07600340992212296, 0.09850682318210602, 0.04330587759613991, -5.115202839078847e-08, -0.01577266864478588, -0.039176203310489655, 0.013688363134860992, 0.0615067295730114, -0.06913883984088898, 0.02419448271393776, 0.011634308844804764, -0.012967870570719242, 0.02268534153699875, -0.007892060093581676, 0.0759401023387909, -0.07232999056577682, -0.05002477765083313, -0.044179853051900864, 0.032577913254499435, 0.028752952814102173, -0.015231415629386902, 0.04776686429977417, 0.07352791726589203, -0.01186380349099636, 0.03671415150165558, -0.03489890694618225, 0.02427213452756405, -0.016510527580976486, -0.00365198845975101, -0.0648215040564537, -0.025217218324542046, 0.08419837802648544, -0.034813977777957916, -0.03128236159682274, 0.034238435328006744, 0.017756320536136627, 0.015902496874332428, 0.028943276032805443, -0.0018074155086651444, 0.0071433852426707745, -0.03013167716562748, -0.029990898445248604, 0.006328584160655737, 0.03606924042105675, -0.0007775082485750318, 0.032948099076747894, -0.023731304332613945, -0.02021717093884945, -0.052374619990587234, -0.04053552821278572, 0.06308306753635406, -0.16675308346748352, 0.05582131817936897, 0.011750622652471066, 0.02571108005940914, 0.01524193026125431, -0.03796237334609032, 0.04426216706633568, -0.015114519745111465, -0.05179325491189957, 0.007704650517553091, 0.0691920593380928, -0.026470236480236053, -0.02794160693883896, -0.02992844209074974, 0.005594970192760229, -0.018221508711576462, -0.025221336632966995 ] }, { "text": "### GRU (Gated Recurrent Unit)\n\nGRUs are a simpler alternative to LSTMs with fewer parameters.\n\n```python\nclass GRUModel(nn.Module):\n def __init__(self, input_size, hidden_size, output_size, num_layers=2):\n super().__init__()\n \n self.gru = nn.GRU(\n input_size=input_size,\n hidden_size=hidden_size,\n num_layers=num_layers,\n batch_first=True,\n dropout=0.2\n )\n \n self.fc = nn.Linear(hidden_size, output_size)\n \n def forward(self, x):\n output, hidden = self.gru(x)\n # Use last time step output\n return self.fc(output[:, -1, :])", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_25", "embedding": [ -0.04246727004647255, -0.11326208710670471, -0.04375419765710831, 0.013627724722027779, -0.030755341053009033, 0.04126233607530594, -0.026597514748573303, -0.003933961037546396, -0.01651187613606453, -0.09517708420753479, 0.04707363620400429, -0.009895146824419498, 0.007432185113430023, -0.06707253307104111, -0.04875221103429794, 0.00506054051220417, -0.046743519604206085, 0.012467347085475922, 0.06875892728567123, -0.1311035454273224, 0.049504928290843964, 0.041043657809495926, -0.015202575363218784, 0.052734777331352234, -0.015638766810297966, -0.018946250900626183, -0.031182684004306793, 0.007278317119926214, 0.06467016786336899, -0.10738054662942886, 0.06978800147771835, 0.07480492442846298, -0.03211652487516403, 0.029709413647651672, -0.03592418134212494, 0.0642089769244194, -0.06511950492858887, -0.026583081111311913, -0.031225567683577538, 0.0037081281188875437, 0.07504276186227798, 0.019602473825216293, 0.02863720990717411, -0.046780671924352646, 0.04562671110033989, 0.051141828298568726, 0.04636940360069275, -0.019878193736076355, -0.01713729463517666, 0.008095434866845608, 0.05595562979578972, 0.08046961575746536, 0.04163721576333046, 0.035066451877355576, 0.00508937519043684, -0.0004990916349925101, 0.0563303679227829, -0.01090316753834486, -0.07051247358322144, -0.020435281097888947, -0.07057459652423859, 0.009679121896624565, -0.027353502810001373, -0.07190758734941483, -0.02554914727807045, 0.021560080349445343, 0.016369005665183067, 0.013052896596491337, 0.03686393052339554, 0.12090058624744415, 0.0057276044972240925, -0.006418304052203894, 0.04826587811112404, 0.021110374480485916, -0.00418497808277607, -0.04612914100289345, 0.09678608179092407, -0.006348298862576485, -0.033880773931741714, 0.006677743513137102, 0.032172828912734985, 0.04240858927369118, 0.004279522690922022, -0.03756098449230194, 0.024453572928905487, -0.08178580552339554, 0.015883680433034897, 0.05149821192026138, 0.03705156221985817, -0.07403415441513062, -0.012104167602956295, -0.07170271873474121, -0.02474384941160679, 0.01835918053984642, 0.015147902071475983, 0.07252142578363419, -0.029760096222162247, -0.03035641275346279, -0.0003916635178029537, -0.007054141256958246, -0.00943036563694477, -0.0010704686865210533, -0.0033253617584705353, 0.02002173475921154, 0.007027070038020611, 0.07659636437892914, 0.0285046249628067, 0.07000768929719925, -0.009286035783588886, -0.050255488604307175, 0.011790545657277107, -0.01769902929663658, 0.044734060764312744, 0.05540331080555916, 0.11399715393781662, -0.06835900992155075, 0.07724211364984512, -0.034913573414087296, -0.003096122294664383, 0.03866513818502426, -0.02631778083741665, 0.014609003439545631, -0.0553617998957634, -0.00920195784419775, -0.03640115261077881, -0.02521563693881035, 0.022151997312903404, 4.1697862949497754e-33, -0.015923352912068367, -0.0008439472294412553, -0.03426745906472206, -0.0688999742269516, 0.03181217238306999, 0.10318046063184738, 0.0720420628786087, -0.021895788609981537, -0.0012662800727412105, 0.029695209115743637, -0.09641195088624954, 0.008769187144935131, -0.07042691856622696, 0.02102511003613472, -0.07602577656507492, -0.02056875266134739, 0.03648083657026291, 0.03307783976197243, 0.016902927309274673, -0.09977608174085617, 0.013123993761837482, 0.01661885529756546, -0.0073540392331779, -0.11505592614412308, 0.014009328559041023, -0.029902208596467972, 0.034741949290037155, -0.08147379755973816, -0.026873372495174408, -0.02747136726975441, -0.0663546696305275, 0.005792191252112389, -0.00295839156024158, -0.02186921052634716, 0.04214546084403992, -0.033126652240753174, 0.05768848955631256, 0.04541979730129242, 0.06582069396972656, -0.10933537036180496, -0.05807080119848251, 0.02960861288011074, 0.04740824177861214, 0.021454399451613426, -0.11033429950475693, -0.04824397340416908, -0.008553944528102875, 0.06755390763282776, -0.028382567688822746, -0.023372769355773926, 0.06934912502765656, -0.01102412398904562, -0.07456817477941513, -0.10077349096536636, 0.005067937541753054, -0.06832298636436462, 0.05359979346394539, 0.12396866083145142, 0.056109245866537094, 0.020244793966412544, 0.06229066476225853, 0.04496464878320694, -0.012525508180260658, 0.054464492946863174, 0.010548636317253113, 0.0021012865472584963, 0.0011925589060410857, 0.03686416894197464, 0.021200481802225113, 0.0005035969079472125, -0.05810001492500305, 0.007559206336736679, -0.03364766389131546, -0.0312363151460886, 0.06856785714626312, -0.06447524577379227, 0.07004264742136002, -0.15420128405094147, -0.031836289912462234, 0.02072443813085556, 0.0196012444794178, 0.0305030457675457, -0.05083991959691048, -0.0203083585947752, 0.031910017132759094, -0.04121111333370209, 0.04423603042960167, -0.018852755427360535, -0.03098352998495102, -0.05120603367686272, -0.08331122994422913, -0.041629042476415634, 0.10549124330282211, 0.05136210471391678, -0.0871291533112526, -4.426308549657969e-33, 0.0828767642378807, 0.07353595644235611, 0.08058296144008636, 0.02544865943491459, 0.027465200051665306, -0.042732927948236465, -0.0194777213037014, 0.08746441453695297, -0.01197761856019497, 0.05373583361506462, -0.03581182658672333, 0.015783054754137993, 0.028682155534625053, 0.026396356523036957, 0.08088064938783646, -0.0006882937159389257, 0.044581037014722824, -0.04145114868879318, -0.021121002733707428, -0.0605950690805912, -0.024497922509908676, 0.06784190237522125, -0.09223951399326324, -0.02185913920402527, -0.050389863550662994, -0.004452374763786793, 0.01707770675420761, 0.10871881246566772, 0.017141442745923996, -0.05149783939123154, -0.06145796924829483, -0.05155434459447861, -0.01855754479765892, 0.02360351011157036, -0.03694519028067589, 0.047836191952228546, 0.02177920565009117, -0.0016169208101928234, -0.0036985105834901333, 0.001554683898575604, 0.06222296878695488, 0.043732378631830215, 0.02413131110370159, 0.009529570117592812, 0.007539975922554731, 0.048167601227760315, -0.07935034483671188, 0.02221406251192093, -0.06204853951931, 0.05333826690912247, -0.055255740880966187, 0.012515261769294739, -0.05307074636220932, -0.023203665390610695, -0.028861206024885178, -0.020847409963607788, -0.06362336128950119, -0.009446474723517895, -1.7736050722305663e-05, -0.02324000559747219, -0.06207430735230446, -0.10467110574245453, 0.017470519989728928, -0.07978881150484085, 0.013371954672038555, 0.032929711043834686, -0.0176829993724823, 0.020610181614756584, -0.022777875885367393, 0.010066538117825985, 0.07353685796260834, 0.07701414823532104, -0.008851912803947926, 0.05104011669754982, -0.07608684152364731, -0.018412331119179726, -0.08335795253515244, -0.09172531962394714, 0.015913134440779686, -0.021534839645028114, -0.03827100992202759, -0.008554846048355103, -0.0008470567408949137, 0.08061923831701279, 0.02214086428284645, 0.055776942521333694, 0.06551437824964523, 0.13725891709327698, 0.0891474038362503, -0.04237509146332741, 0.05665814131498337, -0.002117257798090577, 0.0526527464389801, 0.036182280629873276, 0.043093241751194, -4.930232222477571e-08, -0.053859222680330276, -0.020463120192289352, 0.044626761227846146, 0.047398220747709274, 0.015449774451553822, -0.036868538707494736, 0.04663585498929024, -0.015154175460338593, 0.0818905159831047, -0.10400902479887009, 0.0866171270608902, -0.00844206940382719, -0.02383512444794178, -0.011452185921370983, -0.015920547768473625, 0.09565462172031403, 0.02181720733642578, -0.04697559028863907, 0.04576655477285385, -0.01945343054831028, -0.0073702833615243435, -0.011188957840204239, -0.020061137154698372, 0.057370491325855255, -0.06846987456083298, -0.044587407261133194, -0.001612923457287252, -0.016775956377387047, -0.03096458874642849, -0.007519121747463942, 0.03643195703625679, 0.04015294834971428, 0.03900127112865448, 0.13788025081157684, -0.043474067002534866, 0.03738349303603172, 0.027904503047466278, 0.08449139446020126, -0.004612618125975132, 0.007299658842384815, -0.08283939212560654, 0.015011326409876347, -0.09678493440151215, -0.01539143268018961, -0.09882200509309769, -0.013706174679100513, -0.06213664636015892, -0.14407722651958466, 0.0028702588751912117, 0.009919089265167713, 0.04545068368315697, -0.052416905760765076, 0.050131656229496, 0.032906219363212585, 0.04059641435742378, -0.05808382108807564, -0.07718762755393982, -0.06396670639514923, 0.024790743365883827, 0.05462723597884178, -0.10608923435211182, 0.03157278895378113, -0.01301991194486618, 0.046047959476709366 ] }, { "text": "# Time series prediction\ngru = GRUModel(input_size=1, hidden_size=64, output_size=1)\ntime_series = torch.randn(32, 100, 1) # 100 time steps\nprediction = gru(time_series)\nprint(f\"GRU prediction shape: {prediction.shape}\") # [32, 1]\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_26", "embedding": [ -0.058437004685401917, -0.05256424844264984, -0.048974085599184036, 0.029419640079140663, 0.0345306433737278, -0.042540233582258224, -0.02500833198428154, 0.016752567142248154, -0.03353690728545189, -0.11127958446741104, -0.00811519380658865, -0.03987203165888786, -0.07876596599817276, -0.02467856928706169, -0.05101362243294716, -0.08101309090852737, -0.14971452951431274, -0.0595126673579216, 0.05621181055903435, -0.10921338200569153, 0.12300368398427963, -0.027768289670348167, 0.030613483861088753, 0.05387371778488159, -0.002155180322006345, 0.044837746769189835, 0.02632950246334076, 0.07957769930362701, 0.015374896116554737, -0.012599076144397259, 0.03971943259239197, 0.056481655687093735, -0.020040173083543777, -0.0019500809721648693, -0.005096442066133022, -0.03431049734354019, -0.05886707827448845, 0.009745466522872448, 0.02535812370479107, 0.03656047582626343, 0.002330261981114745, -0.01024649664759636, 0.0164890605956316, 0.013433314859867096, 0.035029035061597824, 0.036361221224069595, 0.08748432248830795, -0.03709627687931061, -0.0601966455578804, 0.029219625517725945, 0.04552052170038223, 0.023999718949198723, -0.0063506076112389565, -0.008902540430426598, 0.06513077765703201, -0.014939125627279282, 0.05803916975855827, -0.09758379310369492, 0.011261167004704475, -0.13669461011886597, -0.03676949813961983, -0.025588002055883408, -0.02119755744934082, -0.07800073176622391, -0.027044743299484253, 0.005486203823238611, -0.030513722449541092, -0.03097122348845005, -0.0009828162146732211, 0.021891532465815544, 0.010337574407458305, 0.05776070058345795, 0.02471274882555008, 0.009561138227581978, -0.021633131429553032, 0.017264578491449356, 0.06423962116241455, 0.03858146443963051, 0.011807754635810852, -0.024971306324005127, -0.03921908512711525, 0.035011231899261475, 0.0647742822766304, 0.018186001107096672, 0.016143616288900375, 0.00789757538586855, 0.08947433531284332, 0.0480986088514328, 0.011076788417994976, -0.08100472390651703, 0.008605938404798508, -0.08345457166433334, -0.03879827260971069, -0.01170374732464552, -0.04280807450413704, 0.10659225285053253, 0.041540343314409256, -0.11362773925065994, -0.005065101198852062, 0.010807132348418236, -0.021303601562976837, -0.030944159254431725, 0.0704769715666771, 0.06028887629508972, -0.013083862140774727, 0.05543007701635361, 0.030837232246994972, 0.09863258898258209, 0.014080552384257317, 0.023234667256474495, 0.023674562573432922, 0.03171287477016449, 0.052225008606910706, 0.038478784263134, 0.09126347303390503, -0.06516928225755692, -0.026613643392920494, 0.027442507445812225, -0.07245893031358719, 0.13156133890151978, -0.01618032716214657, 0.06354746222496033, -0.030933471396565437, 0.04813940078020096, -0.07836185395717621, -0.041986554861068726, 0.034033335745334625, 2.6341311279530933e-33, -0.02985803782939911, 0.00689316401258111, -0.06559953838586807, -0.049266744405031204, 0.007515082601457834, 0.07005614042282104, -0.013464503921568394, -0.03939910605549812, 0.04250531643629074, 0.024984974414110184, -0.1242622584104538, 0.04060465469956398, -0.0595296211540699, 0.03442429006099701, -0.0951259657740593, 0.02376192808151245, 0.06465968489646912, 0.04232754558324814, 0.01697048544883728, -0.07210758328437805, 0.05516492947936058, 0.025525381788611412, -0.026767387986183167, -0.09218396991491318, -0.03380315378308296, 0.038131073117256165, -0.0022374677937477827, -0.03405982628464699, -0.04222012683749199, -0.0268109031021595, 0.021206103265285492, -0.01864505559206009, 0.03215734660625458, -0.0031192435417324305, 0.05983231961727142, -0.04458453506231308, 0.09449899941682816, 0.031041331589221954, -0.01496502198278904, -0.09151056408882141, 0.047946423292160034, 0.020286595448851585, 0.052826933562755585, -0.032787151634693146, -0.0325610376894474, 0.007091391831636429, -0.008728528395295143, 0.07402641326189041, -0.0017404832178726792, 0.007733069825917482, 0.012635569088160992, -0.005540925078094006, -0.029683366417884827, -0.0228596031665802, 0.005828790366649628, -0.03623226657509804, 0.09000501781702042, 0.018324116244912148, 0.08722706884145737, -0.11187919229269028, 0.02831738069653511, 0.07965406775474548, 0.04653891548514366, -0.051433976739645004, -0.05371392145752907, -0.017272748053073883, 0.006318880710750818, 0.04817298799753189, 0.014375204220414162, 0.06231086701154709, -0.0692034512758255, 0.03471098095178604, -0.03720276057720184, -0.035368405282497406, -0.004660706967115402, -0.05276268348097801, 0.02875949628651142, -0.1503433734178543, -0.04631081968545914, 0.04869484528899193, -0.06488267332315445, 0.013757252134382725, -0.02107693813741207, -0.10721088945865631, -0.014849774539470673, -0.05957547575235367, -0.005434826016426086, 0.002502093557268381, -0.08486003428697586, -0.06619779020547867, -0.1523548662662506, -0.01533628161996603, 0.06614488363265991, 0.03221325948834419, -0.06741375476121902, -3.5257733477525536e-33, -0.0023738383315503597, 0.03334641829133034, 0.1148759201169014, -0.018418502062559128, 0.025763891637325287, 0.002563686575740576, -0.027201101183891296, 0.001266899169422686, -0.01136533822864294, 0.03817804902791977, -0.0073297456838190556, -0.06367693096399307, 0.013587764464318752, 0.002735026180744171, 0.08354093134403229, 0.0014928980963304639, 0.016002144664525986, -0.015460588037967682, -0.02434762381017208, -0.04612412676215172, -0.06654594093561172, 0.003633007640019059, -0.1285429149866104, -0.012827065773308277, -0.08066999167203903, 0.024168625473976135, 0.13304434716701508, 0.04965328797698021, -0.03682297095656395, -0.03836824744939804, -0.060578763484954834, -0.08792842924594879, -0.03638312593102455, 0.08435487747192383, -0.04114006459712982, 0.021179161965847015, 0.09849605709314346, -0.0076920161955058575, -0.02979196421802044, -0.06894848495721817, 0.054207198321819305, 0.08751147240400314, -0.01711593009531498, 0.06361467391252518, -0.031792160123586655, 0.022148357704281807, 0.01810571365058422, 0.0461738258600235, 0.01781138963997364, 0.03431737795472145, 0.011895453557372093, -0.017949415370821953, -0.07739312201738358, 0.024114634841680527, -0.0018714203033596277, 0.014200788922607899, -0.024617692455649376, -0.019092118367552757, -0.07486137747764587, 0.051892559975385666, -0.04202704131603241, -0.07752373069524765, 0.008832086808979511, 0.025374161079525948, 0.00973372720181942, 0.019884493201971054, -0.05952572077512741, 0.01924486644566059, 0.02680950053036213, 0.061238884925842285, 0.06326349824666977, 0.12168841063976288, 0.008318576030433178, 0.03874990716576576, 0.0027451554778963327, -0.009767167270183563, 0.021456221118569374, 0.012606492266058922, 0.05585372820496559, -0.05760796740651131, -0.036967504769563675, 0.00440938537940383, -0.01174122653901577, 0.044524386525154114, -0.0021052267402410507, 0.012752430513501167, 0.040472082793712616, 0.10328704863786697, 0.06490949541330338, -0.06459004431962967, 0.04005012288689613, 0.016835322603583336, 0.07988963276147842, -0.00012670383148360997, 0.04199027270078659, -3.6198297692635606e-08, -0.0264186542481184, -0.012034469284117222, 0.047052979469299316, 0.019989676773548126, -0.016989421099424362, 0.05177431181073189, 0.01908102072775364, -0.04491711035370827, 0.03770823031663895, -0.06413896381855011, 0.13431912660598755, -0.06328527629375458, -0.04913143068552017, 0.019448816776275635, 0.05842587351799011, 0.08948645740747452, 0.004598384723067284, 0.030346598476171494, 0.018492262810468674, -0.054091036319732666, 0.026359548792243004, -0.06381000578403473, -0.008391877636313438, 0.015177830122411251, -0.04109965264797211, -0.06622391939163208, -0.036552369594573975, 0.019096968695521355, -0.08545532077550888, 0.02846533991396427, 0.05190534144639969, -0.0002581550506874919, 0.02540900744497776, 0.03131607174873352, 0.014957261271774769, -0.006389372516423464, -0.010636977851390839, 0.10157231986522675, 0.03392474353313446, 0.06653710454702377, -0.02169467881321907, 0.013018873520195484, -0.0635060966014862, -0.04260396957397461, -0.027822833508253098, -0.0032296685967594385, -0.0010785773629322648, -0.09465968608856201, 0.03604729473590851, 0.08328131586313248, 0.044209327548742294, -0.007543167099356651, 0.04490043967962265, 0.02606741152703762, 0.003822741098701954, -0.019075455144047737, -0.029913922771811485, -0.03914859518408775, -0.037626661360263824, -0.005924221593886614, -0.003074520966038108, -0.05399908497929573, -0.06224960461258888, 0.025930223986506462 ] }, { "text": "## Attention Mechanisms\n\nAttention allows models to focus on relevant parts of the input when making predictions. It's the foundation of modern architectures like Transformers.", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_27", "embedding": [ 0.0321076475083828, -0.05127961188554764, -0.0037082284688949585, 0.043149299919605255, 0.10736894607543945, 0.05291528254747391, 0.03625399246811867, 0.045297738164663315, 0.1192416250705719, -0.004519743844866753, -0.009871324524283409, 0.029610272496938705, -0.004455571994185448, -0.01929517462849617, -0.017959190532565117, -0.005015124101191759, 0.06025702506303787, -0.06554846465587616, -0.09871399402618408, -0.058553602546453476, 0.1078803539276123, 0.0018073167884722352, 0.02554207667708397, 0.009111421182751656, -0.0416116937994957, 0.012643460184335709, -0.08140526711940765, -0.06265915185213089, 0.04981755465269089, -0.020921776071190834, 0.017612243071198463, 0.036489833146333694, 0.06870925426483154, 0.03720125928521156, -0.13377179205417633, 0.05531856417655945, -0.0932965949177742, -0.020798593759536743, -0.0256819948554039, -0.05939309671521187, -0.04317439720034599, -0.04407919943332672, 0.012468117289245129, 0.06708700209856033, 0.042735643684864044, 0.007730008568614721, -0.0023599453270435333, -0.030809616670012474, -0.044043175876140594, -0.08296164870262146, -0.11082108318805695, -0.10910072177648544, 0.03424852341413498, -0.028397606685757637, -0.024258874356746674, 0.03926771879196167, -0.005753394216299057, -0.007452839054167271, 0.00319887837395072, -0.04018834978342056, -0.07128149271011353, -0.012987456284463406, -0.03735312819480896, -0.0678512379527092, 0.058006007224321365, 0.002626539906486869, 0.03913525864481926, -0.03652830421924591, -0.05813972279429436, -0.021511444821953773, 0.06398119032382965, 0.04866565018892288, 0.072186678647995, -0.08850803971290588, 0.1523873507976532, 0.06980025768280029, 0.006386641878634691, -0.02550763078033924, 0.06040076166391373, -0.019979791715741158, -0.003011474385857582, -0.07990740239620209, 0.0173391904681921, -0.00514897471293807, 0.05506804585456848, 0.030397139489650726, 0.0017220464069396257, -0.03184648975729942, -0.01084255799651146, 0.007890771143138409, -0.03577554598450661, -0.17233729362487793, 0.00219789263792336, 0.009850826114416122, 0.005108578130602837, 0.018458280712366104, 0.0260247141122818, -0.03415268287062645, -0.08838265389204025, -0.027168752625584602, 0.02277873270213604, 0.01905687153339386, 0.06432273983955383, 0.004323824308812618, 0.00353308767080307, -0.023331768810749054, 0.10064736008644104, 0.028998907655477524, 0.015024933964014053, -0.07217442244291306, -0.00023709448578301817, -0.0009533718111924827, -0.015256159007549286, -0.05217228829860687, 0.034595128148794174, -0.09243851155042648, 0.0033832653425633907, -0.019069727510213852, 0.019705548882484436, -0.012737101875245571, 0.05502226948738098, -0.002049329224973917, -0.0648549348115921, -0.0053137741051614285, 0.08760721981525421, -0.031210200861096382, -0.11426708847284317, -1.1750737442498839e-33, 0.011343060992658138, 0.00645324494689703, 0.012439933605492115, 0.059209197759628296, 0.00229782541282475, -0.011261245235800743, -0.033457979559898376, -0.03135225176811218, 0.021620532497763634, 0.024844791740179062, -0.017161864787340164, 0.03207947313785553, -0.016346869990229607, 0.1020197942852974, 0.017442235723137856, -0.07583285123109818, -0.015050802379846573, 0.08524678647518158, -0.08213765919208527, 0.021830540150403976, -0.014658053405582905, 0.03686504438519478, 0.00687082065269351, -0.06618078052997589, -0.018698355183005333, 0.13109451532363892, -0.011082329787313938, -0.026512689888477325, -0.052289947867393494, 0.015096578747034073, -0.09216126054525375, 0.10277408361434937, -0.057205237448215485, 0.0011402206728234887, -0.017092375084757805, -0.0478065051138401, 0.010938562452793121, -0.043590497225522995, 0.09355214983224869, -0.043363168835639954, 0.02620108611881733, 0.07131943851709366, -0.06767463684082031, -0.011304102838039398, -0.02469203993678093, 0.02313155122101307, 0.01705598458647728, 0.09135599434375763, -0.02574731782078743, 0.03299025818705559, 0.04256177321076393, 0.036885056644678116, -0.03571905195713043, -0.0814301073551178, 0.031221650540828705, 0.029536614194512367, 0.06088864803314209, 0.03535185381770134, 0.030171703547239304, 0.02051439881324768, 0.0036716365721076727, -0.010304887779057026, 0.024465737864375114, 0.029283737763762474, 0.026873400434851646, 0.031554579734802246, -0.018753299489617348, 0.05356451869010925, 0.04330454021692276, 0.07506241649389267, -0.05152425915002823, 0.07159274071455002, -0.034324679523706436, 0.053449418395757675, -0.014840185642242432, 0.0004855143488384783, 0.006495456676930189, -0.05844580754637718, 0.05180486664175987, 0.010864920914173126, -0.01163687277585268, -0.021289076656103134, -0.04711000248789787, -0.0009351218468509614, -0.013886638917028904, 0.040521517395973206, 0.013777939602732658, -0.061280932277441025, -0.07430659234523773, -0.013940326869487762, 0.043371204286813736, -0.008253255859017372, -0.027918418869376183, 0.016149450093507767, -0.09247097373008728, 2.108258531338129e-34, -0.023067472502589226, 0.017519298940896988, -0.10417483001947403, 0.0031308126635849476, -0.035769641399383545, -0.04269557073712349, -0.0192615557461977, -0.04872679337859154, -0.01287543959915638, 0.0187760591506958, 0.04558641090989113, -0.050593696534633636, -0.04763465002179146, -0.0028917305171489716, -0.022970430552959442, -0.04792303964495659, 0.001055884757079184, -0.07408580183982849, -0.07669196277856827, -0.00785939209163189, 0.05191250145435333, 0.02789304219186306, -0.040537551045417786, -0.006719995755702257, -0.07202737033367157, 0.038459572941064835, -0.06800654530525208, 0.07661744207143784, 0.054552141577005386, -0.0546867735683918, -0.10918942838907242, 0.020085619762539864, 0.07508955895900726, -0.009669402614235878, -0.01389352697879076, 0.03362957760691643, 0.0359005331993103, 0.000939004763495177, 0.01863958314061165, 0.046752989292144775, 0.060095448046922684, -0.026573022827506065, 0.018076853826642036, 0.03174688667058945, -0.05343770980834961, 0.03351563215255737, 0.014994428493082523, -0.017826836556196213, -0.03536572307348251, 0.005963361822068691, 0.013042188249528408, -0.0009982859482988715, -0.05741005390882492, -0.07523680478334427, -0.12282001972198486, 0.04691720008850098, -0.02304605022072792, -0.02054138109087944, 0.08163190633058548, -0.0042211515828967094, -0.006558331660926342, 0.012540443800389767, -0.012033100239932537, -0.02539333887398243, -0.005994546692818403, 0.008768655359745026, -0.026164855808019638, -0.09472005069255829, 0.11751493811607361, -0.020941752940416336, 0.11394331604242325, 0.034038543701171875, 0.016281086951494217, 0.026280570775270462, -0.06341639906167984, 0.006920667830854654, -0.0006131254485808313, -0.029455499723553658, 0.025079835206270218, -0.036290112882852554, -0.04161548614501953, -0.0009412647923454642, 0.024254685267806053, -0.021260853856801987, 0.012924090027809143, 0.09019365161657333, 0.08095674216747284, 0.03902392089366913, -0.04588529095053673, -0.058959443122148514, -0.07856910675764084, 0.06525889784097672, -0.009073609486222267, 0.08463968336582184, -0.11624401062726974, -2.741373350545473e-08, -0.0832427591085434, -0.025907671079039574, 0.015771783888339996, 0.015912041068077087, 0.011213972233235836, -0.047881126403808594, 0.007752529811114073, 0.10913728922605515, -0.03790483623743057, 0.030599618330597878, -0.006074319127947092, 8.217948925448582e-05, -0.001051435829140246, 0.04033224657177925, 0.14727099239826202, 0.055047597736120224, 0.03876834362745285, 0.01094502117484808, -0.04911873862147331, -0.06706181168556213, 0.045524027198553085, -0.022274835035204887, -0.004730219952762127, -0.0275550726801157, 0.06985905766487122, -0.018334828317165375, -0.06341727823019028, 0.17077182233333588, -0.010422811843454838, 0.004759371280670166, 0.10537160933017731, 0.04688050597906113, 0.010560938157141209, -0.0247593242675066, -0.015317991375923157, 0.08697932958602905, 0.08893518149852753, -0.013038539327681065, 0.043911971151828766, -0.037270110100507736, 0.015462604351341724, -0.007559276185929775, -0.07449888437986374, 0.08484600484371185, -0.007433595135807991, 0.03485562652349472, 0.015275228768587112, -0.0963348001241684, 0.01104106567800045, -0.05732128024101257, 0.006920585408806801, 0.017165884375572205, -0.0018514671828597784, 0.041391272097826004, -0.012870155274868011, 0.004031188786029816, 0.0871419832110405, -0.017687004059553146, -0.02329835668206215, 0.012857448309659958, 0.08892287313938141, 0.05606745928525925, -0.017629850655794144, -0.011843886226415634 ] }, { "text": "### Basic Attention\n\n```python\nimport torch\nimport torch.nn as nn\nimport torch.nn.functional as F", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_28", "embedding": [ 0.026657206937670708, -0.038120102137327194, -0.01733304001390934, 0.07791829109191895, -0.020750418305397034, -0.008357535116374493, 0.09522198885679245, 0.04761065915226936, -0.005627387203276157, -0.07537722587585449, 0.03974567726254463, 0.028995513916015625, -0.10115420818328857, 0.05550834909081459, 0.007368979975581169, 0.06144792214035988, -0.06960418820381165, -0.0515710823237896, -0.05932896211743355, -0.07466595619916916, 0.11798420548439026, -0.00980308186262846, 0.13157397508621216, 0.048006054013967514, -0.07086432725191116, -0.016537010669708252, -0.021000413224101067, 0.03274814784526825, 0.05926727503538132, -0.01709776744246483, 0.056391384452581406, 0.06826236844062805, -0.049990445375442505, 0.0709977075457573, 0.017827443778514862, 0.0052987500093877316, -0.10094717144966125, -0.02256452664732933, -0.0019082209328189492, 0.03130296245217323, 0.01498718373477459, -0.03874806687235832, -0.04905971512198448, -0.06558910757303238, -0.026080140843987465, 0.03988148272037506, 0.09159505367279053, -0.0025992889422923326, 0.0094088613986969, -0.039425209164619446, -0.003601091681048274, 0.0026010239962488413, -0.012712358497083187, 0.02219821698963642, 0.08881422132253647, 0.006843474227935076, 0.0439484640955925, -0.10574416071176529, 0.0017997336108237505, -0.10644222795963287, 0.02620580792427063, 0.018387282267212868, 0.032935310155153275, -0.06771604716777802, 0.03448635712265968, 0.012195062823593616, -0.0011108384933322668, -0.04335387796163559, 0.03246433660387993, -0.01993265189230442, -0.037049077451229095, -0.029220756143331528, -0.0043557086028158665, 0.018259786069393158, 0.02086169831454754, -0.07630323618650436, 0.06602166593074799, 0.01052380632609129, 0.04159817099571228, -0.0531596802175045, 0.009572128765285015, -0.018640587106347084, 0.030079711228609085, 0.03586892783641815, 0.061335913836956024, 0.0023098147939890623, -0.01690824143588543, 0.027585048228502274, 0.0002716676681302488, -0.0018374697538092732, -0.14548057317733765, -0.0950438529253006, 0.01659397780895233, 0.014042569324374199, -0.04893581569194794, -8.802605589153245e-05, 0.06782573461532593, 0.013311253860592842, -0.11521759629249573, 0.02819068543612957, 0.011623712256550789, 0.0004968798602931201, -0.02699795551598072, 0.03940143808722496, -0.04421001672744751, 0.04996276646852493, 0.015282826498150826, 0.04665039852261543, -0.011584932915866375, -0.06533625721931458, 0.034490976482629776, -0.04971189796924591, 0.012748958542943, -0.07159573584794998, 0.039367593824863434, -0.08687753230333328, -0.034314244985580444, 0.04610048606991768, 0.03831753879785538, 0.13221803307533264, 0.0495581328868866, 0.026552444323897362, -0.10014612227678299, 0.07406092435121536, -0.03002014383673668, -0.05784980207681656, 0.010619040578603745, 3.555578374359637e-33, -0.056127216666936874, 0.043462224304676056, -0.018944650888442993, -0.002019234001636505, -0.012400195002555847, -0.024266857653856277, 0.07101443409919739, -0.07044726610183716, -0.10508489608764648, 0.040912408381700516, -0.019833635538816452, 0.03163536638021469, -0.02436934970319271, 0.05034136027097702, -0.13105185329914093, -0.024033579975366592, 0.10342974215745926, 0.01458618976175785, 0.02277965657413006, -0.04905696585774422, 0.02355545572936535, 0.0726742222905159, -0.007495660334825516, -0.03679986298084259, -0.0746990442276001, 0.0030450255144387484, -0.055849336087703705, -0.05237346142530441, 0.019390296190977097, -0.004742605146020651, -0.013151945546269417, -0.005112559534609318, 0.06447296589612961, 0.010708673857152462, 0.050937723368406296, -0.05854146182537079, 0.03837165609002113, -0.008761696517467499, -0.0220551285892725, -0.09609498828649521, 0.001003315090201795, 0.10621315985918045, -0.028003206476569176, -0.01633490063250065, -0.013822343200445175, 0.05633685737848282, -0.05185825005173683, 0.13274413347244263, 0.022230427712202072, 0.022631553933024406, -0.025587476789951324, 0.0018095470732077956, 0.05017160251736641, 0.044520892202854156, 0.050707317888736725, -0.02921454980969429, 0.025675302371382713, 0.051494892686605453, 0.07144948840141296, -0.09167296439409256, 0.0607839897274971, 0.022457731887698174, -0.014236146584153175, 0.048065029084682465, 0.012287954799830914, -0.025202054530382156, 0.027072755619883537, 0.09755606204271317, -0.01649412512779236, -0.004284297116100788, -0.11457620561122894, 0.08257075399160385, -0.02043185569345951, 0.00045708470861427486, -0.006096927914768457, -0.029019558802247047, -0.037515752017498016, -0.12009449303150177, -0.037056852132081985, 0.04001523554325104, -0.04304146021604538, 0.008007566444575787, -0.036065295338630676, -0.06942121684551239, -0.03524059057235718, -0.013711392879486084, 0.011119872331619263, -0.047180917114019394, -0.010279553942382336, -0.056657854467630386, -0.08535430580377579, -0.11316539347171783, 0.043309152126312256, -0.020707638934254646, -0.015658017247915268, -4.051693561072276e-33, 0.034991126507520676, 0.09610708057880402, -0.029004717245697975, 0.02934202179312706, -0.06904027611017227, 0.007449046242982149, -0.04194575175642967, -0.05943479761481285, -0.02356198988854885, 0.0128102358430624, -0.0007467903196811676, -0.08185748755931854, 0.024427998811006546, -0.06668774038553238, 0.05645695701241493, 0.03851950913667679, -0.03432748466730118, 0.05233960598707199, 0.023676646873354912, 0.029612526297569275, -0.06203491985797882, 0.07011877000331879, -0.09983653575181961, 0.02374095283448696, -0.10662448406219482, 0.036461856216192245, 0.07347463071346283, 0.04631264507770538, 0.008419795893132687, -0.011632392182946205, -0.0011137016117572784, 0.03296060487627983, -0.05278199911117554, 0.024016348645091057, -0.0304741021245718, 0.00010938121704384685, 0.10149633884429932, -0.056293606758117676, -0.03048075921833515, -0.06432479619979858, 0.1318817138671875, 0.08402479439973831, -0.002201048657298088, 0.06624568998813629, -0.08825260400772095, 0.03189028054475784, -0.022695906460285187, -0.006738258525729179, -0.018875543028116226, 0.015161105431616306, -0.0017694724956527352, -0.10568704456090927, -0.08180651813745499, -0.046160418540239334, -0.06107136607170105, 0.045809779316186905, 0.05538404732942581, 0.02134847082197666, -0.014819100499153137, -0.03523491322994232, -0.013369755819439888, -0.09801094979047775, 0.054687876254320145, 0.007647515274584293, -0.0346163809299469, -0.028073031455278397, -0.09017989039421082, 0.049928776919841766, 0.08921458572149277, -0.05867345631122589, 0.0542730912566185, 0.10993978381156921, 0.05127965286374092, 0.017690768465399742, -0.00936245359480381, 0.03977825865149498, 0.06128595396876335, 0.0027813988272100687, 0.020277278497815132, 0.07216167449951172, -0.00988161563873291, -0.03726745769381523, 0.0039499602280557156, -0.013033809140324593, -0.019101912155747414, 0.007808956783264875, 0.07359286397695541, 0.09611285477876663, -0.030319225043058395, -0.13185107707977295, 0.042795371264219284, 0.025249306112527847, 0.07959266006946564, -0.01245133951306343, 0.00980537012219429, -2.9485981656307558e-08, -0.063853420317173, -0.015618110075592995, -0.022444691509008408, -0.023351967334747314, -0.016300972551107407, 0.03629749268293381, 0.031246546655893326, 0.020504435524344444, -0.05704841390252113, -0.025083139538764954, 0.04646066576242447, -0.005526813678443432, 0.045122548937797546, -0.009656116366386414, 0.025093281641602516, 0.11694928258657455, 0.01630798727273941, 0.05046489089727402, 0.005211445968598127, -0.049664657562971115, -0.017555294558405876, -0.02964056096971035, 0.03704063966870308, 0.01055800262838602, -0.04839707538485527, 0.003983567003160715, 0.001370079698972404, -0.01412662398070097, -0.03192519396543503, -0.03871355950832367, 0.05460560321807861, -0.025174595415592194, 0.06721378117799759, -0.0063041881658136845, -0.03273817151784897, 0.03398774191737175, 0.022136107087135315, 0.004840036388486624, -0.0035610042978078127, 0.031001269817352295, -0.03588063269853592, -0.004603542387485504, -0.06607771664857864, 0.004335406702011824, -0.03800953924655914, -0.016618169844150543, -0.03133232519030571, -0.0337228998541832, -0.049678556621074677, 0.006160486489534378, 0.03600231930613518, 0.004231052007526159, -0.02297949232161045, 0.0227249413728714, -0.0030160711612552404, 0.035400811582803726, 0.0601036436855793, 0.048845499753952026, -0.06617800891399384, -0.036124520003795624, 0.04766729101538658, 0.05906979739665985, -0.010517929680645466, -0.07447472214698792 ] }, { "text": "class Attention(nn.Module):\n \"\"\"Simple additive attention mechanism.\"\"\"\n \n def __init__(self, hidden_size):\n super().__init__()\n self.attention = nn.Linear(hidden_size, 1)\n \n def forward(self, encoder_outputs):\n # encoder_outputs: [batch, seq_len, hidden_size]\n \n # Compute attention scores\n scores = self.attention(encoder_outputs) # [batch, seq_len, 1]\n scores = scores.squeeze(-1) # [batch, seq_len]\n \n # Softmax to get attention weights\n weights = F.softmax(scores, dim=1) # [batch, seq_len]\n \n # Weighted sum of encoder outputs\n context = torch.bmm(\n weights.unsqueeze(1), # [batch, 1, seq_len]\n encoder_outputs # [batch, seq_len, hidden_size]", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_29", "embedding": [ -0.020125290378928185, -0.10487666726112366, -0.0671636313199997, 0.05628585442900658, 0.006647222675383091, -0.005393886473029852, 0.012373343110084534, 0.03023594431579113, -0.036556143313646317, -0.0946132242679596, 0.008413187228143215, -0.03336295485496521, -0.02361334301531315, -0.009877048432826996, -0.07165227085351944, 0.07152128964662552, 0.02546406351029873, 0.04257041588425636, -0.10240953415632248, -0.0908019170165062, 0.08071118593215942, -0.019373886287212372, 0.08521031588315964, 0.03768778592348099, -0.0029072603210806847, -0.03713657334446907, -0.039193108677864075, 0.02010280080139637, 0.06194504722952843, -0.05039969086647034, 0.060291554778814316, 0.008481998927891254, 0.04766112193465233, 0.08829502761363983, -0.03378542512655258, 0.0400230810046196, -0.10241097956895828, -0.005381437949836254, -0.010026166215538979, -0.011768863536417484, 0.02067827805876732, 0.03631812706589699, -0.002082148566842079, -0.01923763006925583, 0.04787207767367363, -0.0009616827010177076, 0.02102111279964447, 0.00507310451939702, 0.002782701514661312, -0.09274814277887344, 0.012676472775638103, 0.036901894956827164, -0.032830383628606796, 0.0354522243142128, 0.008862463757395744, -0.010017956607043743, 0.0015937886200845242, -0.08391086757183075, -0.05441776290535927, -0.03735029697418213, -0.014121703803539276, -0.040548741817474365, 0.03489649295806885, -0.07052711397409439, 0.036433033645153046, -0.013022824190557003, 0.0018830479821190238, 0.004758886992931366, -0.03986573964357376, 0.03551794961094856, 0.0198997650295496, 0.009378375485539436, -0.019216978922486305, 0.004375772085040808, 0.07072865962982178, -0.02970709279179573, 0.07355174422264099, 0.035283420234918594, -0.005718879401683807, -0.0018962124595418572, 0.009337063878774643, -0.04609754681587219, 0.06124037876725197, -0.0015010809293016791, 0.10781817883253098, -0.06133698672056198, 0.04105134680867195, 0.044985998421907425, 0.006824121344834566, 0.04331822693347931, -0.03764166310429573, -0.08173990994691849, -0.07310356944799423, 0.006600477267056704, 0.022648053243756294, -0.002213742583990097, 0.008771341294050217, -0.015618433244526386, -0.04885462671518326, 0.01051192544400692, -0.0022767027840018272, 0.013707173988223076, 0.015062850899994373, -0.020617401227355003, 0.0559481717646122, 0.06072104349732399, 0.09893549978733063, 0.1360185444355011, 0.004929135087877512, -0.11473482847213745, 0.009624551050364971, 0.012537874281406403, 0.05507512390613556, 0.018438126891851425, 0.07908064126968384, -0.021590327844023705, 0.002792823128402233, 0.07871504127979279, 0.06764480471611023, 0.05915455147624016, 0.04264894872903824, 0.04474851116538048, -0.0564676970243454, 0.02968973107635975, -0.014316213317215443, -0.012276902794837952, -0.08475210517644882, 4.0261493341449384e-33, -0.023720402270555496, 0.0263096671551466, -0.05358755961060524, -0.041182246059179306, -0.04165765270590782, 0.06567643582820892, 0.047048769891262054, -0.024604080244898796, -0.07729437202215195, -0.0023506085854023695, -0.06104369834065437, 0.028675496578216553, 0.015560022555291653, 0.067344531416893, -0.009937841445207596, -0.049603983759880066, 0.040103599429130554, 0.032474584877491, 0.008256962522864342, -0.02355586178600788, 0.04884672909975052, 0.05777932330965996, -0.009042235091328621, -0.0790681391954422, -0.07347869873046875, 0.02513759396970272, -0.030383680015802383, -0.07574666291475296, -0.07851437479257584, -0.01487333606928587, -0.052874255925416946, 0.034673966467380524, -0.005896321963518858, -0.032280754297971725, 0.041200388222932816, -0.07079484313726425, 0.07735588401556015, 0.04239455983042717, 0.05980929359793663, -0.07448713481426239, 0.015777314081788063, 0.10570599138736725, -0.022087756544351578, -0.04693532735109329, -0.10495435446500778, 0.019542165100574493, -0.05052218213677406, 0.11437682807445526, 0.032525818794965744, 0.04060903936624527, 0.00423184409737587, -0.04178519919514656, -0.023144952952861786, -0.0633620098233223, -0.0019135125912725925, -0.025272836908698082, 0.08981787413358688, 0.0873718410730362, 0.06989899277687073, 0.005748499650508165, 0.04984660446643829, -0.01981561817228794, -0.001867392915301025, 0.025076698511838913, 0.015477017499506474, 0.006679826881736517, -0.04641341418027878, 0.03209548071026802, 0.05071113631129265, 0.02139969728887081, -0.07905321568250656, 0.10388093441724777, -0.028147144243121147, -0.04512833058834076, 0.05199437588453293, -0.05398930236697197, 0.02367631159722805, -0.14460863173007965, -0.04800039529800415, 0.0013970969012007117, -0.044937677681446075, 0.08982210606336594, -0.049272436648607254, -0.07065078616142273, -0.06479214876890182, 0.02099246345460415, -0.02534639462828636, -0.04640830308198929, -0.07828003168106079, -0.019192615523934364, -0.060953013598918915, -0.09547297656536102, -0.0011985169257968664, -0.0051814354956150055, -0.10116609185934067, -3.764510372932806e-33, -0.0034551622811704874, 0.1307331770658493, -0.02462002821266651, 0.024604765698313713, -0.002047648886218667, 0.043007053434848785, -0.026660263538360596, 0.014862456358969212, -0.04209056496620178, 0.039985090494155884, 0.0011931275948882103, -0.05836647376418114, 0.009849335066974163, 0.002374769886955619, 0.11531086266040802, -0.02724936604499817, -0.03292437270283699, 0.061226971447467804, -0.046621110290288925, -0.034821443259716034, -0.03339126706123352, 0.11973455548286438, -0.06083178147673607, 0.046829164028167725, -0.06537307053804398, 0.047179996967315674, -0.01398972887545824, 0.07913913577795029, 0.011681174859404564, -0.07865414768457413, -0.04749860614538193, 0.009891110472381115, -0.06434053182601929, 0.009746331721544266, -0.057867925614118576, 0.03608894720673561, 0.029156029224395752, -0.05457998067140579, -0.033674925565719604, 0.03630165383219719, 0.10578615963459015, 0.04635219648480415, -0.06333893537521362, 0.05561287701129913, -0.024276956915855408, 0.08058100193738937, -0.0457364059984684, -0.03773411363363266, -0.036557335406541824, 0.05163498595356941, -0.022100793197751045, -0.027996869757771492, -0.07254141569137573, 0.014080074615776539, -0.09214809536933899, -0.026023704558610916, 0.014923560433089733, -0.010231602936983109, 0.05160379782319069, -0.027950705960392952, -0.02894503064453602, -0.05470588803291321, 0.010137191973626614, -0.025782661512494087, -0.03627556562423706, 0.02225138433277607, -0.017125586047768593, 0.007936581037938595, 0.05466722324490547, 0.01383410394191742, 0.05513754487037659, 0.09222930669784546, 0.07096860557794571, 0.03056674264371395, -0.013045120052993298, 0.07386679202318192, -0.047434814274311066, -0.04928368702530861, -0.029374144971370697, -0.018583986908197403, -0.07849060744047165, -0.04905575513839722, 0.03613852709531784, 0.03896038606762886, 0.0126625532284379, 0.04706945642828941, 0.1359032243490219, 0.05825163051486015, 7.778050348861143e-05, -0.06085917353630066, 0.04557539150118828, 0.04376424849033356, 0.053335513919591904, 0.03993186354637146, 0.008668907918035984, -5.303914107912533e-08, -0.06206188723444939, -0.07838035374879837, -0.06796757876873016, 0.10101155191659927, -0.0294894278049469, -0.00987700093537569, 0.02419699728488922, 0.05584541708230972, -0.07001161575317383, -0.03569518029689789, 0.0725276991724968, -0.0607636384665966, 0.00033488127519376576, -0.008054680190980434, 0.04036514833569527, 0.06355553865432739, 0.009828182868659496, -0.020810697227716446, 0.013445736840367317, -0.053695984184741974, -0.03017379529774189, -0.018663626164197922, -0.003250912530347705, 0.025332624092698097, -0.06962770223617554, -0.0370682030916214, -0.060240138322114944, 0.01653646118938923, 0.0026564456056803465, -0.039288152009248734, 0.11962428689002991, 0.01672249101102352, 0.06914971768856049, 0.054504118859767914, -0.026911819353699684, 0.07637480646371841, -0.016849244013428688, 0.010652459226548672, -0.014629149809479713, 0.12374866753816605, -0.06201831251382828, 0.013940640725195408, -0.02694539725780487, -8.532901119906455e-05, 0.030165597796440125, -0.022272132337093353, -0.039739012718200684, -0.11799224466085434, 0.03321731463074684, -0.03487998619675636, 0.10490626096725464, -0.023011865094304085, -0.049790866672992706, 0.024123093113303185, 0.02259543165564537, -0.04839970916509628, -0.024453043937683105, 0.021716458722949028, -0.016530167311429977, 0.047616999596357346, -0.03146824985742569, 0.0389716811478138, -0.06546344608068466, -0.029132790863513947 ] }, { "text": "weights.unsqueeze(1), # [batch, 1, seq_len]\n encoder_outputs # [batch, seq_len, hidden_size]\n ).squeeze(1) # [batch, hidden_size]\n \n return context, weights\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_30", "embedding": [ -0.0619426853954792, 0.028546042740345, -0.07309507578611374, 0.10036886483430862, -0.055688269436359406, -0.02030838467180729, 0.04689963534474373, -0.035580750554800034, -0.08957497775554657, -0.13696007430553436, 0.02868942730128765, -0.06486428529024124, 0.02646838314831257, -0.11032361537218094, -0.028925631195306778, 0.06683453172445297, -0.01585133746266365, 0.08953975141048431, -0.11502180248498917, -0.1231531947851181, 0.0795673131942749, 0.026483789086341858, -0.04679566249251366, 0.042617376893758774, 0.044398676604032516, -0.0343451201915741, -0.0761951431632042, 0.024703936651349068, 0.058879554271698, -0.04611566290259361, 0.042210180312395096, -0.01403630431741476, 0.03203609585762024, 0.02491278201341629, 0.09766317903995514, 0.014134123921394348, -0.07430369406938553, -0.06925962120294571, -0.009062168188393116, 0.007586595136672258, 0.04056373983621597, 0.060718096792697906, -0.03545435518026352, -0.002777953865006566, -0.08259386569261551, -0.022584956139326096, -0.020915282890200615, 0.033926691859960556, -0.029297487810254097, -0.08200021833181381, 0.05744365602731705, 0.06492198258638382, -0.042726144194602966, 0.056648921221494675, -0.032724082469940186, -0.10366632044315338, 0.06563951075077057, -0.02682499587535858, -0.10724609345197678, 0.026366226375102997, -0.0640920028090477, -0.04330030828714371, -0.0017391867004334927, 0.012614987790584564, -0.019769825041294098, -0.014264877885580063, 0.018241731449961662, -0.0157560333609581, 0.03253922984004021, 0.03254435583949089, 0.03786348178982735, -0.05697194114327431, -0.07373033463954926, 0.05012651905417442, 0.04463111236691475, -0.0005941519048064947, 0.10051525384187698, -0.016672326251864433, 0.009772938676178455, 0.034943319857120514, -0.04946935549378395, -0.0395687110722065, 0.0692112073302269, 0.0010156371863558888, 0.02601102739572525, -0.005584976635873318, -0.03407381847500801, 0.06684372574090958, 0.0653228610754013, 0.050310708582401276, -0.06133345142006874, -0.06904610991477966, -0.06702511012554169, 0.040572769939899445, 0.04248396307229996, -0.006492109503597021, 0.0036918732803314924, 0.014409058727324009, -0.06162711977958679, 0.022695813328027725, 0.022228259593248367, 0.017899688333272934, 0.0994621217250824, 0.05382118746638298, -0.026989387348294258, 0.08450531959533691, 0.055607013404369354, 0.04694060608744621, 0.014419722370803356, -0.05062485858798027, 0.05105957016348839, 0.004817003849893808, 0.08424052596092224, 0.008684760890901089, 0.06425905227661133, -0.01684962771832943, 0.0737854465842247, 0.009239637292921543, -0.038140326738357544, 0.08842884749174118, 0.0015501405578106642, -0.012655346654355526, -0.0918361023068428, -0.024711523205041885, -0.04264139011502266, -0.0064936429262161255, -0.07782357931137085, -1.2664370222866307e-33, -0.06452573090791702, -0.05314640328288078, 0.016796743497252464, -0.12583661079406738, -0.012779662385582924, 0.1137993261218071, 0.011234068311750889, 0.02018730156123638, -0.05397408828139305, 0.03389569744467735, -0.028797805309295654, 0.01764196716248989, 0.020779600366950035, 0.08365581929683685, -0.0012174841249361634, -0.046880125999450684, 0.03961478918790817, 0.07862387597560883, 0.0579724982380867, -0.08192092180252075, -0.014008835889399052, 0.010088436305522919, -0.0704183280467987, -0.015277550555765629, -0.07022033631801605, -0.08093501627445221, -0.012311933562159538, -0.11594127118587494, -0.06265167146921158, 0.004718410316854715, -0.10729507356882095, -0.01082978118211031, 0.019775843247771263, -0.05312162637710571, 0.017852792516350746, -0.05307088419795036, 0.0770573541522026, 0.05236353352665901, 0.025071123614907265, -0.061263274401426315, 0.05491131171584129, 0.030856752768158913, 0.014614058658480644, -0.06326320767402649, -0.06967342644929886, -0.05866650119423866, -0.011943326331675053, 0.0604318343102932, -0.0022319627460092306, 0.013116990216076374, 0.07640138268470764, -0.016212500631809235, 0.034408483654260635, -0.01738136261701584, 0.07815808802843094, -0.03108595684170723, 0.0769728273153305, 0.03918693959712982, 0.12636660039424896, 0.04010169208049774, -0.0006569653633050621, 0.021403027698397636, 0.039740189909935, 0.03810330852866173, 0.04673030972480774, -0.04307885468006134, 0.014116005040705204, -0.03412551060318947, -0.06023640185594559, 0.05389389395713806, -0.10112611949443817, 0.03874615952372551, -0.011117443442344666, 0.019448423758149147, -0.0012404854642227292, -0.05152711644768715, 0.01876840926706791, -0.11051581054925919, -0.05348287522792816, 0.06104957312345505, 0.014804220758378506, 0.10029945522546768, -0.0053809164091944695, -0.0002504553704056889, -0.05440128967165947, -0.03002908080816269, -0.0003505163185764104, -0.04400144889950752, 8.158510172506794e-05, -0.03917732834815979, -0.04159293696284294, -0.09451357275247574, -0.027612941339612007, -0.10145524144172668, -0.07831765711307526, -4.111660670695506e-34, 0.014743218198418617, 0.09870582818984985, -0.01900845766067505, -0.025694210082292557, 0.008952083066105843, -0.04060713201761246, 0.01935989037156105, 0.08699503540992737, -0.03662789613008499, 0.02733156643807888, 0.01919575221836567, -0.015909098088741302, -0.005492180120199919, -0.02830452471971512, 0.12083391845226288, 0.01191824208945036, -0.07262343168258667, 0.0784463956952095, -0.022198345512151718, 0.0028894057031720877, 0.05125900357961655, 0.006467475555837154, -0.06685327738523483, 0.11603070050477982, -0.00023435935145244002, -0.042290132492780685, -0.006330031435936689, 0.056234560906887054, 0.040315788239240646, -0.014866004697978497, -0.04248970374464989, -0.01878344640135765, -0.0015458334237337112, 0.041031740605831146, -0.05800216272473335, -0.014505280181765556, 0.05992041155695915, 0.028091179206967354, 0.044500481337308884, 0.023655196651816368, 0.009436915628612041, 0.10591832548379898, -0.014363652095198631, 0.06588836014270782, -0.040050387382507324, 0.02551685832440853, -0.02396325394511223, -0.06234698370099068, -0.008644208312034607, -0.030208978801965714, -0.01624152809381485, 0.03690941259264946, -0.10478527843952179, 0.035399362444877625, -0.02967314049601555, -0.09185337275266647, 0.005713307298719883, -0.014753022231161594, 0.0011507699964568019, -0.01977677270770073, -0.03606800734996796, -0.022153204306960106, 0.02885894849896431, -0.10016930848360062, -0.009172662161290646, -0.0016188329318538308, -0.021898772567510605, 0.017650704830884933, -0.07222674041986465, -0.006740385666489601, 0.021967336535453796, -0.008429113775491714, 0.05207470804452896, 0.07089657336473465, -0.09962093830108643, 0.01403748244047165, -0.042027104645967484, -0.015430863946676254, 0.0027286368422210217, 0.010518543422222137, -0.02434188686311245, -0.04509181156754494, 0.06126321479678154, 0.0547294057905674, 0.08200452476739883, 0.08573281019926071, 0.02668098919093609, 0.04830097034573555, -0.01077402662485838, 0.021352341398596764, 0.03678039833903313, 0.014407041482627392, 0.08050861209630966, 0.11475451290607452, 0.03457934781908989, -3.563483019775049e-08, -0.010670626536011696, -0.0895913764834404, 0.02473783679306507, 0.039258040487766266, -0.02217319793999195, 0.04015669599175453, 0.035405199974775314, 0.026622535660862923, 0.0035486773122102022, 0.0018333325861021876, 0.1036420464515686, -0.05098288133740425, -0.02747243270277977, 0.05037542060017586, 0.019283834844827652, 0.07229436188936234, -0.028311479836702347, -0.020243024453520775, 0.026934057474136353, -0.05322502925992012, -0.023834597319364548, 0.007152095437049866, -0.02502061054110527, 0.018794342875480652, -0.021525703370571136, -0.09590160846710205, -0.07996901124715805, 0.04728926718235016, 0.0705254003405571, -0.012518646195530891, 0.031859394162893295, 0.009686479344964027, 0.0007273821393027902, 0.0092384684830904, -0.06572827696800232, 0.03410223871469498, 0.0031781266443431377, -0.0024729527067393064, -0.031051162630319595, 0.03293910622596741, -0.06583290547132492, 0.0026444802060723305, 0.010407461784780025, -0.029137587174773216, 0.01804094761610031, -0.019285278394818306, 0.004363862797617912, -0.01576627977192402, -0.030867109075188637, -0.03158882260322571, 0.03398456797003746, -0.006163792684674263, -0.00910020712763071, 0.0678446888923645, 0.009502841159701347, -0.01745026931166649, -0.04075607657432556, 0.003124318551272154, 0.011076259426772594, 0.04571899026632309, -0.036766380071640015, 0.03160256892442703, 0.03946198523044586, -0.02903759479522705 ] }, { "text": "### Scaled Dot-Product Attention\n\nThis is the attention mechanism used in Transformers.", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_31", "embedding": [ -0.04516228660941124, 0.017641915008425713, -0.04010877013206482, 0.004673035815358162, 0.03158910945057869, -0.037956904619932175, 0.08568528294563293, 0.09502279758453369, 0.05502322316169739, -0.00949862040579319, 0.0632207989692688, 0.0893077477812767, 0.021371085196733475, 0.031070945784449577, -0.027340734377503395, 0.06621070951223373, 0.014876593835651875, 0.013377688825130463, -0.08353132754564285, -0.050196919590234756, 0.10365109890699387, 0.03315717354416847, -0.020942265167832375, 0.0030752012971788645, -0.008715194649994373, 0.08333821594715118, -0.0397723950445652, -0.07058607041835785, 0.020948974415659904, -0.06682594865560532, -0.015835879370570183, 0.05583934485912323, -0.008483586832880974, 0.0360725112259388, -0.09616504609584808, 0.05563659220933914, -0.04858724772930145, 0.039161644876003265, -0.05827261134982109, -0.06144998222589493, 0.05983836203813553, -0.010085591115057468, -0.012284346856176853, 0.0002802183444146067, 0.03185888007283211, 0.02973313070833683, 0.004227667115628719, 0.02360844984650612, -0.02688140980899334, -0.08409982174634933, -0.021331239491701126, -0.07927679270505905, -0.04935748875141144, 0.06934765726327896, -0.0026394366286695004, 0.03289507329463959, 0.02543438971042633, 0.008712051436305046, 0.030249958857893944, 0.013875266537070274, -0.06733960658311844, 0.002443344332277775, -0.009846977889537811, -0.02727426588535309, 0.023504871875047684, -0.039498619735240936, 0.04856272041797638, -0.11322366446256638, -0.08871975541114807, -0.005801598075777292, 0.01628834567964077, 0.002577913925051689, 0.029904333874583244, -0.006032576318830252, 0.11307714134454727, 0.028521833941340446, 0.010721343569457531, -0.06479650735855103, 0.06802975386381149, 0.020157376304268837, -0.009777925908565521, -0.003722243010997772, 0.004510603845119476, 0.03937087953090668, 0.05391871929168701, 0.08434745669364929, -0.0016569258878007531, -0.09859205782413483, -0.0018797150114551187, 0.022515853866934776, -0.07225334644317627, -0.11052729189395905, -0.04858764261007309, 0.031944822520017624, -0.03995193541049957, -0.07647727429866791, -0.03221867233514786, 0.005646431352943182, -0.05035362392663956, 0.029085272923111916, 0.0711817815899849, -0.05280845984816551, 0.050368502736091614, 0.005497097969055176, -0.05145430564880371, -0.04382253438234329, 0.0009551382390782237, 0.05758728086948395, 0.044082045555114746, -0.00026339167379774153, -0.03152042254805565, -0.0356801301240921, -0.04714140668511391, -0.06811651587486267, -0.009226138703525066, -0.08489973843097687, -0.052962157875299454, 0.013066468760371208, 0.00910282600671053, 0.005787174683064222, 0.09844456613063812, 0.003934168256819248, -0.11443661153316498, -0.02036578208208084, 0.030513396486639977, 0.023063622415065765, -0.029735524207353592, -1.0609258959453472e-33, -0.052656982094049454, 0.035855408757925034, 0.004902001470327377, 0.03318400681018829, -0.08711940795183182, 0.026658929884433746, -0.012488179840147495, -0.005049286875873804, 0.009305620566010475, 0.013312194496393204, 0.0004308769421186298, 0.10258790105581284, 0.004320407751947641, 0.11355595290660858, -0.02951335534453392, -0.16370153427124023, 0.036039650440216064, 0.11455035954713821, -0.06703009456396103, -0.05053862929344177, -0.011625545099377632, 0.07516749203205109, -0.02312428131699562, 0.013134476728737354, -0.037129249423742294, 0.013095851056277752, -0.044627971947193146, -0.0567128024995327, -0.03124324604868889, 0.029128998517990112, -0.042656902223825455, 0.10816354304552078, -0.024205969646573067, -0.01579546183347702, -0.046062666922807693, -0.03911061957478523, -0.0029687657952308655, -0.08264683932065964, 0.019510095939040184, -0.029277047142386436, 0.03606804832816124, 0.031079523265361786, -0.0789887085556984, 0.004068529233336449, -0.04644535109400749, 0.014642889611423016, 0.03299219533801079, 0.020775390788912773, -0.01554969884455204, -0.01819542422890663, 0.010324982926249504, 0.03285619616508484, 0.029075197875499725, -0.04408394545316696, 0.15224589407444, 0.05972563475370407, 0.06608320027589798, -0.0030700156930834055, 0.019937239587306976, -0.005231059156358242, -0.03717361018061638, -0.009858515113592148, -0.012637331150472164, 0.02730504237115383, -0.0009559277095831931, -0.037396520376205444, -0.023778047412633896, -0.0018050681101158261, -0.006741158198565245, 0.05852706357836723, -0.007378832437098026, 0.09900016337633133, -0.00798895675688982, 0.013150575570762157, -0.0388573557138443, -0.010823400691151619, 0.047879207879304886, 0.01533825695514679, 0.057126350700855255, -0.01908249780535698, -0.08130161464214325, -0.03270397335290909, -0.025769630447030067, -0.07068949192762375, -0.02495456673204899, -0.012633911333978176, 0.0023207874037325382, -0.1354779303073883, -0.08436691015958786, -0.05956767499446869, 0.07027355581521988, -0.01503751240670681, -0.07615796476602554, 0.02714737318456173, -0.08822624385356903, 2.855858474370459e-34, -0.024007664993405342, 0.005633873865008354, -0.07398925721645355, 0.052319277077913284, -0.04562435671687126, -0.015874771401286125, 0.024662360548973083, 0.015878962352871895, -0.005828278139233589, 0.06323384493589401, 6.58617282169871e-05, -0.051858630031347275, -0.009793071076273918, -0.022692324593663216, 0.03740723058581352, 0.017236249521374702, 0.040956880897283554, -0.051533881574869156, -0.012700336053967476, 0.022389177232980728, 0.04219069331884384, 0.06788095831871033, 0.02002134546637535, 0.005843290593475103, -0.039869971573352814, -0.008773169480264187, -0.06619057059288025, -0.0022409402299672365, 0.04407493770122528, -0.031598787754774094, -0.08577463775873184, -0.027195004746317863, 0.06660902500152588, 0.02029978670179844, -0.009896955452859402, -0.006790966261178255, -0.024419110268354416, -0.032310497015714645, 0.02220647782087326, -0.06790006905794144, 0.013465551659464836, 0.021138006821274757, 0.06059077009558678, 0.03991604596376419, -0.05328400060534477, -0.02089150995016098, 0.0643797442317009, -0.06745753437280655, -0.021794648841023445, 0.05654986947774887, 0.006588804069906473, 0.023409709334373474, -0.018831217661499977, -0.05140635371208191, -0.12418718636035919, 0.05347558110952377, -0.040384531021118164, 0.0058640651404857635, 0.03424215316772461, -0.048046041280031204, 0.06365428864955902, -0.056642796844244, 0.005019342061132193, -0.06996594369411469, -0.007270512171089649, 0.043057508766651154, 0.05700249597430229, -0.027194147929549217, 0.07878419011831284, 0.00028412844403646886, 0.175554096698761, 0.04628727585077286, 0.021072085946798325, -0.047989372164011, -0.07282250374555588, -0.0884416252374649, 0.03774518519639969, -0.0750608965754509, -0.030873430892825127, -0.0290435329079628, -0.06042296811938286, 0.011815296486020088, 0.04806247353553772, 0.0730031207203865, -0.021762849763035774, 0.011186574585735798, 0.034546684473752975, 0.07045412808656693, -0.008645853027701378, 0.0638788565993309, -0.05898156389594078, 0.06419655680656433, -0.009334331378340721, 0.08525221049785614, 0.002112891059368849, -2.1191819854493588e-08, -0.08998289704322815, -0.010354060679674149, -0.02169034257531166, 0.002722363453358412, 0.03283831849694252, -0.04882817342877388, -0.00031366891926154494, 0.08581318706274033, -0.040348805487155914, -0.01266067661345005, 0.021146250888705254, -0.027746470645070076, 0.027748428285121918, 0.016660340130329132, 0.16806045174598694, 0.04356525465846062, -0.02202734537422657, 0.013155085034668446, -0.07310181856155396, -0.07946117222309113, -0.04637433961033821, 0.06787696480751038, 0.04316718503832817, 0.015072081238031387, -0.03405192121863365, 0.0182464849203825, -0.014275159686803818, 0.11675284802913666, 0.02402047999203205, -0.021464457735419273, -0.0005257971351966262, 0.0715530663728714, -0.009921940974891186, -0.03318532183766365, -0.054607588797807693, 0.10987178981304169, 0.06654594838619232, 0.05767408013343811, 0.044900085777044296, 0.039384789764881134, -0.004734207410365343, -0.05055033415555954, -0.010752568021416664, 0.12497927993535995, -0.02681267447769642, 0.07891172915697098, -0.04385542497038841, -0.0694989413022995, -0.048573486506938934, -0.07437346130609512, 0.0672239363193512, 0.04074551910161972, -0.031776223331689835, 0.03385273367166519, -0.006809174548834562, -0.007529459893703461, 0.04370720311999321, -0.03317709267139435, -0.031095432117581367, 0.05667753517627716, 0.021209146827459335, 0.07460528612136841, 0.03590570390224457, 0.015342076309025288 ] }, { "text": "```python\nclass ScaledDotProductAttention(nn.Module):\n def __init__(self, d_k):\n super().__init__()\n self.scale = d_k ** 0.5\n \n def forward(self, query, key, value, mask=None):\n \"\"\"\n Args:\n query: [batch, seq_len, d_k]\n key: [batch, seq_len, d_k]\n value: [batch, seq_len, d_v]\n mask: Optional mask for padding or causal attention\n \"\"\"\n # Compute attention scores\n scores = torch.bmm(query, key.transpose(1, 2)) / self.scale\n # scores: [batch, seq_len, seq_len]\n \n # Apply mask if provided\n if mask is not None:\n scores = scores.masked_fill(mask == 0, float('-inf'))\n \n # Softmax to get attention weights", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_32", "embedding": [ 0.008161990903317928, -0.04287167266011238, -0.04980464652180672, 0.10673336684703827, -0.022297672927379608, 0.024557139724493027, 0.08237747102975845, 0.05767863616347313, -0.051855891942977905, -0.05904588848352432, -0.0037352817598730326, -0.05705643817782402, -0.007705665193498135, 0.008459609933197498, -0.03687184303998947, 0.04900098964571953, 0.04568078741431236, 0.024582307785749435, -0.08552061021327972, -0.1064656674861908, 0.05194990336894989, -0.027147652581334114, 0.08099398016929626, 0.05268584564328194, -0.024558331817388535, -0.0013852769043296576, -0.05225826054811478, -0.023062491789460182, 0.0833171159029007, 0.012091645039618015, 0.02082672342658043, -0.03690080717206001, 0.025756219401955605, 0.07758886367082596, -0.033852580934762955, -0.005778567865490913, -0.06434736400842667, 0.044544097036123276, -0.05284174904227257, -0.022885926067829132, 0.07074642181396484, -0.014383062720298767, -0.031134547665715218, -0.03792693093419075, 0.05380526930093765, 0.020946010947227478, -0.0038461603689938784, 0.004948166199028492, -0.02864711545407772, -0.04476211592555046, -0.029694819822907448, -0.028337283059954643, -0.03332943096756935, 0.013442971743643284, 0.03356452286243439, 0.040332239121198654, 0.011813998222351074, -0.04893084615468979, 0.05459170788526535, -0.05598389357328415, -0.05881941318511963, -0.09314143657684326, 0.07726002484560013, -0.05953255668282509, 0.04123106598854065, -0.005045897327363491, -0.011499001644551754, -0.02340041846036911, 0.011674690991640091, 0.04115433618426323, 0.001190408831462264, 0.011183648370206356, 0.03141474351286888, 0.0064428807236254215, 0.04083120822906494, 0.03167587146162987, 0.013528593815863132, -0.0823030173778534, 0.0060575190000236034, 0.012214909307658672, -0.008112052455544472, -0.05251215025782585, 0.031504321843385696, 0.03836893290281296, 0.13528235256671906, -0.053675342351198196, 0.06578889489173889, -0.01287348847836256, 0.005543245002627373, -0.0016078028129413724, -0.04824771732091904, -0.036016710102558136, -0.10288990288972855, 0.009545331820845604, 0.03652965649962425, 0.023374047130346298, -0.045711856335401535, -0.025252792984247208, -0.049696095287799835, 0.03419596329331398, 0.0457824245095253, -0.009606636129319668, -0.05042262747883797, -0.0007782970787957311, 0.020498935133218765, 0.0585981048643589, 0.039970673620700836, 0.06587047874927521, 0.02532985992729664, -0.08150996267795563, 0.006633223034441471, 0.01621236652135849, 0.056135039776563644, -0.01051145140081644, 0.06634794920682907, -0.04221149533987045, 0.06082931160926819, 0.10494576394557953, 0.05573519319295883, 0.06922563165426254, 0.05176391825079918, 0.04716437682509422, -0.0692560151219368, -0.018085984513163567, 0.01874358393251896, -0.016604239121079445, -0.01577506959438324, 3.755918611254249e-33, 0.015549952164292336, 0.006805629935115576, -0.05805850028991699, -0.07506205141544342, -0.00489050941541791, 0.06701387465000153, 0.06948118656873703, -0.019212208688259125, -0.06949461996555328, -0.028314242139458656, -0.017025288194417953, -0.0017465336713939905, 0.027050696313381195, 0.0013665835140272975, -0.08895858377218246, -0.04900554195046425, 0.07343194633722305, 0.04516918957233429, -0.032587043941020966, -0.04300419241189957, 0.07120171189308167, 0.014008428901433945, -0.02567441388964653, -0.06364955753087997, -0.0325048491358757, 0.02117200754582882, -0.07497423142194748, -0.029016390442848206, -0.04511994868516922, 0.0004363675252534449, -0.06292377412319183, 0.02036021463572979, -0.06919007748365402, -0.008313762955367565, -0.0032685319893062115, -0.05535567179322243, 0.06357935070991516, 0.008276550099253654, 0.06594275683164597, -0.07409778237342834, -0.0261012464761734, 0.07906155288219452, -0.046014562249183655, -0.02817918173968792, -0.1249350905418396, 0.012537478469312191, -0.03417458385229111, 0.11025632172822952, -0.014720325358211994, -0.021960139274597168, -0.009332873858511448, -0.01099702250212431, -0.0281260684132576, -0.1511872559785843, 0.02063065953552723, -0.027558481320738792, 0.07981614768505096, 0.05657219886779785, 0.07785604149103165, -0.03961418941617012, 0.02869086153805256, -0.03032226860523224, -0.062448207288980484, 0.05230970308184624, 0.02483844943344593, 0.01534710731357336, -0.05860361456871033, 0.0025933515280485153, 0.012359987944364548, 0.013714689761400223, -0.020368115976452827, 0.10336119681596756, -0.08497168868780136, -0.045760005712509155, -0.009573928080499172, -0.09129804372787476, 0.044294167309999466, -0.09396474808454514, -0.0423489585518837, -0.006534547079354525, -0.041002850979566574, 0.03355405852198601, -0.06418025493621826, -0.045579519122838974, -0.017039846628904343, -0.0008972912328317761, -0.015876606106758118, -0.04290597885847092, -0.0924597829580307, -0.052686214447021484, -0.04533526301383972, -0.11344977468252182, 0.014880937524139881, -0.007154384162276983, -0.12764209508895874, -3.148592842746191e-33, -0.0014962072018533945, 0.12324248254299164, -0.02265945076942444, 0.0755760669708252, 0.033028267323970795, 0.024639230221509933, 0.013573508709669113, -0.017179248854517937, -0.01288470160216093, 0.038594260811805725, -0.042123980820178986, -0.0572957769036293, -0.03394574671983719, -0.03847454488277435, 0.07523170858621597, 0.017316119745373726, -0.018835876137018204, 0.06711907684803009, -0.05943864956498146, -0.026367729529738426, -0.03948001191020012, 0.12537966668605804, -0.10937473177909851, 0.0845722183585167, -0.03854832053184509, -0.026189250871539116, 0.015252375975251198, 0.0419493243098259, -0.022386373952031136, -0.07979275286197662, -0.04997238889336586, -0.012236764654517174, -0.03259994462132454, -0.00937084574252367, -0.04431331902742386, 0.06255514174699783, 0.003223969368264079, -0.10154521465301514, -0.05861322581768036, 0.06586632877588272, 0.088516965508461, 0.025337666273117065, -0.06764936447143555, 0.034692224115133286, -0.044745393097400665, 0.06268378347158432, -0.005458187777549028, 0.013327125459909439, -0.06919584423303604, 0.06899998337030411, -0.0287774708122015, -0.01954067312180996, -0.03969961777329445, 0.04399384185671806, -0.13119244575500488, 0.015201136469841003, -0.02984783798456192, 0.018955454230308533, -0.026307780295610428, -0.0479409322142601, -0.008363572880625725, -0.09089014679193497, 0.05429349094629288, 0.0011995886452496052, 0.013881196267902851, 0.037716131657361984, 0.028350671753287315, 0.02765122801065445, 0.03977896273136139, 0.009920172393321991, 0.046538058668375015, 0.07715948671102524, 0.12445609271526337, 0.0050965468399226665, -0.00939044076949358, 0.03486048802733421, -0.020772596821188927, 0.0035040825605392456, 0.0006469003274105489, 0.026490075513720512, -0.045504603534936905, -0.019339419901371002, 0.09197696298360825, 0.04974241554737091, 0.006731744855642319, 0.07871481776237488, 0.11264736950397491, 0.10192248225212097, 0.00696168839931488, -0.0031991766300052404, -0.006554554216563702, -0.011207140982151031, 0.05337139219045639, 0.03675398603081703, 0.0580097958445549, -5.688326254471576e-08, -0.05837377905845642, -0.013617794029414654, -0.07114015519618988, 0.172561913728714, -0.01641344092786312, 0.004404778126627207, 0.001356277265585959, 0.034616921097040176, -0.06684736162424088, 0.009859045036137104, 0.07386802136898041, -0.062382228672504425, 0.045814596116542816, -0.01952330209314823, 0.02195233851671219, 0.029533937573432922, 0.013787723146378994, 0.011058026924729347, 0.0009604095830582082, -0.053369197994470596, -0.06276068091392517, 0.008390789851546288, 0.0003278960066381842, 0.029871158301830292, -0.042664021253585815, -0.012329037301242352, -0.0340493768453598, 0.012615698389708996, 0.03466252610087395, -0.04874912276864052, 0.036565616726875305, -0.025046750903129578, 0.07104820013046265, 0.0588320828974247, -0.00638053473085165, 0.05314471572637558, -0.017149241641163826, 0.06071861460804939, -0.006378286983817816, 0.10517197847366333, -0.009291816502809525, 0.025788569822907448, 0.0030031113419681787, 0.03447690233588219, 0.001637372188270092, 0.005631821230053902, -0.0642080157995224, -0.060476161539554596, 0.040190890431404114, -0.010204204358160496, 0.11188115924596786, -0.037797197699546814, -0.06519810110330582, 0.048203110694885254, 0.060940999537706375, -0.005833424627780914, 0.007375038228929043, 0.04217034950852394, -0.0719304159283638, 0.045599937438964844, 0.02222045697271824, 0.03871537372469902, -0.09222538024187088, -0.010645569302141666 ] }, { "text": "if mask is not None:\n scores = scores.masked_fill(mask == 0, float('-inf'))\n \n # Softmax to get attention weights\n attention_weights = F.softmax(scores, dim=-1)\n \n # Weighted sum of values\n output = torch.bmm(attention_weights, value)\n \n return output, attention_weights", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_33", "embedding": [ 0.04726093262434006, -0.023882374167442322, -0.07859530299901962, 0.09251511842012405, 0.04337838664650917, 0.0039302874356508255, 0.051221076399087906, -0.0012095835991203785, -0.01568744331598282, -0.09579390287399292, -0.032004255801439285, -0.08349930495023727, -0.01901834085583687, -0.013543501496315002, -0.06541979312896729, 0.06528531014919281, 0.004994585644453764, 0.021775294095277786, -0.02043694257736206, -0.1029856875538826, 0.07456890493631363, -0.025289306417107582, 0.033811286091804504, 0.02559690549969673, 0.026708820834755898, -0.01964031346142292, -0.061120424419641495, 0.017442580312490463, 0.054908573627471924, 0.00017469697922933847, -0.006044813897460699, -0.04778210073709488, 0.10209984332323074, 0.055339861661195755, -0.0001243142905877903, -0.048027198761701584, -0.07548537850379944, 0.042204272001981735, -0.036361806094646454, 0.018604593351483345, -0.004651055671274662, 0.009900710545480251, -0.029877185821533203, -0.028272299095988274, 0.003402619156986475, 0.028970489278435707, 0.01820770464837551, -0.0013619138626381755, 0.030384039506316185, -0.05085121467709541, 0.07798437029123306, 0.023340947926044464, -0.07201176881790161, 0.064588263630867, 0.006930307950824499, -0.030813133344054222, -0.007268867921084166, -0.08662230521440506, -0.005462921690195799, -0.0802125483751297, -0.058645930141210556, -0.043978381901979446, 0.0928300991654396, -0.039041031152009964, 0.05322325974702835, 0.019873669371008873, -0.06763777136802673, -0.011132219806313515, -0.02692435123026371, 0.024706047028303146, 0.04258168488740921, 0.010754268616437912, 0.050997499376535416, -0.032344114035367966, 0.03716512769460678, 0.011299465782940388, 0.037804003804922104, -0.054496582597494125, 0.03901897370815277, 0.08722010999917984, 1.8784214262268506e-05, -0.07389170676469803, 0.011835546232759953, 0.03764121234416962, 0.05904935672879219, -0.056938014924526215, 0.02164219133555889, 0.055685702711343765, 5.3404179197968915e-05, 0.006740660406649113, -0.07301000505685806, -0.005952138453722, -0.06606218218803406, 0.05633566156029701, 0.024120118468999863, -0.017594054341316223, 0.015684576705098152, -0.004071059636771679, -0.059404805302619934, -0.0012590625556185842, -0.030657485127449036, -0.021924110129475594, -0.0084052924066782, -0.04611918330192566, 0.04626844450831413, 0.07269294559955597, 0.055185262113809586, 0.08678151667118073, 0.007505504414439201, -0.11399661004543304, 0.031122660264372826, -0.010601135902106762, 0.06723780930042267, 0.023545242846012115, 0.06324504315853119, -0.0065560718066990376, 0.06946340948343277, 0.09368712455034256, -0.015538142062723637, 0.08146833628416061, 0.08065194636583328, 0.05189279839396477, -0.036585789173841476, -0.014536119997501373, -0.022697316482663155, -0.04148143157362938, -0.07746139913797379, 3.980285952679668e-33, -0.008228649385273457, 0.009732796810567379, -0.05377280339598656, -0.044835854321718216, -0.05397655442357063, 0.042249392718076706, 0.0648251473903656, -0.02848336100578308, -0.07160057127475739, 0.003053348744288087, -0.027446052059531212, 0.051057446748018265, -0.03143402189016342, 0.0007948630955070257, -0.05222748592495918, -0.020148232579231262, 0.10849159955978394, -0.034628964960575104, 0.02076680026948452, -0.008487498387694359, 0.033721283078193665, 0.04092075675725937, -0.030825577676296234, -0.05701611563563347, -0.013424676842987537, -0.012801148928701878, -0.05967934802174568, -0.06446928530931473, -0.06866911798715591, -0.010075964033603668, -0.04919493943452835, 0.035362809896469116, 0.011105966754257679, -0.052761055529117584, -0.005344817880541086, -0.029459858313202858, 0.07545445114374161, 0.032863304018974304, 0.0460205152630806, -0.08393547683954239, 0.03606250137090683, 0.08021876215934753, -0.03658862039446831, -0.05522196739912033, -0.0479809008538723, 0.04032207280397415, -0.03401042893528938, 0.08914896100759506, 0.04128742218017578, 0.056209057569503784, 0.005097446031868458, -0.0271650068461895, -0.0369584746658802, -0.041472092270851135, -0.07851788401603699, -0.019872259348630905, 0.05931505933403969, 0.06732923537492752, 0.04560154676437378, -0.09683170169591904, 0.06912320852279663, -0.006600872613489628, -0.03608974814414978, 0.002350583439692855, -0.017483895644545555, 0.031633567065000534, 0.010770143941044807, -0.010863389819860458, -0.026433777064085007, -0.0107120918110013, -0.08355826884508133, 0.0708097591996193, -0.05881888046860695, -0.026392312720417976, -0.03682456538081169, -0.05412067100405693, 0.04628751426935196, -0.10347926616668701, -0.038876842707395554, 0.0027022657450288534, 0.011378253810107708, 0.06350740790367126, -0.027300631627440453, -0.07657966762781143, -0.05738095939159393, 0.07165481150150299, 0.0058207218535244465, 0.012462127022445202, -0.05183928459882736, -0.06908828765153885, -0.04958533123135567, -0.06654153764247894, -0.040507618337869644, -0.003533905604854226, -0.13828685879707336, -3.79908092710652e-33, -0.040243081748485565, 0.11153001338243484, -0.0335160531103611, -0.014288607984781265, -0.01661628670990467, 0.0920846238732338, 0.023749519139528275, -0.03711456432938576, 0.030011961236596107, 0.08611244708299637, 0.02511119842529297, -0.09799813479185104, -0.07864938676357269, -0.030957570299506187, 0.07914771884679794, -0.04328525811433792, -0.04926447570323944, 0.06274525076150894, -0.08443870395421982, -0.01370271947234869, -0.09439509361982346, 0.09617318212985992, -0.04763536900281906, 0.0296926386654377, -0.09422244131565094, 0.026387063786387444, 0.03781336173415184, 0.019901586696505547, -0.014063789509236813, -0.06680644303560257, -0.014684953726828098, 0.022865908220410347, -0.02713240496814251, 0.0038049789145588875, -0.05554484575986862, 0.015071467496454716, 0.05074702948331833, -0.08190014958381653, -0.03596160188317299, 0.012234339490532875, 0.04300873726606369, 0.036004889756441116, -0.07661161571741104, 0.0498860664665699, -0.06844259798526764, 0.044202420860528946, 0.01402756106108427, -0.030041910707950592, -0.0020131124183535576, -0.014083446003496647, -0.0170289259403944, -0.07872435450553894, -0.055663131177425385, 0.04211842268705368, -0.0987480953335762, 0.006355509627610445, -0.03850268945097923, -0.019541265442967415, 0.038340769708156586, -0.03189201280474663, -0.005820295307785273, -0.028124283999204636, -0.04463643953204155, -0.00328784785233438, -0.032409265637397766, 0.06375204026699066, 0.028094200417399406, 0.008931386284530163, 0.046128954738378525, 0.05652167648077011, 0.06725109368562698, 0.11594140529632568, 0.13390415906906128, 0.05444544553756714, 0.0040465728379786015, 0.09289088845252991, -0.0465736985206604, 0.019047781825065613, -0.03651437535881996, -0.007921253331005573, -0.043358154594898224, -0.04425722733139992, 0.042067378759384155, 0.04016299545764923, 0.04225649684667587, 0.0541110560297966, 0.09097196161746979, 0.047182437032461166, -0.03187637776136398, -0.04475697502493858, 0.009633461013436317, 0.023866310715675354, 0.09297820180654526, -0.032729826867580414, 0.023394810035824776, -3.532533909833546e-08, -0.02320905588567257, -0.03790108114480972, -0.06786778569221497, 0.06494710594415665, -0.07752344012260437, 0.03332654386758804, 0.038445860147476196, 0.0015763911651447415, -0.02898917905986309, 0.016498740762472153, 0.01219757180660963, -0.06984920054674149, 0.0247475765645504, -0.03909289464354515, 0.008080090396106243, 0.12650901079177856, 0.006831128615885973, 0.03563762828707695, 0.04508528858423233, -0.03954903408885002, -0.01577521674335003, -0.03377343714237213, -0.011905801482498646, 0.015696272253990173, -0.02480270154774189, -0.024524621665477753, -0.06611648947000504, 0.0030224411748349667, 0.01711164228618145, 0.06234055012464523, 0.10880203545093536, -0.009638085030019283, 0.06734858453273773, 0.03889879211783409, 0.04629398137331009, 0.0355159193277359, -0.01699650287628174, 0.036954835057258606, -0.0427466556429863, 0.1756761074066162, -0.022181259468197823, 0.020006556063890457, 0.02974623441696167, -0.019205544143915176, 0.02951141446828842, 0.02099688909947872, -0.048605967313051224, -0.07376930117607117, 0.04485420137643814, -0.03682732209563255, 0.15174120664596558, -0.03798873722553253, -0.09468214958906174, 0.03986666351556778, -0.017419319599866867, -0.053280118852853775, 0.026456814259290695, 0.06349948793649673, -0.03182549402117729, -0.020336750894784927, 0.013483474031090736, 0.010765297338366508, -0.06024244800209999, -0.013645709492266178 ] }, { "text": "# Example usage\nd_k = 64\nattention = ScaledDotProductAttention(d_k)\n\nbatch_size, seq_len = 8, 20\nQ = torch.randn(batch_size, seq_len, d_k)\nK = torch.randn(batch_size, seq_len, d_k)\nV = torch.randn(batch_size, seq_len, d_k)\n\noutput, weights = attention(Q, K, V)\nprint(f\"Attention output shape: {output.shape}\") # [8, 20, 64]\nprint(f\"Attention weights shape: {weights.shape}\") # [8, 20, 20]\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_34", "embedding": [ 0.023008547723293304, -0.018331896513700485, -0.022250931710004807, 0.0834464505314827, -0.015019197016954422, -0.001694873790256679, 0.09021002799272537, 0.054214656352996826, -0.04967169836163521, -0.05142449215054512, 0.03856157138943672, -0.004093655385077, -0.022882621735334396, 0.0010674847289919853, -0.05127154290676117, 0.0420234389603138, -0.014273812994360924, 0.0010133361211046576, -0.07803528755903244, -0.09118710458278656, 0.07325205951929092, -0.0434996597468853, 0.08235945552587509, 0.041797488927841187, 0.030504342168569565, 0.02650068700313568, -0.025668766349554062, 0.005442932713776827, 0.05785578489303589, -0.008267516270279884, 0.061603814363479614, 0.028757810592651367, 0.03555332496762276, 0.013175747357308865, 0.028722470626235008, -0.011342308484017849, -0.1091436892747879, -0.0006936425343155861, -0.03950061649084091, -0.004890158772468567, 0.0676184743642807, 0.006467009894549847, -0.06814181059598923, -0.001629121252335608, 0.03271779045462608, 0.046966105699539185, 0.028230100870132446, -0.041573114693164825, -0.03626361861824989, -0.05607011914253235, -0.0010649804025888443, -0.05064814165234566, -0.027093645185232162, -0.00730438856408, 0.013441156595945358, 0.02447565644979477, 0.0645662173628807, -0.02153334952890873, 0.028462566435337067, -0.0316227562725544, -0.05333273112773895, -0.05582800880074501, 0.028126779943704605, -0.05932748317718506, 0.022067835554480553, -0.01090684998780489, 0.02909882180392742, -0.04314305633306503, 0.013690480962395668, -0.00551966205239296, -0.020303748548030853, 0.06882109493017197, 0.043942440301179886, 0.003285794286057353, 0.03704596310853958, -0.003967223223298788, 0.04135410115122795, -0.060583651065826416, 0.020516160875558853, -0.07248018682003021, -0.07306184619665146, -0.013437047600746155, 0.10348054021596909, 0.0009122127084992826, 0.1070183590054512, 0.042674142867326736, 0.046031881123781204, 0.006664305459707975, -0.002554995706304908, 0.005798439495265484, -0.0579252615571022, -0.06410913914442062, -0.13320952653884888, -0.01239059865474701, -0.019625157117843628, -0.0010546072153374553, 0.011065971106290817, -0.03952419012784958, -0.0788540467619896, 0.0004867061215918511, 0.08438833802938461, -0.06670603901147842, 0.06196298822760582, 0.061229411512613297, 0.003190582850947976, 0.06330394744873047, -0.006714969873428345, 0.03572376072406769, 0.026046616956591606, -0.04170696437358856, 0.059586651623249054, 0.03017430007457733, 0.010226460173726082, 0.012106703594326973, 0.07776027172803879, -0.05753685534000397, -0.002318841638043523, 0.05651924014091492, 0.05094181001186371, 0.06529916822910309, 0.010267259553074837, -0.015958337113261223, -0.06458399444818497, 0.0012476402334868908, -0.0662473812699318, -0.03689438849687576, -0.032633017748594284, 2.3742811222061186e-33, -0.033056896179914474, -0.0003753234341274947, -0.05996020883321762, -0.06815071403980255, 0.017711350694298744, 0.043147437274456024, 0.06328637897968292, -0.0556204691529274, -0.05838460847735405, -0.05187169462442398, -0.05410659313201904, -0.003486746922135353, 0.01679806411266327, 0.05237782374024391, -0.08998498320579529, -0.08466918766498566, 0.05958455428481102, 0.14252683520317078, -0.04982968419790268, -0.04557957500219345, 0.0456526055932045, 0.07725062221288681, -0.029124844819307327, -0.02242417261004448, -0.06089803948998451, -0.019327260553836823, -0.04207650572061539, 0.0063917916268110275, -0.059266332536935806, 0.024520229548215866, -0.07550335675477982, 0.02316133864223957, 0.008472460322082043, 0.005449628457427025, -0.015453922562301159, -0.1059454008936882, 0.059559959918260574, -0.027821458876132965, 0.02669261395931244, -0.13668078184127808, 0.051981981843709946, 0.08667949587106705, 0.04304084554314613, -0.04067391902208328, -0.10544241964817047, 0.03836016729474068, -0.009230151772499084, 0.13753411173820496, 0.017179986461997032, -0.03402077779173851, 0.01222028024494648, -0.03909553214907646, 0.018515057861804962, -0.057289715856313705, 0.06549288332462311, -0.006479927338659763, 0.06978306919336319, 0.04325210303068161, 0.1350664496421814, -0.030116047710180283, 0.037968117743730545, 0.08939478546380997, -0.04265044257044792, 0.06467822194099426, 0.00866283942013979, 0.01708904653787613, -0.006683275569230318, -0.004020379390567541, 0.007454074919223785, 0.06133267655968666, -0.05005102977156639, 0.1272342950105667, -0.06091827526688576, 0.010585668496787548, -0.005671838764101267, -0.060105860233306885, 0.033389829099178314, -0.08158435672521591, -0.07491668313741684, 0.05526627600193024, -0.030831944197416306, 0.08305183053016663, -0.06601951271295547, -0.09603841602802277, -0.035427335649728775, -0.04222305864095688, -0.0050071608275175095, -0.1070265918970108, -0.09792978316545486, -0.03491271287202835, -0.05433027446269989, -0.1179233267903328, 0.017533332109451294, -0.016263749450445175, -0.12942591309547424, -1.8818962933474176e-33, -0.004796101711690426, 0.1332709789276123, 0.039832983165979385, 0.027980629354715347, -0.008894798345863819, 0.016993323341012, -0.006287978962063789, -0.00214260327629745, -0.03990735858678818, -0.010433955118060112, -0.06545031815767288, -0.08417654782533646, -0.03746715188026428, -0.05227947235107422, 0.07953357696533203, 0.004420802928507328, -0.027228375896811485, 0.015580810606479645, -0.01654117740690708, -0.027695003896951675, -0.019099336117506027, 0.0545915924012661, -0.0872998908162117, 0.07278928905725479, -0.02008037082850933, -0.05298829823732376, -0.0017904072301462293, 0.03471865504980087, 0.023476505652070045, -0.0906476154923439, -0.09264491498470306, -0.038062091916799545, -0.02430485561490059, 0.07897347956895828, -0.01244958583265543, -0.019772037863731384, 0.03366268053650856, -0.06119297817349434, 0.024582916870713234, -0.0033898092806339264, 0.07334351539611816, 0.00016457044694107026, -0.010059097781777382, 0.06539269536733627, -0.05204973369836807, 0.024417346343398094, -0.024814920499920845, 0.003036301117390394, -0.04643874242901802, 0.016388412564992905, -0.023154282942414284, -0.02447797916829586, -0.05399351939558983, 0.030163979157805443, -0.09953238815069199, 0.011188549920916557, -0.015662534162402153, 0.046891603618860245, -0.024310143664479256, -0.058227647095918655, -0.025754574686288834, -0.13917332887649536, 0.05076172202825546, -0.004031991120427847, -0.0031483981292694807, 0.05224335193634033, 0.00047309682122431695, -0.0247011948376894, 0.024906598031520844, 0.0018846617313101888, 0.07847745716571808, 0.07688061892986298, 0.03765762224793434, 0.013249371200799942, -0.06566732376813889, -0.009856868535280228, -0.024240242317318916, -0.00437875185161829, 0.0193161703646183, 0.011284356005489826, -0.02001318708062172, 0.013076613657176495, 0.09534051269292831, 0.0758579671382904, 0.021463653072714806, 0.09262979030609131, 0.1015223041176796, 0.08978937566280365, 0.03222077339887619, 0.018509019166231155, 0.029567280784249306, 0.05281132087111473, 0.08428081125020981, 0.11325610429048538, 0.08383769541978836, -4.2659387133880955e-08, -0.05479985475540161, -0.044206179678440094, 0.012856443412601948, 0.07066037505865097, 0.012322995811700821, -0.0016616808716207743, 0.028488611802458763, 0.046287644654512405, -0.03206101059913635, -0.0024973913095891476, 0.04073458909988403, -0.06156786158680916, -0.02731526456773281, -0.005069233477115631, 0.024621250107884407, 0.03264159709215164, -0.012278081849217415, 0.02461399883031845, 0.014793220907449722, -0.03736104816198349, -0.03290896117687225, 0.005082002375274897, 0.04635540768504143, 0.0214071087539196, -0.09720587730407715, -0.0509767048060894, -0.019032131880521774, 0.06101743504405022, 0.01291646808385849, -0.07332710176706314, 0.026636678725481033, -0.013092833571135998, 0.036152128130197525, 0.02383449487388134, -0.03310472518205643, 0.03907006233930588, -0.04303419962525368, 0.05631517246365547, 0.003798483405262232, 0.06878932565450668, -0.010380606167018414, 0.0042315637692809105, 0.04368773475289345, 0.03035125322639942, 0.03279058262705803, -0.011773795820772648, -0.05918528512120247, -0.057693976908922195, 0.020033719018101692, -0.007004652637988329, 0.08575847744941711, 0.02344180829823017, -0.0689157024025917, 0.057433582842350006, -0.028493868187069893, -0.010177548974752426, -0.009265377186238766, 0.022617517039179802, -0.03934795409440994, 0.058259304612874985, 0.009892184287309647, 0.04733952879905701, -0.03659968450665474, -0.03125770762562752 ] }, { "text": "### Multi-Head Attention\n\nMulti-head attention allows the model to attend to different representation subspaces.", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_35", "embedding": [ 0.042644090950489044, -0.09120112657546997, 0.019018037244677544, 0.01726534403860569, 0.061636898666620255, 0.1270904392004013, 0.007949699647724628, -0.07087649405002594, 0.11627707630395889, -0.03993991017341614, 0.010894169099628925, -0.033058080822229385, -0.003271725494414568, -0.011605343781411648, -0.03776096925139427, -0.005296024493873119, 0.018079301342368126, -0.012339192442595959, -0.0782153531908989, 0.010270181111991405, 0.09964728355407715, -0.0483073927462101, 0.059839218854904175, -0.01529718842357397, -0.023907387629151344, 0.0008403140818700194, -0.0548999160528183, 0.002337596844881773, 0.02997812256217003, -0.04629011079668999, 0.03430529683828354, 0.09800870716571808, 0.01585916243493557, 0.04787579923868179, -0.08001374453306198, 0.02949615940451622, -0.017799243330955505, 0.05027510225772858, -0.005665818694978952, 0.001263925340026617, -0.024613337591290474, 0.0658603385090828, -0.03236190974712372, 0.04220610111951828, 0.023486189544200897, -0.007505184505134821, -0.056143537163734436, -0.04663897678256035, 0.028835559263825417, -0.08602292090654373, -0.044922854751348495, -0.056725624948740005, -0.010025298222899437, 0.037179134786129, -0.026639806106686592, -0.014821316115558147, -0.030906621366739273, -0.031084945425391197, 0.012215116992592812, 0.010015755891799927, -0.06292762607336044, -0.02530401386320591, 0.009349068626761436, -0.008677742443978786, 0.12352869659662247, -0.02757745049893856, -0.0874892994761467, 0.028694748878479004, -0.1067158430814743, 0.012633539736270905, 0.0034502593334764242, 0.023574093356728554, 0.0032324979547411203, -0.12437929958105087, 0.08030420541763306, 0.009140826761722565, 0.03836626186966896, -0.036484379321336746, 0.1700347363948822, -0.00965115986764431, 0.010183694772422314, 0.048404768109321594, -0.032321199774742126, -0.028891799971461296, 0.09275151044130325, 0.004471105057746172, -0.07586881518363953, -0.06317286193370819, -0.04932137578725815, -0.0085721081122756, -0.04532396420836449, -0.07288302481174469, 0.025442471727728844, 0.03229811415076256, -0.04253346472978592, -0.04009604826569557, 0.01877143792808056, 0.06548941135406494, 0.05088799446821213, 0.012496103532612324, 0.03165788576006889, -0.052368152886629105, 0.09277015179395676, 0.0008021178073249757, 0.006674147676676512, -0.08176390826702118, 0.05719373747706413, 0.004594388417899609, -0.012724095024168491, -0.11334382742643356, 0.026183918118476868, -0.0338459312915802, -0.04362355172634125, 0.014430533163249493, -0.011246703565120697, -0.0400509387254715, 0.0013544970424845815, 0.018475571647286415, 0.07349725067615509, -0.05331406742334366, 0.012962734326720238, -0.043683696538209915, 0.014655784703791142, -0.016038665547966957, 0.04455072805285454, -0.09267023950815201, -0.12324300408363342, -2.1366492453866314e-34, 0.02355850860476494, -0.022958340123295784, -8.540053386241198e-05, 0.052798882126808167, 0.05721025913953781, 0.046116605401039124, -0.007036514114588499, 0.0286061093211174, -0.032220035791397095, 0.014699917286634445, -0.023690637201070786, -0.007476620841771364, -0.03805391862988472, 0.10730334371328354, -0.04993952065706253, -0.008305232040584087, -0.0673610121011734, 0.05642150342464447, -0.07840470224618912, -0.01985153742134571, 0.033638037741184235, 0.074800506234169, -0.051866091787815094, -0.03033030964434147, -0.03875666484236717, 0.047827836126089096, 0.033233098685741425, -0.09294621646404266, -0.11317198723554611, 0.02369939349591732, -0.07860133796930313, 0.09924023598432541, -0.058599814772605896, 0.017736263573169708, 0.0016860119067132473, -0.013405561447143555, -1.920334398164414e-05, -0.023054391145706177, 0.07008178532123566, -0.031972937285900116, 0.04803004115819931, 0.07086686789989471, -0.03071923367679119, -0.07431071251630783, -0.058207008987665176, 0.05974937975406647, 0.04026489332318306, 0.034265268594026566, -0.04482792690396309, 0.03148543834686279, 0.027176443487405777, 0.036711230874061584, -0.033885497599840164, -0.02421761117875576, 0.0179909598082304, 0.07075367122888565, 0.012725415639579296, 0.057857949286699295, 0.10065200924873352, 0.00561955152079463, -0.0033238769974559546, 0.008856610395014286, 0.0018931350205093622, -0.021636461839079857, 0.028759483247995377, 0.038961853832006454, 0.015303944237530231, -0.008094158954918385, 0.07426721602678299, 0.11983384937047958, -0.08943460136651993, 0.06769368052482605, -0.0412747897207737, -0.010882404632866383, -0.05678818002343178, -0.04497154429554939, 0.010112126357853413, -0.029947752133011818, -0.008931050077080727, 0.07104574888944626, -0.014470146968960762, 0.019402064383029938, -0.060999300330877304, -0.02200774848461151, -0.04939768835902214, -0.0006899471627548337, 0.022335635498166084, -0.11730904877185822, -0.021624121814966202, -0.034792665392160416, 0.14660896360874176, -0.02721286006271839, -0.054528385400772095, 0.010089321993291378, -0.04624340683221817, -1.2068835397380966e-33, 0.03277427330613136, 0.0169244222342968, -0.08844830095767975, -0.09708115458488464, -0.002607952104881406, -0.07960254698991776, 0.06674067676067352, -0.045353446155786514, -0.004598195198923349, 0.019438060000538826, 0.042125727981328964, -0.024464912712574005, -0.013790185563266277, 0.04815684258937836, 0.04576835781335831, -0.02972147800028324, 0.03612932935357094, -0.04883759841322899, -0.045493755489587784, -0.02478671632707119, 0.017299136146903038, 0.02060231752693653, -0.01827407255768776, 0.018697798252105713, -0.03511795029044151, 0.04160009324550629, -0.02093898132443428, 0.025056134909391403, 0.09580173343420029, -0.022247646003961563, -0.033165525645017624, -0.06620198488235474, -0.0030694061424583197, 0.040066562592983246, -0.055787667632102966, 0.0033987273927778006, -0.002882559783756733, 0.004729023668915033, -0.010656689293682575, 0.11090683937072754, 0.013322382234036922, -0.03524642437696457, 0.03854481130838394, 0.07006550580263138, -0.012976085767149925, 0.02828177437186241, 0.020172031596302986, -0.06301502138376236, -0.0655260905623436, -0.00012536517169792205, -0.07651583105325699, -0.022705059498548508, -0.05301147326827049, -0.015428172424435616, -0.11633119732141495, 0.026575474068522453, 0.024538928642868996, -0.023737985640764236, 0.03663276135921478, -0.0595720037817955, 0.020821284502744675, -0.03138033300638199, -0.030428292229771614, 0.023033732548356056, 0.00886575412005186, -0.05113079026341438, -0.04478350654244423, -0.11987791210412979, 0.02819056622684002, 0.012291163206100464, 0.004906418267637491, 0.012927425093948841, -0.015044416300952435, 5.289120599627495e-05, 0.016637075692415237, 0.0040828390046954155, -0.026841670274734497, -0.03539071977138519, 0.05612814053893089, -0.008797424845397472, -0.08366049081087112, -0.07124257832765579, 0.03653024137020111, 0.049485061317682266, 0.021505232900381088, 0.08699534833431244, 0.03792755305767059, 0.06672728061676025, -0.030771998688578606, -0.12720872461795807, 0.016185734421014786, 0.018392523750662804, 0.02537088468670845, 0.062154799699783325, -0.08528228104114532, -2.4128183895300026e-08, -0.1445450484752655, -0.07069328427314758, 0.018752409145236015, -0.022758938372135162, -0.027211131528019905, -0.08658194541931152, -0.02695847861468792, 0.07308711856603622, -0.02188761904835701, 0.06082414835691452, 0.020808251574635506, -0.00542964693158865, -0.003601150354370475, -0.008647728711366653, 0.059606730937957764, 0.013299871236085892, -0.023802053183317184, 0.0731302872300148, -0.0065117101185023785, -0.027785254642367363, -0.020310526713728905, -0.0074588279239833355, -0.02026813104748726, 0.0003083345654886216, 0.025407154113054276, 0.005436388775706291, -0.013179106637835503, 0.14090223610401154, -0.002550050849094987, 0.0185213852673769, 0.055001065135002136, 0.08735506236553192, -0.015419372357428074, -0.03397471457719803, -0.05257432535290718, 0.07772669196128845, -0.009121309965848923, -0.011495715007185936, 0.04774416238069534, 0.0016020239563658834, 0.007852342911064625, 0.011611833237111568, -0.05387817695736885, 0.08195491135120392, 0.08977454155683517, 0.08345960825681686, 0.0656585618853569, -0.069748155772686, 0.04309852793812752, -0.004080743994563818, 0.06495984643697739, -0.0015796287916600704, -0.03429398313164711, 0.08711519092321396, -0.05877968296408653, 0.03722120448946953, 0.08143595606088638, -0.022479960694909096, 0.06019486114382744, 0.020880650728940964, 0.03186161071062088, 0.047269467264413834, 0.0035924327094107866, 0.015116747468709946 ] }, { "text": "```python\nclass MultiHeadAttention(nn.Module):\n def __init__(self, d_model, num_heads):\n super().__init__()\n assert d_model % num_heads == 0\n \n self.d_model = d_model\n self.num_heads = num_heads\n self.d_k = d_model // num_heads\n \n # Linear projections for Q, K, V\n self.W_q = nn.Linear(d_model, d_model)\n self.W_k = nn.Linear(d_model, d_model)\n self.W_v = nn.Linear(d_model, d_model)\n \n # Output projection\n self.W_o = nn.Linear(d_model, d_model)\n \n self.attention = ScaledDotProductAttention(self.d_k)\n \n def forward(self, query, key, value, mask=None):\n batch_size = query.size(0)\n \n # Linear projections and reshape for multi-head", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_36", "embedding": [ 0.023332955315709114, -0.04248465597629547, -0.040270544588565826, -0.005037445574998856, -0.017960237339138985, 0.007575538940727711, 0.01178137119859457, 0.02246740274131298, -0.04176784306764603, 0.03695886582136154, 0.03900818154215813, -0.08605153858661652, 0.07049506157636642, -0.00344151072204113, -0.032807815819978714, -0.02732541598379612, -0.0265053678303957, 0.07630754262208939, -0.06321042776107788, -0.0003797637764364481, 0.03923071548342705, 0.05287761241197586, 0.050708115100860596, 0.027165276929736137, 0.0006080653984099627, -0.024702729657292366, -0.0190341304987669, 0.00031083449721336365, 0.0024556631688028574, -0.0412471741437912, 0.03523919731378555, -0.008728189393877983, -0.07164408266544342, 0.06453215330839157, 0.03752915561199188, 0.044062644243240356, -0.0518135130405426, 0.018780596554279327, -0.082396000623703, 0.0058253975585103035, 0.06989365071058273, 0.041103024035692215, -0.07203178107738495, -0.04846001788973808, 0.061641253530979156, 0.08607061207294464, -0.08518978208303452, -0.01862495206296444, 0.042973197996616364, -0.10404502600431442, -0.05880961939692497, -0.07115624845027924, -0.028128748759627342, 0.023487674072384834, -0.02276149019598961, 0.0355645976960659, 0.019847888499498367, -0.050201743841171265, 0.01130733359605074, -0.019625278189778328, -0.07215482741594315, -0.03480483219027519, 0.04698872193694115, -0.0192920733243227, 0.01677566021680832, 0.003678696695715189, -0.0364660881459713, 0.002844124101102352, -0.04650096595287323, 0.0645366683602333, -0.06314103305339813, -0.017011340707540512, -0.01205222588032484, -0.09330755472183228, 0.017418676987290382, -0.06357739865779877, 0.08176939934492111, -0.03897435590624809, 0.017001884058117867, -0.0020407107658684254, -0.058205850422382355, -0.003317120485007763, -0.011777724139392376, -0.013010791502892971, 0.11628903448581696, -0.0643053650856018, -0.036207664757966995, 0.00047459269990213215, -0.012210285291075706, 6.442784797400236e-05, -0.048131439834833145, -0.039802126586437225, -0.08403167128562927, -0.01854916475713253, 0.03831588104367256, 0.007923439145088196, -0.04749724641442299, 0.021635154262185097, 0.054158829152584076, 0.03349324315786362, 0.045521900057792664, -0.10052426159381866, -0.036393605172634125, -0.003822283586487174, 0.019243456423282623, 0.05796932801604271, 0.030737414956092834, 0.014169161207973957, 0.010236085392534733, -0.10017523169517517, 0.021534893661737442, -0.052368149161338806, 0.001561707933433354, -0.008764074184000492, 0.04190259426832199, 0.019548216834664345, -0.019854452461004257, 0.055145781487226486, 0.016739189624786377, -0.0860123559832573, 0.02516237273812294, -0.02709643542766571, 0.039228133857250214, -0.03748709708452225, 0.0027903588488698006, -0.009041671641170979, -0.05526456981897354, 1.3086944829952573e-33, 0.0034164029639214277, 0.01580384373664856, 0.014883756637573242, -0.032550737261772156, 0.04068092256784439, 0.09795407205820084, 0.06621073931455612, 0.03402741253376007, -0.048976052552461624, -0.03891247510910034, -0.04097970202565193, 0.01153919380158186, 0.012123520486056805, 0.02875594235956669, -0.11209941655397415, -0.0450376532971859, 0.010037108324468136, 0.1373799592256546, -0.04960905387997627, 0.00758465426042676, 0.10494513809680939, 0.04196534305810928, -0.00113971927203238, -0.06339387595653534, -0.028327804058790207, 0.03992120921611786, -0.03806336224079132, -0.00803002156317234, -0.12072206288576126, 0.025591425597667694, -0.10568662732839584, 0.019899215549230576, -0.07275582104921341, -0.004802187439054251, -0.021563230082392693, -0.0521523542702198, 0.012554113753139973, 0.005253102630376816, 0.025108687579631805, -0.06971041858196259, -0.01317281648516655, 0.07529891282320023, -0.011506467126309872, -0.08046098798513412, -0.1176331415772438, 0.01789611019194126, -0.029306257143616676, 0.12061712145805359, -0.08003024756908417, -0.012285539880394936, 0.07247598469257355, -0.021246137097477913, -0.007664413191378117, -0.08918529748916626, -0.0424700565636158, 0.026819372549653053, 0.01638779789209366, 0.07349113374948502, 0.10140780359506607, 0.0012068642536178231, 0.001411809935234487, 0.027517979964613914, -0.10631954669952393, 0.03141963854432106, 0.06324896961450577, 0.03472299501299858, 0.037431396543979645, 0.07020791620016098, 0.0973038524389267, 0.055725790560245514, 0.016023194417357445, 0.04800762981176376, -0.08244070410728455, -0.032287728041410446, 0.05618568882346153, -0.05070386081933975, 0.021245867013931274, -0.031520552933216095, -0.04109540954232216, 0.029210709035396576, 0.017105400562286377, 0.14994864165782928, -0.09971551597118378, -0.1000976487994194, 0.015506893396377563, -0.05036427825689316, 0.0055921804159879684, -0.049666836857795715, -0.0846237912774086, -0.0405169278383255, 0.0066356295719742775, -0.06646910309791565, 0.002263617468997836, -0.006290764547884464, -0.08748090267181396, -3.0544857037552355e-33, 0.10728031396865845, 0.08986839652061462, 0.03849495202302933, 0.01958431676030159, 0.01939125917851925, -0.02809547819197178, 0.010392514057457447, 0.003261659760028124, -0.049367014318704605, -0.07318972051143646, -0.062336768954992294, -0.08757250010967255, 0.05721044912934303, 0.03367329016327858, 0.11996033042669296, 0.0223640538752079, -0.000600285129621625, 0.0017840408254414797, -0.05410023033618927, -0.04013945162296295, -0.031869664788246155, 0.07780135422945023, -0.13149096071720123, 0.013942867517471313, -0.038931138813495636, -0.025831839069724083, -0.06968571245670319, 0.08340806514024734, 0.015784088522195816, -0.04144737124443054, -0.05152616277337074, -0.02714408002793789, -0.07359998673200607, 0.025885898619890213, -0.02914915233850479, 0.07988949865102768, -0.02233891375362873, -0.04551335424184799, -0.005250353366136551, 0.10670075565576553, 0.05273625627160072, -0.0012662399094551802, 0.023137729614973068, 0.032412659376859665, -0.010193834081292152, 0.020050860941410065, -0.042950842529535294, 0.025564026087522507, -0.052894920110702515, 0.052507780492305756, -0.07035333663225174, 0.003054535947740078, -0.017139209434390068, 0.03209609165787697, -0.10448991507291794, 0.05322924628853798, -0.03546980023384094, 0.022037772461771965, -0.016304200515151024, -0.11246473342180252, 0.042746081948280334, -0.11150889098644257, 0.023341171443462372, 0.033695392310619354, 0.03579535335302353, 0.02684161625802517, -0.01977992057800293, -0.0708959624171257, -0.011810568161308765, -0.02015351504087448, -0.03428466618061066, 0.04809638485312462, 0.03444793447852135, -0.012283778749406338, 0.008875231258571148, 0.031197723001241684, -0.06598144769668579, -0.010300679132342339, 0.0446181483566761, 0.09707266837358475, -0.0872424766421318, -0.03294076398015022, 0.08640329539775848, 0.09895631670951843, -0.021092182025313377, 0.05858267471194267, 0.09773553907871246, 0.12028161436319351, 0.00845852680504322, -0.09188640862703323, 0.014503038488328457, 0.03663872182369232, 0.045708153396844864, 0.1257268190383911, 0.027332156896591187, -5.404524472396588e-08, -0.046529583632946014, -0.02278595045208931, 0.048505641520023346, 0.06897509843111038, 0.0043917205184698105, -0.007690065540373325, 0.0263078510761261, 0.05215291678905487, -0.004245822783559561, 0.007960815913975239, 0.05217393860220909, -0.03447473794221878, 0.042063988745212555, 0.026607880368828773, -0.00643323827534914, 0.0020216668490320444, -0.05778038129210472, -0.014114773832261562, 0.0057088411413133144, -0.06417280435562134, -0.0693921148777008, 0.023069389164447784, 0.023530350998044014, 0.04538160562515259, -0.03747071698307991, -0.03110901266336441, -0.00933222845196724, 0.07524505257606506, 0.009766004048287868, -0.034232500940561295, -0.0024537008721381426, 0.005730820819735527, -0.006539099384099245, 0.010172359645366669, -0.004514070227742195, 0.0018798861419782043, 0.023235192522406578, 0.07659076154232025, 0.04712063819169998, 0.015986744314432144, -0.0488056056201458, 0.067256398499012, -0.036022115498781204, 0.05987808108329773, 0.08513454347848892, 0.04132113233208656, -0.017352567985653877, -0.02567119523882866, 0.012325551360845566, -0.018785351887345314, 0.020180324092507362, -0.022082066163420677, -0.00818717386573553, 0.056570544838905334, -0.035919029265642166, 0.02193327248096466, 0.0095448587089777, 0.006331153213977814, -0.028311634436249733, 0.04773806780576706, -0.0009526195353828371, 0.040094777941703796, -0.0561145581305027, -0.008672446012496948 ] }, { "text": "batch_size = query.size(0)\n \n # Linear projections and reshape for multi-head\n Q = self.W_q(query).view(batch_size, -1, self.num_heads, self.d_k).transpose(1, 2)\n K = self.W_k(key).view(batch_size, -1, self.num_heads, self.d_k).transpose(1, 2)\n V = self.W_v(value).view(batch_size, -1, self.num_heads, self.d_k).transpose(1, 2)\n # Q, K, V shape: [batch, num_heads, seq_len, d_k]\n \n # Reshape for batch matrix multiplication\n Q = Q.reshape(batch_size * self.num_heads, -1, self.d_k)\n K = K.reshape(batch_size * self.num_heads, -1, self.d_k)\n V = V.reshape(batch_size * self.num_heads, -1, self.d_k)\n \n # Apply attention\n attended, weights = self.attention(Q, K, V, mask)", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_37", "embedding": [ -0.01304690446704626, -0.018504463136196136, -0.07023835927248001, 0.014692988246679306, -0.12201937288045883, -0.030027665197849274, 0.0023594314698129892, -0.01777813769876957, -0.11030511558055878, -0.001743913278914988, 0.0006228351849131286, -0.05838833749294281, 0.005191036965698004, -0.009470207616686821, -0.05623922497034073, 0.047074928879737854, -0.03918490931391716, 0.09588631242513657, -0.07983666658401489, -0.010435334406793118, -0.028489166870713234, 0.0373912937939167, 0.012856200337409973, -0.011683709919452667, 0.0699857696890831, 0.014922218397259712, -0.007580578327178955, 0.008969321846961975, -0.030957117676734924, -0.04225593060255051, 0.010895769111812115, 0.036129679530858994, -0.006616546306759119, 0.025385471060872078, 0.041874438524246216, -0.03321334347128868, -0.009869166649878025, 0.04165675491094589, -0.018665635958313942, 0.060508668422698975, 0.11601496487855911, 0.06759172677993774, -0.08307188749313354, -0.01622834801673889, 0.022684605792164803, 0.07467559725046158, -0.06753505021333694, -0.003954840358346701, 0.033587969839572906, -0.06044550612568855, -0.07621551305055618, 0.015909602865576744, -0.010359460487961769, 0.05992940068244934, -0.09485672414302826, -0.03610575944185257, 0.058592539280653, -0.04099787771701813, -0.02296445332467556, 0.010725470259785652, -0.0044615441001951694, -0.058938171714544296, 0.06175549700856209, -0.022334923967719078, -0.017726518213748932, -0.025981923565268517, -0.017027609050273895, 0.008259867317974567, -0.027222679927945137, 0.057120390236377716, -0.06646444648504257, -0.020732292905449867, 0.006788883823901415, -0.07359728962182999, -0.1015862226486206, -0.05847441405057907, 0.08388057351112366, -0.043885380029678345, 0.028243066743016243, -0.008808545768260956, -0.012773030437529087, 0.005141694564372301, 0.010389775037765503, -0.02389131300151348, 0.06927565485239029, -0.06396155804395676, -0.02736787497997284, -0.009411705657839775, -0.013409031555056572, -0.035302743315696716, -0.03894808515906334, -0.002205024939030409, -0.06511813402175903, -0.04811830073595047, 0.06753115355968475, 0.00933656096458435, 0.016480278223752975, 0.032130155712366104, 0.049270860850811005, 0.010435170494019985, 0.038334235548973083, -0.07588982582092285, -0.014863892458379269, -0.017364582046866417, -0.03424736484885216, 0.06913896650075912, 0.01666247844696045, 0.061511218547821045, 0.021724047139286995, -0.1185731366276741, 0.053672175854444504, -0.007342553231865168, 0.01517550740391016, 0.013889480382204056, 0.063414566218853, 0.0011291446862742305, 0.03874067962169647, 0.030024738982319832, -0.05588700622320175, -0.04890331253409386, -0.0055403015576303005, 0.01201785821467638, 0.021161267533898354, -0.04418935626745224, -0.039161719381809235, -0.012662610970437527, -0.0646720677614212, 1.9605014169159116e-33, -0.05646635964512825, 0.03647732734680176, -0.0024430768098682165, -0.06323746591806412, 0.06138069927692413, 0.055678073316812515, 0.043599460273981094, -0.0015353730414062738, -0.04339752346277237, -0.0324501097202301, -0.023892033845186234, -0.017063092440366745, 0.017389774322509766, -0.013643709011375904, -0.12781386077404022, -0.0038187308236956596, -0.02524583227932453, 0.09858500957489014, -0.03184250742197037, -0.10466336458921432, 0.09913281351327896, 0.011266615241765976, -0.013804045505821705, 0.00395934097468853, -0.09021338075399399, -0.01936720684170723, 0.010025857016444206, -0.02177688665688038, -0.11285410076379776, -0.030517395585775375, -0.1017262265086174, 0.03904351219534874, -0.04371314123272896, -0.07434394955635071, 0.012997755780816078, -0.061272550374269485, 0.05568167194724083, -0.0008418547222390771, 0.08440274000167847, -0.05176727473735809, -0.004136803559958935, 0.07673321664333344, 0.004812648985534906, -0.09053090959787369, -0.11736268550157547, 0.05081599950790405, 0.003944615367799997, 0.1363326609134674, -0.005848809145390987, 0.019422009587287903, 0.0041745370253920555, -0.04217519611120224, 0.024499893188476562, -2.1535686300921952e-06, 0.006910863798111677, 0.007438631262630224, 0.061389293521642685, 0.03515218198299408, 0.10327524691820145, 0.03935816138982773, -0.028571486473083496, -0.019216271117329597, -0.09412124752998352, 0.03572992607951164, 0.022611359134316444, -0.0188751257956028, 0.09650935977697372, 0.08957556635141373, 0.01992923952639103, 0.10462126135826111, -0.0012550780083984137, 0.034374892711639404, -0.0364014096558094, -0.04197600483894348, 0.030610090121626854, -0.06786706298589706, 0.09053095430135727, -0.005716684740036726, -0.08760664612054825, 0.0537400022149086, 0.021865781396627426, 0.17963607609272003, -0.04633417725563049, -0.13690759241580963, -0.03219258412718773, -0.10155073553323746, 0.006691369228065014, -0.07454651594161987, -0.01838316023349762, -0.05695227533578873, -0.029178878292441368, 0.008260565809905529, 0.031113730743527412, 0.014701803214848042, -0.05930414795875549, -2.2644054611828516e-33, 0.0689396783709526, 0.070878766477108, 0.02911807782948017, -0.00931406021118164, -0.019534127786755562, -0.01695236936211586, 0.032408226281404495, 0.013636568561196327, -0.04448607563972473, -0.0836869552731514, -0.053959280252456665, -0.06247590854763985, 0.04389354959130287, 0.024392062798142433, 0.09801657497882843, 0.029248278588056564, 0.030235530808568, 0.04409835487604141, -0.02851860597729683, -0.07051916420459747, 0.01409305538982153, 0.06969501078128815, -0.09547334909439087, 0.027515647932887077, -0.07607079297304153, 0.002997210482135415, -0.03452976793050766, 0.013293545693159103, 0.035337962210178375, -0.04612730070948601, -0.019981781020760536, -0.07713543623685837, -0.037610698491334915, 0.0666886419057846, -0.007355839014053345, 0.05714625120162964, -0.026175789535045624, -0.016108360141515732, -0.029589874669909477, 0.0273765716701746, -0.006013767793774605, -0.0015369461616501212, 0.02722960151731968, 0.03566761314868927, -0.01923620142042637, 0.022153345867991447, 0.0048365481197834015, 0.01628059521317482, -0.05530250817537308, 0.036148399114608765, -0.011986810714006424, 0.008982038125395775, -0.05535717308521271, 0.03381890803575516, -0.04314884543418884, 0.014725965447723866, -0.04469843581318855, 0.0014002480311319232, -0.012195929884910583, -0.09232163429260254, -0.010728677734732628, -0.1199837177991867, 0.005096783395856619, 0.0018464610911905766, -0.003940407652407885, 0.03672230988740921, 0.033134039491415024, -0.010379163548350334, -0.029122354462742805, 0.03311334550380707, -0.01223063562065363, -0.01564670540392399, 0.08102389425039291, -0.013653254136443138, -0.05282722786068916, -0.002573313657194376, -0.05605379119515419, 0.03556119650602341, 0.027072373777627945, 0.10673993080854416, -0.03603780269622803, -0.051080819219350815, 0.05645599588751793, 0.11236622929573059, 0.00917453970760107, 0.08964318782091141, 0.04919515922665596, 0.08109761774539948, 0.04562779515981674, -0.024422846734523773, 0.019091771915555, -0.019322967156767845, 0.07819290459156036, 0.11317845433950424, 0.08189269155263901, -4.2860996529725526e-08, -0.015299743041396141, -0.020887285470962524, 0.04812420532107353, 0.07166167348623276, -0.014806061051785946, -0.04339402914047241, 0.019461780786514282, 0.09853383153676987, -0.008427719585597515, 0.0036570874508470297, 0.014450190588831902, -0.03730551525950432, 0.005267580971121788, 0.03890247270464897, -0.03040967509150505, 0.0038849562406539917, -0.09407923370599747, 0.01165783405303955, 0.07207583636045456, -0.05212650075554848, -0.051430340856313705, 0.000402932520955801, 0.031905435025691986, 0.08544305711984634, -0.047833673655986786, -0.0014391000149771571, -0.011461885645985603, 0.03110060654580593, 0.06254518777132034, -0.02895152010023594, 0.0038450041320174932, -0.008205019868910313, 0.05803868919610977, 0.04481121525168419, 0.006576382555067539, -0.09545441716909409, -0.0044920179061591625, 0.08125273883342743, 0.0064513953402638435, 0.002906573237851262, -0.09329064190387726, 0.07145802676677704, 0.0532153956592083, 0.060589611530303955, 0.07118494063615799, 0.04496222361922264, -0.014453068375587463, 0.005386405624449253, 0.051732514053583145, -0.017813025042414665, 0.057785727083683014, -0.03792544826865196, 0.03086700849235058, 0.0390281081199646, -0.03567734733223915, 0.06496787071228027, -0.040607500821352005, 0.04300816357135773, 0.08149866759777069, 0.02275492064654827, -0.01337851956486702, -0.0018530570669099689, -0.07263331860303879, -0.040560778230428696 ] }, { "text": "# Apply attention\n attended, weights = self.attention(Q, K, V, mask)\n \n # Reshape back\n attended = attended.view(batch_size, self.num_heads, -1, self.d_k)\n attended = attended.transpose(1, 2).contiguous().view(batch_size, -1, self.d_model)\n \n # Final linear projection\n output = self.W_o(attended)\n \n return output", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_38", "embedding": [ 0.04620984569191933, -0.02318922057747841, -0.06428420543670654, 0.0419963039457798, -0.03168654814362526, 0.002797229215502739, -0.014210419729351997, -0.04298071190714836, -0.07089629024267197, -0.01297045685350895, 0.007118814159184694, -0.01807493343949318, 0.0006488954531960189, -0.00867275521159172, -0.07169286161661148, 0.03276946395635605, 0.05328427255153656, 0.0717034786939621, -0.04321761801838875, -0.04808180034160614, 0.011859574355185032, 0.06838049739599228, 0.033296454697847366, 0.015478667803108692, 0.038162630051374435, 0.014579390175640583, 0.01501106470823288, -0.014866315759718418, 0.0073156836442649364, -0.036847345530986786, 0.03177809342741966, -0.02823321707546711, 0.06550371646881104, 0.04826769977807999, 0.029132893308997154, -0.014292830601334572, -0.08037453144788742, 0.04131680727005005, -0.05562784895300865, 0.002516659675166011, 0.06092285364866257, 0.0696764588356018, -0.0564245842397213, -0.011961245909333229, 0.0343487411737442, 0.016994934529066086, -0.019331762567162514, -0.002762437565252185, 0.047177817672491074, -0.08643395453691483, -0.019730404019355774, -0.04183792695403099, 0.02657337859272957, 0.04759591072797775, -0.07425741851329803, 0.02221808396279812, 0.068231500685215, -0.07170316576957703, -0.03963331878185272, 0.002650653012096882, -0.06316561996936798, -0.033687982708215714, -0.010588296689093113, -0.02243027836084366, 0.02001189813017845, -0.02346123196184635, -0.04596493020653725, 0.04253048449754715, 0.0016951117431744933, 0.06331564486026764, 0.009519267827272415, 0.018588436767458916, 0.05511618033051491, -0.10152885317802429, 0.010932321660220623, -0.04295515641570091, 0.07779722660779953, -0.06319800764322281, 0.10123807191848755, -0.01089349202811718, 0.024395277723670006, -0.02411782182753086, 0.049157049506902695, -0.03322935104370117, 0.06809425354003906, -0.017325831577181816, -0.04130535572767258, 0.017505623400211334, -0.019348585978150368, -0.03230629861354828, -0.05396024137735367, -0.03326940909028053, -0.1000325158238411, 0.015692580491304398, -0.0007007778622210026, -0.015237487852573395, 0.042562175542116165, 0.017097605392336845, 0.03893881291151047, 0.021905267611145973, -0.000986674102023244, -0.03320197016000748, -0.010399449616670609, -0.04176649451255798, -0.04579152911901474, 0.027428051456809044, 0.034123495221138, 0.10020298510789871, -0.006333006080240011, -0.08673156052827835, 0.07353654503822327, -0.021721182391047478, 0.03042888455092907, 0.041679855436086655, 0.09497173130512238, -0.04933052510023117, 0.06382129341363907, 0.025494221597909927, -0.05638303980231285, -0.023307526484131813, 0.01622205600142479, 0.010153844952583313, -6.0748094256268814e-05, -0.015349997207522392, -0.009833648800849915, -0.07779409736394882, -0.024125348776578903, 1.3447215481380372e-33, -0.04034209996461868, -0.0012348437448963523, -0.028353530913591385, -0.05125095322728157, 0.04501733556389809, 0.03509514406323433, 0.014485809952020645, -0.07250749319791794, -0.022674400359392166, -0.046493127942085266, -0.020349441096186638, 0.014081545174121857, 0.038897667080163956, 0.04471394419670105, -0.1315862238407135, -0.04074559360742569, 0.03949550539255142, 0.1654627025127411, -0.06965629756450653, -0.04401989281177521, -0.01516943983733654, 0.04634401202201843, -0.02586766518652439, -0.03612302243709564, -0.05070215091109276, -0.006323437672108412, 0.007251082453876734, -0.01363794319331646, -0.10226045548915863, 0.00540796248242259, -0.09495693445205688, 0.06966361403465271, -0.020265299826860428, -0.03603992983698845, -0.042804185301065445, -0.0306090135127306, 0.08895263075828552, 0.006190120708197355, 0.09556819498538971, -0.0658663660287857, 0.027789894491434097, 0.11230103671550751, 0.02886679396033287, -0.04234323278069496, -0.10709646344184875, 0.00852761697024107, -0.011176557280123234, 0.11541993170976639, 0.0019835312850773335, 0.0670199915766716, 0.038227494806051254, -0.07666461914777756, -0.004288180731236935, -0.03169560432434082, -0.04809872806072235, -0.03340169042348862, 0.09748847782611847, 0.09333916753530502, 0.13461612164974213, 0.020281150937080383, 0.03600738197565079, 0.027727950364351273, -0.0751345083117485, 0.04239242523908615, 0.03226735442876816, -0.03610454499721527, -0.02157013863325119, 0.011953452602028847, 0.026668427512049675, 0.11478646844625473, -0.051475223153829575, 0.0606456995010376, -0.0372435636818409, 0.019616657868027687, 0.03828442096710205, -0.04504593834280968, 0.07641367614269257, -0.020492160692811012, -0.04921047389507294, 0.03650422766804695, 0.02911444753408432, 0.10533519834280014, -0.08297131955623627, -0.09808266907930374, -0.020410794764757156, -0.01773925870656967, -0.016374919563531876, -0.03454484045505524, -0.04906155541539192, -0.03682024031877518, -0.028048356994986534, -0.025962550193071365, 0.015545910224318504, 0.013717005029320717, -0.049407958984375, -1.0831744224220629e-33, 0.09396738559007645, 0.17901483178138733, 0.025301523506641388, -0.055416040122509, 0.011958558112382889, 0.004704886116087437, 0.0014921438414603472, 0.026897329837083817, -0.05036093294620514, -0.03245564177632332, -0.023739077150821686, -0.1093643456697464, 0.01637069694697857, 0.048578791320323944, 0.10109321027994156, -0.007443539798259735, 0.0627501979470253, -0.010722251608967781, -0.10070523619651794, -0.04473801329731941, -0.025300785899162292, 0.02463049255311489, -0.058568764477968216, -0.010034486651420593, -0.06743807345628738, -0.011956289410591125, -0.013905193656682968, 0.05590202286839485, 0.027071848511695862, -0.08667835593223572, -0.04733145609498024, -0.0917353630065918, -0.018339047208428383, 0.05664221942424774, -0.036706652492284775, 0.11116056889295578, -0.003079478396102786, -0.010853390209376812, -0.01639495976269245, 0.014709432609379292, 0.0022809868678450584, -0.002927204826846719, -0.026013951748609543, 0.03985476493835449, -0.029002882540225983, 0.024871602654457092, -0.012879929505288601, -0.022270098328590393, -0.07243448495864868, -0.02687455713748932, -0.08318223059177399, 0.0029585720039904118, -0.06336849182844162, 0.021396659314632416, -0.09020016342401505, -0.008921914733946323, -0.005336080677807331, 0.0003469428338576108, -0.0011125609744340181, -0.10033050179481506, 0.016378505155444145, -0.08912372589111328, 0.00811350904405117, -0.052440982311964035, 0.015836436301469803, 0.018828434869647026, 0.05025337636470795, -0.03336438909173012, -0.012843219563364983, 0.036798108369112015, 0.01168442890048027, 0.04661604389548302, 0.07614890486001968, 0.051161423325538635, -0.01349185686558485, -0.009140726178884506, -0.06509564071893692, 0.019381161779165268, 0.013727664947509766, 0.057565730065107346, -0.08405150473117828, -0.03725939989089966, 0.07688383758068085, 0.052614301443099976, 0.05983320251107216, 0.12148457765579224, 0.08409953117370605, 0.03532841429114342, 0.003409752156585455, -0.034939706325531006, 0.017611855641007423, -0.0004095894400961697, 0.10090035945177078, 0.05622357502579689, 0.09314586967229843, -4.0243840260245634e-08, -0.07021524012088776, -0.0679934173822403, 0.05260356515645981, 0.04345938190817833, -0.01748448982834816, -0.048558201640844345, 0.03643014281988144, 0.08085398375988007, -0.019504746422171593, -0.018119603395462036, 0.002996612573042512, -0.05989808589220047, 0.022399233654141426, 0.017753204330801964, -0.014509331434965134, 0.0595831573009491, -0.06862594187259674, 0.008841129951179028, 0.004908902104943991, -0.05841036140918732, -0.05193429812788963, 0.004943837411701679, -0.0041085523553192616, 0.09729660302400589, -0.0100446417927742, 0.013328300788998604, -0.05481227487325668, 0.03766852989792824, 0.03417801856994629, -0.07249362021684647, 0.06107562035322189, -0.00227497355081141, 0.01019011065363884, 0.0034225594718009233, -0.007683394942432642, -0.012857374735176563, 0.003060143906623125, 0.031534526497125626, -0.004130139015614986, 0.04386058449745178, -0.07629226893186569, 0.009577538818120956, 0.06048164144158363, 0.0721963569521904, 0.09862537682056427, 0.050445448607206345, -0.03544469177722931, -0.053664352744817734, 0.03199290484189987, -0.10383664071559906, 0.058953966945409775, -0.05838144198060036, -0.049109313637018204, 0.030840208753943443, -0.04380108043551445, 0.02541741542518139, 0.003395519917830825, 0.02569078840315342, 0.018580390140414238, 0.014997567981481552, 0.01878330670297146, 0.04350821673870087, -0.12604425847530365, -0.02746044658124447 ] }, { "text": "# Example\nmha = MultiHeadAttention(d_model=512, num_heads=8)\nx = torch.randn(4, 30, 512) # Batch=4, SeqLen=30, Dim=512\noutput = mha(x, x, x) # Self-attention\nprint(f\"Multi-head attention output: {output.shape}\") # [4, 30, 512]\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_39", "embedding": [ 0.06104638800024986, -0.0101694967597723, -0.04615868255496025, 0.03553188592195511, -0.0037669974844902754, 0.003229351481422782, 0.0043074763379991055, 0.019576415419578552, -0.03860020637512207, -0.04600277915596962, 0.062108613550662994, -0.09587642550468445, -0.023026863113045692, -0.005145576316863298, 0.027200978249311447, 0.044869132339954376, -0.05603130906820297, 0.038398776203393936, -0.04851703345775604, -0.052267786115407944, 0.12679658830165863, 0.027498938143253326, 0.08704136312007904, 0.00773212593048811, -0.040352463722229004, -0.0163330789655447, -0.010817771777510643, 0.0038642906583845615, -0.011968202888965607, -0.06783056259155273, 0.10565947741270065, 0.01453969907015562, -0.053770873695611954, 0.06540706753730774, 0.026347044855356216, -0.0016772381495684385, -0.10859782993793488, 0.05486859008669853, -0.022704284638166428, -0.004668974783271551, 0.022254088893532753, 0.036425378173589706, -0.017677107825875282, -0.058029595762491226, 0.04019788280129433, 0.03356222063302994, -0.04139528423547745, -0.057034630328416824, 0.015665309503674507, -0.05047500506043434, 0.02439112588763237, -0.10110283643007278, -0.029172856360673904, 0.039553724229335785, 0.050707291811704636, 0.010104259476065636, -0.01271791197359562, -0.06312236934900284, -0.06104998663067818, -0.004754498600959778, -0.04394827410578728, -0.008706624619662762, 0.003358909161761403, -0.07508409768342972, 0.0636175274848938, 0.005829789210110903, -0.03771812096238136, 0.0190543532371521, -0.08332056552171707, 0.004312805365771055, -0.01686929538846016, -0.042473554611206055, -0.008941120468080044, -0.12988464534282684, 0.032965078949928284, -0.0012104088673368096, 0.03411346673965454, -0.01616624929010868, 0.040538594126701355, -0.0463600791990757, -0.06748358905315399, 0.03194066137075424, 0.06380105018615723, 0.036284755915403366, 0.08303149789571762, 0.058350302278995514, -0.061034880578517914, 0.02115779183804989, -0.036388833075761795, 0.005413300357758999, -0.07079911231994629, -0.0627632886171341, -0.0834028497338295, 0.0162400733679533, -0.013754475861787796, 0.016022847965359688, 0.012550103478133678, -0.00968809425830841, -0.01875489391386509, 0.010198889300227165, 0.02462199702858925, -0.05475043132901192, 0.017323831096291542, 0.012564307078719139, -0.022907651960849762, 0.04604172706604004, 0.03526975214481354, 0.046995166689157486, -0.034443944692611694, -0.08651432394981384, 0.09852207452058792, 0.004806215409189463, 0.014514866285026073, -0.04021691530942917, 0.07694899290800095, -0.018286027014255524, -0.049178656190633774, 0.021396454423666, 0.06191191449761391, -0.022400453686714172, -0.031107807531952858, -0.024490240961313248, -0.022975442931056023, -0.020867131650447845, -0.011310987174510956, -0.04030121862888336, -0.040847133845090866, 3.215159985807303e-33, 0.00653427978977561, 0.03888439014554024, -0.04877535626292229, 0.0052104429341852665, -0.011323174461722374, 0.05038886517286301, 0.06454828381538391, -0.0776749923825264, -0.06957732141017914, 0.016557352617383003, -0.002543901326134801, -0.016387052834033966, 0.0035896096378564835, 0.04603800177574158, -0.13314051926136017, -0.0712428167462349, 0.0729166641831398, 0.11604686826467514, -0.06128767877817154, 0.012500138953328133, 0.03331518918275833, 0.1253572702407837, -0.03203814849257469, -0.07271481305360794, -0.042595572769641876, 0.0776912197470665, -0.032366979867219925, -0.03168449550867081, -0.04565182700753212, 0.039929263293743134, -0.04071551933884621, 0.049534544348716736, 0.02519962377846241, -0.06635952740907669, -0.0110275037586689, -0.04465458542108536, -0.01977860927581787, 0.013473059050738811, -0.006013349164277315, -0.05688462406396866, 0.0438554622232914, 0.0888226255774498, 0.02192067727446556, -0.06571531295776367, -0.1468614935874939, 0.09491060674190521, -0.09447245299816132, 0.08723318576812744, 0.004480594303458929, -0.0044255852699279785, 0.00566651439294219, -0.0036991380620747805, 0.019413771107792854, 0.030375707894563675, 0.02342597395181656, -0.015272132121026516, -0.04543710872530937, 0.06702326238155365, 0.14005674421787262, -0.00692062359303236, 0.01205393485724926, 0.07767964899539948, -0.08747078478336334, 0.020210837945342064, 0.0027644799556583166, -0.01137276366353035, 0.0657276138663292, 0.06888262182474136, 0.03175785019993782, 0.054018933326005936, -0.05855843797326088, 0.05229545012116432, -0.05048895627260208, -0.026445316150784492, -0.007426813710480928, -0.04631529003381729, 0.07308684289455414, -0.032366782426834106, 0.05308971181511879, 0.046251215040683746, 0.024264894425868988, 0.1514148712158203, -0.03874724730849266, -0.1249137818813324, 0.014910180121660233, -0.008037500083446503, -0.008081387728452682, -0.06997902691364288, -0.08293401449918747, -0.040102601051330566, -0.025775860995054245, -0.05406486243009567, 0.04220305010676384, -0.05472829192876816, -0.11736050993204117, -3.434704861658474e-33, 0.07234697043895721, 0.07385801523923874, -0.012203671038150787, -0.00038577901432290673, 0.011039389297366142, 0.015015294775366783, 0.07856053858995438, -0.0486953929066658, -0.08911819010972977, -0.034024011343717575, -0.024458056315779686, -0.027463974431157112, -0.03877099230885506, -0.0012954447884112597, 0.10584325343370438, -0.0263950414955616, -0.0030176187865436077, -0.024473009631037712, 0.008472814224660397, -0.031167594715952873, -0.016062745824456215, 0.03474383056163788, -0.04605283960700035, 0.03988621383905411, -0.04601381719112396, -0.008167250081896782, -0.04184411093592644, 0.015581202693283558, 0.01579880714416504, -0.0288175567984581, -0.016525553539395332, -0.007325717713683844, 0.010906927287578583, 0.07146189361810684, -0.06677792966365814, -0.0071647982113063335, 0.02861473150551319, 0.004107902757823467, 0.014077991247177124, 0.08542132377624512, 0.022951483726501465, -0.010555663146078587, 0.01810912787914276, 0.10624504089355469, -0.03667773678898811, 0.06530342251062393, -0.0866544246673584, 0.022091034799814224, -0.024034440517425537, 0.04632142558693886, -0.07532023638486862, -0.10545680671930313, -0.060574669390916824, -0.0016800790326669812, -0.1000240370631218, -0.019045813009142876, 0.018756186589598656, -0.0016061419155448675, -0.009707806631922722, -0.02235138602554798, -0.0022323373705148697, -0.10839018225669861, 0.02838193252682686, 0.002781811635941267, 0.027858329936861992, 0.013969851657748222, 0.018203936517238617, -0.14313529431819916, -0.023162491619586945, 0.008933326229453087, 0.018529970198869705, 0.040174700319767, -0.005488577298820019, 0.001380829606205225, -0.00897515844553709, -0.002420972101390362, -0.06614293158054352, 0.008538815192878246, 0.040374286472797394, 0.023275980725884438, -0.06495410203933716, 0.007838466204702854, 0.0234365351498127, 0.08703917264938354, 0.053445424884557724, 0.03500945493578911, 0.05976066738367081, 0.07803400605916977, -0.0023954391945153475, -0.10664261132478714, 0.008141238242387772, 0.07478649169206619, 0.12214422225952148, 0.06740807741880417, -0.00742675457149744, -4.348969895318078e-08, -0.015816358849406242, -0.09257274866104126, 0.034104831516742706, 0.017039014026522636, -0.08305590599775314, -0.006475946865975857, 0.010868261568248272, 0.0612744465470314, 0.008286608383059502, 0.008582687005400658, 0.08020401746034622, -0.07417281717061996, -0.02360844798386097, 0.00674466323107481, 0.03219163045287132, 0.011078191921114922, -0.014665260910987854, 0.05016261339187622, -0.02182910591363907, -0.12104713171720505, -0.03439749404788017, 0.039661698043346405, 0.07007762044668198, -0.021513042971491814, -0.05087249353528023, -0.01816944032907486, -0.015752272680401802, 0.08160503208637238, -0.019177423790097237, -0.07722598314285278, 0.07508791983127594, 0.004093120340257883, 0.016853298991918564, 0.009492670185863972, 0.0015563308261334896, -0.001902519492432475, 0.027430888265371323, 0.06270163506269455, 0.0642319843173027, 0.05335531383752823, -0.011937742121517658, 0.023553086444735527, 0.01609041355550289, 0.04829700291156769, 0.09062625467777252, 0.026175659149885178, 0.0020276042632758617, -0.05960443243384361, -0.012393701821565628, 0.015664787963032722, 0.0338192917406559, 0.021053098142147064, -0.01578172668814659, 0.08274192363023758, -0.07760518044233322, -0.002297423081472516, 0.03801026940345764, 0.023699551820755005, -0.010096486657857895, -0.0016872341511771083, 0.07851391285657883, 0.0026894721668213606, -0.05966563522815704, -0.0209344532340765 ] }, { "text": "### Self-Attention with RNN\n\nCombining attention with RNNs for sequence classification.", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_40", "embedding": [ -0.05806244909763336, -0.08264189958572388, 0.06716697663068771, 0.004703470040112734, -0.0097137950360775, 0.09878864139318466, 0.03230363875627518, 0.013120001181960106, 0.012908801436424255, -0.1264464557170868, -0.06719410419464111, 0.0012766231084242463, -0.0870034396648407, 0.01846950501203537, -0.06635976582765579, 0.001337361754849553, 0.024773728102445602, -0.06596238166093826, -0.015000232495367527, -0.02825232967734337, 0.03690837696194649, 0.06120811402797699, 0.07766976952552795, 0.07214616984128952, 0.025271933525800705, -0.031252939254045486, 0.003194668795913458, -0.0175153985619545, 0.08079766482114792, 0.0085299639031291, 0.08433959633111954, 0.05289754644036293, 0.06298942118883133, 0.07277697324752808, -0.03188290446996689, 0.003348633414134383, -0.08537109196186066, -0.035038404166698456, -0.05676916986703873, -0.0073869721964001656, 0.030182313174009323, 0.000492950202897191, -0.010566836223006248, 0.03598199412226677, 0.06064465641975403, -0.028518464416265488, -0.02874879352748394, -0.006952558644115925, -0.02743382565677166, 0.0029600649140775204, -0.07022371888160706, 0.033478718250989914, -0.006769718136638403, 0.06850510090589523, -0.013382039964199066, 0.047488242387771606, -0.01614580862224102, -0.022198030725121498, 0.017712676897644997, 0.00780425826087594, 0.03917774185538292, -0.0431138314306736, 0.0016336910193786025, -0.040417108684778214, 0.042524974793195724, 0.016369478777050972, 0.006205625832080841, 0.11358890682458878, 0.0096097057685256, 0.055541958659887314, -0.006691802758723497, 0.058210816234350204, 0.023403439670801163, 0.02462753839790821, 0.05226346105337143, 0.08116775006055832, -0.006926929112523794, -0.04425495117902756, 0.027646437287330627, -0.06505250930786133, -0.07452335953712463, -0.04455971717834473, 0.045616984367370605, -0.01583927311003208, -0.020097993314266205, -0.023130016401410103, 0.0024254992604255676, 0.02356564626097679, -0.04108714312314987, 0.020445317029953003, -0.05399571359157562, -0.0769919827580452, 0.07960470020771027, -0.053091201931238174, 0.004245143849402666, 0.0601499006152153, 0.03610800951719284, 0.003095384221524, -0.06747104227542877, 0.022781020030379295, 0.02989814057946205, 0.02631743811070919, 0.029343256726861, 0.00919654406607151, -0.01810470037162304, 0.0021337918005883694, 0.06917612999677658, -0.049447670578956604, 0.08343903720378876, -0.06389179825782776, 0.029097378253936768, 0.00920774508267641, -0.031948257237672806, -0.12619230151176453, 0.04170060157775879, -0.03397542983293533, -0.07069488614797592, 0.0011936763767153025, 0.06603814661502838, 0.01234621461480856, 0.017802685499191284, -0.023957163095474243, -0.04998534172773361, 0.029035532847046852, 0.050522346049547195, -0.08639117330312729, -0.029733307659626007, 1.2563235923544839e-34, 0.04863891378045082, 0.012562391348183155, 0.07570304721593857, 0.012190476059913635, -0.007295615039765835, 0.003159896470606327, -0.01800565794110298, -0.010026645846664906, -0.04335658624768257, -0.03180596977472305, -0.0331570990383625, 0.023779716342687607, -0.0827556923031807, 0.005255264695733786, -0.07230168581008911, -0.009467747062444687, -0.011017169803380966, 0.0061788358725607395, -0.0499207004904747, 0.043252501636743546, -0.024733766913414, 0.06874856352806091, -0.006079263985157013, -0.02516789175570011, 0.013926158659160137, 0.030735788866877556, 0.07388724386692047, -0.08842561393976212, -0.03611113503575325, 0.02206522598862648, -0.05020654574036598, 0.013516269624233246, -0.07796447724103928, 0.04353272542357445, 0.06541574001312256, -0.07267377525568008, -0.006836259737610817, 0.04019191861152649, 0.021959204226732254, -0.03945169225335121, -0.010047219693660736, 0.05566898360848427, -0.054886553436517715, 0.03299269825220108, -0.04814613610506058, -0.031156357377767563, 0.017752690240740776, 0.07734530419111252, 0.056730203330516815, -0.02557062916457653, -0.0053006503731012344, 0.03952491655945778, -0.10128629952669144, -0.10540810227394104, 0.030747191980481148, -0.0002760596398729831, 0.03818047419190407, 0.12632369995117188, 0.01849627122282982, 0.041136592626571655, 0.09331270307302475, -0.050164397805929184, -0.0008453807095065713, 0.05416081100702286, 0.02132164128124714, -0.06077606976032257, 0.0062829614616930485, 0.06078257039189339, 0.018106695264577866, -0.0257724616676569, -0.04657121002674103, 0.05030907317996025, -0.02426373027265072, 0.016982877627015114, 0.025406373664736748, -0.003114058170467615, 0.07911796867847443, -0.09758016467094421, -0.01292265672236681, 0.0703270211815834, -0.01874200440943241, -0.03645050898194313, -0.04737304523587227, -0.041315287351608276, -0.04635462164878845, 0.02055581659078598, 0.07419006526470184, -0.073323555290699, -0.007563009858131409, 0.0022190194576978683, 0.06846541166305542, 0.01676858402788639, -0.022523293271660805, 0.009002359583973885, -0.10514318197965622, -1.8893933759117714e-33, 0.05346313491463661, 0.09297249466180801, -0.12628628313541412, 0.028790324926376343, -0.040440551936626434, -0.04421558603644371, -0.03284425288438797, 0.037447407841682434, 0.0018942077876999974, 0.040131717920303345, 0.00496459286659956, 0.0005411104066297412, 0.06178873032331467, -0.050267212092876434, -0.03616311773657799, -0.06673652678728104, 0.014871976338326931, 0.0008825142285786569, -0.1082363873720169, 0.0251325536519289, -0.009839375503361225, 0.06066593900322914, -0.10369092226028442, 0.015942808240652084, -0.051811832934617996, 0.019248396158218384, 0.02947097457945347, 0.12082765996456146, 0.023610105738043785, -0.07841694355010986, -0.01196974515914917, 0.030054667964577675, 0.07044188678264618, -0.017957109957933426, -0.0521724559366703, -0.020657531917095184, 0.055970098823308945, -0.037971727550029755, -0.04034503549337387, 0.025250142440199852, 0.11068432778120041, -0.013857205398380756, -0.013268394395709038, 0.02230597287416458, -0.0846913754940033, -0.07497250288724899, -0.05788285657763481, 0.03096226043999195, -0.02655421756207943, 0.058156248182058334, -0.09420975297689438, 0.014643116854131222, -0.10589148849248886, -0.06047508493065834, -0.0218014158308506, 0.0049989186227321625, 0.006700022146105766, 0.03779781982302666, 0.00912991538643837, -0.008158272132277489, -0.031890712678432465, 0.0036544031463563442, 0.06754399091005325, -0.03944605588912964, 0.08287007361650467, -0.08734628558158875, -0.03140828013420105, -0.07867392152547836, 0.02619304321706295, -0.040187664330005646, 0.10885325074195862, 0.04121938720345497, 0.012223167344927788, 0.05372680723667145, -0.03248400613665581, -0.03510282561182976, 0.009141240268945694, -0.047069843858480453, -0.012033913284540176, -0.06953322142362595, -0.10706353187561035, -0.0031685505528002977, 0.006721051409840584, 0.009130695834755898, 0.012448822148144245, 0.127467080950737, 0.16124778985977173, 0.044330064207315445, -0.02185436524450779, -0.009794424287974834, -0.009194865822792053, 0.004828938748687506, -0.0037595045287162066, 0.06042398139834404, -0.12927748262882233, -2.1163931052115004e-08, -0.04732324182987213, -0.06736508011817932, 0.034873951226472855, 0.0851401537656784, 0.01765204221010208, -0.011248694732785225, -0.04750930890440941, 0.05332067608833313, -0.008402707986533642, 0.004101335536688566, 0.03722575679421425, -0.024189351126551628, -0.09107901155948639, 0.003830535802990198, 0.006563759408891201, -0.02562241069972515, 0.013124020770192146, 0.055089373141527176, -0.03486727550625801, -0.008937566541135311, -0.009474826976656914, -0.004710554610937834, 0.009674780070781708, -0.04223758727312088, 0.015138070099055767, 0.0014832628658041358, -0.024734439328312874, 0.12041366100311279, 0.0068976376205682755, -0.03846341744065285, 0.06165918707847595, 0.024772943928837776, -0.03097810223698616, -0.10247638076543808, -0.12537549436092377, 0.05987001955509186, 0.05803733691573143, 0.04352738708257675, 0.04510031268000603, -0.060903679579496384, -0.020071065053343773, 0.03658591955900192, -0.06761308759450912, 0.03429671749472618, -0.055350832641124725, -0.03254498541355133, -0.003013476962223649, -0.10925605148077011, 0.05273380130529404, -0.10110592097043991, 0.040708739310503006, -0.07977752387523651, 0.05304760858416557, 0.024807332083582878, 0.0460580512881279, 0.07070804387331009, 0.04484027251601219, 0.0008179898140951991, 0.0047442917712032795, 0.05597712844610214, 0.029827065765857697, 0.046112269163131714, -0.0008036410436034203, 0.024657657369971275 ] }, { "text": "```python\nclass AttentionRNN(nn.Module):\n def __init__(self, vocab_size, embed_dim, hidden_size, num_classes):\n super().__init__()\n \n self.embedding = nn.Embedding(vocab_size, embed_dim)\n \n self.lstm = nn.LSTM(\n embed_dim, hidden_size,\n batch_first=True, bidirectional=True\n )\n \n self.attention = Attention(hidden_size * 2)\n self.fc = nn.Linear(hidden_size * 2, num_classes)\n \n def forward(self, x):\n # Embed\n embedded = self.embedding(x)\n \n # LSTM encoding\n lstm_out, _ = self.lstm(embedded)\n \n # Apply attention to get context vector\n context, attention_weights = self.attention(lstm_out)\n \n # Classify", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_41", "embedding": [ 0.010002443566918373, -0.09271515160799026, -0.04632647708058357, 0.001467171823605895, 0.04021119698882103, 0.030635099858045578, 0.015893036499619484, 0.0006042324821464717, -0.03040388971567154, -0.08897382766008377, 0.012439538724720478, -0.029387645423412323, 0.0020724216010421515, -0.03629552572965622, -0.04315144568681717, 0.03202691674232483, 0.03801560401916504, 0.0300018098205328, -0.054645176976919174, 0.0013508861884474754, 0.03768231347203255, 0.07784343510866165, 0.06982212513685226, 0.025095494464039803, -0.02187400311231613, -0.022776072844862938, -0.005876239389181137, 0.00213868310675025, 0.05017578974366188, -0.0648658350110054, 0.11805065721273422, 0.05610443279147148, -0.03781949356198311, 0.07739873975515366, -0.06040610745549202, 0.08419608324766159, -0.1038174256682396, -0.009508403018116951, -0.044855572283267975, 0.022231867536902428, 0.04260539636015892, 0.033094510436058044, -0.014709996059536934, 0.012245222926139832, 0.06605368852615356, 0.051671404391527176, -0.0029595436062663794, -0.02448051981627941, 0.019556868821382523, -0.08690754324197769, -0.05196352303028107, -0.021576855331659317, -0.09539802372455597, 0.03108515776693821, -0.06575751304626465, 0.0453573614358902, 0.028452623635530472, -0.0036855011712759733, -0.03410512953996658, -0.006429839413613081, -0.04172242060303688, -0.0030763093382120132, 0.06107664480805397, -0.062343914061784744, -0.026444191113114357, -0.015377604402601719, 0.001947055454365909, 0.04743959754705429, -0.01455545611679554, 0.03842329978942871, -0.013739428482949734, 0.034510206431150436, 0.019223343580961227, 0.018108291551470757, 0.051879797130823135, -0.024253077805042267, 0.08664840459823608, 0.01543046347796917, 0.025108586996793747, -0.07121849805116653, -0.022850189357995987, -0.01900552771985531, 0.042186833918094635, -0.007580718956887722, 0.14033204317092896, -0.04549543932080269, 0.033419251441955566, 0.027976050972938538, -0.024562405422329903, 0.01096632145345211, -0.012502478435635567, -0.062079865485429764, -0.07316763699054718, -0.0013484765077009797, 0.05794505402445793, -0.0012654818128794432, -0.01545795425772667, 0.005574533250182867, -0.010121052153408527, 0.02254653349518776, 0.0006110297981649637, -0.029212068766355515, 0.008748232387006283, 0.045669179409742355, 0.0356515608727932, 0.06699763983488083, 0.060500599443912506, 0.02432541735470295, 0.034692686051130295, -0.13024798035621643, -0.011883318424224854, -0.041772302240133286, -0.0252230167388916, -0.04816543310880661, 0.0780550092458725, -0.01910889521241188, 0.01545860804617405, -0.0025883661583065987, 0.04928639158606529, 0.005587095394730568, -0.0034092688001692295, 0.028908059000968933, 0.017122814431786537, -0.022645900025963783, -0.04732292518019676, -0.03303251415491104, -0.061743345111608505, 4.092946800630415e-33, -0.012257345952093601, -0.034365881234407425, -0.03137892857193947, -0.0060577611438930035, 0.01191142201423645, 0.04524265602231026, 0.06597432494163513, 0.02085731364786625, -0.04783093184232712, 0.010627707466483116, -0.029643671587109566, 0.015561758540570736, 0.009149844758212566, 0.09770467877388, -0.04939785599708557, -0.020382285118103027, -0.019729863852262497, 0.040314510464668274, -0.05448935553431511, -0.051680486649274826, 0.020974837243556976, 0.07658246904611588, 0.01219778973609209, -0.10609591007232666, -0.02386791817843914, 0.004398065153509378, 0.013635193929076195, -0.10288386791944504, -0.08202800899744034, 0.01443171501159668, -0.09386266767978668, 0.005427161231637001, 0.009210385382175446, -0.01123124361038208, 0.04443749412894249, -0.059086550027132034, 0.0018426108872517943, 0.02275567315518856, 0.03590444102883339, -0.1372118443250656, -0.009697572328150272, 0.07123300433158875, 0.019742121919989586, -0.02463568188250065, -0.13320046663284302, -0.016933763399720192, 0.003885856829583645, 0.10301028192043304, -0.04404541477560997, 0.01669374108314514, 0.06490612030029297, -0.05978785827755928, -0.048059675842523575, -0.07336337864398956, -0.024884270504117012, -0.020188914611935616, 0.07155303657054901, 0.1782127171754837, 0.0757790207862854, -0.02820451743900776, 0.0513673797249794, 0.02095899172127247, 0.0011922043049708009, 0.10017766058444977, 0.014261791482567787, 0.013644633814692497, -0.026897979900240898, 0.014046730473637581, 0.07769647240638733, 0.001049022190272808, -0.019659537822008133, 0.02588110975921154, -0.08734387159347534, -0.046306442469358444, 0.0585884228348732, -0.03171510621905327, 0.010301048867404461, -0.09701786190271378, -0.07095374166965485, 0.021202368661761284, -0.00015490392979700118, 0.012560555711388588, -0.04143686220049858, -0.05183611810207367, -0.0763092115521431, -0.04886560142040253, 0.06937963515520096, -0.1116524487733841, -0.04838290810585022, 0.012228552252054214, -0.05736542493104935, -0.0911656990647316, -0.008960410952568054, 0.008616997860372066, -0.06973925232887268, -5.362999386400786e-33, 0.06362567096948624, 0.15088140964508057, -0.016685068607330322, -0.02273433282971382, -0.006468306295573711, 0.006831057369709015, -0.014014172367751598, 0.060029663145542145, -0.05497954040765762, 0.05372462049126625, 0.0026091632898896933, -0.03579128161072731, 0.07068902999162674, -0.03688497096300125, 0.07001034170389175, 0.004685806110501289, -0.004620369989424944, 0.052350904792547226, -0.07860301434993744, -0.014041685499250889, -0.056699976325035095, 0.10241598635911942, -0.055991318076848984, 0.020418740808963776, -0.03722275048494339, -0.0031021914910525084, 0.01880364678800106, 0.09571415930986404, 0.009809073992073536, -0.08937858045101166, -0.10481157898902893, 0.006541666109114885, -0.04789186641573906, 0.01382265705615282, -0.058330949395895004, 0.05406797304749489, -0.007684662006795406, -0.05547388270497322, -0.0235564224421978, 0.02622423879802227, 0.1352369338274002, 0.05711204558610916, -0.061601828783750534, 0.009459284134209156, -0.050377316772937775, 0.03524504229426384, -0.06374435126781464, 0.012468013912439346, 0.002878887113183737, 0.059645842760801315, -0.04834192991256714, -0.01028880849480629, 0.0009058855357579887, 0.014669414609670639, -0.06270590424537659, 0.04692027345299721, 0.007389029487967491, 0.009629378095269203, 0.011101514101028442, -0.033630482852458954, 0.007802295032888651, -0.06447165459394455, 0.01454583927989006, -0.06543762981891632, 0.045680783689022064, -0.012288070283830166, -0.07371580600738525, 0.009751716628670692, -0.004035777412354946, -0.01557044219225645, 0.07252028584480286, 0.11274844408035278, 0.029092852026224136, -0.0013575834454968572, -0.06172887608408928, 0.07214121520519257, -0.030549997463822365, -0.03756947070360184, -0.01150460634380579, -0.04722889885306358, -0.025913091376423836, -0.059168849140405655, 0.08627620339393616, 0.04493120685219765, -0.016791127622127533, 0.09187114983797073, 0.12275800853967667, 0.08316349983215332, 0.04160172864794731, -0.07772863656282425, 0.03523271903395653, 0.04941689223051071, 0.004481146112084389, 0.08436881005764008, 0.05511856824159622, -5.190824836631691e-08, -0.11193661391735077, -0.053848184645175934, 0.026336463168263435, 0.05312906950712204, -0.007645557634532452, -0.027449235320091248, 0.019646035507321358, 0.07908347994089127, -0.028589962050318718, 0.03124275803565979, 0.02997695840895176, -0.046939242631196976, -0.026449022814631462, -0.017567085102200508, -0.0021933214738965034, 0.022168368101119995, -0.03261023759841919, -0.02565293200314045, 0.007265933323651552, 0.008206669241189957, -0.05818060413002968, -0.052174363285303116, 0.03182432800531387, 0.050021324306726456, -0.06372459977865219, -0.07431478798389435, 0.007787112146615982, 0.014613887295126915, 0.04351310804486275, -0.055059242993593216, 0.05090855062007904, 0.04550221189856529, -0.0064435238018631935, -0.03247217461466789, -0.08947774022817612, 0.12434662878513336, -0.019403640180826187, -0.011481914669275284, 0.0054462808184325695, 0.061182402074337006, -0.06736722588539124, -0.006491504609584808, -0.03763814643025398, 0.015868717804551125, 0.04640477895736694, 0.01641981489956379, -0.007910145446658134, -0.1256030946969986, 0.00945777166634798, -0.05616573616862297, 0.06257068365812302, -0.018432965502142906, -0.057587943971157074, 0.024739373475313187, -0.002031118143349886, -0.013567054644227028, -0.04382321238517761, 0.05627363920211792, -0.04267214238643646, 0.03655141592025757, -0.06532023102045059, 0.07098720222711563, -0.006945663597434759, -0.0032889361027628183 ] }, { "text": "# Apply attention to get context vector\n context, attention_weights = self.attention(lstm_out)\n \n # Classify\n output = self.fc(context)\n \n return output, attention_weights", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_42", "embedding": [ 0.06694883853197098, -0.032856062054634094, -0.07244344800710678, 0.031989410519599915, 0.08809772878885269, 0.04187841713428497, 0.06318826228380203, 0.04617411643266678, -0.08668576925992966, -0.1236448585987091, -0.021481012925505638, -0.07710256427526474, 0.01624002493917942, -0.04485497623682022, -0.022826842963695526, 0.026641204953193665, 0.052659645676612854, 0.04353674128651619, -0.025996806100010872, -0.04565183073282242, 0.05798479914665222, 0.030003078281879425, 0.07478507608175278, 0.001211297931149602, -0.026374951004981995, 0.006192389409989119, -0.017802216112613678, 0.02242230251431465, 0.06566061824560165, -0.020839748904109, 0.1368943750858307, 0.0652514100074768, -0.0073263333179056644, 0.059945814311504364, -0.10001997649669647, 0.0003110428515356034, -0.08566577732563019, -0.12231044471263885, -0.03567376732826233, -0.04201800748705864, 0.016024814918637276, 0.016753124073147774, -0.10837817937135696, -0.011151590384542942, 0.020446648821234703, 0.045773666352033615, 0.02423439361155033, -0.0011093548964709044, 0.015730351209640503, -0.020741410553455353, -0.044594984501600266, 0.029846470803022385, -0.09435197710990906, 0.014399411156773567, -0.1027674451470375, 0.04989461228251457, 0.08926335722208023, 0.002468715887516737, -0.040443986654281616, -0.07407641410827637, -0.07083239406347275, -0.02510800212621689, -0.0009287829743698239, -0.00732609024271369, -0.015663988888263702, 0.019220756366848946, 0.018468424677848816, 0.03565841168165207, 0.015878168866038322, -0.043934114277362823, 0.05215614661574364, 0.01619953103363514, 0.0750642940402031, -0.04680342972278595, 0.046033840626478195, -0.01731991022825241, 0.04748665913939476, -0.002158091403543949, 0.011828811839222908, -0.006091336254030466, -0.023724589496850967, -0.015841804444789886, 0.037227045744657516, -0.037650078535079956, 0.09888637810945511, 0.008134651929140091, 0.0003865916805807501, 0.0843120589852333, -0.03808003291487694, 0.0353224016726017, -0.017721453681588173, -0.06601625680923462, -0.0639146938920021, -0.009659076109528542, 0.03391707316040993, 0.0007030983688309789, -0.0013120821677148342, 0.00403831759467721, -0.02340247668325901, -0.010371309705078602, -0.015600047074258327, -0.025104152038693428, -0.021733621135354042, 0.020177140831947327, 0.01165849156677723, 0.10938002914190292, -0.006346512120217085, 0.05644991248846054, 0.02516002766788006, -0.11254879087209702, 0.025452710688114166, 0.0045372480526566505, -0.001534983515739441, -0.021833205595612526, 0.09628655761480331, 0.0027365656569600105, 0.0547349788248539, -0.05894114449620247, -0.0025014285929501057, 0.09107010066509247, 0.015219349414110184, -0.030787277966737747, -0.08552693575620651, -0.01332660298794508, -0.06865476816892624, -0.05189436674118042, -0.07854711264371872, 1.8868118801147702e-33, -0.03855220973491669, -0.06012355908751488, 0.026764361187815666, -0.03654481843113899, -0.00711060082539916, 0.054500773549079895, 0.014201038517057896, 0.001100756460800767, -0.015957968309521675, -0.005156929139047861, -0.03586968779563904, 0.057281494140625, -0.003978989087045193, 0.02337789162993431, -0.08068118989467621, -0.01859998144209385, 0.019261986017227173, 0.010077936574816704, 0.019365482032299042, 0.022226925939321518, 0.0059012481942772865, 0.035192959010601044, -0.011252941563725471, -0.06759222596883774, -0.0034936678130179644, 0.035343050956726074, 0.04202151298522949, -0.044050801545381546, -0.07028007507324219, 0.0019077390898019075, -0.08726692944765091, 0.015437557362020016, 0.041218195110559464, -0.008072416298091412, -0.019100524485111237, -0.077764593064785, 0.030779318884015083, 0.03489910811185837, -0.03481665626168251, -0.16895528137683868, 0.008247197605669498, 0.059521935880184174, 0.030103860422968864, 0.04272184520959854, -0.07248082756996155, 0.0032894040923565626, -0.050330907106399536, 0.06180106848478317, 0.04557090997695923, 0.024485325440764427, 0.08044957369565964, -0.051689568907022476, -0.018760500475764275, -0.0549093596637249, -0.017001615837216377, 0.026102447882294655, 0.035143133252859116, 0.15365442633628845, 0.06275788694620132, -0.039528738707304, 0.09327757358551025, 0.039524804800748825, 0.012595707550644875, 0.06753391027450562, 0.045525550842285156, 0.0011171776568517089, 0.01895865611732006, 0.045793600380420685, -0.011208749376237392, 0.050055425614118576, -0.036575522273778915, 0.052495069801807404, -0.02950100600719452, 0.03564019501209259, 0.08255809545516968, 0.007356779649853706, 0.032025352120399475, -0.12346991896629333, -0.0896533727645874, 0.09431235492229462, 0.07542450726032257, 0.06352055072784424, -0.014534351415932178, -0.04445783421397209, -0.0422590896487236, 0.03659506142139435, 0.038487836718559265, -0.10106369853019714, -0.04099603742361069, 0.006049235351383686, -0.07518275827169418, -0.048911064863204956, -0.002276947721838951, 0.007355628069490194, -0.14576105773448944, -3.576456990740164e-33, -0.0009347318555228412, 0.09911797940731049, -0.027527373284101486, -0.09621437638998032, 0.012616888619959354, 0.015637923032045364, -0.02890177071094513, 0.09089803695678711, -0.06504209339618683, 0.11644230037927628, 0.03392403945326805, -0.08887940645217896, 0.0052006919868290424, -0.019918009638786316, 0.051280561834573746, -0.07212661951780319, -0.02906799502670765, 0.01778530888259411, -0.10175759345293045, 0.0006813653162680566, -0.025828735902905464, 0.04895027354359627, -0.0050757392309606075, 0.007594067137688398, -0.06851708143949509, -0.032058313488960266, 0.006394730880856514, 0.08871019631624222, 0.017157146707177162, -0.12219352275133133, -0.054239656776189804, -0.0021608606912195683, 0.0023601169232279062, 0.04573110118508339, -0.03248909115791321, 0.03221755474805832, -0.0018334191991016269, -0.08172062784433365, 0.0063595580868422985, 0.019127875566482544, 0.06903879344463348, 0.0844947099685669, -0.04557887092232704, -0.019047105684876442, -0.0667087733745575, -0.014203566126525402, -0.031869083642959595, -0.026513032615184784, 0.015153034590184689, 0.008421978913247585, -0.04153500124812126, -0.005112715531140566, -0.06409226357936859, -0.0013300800928846002, -0.060054052621126175, -0.007077868562191725, 0.00684712827205658, -0.03558570146560669, -0.00692354841157794, -0.05572229251265526, 0.0032894741743803024, -0.04026367887854576, -0.05402776226401329, -0.03782748803496361, 0.04049733653664589, -0.0010134457843378186, 0.005072915926575661, 0.01169968955218792, 0.017747310921549797, 0.044489845633506775, 0.06905773282051086, 0.09723179787397385, 0.04212168604135513, 0.06699705123901367, -0.024604519829154015, 0.07979238033294678, -0.09958182275295258, -0.06456609070301056, -0.0208741407841444, -0.09578937292098999, 0.023767119273543358, -0.07125204801559448, 0.05965528264641762, 0.06914907693862915, 0.040816426277160645, 0.0330086313188076, 0.09414929151535034, 0.05278095230460167, 0.037689629942178726, -0.06793832778930664, 0.048392798751592636, 0.03516493737697601, -0.006181810982525349, 0.0771661102771759, 0.03665302321314812, -3.119304992083016e-08, -0.07362294942140579, -0.025521842762827873, 0.03153211250901222, 0.06487413495779037, -0.022538920864462852, 0.017324086278676987, 0.013016222044825554, 0.03211738541722298, -0.008163884282112122, 0.03015729784965515, -0.048622988164424896, -0.06316845864057541, -0.08465909957885742, -0.0029156282544136047, 0.02964758314192295, 0.029239173978567123, -0.0030072380322963, 0.05215907841920853, 0.0553368479013443, -0.014745784923434258, 0.03018416278064251, -0.024151714518666267, 0.030124016106128693, 0.04331575706601143, -0.0001321727759204805, -0.061597663909196854, -0.02155560813844204, 0.033213190734386444, 0.00988357700407505, -0.03876484930515289, 0.03324892371892929, 0.0050743878819048405, -0.06542213261127472, -0.06344195455312729, -0.06671148538589478, 0.046420563012361526, -1.2193720067443792e-05, -0.024086229503154755, 0.0010731687070801854, 0.07266293466091156, -0.018361158668994904, 0.020994994789361954, -0.009541232138872147, 0.032592933624982834, -0.00456243846565485, 0.012246286496520042, 0.0070741381496191025, -0.10070648044347763, 0.033001165837049484, -0.04727557301521301, 0.04859240725636482, -0.01567951589822769, -0.06616725027561188, -0.007284283172339201, -0.02970557101070881, -0.09582611918449402, -0.005226033739745617, 0.049381911754608154, -0.03370865061879158, -0.0165217537432909, -0.040260348469018936, 0.10349757969379425, 0.011362805031239986, 0.018791142851114273 ] }, { "text": "# Example\nmodel = AttentionRNN(vocab_size=5000, embed_dim=128, hidden_size=128, num_classes=2)\ntext = torch.randint(0, 5000, (8, 50))\noutput, attn_weights = model(text)\nprint(f\"Output: {output.shape}, Attention: {attn_weights.shape}\")\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_43", "embedding": [ 0.004681746941059828, -0.03450119495391846, -0.06561427563428879, 0.1217145100235939, 0.048609718680381775, 0.00714670168235898, 0.02489195391535759, 0.033307868987321854, 0.019738690927624702, -0.1074187159538269, 0.038358159363269806, -0.029122384265065193, -0.05816758796572685, -0.016832811757922173, -0.05102138966321945, 0.04170723259449005, 0.023405009880661964, -0.012818963266909122, -0.03288990631699562, -0.06896816194057465, 0.09496738016605377, 0.0022550425492227077, 0.11378990113735199, 0.02076875790953636, 0.002465534955263138, -0.03643788397312164, -0.040160518139600754, 0.03731571510434151, 0.03411557525396347, -0.0002804052201099694, 0.10510595887899399, -0.027523258700966835, -0.013466797769069672, 0.05237354338169098, 0.006209070328623056, 0.026516076177358627, -0.11395156383514404, -0.053108032792806625, -0.02238490618765354, -0.021393833681941032, 0.04740282893180847, 0.0023059239611029625, -0.05718701332807541, 0.02286153845489025, 0.07572423666715622, 0.016043776646256447, 0.04709489643573761, -0.03672942891716957, -0.0007201106054708362, -0.04221482574939728, 0.018361913040280342, -0.10726454854011536, -0.06657108664512634, -0.022573675960302353, -0.0033848837483674288, 0.0383392795920372, 0.022624002769589424, -0.08400863409042358, -0.03628053143620491, -0.07221675664186478, -0.016690783202648163, 0.0025527130346745253, 0.0026752238627523184, -0.07376199960708618, 0.01116151362657547, -0.0015049363719299436, 0.0023910512682050467, 0.024860437959432602, -0.03700408712029457, 0.009972784668207169, 0.007607053034007549, 0.03925235569477081, 0.03330681473016739, -0.027194777503609657, 0.06109144538640976, 0.02041536197066307, 0.07630731165409088, -0.017484378069639206, 0.05104581266641617, -0.06882644444704056, -0.04374904930591583, -0.013397647067904472, 0.10983587801456451, 0.03301023691892624, 0.09777636080980301, 0.03558773174881935, 0.043133798986673355, 0.049917805939912796, -0.0129763875156641, -0.030213315039873123, -0.057351283729076385, -0.050484709441661835, -0.07233253121376038, 0.013160903938114643, -0.06411229819059372, 0.02243092842400074, 0.026767628267407417, -0.02121966890990734, -0.09294668585062027, 0.014599737711250782, 0.024910593405365944, -0.03988124802708626, 0.10814347118139267, 0.04966529458761215, -0.0001854943548096344, 0.053847022354602814, 0.026912854984402657, 0.058279022574424744, -0.0016542194643989205, -0.052073873579502106, 0.04355012997984886, 0.04954748600721359, 0.015444856137037277, -0.03166508302092552, 0.09887299686670303, -0.0469355583190918, -0.05885152518749237, -0.010057084262371063, 0.002900943160057068, 0.07677382230758667, -0.042033713310956955, 0.054906509816646576, -0.08893804997205734, 0.011748203076422215, -0.04436814412474632, -0.02587740495800972, 0.015165470540523529, 2.639565768944731e-33, 0.0016492095310240984, 0.0008902038098312914, -0.05588623136281967, 0.003889699699357152, 0.034539975225925446, 0.05812643840909004, 0.03368974104523659, -0.07517986744642258, -0.05786772444844246, -0.008759739808738232, -0.049834202975034714, -0.04502261057496071, -0.008239592425525188, 0.05681024119257927, -0.07641241699457169, -0.05902034789323807, 0.04849525913596153, 0.08305231481790543, -0.007258547004312277, -0.0032271933741867542, 0.007101389113813639, 0.07578398287296295, -0.05337928235530853, -0.04790835455060005, -0.02955058589577675, 0.01598293147981167, -0.04117250069975853, -0.03337390348315239, -0.09694083780050278, 0.008877216838300228, -0.05817706137895584, 0.012721681967377663, 0.06530885398387909, -0.049352653324604034, -0.045514799654483795, -0.09221906960010529, 0.06967197358608246, 0.008915082551538944, -0.015953050926327705, -0.12144172936677933, 0.07750872522592545, 0.10100503265857697, 0.00505634443834424, -0.03562256321310997, -0.08497115224599838, 0.06310459226369858, 0.005095920991152525, 0.11378665268421173, 0.008602453395724297, -0.01449556928128004, 0.015187805518507957, -0.041041720658540726, -0.027208669111132622, 0.0034942207857966423, 0.032165560871362686, -0.04737939313054085, 0.08112724125385284, 0.07624760270118713, 0.12742196023464203, -0.05496294051408768, 0.05839740112423897, 0.06067804992198944, 0.019325999543070793, 0.051403436809778214, 0.00819407869130373, 0.03397097811102867, -0.01628958061337471, -0.023881498724222183, 0.0267327968031168, 0.03298764303326607, -0.09585613012313843, 0.05158665031194687, -0.07608991861343384, 0.006934629287570715, -0.02130819670855999, -0.03438572213053703, 0.003306988626718521, -0.1041375994682312, -0.01780989207327366, 0.09287773817777634, -0.026714716106653214, 0.03329906240105629, -0.0224988404661417, -0.08104263246059418, -0.05949359014630318, -0.012775738723576069, 0.03496209904551506, -0.11560411006212234, -0.03940223529934883, -0.024287866428494453, -0.054191701114177704, -0.06405946612358093, -0.012618020176887512, -0.06176285073161125, -0.07325447350740433, -2.3509738242941974e-33, -0.017278725281357765, 0.097365602850914, -0.012053954415023327, 0.01044214703142643, -0.013494332320988178, 0.05591501668095589, -0.0018917068373411894, 0.02424013614654541, -0.05545239523053169, 0.013494400307536125, 0.004089032765477896, -0.10964790731668472, -0.022924043238162994, -0.08451561629772186, 0.11904595047235489, -0.03681502491235733, -0.010349133983254433, 0.024278143420815468, -0.007838624529540539, 0.024852868169546127, -0.0460449680685997, 0.03864753246307373, -0.062090594321489334, 0.05533694475889206, -0.01916734129190445, -0.017920076847076416, 0.047835465520620346, 0.051327142864465714, 0.021753905341029167, -0.10340400785207748, -0.06712029129266739, -0.01631110906600952, -0.008807502686977386, 0.07149279862642288, -0.07396361231803894, 0.01913021132349968, 0.0949549451470375, -0.023172516375780106, -0.017045501619577408, 0.002347155474126339, 0.11599805951118469, -0.007952655665576458, -0.08823812752962112, 0.05745682865381241, -0.1158607080578804, 0.07382895797491074, -0.05304599925875664, -0.04220762103796005, -0.015696551650762558, -0.021559713408350945, 0.006361448671668768, -0.09695323556661606, -0.029249409213662148, 0.031144879758358, -0.07146677374839783, -0.0006321599357761443, 0.013420982286334038, -0.010155784897506237, 0.0018482208251953125, -0.04335983842611313, -0.02406306378543377, -0.06540495902299881, 0.004558023065328598, -0.030221501365303993, 0.01878279261291027, 0.0019484178628772497, -0.010027561336755753, -0.012892728671431541, 0.05955919995903969, -0.0012744637206196785, 0.036850523203611374, 0.0989573523402214, 0.05944141000509262, 0.07893925905227661, -0.014160462655127048, 0.030663177371025085, -0.0022924072109162807, 0.023992303758859634, 0.00711671682074666, -0.061807695776224136, -0.0019950263667851686, 0.006850956007838249, 0.06285756081342697, 0.0073532224632799625, 0.0650361031293869, 0.07513382285833359, 0.06695014238357544, 0.0476471446454525, 0.002242964692413807, -0.044851575046777725, 0.023550046607851982, 0.07884278148412704, 0.06947904825210571, 0.07858490198850632, 0.07337129861116409, -4.232029837680784e-08, -0.07757388800382614, -0.0382441021502018, 0.025655323639512062, 0.03773326426744461, -0.059003908187150955, -0.008218793198466301, 0.06841466575860977, 0.016116775572299957, -0.04268697276711464, 0.033037591725587845, 0.02706911787390709, -0.07742341607809067, -0.0155875813215971, -0.029228491708636284, 0.0188236515969038, 0.058152083307504654, -0.0032576373778283596, 0.009779416024684906, 0.033354613929986954, -0.04812902957201004, -0.030712392181158066, 0.01894158497452736, 0.04752234369516373, -0.0273655503988266, -0.026329219341278076, -0.03568316251039505, -0.05436030775308609, 0.06052237004041672, 0.010861641727387905, -0.06940695643424988, 0.06851513683795929, -0.03529044985771179, 0.017444685101509094, 0.01619955711066723, -0.005832694470882416, 0.054301176220178604, -0.0009159882902167737, -0.023194722831249237, 0.02601524442434311, 0.0936470478773117, 0.030746255069971085, 0.013774841092526913, 0.03273060917854309, -0.019792640581727028, 0.04911741986870766, 0.01054900698363781, -0.016821231693029404, -0.09893660247325897, 0.0646212100982666, -0.011863958090543747, 0.06378192454576492, 0.0006073274998925626, -0.10122863203287125, 0.018695645034313202, -0.06922592967748642, -0.029142728075385094, 0.06087138131260872, 0.05709105357527733, -0.07852361351251602, 0.0038414476439356804, 0.07573522627353668, 0.008028930053114891, -0.062439192086458206, -0.03603838011622429 ] }, { "text": "## Complete Training Example\n\nHere's a full example training a CNN on image classification:\n\n```python\nimport torch\nimport torch.nn as nn\nimport torch.optim as optim\nfrom torch.utils.data import DataLoader, TensorDataset", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_44", "embedding": [ -0.04351041093468666, -0.11263733357191086, -0.0022761314176023006, 0.011213636957108974, 0.014122473075985909, -0.008675997145473957, 0.035518065094947815, -0.005967766512185335, -0.13070562481880188, -0.12212064117193222, 0.0014671537792310119, 0.014034727588295937, -0.05608038231730461, 0.07486239820718765, -0.031434133648872375, 0.009901409037411213, -0.019237957894802094, 0.04792477935552597, -0.09325095266103745, -0.03674521669745445, 0.0766708105802536, -0.04057268798351288, 0.07948527485132217, 0.013578501529991627, -0.009795527905225754, 0.0026239051949232817, 0.04311167076230049, -0.025726979598402977, 0.046581026166677475, -0.014841773547232151, -0.011398941278457642, -0.003069390309974551, -0.06514043360948563, 0.06778544187545776, -0.035705700516700745, 0.013381196185946465, -0.06111744046211243, -0.02263347990810871, -0.006990937516093254, 0.007628140039741993, 0.005366457626223564, -0.05472639203071594, -0.032624538987874985, -0.029653415083885193, -0.02350596711039543, 0.06371276825666428, 0.05471613630652428, -0.01758498325943947, -0.00916619598865509, -0.012963942252099514, -0.020602939650416374, -0.014934197999536991, -0.09374423325061798, 0.058425020426511765, -0.02040955051779747, -0.03596121445298195, 0.030342189595103264, -0.007565494626760483, -0.036334823817014694, -0.04195835813879967, 0.022153453901410103, 0.0006034888792783022, 0.027158545330166817, -0.03861292451620102, -0.00995783694088459, 0.000492367020342499, 0.015854842960834503, -0.020961586385965347, 0.09710535407066345, -0.1434410810470581, 0.015224678441882133, 0.02297915890812874, 0.014175334013998508, 0.04505022242665291, -0.015514742583036423, -0.0744907408952713, 0.1209397166967392, 0.08128421008586884, 0.06413152068853378, -0.07845504581928253, -0.034561414271593094, 0.002720857970416546, 0.09391060471534729, 0.004990783985704184, 0.07538573443889618, -0.016372915357351303, -0.029645705595612526, 0.10250648111104965, -0.007261158898472786, -0.019930118694901466, -0.02860432118177414, -0.02618800476193428, -0.06353556364774704, -0.026717377826571465, 0.03395608067512512, -0.0030424732249230146, -0.007399026770144701, 0.021329985931515694, -0.1304987221956253, 0.004001012071967125, -0.01540366467088461, -0.07206632196903229, -0.05334203317761421, 0.056217294186353683, 0.008849788457155228, 0.055469267070293427, 0.0137697234749794, 0.013643724843859673, 0.005451880395412445, -0.036941319704055786, 0.009563802741467953, 0.04872767627239227, -0.03827698156237602, -0.14402097463607788, 0.029001755639910698, 0.0016881313640624285, -0.10028450936079025, 0.02904650941491127, -0.024757426232099533, 0.08882026374340057, -0.06903322041034698, 0.054480865597724915, -0.04967676103115082, 0.013249983079731464, 0.020119808614253998, -0.055311981588602066, -0.0968274399638176, 7.130467916851377e-33, 0.008939223363995552, -0.03437094762921333, -0.010567935183644295, -0.05661490559577942, -0.04395473748445511, -0.04207956790924072, 0.0806693360209465, -0.02771817520260811, -0.06102040782570839, 0.01582927815616131, -0.013622255995869637, 0.015006378293037415, 0.016556689515709877, 0.1344016194343567, -0.06408458203077316, -0.045498915016651154, 0.01921886019408703, -0.0086728036403656, 0.08403298258781433, 0.028292886912822723, 0.05321520194411278, 0.023676857352256775, 0.03200663626194, 0.025594396516680717, -0.021847788244485855, -0.017484718933701515, -0.04621865600347519, -0.012527150101959705, 0.05231048911809921, 0.017369164153933525, -0.03519454970955849, -0.038811590522527695, 0.046406447887420654, -0.007914463989436626, 0.06637084484100342, -0.05837283656001091, -0.006226798519492149, 0.061699409037828445, 0.01594281569123268, -0.04384053125977516, 0.014354914426803589, 0.0798836424946785, -0.02077457681298256, -0.034863606095314026, -0.06042943149805069, 0.05328355357050896, 0.0008657150901854038, 0.018438981845974922, -0.010756964795291424, 0.003960291855037212, -0.01275748573243618, -0.06270825117826462, 0.00023528710880782455, 0.0016937179025262594, 0.0216240081936121, 0.018282344564795494, 0.039181455969810486, 0.049384843558073044, 0.04494326561689377, -0.11302940547466278, 0.05601419508457184, 0.023105619475245476, -0.025650672614574432, 0.06854865700006485, -0.04865027964115143, -0.033427074551582336, 0.0012673138407990336, 0.014529189094901085, -0.04414673149585724, 0.02638358063995838, -0.09297504276037216, 0.07493998110294342, -0.046738315373659134, -0.042492568492889404, 0.04203740134835243, -0.031978826969861984, -0.005826655775308609, -0.05334210395812988, -0.0744822546839714, 0.07795880734920502, -0.017185235396027565, -0.008808121085166931, 0.02426568977534771, -0.06985348463058472, -0.11283087730407715, 0.07428416609764099, 0.04101525619626045, -0.043516915291547775, 0.034302279353141785, -0.04885423928499222, -0.0794726237654686, -0.030368000268936157, 0.03687797114253044, 0.007595118600875139, 0.030880795791745186, -6.513899824009979e-33, 0.04641889035701752, 0.10284221172332764, -0.038606639951467514, 0.0017418201314285398, -0.029587803408503532, 0.0481700524687767, -0.0010013501159846783, 0.01819378323853016, -0.038293566554784775, 0.04140958562493324, 0.031944774091243744, 0.029636086896061897, -0.05492183566093445, -0.08947941660881042, -0.06942599266767502, -0.048295293003320694, -0.050471942871809006, -0.0033170045353472233, 0.024359002709388733, 0.015153954736888409, -0.05604249984025955, 0.08481048792600632, -0.09240838140249252, 0.015772094950079918, -0.11111270636320114, 0.04476979002356529, 0.03623339161276817, 0.07719101756811142, 0.009396067820489407, -0.012523707933723927, -0.030990248546004295, -0.03626863658428192, -0.0022046996746212244, -0.016615426167845726, -0.010880738496780396, 0.07282565534114838, 0.1184350773692131, -0.06114626303315163, -0.03671170026063919, 0.016749562695622444, 0.08471653610467911, 0.03010573238134384, -0.023298557847738266, 0.09750977158546448, -0.08196815103292465, -0.021507780998945236, -0.05684293061494827, 0.03869330883026123, -0.01978403702378273, 0.013727625831961632, -0.0005476453225128353, -0.05471273139119148, -0.08640798181295395, -0.002640704857185483, 0.006898222956806421, -0.039921313524246216, 0.06829071789979935, -0.008494873531162739, 0.036754216998815536, 0.026035428047180176, -0.04691430181264877, -0.07495337724685669, 0.013083133846521378, -0.030448731034994125, -0.08937394618988037, 0.0018189639085903764, -0.12765978276729584, 0.05056174099445343, 0.0263555645942688, 0.10467981547117233, -0.02090165950357914, 0.08308377861976624, 0.047175198793411255, 0.05243192985653877, -0.0017952874768525362, -0.022469177842140198, 0.019495408982038498, 0.04485243186354637, 0.057240359485149384, -0.005572015419602394, 0.045937154442071915, -0.06983376294374466, -0.04663785547018051, 0.0736771821975708, 0.11890330165624619, 0.11691080033779144, 0.07794231921434402, 0.03595534339547157, 0.01940263621509075, -0.07044211775064468, 0.02199835143983364, -0.04327477514743805, 0.09783915430307388, 0.05458957701921463, 0.04827484115958214, -3.9948417906998657e-08, -0.006456482689827681, -0.0013049117987975478, 0.07553783059120178, 0.0009671708103269339, -0.01885683834552765, 0.011738640256226063, 0.06652582436800003, 0.09507863223552704, 0.009834316559135914, 0.04727619141340256, 0.004566580522805452, 0.013697268441319466, -0.010567199438810349, -0.002972031245008111, 0.058330051600933075, 0.10631240904331207, 0.017870234325528145, 0.06001816317439079, 0.05147054046392441, -0.020939355716109276, 0.013628539629280567, -0.09374644607305527, 0.002600910374894738, 0.024563856422901154, 0.054123565554618835, -0.07140164077281952, 0.011642944067716599, 0.024042190983891487, -0.08155769109725952, -0.025870023295283318, -0.014408847317099571, -0.033161506056785583, 0.04108969122171402, -0.08160421252250671, 0.08185421675443649, 0.07026685029268265, -0.022058118134737015, -0.03021291084587574, -0.02657385729253292, -0.023588402196764946, -0.04095214232802391, 0.015215463936328888, 0.009160308167338371, -0.029506709426641464, 0.016208406537771225, 0.013497036881744862, 0.004198400769382715, -0.10926222801208496, -0.027754342183470726, 0.006883214693516493, 0.04351611062884331, 0.04436315968632698, -0.04040971398353577, 0.07640878856182098, 0.0214978139847517, -0.003951089922338724, -0.0005916832596994936, -0.032688677310943604, -0.014424240216612816, 0.005943845957517624, 0.019928840920329094, 0.08714050054550171, -0.03715710714459419, -0.07836826890707016 ] }, { "text": "```python\nimport torch\nimport torch.nn as nn\nimport torch.optim as optim\nfrom torch.utils.data import DataLoader, TensorDataset\n\n# Model\nclass ImageClassifier(nn.Module):\n def __init__(self):\n super().__init__()\n self.features = nn.Sequential(\n nn.Conv2d(3, 32, 3, padding=1),\n nn.ReLU(),\n nn.MaxPool2d(2),\n nn.Conv2d(32, 64, 3, padding=1),\n nn.ReLU(),\n nn.MaxPool2d(2),\n nn.Conv2d(64, 128, 3, padding=1),\n nn.ReLU(),\n nn.AdaptiveAvgPool2d(1)\n )\n self.classifier = nn.Linear(128, 10)\n \n def forward(self, x):\n x = self.features(x)\n x = x.view(x.size(0), -1)\n return self.classifier(x)", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_45", "embedding": [ -0.049135319888591766, -0.10858825594186783, 0.012874841690063477, -0.0022806015331298113, 0.0062566944397985935, -0.017082761973142624, 0.02974911779165268, 0.002725324360653758, -0.05089487507939339, -0.0972333624958992, 0.03840062394738197, 0.0033354698680341244, -0.06931096315383911, 0.06584469974040985, -0.08342897146940231, 0.04313357174396515, -0.03220795467495918, 0.010519617237150669, -0.07734015583992004, -0.059137724339962006, 0.09146499633789062, -0.0030472392681986094, 0.020898515358567238, 0.012182813137769699, -0.01619199477136135, 0.04169589281082153, 0.011889551766216755, 0.010883809998631477, 0.10703594237565994, -0.06094939261674881, 0.021470680832862854, 0.031152408570051193, -0.09434125572443008, 0.019080527126789093, 0.015738893300294876, -0.012630886398255825, -0.0890854075551033, 0.011511232703924179, -0.026897139847278595, 0.06285016983747482, 0.019375966861844063, -0.03334011137485504, 0.025992875918745995, -0.005649012979120016, 0.08126075565814972, 0.12671992182731628, 0.05754983425140381, 0.013312104158103466, 0.029372699558734894, -0.05155937001109123, 0.010589806362986565, 0.02205832675099373, -0.08966996520757675, 0.02168983593583107, 0.05714898556470871, 0.00350190419703722, 0.026207635179162025, -0.06927251815795898, -0.004691486246883869, -0.052773818373680115, 0.07224424928426743, 0.004561120644211769, 0.06431406736373901, -0.03760616108775139, 0.008270221762359142, -0.016210775822401047, 0.004230690188705921, 0.006826138123869896, 0.023337310180068016, 0.023507801815867424, -0.0048645115457475185, 0.05050794035196304, -0.03204963356256485, 0.0507095605134964, 0.0220881849527359, -0.07643196731805801, 0.14144471287727356, 0.05946290120482445, 0.04549655318260193, -0.045060280710458755, -0.01496921293437481, 0.008685133419930935, 0.07612334936857224, -0.006526496261358261, 0.07719007879495621, -0.07880915701389313, -0.0033937853295356035, 0.008244339376688004, 0.03296233341097832, -0.005310512613505125, -0.01105827558785677, -0.004356750287115574, -0.10526898503303528, 0.014370591379702091, -0.031458694487810135, 0.004566546529531479, 0.014814021997153759, 0.026857219636440277, -0.08555503189563751, 0.04711189866065979, -0.021400192752480507, -0.09724636375904083, -0.06860760599374771, 0.05079067498445511, 0.038021888583898544, 0.055938053876161575, 0.037525955587625504, 0.07034929096698761, 0.017262017354369164, -0.029820768162608147, 0.02575204335153103, -0.041837356984615326, -0.02009378932416439, -0.03274703398346901, 0.037385210394859314, -0.025450918823480606, -0.07945340126752853, 0.05955934897065163, 0.022729001939296722, 0.055127620697021484, -0.01745319552719593, 0.03426438197493553, -0.022354716435074806, 0.05085000395774841, -0.011388648301362991, -0.0002867023285944015, -0.07958941906690598, 4.580106557099711e-33, -0.03399832919239998, 0.01588745042681694, -0.012906190939247608, -0.07539986073970795, -0.03296439349651337, 0.03654739633202553, 0.06481188535690308, -0.04565572738647461, -0.03749782592058182, 0.003567265812307596, -0.06536579877138138, -0.048932839184999466, -0.007025366649031639, 0.0426904633641243, -0.0099817905575037, -0.055224061012268066, -0.010445627383887768, 0.03368248790502548, -0.03512513265013695, 0.005746685434132814, 0.060841795057058334, 0.08960820734500885, 0.013694645836949348, -0.08344335854053497, -0.08577952533960342, -0.017052559182047844, -0.020553041249513626, -0.027486706152558327, -0.019265586510300636, 0.01357291266322136, -0.034839678555727005, -0.0522875115275383, 0.030658254399895668, 0.02658911980688572, -0.019522013142704964, -0.049543920904397964, 0.050659701228141785, 0.01729542948305607, -0.021996738389134407, -0.07916940003633499, -0.00406939210370183, 0.09940523654222488, -0.0032588967587798834, -0.060889050364494324, -0.07188322395086288, 0.004176141228526831, 0.02974834106862545, 0.08913607895374298, -0.10137584060430527, -0.027690470218658447, -0.04143817350268364, -0.0007807771326042712, -0.006096532102674246, 0.00373900611884892, -0.0037093935534358025, -0.03518011420965195, 0.03759370744228363, 0.07190369814634323, 0.054016727954149246, -0.04338473826646805, 0.000491475744638592, 0.033646393567323685, -0.01918608509004116, 0.026100074872374535, -0.008234935812652111, 0.012933041900396347, 0.023361338302493095, 0.025738291442394257, 0.048055250197649, -0.010876159183681011, -0.09498893469572067, 0.060920871794223785, -0.07073608785867691, -0.03942074626684189, 0.015539954416453838, -0.10246893763542175, 0.033148929476737976, -0.06870592385530472, -0.08556235581636429, -0.021248167380690575, -0.09962059557437897, 0.10376911610364914, 0.0027892636135220528, -0.10256098955869675, -0.11498680710792542, -0.022074218839406967, 0.032159917056560516, -0.02683139778673649, -0.027961332350969315, -0.05198816955089569, -0.06396457552909851, -0.08383291214704514, 0.09396643936634064, 0.004492380190640688, -0.004086636938154697, -4.148160504972507e-33, 0.039948683232069016, 0.06489473581314087, -0.014148561283946037, 0.05374961346387863, 0.008466891944408417, 0.006474320311099291, 0.04187880828976631, 0.06267412006855011, -0.05623095855116844, -0.04939498379826546, 0.03792432323098183, 0.003511781571432948, -0.024606777355074883, -0.027352796867489815, 0.07318336516618729, -0.018352244049310684, -0.05843445658683777, 0.03081287257373333, 0.021877549588680267, -0.0316154882311821, -0.03950957581400871, 0.13606104254722595, -0.074564129114151, 0.035872217267751694, -0.1261613667011261, 0.06141376122832298, -0.011182748712599277, 0.049104560166597366, 0.015361262485384941, -0.007430083118379116, -0.018416674807667732, -0.025812074542045593, -0.08042293041944504, 0.07435905188322067, -0.017942247912287712, 0.03035922907292843, 0.027898728847503662, -0.06525599956512451, -0.010621899738907814, 0.08144649118185043, 0.11132518202066422, 0.03518423065543175, -0.04724322259426117, 0.11625834554433823, -0.07372976839542389, 0.018803207203745842, -0.03750205039978027, 0.026037322357296944, 0.011812492273747921, 0.0011701977346092463, -0.05505432188510895, -0.08901368826627731, -0.058268021792173386, 0.04626680165529251, -0.03065737523138523, 0.02897455170750618, 0.01993400789797306, 0.031072348356246948, 0.02886594645678997, 0.0589776374399662, -0.026961863040924072, -0.09023965150117874, 0.025673136115074158, -0.041389238089323044, 0.013391966000199318, -0.009518000297248363, -0.053209174424409866, 0.053775474429130554, 0.03965790942311287, 0.04369986802339554, -0.04040512070059776, 0.13157539069652557, 0.02420308068394661, -0.003104858798906207, -0.01687583327293396, -0.028999213129281998, 0.02539440058171749, 0.028839239850640297, 0.07583799958229065, -0.039247531443834305, -0.1067771166563034, -0.02985706366598606, 0.03945479542016983, 0.11871959269046783, 0.05113933980464935, 0.0027871602214872837, 0.08616115152835846, 0.11055566370487213, 0.028660940006375313, -0.07499567419290543, 0.042003534734249115, 0.009932721965014935, 0.07188739627599716, 0.09254847466945648, 0.053404565900564194, -5.668486124932315e-08, -0.08914491534233093, -0.05556005984544754, 0.03172207251191139, 0.038060497492551804, 0.013308162800967693, -0.02977607399225235, 0.03453125059604645, 0.0797559916973114, 0.00917847454547882, -0.04091447964310646, 0.09465140104293823, -0.0026776972226798534, 0.00814940594136715, -0.025493456050753593, 0.014465024694800377, 0.05608466640114784, -0.05115070194005966, 0.004801289644092321, -0.016993865370750427, -0.03683795779943466, -0.03886420279741287, -0.09768515825271606, -0.01815430447459221, -0.017660940065979958, -0.06393929570913315, -0.0714741200208664, 0.005490811076015234, -0.0018691166769713163, 0.015055658295750618, -0.019690126180648804, -0.008032006211578846, -0.019554929807782173, 0.07847005873918533, 0.01787884719669819, 0.0412612222135067, 0.07997605949640274, 0.001842364901676774, 0.018306473270058632, -0.004580832552164793, 0.016595778986811638, -0.08683860301971436, 0.048902325332164764, -0.0005463433917611837, -0.013926985673606396, 0.09315210580825806, -0.020916691049933434, 0.02159024402499199, -0.09719017893075943, -0.027374843135476112, 0.0338139645755291, 0.023282699286937714, 0.01916557550430298, -0.010080668143928051, 0.06791120767593384, 0.07095322757959366, -0.05706936866044998, -0.08220512419939041, 0.03220934793353081, -0.02682291716337204, 0.03163554519414902, 0.007115418557077646, 0.017162185162305832, -0.059379030019044876, -0.026796024292707443 ] }, { "text": "# Training function\ndef train(model, train_loader, epochs=10, device='cpu'):\n model = model.to(device)\n criterion = nn.CrossEntropyLoss()\n optimizer = optim.Adam(model.parameters(), lr=0.001)\n scheduler = optim.lr_scheduler.StepLR(optimizer, step_size=5, gamma=0.5)\n \n for epoch in range(epochs):\n model.train()\n total_loss = 0\n correct = 0\n total = 0\n \n for batch_x, batch_y in train_loader:\n batch_x, batch_y = batch_x.to(device), batch_y.to(device)\n \n optimizer.zero_grad()\n outputs = model(batch_x)\n loss = criterion(outputs, batch_y)\n loss.backward()\n optimizer.step()\n \n total_loss += loss.item()", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_46", "embedding": [ -0.05812683701515198, -0.0462600477039814, 0.0009286994463764131, 0.04784757271409035, -0.017529916018247604, -0.05345465987920761, -0.03553298860788345, 0.06247103959321976, -0.10999589413404465, -0.09145965427160263, -0.014460968784987926, -0.0779455304145813, -0.006169585511088371, -0.05994695797562599, -0.045964017510414124, 0.02558782510459423, -0.020946472883224487, -0.006637893617153168, -0.03694136068224907, -0.10436522215604782, 0.06536166369915009, 0.023537442088127136, 0.013640804216265678, 0.021858833730220795, 0.011238901875913143, -0.054669320583343506, -0.0139445336535573, 0.015397942624986172, 0.03472273051738739, -0.012697329744696617, 0.08545280992984772, -0.02242281287908554, -0.03010297566652298, 0.04824366793036461, 0.030431510880589485, 0.01485986914485693, -0.05769805237650871, -0.08298517763614655, -0.014719739556312561, 0.017565155401825905, 0.021141786128282547, -0.02636011876165867, -0.034556832164525986, -0.04365396872162819, 0.04996713995933533, 0.045547764748334885, -0.014274478890001774, -0.004231506492942572, 0.038487207144498825, -0.0025051578413695097, -0.002781858202069998, -0.021273313090205193, -0.005543370731174946, -0.0444706454873085, -0.054502490907907486, 0.03742612525820732, 0.06903206557035446, -0.023761996999382973, -0.05603973940014839, -0.002342856489121914, -0.02809717319905758, -0.05502016469836235, -0.05251016467809677, -0.04647297412157059, -0.01260222028940916, -0.05001341551542282, 0.007306569721549749, -0.02352612465620041, 0.027309052646160126, 0.06813327223062515, 0.06585542857646942, 0.03378036618232727, -0.017751941457390785, 0.015367682091891766, -0.0358654223382473, 0.005848489236086607, 0.14950448274612427, 0.02868826314806938, -0.053237490355968475, -0.09765426069498062, -0.052155766636133194, -0.034562479704618454, 0.02878161519765854, -0.025501133874058723, 0.06904608756303787, -0.07324060797691345, 0.05374302342534065, 0.019370488822460175, 0.07927282899618149, 0.009433620609343052, 0.0490192174911499, 0.02359848842024803, -0.050167374312877655, -0.005863327533006668, 0.0504002720117569, 0.08383026719093323, -0.021642547100782394, -0.014971695840358734, -0.06934785842895508, 0.05809192731976509, -0.0024441659916192293, -0.051402829587459564, 0.065839983522892, 0.044405341148376465, -0.0012353757629171014, 0.03942698612809181, 0.10631195455789566, 0.02793676033616066, -0.006207311991602182, -0.04542308300733566, 0.07478482276201248, 0.06904958188533783, 0.02900754101574421, 0.012392141856253147, 0.08181539922952652, 0.0627453550696373, -0.01598813571035862, 0.05645938590168953, -0.024810323491692543, 0.07106571644544601, -0.09847860783338547, 0.07252981513738632, -0.01876678504049778, -0.006529104430228472, -0.04356556758284569, -0.009099936112761497, -0.04781320318579674, 6.362432968802711e-33, -0.03362744674086571, -0.016499584540724754, -0.011594880372285843, -0.13085801899433136, -0.04305272176861763, 0.020289035513997078, -0.006180738098919392, 0.03606179729104042, -0.033286575227975845, -0.02123088575899601, -0.11780072748661041, -0.06704113632440567, -0.02694249339401722, 0.05463884770870209, -0.013560537248849869, -0.050972919911146164, 0.012348317541182041, 0.033822838217020035, 0.12822702527046204, -0.0016868290258571506, 0.09168621152639389, -0.11869179457426071, -0.09310711175203323, -0.041347336024045944, -0.0364832878112793, 0.09811023622751236, 0.0498497299849987, -0.045419104397296906, -0.09502939134836197, -0.0040208869613707066, -0.07553019374608994, 0.01048849243670702, 0.010528840124607086, -0.018462948501110077, 0.029087599366903305, -0.030444137752056122, 0.022769970819354057, 0.09896444529294968, 0.06045671924948692, -0.034578584134578705, -0.024869704619050026, 0.04154602438211441, 0.02239021472632885, -0.04967395216226578, -0.05281495302915573, -0.056067485362291336, 0.015022155828773975, 0.06280434131622314, 0.0440196692943573, 0.03295230492949486, -0.014602607116103172, -0.0785142332315445, 0.027753444388508797, -0.08204562962055206, -0.017135117202997208, -0.01894288696348667, 0.056238893419504166, 0.0948566421866417, 0.13622787594795227, -0.019213121384382248, 0.06513054668903351, 0.02689116634428501, -0.028137998655438423, 0.0024085461627691984, -0.0034230975434184074, 0.020914753898978233, 0.011932731606066227, -0.05315326154232025, 0.015760445967316628, 0.061305414885282516, -0.08342286944389343, -0.00030690222047269344, 0.021358080208301544, -0.05306291952729225, 0.1258477121591568, -0.07958914339542389, 0.012118643149733543, -0.07754293084144592, -0.07734880596399307, -0.00401662802323699, -0.04772252216935158, 0.1102699488401413, -0.08114586025476456, -0.10721484571695328, -0.025357834994792938, -0.04801378399133682, 0.028085827827453613, 0.015969134867191315, -0.0006116129807196558, -0.022523336112499237, -0.016297845169901848, -0.06039150431752205, 0.018481522798538208, 0.05658695101737976, -0.03406250476837158, -7.373673289932693e-33, 0.0244570504873991, 0.04240471497178078, 0.03286490961909294, 0.01903652213513851, 0.052613623440265656, -0.015298976562917233, 0.024892913177609444, 0.020833972841501236, -0.026589063927531242, 0.006237476598471403, -0.006616807077080011, -0.06530497223138809, -0.02321830950677395, -0.03631364554166794, 0.0548948235809803, -0.020479632541537285, -0.030477002263069153, 0.033144086599349976, 0.05594032257795334, -0.013512997888028622, -0.03879760578274727, 0.14028774201869965, -0.12083330005407333, -0.0188757237046957, 0.004705838859081268, -0.04842387139797211, -0.014041773043572903, 0.11824870854616165, 0.04237344115972519, -0.08013419061899185, -0.04473772272467613, 0.0039046439342200756, -0.036297231912612915, 0.052114635705947876, 0.08189645409584045, 0.07376473397016525, 0.005192995071411133, 0.00706439046189189, -0.006318212021142244, 0.058812759816646576, 0.12504936754703522, 0.05793074518442154, -0.017659610137343407, 0.04961274191737175, 0.017949648201465607, 0.05036328732967377, -0.062476109713315964, -0.04701347276568413, -0.09103865176439285, 0.00261944392696023, 0.005050626117736101, -0.03683723509311676, -0.07184001803398132, 0.025977440178394318, 0.011391901411116123, -0.024947935715317726, 0.011062619276344776, -0.05808200314640999, -0.03577478602528572, 0.02083822898566723, -0.04677984490990639, -0.09913129359483719, 0.002045445842668414, -0.03175003454089165, -0.04678884893655777, 0.032935090363025665, -0.037405453622341156, 0.06797901540994644, 0.004660413134843111, 0.03809483349323273, -0.04088984802365303, 0.04235129430890083, 0.07143785804510117, 0.030392875894904137, -0.10979766398668289, 0.0352998711168766, -0.040802840143442154, 0.016780175268650055, -0.01354117039591074, -0.032758574932813644, -0.029425866901874542, -0.027349155396223068, 0.013928182423114777, 0.060532908886671066, -0.027151618152856827, 0.04336417466402054, 0.06094890460371971, 0.13005059957504272, 0.026285964995622635, -0.062268879264593124, 0.04313330352306366, -0.05122818797826767, 0.037156842648983, 0.08620204031467438, -0.0016194900963455439, -5.3243702780036983e-08, 0.019836965948343277, 0.006784537807106972, 0.0789281502366066, 0.08442875742912292, 0.05748468637466431, -0.036765940487384796, 0.03319130837917328, -0.00019926072855014354, 0.04232237488031387, 0.008634758181869984, 0.051966868340969086, -0.05039605870842934, -0.025613926351070404, 0.01790749654173851, 0.03790735453367233, 0.04020529240369797, -0.02030603028833866, 0.07146652042865753, 0.03528743237257004, -0.03731771931052208, -0.019820261746644974, -0.0475304089486599, -0.009612896479666233, -0.0382743701338768, -0.009591960348188877, -0.061213210225105286, 0.023776443675160408, 0.02393810823559761, -0.0029393909499049187, -0.05461178719997406, -0.010379262268543243, 0.014539689756929874, 0.028750387951731682, 0.02152637206017971, -0.033196110278367996, 0.057987429201602936, 0.05405683442950249, 0.061974357813596725, 0.07995034754276276, 0.045561447739601135, -0.08124527335166931, 0.01875687763094902, -0.07294787466526031, -0.07084458321332932, 0.029910970479249954, -0.019716661423444748, -0.027794549241662025, -0.07820410281419754, 0.0035156162921339273, 0.019429853186011314, 0.0015798378735780716, -0.017499441280961037, -0.008379251696169376, 0.01417651679366827, 0.008720193058252335, -0.09878648072481155, -0.05954860523343086, -0.07210686057806015, -0.06981262564659119, -0.007397254928946495, -0.0083471005782485, -0.0026876917108893394, -0.037199974060058594, -0.030156753957271576 ] }, { "text": "loss.backward()\n optimizer.step()\n \n total_loss += loss.item()\n _, predicted = outputs.max(1)\n correct += predicted.eq(batch_y).sum().item()\n total += batch_y.size(0)\n \n scheduler.step()\n \n accuracy = 100. * correct / total\n print(f\"Epoch {epoch+1}/{epochs} - Loss: {total_loss:.4f} - Accuracy: {accuracy:.2f}%\")", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_47", "embedding": [ -0.018511559814214706, 0.0627545490860939, -0.05865533649921417, 0.08070852607488632, -0.03280768543481827, -0.047785744071006775, -0.05824596434831619, 0.05284219980239868, -0.09898079186677933, -0.03646747022867203, -0.052860014140605927, -0.06622447818517685, 0.039718322455883026, -0.05678845942020416, -0.11361953616142273, -0.04474663361907005, -0.06930399686098099, 0.05891123414039612, -0.0031449925154447556, -0.15415821969509125, -0.02972068451344967, 0.01941009610891342, 0.0603204146027565, 0.07430700212717056, 0.03130890056490898, -0.02903253585100174, -0.10060930997133255, 0.009440208785235882, 0.012316842563450336, -0.0007576796924695373, 0.0052562737837433815, -0.006367983762174845, 0.039414383471012115, 0.005495135672390461, 0.018478522077202797, -0.011508781462907791, -0.04948599264025688, -0.04703449085354805, 0.08721232414245605, -0.022823983803391457, 0.03254379332065582, 0.01081625372171402, -0.013112576678395271, 0.007175794802606106, -0.02360904961824417, 0.031665168702602386, -0.050504714250564575, -0.01969950459897518, 0.004840224049985409, 0.07479492574930191, -0.008896349929273129, 0.03875919058918953, 0.019581399857997894, -0.035794515162706375, -0.06234126165509224, 0.10935790836811066, 0.10932567715644836, 0.05053829029202461, -0.088997483253479, -0.017988741397857666, 0.012954170815646648, -0.07471618056297302, -0.11255185306072235, -0.07511419802904129, -0.010135354474186897, -0.021142348647117615, -0.0015244907699525356, -0.02067345567047596, 0.00836148764938116, 0.06206175684928894, 0.03786715492606163, 0.012053952552378178, 0.04161852225661278, 0.009521030820906162, -0.05239136144518852, -0.037211980670690536, 0.13017870485782623, 0.07908248156309128, -0.04142950847744942, 0.025828542187809944, -0.03749118000268936, -0.044912345707416534, 0.012758822180330753, -0.05106125771999359, 0.028428955003619194, -0.06481533497571945, 0.04588619992136955, 0.03191617503762245, 0.08253416419029236, 0.005456766579300165, -0.02397988550364971, -0.04976462945342064, -0.04313519597053528, -0.014653398655354977, 0.031970441341400146, 0.09416492283344269, -0.0030428143218159676, -0.008996759541332722, 0.0036843703128397465, 0.010715263895690441, -0.026156418025493622, -0.04130621626973152, 0.027941996231675148, -0.04225464165210724, 0.09962301701307297, 0.00848256517201662, 0.0790185034275055, 0.01786855235695839, 0.03459908813238144, -0.007384492550045252, 0.09436984360218048, 0.04250499606132507, 0.08399438112974167, 0.0053593493066728115, 0.13720674812793732, 0.020071955397725105, -0.0007507047848775983, 0.05072099715471268, 0.004509401507675648, 0.047545112669467926, -0.07904960215091705, 0.06609564274549484, 0.07354787737131119, -0.018353503197431564, -0.018206769600510597, -0.03816801309585571, 0.0042454516515135765, 3.950933858739636e-34, -0.052324872463941574, -0.0507601723074913, 0.03245840221643448, -0.09431371837854385, 0.00948378350585699, 0.0664960965514183, -0.02916863188147545, -0.005263116676360369, 0.0462157242000103, -0.07019168883562088, -0.0876142606139183, -0.05778152868151665, -0.026242556050419807, 0.05423978343605995, 0.004808672703802586, -0.08315500617027283, 0.03316637501120567, 0.07988028228282928, 0.033900000154972076, -0.01743880845606327, 0.06150595471262932, -0.05554395541548729, -0.06758184731006622, -0.09216511249542236, -0.0012690379517152905, 0.042900390923023224, 0.05472423881292343, -0.023546956479549408, -0.13478007912635803, 0.003165429923683405, 0.0018991518300026655, 0.004224782343953848, 0.01739293336868286, -0.0660184845328331, 0.04916417971253395, -0.04056008160114288, 0.022342391312122345, 0.09774745255708694, 0.039069920778274536, -0.014244109392166138, -0.08640160411596298, 0.014077276922762394, 0.008811586536467075, -0.053168885409832, -0.05824458971619606, -0.0360165573656559, -0.0031455345451831818, 0.04194163531064987, 0.06393882632255554, 0.07203835994005203, 0.0030520702712237835, -0.11097138375043869, -0.011964239180088043, 0.0050783585757017136, -0.0037947490345686674, -0.056268349289894104, 0.08876211196184158, 0.04677111282944679, 0.11590227484703064, -0.04469425603747368, 0.0516115240752697, 0.05775647982954979, -0.01904498040676117, -0.020586468279361725, -0.05715246498584747, 0.030570602044463158, 0.052780624479055405, -0.014374819584190845, -0.02114143967628479, 0.039889998733997345, -0.07592984288930893, 0.031653959304094315, 0.029548490419983864, -0.030837051570415497, 0.10306569933891296, -0.031184159219264984, 0.08909450471401215, -0.06528985500335693, -0.035889048129320145, -0.03698030486702919, -0.0010357550345361233, 0.09711411595344543, -0.10482953488826752, -0.0739307776093483, 0.0075152539648115635, 0.013673707842826843, 0.0051332879811525345, 0.030670564621686935, 0.023997731506824493, -0.0170576274394989, -0.07879514247179031, -0.044458601623773575, 0.02529892511665821, 0.09487364441156387, -0.06447502970695496, -1.8767410159350926e-33, 0.01978856883943081, 0.10263030230998993, 0.03891954571008682, 0.050668492913246155, -0.016009889543056488, -0.03412890061736107, 0.024889515712857246, 0.06479384005069733, -0.021515604108572006, 0.04507845640182495, -0.01523233950138092, -0.020048419013619423, -0.08064690977334976, 0.042600929737091064, 0.027996109798550606, -0.027339620515704155, -0.019659096375107765, -0.0013922832440584898, 0.055674467235803604, -0.05477650463581085, -0.008965334855020046, 0.021023733541369438, -0.09962214529514313, 0.06147075071930885, 0.042078789323568344, -0.02477981336414814, 0.04717092961072922, 0.10668522864580154, 0.007191666401922703, -0.10851708054542542, 0.016493702307343483, -0.02806168608367443, 0.02025379054248333, 0.058931268751621246, 0.04695941507816315, -0.02187059260904789, 0.0026230113580822945, -0.02823513187468052, 0.04422806575894356, 0.03878919035196304, 0.0695452094078064, 0.003924060147255659, -0.06343866139650345, 0.043729089200496674, 0.008394855074584484, 0.03267355635762215, -0.02172451838850975, -0.01479358784854412, -0.007451383396983147, -0.030168598517775536, 0.028802646324038506, -0.06313158571720123, -0.10886498540639877, 0.06607041507959366, 0.02574903517961502, -0.0028814978431910276, -0.01746731996536255, -0.0414172001183033, -0.06726899743080139, 0.04761449620127678, -0.09635418653488159, -0.011308704502880573, 0.06040681526064873, 0.03853696957230568, -0.013672739267349243, 0.04036403447389603, -0.06273550540208817, 0.04784533008933067, 0.028011269867420197, 0.050847429782152176, 0.04871358349919319, 0.08233021944761276, 0.007232423406094313, 0.05916110798716545, -0.02377604879438877, -0.010512551292777061, -0.04061805456876755, 0.022184668108820915, 0.03872786834836006, 0.06787405163049698, -0.02465997263789177, 0.018054451793432236, 0.042731259018182755, 0.0065489583648741245, -0.01318320631980896, 0.023418646305799484, -0.0017375103197991848, 0.056770049035549164, -0.00729635963216424, -0.004943322855979204, 0.00824244599789381, -0.013978532515466213, 0.03546224161982536, 0.00853310152888298, 0.02851065620779991, -4.192726166252214e-08, -0.057688821107149124, -0.022009219974279404, 0.0787210762500763, 0.06994949281215668, 0.02836300991475582, -0.01013012882322073, 0.002049222821369767, 0.005935143679380417, 0.0022716871462762356, 0.00031665837741456926, 0.05377230420708656, -0.10009929537773132, -0.06655032932758331, 0.025210870429873466, -0.022989284247159958, 0.019751431420445442, 0.004532747436314821, 0.025113826617598534, 0.02741081826388836, -0.020708007737994194, 0.01274630706757307, -0.04550870880484581, 0.030401606112718582, -0.05255815386772156, -0.07232046127319336, -0.05110470578074455, -0.009117747657001019, 0.11574126780033112, -0.051940057426691055, -0.047319673001766205, 0.02394057996571064, -0.011678076349198818, 0.031470298767089844, 0.05691460520029068, -0.08759424090385437, 0.022796327248215675, 0.0012443006271496415, -0.015021349303424358, 0.06003160774707794, 0.05237676948308945, -0.08059203624725342, -0.012842629104852676, -0.056151583790779114, -0.035008035600185394, -0.01780265010893345, -0.03818751499056816, 0.02636713720858097, -0.038419853895902634, -0.03698870912194252, -0.07375214248895645, 0.03756151720881462, -0.011747311800718307, 0.0058277687057852745, 0.049679458141326904, 0.0030323704704642296, -0.0891309529542923, -0.10543754696846008, -0.09362141042947769, -0.024343229830265045, 0.041693639010190964, -0.027206534519791603, -0.02519584819674492, -0.03909074142575264, -0.01698991283774376 ] }, { "text": "# Create sample data and train\nX = torch.randn(1000, 3, 32, 32) # 1000 RGB images 32x32\ny = torch.randint(0, 10, (1000,)) # 10 classes\n\ndataset = TensorDataset(X, y)\nloader = DataLoader(dataset, batch_size=32, shuffle=True)\n\nmodel = ImageClassifier()\ntrain(model, loader, epochs=5)\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_48", "embedding": [ 0.0377323217689991, -0.10597635060548782, -0.002842081245034933, -0.005222254898399115, 0.027946120128035545, -0.03452965244650841, 0.028155814856290817, -0.007596393581479788, -0.11797098070383072, -0.10423321276903152, -0.03218211606144905, -0.013713579624891281, -0.04059368371963501, 0.02292237989604473, -0.0219923947006464, 0.052523158490657806, -0.05272550508379936, 0.010400405153632164, -0.09560824185609818, -0.04645152762532234, 0.08802315592765808, -0.07655729353427887, 0.0765322595834732, 0.0012602154165506363, -0.04123017564415932, -0.009908227249979973, 0.09033247083425522, -0.07430822402238846, 0.04736363887786865, -0.015670502558350563, 0.03925437107682228, -0.012464695610105991, -0.05647364631295204, 0.018480397760868073, 0.034103795886039734, -0.06265155225992203, -0.08331048488616943, -0.06596309691667557, 0.001451224321499467, 0.08458215743303299, 0.00861446000635624, -0.016992934048175812, 0.004407364875078201, 0.009710886515676975, 0.02554933726787567, 0.06173223257064819, 0.09165983647108078, -0.00333781773224473, 0.0667872279882431, -0.015157562680542469, 0.021448927000164986, -0.030148779973387718, -0.0810868889093399, 0.029569953680038452, -0.02434246614575386, -0.03067539446055889, 0.05414668843150139, -0.02660689502954483, -0.029037125408649445, -0.049725648015737534, 0.0031119834166020155, -0.01807062327861786, 0.02267790213227272, -0.006034073419868946, -0.008900630287826061, -0.03786433860659599, -0.007997028529644012, -0.006883583497256041, 0.08359774947166443, -0.08677846193313599, 0.016665156930685043, 0.03784175217151642, 0.009141501039266586, 0.09553798288106918, -0.07655229419469833, -0.04531445354223251, 0.1354566067457199, 0.03960612788796425, 0.03711220622062683, -0.06214255094528198, -0.07998056709766388, -0.060855962336063385, 0.11854595690965652, -0.003933772444725037, 0.05683045834302902, -0.0478285476565361, 0.015652410686016083, 0.10007352381944656, -0.03088109940290451, -0.02574096992611885, -0.01245272159576416, 0.04581087827682495, -0.10835126787424088, 0.03719736635684967, -0.005359788425266743, 0.008888323791325092, 0.0833943784236908, -0.034689437597990036, -0.0518069863319397, 0.009428913705050945, -0.017366556450724602, -0.07847543060779572, -0.0014623802853748202, 0.13025802373886108, 0.0017474353080615401, 0.013457611203193665, -0.01366758719086647, 0.04967251792550087, -0.03826205059885979, -0.006802036426961422, 0.06305760145187378, 0.05059807002544403, -0.02875537984073162, -0.03742466866970062, 0.06512389332056046, -0.0007714416715316474, -0.113918237388134, 0.0466516949236393, -0.06309731304645538, 0.07426522672176361, -0.05756814777851105, 0.07560981065034866, -0.02809019573032856, 0.01360016968101263, -0.08303827792406082, -0.04849182441830635, -0.04166552424430847, 6.432405004719377e-33, -0.014080382883548737, -0.025380656123161316, -0.03619245067238808, -0.02082531526684761, 0.016144052147865295, 0.04429878294467926, 0.07167036086320877, -0.029196998104453087, -0.04285598546266556, 0.01335106324404478, -0.043859075754880905, -0.035130273550748825, 0.045049238950014114, 0.07182620465755463, -0.07194774597883224, -0.025805402547121048, 0.003290419466793537, -0.0023946973960846663, 0.06039191782474518, 0.0529690720140934, 0.06867660582065582, 0.058591969311237335, 0.038994304835796356, 0.011009416542947292, -0.10779231786727905, -0.02260000817477703, -0.014774477109313011, 0.016528738662600517, 0.025324111804366112, 0.009918359108269215, -0.028276855126023293, -0.04988674446940422, 0.009988702833652496, -0.003757936181500554, -0.003071574494242668, -0.07036780565977097, 0.058029573410749435, 0.05700824037194252, -0.06875432282686234, -0.09228550642728806, 0.07209601998329163, 0.0842147096991539, 0.040233027189970016, -0.06812556833028793, -0.08178020268678665, 0.007876355201005936, 0.03572992980480194, 0.06803655624389648, 0.022165030241012573, 0.01837954856455326, -0.01790626533329487, -0.05598888173699379, -0.009294920600950718, 0.008751963265240192, 0.04788101091980934, -0.04833930730819702, 0.057615965604782104, 0.030708033591508865, 0.11238524317741394, -0.05901588499546051, 0.028903286904096603, 0.028858507052063942, 0.018669607117772102, 0.07555805891752243, 0.007820550352334976, -0.006740084383636713, 0.05434729903936386, -0.029143664985895157, -0.02967320941388607, 0.03721104934811592, -0.05947989597916603, 0.054345376789569855, -0.044520195573568344, -0.03288274258375168, 0.006498595234006643, -0.0701928362250328, 0.0454748161137104, -0.0036504031158983707, -0.09226668626070023, 0.05100024491548538, -0.0734928548336029, 0.05936434864997864, 0.007211916148662567, -0.12842907011508942, -0.09001867473125458, 0.022127296775579453, -0.022511636838316917, -0.015041518956422806, 0.0053482577204704285, -0.03827209398150444, -0.043756306171417236, -0.042841870337724686, 0.06577088683843613, -0.0004883927758783102, -0.035537149757146835, -5.7594646109163574e-33, 0.026829876005649567, 0.08267563581466675, -0.013302275910973549, 0.017603186890482903, -0.008784670382738113, 0.014344516210258007, 0.021389344707131386, 0.060135792940855026, -0.026647379621863365, 0.004634502809494734, 0.03831261768937111, 0.008101725950837135, -0.04689188301563263, -0.05485288053750992, 0.0009435784886591136, -0.06028824299573898, 0.007882275618612766, 0.007652463391423225, -0.011761163361370564, -0.012411446310579777, -0.06151934713125229, 0.09206710010766983, -0.05224606767296791, -0.000894001277629286, -0.09477151930332184, 0.021963216364383698, -0.00797363556921482, 0.050538066774606705, 0.03627869114279747, -0.03893095254898071, 0.001616240362636745, -0.025219058617949486, -0.05735306814312935, 0.006510761100798845, -0.026552222669124603, 0.03331353887915611, 0.09304972738027573, 0.003215423785150051, -0.013775750063359737, 0.07459719479084015, 0.026748051866889, 0.02688349224627018, -0.0894850417971611, 0.09578373283147812, -0.08123204857110977, -0.00024214635777752846, -0.07286275178194046, 0.011745435185730457, 0.03061228059232235, 0.009461325593292713, -0.0014717341400682926, -0.07348718494176865, -0.05944138392806053, -0.01260377001017332, 0.03021150268614292, -0.05105562135577202, -0.02796478196978569, 0.02166929841041565, 0.04287566617131233, 0.08305394649505615, -0.003949456382542849, -0.07325297594070435, -0.017648955807089806, -0.06145252287387848, -0.05080045014619827, 0.012357351370155811, -0.12251317501068115, 0.03299097344279289, 0.02964193932712078, 0.13626179099082947, 0.0006906346534378827, 0.0793461799621582, 0.021350115537643433, 0.062136512249708176, -0.04281063750386238, -0.025529399514198303, 0.006644229870289564, 0.048689208924770355, 0.11751546710729599, -0.021577637642621994, 0.019361115992069244, -0.007796440273523331, 0.01658862642943859, 0.06461183726787567, 0.0690457671880722, 0.074260413646698, 0.019813552498817444, 0.0494731105864048, 0.06514029204845428, -0.04432658478617668, 0.046281032264232635, -0.04696188494563103, 0.09941855072975159, 0.07458853721618652, 0.07644681632518768, -4.4559190115478486e-08, 1.9115990653517656e-05, 0.011920996010303497, 0.09405294060707092, 0.04377823323011398, -0.04366757348179817, -0.013919839635491371, 0.01971731334924698, 0.07060837000608444, 0.05643900856375694, -0.013196965679526329, 0.061007581651210785, -0.024378398433327675, 0.008347244001924992, 0.016854247078299522, 0.02572365663945675, 0.04697906970977783, -0.007896156050264835, 0.025386182591319084, 0.05451282486319542, 0.016372011974453926, 0.008580680005252361, -0.10231535881757736, 0.0070171961560845375, -0.020821627229452133, 0.0032983783166855574, -0.06579411029815674, 0.0294803399592638, 0.036988966166973114, -0.07244335114955902, -0.053418103605508804, -0.010643099434673786, -0.06569728255271912, 0.025306137278676033, -0.014440804719924927, 0.017996186390519142, 0.04315699636936188, -0.016102708876132965, -0.0027072597295045853, -0.006648967042565346, -0.029961897060275078, -0.10596571117639542, -0.02971319481730461, 0.03035919927060604, -0.06916949152946472, 0.02663525938987732, -0.046761155128479004, -0.02286979928612709, -0.07145135849714279, -0.003895203350111842, 0.04781201854348183, 0.014860679395496845, 0.019836323335766792, -0.055570680648088455, 0.045749228447675705, 0.042328644543886185, -0.03975268453359604, -0.042163509875535965, 0.02017810568213463, -0.03220200538635254, 0.013246647082269192, -0.0057412865571677685, 0.006478114519268274, -0.09037429839372635, -0.11993018537759781 ] }, { "text": "## Activation Functions\n\n```python\nimport torch\nimport torch.nn.functional as F\n\nx = torch.linspace(-5, 5, 100)\n\n# Common activation functions\nrelu = F.relu(x) # max(0, x)\nsigmoid = torch.sigmoid(x) # 1 / (1 + e^-x)\ntanh = torch.tanh(x) # (e^x - e^-x) / (e^x + e^-x)\nleaky_relu = F.leaky_relu(x, 0.01) # x if x > 0 else 0.01*x\ngelu = F.gelu(x) # Used in Transformers\n\n# In a model\nmodel = nn.Sequential(\n nn.Linear(10, 64),\n nn.GELU(), # or nn.ReLU(), nn.LeakyReLU(), etc.\n nn.Linear(64, 10)\n)\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_49", "embedding": [ -0.08391937613487244, -0.06554116308689117, 0.029252851381897926, 0.04349672421813011, -0.033874060958623886, -0.03390738368034363, 0.08263139426708221, 0.09198455512523651, -0.005936596542596817, -0.046634528785943985, 0.08148876577615738, -0.01741555705666542, -0.05873403698205948, 0.0582684688270092, -0.002952962415292859, -0.0015279646031558514, -0.04592791199684143, -0.0023887387942522764, -0.12179641425609589, -0.09897802770137787, 0.13333040475845337, -0.01991899497807026, 0.003112238133326173, -0.004619226790964603, 0.010980070568621159, -0.057443417608737946, 0.00597894424572587, -0.004027205985039473, 0.06968903541564941, -0.05686916410923004, 0.03120877593755722, 0.042218394577503204, -0.05944583937525749, -0.016790276393294334, 0.026946166530251503, -0.011816014535725117, -0.0836680680513382, -0.05984308198094368, -0.03616712987422943, 0.029221927747130394, -0.010439143516123295, -0.05490101873874664, -0.009522238746285439, -0.028662873432040215, 0.06095477193593979, 0.026416806504130363, 0.09061376750469208, 0.022965524345636368, 0.0035497599747031927, 0.01010584644973278, 0.09689553827047348, 0.08044411987066269, -0.035499393939971924, 0.0834842398762703, 0.025067558512091637, -0.048348426818847656, 0.02151411585509777, -0.10402128845453262, -0.028868861496448517, -0.023570895195007324, -0.0017006444977596402, -0.012423555366694927, 0.018138445913791656, -0.04807928577065468, -0.009884332306683064, 0.006271710153669119, -0.005813804920762777, -0.11287934333086014, 0.027986718341708183, 0.06187420338392258, -0.029756639152765274, -0.002764288568869233, -0.040470656007528305, 0.021477896720170975, 0.047623395919799805, -0.055370863527059555, 0.13359448313713074, 0.026842279359698296, -0.009294791147112846, -0.025554319843649864, 0.013960801996290684, 0.014245094731450081, 0.020909391343593597, -0.01342691108584404, 0.05931387096643448, 0.02524900622665882, 0.019864557310938835, 0.03962109982967377, 0.04418319836258888, -0.0005409936420619488, -0.059744685888290405, -0.021473294124007225, -0.062456198036670685, -0.04970682039856911, 0.027876585721969604, -0.0064787473529577255, 0.024984799325466156, 0.0024904999881982803, -0.08727959543466568, 0.027755431830883026, -0.07739599794149399, -0.047586750239133835, 0.03803369775414467, -0.027714604511857033, -0.02179407700896263, 0.05088905990123749, 0.016045812517404556, 0.09486818313598633, 0.013726566918194294, -0.04731149226427078, 0.039613962173461914, -0.03506523370742798, 0.04443442448973656, -0.01724296435713768, 0.08525056391954422, -0.05298205465078354, 0.017498081550002098, 0.03391001373529434, -0.020822690799832344, 0.06698068231344223, 0.027607809752225876, 0.03124997951090336, -0.07432028651237488, 0.11538631469011307, -0.10250036418437958, 0.039750996977090836, -0.050909414887428284, 7.068279122905093e-33, -0.07133009284734726, 0.09739452600479126, -0.06889753043651581, -0.033608775585889816, -0.04983283951878548, 0.028806066140532494, 0.007272757589817047, -0.003885404672473669, -0.09400901198387146, 0.041413504630327225, -0.08139883726835251, 0.06742402911186218, -0.03697098419070244, 0.0072629498317837715, -0.07040579617023468, -0.03962637111544609, 0.06792334467172623, 0.03465372323989868, 0.05244637280702591, -0.053251996636390686, 0.06853358447551727, 0.0351887121796608, 0.011496096849441528, -0.06284420937299728, -0.09694934636354446, 0.02585233375430107, -0.05228222906589508, -0.08185736835002899, -0.05275564640760422, -0.030663594603538513, 0.008742639794945717, 0.051834478974342346, 0.05467276647686958, -0.01394540537148714, 0.05196661129593849, 0.01502450555562973, 0.023987656459212303, -0.02576034888625145, 0.06562235206365585, -0.05835925042629242, -0.05128849297761917, 0.08531538397073746, 0.005677070468664169, -0.0163387693464756, -0.013002055697143078, -0.013715109787881374, -0.056426454335451126, 0.06504488736391068, 0.05673615634441376, -0.0293066818267107, -0.014096387661993504, 0.014372771605849266, -0.025496210902929306, 0.06084231659770012, 0.023605860769748688, 0.025435442104935646, 0.05284230783581734, 0.06424121558666229, 0.0700388178229332, -0.04147045686841011, 0.010356930084526539, 0.021070092916488647, -0.021812651306390762, 0.008755175396800041, -0.0067557599395513535, 0.022946586832404137, 0.005760567262768745, 0.06668693572282791, -0.010028338059782982, 0.01708531379699707, -0.07545438408851624, 0.060752637684345245, -0.017520830035209656, -0.07221782207489014, 0.0065617249347269535, -0.07047275453805923, 0.03139505535364151, -0.06972778588533401, -0.03220965340733528, -0.0007952245068736374, -0.05025918781757355, 0.055176250636577606, -0.0005436730571091175, -0.04581750929355621, -0.05131986364722252, -0.024544306099414825, 0.0065729813650250435, 0.028620896860957146, -0.04742021858692169, -0.03725915029644966, -0.02520551159977913, -0.07305443286895752, 0.058884020894765854, -0.01341330911964178, -0.04130084067583084, -6.743935252258269e-33, -0.04098130390048027, 0.04305253177881241, -0.014703121036291122, 0.041325442492961884, 0.002663603750988841, 0.02760222926735878, 0.013971463777124882, -0.028762342408299446, -0.005006853956729174, -0.051443275064229965, 0.07324686646461487, -0.029717298224568367, -0.08294783532619476, -0.03842851147055626, 0.10514891892671585, -0.000265793438302353, -0.07328051328659058, 0.00538255088031292, 0.02617178112268448, 0.015828361734747887, -0.057644572108983994, 0.0904955044388771, -0.17353364825248718, 0.029379038140177727, -0.11733725666999817, 0.04237409308552742, -0.05494043603539467, 0.061184730380773544, 0.056569091975688934, -0.015566748566925526, -0.06576009094715118, 0.03240640461444855, -0.05312299728393555, 0.041356321424245834, 0.034854453057050705, 0.02525300346314907, 0.06203846633434296, 0.02023971825838089, -0.010295764543116093, -0.030931750312447548, 0.10267116129398346, 0.030566606670618057, -0.004521836526691914, 0.05911137908697128, -0.03968365117907524, 0.06586189568042755, -0.007185025606304407, -0.04094689339399338, -0.03449803590774536, 0.015855465084314346, 0.034607477486133575, -0.09469772130250931, -0.11685796082019806, -0.0014473951887339354, -0.09941275417804718, 0.11692202091217041, -0.018153557553887367, 0.0004335431440267712, 0.002223428338766098, -0.013634284026920795, -0.022872084751725197, -0.10194987058639526, 0.11156609654426575, -0.029974179342389107, -0.07231626659631729, -0.0020501497201621532, -0.04025956615805626, 0.02645271271467209, 0.06211774796247482, -0.024415267631411552, 0.0484861396253109, 0.0752025917172432, 0.1317022740840912, -0.031831175088882446, -0.08226972073316574, -0.07103677839040756, -0.0162337813526392, -0.06198056414723396, 0.026174597442150116, -0.00942721776664257, -0.08392873406410217, 0.006047988310456276, -0.006475699599832296, 0.02657879702746868, 0.00811093207448721, 0.005336696282029152, 0.050922997295856476, 0.11933921277523041, 0.008936643600463867, -0.07778995484113693, -0.00786263681948185, 0.037343449890613556, 0.07576707750558853, -0.01621665060520172, 0.09190495312213898, -5.548941217625725e-08, 0.04337833821773529, 0.025643322616815567, 0.00815428514033556, -0.015081116929650307, 0.01529307197779417, -0.013991143554449081, 0.06334405392408371, -3.42845669365488e-05, -0.08073011040687561, -0.039729658514261246, 0.06700243800878525, 0.025993892922997475, 0.031185483559966087, -0.06335154175758362, 0.020120924338698387, 0.08927102386951447, 0.014836018905043602, 0.004681584425270557, 0.011525042355060577, -0.04674185812473297, -0.05975651368498802, -0.002195127308368683, 0.020603109151124954, -0.03756830096244812, -0.08718328922986984, -0.042946040630340576, -0.0006813372019678354, 0.008570893667638302, -0.016523120924830437, 0.01980043388903141, 0.012979182414710522, -0.024598561227321625, 0.04410140961408615, 0.07703469693660736, 0.025059206411242485, 0.0949224978685379, 0.044882457703351974, 0.05432456359267235, -0.02182166837155819, -0.001173170399852097, -0.059485986828804016, -0.008044724352657795, 0.005652925930917263, 0.012010827660560608, 0.02661985531449318, -0.007593824993818998, 0.038100048899650574, -0.09351065754890442, -0.003989262040704489, 0.03784864395856857, 0.0078049153089523315, 0.05344877392053604, -0.06977209448814392, 0.0034983172081410885, -0.012059705331921577, -0.037563346326351166, -0.07087720930576324, 0.013631857931613922, 0.007861236110329628, 0.008464692160487175, -0.02031886577606201, 0.04919718950986862, 0.02842312678694725, -0.07769693434238434 ] }, { "text": "## Loss Functions\n\n```python\n# Classification\nce_loss = nn.CrossEntropyLoss() # Multi-class\nbce_loss = nn.BCEWithLogitsLoss() # Binary\n\n# Regression\nmse_loss = nn.MSELoss() # Mean Squared Error\nmae_loss = nn.L1Loss() # Mean Absolute Error\nhuber_loss = nn.SmoothL1Loss() # Robust to outliers\n\n# Sequence models\nctc_loss = nn.CTCLoss() # Speech recognition\n\n# Example usage\npredictions = torch.randn(32, 10) # 32 samples, 10 classes\ntargets = torch.randint(0, 10, (32,))\nloss = ce_loss(predictions, targets)\n```", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_50", "embedding": [ -0.0943680852651596, -0.11550947278738022, 0.010277838446199894, 0.03863661736249924, 0.050834301859140396, -0.023311804980039597, -0.0011115201050415635, 0.041840944439172745, -0.051907338201999664, -0.10547579079866409, -0.07628950476646423, -0.08052078634500504, -0.049978189170360565, -0.040700122714042664, -0.0676291286945343, -0.02196357026696205, -0.03897884860634804, 0.03704867139458656, -0.07477205246686935, -0.10515982657670975, 0.11100486665964127, 0.08687210083007812, 0.06731238961219788, 0.10802452266216278, 0.04248020797967911, -0.03215722367167473, -0.009079205803573132, 0.043308187276124954, 0.003369205864146352, -0.019257206469774246, 0.06725606322288513, 0.01742268167436123, -0.01923735998570919, 0.03460881486535072, 0.008408459834754467, -0.014042869210243225, -0.07210110127925873, -0.04559475928544998, -0.002062990330159664, 0.03507230803370476, -0.04106704145669937, 0.013529865071177483, 0.04163333773612976, -0.009136686101555824, -0.012393218465149403, -0.001445183763280511, -0.008850089274346828, -0.03980075195431709, 0.00501134991645813, -0.02681470662355423, 0.0018288944847881794, -0.037092745304107666, -0.025529200211167336, 0.04394897446036339, -0.06101980805397034, -0.004367572721093893, 0.01340449322015047, -0.062300074845552444, 0.00423181988298893, -0.09180496633052826, 0.05920099839568138, -0.04875029996037483, 0.010029279626905918, -0.0369311161339283, -0.05421597883105278, -0.012687843292951584, -0.030925597995519638, 0.04371241107583046, 0.03378460183739662, 0.06385581940412521, -0.04838832840323448, 0.02870199643075466, -0.00022115885803941637, 0.11316461861133575, 0.030843423679471016, -0.004137106705456972, 0.12059037387371063, 0.009762270376086235, 0.020232366397976875, -0.05921238288283348, 0.0021512361709028482, -0.0233993511646986, 0.03381729498505592, -0.022887809202075005, 0.09798038005828857, -0.03414943069219589, 0.054513994604349136, 0.00598929775878787, 0.030604153871536255, -0.012939461506903172, -0.05267207697033882, -0.044351834803819656, -0.023280976340174675, 0.020547470077872276, 0.006842092145234346, 0.03450336679816246, 0.07611339539289474, -0.020968947559595108, -0.015652859583497047, 0.043627601116895676, -0.03897527605295181, -0.021043071523308754, -0.008063285611569881, 0.011559437029063702, 0.019606251269578934, 0.012543607503175735, 0.0636722519993782, 0.02277141623198986, 0.05332554876804352, -0.05087164789438248, 0.02382764220237732, 0.03178545460104942, -0.038420118391513824, -0.047394100576639175, 0.08303788304328918, 0.03824888914823532, -0.08369508385658264, 0.02678251452744007, -0.029145408421754837, 0.12215103209018707, -0.09030576795339584, 0.054142918437719345, -0.037618789821863174, 0.04854307696223259, -0.03076978214085102, -0.035047270357608795, -0.08263476938009262, 7.59465961573156e-33, 0.004564551170915365, 0.03212469816207886, -0.05981513112783432, -0.031294260174036026, 0.013789883814752102, 0.003833627328276634, -0.025253131985664368, -0.04913624748587608, -0.0578201487660408, 0.011059730313718319, -0.03081812709569931, -0.018354585394263268, -0.0410003699362278, 0.052587177604436874, -0.025031128898262978, 0.015428581275045872, 0.020046964287757874, 0.04198521375656128, 0.018352629616856575, -0.03013216145336628, 0.042021043598651886, 0.0392024964094162, -0.010790354572236538, -0.08514301478862762, -0.008623963221907616, 0.10690418630838394, -0.01854517124593258, -0.040251947939395905, 0.013034011237323284, 0.03657829388976097, -0.01700488105416298, 0.02444922737777233, 0.04918839409947395, -0.07205488532781601, 0.05956355109810829, 0.02645937353372574, 0.021524425595998764, 0.04027603566646576, 0.006253093481063843, -0.03376610204577446, -0.03453535959124565, 0.05913124606013298, 0.011605880223214626, -0.09179919958114624, -0.03691461682319641, -0.026077497750520706, -0.04604702442884445, 0.07766060531139374, 0.03444446995854378, 0.01841670647263527, -0.021431827917695045, -0.08060826361179352, -0.058454085141420364, 0.0889427438378334, 0.02570502460002899, -0.03507165238261223, 0.05637311562895775, 0.04154612496495247, 0.106547050178051, -0.053570639342069626, 0.067664235830307, 0.03168701380491257, 0.005638382863253355, -0.03727216273546219, 0.043526437133550644, -0.013275839388370514, -0.025420140475034714, 0.04092349112033844, -0.015111753717064857, 0.0073339324444532394, -0.052183207124471664, -0.03411036729812622, -0.04796682298183441, 0.01583954505622387, 0.04152005910873413, -0.026506122201681137, 0.005855262745171785, -0.06087931618094444, -0.04426126182079315, 0.022988585755228996, -0.06685742735862732, 0.056786954402923584, -0.012523374520242214, -0.14882925152778625, -0.06340530514717102, -0.028684357181191444, 0.029077284038066864, -0.0553581528365612, -0.07174833863973618, 0.010108561255037785, -0.09084935486316681, -0.01411588117480278, 0.04355403035879135, 0.046481575816869736, -0.11331558227539062, -9.713096596533115e-33, -0.061106372624635696, 0.1547057330608368, 0.01520226988941431, 0.0647350400686264, -0.07109387964010239, 0.0027962327003479004, -0.0019339796854183078, 0.037991926074028015, -0.03655458986759186, -0.030531790107488632, 0.027594273909926414, -0.07768499851226807, -0.015214159153401852, -0.007277090102434158, 0.08131091296672821, -0.0670509785413742, 0.014404268004000187, 0.04139827564358711, 0.030048714950680733, 0.024119673296809196, 0.03754027187824249, 0.10045420378446579, -0.1316206157207489, -0.009285425767302513, -0.1242142915725708, 0.005407033022493124, -0.037004608660936356, 0.07233458757400513, 0.004965024534612894, -0.11061540991067886, -0.041883815079927444, 0.06382668763399124, -0.09717428684234619, 0.04434645175933838, -0.03354271501302719, 0.06476663053035736, 0.025748804211616516, -0.06943674385547638, -0.034047506749629974, 0.0032496675848960876, 0.12027496099472046, 0.07334442436695099, -0.0707683116197586, 0.00474910531193018, -0.025788363069295883, -0.003464875742793083, -0.02645384706556797, 0.028174132108688354, 0.0921957939863205, 0.03243052959442139, 0.05860117822885513, -0.07636591792106628, -0.07306709885597229, 0.056657128036022186, -0.03481714054942131, 0.032651256769895554, 0.002321656560525298, -0.012236537411808968, -0.04404377192258835, 0.026812996715307236, -0.04301009327173233, -0.017545390874147415, -0.02426292933523655, -0.020992010831832886, 0.017741914838552475, 0.035450275987386703, -0.10382632166147232, 0.054769981652498245, 0.06639456748962402, 0.03733193129301071, 0.024234618991613388, 0.11280450224876404, 0.0021770258899778128, -0.04138283059000969, -0.06054723635315895, 0.006256175227463245, -0.09008591622114182, -0.016297655180096626, 0.003837285563349724, 0.018574390560388565, -0.05205881595611572, -0.004237127490341663, 0.09631525725126266, 0.027895208448171616, 0.01698700711131096, 0.08200085163116455, 0.05427245795726776, 0.05518925189971924, 0.016156818717718124, -0.08424180001020432, -0.00987735204398632, 0.006960275582969189, 0.11695607006549835, 0.04645707085728645, 0.03605399280786514, -5.807406466828979e-08, -0.03235020115971565, 0.03069133497774601, -0.023148609325289726, 0.02129875309765339, -0.010057946667075157, -0.03100557066500187, -0.029431242495775223, 0.02237931452691555, -0.006583872251212597, -0.006742292083799839, 0.03494447469711304, -0.061302293092012405, -0.0068992432206869125, 0.03143547475337982, 0.010486428625881672, 0.0613727904856205, -0.0555935762822628, 0.0854516327381134, 0.01692768558859825, -0.08473964035511017, 0.00015850494673941284, -0.0561947301030159, 0.06023084372282028, 0.014950915239751339, -0.03292560949921608, -0.06406327337026596, 0.06059882044792175, 0.11375676840543747, -0.04484272003173828, -0.0035637004766613245, -0.01855655387043953, -0.0050584240816533566, -0.003151975804939866, -0.0010804591001942754, -0.009042509831488132, 0.07145434617996216, -0.03659222647547722, 0.021439313888549805, 0.054332707077264786, 0.072858527302742, -0.0716492086648941, 0.011769847944378853, -0.0665532574057579, -0.006576240994036198, 0.045976899564266205, 0.0065429843962192535, 0.018636031076312065, -0.10418473184108734, -0.004712944384664297, -0.03361599147319794, 0.0162432212382555, 0.028932642191648483, -0.01901518553495407, 0.006934323348104954, 0.08887161314487457, -0.03838711231946945, -0.04857751727104187, 0.03906107321381569, -0.0629330426454544, -0.02876274660229683, -0.015922468155622482, -0.05080080032348633, -0.061489857733249664, -0.04658176749944687 ] }, { "text": "## Key Takeaways\n\n- Deep learning uses multiple layers to learn hierarchical representations\n- Backpropagation efficiently computes gradients using the chain rule\n- CNNs excel at spatial data (images) using convolutional filters\n- RNNs/LSTMs/GRUs process sequential data with memory\n- Attention mechanisms allow models to focus on relevant input parts\n- PyTorch provides a flexible framework for building and training models\n- Always use GPU acceleration when available for faster training", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_51", "embedding": [ -0.02555624395608902, -0.09637778252363205, 0.05994676798582077, -0.03665495663881302, 0.03888370096683502, 0.03742070868611336, -0.10902935266494751, -0.04337136074900627, 0.014014492742717266, -0.05860310420393944, -0.08028097450733185, -0.008634225465357304, -0.04598145931959152, 0.018244298174977303, -0.04209734499454498, -0.033925335854291916, 0.034320224076509476, 0.10330849885940552, -0.12957492470741272, -0.09642788022756577, 0.011039575561881065, -0.0328739657998085, -0.025605790317058563, -0.020971031859517097, 0.0373600572347641, 0.07209374010562897, 0.0018901011208072305, -0.03324020653963089, 0.06996453553438187, -0.0006439093267545104, 0.069758839905262, -0.04358691722154617, 0.018172141164541245, 0.07617174834012985, -0.13166087865829468, 0.04416327178478241, -0.0554407499730587, 0.006867100019007921, -0.010776412673294544, -0.025949984788894653, -0.027991602197289467, -0.016684522852301598, -0.02709450200200081, 0.03738327696919441, 0.11075542867183685, 0.01377236656844616, 0.03113911673426628, -0.05469709262251854, -0.0033208199311047792, 0.04472501948475838, -0.018990831449627876, 0.011757747270166874, -0.00866784993559122, 0.08006511628627777, 0.004532514605671167, 0.047126613557338715, -0.0013542630476877093, 0.032111670821905136, -0.019047267735004425, 0.009249941445887089, 0.019004052504897118, -0.0737365111708641, -0.004612499848008156, -0.03624436631798744, -0.018908731639385223, -0.04679735004901886, -0.013149101287126541, 0.011365162208676338, 0.10225913673639297, -0.11466912180185318, 0.08600031584501266, 0.08733775466680527, -0.039788875728845596, -0.0151411984115839, -0.001960109220817685, -0.013033387251198292, 0.0012231661239638925, -0.0022228830493986607, 0.08265271782875061, -0.10998836159706116, 0.09195663034915924, 0.06976829469203949, 0.015538979321718216, 0.028185436502099037, 0.11914274096488953, -0.01641567423939705, -0.0003224120882805437, 0.027761148288846016, -0.10231048613786697, -0.048881955444812775, 0.06618226319551468, -0.0798119604587555, -0.04144816845655441, -0.047942690551280975, 0.016788354143500328, 0.0010887299431487918, -0.062456533312797546, -0.09081874787807465, -0.054392799735069275, 0.00699192751199007, -0.017376385629177094, -0.019390081986784935, 0.0692206472158432, 0.04315973073244095, 0.0026778101455420256, 0.014498588629066944, 0.02290734089910984, 0.07022998481988907, -0.001579097704961896, -0.07736055552959442, -0.010128834284842014, 0.039886802434921265, -0.009592808783054352, 0.007132525090128183, 0.048313070088624954, -0.0389375314116478, 0.0019770916551351547, -0.050952062010765076, 0.006256977561861277, 0.053399644792079926, -0.1491447389125824, 0.00915718637406826, -0.05410344898700714, -0.002463817596435547, -0.027063986286520958, -0.029192810878157616, -0.05094791576266289, 1.0348505659766287e-32, -0.034945301711559296, 0.012277535162866116, -0.03604042902588844, 0.0010421727783977985, 0.028118275105953217, -0.039713189005851746, 0.0271904319524765, 0.01806606724858284, 0.022584207355976105, 0.07571321725845337, -0.04849077761173248, 0.021221408620476723, -0.06860224157571793, 0.17942212522029877, 0.006143808830529451, -0.010452141053974628, -0.045842066407203674, -0.012965896166861057, 0.03523525595664978, 0.01231248676776886, -0.020757116377353668, 0.044675447046756744, 0.034241728484630585, 0.038543131202459335, -0.012698682025074959, 0.028621802106499672, 0.022772572934627533, 0.03558729588985443, -0.014352901838719845, -0.004202178213745356, -0.03327483683824539, 0.01497744582593441, -0.09270086884498596, -0.0002480041584931314, -0.01061371248215437, 0.0075453720055520535, 0.029876790940761566, -0.050072379410266876, 0.06973893940448761, -0.045401886105537415, -0.008965132758021355, 0.01967605948448181, -0.017860976979136467, 0.000520810775924474, -0.07806922495365143, 0.016942499205470085, -0.007664824370294809, -0.00890329573303461, -0.004940983839333057, 0.0017687981016933918, 0.07222907245159149, 0.047557197511196136, -0.04617338255047798, -0.06396835297346115, 0.05870509892702103, -0.002071116119623184, 0.03397471457719803, 0.06722937524318695, 0.02547028660774231, 0.035144999623298645, 0.10288017243146896, -0.007309385575354099, -0.029328741133213043, 0.10953526198863983, 0.01340190414339304, 0.007658127695322037, 0.017474651336669922, 0.11021674424409866, -0.014031845144927502, 0.01721622422337532, -0.05552011355757713, 0.030309002846479416, 0.041758760809898376, -0.07502535730600357, 0.00975720677524805, 0.008025548420846462, -0.020433863624930382, -0.11115814000368118, 0.0023078080266714096, 0.11596252769231796, -0.05406765639781952, 0.07698427140712738, 0.003298666561022401, 0.004193796310573816, -0.04733595252037048, 0.024121280759572983, -0.0038133019115775824, -0.08041685074567795, 0.04024367034435272, 0.018103208392858505, -0.0720466747879982, -0.04840969294309616, 0.00806150957942009, 0.0475507415831089, 0.016257427632808685, -9.220326425932535e-33, 0.014078814536333084, 0.08710343390703201, -0.06775697320699692, 0.02329147234559059, 0.015452784486114979, -0.04979778826236725, -0.09425488114356995, -0.05495069921016693, -0.04785047471523285, -0.023425759747624397, -0.022728078067302704, 0.013615879230201244, 0.02646244317293167, -0.03125610575079918, 0.010372343473136425, -0.02846834808588028, -0.04765964299440384, -0.0542268268764019, -0.022683432325720787, -0.03800537437200546, -0.031166302040219307, 0.06704089790582657, -0.03187437355518341, -0.002961251884698868, -0.08667310327291489, -0.04323546215891838, -0.036657534539699554, 0.0006873754318803549, 0.07731270045042038, 0.024051887914538383, -0.040418803691864014, -0.022014442831277847, 0.048860710114240646, -0.0022455754224210978, -0.03159252554178238, 0.07386400550603867, 0.0354701392352581, -0.02377168834209442, -0.012984663248062134, -0.0698804259300232, 0.07321161031723022, 0.01949765533208847, 0.047001905739307404, -0.007845758460462093, -0.019344039261341095, 0.021443143486976624, -0.056925274431705475, 0.016671767458319664, -0.0031232049223035574, 0.025889040902256966, 0.048660825937986374, 0.03868541866540909, -0.06667225062847137, -0.027466952800750732, 0.0032577761448919773, -0.009288637898862362, 0.02033277601003647, -0.02365124225616455, 0.056584522128105164, 0.0056129442527890205, -0.10339464247226715, -0.09194690734148026, -0.05322350934147835, 0.006962647195905447, -0.08282140642404556, 0.03720463439822197, -0.060627374798059464, 0.022031115368008614, 0.04367546737194061, 0.04923879727721214, 0.03854566067457199, 0.018103841692209244, 0.04868828505277634, 0.1050327718257904, -0.0764225646853447, -0.04058433696627617, -0.02866869419813156, -0.04201483353972435, -0.012798662297427654, -0.03791121020913124, 0.059709612280130386, -0.05113384127616882, -0.07100331783294678, 0.05334373563528061, 0.07085968554019928, 0.11749737709760666, 0.0146574592217803, -0.01728031598031521, 0.025727981701493263, -0.032908808439970016, 0.015349307097494602, 0.004617284517735243, -0.028297021985054016, 0.025729550048708916, -0.05055475980043411, -4.594605940155816e-08, -0.023687172681093216, 0.016806259751319885, 0.11237448453903198, -0.057434793561697006, -0.014902198687195778, -0.07653824985027313, 0.059187065809965134, 0.19650143384933472, -0.002795703709125519, 0.05902550369501114, 0.052243221551179886, 0.017156101763248444, -0.05740763992071152, -0.07222114503383636, 0.08818021416664124, 0.12493883818387985, 0.07249243557453156, 0.02936135046184063, 0.03599812835454941, -0.037295062094926834, 0.027769403532147408, 0.02609284780919552, -0.0228535495698452, 0.05436671897768974, 0.05323249474167824, -0.04960726201534271, 0.014772344380617142, 0.05763232335448265, -0.020105930045247078, 0.02288147807121277, 0.03563016653060913, -0.0028851176612079144, -0.0006695156916975975, -0.025551220402121544, 0.03606170415878296, 0.1091274693608284, -0.007193704601377249, -0.04199976101517677, 0.019025443121790886, -0.048546962440013885, -0.026827258989214897, 0.044719431549310684, -0.030108163133263588, -0.030209986492991447, -0.06392712891101837, 0.013249030336737633, -0.06152656674385071, -0.08797517418861389, -0.018324190750718117, 0.06862440705299377, 0.009301932528614998, 0.013818642124533653, 0.02102009393274784, 0.06484568864107132, 0.020162900909781456, 0.018765941262245178, -0.00848596915602684, -0.09985480457544327, 0.04392252862453461, 0.04690122976899147, -0.016704756766557693, 0.050751131027936935, 0.00505485013127327, -0.01261222455650568 ] }, { "text": "## Resources for Learning\n\n### Online Courses\n- [Deep Learning Specialization (Coursera)](https://www.coursera.org/specializations/deep-learning)\n- [Fast.ai Practical Deep Learning](https://course.fast.ai/)\n- [Stanford CS231n: CNNs for Visual Recognition](http://cs231n.stanford.edu/)\n- [Stanford CS224n: NLP with Deep Learning](http://web.stanford.edu/class/cs224n/)\n\n### Books\n- \"Deep Learning\" by Goodfellow, Bengio, and Courville\n- \"Dive into Deep Learning\" (d2l.ai) - Free online book\n- \"Neural Networks and Deep Learning\" by Michael Nielsen\n\n### Documentation\n- [PyTorch Documentation](https://pytorch.org/docs/)\n- [PyTorch Tutorials](https://pytorch.org/tutorials/)", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_52", "embedding": [ -0.09393323957920074, -0.11896304041147232, 0.034637704491615295, 0.01696188934147358, 0.014951391145586967, -0.007797097787261009, -0.015199374407529831, 0.04026385769248009, -0.10898878425359726, -0.06152772158384323, -0.018491774797439575, 0.04938899725675583, -0.04064634442329407, 0.04748934134840965, -0.03322429582476616, 0.034484345465898514, 0.01956658996641636, 0.11934316903352737, -0.0784163773059845, -0.07472766935825348, 0.05998535454273224, 0.008158409968018532, 0.07296399027109146, -0.05046913027763367, 0.0051003098487854, -0.006248783320188522, 0.05641705542802811, -0.08709005266427994, 0.016239365562796593, -0.025077490136027336, -0.06731096655130386, -0.02543749287724495, -0.0028013125993311405, 0.04145494103431702, -0.03447495400905609, 0.015018575824797153, -0.00616459408774972, -0.005649975035339594, 0.04982271417975426, 0.03396860510110855, -0.02140030823647976, 0.0037120606284588575, -0.01411738432943821, -0.01857518032193184, 0.10115667432546616, 0.08777439594268799, -0.018271444365382195, -0.06531772762537003, 0.017807329073548317, 0.027738450095057487, -0.08889701217412949, -0.001662059803493321, -0.06607220321893692, 0.06732364743947983, -0.008429746143519878, 0.045004673302173615, 0.07023639231920242, 0.033450815826654434, -0.020094512030482292, -0.022425297647714615, 0.06283385306596756, -0.08922553062438965, 0.018859967589378357, -0.03525826334953308, -0.02918032743036747, 0.030034951865673065, 0.017800496891140938, 0.08072485774755478, 0.0790674015879631, -0.033904340118169785, -0.03335612639784813, 0.037773773074150085, -0.026398437097668648, 0.048138219863176346, 0.055452242493629456, -0.05838514119386673, 0.06408823281526566, -0.0029544213321059942, 0.031180040910840034, -0.07991677522659302, 0.009988455101847649, 0.031621888279914856, 0.036184147000312805, 0.00488239387050271, 0.0499236136674881, -0.03470570966601372, -0.04907737299799919, -0.00011610628280322999, 0.028523309156298637, -0.03143209591507912, 0.03672366589307785, -0.09598216414451599, 0.0061821346171200275, 0.005697367712855339, 0.0655544176697731, 0.01593758910894394, -0.0015541641041636467, -0.110634945333004, -0.0656672939658165, 0.014028840698301792, -0.049817368388175964, -0.04674951732158661, -0.021436624228954315, -0.028866760432720184, -0.040665436536073685, 0.07753811776638031, 0.05793948471546173, 0.028735212981700897, 0.06046401709318161, -0.060521215200424194, 0.05773103982210159, 0.02666558511555195, -0.013188972137868404, -0.04602271690964699, 0.04384251683950424, 0.0015164876822382212, 0.051393717527389526, 0.01381333451718092, 0.1330624222755432, 0.055490024387836456, -0.10816094279289246, -0.004311007913202047, -0.020802859216928482, 0.02931717410683632, 0.03144518658518791, -0.056161750108003616, -0.06724275648593903, 1.2553937120381361e-33, 0.04580618813633919, 0.03737233206629753, 0.010321484878659248, 0.013077441602945328, 0.09146405011415482, -0.08100944012403488, 0.08235712349414825, 0.0339009128510952, -0.07474389672279358, 0.02560283988714218, -0.040394559502601624, 0.005255787633359432, -0.06152358278632164, 0.11671629548072815, -0.05716128647327423, -0.11876166611909866, -0.02550392970442772, 0.014599953778088093, 0.1061488538980484, -0.009205463342368603, 0.003408990101888776, 0.03609594330191612, -0.016947193071246147, 0.047418851405382156, 0.006094351410865784, 0.0003041980671696365, 0.021718695759773254, -0.040182311087846756, 0.06799288094043732, -0.002283059526234865, -0.08788160234689713, 0.020305408164858818, 0.008481255732476711, 0.005540940910577774, 0.05447353050112724, 0.016613749787211418, -0.07433991134166718, 0.013552672229707241, 0.010819117538630962, -0.02925010770559311, -0.03974207863211632, 0.05054349824786186, -0.007266799919307232, -0.07527622580528259, -0.06263657659292221, -0.06685977429151535, -0.02368828095495701, 0.05294166877865791, 0.09730876237154007, -0.13182801008224487, -0.08512535691261292, 0.004274411126971245, -0.06846575438976288, -0.06231416389346123, 0.0005348234553821385, -0.03135254234075546, -0.00034629247966222465, 0.0819711983203888, -0.0017911678878590465, 0.019295623525977135, 0.07416363060474396, 0.058760594576597214, -0.015301097184419632, 0.023240022361278534, -0.06228731572628021, -0.014105363748967648, -0.03161146119236946, 0.024983901530504227, -0.014850868843495846, -0.017416123300790787, -0.0468246266245842, 0.07638546079397202, 0.036827754229307175, -0.09532210975885391, -0.012593749910593033, 0.08615032583475113, 0.040051817893981934, -0.08403006196022034, -0.02803085185587406, 0.036810893565416336, -0.031641725450754166, 0.03964955732226372, 0.015187208540737629, -0.04441673308610916, -0.0922476202249527, 0.00761202210560441, -0.002631505485624075, -0.06367605179548264, 0.05864943936467171, 0.028742006048560143, 0.025037158280611038, -0.007968802005052567, -0.03385163098573685, -0.005198359955102205, 0.005681955721229315, -1.094587737884578e-33, 0.010899174027144909, 0.06218314170837402, -0.05458823963999748, 0.04410324990749359, 0.04094378650188446, 0.021539397537708282, -0.07000003010034561, 0.01902606338262558, -0.030767209827899933, -0.051751721650362015, -0.0014198696007952094, 0.019387992098927498, -0.01683981530368328, 0.054960306733846664, -0.021433742716908455, -0.04185474291443825, -0.08065874874591827, -0.017973309382796288, -0.014719493687152863, 0.01193561777472496, 0.04501081258058548, 0.08089866489171982, -0.10781082510948181, -0.002633835654705763, -0.01857157051563263, -0.008291826583445072, -0.04125317558646202, 0.05336497724056244, -0.037569377571344376, 0.02477126009762287, 0.009547765366733074, -0.027035897597670555, -0.06420940160751343, 0.03809850662946701, -0.03295394033193588, 0.06317008286714554, 0.02034858986735344, -0.022134123370051384, -0.005087277386337519, 0.043601516634225845, 0.12375292181968689, -0.028641168028116226, 0.039229560643434525, -0.07962124794721603, -0.010837346315383911, -0.027940601110458374, -0.04704831540584564, 0.034301456063985825, 0.007496724370867014, 0.03547138720750809, 0.050254739820957184, -0.02756834588944912, -0.025511203333735466, -0.027265500277280807, -0.01776026375591755, 0.007754349149763584, 0.07782549411058426, 0.0014476736541837454, 0.03316452354192734, 0.05681457370519638, -0.10663522779941559, -0.028187287971377373, -0.07142745703458786, 0.0542292594909668, -0.10145346820354462, -0.04999389126896858, -0.04109577462077141, 0.06418092548847198, 0.03785645216703415, -0.008874592371284962, -0.024675780907273293, -0.0025082258507609367, 0.031586483120918274, 0.030271252617239952, -0.0734715685248375, -0.0037018090952187777, -0.009831841103732586, 0.0774262472987175, -0.015783805400133133, 0.0024570010136812925, 0.08814433217048645, -0.006811199244111776, -0.061427630484104156, 0.11432312428951263, 0.07012486457824707, 0.1413244903087616, 0.03699927777051926, 0.025988135486841202, 0.0031175457406789064, -0.0064552342519164085, -0.05331539735198021, -0.011652539484202862, -0.02704852633178234, 0.04768428951501846, -0.02127133682370186, -3.9913921057177504e-08, -0.041706085205078125, 0.0236817616969347, 0.00876258872449398, -0.030217422172427177, 0.06333043426275253, 0.00033741098013706505, 0.029839206486940384, 0.08014277368783951, -0.07750185579061508, 0.06692792475223541, 0.0009123149793595076, -0.05513300374150276, 0.024860765784978867, -0.05431048199534416, 0.009362615644931793, 0.0810355395078659, 0.0029266795609146357, -0.05156543105840683, 0.052205972373485565, -0.014250606298446655, 0.07885707169771194, -0.01500010397285223, -0.006686746142804623, 0.013221059925854206, 0.018439698964357376, -0.02048657462000847, 0.012035307474434376, 0.05162107199430466, -0.018131619319319725, -0.043715424835681915, -0.040847789496183395, 0.046505168080329895, 0.09416045248508453, -0.12539032101631165, 0.12917178869247437, 0.06295683234930038, 0.01931414008140564, -0.07056322693824768, -0.0027557641733437777, -0.006868679542094469, -0.041416630148887634, 0.06208580359816551, 0.011874422430992126, -0.007737291976809502, 0.06279521435499191, 0.015600618906319141, 0.0073572495020926, -0.05421598628163338, -0.015013961121439934, 0.03527721390128136, -0.027290958911180496, -0.012703882530331612, 0.020247794687747955, 0.06390001624822617, 0.020761851221323013, 0.07038145512342453, -0.02560398355126381, -0.056522779166698456, 0.06304249167442322, 0.08151320368051529, -0.023944217711687088, 0.10481896996498108, -0.09397821873426437, 0.019295113161206245 ] }, { "text": "## Related Topics\n\n- [Machine Learning Fundamentals](ml.html) - ML basics before diving into DL\n- [Python Basics](python.html) - Programming foundation\n- [Transformers](transformers.html) - Modern attention-based architectures\n\n## Tools and Libraries\n\n- **PyTorch**: Flexible deep learning framework\n- **TensorFlow/Keras**: Alternative framework by Google\n- **Hugging Face**: Pre-trained models and datasets\n- **Weights & Biases**: Experiment tracking\n- **TensorBoard**: Visualization toolkit\n\n---\n\n**Last Updated:** November 24, 2025 \n**Difficulty Level:** Intermediate", "source": "dl.md", "type": "markdown", "chunk_id": "dl.md_53", "embedding": [ -0.09508013725280762, -0.08839414268732071, 0.004913522396236658, -0.034370530396699905, 0.03974948078393936, -0.019270002841949463, -0.02343888208270073, -0.006214302033185959, -0.14591094851493835, -0.06058216467499733, -0.02171403542160988, 0.007989786565303802, -0.0322696790099144, -0.0028076875023543835, -0.034680500626564026, 0.05976274609565735, 0.025194570422172546, 0.07440707832574844, -0.09296824038028717, -0.07920987159013748, 0.022440973669290543, 0.01577136293053627, 0.0033879054244607687, -0.0018993113189935684, 0.012678706087172031, 0.016090475022792816, 0.003642823314294219, -0.05052407085895538, 0.020099233835935593, -0.04058580845594406, 0.014600163325667381, -0.055179473012685776, 0.013828561641275883, 0.04550628736615181, -0.058951184153556824, 0.03376729041337967, 0.0022110878489911556, -0.054459307342767715, -0.04046257585287094, -0.017148615792393684, -0.059781767427921295, -0.055812787264585495, 0.002792266197502613, -0.023496082052588463, 0.0756983757019043, 0.06329544633626938, -0.029159357771277428, -0.08062803745269775, 0.006198837421834469, -0.06630492955446243, -0.057506680488586426, -0.1373714804649353, -0.03033706545829773, 0.04929890111088753, -0.07200612872838974, 0.005899742711335421, 0.03467513993382454, -0.044655706733465195, 0.0439583882689476, -0.07597488909959793, -0.029594242572784424, -0.021417686715722084, -0.032127488404512405, 0.0031437932047992945, -0.04552580788731575, -0.023545661941170692, 0.043272826820611954, -0.007619478274136782, 0.07605835795402527, -0.06616993993520737, -0.06471013277769089, 0.01806481182575226, -0.026741817593574524, 0.03560369089245796, 0.04517872631549835, -0.057719700038433075, 0.05911288037896156, -0.03553039953112602, 0.036092452704906464, -0.029146119952201843, -0.006443431135267019, 0.017235400155186653, 0.002139239339157939, 0.07871741056442261, 0.04093547165393829, -0.07217248529195786, -0.0747763141989708, 0.0706527978181839, -0.026693986728787422, -0.04457958787679672, 0.05638927221298218, -0.059365976601839066, 0.010965554043650627, 0.023130621761083603, 0.0010708546033129096, 0.09520167857408524, -0.010968306101858616, -0.11601707339286804, -0.07621889561414719, 0.04565884545445442, -0.06524085253477097, -0.04415569826960564, 0.041967395693063736, 0.03434538096189499, -0.01985541544854641, -0.023152906447649002, 0.026133611798286438, 0.06267976015806198, 0.059635382145643234, -0.06381462514400482, 0.03520022705197334, -0.0286356620490551, -0.02873201109468937, -0.09914832562208176, 0.09382744133472443, -0.029038432985544205, -0.005623258650302887, 0.009117711335420609, 0.023381303995847702, 0.050948623567819595, -0.04405438154935837, 0.060894694179296494, -0.04674563556909561, 0.026845192536711693, 0.014248319901525974, -0.0051999581046402454, -0.07397682964801788, -2.7778285165144023e-33, 0.03823282942175865, -0.009215575642883778, 0.018380453810095787, 0.06844297051429749, 0.06542479246854782, -0.08558719605207443, 0.05225011333823204, -0.01841217838227749, -0.019330235198140144, 0.06643886864185333, -0.025657735764980316, 0.09536315500736237, -0.07636401802301407, 0.09644097089767456, -0.025103207677602768, -0.11392218619585037, 0.04177282750606537, 0.012122142128646374, 0.026543356478214264, 0.04226706549525261, 0.011380031704902649, 0.042243048548698425, 0.03561633825302124, 0.03327181562781334, -0.003450184827670455, 0.04859326034784317, 0.013472471386194229, -0.034589286893606186, 0.013775382190942764, 0.020083647221326828, -0.11551471054553986, 0.050229739397764206, -0.08059711754322052, -0.010447387583553791, -0.021493006497621536, -0.01112788263708353, -0.01923345774412155, -0.09310303628444672, 0.0016450160183012486, -0.061337850987911224, -0.08300485461950302, 0.05987248197197914, -0.017250366508960724, -0.08556119352579117, -0.02542957477271557, 0.016553767025470734, 0.024462051689624786, 0.025750281289219856, 0.10461261868476868, -0.030759919434785843, -0.04624456912279129, -0.028315739706158638, -0.0441589318215847, -0.012943738140165806, 0.0006925901980139315, 0.05756320804357529, 0.046313896775245667, 0.07219021022319794, 0.03674742579460144, 0.007806740701198578, 0.08225245028734207, 0.044712379574775696, 0.00475586811080575, -0.00989544577896595, -0.00013278979167807847, -0.016481226310133934, -0.026589004322886467, 0.07023566216230392, 0.027788173407316208, 0.03277324140071869, -0.10573036968708038, 0.06534476578235626, 0.028009379282593727, -0.041777580976486206, 0.019836504012346268, 0.03127296641469002, 0.07642395794391632, -0.05757162347435951, 0.011331936344504356, 0.021275507286190987, -0.058015454560518265, 0.053337860852479935, 0.01972058229148388, -0.07886500656604767, -0.03016906976699829, 0.015479843132197857, -0.0025305531453341246, -0.03733145445585251, -0.04936791583895683, -0.043086495250463486, -0.06954029202461243, 0.010087992995977402, -0.0057823737151920795, 0.045603178441524506, -0.05487024039030075, 4.2657592557161726e-34, 0.01427521649748087, 0.0927283763885498, -0.08991033583879471, 0.03939151391386986, 0.025153061375021935, 0.009705599397420883, -0.019785620272159576, 0.055580299347639084, 0.02390965260565281, 0.022866884246468544, -0.011985787190496922, -0.044057391583919525, 0.05325070396065712, -0.014803659170866013, 0.04197504743933678, 0.005217941012233496, -0.05449239909648895, -0.08664192259311676, -0.03290465101599693, 0.013050590641796589, -0.09592512249946594, 0.11900223791599274, -0.11966513842344284, -0.037299029529094696, -0.0575515478849411, -0.009983944706618786, -0.061227187514305115, 0.0009734892519190907, 0.044539716094732285, -0.005946803838014603, -0.02729613147675991, -0.0033488241024315357, 0.028627319261431694, 0.024427568539977074, 0.014809766784310341, 0.04742467403411865, 0.0642901062965393, -0.04626366123557091, 0.03861252963542938, 0.005761296488344669, 0.12563514709472656, 0.026276517659425735, 0.020919717848300934, -0.0037855496630072594, 0.0019311605719849467, 0.02007146179676056, -0.08436717838048935, 0.017304884269833565, -0.017211711034178734, -0.05493393912911415, -0.0054827905260026455, -0.00017987236788030714, -0.058926407247781754, -0.08255897462368011, -0.031353261321783066, 0.0019139639334753156, 0.06315095722675323, -0.0016143324319273233, 0.08413763344287872, 0.0011981416027992964, -0.12143266201019287, -0.05520012602210045, -0.023161407560110092, -0.00721102487295866, -0.10240576416254044, 0.026047149673104286, -0.08640091121196747, -5.8045436162501574e-05, 0.015452937223017216, 0.01924956403672695, -0.006637975573539734, 0.04194264113903046, 0.06700005382299423, -0.017828013747930527, -0.07608986645936966, -0.037396520376205444, -0.006849450524896383, 4.194118082523346e-05, -3.8744346966268495e-05, -0.009108800441026688, 0.03794337809085846, -0.019131489098072052, 0.020401451736688614, 0.060055237263441086, 0.058989349752664566, 0.10531419515609741, 0.06005943939089775, 0.0010884410003200173, 0.04343758895993233, -0.03825713321566582, -0.052731167525053024, 0.051607679575681686, 0.015774453058838844, 0.12870995700359344, -0.009093035012483597, -4.7073697828636796e-08, -0.04642727971076965, 0.04703543707728386, 0.007330451626330614, 0.014242023229598999, 0.02567211166024208, 0.04090449959039688, 0.08189048618078232, 0.08266936987638474, -0.06774278730154037, 0.09304302930831909, 0.04194289445877075, -0.01741168648004532, -0.005943984724581242, 0.02522438019514084, -0.00411443505436182, 0.1500038504600525, -0.04507461190223694, 0.031909748911857605, 0.0375535748898983, -0.02804112620651722, 0.06193016096949577, -0.0015348392771556973, 0.0006897284765727818, -0.03826967999339104, 0.004577953834086657, -0.06880013644695282, 0.0028063019271939993, 0.06204370781779289, -0.05559351667761803, -0.005494810175150633, -0.042891327291727066, 0.006763435434550047, 0.012218187563121319, -0.03083023801445961, 0.048621587455272675, 0.10760928690433502, 0.010366812348365784, -0.059190601110458374, -0.017767570912837982, 0.06977012008428574, -0.01745831035077572, 0.07157661020755768, -0.05742599070072174, 0.00040645754779689014, 0.041439104825258255, 0.037603989243507385, -0.012960000894963741, -0.10215309262275696, -0.04055896773934364, 0.023582661524415016, 0.07870157808065414, 0.01926695555448532, -0.01209070160984993, 0.0936950221657753, 0.07810570299625397, 0.09526312351226807, 0.01979917846620083, -0.056597232818603516, 0.016819946467876434, 0.048173803836107254, 0.05348799750208855, 0.0928616151213646, 0.00425356812775135, 0.009262732230126858 ] }, { "text": "---\ntitle: \"How to Deploy Model to Arduino?\"\nid: \"arduinodeploy\"\ncategory: \"edge-ml\"\ntags: [\"edge machine learning\", \"\"]\nrelated: [\"arduino-edgeimpulse\"]\ndate: \"2021-11-28\"\ndescription: \"Deployment of edge impulse to Arduino\"\n---\n\n\nIn this post, I will explain the deployment of edge impulse to Arduino. \n\n\"You can deploy your impulse to any device. This makes the model run without an internet connection, \nminimizes latency, and runs with minimal power consumption.\"\n\nPlease check this website: [https://docs.edgeimpulse.com/docs/running-your-impulse-arduino](https://docs.edgeimpulse.com/docs/running-your-impulse-arduino)", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_0", "embedding": [ -0.019580576568841934, -0.07568857073783875, -0.034286387264728546, 0.009515613317489624, -0.03424753248691559, -0.06471995264291763, -0.0738184005022049, 0.004561098292469978, -0.13210459053516388, 0.002421471057459712, 0.08526990562677383, -0.04416610673069954, -0.020469985902309418, -0.025760887190699577, -0.01968599483370781, 0.06250353157520294, 0.12573768198490143, -0.052958328276872635, 3.166651731589809e-05, 0.0424463115632534, 0.06537377834320068, -0.037298474460840225, -0.03472130000591278, -0.043692898005247116, 0.014647905714809895, 0.02154485695064068, -0.01576513983309269, 0.06227991357445717, 0.004443103913217783, -0.040313877165317535, 0.08396090567111969, -0.03856167569756508, 0.052750952541828156, 0.059217669069767, 0.088527150452137, 0.02517339400947094, 0.000890775874722749, 0.03859003260731697, 0.058024704456329346, -0.03114752657711506, 0.04822675138711929, -0.057505086064338684, -0.06108025833964348, -0.046944521367549896, 0.04457416385412216, -0.011638540774583817, 0.038914382457733154, -0.035730548202991486, 0.014322545379400253, -0.04804905503988266, 0.0013972538290545344, -0.054851189255714417, -0.06716768443584442, -0.01811366155743599, -0.06054268404841423, -0.03331005200743675, 0.011070989072322845, 0.036571260541677475, 0.052238479256629944, 0.008418958634138107, -0.025190427899360657, 0.0021381699480116367, -0.031748298555612564, 0.0010727564804255962, -0.08662369102239609, 0.036271169781684875, 0.041423577815294266, 0.05121157318353653, -0.03357653692364693, -0.01893456280231476, 0.09778956323862076, 0.02417931519448757, -0.04955931380391121, -0.011345609091222286, 0.009686136618256569, -0.052866701036691666, 0.10020140558481216, -0.01192568801343441, -0.03579879552125931, 0.016668569296598434, -0.023367865011096, -0.09269007295370102, -0.05543551594018936, 0.002591094234958291, 0.004375053104013205, 0.060641806572675705, -0.03509755805134773, 0.0306685958057642, -0.03442313149571419, -0.05890331417322159, 0.020166723057627678, 0.004817189648747444, -0.053260352462530136, -0.02865539863705635, 0.05672353133559227, 0.05048224329948425, -0.040341369807720184, -0.0834924578666687, -0.10104437917470932, -0.012410235591232777, -0.0597301721572876, -0.09959499537944794, -0.04484676569700241, -0.015978893265128136, -0.011633475311100483, -0.0185648612678051, -0.020599624142050743, 0.014292494393885136, 0.06421654671430588, -0.005566018167883158, 0.02310977503657341, 0.0297921784222126, -0.06373631954193115, -0.010344522073864937, -0.022618627175688744, -0.022342031821608543, -0.08164876699447632, -0.02008313313126564, 0.07767291367053986, -0.04536305367946625, -0.07048845291137695, 0.033103808760643005, -0.004369464237242937, -0.015231098048388958, 0.03385993465781212, -0.053263381123542786, -0.054856445640325546, 2.1743662673297107e-33, 0.04034920409321785, -0.004143867641687393, -0.07089737057685852, -0.03567720204591751, 0.04899710789322853, -0.018659671768546104, 0.02781892567873001, -0.02104642614722252, 0.009778080508112907, -0.02072358876466751, -0.06408202648162842, -0.11401500552892685, 0.009109710343182087, 0.06193523854017258, -0.0009041751618497074, -0.062200676649808884, 0.032288096845149994, -0.054278984665870667, 0.0723385438323021, 0.0023037646897137165, 0.07102063298225403, -0.06089029088616371, -0.09990920126438141, 0.04903647303581238, -0.0559500977396965, 0.11822449415922165, 0.04509202763438225, 0.033042434602975845, 0.11599147319793701, 0.06233881041407585, -0.08178821951150894, 0.041138000786304474, -0.004066698253154755, -0.016268357634544373, 0.0051068514585494995, 0.07031255960464478, -0.06536280363798141, 0.001084855291992426, 0.007910205982625484, -0.01032885629683733, 0.06490591913461685, 0.03564165160059929, -0.05560021102428436, -0.07762865722179413, -0.03500060364603996, -0.0775413066148758, 0.05704772099852562, -0.05878172814846039, 0.008684249594807625, 0.026182077825069427, -0.019085794687271118, -0.06354892998933792, 0.09879098832607269, 0.023174675181508064, 0.007348500192165375, -0.003759552724659443, -0.04148685559630394, 0.034565869718790054, 0.10784313082695007, -0.006677804980427027, 0.042805563658475876, -0.10814863443374634, -0.041185177862644196, 0.04375928267836571, 0.046457573771476746, 0.01045596320182085, -0.020177537575364113, 0.012473284266889095, 0.04125792905688286, 0.00522986613214016, -0.02637649141252041, -0.020853426307439804, 0.005096111446619034, -0.04046759009361267, 0.03579181432723999, -0.023296959698200226, -0.029519731178879738, 0.06677242368459702, -0.01802181266248226, -0.004250872414559126, -0.05491204187273979, 0.04702961817383766, 0.009500040672719479, -0.04889611899852753, 0.10988650470972061, 0.04754539579153061, -0.004693103954195976, -0.049972303211688995, -0.06952174007892609, 0.04570676013827324, -0.0017338532488793135, -0.0018561993492767215, -0.094785675406456, 0.06615462899208069, -0.01579890213906765, -3.347746565030441e-33, 0.025106171146035194, 0.036386799067258835, 0.00696270726621151, 0.09418703615665436, -0.015209360048174858, 0.017203545197844505, 0.056940313428640366, 0.02254970744252205, -0.0708412453532219, -0.008692029863595963, -0.07686911523342133, -0.0008007089491002262, 0.01865016669034958, -0.01622130535542965, -0.031063199043273926, -0.008545450866222382, 0.020051460713148117, -0.06864000111818314, 0.00620120158419013, 0.0006555994623340666, -0.07444935292005539, 0.032053135335445404, 0.02680053934454918, -0.0331466905772686, 0.013095220550894737, -0.04494122415781021, -0.0795227512717247, 0.0883481577038765, 0.049296002835035324, -0.023638391867280006, 0.006901423912495375, 0.03629413992166519, -0.04058733955025673, -0.07516217231750488, -0.021244298666715622, 0.11656304448843002, 0.008836713619530201, 0.01650233007967472, 0.024062227457761765, -0.02262921631336212, 0.01442630309611559, -0.03278046473860741, -0.04940313845872879, -0.011941157281398773, 0.04307538643479347, 0.07777222990989685, -0.04032866284251213, -0.032801553606987, -0.07125330716371536, -0.04101568087935448, -0.006689754314720631, 0.07592646777629852, -0.023660460487008095, 0.05132778361439705, 0.024717584252357483, -0.046120330691337585, 0.08221521228551865, 0.04483462870121002, -0.08303014189004898, -0.026958489790558815, -0.004166985861957073, -0.07881893962621689, 0.004776413086801767, -0.03843960165977478, 0.017896151170134544, 0.0903371050953865, -0.003539422294124961, 0.0015636327443644404, -0.06800022721290588, 0.025753015652298927, -0.042533908039331436, 0.06895975023508072, 0.033102139830589294, 0.02403378300368786, -0.05736217275261879, -0.04299583658576012, -0.029971692711114883, 0.023509088903665543, 0.02513114921748638, 0.00035394536098465323, -0.04303384944796562, 0.0553516149520874, -0.10610204190015793, 0.005636853631585836, -0.07882041484117508, -0.06994497030973434, 0.07045348733663559, 0.006673942785710096, -0.03467933461070061, -0.0542345866560936, -0.088108591735363, -0.02883528545498848, -0.014573149383068085, 0.1049724668264389, -0.04908992350101471, -5.0657749994797996e-08, -0.05785974860191345, 0.12512581050395966, 0.04060738533735275, 0.007859647274017334, -0.0052065434865653515, 0.06779322773218155, 0.050123900175094604, -0.00020234262046869844, 0.10621146857738495, -0.015325766056776047, -0.013836154714226723, -0.05102577060461044, -0.00843723677098751, 0.11666405200958252, 0.013170451857149601, 0.055482491850852966, 0.04621895030140877, -0.0011850004084408283, 0.05476514622569084, -0.023212824016809464, 0.04295499622821808, -0.02522195316851139, 0.018026214092969894, 0.029372060671448708, 0.09161687642335892, -0.004203310701996088, -0.015308375470340252, -0.05458887293934822, -0.007444056682288647, 0.010072758421301842, -0.09144248813390732, 0.022692518308758736, 0.10164143890142441, 0.012881241738796234, -0.016563495621085167, 0.019988270476460457, -0.059074606746435165, 0.05395292118191719, 0.060681842267513275, 0.05997385457158089, 0.07324481010437012, 0.08772950619459152, -0.04285437986254692, -0.04257826507091522, -0.04287842661142349, -0.03392906114459038, -0.004158609081059694, -0.0579502210021019, -0.0071190050803124905, 0.09604672342538834, 0.0972503125667572, 0.006126475054770708, 0.006417154800146818, -0.01899111643433571, 0.07632066309452057, 0.027227142825722694, 0.048606373369693756, -0.09344694018363953, 0.06835106760263443, 0.09720170497894287, 0.10614056140184402, -0.03498101606965065, -0.0316481813788414, 0.08592066913843155 ] }, { "text": "- Go to your project from Edge Impulse, click Deployment.\n- Select Arduino from Deploy your impulse part. \n- Select Arduino Nano 33 BLE Sense from Build Firmware.\n- Select Quantized Version and click analyze. \n- Build your model.\n\nIt gives me arduino_motion-nano-33-ble-sense-v1.zip which includes flash.bat file. \nReboot arduino and run flash.bat.\nLunch command prompt run $edge-impulse-run --> This starts live classification.\n\nBut, this is not what I want. I would like to **download impulse library.**\n\n I click build again without selecting Arduino Nano 33 BLE Sense from Build Firmware, \n it gives me ei-arduino-motion.zip this time.", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_1", "embedding": [ -0.006285388022661209, -0.06962209939956665, -0.061832159757614136, -0.02899155393242836, 0.11428571492433548, -0.07176431268453598, -0.02167540043592453, 0.005598094314336777, -0.10050617903470993, 0.009347748942673206, 0.06634004414081573, -0.06750434637069702, -0.07711086422204971, -0.021643856540322304, 0.02510804496705532, 0.02053726837038994, 0.0008814953616820276, -0.005867985542863607, 0.054315123707056046, 0.05091579630970955, 0.04100966826081276, -0.024359099566936493, 0.06139061972498894, -0.011420988477766514, -0.03621380776166916, 0.01791895367205143, 0.016289835795760155, 0.029375506564974785, -0.01180743332952261, -0.09907135367393494, 0.08269643038511276, 0.042123258113861084, 0.10482210665941238, -0.03999270871281624, 0.17356522381305695, 0.004135897383093834, -0.010555652901530266, -0.013949714601039886, 0.03102147951722145, -0.039200764149427414, -0.019865505397319794, 0.01093393936753273, -0.002094530500471592, -0.0011358321644365788, 0.02429240569472313, -0.02102651074528694, 0.005327831022441387, -0.01239001750946045, 0.03584699705243111, 0.016902122646570206, -0.07058454304933548, -0.0235811285674572, -0.009700237773358822, -0.019124478101730347, 0.021414542570710182, 0.04482988640666008, -0.03294741362333298, 0.06471994519233704, 0.0715993270277977, 0.005318771582096815, 0.009288567118346691, -0.04766688495874405, -0.01682242564857006, -0.025919977575540543, -0.02321101538836956, 0.09145485609769821, 0.04795153811573982, -0.03228699788451195, 0.06341680139303207, -0.02944776602089405, 0.04849522188305855, -0.022902878001332283, -0.037009064108133316, -0.051765456795692444, -0.030224496498703957, 0.0025440328754484653, 0.07228255271911621, 0.08527379482984543, -0.06660059839487076, 0.00878800731152296, -0.0688190683722496, -0.15226927399635315, -0.039217911660671234, 0.02745250053703785, 0.06808895617723465, 0.07651833444833755, 0.028453504666686058, 0.01921416074037552, -0.002445580204948783, 0.0405610166490078, -0.020600633695721626, -0.012360644526779652, -0.0732814222574234, -0.010049151256680489, 0.003259589895606041, 0.05311479791998863, 0.005634785629808903, -0.00019226333824917674, -0.03093203902244568, 0.027530193328857422, -0.10826171189546585, -0.10161051154136658, -0.025143682956695557, 0.06601441651582718, -0.05054094269871712, -0.05964258685708046, 0.0059608533047139645, 0.004773853812366724, 0.10852362960577011, 0.05839681625366211, 0.005424210336059332, -0.020439110696315765, -0.027606159448623657, -0.08337832242250443, -0.021208638325333595, -0.0234848465770483, -0.06502971053123474, 0.04441487044095993, 0.07394347339868546, -0.03766721487045288, 0.06762249767780304, 0.05310038849711418, 0.003094983985647559, -0.027799207717180252, 0.01818930357694626, -0.052040327340364456, -0.04631822183728218, 1.3634356937096165e-33, 0.03363126888871193, 0.006040299776941538, -0.054113127291202545, 0.005458935163915157, 0.0012805910082533956, -0.09485983103513718, 0.06730180978775024, 0.05783067271113396, -0.014116729609668255, -0.03562963008880615, -0.04238182678818703, -0.0047644865699112415, -0.0148923983797431, 0.04658781364560127, -0.03595004603266716, -0.10502483695745468, -0.03687748312950134, -0.059603963047266006, -0.00956796295940876, 0.007342542987316847, 0.04213039577007294, -0.029020780697464943, -0.0756242573261261, 0.028868015855550766, -0.02705945074558258, 0.06774498522281647, 0.08022641390562057, 0.06515299528837204, 0.06296317279338837, 0.06469390541315079, -0.0485556535422802, -0.012392195872962475, -0.004309479147195816, -0.08505537360906601, 0.026976892724633217, -0.009427845478057861, -0.08555464446544647, 0.041008271276950836, -0.03986644744873047, -0.03594846650958061, 0.02330171875655651, 0.03492782637476921, -0.05154593661427498, -0.059583503752946854, -0.0280853770673275, -0.07924523204565048, 0.01350310817360878, -0.04055836424231529, 0.06220066919922829, 0.03946969658136368, -0.014739017002284527, -0.06855171173810959, 0.09887301921844482, -0.04694757238030434, -0.02064894326031208, -0.019165387377142906, -0.03164617344737053, 0.04163045063614845, 0.07657798379659653, -0.006691401824355125, 0.06480924040079117, -0.012142118066549301, 0.0084493737667799, 0.01859945058822632, 0.046661846339702606, 0.02330242097377777, -0.09067966789007187, -0.021476689726114273, 0.05623386427760124, 0.03936728835105896, -0.034281544387340546, -0.033901043236255646, 0.047945477068424225, -0.05921152979135513, 0.02117670327425003, 0.013162652961909771, -0.05404865741729736, 0.08026193827390671, 0.0059451330453157425, -0.060873955488204956, -0.06364759057760239, -0.06016666442155838, 0.07092540711164474, -0.015607981942594051, 0.08364784717559814, 0.023196490481495857, -0.03903079405426979, -0.038005124777555466, -0.042392224073410034, 0.002677126321941614, 0.048708006739616394, -0.05022161826491356, -0.05995187908411026, 0.05255107581615448, -0.042553260922431946, -2.2343414584766024e-33, 0.02323468215763569, 0.0284357238560915, -0.03767106309533119, 0.019362449645996094, -0.10826943069696426, 0.06431843340396881, -0.01870165765285492, -0.012616975232958794, -0.04167668893933296, 0.005102710332721472, -0.054354675114154816, 0.04419419541954994, -0.03515627980232239, 0.0024203688371926546, 0.03747503086924553, 0.03757038712501526, 0.024828217923641205, -0.10020077228546143, 0.03925252705812454, 0.061818841844797134, -0.06998783349990845, 0.019431082531809807, 0.02271123230457306, -0.018141277134418488, -0.02533300779759884, -0.012844513170421124, 0.05563870817422867, 0.06873631477355957, 0.021033523604273796, -0.08965655416250229, 0.019112544134259224, 0.01608129031956196, -0.10095785558223724, -0.017110198736190796, -0.006957012228667736, 0.027948537841439247, -0.01804957166314125, -0.03727016597986221, 0.04482760280370712, -0.054057683795690536, 0.02485041692852974, -0.017364194616675377, -0.1154683455824852, -0.08317145705223083, 0.09405096620321274, 0.027417387813329697, 0.033362552523612976, 0.052390556782484055, -0.045453280210494995, -0.0579020157456398, 0.0303469430655241, 0.08592106401920319, 0.003232186660170555, -0.06417720019817352, -0.009519340470433235, -0.040850650519132614, 0.10844170302152634, 0.03046627715229988, -0.047035884112119675, 0.008034728467464447, 0.029249608516693115, 0.018895618617534637, 0.025339249521493912, -0.06510252505540848, -0.032006070017814636, 0.048571936786174774, -0.015201318077743053, -0.017814427614212036, -0.060832370072603226, 0.05476754158735275, -0.029212916269898415, 0.0821949690580368, -0.0009047031635418534, 0.011112120933830738, -0.015831924974918365, -0.009463266469538212, -0.040055036544799805, 0.0235389806330204, 0.006091051734983921, 0.00023467620485462248, 0.011698883026838303, 0.10915839672088623, 0.0026773358695209026, 0.045645032078027725, -0.059699803590774536, 0.023452971130609512, -0.010910797864198685, -0.008328074589371681, 0.04849494248628616, -0.01850399747490883, -0.008806907571852207, 0.012657200917601585, 0.034129057079553604, 0.1287182718515396, -0.03129041939973831, -4.533677611107123e-08, -0.021412475034594536, 0.06035442277789116, -0.00400929432362318, -0.02706114389002323, 0.0813266932964325, 0.04739616811275482, -0.0039793080650269985, 0.03374391421675682, 0.05991418659687042, -0.07031722366809845, 0.019526949152350426, -0.09390247613191605, -0.02668093331158161, 0.13718557357788086, -0.01612081378698349, 0.03444164991378784, -0.01791749708354473, 0.06206728145480156, -0.018372170627117157, 0.005146197974681854, 0.03014923259615898, -0.0020950199104845524, 0.08359631896018982, 0.028056740760803223, 0.07716633379459381, -0.04233483597636223, -0.002747155725955963, -0.06668046116828918, 0.033007070422172546, -0.05949806049466133, -0.08613605052232742, 0.04399280622601509, 0.0400046780705452, -0.02012561820447445, -0.037830650806427, 0.0298000480979681, 0.018443841487169266, 0.04546266794204712, 0.03979094699025154, 0.08599509298801422, 0.0028608383145183325, 0.0556790716946125, -0.06489203125238419, -0.0652385801076889, -0.02532120794057846, -0.05201083794236183, -0.07461199909448624, -0.07277679443359375, -0.03290817514061928, 0.08885005116462708, 0.0404340997338295, 0.0292856153100729, -0.07887005060911179, 0.07845162600278854, 0.015437431633472443, 0.0027747356798499823, -0.06411496549844742, -0.10479886829853058, -0.01754368282854557, 0.009524240158498287, 0.12232173979282379, -0.06297331303358078, -0.062076322734355927, 0.10058826208114624 ] }, { "text": "I click build again without selecting Arduino Nano 33 BLE Sense from Build Firmware, \n it gives me ei-arduino-motion.zip this time. \n\n- Open Arduino IDE.\n- Sketch --> include licbrary --> Add zip --> select arduino-motion.zip\n- Tools --> board --> Arduino Mbed OS Nano Boards --> select Arduino Nano 33 BLE\n- File --> examples --> Arduino Motion Inferencing --> select Arduino Nano 33 BLE Sense Accelerometer\n- Tools --> Port --> Select Arduino COM\n- Click Upload \n\nI encountered to this error:\n\n Arduino_LSM9DS1.h: No such file or directory\n\nPlease check this website, I found it really heplpful: [https://www.programmingelectronics.com/no-such-file-error/](https://www.programmingelectronics.com/no-such-file-error/)", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_2", "embedding": [ -0.05300737917423248, -0.06556465476751328, -0.012140988372266293, -0.06621366739273071, 0.10549704730510712, -0.02938704937696457, 0.012143854051828384, -0.013330108486115932, -0.07568544149398804, 0.046278391033411026, 0.05732380971312523, -0.04305237531661987, -0.04213014990091324, -0.012586647644639015, 0.029950065538287163, 0.039436426013708115, -0.02806606888771057, -0.032567691057920456, 0.04787733405828476, 0.03983920440077782, 0.03513902425765991, 0.04886786267161369, 0.04389131814241409, 0.006032720673829317, 0.006974382791668177, -0.0723474770784378, 0.05697719007730484, -0.0011844297405332327, -0.034624651074409485, -0.054431550204753876, 0.00600873026996851, 0.032825272530317307, 0.11239488422870636, -0.040602196007966995, 0.1429176777601242, -0.028482036665081978, 0.035595376044511795, -0.027472950518131256, -0.05570047348737717, -0.0953618735074997, -0.020431766286492348, 0.06213830038905144, 0.014500271528959274, 0.028605857864022255, -0.023412328213453293, 0.018025243654847145, 0.07533998787403107, -0.04928887262940407, 0.0025683953426778316, 0.00414792075753212, -0.08267930895090103, -0.024922113865613937, 0.057421162724494934, -0.06294635683298111, -0.007541895844042301, -0.03356754034757614, -0.02725847065448761, 0.05902758985757828, 0.09337596595287323, -0.07869438081979752, 0.06937798857688904, 0.0021432656794786453, -0.022680791094899178, -0.022715693339705467, 0.033040087670087814, 0.024362962692975998, 0.051419779658317566, -0.04030279815196991, 0.016484294086694717, -0.05276640132069588, 0.05459249019622803, -0.02510261721909046, -0.02512967959046364, 0.056094396859407425, -0.02632850594818592, 0.0673590824007988, 0.05715804919600487, 0.05035197362303734, -0.0021735974587500095, -0.03624918684363365, -0.06829255819320679, -0.030016332864761353, 0.024091394618153572, 0.04989909753203392, 0.01802586205303669, 0.034407973289489746, -0.001155894249677658, 0.044636938720941544, 0.08818937093019485, -0.0242050401866436, -0.01450594887137413, -0.05080405995249748, -0.09606468677520752, -0.00015989469829946756, 0.06299187242984772, -0.008276719599962234, 0.002261894987896085, 0.05995021387934685, -0.058073271065950394, -0.005344676319509745, -0.06849757581949234, -0.02119092270731926, 0.01590266451239586, 0.10405854880809784, -0.052705198526382446, -0.013243363238871098, 0.011884227395057678, 0.06752727180719376, 0.0856713056564331, -0.025729920715093613, -0.03394980728626251, -0.03425057232379913, -0.01579948328435421, -0.06738152354955673, -0.06549372524023056, -0.02105342224240303, -0.07905679941177368, 0.0526873953640461, -0.0056929681450128555, -0.019228285178542137, 0.06930003315210342, -0.01828656904399395, -0.03456795960664749, -0.1025097668170929, -0.05845147371292114, -0.06866160780191422, -0.0334852859377861, 9.321115515623946e-34, 0.06253223866224289, 0.02942563220858574, -0.055836886167526245, 0.058947447687387466, 0.044243913143873215, -0.06756167858839035, 0.010713845491409302, 0.0601031668484211, -0.07138258963823318, -0.025282960385084152, -0.05082253739237785, -0.054455410689115524, -0.012614316307008266, 0.04309806227684021, -0.005785961169749498, -0.0711478739976883, -0.01501394435763359, -0.0211662407964468, 0.015704644843935966, -0.02114306390285492, -0.00622531259432435, -0.027299897745251656, -0.06361959129571915, -0.047602564096450806, -0.02736601233482361, 0.06510074436664581, 0.1034870594739914, 0.08780504763126373, 0.05023256316781044, 0.03227664530277252, -0.04801285266876221, 0.013497339561581612, -0.03729880228638649, -0.03657114505767822, 0.013112355023622513, -0.018134035170078278, 0.002958148717880249, 0.0013263300061225891, -0.013881715945899487, -0.0306601170450449, 0.04080970957875252, 0.01799585483968258, -0.03490622714161873, -0.04885087534785271, 0.08229678124189377, -0.07308439910411835, -0.01414837222546339, -0.025939106941223145, 0.049941904842853546, 0.07845331728458405, -0.026071086525917053, -0.03570938855409622, 0.10102526098489761, -0.055030450224876404, 0.016855498775839806, -0.05189839377999306, -0.04165992885828018, -0.030277946963906288, -0.009812367148697376, 0.01949203759431839, 0.08075039088726044, 0.08453855663537979, -0.01310656126588583, 0.025760317221283913, -0.012876925989985466, -0.05425300449132919, 0.0416436605155468, 0.030533449724316597, 0.028980454429984093, 0.03345649316906929, -0.034009646624326706, -0.12773825228214264, 0.11169204115867615, -0.036873091012239456, -0.029477311298251152, -0.007086878642439842, -0.04330967366695404, 0.05087101459503174, 0.000281869521131739, -0.04822545871138573, -0.02625349350273609, -0.08415038883686066, -0.004179257899522781, 0.032415758818387985, 0.08529756218194962, 0.0158180370926857, -0.07060495018959045, 0.03197512775659561, 0.0011562589788809419, 0.01618894562125206, 0.08401519805192947, -0.05039201304316521, -0.08804185688495636, 0.057565491646528244, -0.07335814088582993, -2.2624098758513385e-33, -0.03478031978011131, 0.0019973088055849075, -0.0504479743540287, -0.06823268532752991, -0.1112869530916214, 0.011595314368605614, 0.021534912288188934, -0.043011851608753204, 0.06399689614772797, -0.04685960337519646, -0.022964272648096085, -0.006036677863448858, 0.07203400135040283, -0.06762681901454926, 0.019192997366189957, 0.05993706360459328, -0.01933450438082218, -0.13361330330371857, -0.011237322352826595, 0.03114735148847103, -0.011756873689591885, -0.012152464129030704, 0.05886106938123703, -0.029003407806158066, 0.008059280924499035, 0.012272829189896584, 0.07197871059179306, 0.0929492712020874, 0.008358994498848915, -0.0032529060263186693, 0.047518808394670486, -0.003400595625862479, -0.12474875897169113, 0.07213224470615387, 0.01467115804553032, -0.047457218170166016, -0.014283317141234875, -0.043405044823884964, 0.052436187863349915, -0.09714699536561966, -0.0002805880212690681, 0.02197924070060253, -0.037224844098091125, -0.04443759843707085, 0.07128169387578964, 0.011978916823863983, 0.047590065747499466, -0.016594385728240013, -0.012228347361087799, -0.050166890025138855, 0.010883012786507607, 0.05120878666639328, 0.0393073633313179, -0.10166888684034348, 0.005108710378408432, 0.014410464093089104, 0.057528600096702576, 0.06074199452996254, -0.012987670488655567, 0.04135797172784805, 0.057170379906892776, 0.06984833627939224, 0.022177862003445625, -0.029351213946938515, -0.06297364830970764, 0.0464010052382946, 0.009382059797644615, 0.08112148940563202, -0.020772673189640045, 0.010794371366500854, -0.06424320489168167, 0.019505159929394722, 0.05127179995179176, 0.009249843657016754, 0.03275454416871071, 0.03444494307041168, -0.04563882574439049, 0.033728115260601044, -0.03573319688439369, 0.00451951939612627, 0.09948804974555969, 0.05423547327518463, 0.03557678312063217, 0.04314607009291649, -0.020317966118454933, -0.020508861169219017, -0.04021298885345459, 0.052133288234472275, 0.07205157727003098, -0.02836044877767563, -0.005946690682321787, -0.007276772055774927, 0.08261734992265701, 0.17743945121765137, -0.041239283978939056, -5.031727212667647e-08, 0.0035687009803950787, 0.05269475653767586, -0.00726403808221221, -0.06634306162595749, 0.06791266053915024, -0.006329104769974947, 0.009271745570003986, 0.019307760521769524, 0.01574529893696308, -0.044725965708494186, 0.048580046743154526, -0.07436531037092209, -0.04484622925519943, 0.12286344915628433, -0.0028105557430535555, -0.07090627402067184, -0.1116705909371376, 0.06278185546398163, 0.009357515722513199, -0.016141394153237343, 0.07085296511650085, 0.0008733955328352749, 0.046626977622509, 0.030630312860012054, 0.07666777074337006, -0.012225880287587643, 0.00977792963385582, -0.10169092565774918, 0.02498580887913704, -0.018493419513106346, -0.0844975933432579, 0.014094572514295578, 0.009435470215976238, 0.010988598689436913, 0.00043826314504258335, -0.0012886740732938051, 0.042690251022577286, 0.05684712156653404, 0.07879942655563354, -0.04192667081952095, -0.029240723699331284, 0.10657010227441788, -0.00554678263142705, -0.062391310930252075, -0.026746034622192383, -0.04971206933259964, -0.07592064887285233, -0.013609702698886395, -0.07036043703556061, 0.017365587875247, 0.013808632269501686, 0.0013076670002192259, -0.014036346226930618, 0.07496515661478043, -0.011321892961859703, 0.016590071842074394, -0.10255007445812225, -0.05413505434989929, -0.014834904111921787, -0.017892487347126007, 0.07434199750423431, -0.01715085841715336, -0.07420191913843155, 0.05273616686463356 ] }, { "text": "I installed Arduino_LSM9DS1 from: \n \n Open Arduino IDE: sketch --> include library --> manage libraries --> Arduino_LSM9DS1 \n\nUpload completed with the errors below:", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_3", "embedding": [ -0.06909223645925522, -0.09016618132591248, 0.041056253015995026, -0.07312969863414764, 0.1298837810754776, 0.05098665878176689, 0.014252919703722, 0.06173982843756676, -0.13276676833629608, 0.029649559408426285, 0.0047344034537673, 0.02053779736161232, -0.031306441873311996, 0.053561437875032425, 0.014889443293213844, 0.005489693488925695, -0.01764281652867794, -0.08471532166004181, 0.020517367869615555, 0.05977381020784378, 0.03371458128094673, 0.022771064192056656, -0.062054343521595, -0.00821717455983162, 0.09761472046375275, -0.09098710119724274, -0.026362253352999687, -0.026732461526989937, -0.024718035012483597, -0.022020608186721802, 0.021288331598043442, -0.04041341319680214, -0.007255131378769875, 0.011826768517494202, 0.04870942607522011, -0.04784025624394417, 0.05589045211672783, -0.056186508387327194, -0.08015671372413635, -0.005763225723057985, 0.06455244868993759, 0.08126333355903625, 0.05448713153600693, -0.03732883185148239, -0.064046211540699, -0.0069019002839922905, 0.08193067461252213, 0.007577053736895323, -0.03159660845994949, 0.04495437070727348, -0.06227731704711914, -0.03557540848851204, 0.07368435710668564, -0.019400568678975105, -0.0676913633942604, -0.09930797666311264, 0.02509116567671299, 0.03310726583003998, -0.016955725848674774, -0.04685415327548981, -0.03548619896173477, 0.041142869740724564, -0.005349088925868273, -0.022436300292611122, -0.012455477379262447, 0.03048362396657467, -0.010840768925845623, -0.02026727981865406, -0.03680538758635521, 0.02754124067723751, 0.016514930874109268, 0.03799016401171684, -0.04821237921714783, 0.02563333883881569, -0.0008770033018663526, -0.0021417802199721336, 0.03818785771727562, -0.004363617394119501, -0.04231972247362137, -0.042960140854120255, 0.023516744375228882, -0.028526052832603455, -5.157152372703422e-06, 0.004509334452450275, -0.01928529143333435, 0.011878379620611668, -0.053416550159454346, 0.024936266243457794, 0.030808886513113976, -0.07600732147693634, 0.023203318938612938, -0.0894913598895073, -0.025291066616773605, 0.012473680078983307, 0.04164227843284607, -0.06678403913974762, 0.03070327825844288, 0.07046961784362793, -0.12384536862373352, -0.006738011259585619, -0.03903445228934288, 0.00361039862036705, 0.07944055646657944, 0.06549354642629623, -0.025280999019742012, 0.05466470122337341, 0.0225776769220829, 0.02141619846224785, -9.31083268369548e-05, -0.13598337769508362, -0.014157764613628387, 0.03162773326039314, -0.014695844613015652, -0.04839475080370903, -0.030606715008616447, -0.09231138229370117, -0.0042482102289795876, -0.004551531281322241, -0.07768550515174866, -0.06137590482831001, 0.008301439695060253, -0.00749778188765049, 0.03411314636468887, -0.06278424710035324, -0.011657629162073135, -0.10359972715377808, -0.09515503793954849, 1.5147656221921123e-33, -0.01864604279398918, -0.007769275922328234, -0.05990031361579895, 0.053758781403303146, 0.0083273621276021, -0.037708722054958344, -0.11963368952274323, 0.009255451150238514, -0.05819002911448479, -0.032792918384075165, -0.08901770412921906, -0.06881644576787949, -0.029388898983597755, 0.06529156863689423, -0.009736818261444569, 0.0023255730047822, 0.023347709327936172, 0.06779861450195312, 0.04816684126853943, -0.0034043907653540373, -0.025070399045944214, -0.01740560121834278, -0.056074630469083786, -0.014694783836603165, -0.03503729775547981, 0.11220069974660873, 0.11059600859880447, 0.02754392847418785, 0.06599263101816177, 0.007842980325222015, 0.006489996332675219, 0.06222812458872795, 0.008487802930176258, -0.012654378078877926, 0.043797656893730164, 0.012438304722309113, -0.004342592786997557, -0.0017122233984991908, 0.040930647403001785, -0.09467766433954239, 0.036196909844875336, 0.008639592677354813, -0.11046075820922852, -0.031910307705402374, 0.1325693130493164, -0.07108181715011597, -0.041267819702625275, 0.005950802005827427, 0.036176931113004684, 0.005410273093730211, -0.00259788753464818, -0.047176212072372437, 0.037457969039678574, 0.030102018266916275, 0.012313894927501678, -0.09416336566209793, -0.03342293202877045, -0.018249066546559334, -0.024132732301950455, -0.06343383342027664, 0.09503334760665894, 0.0070376829244196415, -0.0429048128426075, 0.008660582825541496, 0.01820565015077591, -0.07151658833026886, 0.04019183665513992, 0.02578214555978775, 0.03910188749432564, 0.07395059615373611, -0.0683438628911972, -0.10515160858631134, 0.02247234433889389, 0.056769296526908875, 0.014537536539137363, -0.05688629299402237, 0.06654977798461914, 0.0653315857052803, -0.01540843304246664, 0.08366020768880844, -0.03940945118665695, -0.0912400409579277, -0.03513786941766739, -0.02481621503829956, 0.03369099274277687, 0.01853787899017334, 0.05905620753765106, 0.03646468371152878, -0.05051403492689133, 0.04661862924695015, 0.02420961856842041, 0.01040336862206459, -0.025165777653455734, 0.01990167424082756, -0.08315521478652954, -2.9794849397399503e-33, -0.055304352194070816, 0.016943063586950302, 0.014370279386639595, -0.024961041286587715, -0.04491829499602318, -0.001530466484837234, 0.009307262487709522, -0.02238214761018753, 0.0493428036570549, -0.036969076842069626, -0.02321282960474491, -0.08334871381521225, 0.04283923655748367, -0.149080291390419, 0.07058587670326233, -0.05741991847753525, 0.005695704836398363, -0.08679894357919693, 0.010373272001743317, -0.0008488314342685044, -0.019691450521349907, -0.011068514548242092, 0.05362003669142723, -0.007751386146992445, 0.006028253119438887, -0.0033560991287231445, 0.019479215145111084, 0.11296629160642624, 0.02485175058245659, 0.010293136350810528, -0.0190542284399271, 0.04554923623800278, -0.05046077072620392, 0.02981059066951275, -0.04318223521113396, -0.031033560633659363, 0.06282123178243637, -0.0023844994138926268, 0.02039564773440361, -0.09500861167907715, 0.06498917192220688, 0.01878417655825615, 0.013102574273943901, -0.042908020317554474, 0.06548436731100082, -0.029751475900411606, -0.036884158849716187, 0.02822297066450119, -0.02204914763569832, -0.0072974031791090965, -0.012715375982224941, -0.02264917828142643, 0.07577808946371078, -0.029688458889722824, 0.09757839888334274, 0.031017275527119637, 0.07125616073608398, 0.08002176135778427, 0.017352156341075897, 0.046687860041856766, -0.020359128713607788, 0.06923496723175049, -0.07632342725992203, -0.0317615270614624, -0.037045471370220184, 0.00676030945032835, 0.02681390754878521, 0.08345376700162888, -0.02115069516003132, -0.025367528200149536, -0.02895091474056244, 0.09930868446826935, 0.09544353932142258, 0.02807299792766571, 0.031188873574137688, -0.0015850188210606575, -0.10999123752117157, 0.09704062342643738, 0.046086784452199936, -0.032607708126306534, 0.058343976736068726, -0.01566338911652565, 0.02544667199254036, 0.006212187930941582, 0.08949613571166992, -0.019929736852645874, 0.056519512087106705, 0.06739748269319534, 0.029084138572216034, -0.07108429819345474, -0.005600405391305685, 0.028624799102544785, 0.0864202082157135, 0.06362453103065491, 0.04674077406525612, -3.4049726593821106e-08, 0.01946859434247017, 0.03324871137738228, -0.019258808344602585, -0.09040814638137817, 0.007479274645447731, -0.009774526581168175, -0.016943033784627914, -0.012824257835745811, 0.024500325322151184, -0.026478664949536324, 0.05162923410534859, 0.03113507106900215, -0.07045432180166245, 0.039441656321287155, 0.05085664242506027, -0.06517523527145386, -0.14664573967456818, 0.0364052876830101, 0.0360504575073719, 0.07119534909725189, 0.05279914289712906, -0.010211598128080368, 0.045968491584062576, -0.02105073258280754, -0.02300306223332882, 0.02761876955628395, 0.024793239310383797, -0.03008580394089222, 0.054946135729551315, -0.033292412757873535, -0.03561519458889961, 0.020739611238241196, -0.00010293741797795519, -0.04795758053660393, 0.06686953455209732, -0.045723941177129745, 0.06908468157052994, 0.04847222939133644, 0.09519803524017334, -0.06242108345031738, 0.055343013256788254, 0.10961446911096573, 0.05271831154823303, -0.028851136565208435, -0.06150101125240326, -0.010099844075739384, 0.0031781289726495743, 0.07106462121009827, -0.07574518769979477, 0.014246150851249695, -0.04092387855052948, 0.024851232767105103, -0.004868148826062679, 0.014296644367277622, -0.05411984398961067, -0.03881482034921646, -0.009032388217747211, -0.03343866020441055, -0.049302052706480026, 0.016356654465198517, 0.0634707659482956, 0.0466633178293705, -0.03663332387804985, 0.03527602180838585 ] }, { "text": "`C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\ConvolutionFunctions\\arm_convolve_HWC_q7_RGB.c: In function 'arm_convolve_HWC_q7_RGB':\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\ConvolutionFunctions\\arm_convolve_HWC_q7_RGB.c:125:25: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pBuffer) = 0x0;\n ^", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_4", "embedding": [ -0.06429626792669296, 0.012015629559755325, -0.024611929431557655, -0.030864769592881203, -0.004181446973234415, -0.059135552495718, 0.054572876542806625, 0.0969790443778038, -0.05833585560321808, -0.010266454890370369, 0.03351640701293945, -0.13289552927017212, -0.06757024675607681, 0.01449044980108738, -0.01693842001259327, 0.0536089725792408, -0.08550060540437698, 0.02477126009762287, -0.0007252987707033753, 0.06636872887611389, 0.014334439300000668, -0.025894051417708397, -0.007132256403565407, 0.029908031225204468, 0.023471089079976082, 0.004708223044872284, 0.003794897347688675, 0.0581587478518486, 0.03560631722211838, -0.09629549086093903, 0.014422177337110043, 0.07717189937829971, 0.0900253877043724, 0.01570013351738453, 0.09464875608682632, 0.07489708811044693, 0.011569756083190441, -0.11971241235733032, 0.009257798083126545, -0.05278538540005684, 0.05867687612771988, 0.05881866067647934, -0.042962316423654556, -0.02583729662001133, 0.03412163257598877, 0.02344999834895134, 0.10219240188598633, 0.009572730399668217, -0.027052780613303185, -0.017171233892440796, -0.07978960126638412, -0.011588136665523052, -0.009013026021420956, 0.01609850488603115, 0.04554660618305206, 0.006724327336996794, -0.05823808163404465, 0.08552861958742142, 0.10452722012996674, 0.04854946583509445, -0.058742668479681015, -0.029479024931788445, -0.02277565188705921, 0.008464154787361622, -0.061891164630651474, -0.040584810078144073, -0.0039000618271529675, 0.023005381226539612, 0.012033055536448956, 0.019369948655366898, -0.02851720154285431, 0.02853473462164402, -0.05325503647327423, 0.07559023052453995, -0.003984014969319105, 0.03722017630934715, 0.016070039942860603, 0.023080764338374138, -0.05965249240398407, -0.16227507591247559, 0.022356066852808, -0.09731984883546829, -0.04053345322608948, 0.0025344877503812313, 0.14414909482002258, 0.0911996141076088, -0.09938979893922806, -0.011010952293872833, -0.007260627578943968, -0.05513530224561691, -0.03672249987721443, -0.07434303313493729, -0.04106740280985832, -0.0507810078561306, 0.03832294046878815, -0.013960524462163448, 0.04838450998067856, -0.020354432985186577, -0.00768858240917325, 0.0830383375287056, -0.07028951495885849, -0.07136592268943787, 0.02921793796122074, 0.0875844806432724, -5.1698127208510414e-05, -0.018505703657865524, 0.027405748143792152, 0.05328476056456566, -0.024984285235404968, -0.03109368309378624, -0.07295181602239609, 0.014115559868514538, -0.001349225640296936, -0.06708315759897232, 0.029870865866541862, 0.058598604053258896, -0.04493644833564758, 0.011240306310355663, 0.0843707025051117, -0.040466826409101486, -0.031099651008844376, -0.04167044907808304, -0.06886239349842072, 0.014160292223095894, -0.02933516353368759, -0.079922154545784, -0.007304452825337648, 5.850211672773884e-33, 0.047185055911540985, -0.0702878087759018, -0.013477860018610954, -0.014334244653582573, 0.05118895694613457, -0.017400000244379044, 0.03461112454533577, 0.0002636811987031251, -0.060797318816185, -0.03608466312289238, 0.013488092459738255, -0.13573679327964783, 0.026274744421243668, 0.06817342340946198, -0.03415609151124954, 0.003988741431385279, 0.01349978893995285, -0.029020994901657104, -0.04368968680500984, 0.03608299419283867, 0.08481264859437943, 0.03828297555446625, -0.12807519733905792, 0.0521879643201828, -0.14178088307380676, 0.09518761932849884, 0.03547356650233269, 0.018901430070400238, 0.1285598874092102, -0.000855470250826329, -0.03467496857047081, 0.06291861832141876, 0.02993484027683735, -0.03201534226536751, -0.00013707729522138834, 0.010869449935853481, -0.0693504810333252, 0.022005600854754448, -0.046373963356018066, -0.03198012709617615, -0.0253389161080122, 0.020618390291929245, -0.06418279558420181, -0.03723638504743576, 0.0708322525024414, -0.05897509306669235, -0.00044574475032277405, 0.06632423400878906, -0.03709784150123596, 0.0841703861951828, 0.013937970623373985, 0.04118067026138306, 0.04236725717782974, -0.03675410896539688, 0.042659398168325424, -0.06566594541072845, -0.009277639910578728, 0.09668987989425659, 0.054227281361818314, 0.04304936155676842, 0.05392836034297943, 0.02295125089585781, -0.034528106451034546, 0.0013931372668594122, -0.0036613401025533676, 0.034625642001628876, -0.05525365471839905, 0.00038565482827834785, -0.004641916137188673, 0.053408876061439514, -0.02383626438677311, -0.01209984254091978, -0.012633559294044971, 0.030588187277317047, -0.028187815099954605, 0.013382029719650745, -0.07444695383310318, 0.00867232121527195, -0.03611641749739647, -0.03795221820473671, -0.09085831046104431, 0.054739098995923996, 0.023301752284169197, -0.034136202186346054, -0.04660167917609215, -0.07389697432518005, 0.021785588935017586, -0.11366892606019974, -0.05521417409181595, 0.042595602571964264, 0.007235816679894924, -0.018726952373981476, -0.047198422253131866, 0.04070335999131203, -0.09508877992630005, -6.870682195951713e-33, 0.07943236827850342, 0.10438130050897598, -0.043924130499362946, 0.02831253781914711, -0.18386653065681458, 0.05588469281792641, 0.0701553225517273, -0.0636342391371727, 0.01048449520021677, -0.06972598284482956, 0.06278544664382935, 0.005585862323641777, 0.028758171945810318, -0.0411287359893322, 0.05209134891629219, 0.0036911156494170427, -0.035830575972795486, 0.02091808430850506, -0.04469490423798561, 0.03195403143763542, -0.03116503916680813, 0.04861272871494293, 0.0590810589492321, 0.056486207991838455, -0.01879432238638401, 0.03484718129038811, 0.04532056301832199, 0.05039430037140846, -0.02823529578745365, -0.0018315849592909217, -0.020317168906331062, 0.05999559909105301, -0.1479955017566681, -0.05553295463323593, 0.04308830574154854, -0.026678919792175293, 0.009000982157886028, -0.015359719283878803, -0.010951041243970394, -0.058894265443086624, 0.08689351379871368, 0.033466748893260956, -0.004711109679192305, -0.014226284809410572, 0.02662705071270466, -0.0005222437903285027, 0.02391844242811203, -0.024054743349552155, -0.0036603808403015137, -0.013376635499298573, -0.006459945347160101, -0.017474453896284103, 0.017815200611948967, -0.049582455307245255, -0.0087616927921772, 0.023047467693686485, 0.05663679167628288, 0.06140931323170662, 0.08762628585100174, -0.007319160737097263, 0.0025547752156853676, -0.07508181035518646, -0.11730021983385086, -0.099520742893219, 0.03198188170790672, -0.0030972629319876432, -0.0776827484369278, 0.023404201492667198, 0.0833498015999794, -0.029016247019171715, -0.02731362357735634, 0.04593823477625847, 0.03541267663240433, 0.026924502104520798, -0.06053199991583824, 0.0006230729050002992, 0.0371655635535717, -0.04327712208032608, -0.014549916610121727, 0.037915684282779694, -0.001421237364411354, 0.04199850186705589, 0.03118353709578514, 0.06313992291688919, -0.05840909481048584, 0.02830640785396099, -0.018588677048683167, -0.009814496152102947, 0.02702176943421364, -0.017476234585046768, -0.0020517990924417973, 0.025617951527237892, 0.0815645307302475, 0.12241053581237793, -0.009029955603182316, -5.147977333308518e-08, -0.02106034755706787, -0.020073793828487396, -0.024039164185523987, 0.01664394699037075, 0.057089466601610184, -0.0438382588326931, -0.04435297101736069, -0.060879990458488464, 0.01430591195821762, -0.05314818024635315, 0.03941557556390762, -0.024230262264609337, 0.011223235167562962, -0.017266754060983658, 0.013788314536213875, -0.033487118780612946, -0.06777729839086533, -0.011332499794661999, -0.015641886740922928, -0.016763869673013687, -0.011255566962063313, -0.044618766754865646, -0.0021752365864813328, 0.021640567108988762, -0.005377995315939188, -0.073752261698246, 0.034232575446367264, 0.028392238542437553, -0.03229694068431854, -0.0033360114321112633, -0.005408630706369877, 0.04371396452188492, 0.06547066569328308, 0.006899943109601736, 0.03101329691708088, 0.031603194773197174, -0.03652714192867279, 0.07915917783975601, -0.016332410275936127, -3.0589773814426735e-05, -0.08043362200260162, 0.08669023960828781, -0.02005244418978691, 0.0016798677388578653, -0.02127414010465145, -0.06234413757920265, 0.004478790331631899, 0.05218600481748581, -0.00040752027416601777, 0.057603057473897934, 0.03682529553771019, 0.07069632411003113, 0.018766213208436966, 0.03247765824198723, -0.01407497376203537, -0.048526812344789505, 0.010047796182334423, -0.019182754680514336, -0.044798847287893295, 0.00614809850230813, 0.03126387670636177, -0.07385291159152985, 0.0172587800770998, 0.044887885451316833 ] }, { "text": "*__SIMD32(pBuffer) = 0x0;\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\ConvolutionFunctions\\arm_convolve_HWC_q7_RGB.c:158:25: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pBuffer) = __PKHBT(bottom.word, top.word, 0);\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\NNSupportFunctions\\arm_nn_mult_q15.c: In function 'arm_nn_mult_q15':", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_5", "embedding": [ -0.0326947383582592, 0.0004510532889980823, 0.0014310289407148957, -0.03755956143140793, -0.043130215257406235, -0.0808202251791954, 0.0806005448102951, 0.11142633110284805, -0.05866457521915436, -0.009974656626582146, 0.02818423882126808, -0.11998524516820908, -0.03631291165947914, 0.0028749187476933002, -0.007791727315634489, 0.015116184018552303, -0.09283596277236938, -0.007352849468588829, 0.04316823557019234, 0.052275434136390686, 0.058429915457963943, 0.034460343420505524, 0.0027759461663663387, -0.019299853593111038, 0.022837188094854355, -0.001968997297808528, 0.03260311484336853, -0.0041869888082146645, 0.035168807953596115, -0.09148629754781723, 0.03337810933589935, 0.07050345093011856, 0.040923312306404114, 0.0022106056567281485, 0.10265865921974182, 0.04216700419783592, 0.002230885671451688, -0.07176952809095383, 0.0469198152422905, -0.027230331674218178, 0.08428556472063065, 0.06480792909860611, -0.06040552631020546, 0.012764237821102142, 0.04670453071594238, 0.01052617747336626, 0.07480847090482712, 0.017215507104992867, -0.03253952041268349, 0.01772211119532585, -0.05071643739938736, -0.035513635724782944, -0.005164204631000757, 0.03640438988804817, 0.04757985472679138, -0.013940837234258652, -0.03921828418970108, 0.08347868174314499, 0.07336175441741943, 0.042013879865407944, -0.08824220299720764, -0.0037471053656190634, 0.0032265358604490757, -0.037274327129125595, -0.06618395447731018, -0.04630294069647789, -0.01714344508945942, 0.031532395631074905, 0.001888514612801373, 0.037273649126291275, -0.03521430864930153, 0.027765648439526558, -0.04519375413656235, 0.03269323334097862, -0.028458472341299057, 0.035059891641139984, -0.006600112188607454, 0.016241345554590225, -0.006894947960972786, -0.15114158391952515, 0.017626754939556122, -0.06527486443519592, -0.030614636838436127, -0.0006590267294086516, 0.16285660862922668, 0.06843526661396027, -0.1109207272529602, -0.03675754368305206, 0.004050909541547298, -0.06194340065121651, -0.06047355383634567, -0.09472852200269699, -0.05534106865525246, -0.03912034630775452, 0.0033988470677286386, -0.033476050943136215, 0.04313037171959877, -0.003512325929477811, -0.022695301100611687, 0.1039077490568161, -0.06694874912500381, -0.012995409779250622, 0.015524622052907944, 0.06766167283058167, -0.01569482497870922, 0.01765730418264866, 0.031133165583014488, -0.01978020742535591, -0.04486386477947235, -0.04654783755540848, -0.07911926507949829, 0.016570528969168663, -0.03709481656551361, -0.047452446073293686, 0.04435224086046219, 0.05850134789943695, -0.03819639980792999, -0.00647442601621151, 0.08354195952415466, -0.06293187290430069, -0.04183347523212433, -0.04715953394770622, -0.05248010531067848, 0.06168251857161522, -0.0528879351913929, -0.05769641697406769, 0.010063953697681427, 6.319460568756495e-33, 0.03234913945198059, -0.060214459896087646, -0.05092223733663559, -0.018854249268770218, 0.04893145710229874, -0.0073471833020448685, 0.03700267896056175, 0.008563701994717121, -0.08474352210760117, -0.04252491891384125, 0.052623018622398376, -0.15323948860168457, 0.022265378385782242, 0.08943292498588562, -0.03446957841515541, 0.005604207515716553, 0.02084353193640709, -0.00441142451018095, -0.059133388102054596, 0.03597518429160118, 0.08036589622497559, 0.07691388577222824, -0.13936707377433777, 0.04927203059196472, -0.1484808325767517, 0.07406279444694519, -0.013320734724402428, 0.0068585313856601715, 0.09701361507177353, -0.005572321824729443, -0.03663497418165207, 0.06260475516319275, 0.009518379345536232, -0.06880740821361542, -0.027682457119226456, -0.011130360886454582, -0.056168366223573685, 0.029051074758172035, -0.031170373782515526, -0.041846245527267456, -0.055690936744213104, -0.023625290021300316, -0.015249375253915787, -0.0648876279592514, 0.02763649821281433, -0.019868621602654457, -0.029694242402911186, 0.04902565851807594, -0.012191192246973515, 0.02578938566148281, 0.009597052820026875, 0.025398381054401398, 0.030483510345220566, 0.01864001899957657, 0.026358846575021744, -0.08166491240262985, -0.01900947280228138, 0.09410332888364792, 0.05072825774550438, 0.0702444314956665, 0.0545802116394043, 0.03292802348732948, -0.014906001277267933, 0.038740430027246475, -0.0029056507628411055, 0.056856848299503326, -0.020747393369674683, -0.014678919687867165, 0.020464671775698662, 0.07274891436100006, 0.00431524682790041, 0.004744734149426222, -0.02109573595225811, 0.051635321229696274, -0.04828128218650818, 0.026639606803655624, -0.06934051960706711, 0.0019159828079864383, -0.04607204720377922, -0.012855399399995804, -0.03395368903875351, 0.05677473545074463, 0.03159184008836746, -0.06010580435395241, -0.03654668107628822, -0.11368564516305923, 0.030430803075432777, -0.13002972304821014, -0.045955199748277664, 0.017483709380030632, -1.514214000053471e-05, 0.011980375275015831, -0.010663168504834175, 0.03855704516172409, -0.08357299864292145, -6.988349915152993e-33, 0.07671012729406357, 0.12672719359397888, -0.01477525383234024, 0.010945969261229038, -0.2263859063386917, 0.034014418721199036, 0.12235278636217117, -0.04343990236520767, 0.013410046696662903, -0.0637413039803505, 0.0023440478835254908, 0.025982951745390892, 0.03341440111398697, -0.039800308644771576, 0.0895640179514885, 0.046838026493787766, -0.04882121458649635, 0.022919615730643272, 0.0003224580723326653, 0.04574960470199585, -0.016869939863681793, 0.039336610585451126, 0.051835957914590836, 0.03589976951479912, -0.025993231683969498, 0.044691186398267746, 0.032345958054065704, 0.05751260370016098, -0.04820423200726509, -0.03230179101228714, -0.050381410866975784, 0.07396279275417328, -0.10161682218313217, -0.054488103836774826, 0.0492427833378315, -0.04619633033871651, 0.0022441388573497534, -0.0002501634298823774, 0.022746501490473747, -0.05249571055173874, 0.10534507781267166, 0.024096304550766945, 0.01718509942293167, -0.0013500712811946869, 0.019985245540738106, -0.015694716945290565, -0.022080816328525543, -0.037145670503377914, -0.023266149684786797, -0.01636498048901558, 0.030959483236074448, 0.0017579017439857125, 0.04182684049010277, -0.03522266075015068, -0.0071976277977228165, 0.021488722413778305, 0.026123471558094025, 0.04202226921916008, 0.0592288114130497, -0.017027856782078743, -0.005716629326343536, -0.08561065793037415, -0.05908362567424774, -0.08839374780654907, 0.02889174409210682, -0.05919744819402695, -0.08715012669563293, -0.002694126218557358, 0.03664322569966316, -0.031538061797618866, -0.0337442085146904, 0.054261744022369385, 0.0009697439963929355, 0.022964507341384888, -0.06658804416656494, 0.026116523891687393, 0.05592088773846626, -0.023526351898908615, 0.002869602059945464, 0.05302075296640396, 0.02260555513203144, 0.057533152401447296, 0.022289928048849106, 0.031519968062639236, -0.0647338405251503, 0.047372788190841675, -0.03570191562175751, 0.020312191918492317, 0.022761328145861626, -0.014666378498077393, -0.036938294768333435, 0.011067597195506096, 0.1168568953871727, 0.10029224306344986, 0.003289448097348213, -5.759180865538838e-08, -0.026901094242930412, -0.03241372108459473, -0.05165175721049309, 0.051575127989053726, 0.009642274118959904, -0.06656616181135178, -0.06803429126739502, -0.06650242209434509, -0.02687733992934227, -0.07287781685590744, 0.02488384209573269, -0.05661018192768097, 0.009935785084962845, -0.02592894807457924, 0.038164183497428894, -0.027588214725255966, -0.020790843293070793, -0.01407085731625557, -0.0175230223685503, -0.027834482491016388, -0.033187225461006165, 0.0036846864968538284, 0.0004536791821010411, 0.0130546186119318, -0.05312580615282059, -0.04044489562511444, 0.020706430077552795, -0.003151049604639411, -0.017119523137807846, 0.019280025735497475, 0.039073407649993896, 0.03034270368516445, 0.027217408642172813, 0.03823790326714516, 0.046714652329683304, 0.017993319779634476, -0.03700343891978264, 0.04762081801891327, -0.011222016997635365, 0.05372513085603714, -0.06559334695339203, 0.06867988407611847, 0.0015330534661188722, -2.3329963369178586e-05, 0.00048596420674584806, -0.027838874608278275, -0.009378078393638134, 0.022779300808906555, 0.03531504049897194, 0.05960913747549057, 0.04707127809524536, 0.0919429212808609, 0.03816315159201622, 0.009315063245594501, -0.055533308535814285, -0.0521254688501358, -0.021274307742714882, 0.0284409336745739, -0.06765803694725037, 0.02954387292265892, 0.020237242802977562, -0.05841509625315666, 0.03392992913722992, 0.05584819242358208 ] }, { "text": "C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\NNSupportFunctions\\arm_nn_mult_q15.c:98:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pDst)++ = __PKHBT(out2, out1, 16);\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\NNSupportFunctions\\arm_nn_mult_q15.c:99:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pDst)++ = __PKHBT(out4, out3, 16);\n ^", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_6", "embedding": [ -0.0594332180917263, 0.018354980275034904, -0.024033181369304657, -0.08625809848308563, 0.00820078793913126, -0.05643343925476074, 0.02608346752822399, 0.10413841158151627, -0.0526437908411026, -0.01058839913457632, 0.08675321191549301, -0.0897245779633522, -0.07423513382673264, -0.019590022042393684, 0.008226700127124786, 0.04241552576422691, -0.09332042932510376, 0.03476354852318764, 0.022169597446918488, 0.09143669158220291, 0.04314667731523514, 0.022717874497175217, -0.041191913187503815, 0.025593480095267296, -0.053200285881757736, -0.012942137196660042, 0.03729977086186409, 0.03027474880218506, 0.029473721981048584, -0.08141543716192245, 0.0032945536077022552, 0.07543257623910904, 0.015751948580145836, 0.01025115791708231, 0.091839998960495, 0.06777948141098022, -0.006123226135969162, -0.044356878846883774, 0.012826555408537388, -0.032473959028720856, 0.07832740992307663, 0.08501940220594406, -0.022325357422232628, 0.017609378322958946, 0.01790403015911579, -0.004567806608974934, 0.06704229861497879, 0.013881560415029526, -0.06340227276086807, 0.015795879065990448, -0.06042254716157913, 0.02742806077003479, -0.026735680177807808, 0.0026271340902894735, 0.06809378415346146, -0.03569946438074112, -0.09536679089069366, 0.11653783172369003, 0.0914076566696167, 0.04532574117183685, -0.06485681235790253, 0.01894906535744667, -0.014792240224778652, -0.05135007202625275, -0.05632079020142555, -0.024830278009176254, 0.009619479067623615, 0.0014632821548730135, -0.0033798813819885254, 0.07174786180257797, -0.07273279130458832, 0.014020679518580437, -0.052381955087184906, 0.06748597323894501, -0.022183839231729507, 0.06596416234970093, -0.021957501769065857, 0.019895479083061218, -0.037263087928295135, -0.1704542338848114, -0.014050948433578014, -0.05533821880817413, -0.04773605614900589, -0.05547304078936577, 0.09672630578279495, 0.05112919583916664, -0.10494577884674072, -0.03339594230055809, 0.07209815084934235, -0.020994137972593307, 0.007648538798093796, -0.10358010977506638, -0.025741558521986008, -0.008760474622249603, 0.04697354882955551, -0.02140575461089611, 0.03565220162272453, -0.0028284096624702215, 0.0013680631527677178, 0.11405806988477707, -0.05274510011076927, -0.013229787349700928, -0.03548664599657059, 0.07500211149454117, 0.017277203500270844, 0.007120558060705662, 0.028515465557575226, -0.01827177219092846, -0.0352788083255291, -0.03744274377822876, -0.04849108308553696, 0.027012614533305168, -0.015657642856240273, -0.09506522119045258, 0.012811606749892235, 0.05437687784433365, -0.03964344412088394, -0.0089501291513443, 0.07144517451524734, -0.03738096356391907, -0.04778183251619339, -0.04156939685344696, -0.013993698172271252, 0.05033228173851967, -0.053876880556344986, -0.04306044057011604, 0.0007209884934127331, 5.4111865732608376e-33, 0.03465236723423004, -0.05332016572356224, -0.03860509395599365, -0.022033579647541046, 0.042873647063970566, 0.0028823972679674625, 0.016369793564081192, 0.0275601577013731, -0.05370958894491196, -0.04853280633687973, 0.0374460369348526, -0.13711662590503693, 0.03846385329961777, 0.057619597762823105, 0.01390822883695364, 0.002127990359440446, 0.08121860772371292, 0.0013235415099188685, -0.03817656263709068, 0.02992040105164051, 0.10247780382633209, 0.029767313972115517, -0.13657310605049133, 0.013015015050768852, -0.10109512507915497, 0.11373830586671829, 0.014701404608786106, 0.00986390095204115, 0.09825682640075684, -0.0035173206124454737, -0.03430311754345894, 0.03623059764504433, -0.006128657143563032, -0.03232847526669502, 0.021227974444627762, 0.03778635710477829, -0.05565229430794716, 0.004346515517681837, -0.010071029886603355, -0.0941762775182724, -0.03769241273403168, -0.026592090725898743, -0.05271797254681587, -0.023689553141593933, 0.07367700338363647, -0.06411490589380264, -0.05913182348012924, 0.05113387852907181, -0.011369017884135246, 0.005421377252787352, -0.007319035939872265, 0.03610670194029808, 0.06561223417520523, 0.011173109523952007, 0.00249094027094543, -0.07812845706939697, -0.03993476554751396, 0.04612725228071213, 0.01975463517010212, 0.07002630829811096, 0.03661621734499931, 0.02598506398499012, -0.030113738030195236, 0.01890217512845993, -0.026965245604515076, 0.06301930546760559, -0.08997899293899536, -0.007274095434695482, 0.06621137261390686, 0.04342012107372284, -0.02091125212609768, -0.008877436630427837, 0.004522908944636583, 0.07942622900009155, -0.057340577244758606, 0.012496483512222767, -0.06976109743118286, 0.043602559715509415, -0.02090529166162014, -0.0400654673576355, -0.07691249251365662, 0.0794573649764061, 0.03489939495921135, -0.04693559929728508, -0.028207913041114807, -0.10677272081375122, -0.017608074471354485, -0.08606048673391342, -0.017749998718500137, 0.04359019547700882, 0.01730223000049591, 0.03034275583922863, -0.060483578592538834, 0.08313363045454025, -0.0820653960108757, -7.161445131731421e-33, 0.049319878220558167, 0.09855346381664276, -0.030039921402931213, -0.018933473154902458, -0.20874013006687164, 0.03758709505200386, 0.050570547580718994, -0.06883272528648376, 0.004419476725161076, -0.07413259893655777, -0.023790065199136734, -0.0016846036305651069, 0.04419442266225815, -0.08096325397491455, 0.07801374793052673, 0.016130125150084496, -0.03877784311771393, 0.04150298610329628, -0.026473253965377808, 0.035548508167266846, -0.01700127124786377, 0.05154607072472572, 0.0080129848793149, 0.030946319922804832, -0.021711131557822227, 0.03090062364935875, 0.0162491612136364, 0.06103043630719185, -0.056861817836761475, 0.013518850319087505, -0.015453804284334183, 0.04651544243097305, -0.11005018651485443, -0.037358980625867844, 0.052506204694509506, -0.05401083454489708, -0.026857653632760048, 0.004756205249577761, -0.0019832816906273365, -0.06159691512584686, 0.11449616402387619, 0.031000925227999687, -0.007659181021153927, 0.05253177881240845, 0.015277496539056301, -0.00517029594630003, 0.0018977728905156255, -0.021654915064573288, -0.021182017400860786, -0.04178786277770996, 0.01851002685725689, -0.041349757462739944, 0.05268062278628349, -0.03185094892978668, -0.01767362467944622, 0.02748909965157509, 0.049531303346157074, 0.04383671283721924, 0.03303851559758186, 0.00548685435205698, 0.01467039156705141, -0.08754149824380875, -0.08623968064785004, -0.0773439034819603, 0.02869068831205368, -0.06026371195912361, -0.06118554249405861, -0.005659066140651703, 0.06851005554199219, -0.020709263160824776, -0.021053839474916458, 0.07510440051555634, -0.03086155466735363, -0.004579446744173765, -0.0595119334757328, 0.01615765504539013, 0.08967724442481995, -0.014355196617543697, -0.0018645782256498933, 0.0359688363969326, 0.0035528044681996107, 0.0403427891433239, 0.018295109272003174, 0.049186594784259796, -0.09160116314888, 0.05661710351705551, -0.01938200742006302, 0.0016370477387681603, -0.014758452773094177, -0.0034573213197290897, -0.006246647797524929, 0.0156503077596426, 0.06419656425714493, 0.12914825975894928, -0.04329153522849083, -5.161376748219482e-08, -0.04676653817296028, -0.01836252212524414, -0.05477139726281166, 0.040640149265527725, 0.0019163833931088448, -0.02678871341049671, -0.043928712606430054, -0.05187109112739563, -0.02132704108953476, -0.07424549758434296, 0.021781040355563164, -0.02967999316751957, -0.018020570278167725, -0.023472830653190613, 0.049400925636291504, -0.0804770290851593, -0.018259046599268913, -0.013777635991573334, -0.05272715538740158, 0.018289506435394287, -0.0760844275355339, -0.007424477953463793, 0.006289117969572544, 0.014112343080341816, -0.018346639350056648, -0.03964626416563988, 0.05321604013442993, 0.01638035476207733, -0.014411561191082, 0.07855872809886932, 0.029333850368857384, 0.03336472436785698, 0.029493438079953194, 0.049599166959524155, 0.04309219866991043, 0.04007070139050484, -0.03438020870089531, 0.054602738469839096, 0.020840810611844063, 0.05338599160313606, -0.04723093658685684, 0.06041708216071129, -0.03449380397796631, 0.024940142408013344, 0.015494694001972675, -0.05559743195772171, -0.003503924235701561, -0.0065132551826536655, 0.015665076673030853, 0.04107438400387764, 0.03563404455780983, 0.09170747548341751, 0.02283104509115219, -0.006513908039778471, -0.031378865242004395, -0.012319541536271572, -0.03439517691731453, -0.020496437326073647, -0.0669654905796051, 0.014973990619182587, 0.038241833448410034, -0.08858465403318405, 0.023760683834552765, 0.07264890521764755 ] }, { "text": "*__SIMD32(pDst)++ = __PKHBT(out4, out3, 16);\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\NNSupportFunctions\\arm_nn_mult_q7.c: In function 'arm_nn_mult_q7':\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\NNSupportFunctions\\arm_nn_mult_q7.c:80:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pDst)++ = __PACKq7(out1, out2, out3, out4);\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\NNSupportFunctions\\arm_q7_to_q15_reordered_no_shift.c: In function 'arm_q7_to_q15_reordered_no_shift':", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_7", "embedding": [ -0.07536478340625763, 0.019713176414370537, -0.04537074640393257, -0.0639086440205574, 0.013601046055555344, -0.08034607768058777, 0.02329823561012745, 0.09600995481014252, -0.047469936311244965, 0.0028324720915406942, 0.06990854442119598, -0.11105906963348389, -0.06442414969205856, -0.009173383936285973, 0.019359799101948738, 0.04585544019937515, -0.09287497401237488, 0.04009487107396126, 0.02618640661239624, 0.07677797228097916, 0.03205050528049469, -0.00022782580344937742, -0.029818719252943993, 0.014585606753826141, -0.009525720030069351, -0.021482184529304504, 0.026858454570174217, 0.05123678594827652, 0.05310433730483055, -0.05009835213422775, 0.024767104536294937, 0.08850403875112534, 0.044744644314050674, 0.0065369559451937675, 0.11820060014724731, 0.06698697805404663, -0.009239207953214645, -0.06500877439975739, -0.004657870624214411, -0.02281629666686058, 0.07152611017227173, 0.0814029797911644, -0.03151336684823036, 0.017815470695495605, 0.002555927261710167, 0.027569500729441643, 0.0843808501958847, 0.018037166446447372, -0.054904110729694366, 0.015009328722953796, -0.058924417942762375, 0.02897561527788639, -0.04277513548731804, 0.0066049424931406975, 0.07009647786617279, -0.04213208705186844, -0.08024268597364426, 0.08922629803419113, 0.07238397747278214, 0.05762076377868652, -0.04498015716671944, 0.010057331062853336, -0.0017667809734120965, -0.03432866930961609, -0.08791892975568771, -0.01097714900970459, 0.013720853254199028, 0.016272787004709244, -0.0006166971870698035, 0.03303053230047226, -0.06438468396663666, 0.0378592386841774, -0.04545288905501366, 0.08041910082101822, -0.0033658971078693867, 0.05604509636759758, -0.0027339402586221695, 0.020361024886369705, -0.049913447350263596, -0.18421532213687897, 0.0005672216066159308, -0.045950792729854584, -0.05125783756375313, -0.05982741713523865, 0.1000567153096199, 0.05552299693226814, -0.09748231619596481, -0.009418204426765442, 0.06066399812698364, -0.04211340844631195, 0.014012848027050495, -0.09039750695228577, -0.03712470829486847, -0.022445201873779297, 0.04074603691697121, 0.0073734731413424015, 0.03479759395122528, 0.014319881796836853, -0.00924225989729166, 0.11020557582378387, -0.07097864896059036, -0.014801074750721455, -0.02102864533662796, 0.07411841303110123, 0.00827082246541977, 0.008743696846067905, 0.03404106944799423, -0.011379632167518139, -0.05028450861573219, -0.05576498061418533, -0.06194055452942848, 0.03269447013735771, 0.00259898928925395, -0.07137865573167801, 0.010816517286002636, 0.04691896215081215, -0.03409108147025108, -0.015282177366316319, 0.06953016668558121, -0.011060263961553574, -0.05083013325929642, -0.030566463246941566, -0.0008696113945916295, 0.057604607194662094, -0.023992950096726418, -0.045750539749860764, 0.008592852391302586, 4.889765197226903e-33, 0.03563529998064041, -0.06469545513391495, -0.01835697889328003, -0.011074439622461796, 0.050647128373384476, -0.00641108863055706, 0.04281879588961601, 0.00023389827401842922, -0.05696885660290718, -0.03581167012453079, -0.0050726779736578465, -0.1267426311969757, 0.05099235847592354, 0.06123123690485954, -0.0004280848952475935, 0.02420344203710556, 0.06190864369273186, -0.020409373566508293, -0.03622477129101753, 0.04240455850958824, 0.11502861976623535, 0.011615411378443241, -0.13475583493709564, 0.037200961261987686, -0.1069389209151268, 0.11865010112524033, 0.03767859935760498, -0.0007288531633093953, 0.12073655426502228, -0.007341295480728149, -0.07221350073814392, 0.033641062676906586, -0.03511669114232063, -0.016259105876088142, -0.0016679628752171993, 0.0224286075681448, -0.0585547611117363, 0.011585094965994358, -0.05542260408401489, -0.07039029896259308, -0.02511349879205227, -0.015593030489981174, -0.028635313734412193, -0.04023699834942818, 0.05366408824920654, -0.06992480903863907, -0.055855803191661835, 0.05004607141017914, -0.0036949224304407835, 0.023944078013300896, -0.001027614576742053, 0.03870479762554169, 0.06376313418149948, 0.0030741121154278517, 0.0024203506764024496, -0.09306170791387558, -0.03273172676563263, 0.040057819336652756, 0.025340666994452477, 0.04700405150651932, 0.028921080753207207, -0.0017998229013755918, -0.0372685045003891, 0.029761822894215584, 0.00818245392292738, 0.059649694710969925, -0.07931170612573624, 0.014833342283964157, 0.05329706519842148, 0.0674581304192543, -0.018274683505296707, -0.01486562006175518, -0.0012901907321065664, 0.06287966668605804, -0.02943095564842224, 0.007022148463875055, -0.0761285200715065, 0.02567068487405777, -0.04359505698084831, -0.049803994596004486, -0.09382306784391403, 0.09186891466379166, 0.03130212426185608, -0.047996580600738525, -0.049437910318374634, -0.09496790915727615, -0.013935155235230923, -0.09345518797636032, -0.029515879228711128, 0.04377560690045357, -0.010865116491913795, 0.02114909514784813, -0.08265824615955353, 0.07130035012960434, -0.09579924494028091, -6.39244774768302e-33, 0.04535062611103058, 0.09989210218191147, -0.011062009260058403, -0.013650155626237392, -0.20968876779079437, 0.0454895980656147, 0.03541294112801552, -0.045383334159851074, -0.014595101587474346, -0.0871669203042984, -0.010985870845615864, -0.03441712632775307, 0.05321497097611427, -0.07495216280221939, 0.09056345373392105, 0.04865463078022003, -0.06169681251049042, 0.021788010373711586, -0.004884479101747274, 0.06239192932844162, -0.0496179461479187, 0.0737849697470665, 0.014618840999901295, 0.02436813712120056, -0.009220893494784832, 0.030042799189686775, 0.02921341545879841, 0.0670914351940155, -0.02422468736767769, 0.0018940576119348407, -0.027845390141010284, 0.051366765052080154, -0.1495196372270584, -0.01941780187189579, 0.040187664330005646, -0.021470582112669945, 0.010316295549273491, 0.011503617279231548, -0.009568999521434307, -0.06063143536448479, 0.10913307219743729, 0.026324119418859482, -0.01814301125705242, 0.01969720982015133, 0.011006487533450127, 0.01585531234741211, 0.009116488508880138, -0.021942179650068283, -0.031061576679348946, -0.03853762522339821, 0.010398723185062408, -0.02634841576218605, 0.04211929067969322, -0.018816452473402023, -0.021851520985364914, 0.032539162784814835, 0.03184889256954193, 0.04158598184585571, 0.04068390652537346, 0.0007947319536469877, 0.026443595066666603, -0.0947100892663002, -0.09198668599128723, -0.10339930653572083, 0.021324051544070244, -0.05118527635931969, -0.08039162307977676, 0.006520920433104038, 0.05852777138352394, -0.03338257223367691, -0.04546631872653961, 0.04075399786233902, -0.030952947214245796, 0.0038153156638145447, -0.04600294306874275, 0.012309225276112556, 0.06047078222036362, -0.023615561425685883, -0.0005853265756741166, 0.0500011183321476, -0.030069228261709213, 0.03341854363679886, 0.017962021753191948, 0.042032282799482346, -0.09819279611110687, 0.059609588235616684, 0.008243173360824585, 0.022144921123981476, 0.011583550833165646, -0.024650271981954575, -0.005613430868834257, 0.029720714315772057, 0.06551175564527512, 0.1567058265209198, -0.028431417420506477, -5.38933093707783e-08, -0.01825314201414585, -0.01920635625720024, -0.058562491089105606, 0.013737657107412815, -0.0019927017856389284, -0.016446972265839577, -0.06770063936710358, -0.03550023213028908, -0.023938428610563278, -0.06517859548330307, 0.04688192903995514, -0.03829285502433777, -0.012497320771217346, 0.009869739413261414, 0.011572352610528469, -0.043395936489105225, -0.03530636429786682, -0.019290735945105553, -0.03355642035603523, -0.0008547386387363076, -0.03555072471499443, -0.014989265240728855, 0.0011203918838873506, 0.0030849515460431576, -0.014240878634154797, -0.03412257507443428, 0.03741323947906494, 0.012782864272594452, -0.01554192416369915, 0.05526326969265938, 0.024023866280913353, 0.023095062002539635, 0.05289081856608391, 0.025259094312787056, 0.054117582738399506, 0.03040153905749321, 0.004138632211834192, 0.04238581284880638, 0.0421590618789196, 0.03262188285589218, -0.02763058990240097, 0.05632668733596802, -0.06383399665355682, 0.015143432654440403, 0.00658385967835784, -0.08664907515048981, -0.008132665418088436, 0.006547428667545319, 0.027224784716963768, 0.059491489082574844, 0.05631786212325096, 0.08023026585578918, 0.028131896629929543, 0.003925450146198273, -0.013763822615146637, -0.012169168330729008, -0.042299043387174606, -0.03566479682922363, -0.03639709949493408, 0.009685059078037739, 0.020571278408169746, -0.07974138855934143, 0.0232379287481308, 0.061063945293426514 ] }, { "text": "C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\NNSupportFunctions\\arm_q7_to_q15_reordered_no_shift.c:106:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pDst)++ = in2;\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\NNSupportFunctions\\arm_q7_to_q15_reordered_no_shift.c:107:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pDst)++ = in1;\n ^", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_8", "embedding": [ -0.06748667359352112, 0.0003116193402092904, -0.013580774888396263, -0.08189534395933151, -0.016450025141239166, -0.022495070472359657, 0.021058592945337296, 0.07999442517757416, -0.030564580112695694, 0.02849487215280533, 0.09135553985834122, -0.06118697300553322, -0.06001242622733116, -0.002546456176787615, 0.003863636637106538, 0.0422680489718914, -0.11198896914720535, 0.029605265706777573, 0.004451632499694824, 0.07704335451126099, 0.052204929292201996, -0.005055407993495464, -0.057612452656030655, 0.04096094146370888, -0.013965521939098835, -0.0016094939783215523, -0.004746510647237301, 0.05357668921351433, 0.025336816906929016, -0.0908801332116127, -0.020146427676081657, 0.09161705523729324, 0.018395520746707916, 0.00416058162227273, 0.08830874413251877, 0.05040733888745308, 0.0009070119704119861, -0.08020631968975067, 0.018723201006650925, -0.04832351580262184, 0.06024599075317383, 0.09169398993253708, -0.030358944088220596, 0.0043758549727499485, 0.03282177448272705, -0.003307346487417817, 0.03759139031171799, 0.039507605135440826, -0.04563119634985924, 0.0021606311202049255, -0.07748373597860336, 0.04002957046031952, -0.039456985890865326, 0.03037959523499012, 0.050215888768434525, 0.000765988661441952, -0.05765574425458908, 0.12689357995986938, 0.09289410710334778, 0.02500860206782818, -0.038564350455999374, 0.01162393856793642, -0.0002479083195794374, -0.04328833147883415, -0.07254340499639511, -0.05180259421467781, -0.004802112001925707, -0.001600090297870338, -0.01745501346886158, 0.07777254283428192, -0.08584164083003998, 0.001102991634979844, -0.06100486218929291, 0.09105779975652695, -0.005100716836750507, 0.04876919463276863, -0.03046366013586521, 0.001379724475555122, -0.056588124483823776, -0.16120454668998718, -0.016458487138152122, -0.06793074309825897, -0.04598337411880493, -0.0523795485496521, 0.1253795474767685, 0.041893042623996735, -0.10390196740627289, -0.02678910456597805, 0.05939727649092674, -0.02081373892724514, -0.016136785969138145, -0.10725083947181702, -0.0020551644265651703, -0.018741918727755547, 0.05712272226810455, -0.027163594961166382, 0.047338299453258514, -0.00463634030893445, -0.0014373655430972576, 0.10635080188512802, -0.04256143048405647, -0.021631618961691856, -0.04812723770737648, 0.07830014079809189, 0.025419412180781364, -0.015009596943855286, 0.019439423456788063, -0.019815554842352867, -0.054184671491384506, -0.04660259187221527, -0.03561891242861748, 0.028432296589016914, 0.014834021218121052, -0.09561926126480103, 0.004412556532770395, 0.08656034618616104, -0.04140428081154823, 0.02097589522600174, 0.07720877975225449, -0.04468787461519241, -0.03684984892606735, -0.06689105927944183, -0.03967147693037987, 0.06093081459403038, -0.05392563343048096, -0.021609120070934296, 0.005206947214901447, 5.696790925550359e-33, 0.045172069221735, -0.0674668401479721, -0.029556185007095337, -4.934058495109639e-08, 0.06304290145635605, 0.01654982939362526, 0.025049801915884018, 0.03918993100523949, -0.04807404801249504, -0.05630188807845116, 0.03565074875950813, -0.13178880512714386, 0.06057319790124893, 0.05577053129673004, 0.008128157816827297, -0.022961819544434547, 0.07263962924480438, -0.0006178792682476342, -0.054106321185827255, 0.006469332613050938, 0.09348427504301071, 0.014030084013938904, -0.15027788281440735, 0.003450262127444148, -0.07348742336034775, 0.09917820245027542, -0.020396670326590538, 0.014561295509338379, 0.11202298849821091, 0.0032892448361963034, -0.06632799655199051, 0.031508248299360275, -0.03537004441022873, -0.03294576704502106, 0.03201768919825554, 0.04629256948828697, -0.047130659222602844, 0.006193327251821756, -0.01868908479809761, -0.08721806108951569, -0.02240920439362526, -0.019527148455381393, -0.05337069556117058, -0.050588786602020264, 0.08446618914604187, -0.06981530040502548, -0.03750133886933327, 0.08877068758010864, -0.010783446952700615, 0.002666617976501584, 0.017316266894340515, 0.05914003774523735, 0.05054687336087227, -0.004166425671428442, -0.011731608770787716, -0.0690653845667839, -0.013201150111854076, 0.0570409931242466, 0.013459823094308376, 0.08369287103414536, 0.03162331506609917, 0.0163249671459198, -0.023066578432917595, 0.03923537954688072, -0.01085604727268219, 0.05447349697351456, -0.0704846978187561, -0.011762064881622791, 0.05906828120350838, 0.07203060388565063, -0.026576831936836243, -0.010719355195760727, 0.008744742721319199, 0.07702699303627014, -0.041053082793951035, 0.0010610050521790981, -0.08185996860265732, 0.01368833426386118, -0.029331080615520477, -0.07414248585700989, -0.08290708810091019, 0.07121595740318298, 0.036391910165548325, -0.03700495511293411, -0.04004308208823204, -0.11387493461370468, -0.01186197530478239, -0.06086749583482742, -0.013327635824680328, 0.05950835719704628, 0.010726643726229668, 0.023181496188044548, -0.019722480326890945, 0.09423261135816574, -0.04916007071733475, -6.789073500645876e-33, 0.029952935874462128, 0.10078294575214386, -0.0021669496782124043, -0.010835345834493637, -0.19200703501701355, 0.020495742559432983, 0.04667684808373451, -0.056669317185878754, 0.014520281925797462, -0.0916113629937172, 0.005028120242059231, -0.005087828729301691, 0.022546179592609406, -0.04875294491648674, 0.05027694255113602, 0.02432151697576046, -0.03942035511136055, 0.026759088039398193, -0.03703819587826729, 0.058157242834568024, 0.008409504778683186, 0.03129357472062111, 0.007810841780155897, 0.06482969224452972, -0.0074730729684233665, 0.037919316440820694, 0.0335225909948349, 0.06683237850666046, -0.03941602632403374, 0.00638987822458148, -0.013668867759406567, 0.039263952523469925, -0.11948296427726746, -0.03581595420837402, 0.0625651404261589, -0.03771272301673889, -0.022957846522331238, -0.012611247599124908, -0.020264945924282074, -0.016336921602487564, 0.11044881492853165, 0.021741284057497978, -0.0050624823197722435, 0.05696019157767296, 0.0336202047765255, -0.01822219230234623, 0.024445481598377228, -0.017022602260112762, -0.021512795239686966, -0.03249889984726906, 0.000960140023380518, -0.030229993164539337, 0.030497265979647636, -0.028193457052111626, -0.0331604965031147, 0.014753179624676704, 0.02890624664723873, 0.05800064280629158, 0.02602178044617176, 0.012633681297302246, 0.04801617190241814, -0.060554083436727524, -0.08861786872148514, -0.09956425428390503, 0.04913279414176941, -0.06420868635177612, -0.06903915852308273, -0.02309321239590645, 0.05292429402470589, -0.04356302693486214, 0.0040630619041621685, 0.04039529711008072, -0.009146148338913918, -0.003716349136084318, -0.06272196769714355, -0.025448257103562355, 0.09100797772407532, -0.016583656892180443, 0.013633431866765022, 0.028280984610319138, -0.0073889619670808315, 0.018885234370827675, 0.011355568654835224, 0.0819626972079277, -0.1223716288805008, 0.09851135313510895, -0.015475847758352757, 0.015801625326275826, -0.024837134405970573, 0.0008599870488978922, -0.025680948048830032, 0.015117182396352291, 0.09478412568569183, 0.11353398859500885, -0.03646279498934746, -4.953106369498528e-08, -0.03867923468351364, -0.03927209973335266, -0.03069174662232399, 0.03944731876254082, 0.003538968041539192, -0.026762528344988823, -0.04736962914466858, -0.04508228972554207, -0.014118804596364498, -0.0764995813369751, 0.0145705696195364, -0.0035461965017020702, 0.009702101349830627, -0.023285577073693275, 0.04098699241876602, -0.05724252387881279, -0.034961141645908356, -0.021837495267391205, -0.06209144741296768, 0.0036428221501410007, -0.05050881206989288, 0.002821265021339059, 0.03504662588238716, -0.011906302534043789, -0.011449460871517658, -0.05928906798362732, 0.03955351561307907, 0.04636750370264053, 0.01985136792063713, 0.0678599402308464, 0.01870913803577423, 0.020599786192178726, 0.05156543478369713, 0.05322280526161194, 0.021207192912697792, 0.041522931307554245, -0.0029226376209408045, 0.0575958751142025, 0.021081464365124702, 0.006776867434382439, -0.042566005140542984, 0.057381950318813324, -0.05615190789103508, 0.026796428486704826, -0.0021453630179166794, -0.06259173154830933, 0.005208329763263464, -0.01656033843755722, 0.0024247413966804743, 0.03246864676475525, 0.007905581034719944, 0.08956554532051086, 0.06279249489307404, -0.0006920018931850791, -0.0351620689034462, 0.0021999520249664783, -0.0331081748008728, -0.009293668903410435, -0.059439767152071, 0.012875635176897049, 0.035156358033418655, -0.06529196351766586, 0.018562423065304756, 0.06798261404037476 ] }, { "text": "*__SIMD32(pDst)++ = in1;\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\PoolingFunctions\\arm_pool_q7_HWC.c: In function 'compare_and_replace_if_larger_q7':\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\PoolingFunctions\\arm_pool_q7_HWC.c:78:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pIn)++ = in.word;\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\PoolingFunctions\\arm_pool_q7_HWC.c: In function 'accumulate_q7_to_q15':", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_9", "embedding": [ -0.06670171022415161, 0.029104089364409447, -0.0185836274176836, -0.03267809748649597, 0.02489524707198143, -0.08569815754890442, 0.04831705987453461, 0.09533213824033737, -0.04904530942440033, 0.025873174890875816, 0.07301659137010574, -0.08664184808731079, -0.06169165298342705, -0.0016920057823881507, -0.005352194886654615, 0.048368386924266815, -0.0967244878411293, 0.031092533841729164, -0.014977378770709038, 0.059945158660411835, 0.025057632476091385, -0.008511530235409737, -0.05435144901275635, 0.03948713839054108, 0.00901141669601202, 0.00886579044163227, -0.023046771064400673, 0.042387306690216064, 0.012015963904559612, -0.05050257593393326, -0.015584456734359264, 0.119800865650177, 0.06153825297951698, 0.018261054530739784, 0.15945997834205627, 0.057786669582128525, -0.041037965565919876, -0.10242447257041931, 0.027035467326641083, -0.06425429880619049, 0.037674933671951294, 0.06427174061536789, -0.03352783992886543, 0.02555537037551403, 0.008987006731331348, 0.055631667375564575, 0.04312175512313843, 0.02907666563987732, -0.037443820387125015, 0.014439653605222702, -0.08289410173892975, 0.007068914361298084, -0.036801356822252274, -0.015172407031059265, 0.06472155451774597, -0.028390441089868546, -0.035605646669864655, 0.09061334282159805, 0.06060464307665825, 0.004077401477843523, -0.03047269582748413, -0.005101831164211035, 0.01898978091776371, -0.025553036481142044, -0.07934314012527466, -0.05009325593709946, -0.0015877833357080817, 0.046277325600385666, 0.004277752712368965, 0.017410458996891975, -0.05182212218642235, 0.09324968606233597, -0.053499262779951096, 0.11323513835668564, 0.01872207596898079, 0.01856098137795925, -0.014118358492851257, 0.007905504666268826, -0.05150330439209938, -0.1477908045053482, -0.012612785212695599, -0.10989078879356384, -0.02603832259774208, -0.04046338051557541, 0.13514456152915955, 0.05395728722214699, -0.07580144703388214, -0.05222620815038681, 0.06100287288427353, -0.036864884197711945, -0.03399266302585602, -0.08379876613616943, -0.02618495374917984, -0.04442804679274559, 0.05284034460783005, 0.010327729396522045, -0.01290068868547678, 0.008138488046824932, 0.0009221333311870694, 0.10559175908565521, -0.03636268898844719, -0.03782260790467262, -0.024620985612273216, 0.053639963269233704, 0.04723110422492027, 0.0009017994743771851, 0.035797204822301865, 0.021275710314512253, -0.013686620630323887, -0.06552014499902725, -0.057473693042993546, 0.015795685350894928, 0.04202551394701004, -0.07824933528900146, 0.02627691812813282, 0.03884980455040932, -0.01282002404332161, 0.02564455196261406, 0.05993156135082245, 0.006731556262820959, -0.014787334948778152, -0.03481271490454674, -0.02546466886997223, 0.04370461031794548, -0.034353841096162796, -0.028541823849081993, 0.02142382599413395, 3.942572420485443e-33, 0.04364649951457977, -0.09188486635684967, -0.037460409104824066, -0.02467827871441841, 0.04329643025994301, -0.006223625969141722, 0.04360358789563179, -0.007415615487843752, -0.0715746283531189, -0.04493441805243492, -0.019899101927876472, -0.12413271516561508, 0.036130618304014206, 0.033421121537685394, -0.01626109890639782, -0.013856662437319756, 0.03046766296029091, -0.025312382727861404, -0.05102187395095825, 0.026028333231806755, 0.10817106813192368, -0.005992976948618889, -0.15578939020633698, 0.030098406597971916, -0.08282075822353363, 0.074105404317379, 0.004978317767381668, -0.007496124133467674, 0.11479268968105316, 0.004563078749924898, -0.04463443532586098, 0.013728272169828415, -0.07375665009021759, 0.021280886605381966, 0.013816539198160172, 0.03145173564553261, -0.027637150138616562, 0.0017646594205871224, -0.05353553965687752, -0.0845072790980339, -0.06137748807668686, -0.012624538503587246, -0.027853040024638176, -0.06172328069806099, 0.07515442371368408, -0.0825006365776062, -0.019409945234656334, 0.07481300830841064, -0.015394756570458412, 0.02301676571369171, 0.016974791884422302, 0.03732219710946083, 0.04177194461226463, -0.0057883658446371555, -0.014097397215664387, -0.05477052554488182, -0.011195184662938118, 0.06879884004592896, 0.030234605073928833, 0.0861453115940094, 0.05125300958752632, 0.002842681249603629, -0.05659419298171997, 0.029461614787578583, 0.026750341057777405, 0.05008653551340103, -0.016443124040961266, 0.0014831945300102234, 0.026210619136691093, 0.07014765590429306, -0.037495482712984085, -0.04180125519633293, -0.007561234291642904, 0.06110719218850136, -0.0410456508398056, -0.03668161481618881, -0.07071075588464737, 0.03382967412471771, -0.07226942479610443, -0.07988598197698593, -0.10132839530706406, 0.06135231629014015, 0.02191263437271118, -0.056237395852804184, -0.06567136943340302, -0.09088332951068878, 0.018721425905823708, -0.1079651489853859, -0.032599352300167084, 0.04773862287402153, 0.027376191690564156, 0.016351183876395226, -0.05548853427171707, 0.03773399069905281, -0.046954672783613205, -5.650556528680611e-33, 0.039339132606983185, 0.0805433914065361, 0.033311374485492706, -0.003878350369632244, -0.19336603581905365, 0.03422056511044502, 0.05705161392688751, -0.040219713002443314, 0.012053792364895344, -0.10716603696346283, 0.0002671734255272895, 0.0035609311889857054, 0.015213393606245518, -0.0761798620223999, 0.037594571709632874, 0.0687081441283226, -0.05664145201444626, 0.02078399434685707, -0.018715521320700645, 0.09060325473546982, -0.011544137261807919, 0.09531447291374207, 0.0664387196302414, 0.06013289839029312, -0.03484196588397026, 0.011919853277504444, 0.02972756139934063, 0.03621143847703934, -0.015466434881091118, -0.012060648761689663, -0.022942444309592247, 0.07670708745718002, -0.15915437042713165, 0.0075903767719864845, 0.02288772538304329, -0.05139283463358879, 0.0367879793047905, -0.016672609373927116, -0.018628912046551704, -0.029130028560757637, 0.07802022248506546, 0.0024120714515447617, -0.030886119231581688, -0.006145953666418791, 0.010514948517084122, 0.0342736579477787, 0.0016981613589450717, -0.01160349976271391, -0.016866372898221016, -0.028474636375904083, 0.0007785282214172184, -0.029996898025274277, 0.026781195774674416, -0.01134958490729332, -0.028744639828801155, -0.007480090484023094, 0.05437386408448219, 0.030268318951129913, -0.0024868352338671684, 0.0025519677437841892, 0.039121344685554504, -0.06372547149658203, -0.09760288149118423, -0.06938279420137405, 0.03407284617424011, -0.03175459802150726, -0.08901583403348923, 0.027196671813726425, 0.08155088126659393, -0.03253970295190811, -0.02742808870971203, 0.06802065670490265, -0.021692877635359764, -0.015073191374540329, -0.07517148554325104, -0.0173797644674778, 0.05662468820810318, -0.01809990033507347, 0.030933372676372528, 0.06904586404561996, -0.042148392647504807, 0.07146338373422623, 0.003510465146973729, 0.05602404475212097, -0.11448923498392105, 0.050003185868263245, -0.012012683786451817, 0.021887831389904022, -0.023728201165795326, -0.0032823437359184027, -0.0376509428024292, 0.003629453480243683, 0.09051008522510529, 0.10082738101482391, -0.03602016344666481, -5.313728479450219e-08, -0.03303104639053345, -0.02431878075003624, -0.06188861280679703, 0.019748805090785027, 0.024484869092702866, -0.022023342549800873, -0.08264511078596115, -0.006273225415498018, -0.01742284931242466, -0.04944108426570892, 0.05009976401925087, 0.0028798021376132965, 0.00041052306187339127, -0.02278784289956093, 0.014340512454509735, -0.062014397233724594, -0.04717264696955681, -0.01693015918135643, -0.026399245485663414, 0.024902265518903732, 0.017041128128767014, -0.007164514157921076, -0.017979249358177185, 0.02694525197148323, 0.019320713356137276, -0.041229840368032455, 0.028013689443469048, 0.008563009090721607, -0.018453281372785568, 0.03640802204608917, 0.03212089464068413, 0.009448828175663948, 0.05357213690876961, 0.008614994585514069, 0.045207664370536804, 0.05541786178946495, 0.01906108856201172, 0.06000850722193718, 0.00729410070925951, 0.04581473022699356, -0.036188703030347824, 0.07960943877696991, -0.054408490657806396, 0.009495827369391918, 0.018150391057133675, -0.0892811194062233, 0.03736965358257294, -0.009957578033208847, 0.023791274055838585, 0.014010816812515259, 0.04912116006016731, 0.09669479727745056, 0.03615951910614967, 0.013968711718916893, -0.025024281814694405, 0.00691491924226284, 0.003003682941198349, 0.006166425533592701, -0.05292215943336487, 0.028909733518958092, 0.045656636357307434, -0.060408808290958405, 0.035223085433244705, 0.04426029324531555 ] }, { "text": "C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\PoolingFunctions\\arm_pool_q7_HWC.c:122:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pCnt)++ = __QADD16(vo1, in);\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\PoolingFunctions\\arm_pool_q7_HWC.c:125:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pCnt)++ = __QADD16(vo2, in);\n ^", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_10", "embedding": [ -0.07544155418872833, 0.020021511241793633, -0.015294579789042473, -0.0670085921883583, -0.02283049002289772, -0.06266679614782333, 0.041837070137262344, 0.07961006462574005, -0.03175181895494461, -0.027304602786898613, 0.06342709809541702, -0.10083972662687302, -0.09526145458221436, 0.027431976050138474, -0.002269274555146694, 0.040223073214292526, -0.08268529176712036, 0.027656950056552887, 0.00983017310500145, 0.0780055895447731, 0.04869009181857109, 0.01479986123740673, -0.030013281852006912, 0.013922768644988537, 0.005962810013443232, 0.021443424746394157, -0.0020910960156470537, 0.05550696328282356, 0.05415119603276253, -0.07713984698057175, 0.008902940899133682, 0.10950054228305817, 0.025555970147252083, -0.0022075516171753407, 0.10881350189447403, 0.06091639772057533, -0.028197964653372765, -0.07758349925279617, 0.010031923651695251, -0.02794012241065502, 0.08572208136320114, 0.10855486243963242, -0.033952388912439346, 0.02744242735207081, 0.010515737347304821, 0.02267562225461006, 0.060712434351444244, 0.04396522045135498, -0.04754439741373062, 0.006416342221200466, -0.037256889045238495, 0.009421540424227715, -0.0037858823779970407, -0.00818899180740118, 0.065378338098526, -0.017833560705184937, -0.06688103079795837, 0.11600606888532639, 0.08725403249263763, 0.040751125663518906, -0.056672874838113785, -0.020343374460935593, 0.015413215383887291, -0.039573151618242264, -0.07502991706132889, -0.09066759794950485, 0.024858051910996437, 0.04535083472728729, -0.01858033984899521, 0.03096676990389824, -0.047695815563201904, 0.06357906013727188, -0.07647911459207535, 0.08174777030944824, 0.006883644964545965, 0.07007597386837006, -0.025208791717886925, -0.004132491070777178, -0.04044903814792633, -0.16685417294502258, 0.004974778275936842, -0.09519325196743011, -0.03083939664065838, -0.05506676062941551, 0.12435219436883926, 0.06651287525892258, -0.10181770473718643, -0.050902679562568665, 0.04361222684383392, -0.029090426862239838, 0.0024105599150061607, -0.05824214220046997, -0.04616543650627136, -0.03059389255940914, 0.06227787211537361, -0.014737178571522236, 0.03782777488231659, -0.00824633426964283, -0.009843304753303528, 0.11085055768489838, -0.033551182597875595, -0.016355663537979126, -0.033212270587682724, 0.09974438697099686, 0.05385774374008179, -0.0038583148270845413, 0.044935911893844604, 0.04200362041592598, -0.06148789823055267, -0.05659925937652588, -0.049640070647001266, 0.0009388342732563615, 0.04684356600046158, -0.08076437562704086, 0.012067585252225399, 0.07984892278909683, -0.03313586115837097, 0.02236625924706459, 0.07014177739620209, -0.005304077174514532, -0.05686856433749199, -0.04995542764663696, -0.04685821756720543, 0.04525843262672424, -0.00012633594451472163, -0.01235781330615282, -0.030315734446048737, 4.639408777730757e-33, 0.06425768882036209, -0.05463165044784546, -0.03139709681272507, -0.008672025054693222, 0.018319809809327126, -0.01869615539908409, 0.034805718809366226, 0.005543700885027647, -0.042865391820669174, -0.058901239186525345, 0.019923705607652664, -0.14901213347911835, 0.034454502165317535, 0.03331473842263222, -0.0029217973351478577, -0.0024226245004683733, 0.0398644395172596, -0.029756737872958183, -0.05700404942035675, 0.03890067711472511, 0.11770875006914139, 0.03746603801846504, -0.1274414360523224, 0.017267657443881035, -0.09914743155241013, 0.05982547253370285, 0.028392096981406212, 0.006254879292100668, 0.1115717738866806, 0.018492573872208595, -0.05784977227449417, 0.030376186594367027, -0.015679091215133667, -0.042158760130405426, 0.015310247428715229, 0.06752288341522217, -0.052543755620718, 0.009273543953895569, -0.030592435970902443, -0.07301684468984604, -0.03982602432370186, -0.009481222368776798, -0.042042624205350876, -0.04560396075248718, 0.05613846331834793, -0.08764567226171494, -0.004400367382913828, 0.06414782255887985, -0.01764511689543724, 0.03492123633623123, -0.007775565143674612, 0.03165822476148605, 0.038848068565130234, -0.012765911407768726, 0.006685011088848114, -0.05233948677778244, -0.0018097774591296911, 0.04478028416633606, 0.011442993767559528, 0.07628972828388214, 0.05844923108816147, 0.030237093567848206, -0.07874329388141632, 0.027025969699025154, -0.02963896468281746, 0.054877664893865585, -0.05121324211359024, -0.047453559935092926, 0.03705499693751335, 0.04880061745643616, -0.01864033378660679, -0.027518395334482193, -0.030122457072138786, 0.06676362454891205, -0.04110831022262573, -0.0033869852777570486, -0.07414083927869797, 0.03225753828883171, -0.031394414603710175, -0.0480625182390213, -0.0761716440320015, 0.07818260043859482, 0.01619645580649376, -0.03022390976548195, -0.06319255381822586, -0.11714731156826019, 0.0229827668517828, -0.09805598109960556, -0.011098205111920834, 0.05162598937749863, 0.04361796751618385, 0.017937641590833664, -0.01754124090075493, 0.04274476319551468, -0.06830854713916779, -5.846010749837633e-33, 0.00922760833054781, 0.09214965999126434, -0.009892023168504238, 0.004060364328324795, -0.1912207454442978, 0.04729953035712242, 0.05957312509417534, -0.0747920423746109, -0.001498286030255258, -0.1125299483537674, -0.015138247981667519, 0.041862852871418, 0.002446010010316968, -0.06876928359270096, 0.045000169426202774, 0.013330098241567612, -0.020683644339442253, -0.0005939013208262622, -0.014175261370837688, 0.06379416584968567, -0.0052891019731760025, 0.035663872957229614, 0.06482598930597305, 0.06277575343847275, -0.014660347253084183, 0.017415078356862068, 0.03186015039682388, 0.004751018714159727, -0.012711013667285442, 0.003081879811361432, -0.03436785191297531, 0.01976565644145012, -0.109527088701725, -0.03954631835222244, 0.017806531861424446, -0.04288516566157341, 0.018418528139591217, -0.007350095082074404, -0.013600777834653854, -0.05468461290001869, 0.08107849955558777, -0.007517754565924406, -0.014446023851633072, 0.04424859210848808, 0.005609756801277399, 0.0012848774204030633, 0.01761811040341854, -0.038618218153715134, -0.024348778650164604, -0.03442247956991196, -0.021936848759651184, -0.01416492648422718, 0.029464321210980415, -0.0012265827972441912, -0.0012246633414179087, -0.017055928707122803, 0.0689258873462677, 0.053535979241132736, 0.028025075793266296, 0.02551998198032379, 0.048764511942863464, -0.057053640484809875, -0.11941898614168167, -0.11291425675153732, 0.03964480757713318, -0.047354526817798615, -0.07332070916891098, -0.00017198827117681503, 0.09017722308635712, -0.039522163569927216, -0.030207626521587372, 0.07708931714296341, -0.013671999797224998, -0.020108742639422417, -0.0651412084698677, -0.009721842594444752, 0.06734016537666321, 0.0033593247644603252, 0.019804656505584717, 0.028306864202022552, -0.0226161926984787, 0.07683052867650986, -0.023968538269400597, 0.06399302929639816, -0.0731537938117981, 0.03614416345953941, 0.0053447154350578785, 0.0034786288160830736, -0.031035976484417915, -0.012338582426309586, -0.013393310829997063, -0.007562742102891207, 0.05779749155044556, 0.14990898966789246, -0.0475628636777401, -4.8917797812464414e-08, -0.03448595106601715, -0.023714236915111542, -0.03901323303580284, 0.01779647171497345, 0.00456544104963541, -0.0656561404466629, -0.04285667464137077, -0.03615470230579376, 0.002770757768303156, -0.03204459324479103, 0.026852410286664963, -0.0013324066530913115, 0.038389261811971664, -0.05045827105641365, 0.07996167242527008, -0.046268582344055176, -0.03537819907069206, -0.0025540306232869625, -0.05703414976596832, 0.011268315836787224, -0.03793306648731232, -0.006303349044173956, -0.027568725869059563, 0.01037160400301218, -0.00919180829077959, -0.0599282905459404, 0.03335908427834511, -0.01662146858870983, 0.015551487915217876, 0.042488083243370056, 0.01395324058830738, 0.01934799738228321, 0.04202227294445038, 0.025966843590140343, 0.04239869862794876, 0.04545082151889801, -0.024990646168589592, 0.048991359770298004, 0.021940309554338455, 0.054382022470235825, -0.06365018337965012, 0.07837621867656708, -0.03508353978395462, 0.009732157923281193, 0.04210566729307175, -0.037424925714731216, 0.00802317913621664, -0.011314625851809978, -0.004168972838670015, 0.024620041251182556, 0.04226776584982872, 0.09926734119653702, 0.03600809723138809, 0.023637758567929268, -0.01637706533074379, 0.005254755727946758, -0.022143568843603134, -0.03681471198797226, -0.05807659775018692, 0.0019134695176035166, 0.039854370057582855, -0.06914545595645905, 0.008551373146474361, 0.061138950288295746 ] }, { "text": "*__SIMD32(pCnt)++ = __QADD16(vo2, in);\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\dsp\\image\\processing.cpp: In function 'int ei::image::processing::yuv422_to_rgb888(unsigned char*, const unsigned char*, unsigned int, ei::image::processing::YUV_OPTIONS)':\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\dsp\\image\\processing.cpp:73:32: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]\n for (unsigned int i = 0; i < in_size_pixels; ++i) {\n ~~^~~~~~~~~~~~~~~~", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_11", "embedding": [ -0.041728198528289795, 0.05840780958533287, -0.02750716358423233, -0.07392667979001999, 0.08394170552492142, -0.10067538172006607, 0.017344996333122253, 0.09523995965719223, -0.009209942072629929, -0.04140298068523407, -0.002293769968673587, -0.08952018618583679, -0.017557786777615547, 0.0019203381380066276, -0.011037429794669151, 0.0038907048292458057, -0.06462952494621277, 0.047240450978279114, -0.05617865175008774, 0.010802705772221088, 0.0032613324001431465, -0.07719844579696655, -0.0628189817070961, -0.00696434685960412, 0.004472194705158472, 0.02348186820745468, 0.03853217139840126, 0.06468307971954346, 0.06283609569072723, -0.011298704892396927, 0.05387227609753609, 0.04888961836695671, 0.10363832861185074, -0.023624727502465248, 0.08978372067213058, 0.08732258528470993, 0.024474406614899635, -0.15379811823368073, -0.021890511736273766, -0.06208432465791702, -0.009068167768418789, 0.04704560711979866, -0.04350392892956734, -0.002595060970634222, 0.05421437695622444, 0.0898560956120491, 0.03703226149082184, 0.034087520092725754, -0.08663783967494965, -0.04789445921778679, -0.016174111515283585, 0.058744240552186966, -0.04264925792813301, -0.021828602999448776, 0.008184697479009628, 0.0019696205854415894, -0.014675493352115154, 0.003056177869439125, 0.047139957547187805, -0.0029757702723145485, -0.004576907493174076, -0.027804246172308922, -0.01839771866798401, -0.013949461281299591, -0.09282666444778442, -0.01849994622170925, 0.05707234889268875, -0.07970323413610458, 0.016660990193486214, 0.04039783030748367, -0.05211511626839638, 0.05525396019220352, -0.03768765553832054, 0.11436659842729568, -0.004900737665593624, -0.019795672968029976, 0.02080554887652397, 0.03280872479081154, -0.03644097223877907, -0.1480351984500885, 0.01069686096161604, -0.08195217698812485, -0.05088133364915848, -0.06106598675251007, 0.09923020005226135, 0.062322989106178284, -0.05921124294400215, 0.04565878584980965, 0.0635329931974411, -0.00708693265914917, -0.012266173027455807, 0.0037643350660800934, -0.09136460721492767, 0.007289705332368612, 0.11663605272769928, -0.004836795385926962, 0.03872106969356537, -0.011138581670820713, -0.00251191109418869, 0.05375220254063606, -0.05682961642742157, -0.08154116570949554, -0.06456971913576126, 0.043240614235401154, 0.06045336276292801, -0.005589582491666079, 0.04409110173583031, -0.0014121283311396837, -0.012380595318973064, -0.035759322345256805, -0.05896048620343208, 0.01210691500455141, 0.027594199404120445, -0.0015581350307911634, 0.060019414871931076, 0.02516074851155281, -0.05117029696702957, 0.06925630569458008, 0.07152742892503738, -0.04716039448976517, -0.033359963446855545, -0.04703894257545471, -0.08082296699285507, 0.023465951904654503, -0.05640951544046402, -0.10850994288921356, -0.03020242229104042, 3.963942907783392e-33, 0.021386032924056053, 0.011248183436691761, -0.025583025068044662, -0.03341289237141609, -0.014743410050868988, 0.049042366445064545, 0.010134328156709671, -0.05905243381857872, -0.01325485110282898, 0.01730457879602909, -0.06926928460597992, -0.0855761393904686, -0.013291609473526478, 0.0467047393321991, 0.05169638618826866, 0.01654278114438057, 0.03789085894823074, -0.04798536002635956, -0.05202172324061394, 0.006127797532826662, 0.10086944699287415, 0.021815897896885872, -0.08460686355829239, 0.06720796227455139, -0.05908835679292679, 0.04691202566027641, 0.033537235110998154, -0.041311126202344894, 0.12171010673046112, -0.014116846024990082, -0.024282855913043022, -0.014167826622724533, -0.01407129317522049, 0.007570190355181694, 0.02683914639055729, -0.01339783240109682, -0.028417538851499557, 0.033213045448064804, -0.06177402660250664, -0.03112555295228958, 0.0027060112915933132, 0.06874308735132217, -0.02790248580276966, -0.057846102863550186, 0.03237226977944374, -0.05754387378692627, 0.00860228855162859, 0.04495692625641823, 0.01936710998415947, 0.05719660967588425, 0.005518975201994181, 0.042994916439056396, 0.027285952121019363, -0.0492108054459095, 0.002553800120949745, -0.13851065933704376, 0.04601005092263222, 0.06531745195388794, -0.03298775479197502, 0.03836675360798836, 0.029760830104351044, 0.02431117370724678, 0.037871554493904114, -0.027055419981479645, -0.03159612789750099, 0.03144548088312149, -0.05347397178411484, -0.019372904673218727, -0.028687693178653717, 0.04036390781402588, -0.07114090025424957, 0.01555191446095705, -0.027783649042248726, -0.022964907810091972, 0.0077324421145021915, -0.07451491057872772, -0.06424295902252197, -0.010799024254083633, -0.00046580712660215795, -0.04224836453795433, -0.1312975436449051, 0.11990918964147568, 0.020969582721590996, -0.07818526774644852, -0.044695645570755005, -0.08599554002285004, -0.0374954491853714, -0.02804490178823471, -0.04187744855880737, 0.05206634849309921, -0.006108976434916258, -0.023032980039715767, 0.00923335924744606, 0.06003647297620773, -0.06487419456243515, -5.516485520497575e-33, 0.0025568290147930384, 0.07620728015899658, 0.045355185866355896, 0.06904115527868271, -0.14112699031829834, 0.014927983283996582, 0.050669025629758835, -0.08046827465295792, 0.09070061892271042, -0.09514729678630829, 0.0413600392639637, -0.012306028977036476, 0.0019451312255114317, 0.012571892701089382, 0.06210793927311897, -0.022506743669509888, -0.09039261192083359, 0.0074601792730391026, -0.03450096771121025, 0.02228432334959507, -0.055249281227588654, 0.0767972394824028, 0.12073039263486862, 0.04332439973950386, -0.02132415398955345, 0.06957174092531204, 0.08027328550815582, 0.04278254881501198, 0.009449949488043785, -0.08925407379865646, 0.022850004956126213, 0.0659666657447815, -0.12377580255270004, 0.042395781725645065, 0.02000977285206318, -0.05763639882206917, 0.06455335021018982, -0.03161812946200371, -0.027798427268862724, 0.01716601848602295, 0.06935235112905502, 0.01707017794251442, 0.0063669029623270035, 0.03315085172653198, -0.011303643696010113, 0.03131396323442459, 0.031164880841970444, 0.010210768319666386, -0.019603142514824867, -0.041763223707675934, 0.01685161143541336, 0.01490025408565998, -0.05205061659216881, 0.014961762353777885, 0.04212202876806259, 0.007562259677797556, -0.04399176687002182, 0.068216972053051, 0.06242765113711357, 0.022507313638925552, 0.011467105709016323, -0.05522992089390755, -0.06123200058937073, -0.03383319079875946, 0.005425947718322277, 0.07472025603055954, -0.022073207423090935, 0.01990491896867752, 0.03410562127828598, 0.06845751404762268, 0.014081078581511974, 0.019938858225941658, -0.012684189714491367, 0.04419885575771332, -0.05375516787171364, -0.054023634642362595, 0.045305438339710236, 0.03179974853992462, 0.06719812750816345, 0.02673300914466381, -0.06797997653484344, 0.04972531646490097, 0.05209515243768692, 0.044425759464502335, -0.07831710577011108, 0.032926056534051895, -0.05087057501077652, -0.02826087176799774, 0.017070649191737175, -0.008181986398994923, 0.020665546879172325, 0.03763312101364136, 0.06817400455474854, 0.06822165101766586, 0.029861759394407272, -5.353913223871132e-08, -0.007449781056493521, -0.06619415432214737, -0.05677254870533943, -0.0831407830119133, 0.019485358148813248, -0.05872734636068344, -0.024791616946458817, -0.04197659343481064, 0.026167575269937515, -0.08061409741640091, 0.07472775131464005, -0.041191376745700836, 0.009321395307779312, -0.07654036581516266, 0.02613653987646103, -0.03219180926680565, -0.04131245240569115, -0.051889244467020035, 0.006827710196375847, 0.01905067265033722, 0.02891109697520733, -0.03035755828022957, -0.028216322883963585, -0.01499931700527668, -0.018097825348377228, -0.025094958022236824, -0.01142856851220131, 0.029049204662442207, 0.011519362218677998, 0.0119748180732131, 0.07867177575826645, 0.036003511399030685, 0.10734504461288452, -0.00537103321403265, 0.021874694153666496, 0.010864482261240482, 0.028614692389965057, 0.0862957239151001, 0.02001633122563362, -0.010220971889793873, -0.05612195283174515, 0.0355253741145134, -0.04915740340948105, -0.025000492110848427, 0.042646050453186035, -0.03341173753142357, 0.0738290324807167, 0.012598088942468166, -0.02951350249350071, 0.019334929063916206, -0.009918106719851494, 0.06765814870595932, 0.008350171148777008, 0.03809463977813721, 0.002220106078311801, -0.0876760482788086, -0.046904683113098145, -0.06383342295885086, 0.03774822875857353, 0.04131684824824333, 0.031447429209947586, -0.11174480617046356, -0.03885205462574959, -0.008882640860974789 ] }, { "text": "for (unsigned int i = 0; i < in_size_pixels; ++i) {\n ~~^~~~~~~~~~~~~~~~\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\tensorflow\\lite\\core\\api\\op_resolver.cpp: In function 'TfLiteStatus tflite::GetRegistrationFromOpCode(const tflite::OperatorCode*, const tflite::OpResolver&, tflite::ErrorReporter*, const TfLiteRegistration**)':\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\tensorflow\\lite\\core\\api\\op_resolver.cpp:34:20: warning: comparison is always false due to limited range of data type [-Wtype-limits]\n builtin_code < BuiltinOperator_MIN) {\n ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_12", "embedding": [ -0.0215819850564003, -0.020481860265135765, -0.05263853073120117, -0.012049390934407711, 0.018951810896396637, -0.10612445324659348, 0.03617282584309578, 0.08187692612409592, -0.051561787724494934, -0.032082002609968185, 0.024120530113577843, -0.09788087010383606, -0.0705161839723587, -0.013832038268446922, -0.056367360055446625, 1.7473417756264098e-05, -0.012308696284890175, -0.024487312883138657, -0.011454535648226738, -0.022415054962038994, 0.03283237665891647, 0.00937110185623169, -0.0496998205780983, 0.03823386877775192, -0.02330709435045719, 0.02256183512508869, -0.03318262845277786, -0.0015695608453825116, 0.044484980404376984, 0.020269351080060005, 0.055205851793289185, 0.08043370395898819, 0.028320031240582466, 0.03758587688207626, 0.08973505347967148, 0.09044073522090912, -0.06515494734048843, -0.08851809799671173, -0.019962264224886894, -0.05962873250246048, 0.06102998927235603, 0.04112444818019867, -0.017385000362992287, -0.0350782573223114, 0.036977991461753845, 0.04344950243830681, 0.10971373319625854, -0.03820795193314552, -0.0537022165954113, -0.022269459441304207, -0.0735481008887291, 0.0856972485780716, -0.0085498271510005, -0.04180007800459862, 0.0075730811804533005, -0.014000331982970238, 0.004381109960377216, 0.03944075107574463, 0.015474862419068813, 0.0006515068234875798, -0.024064380675554276, -0.04288960620760918, -0.0367991179227829, -0.05018521472811699, -0.030001478269696236, 0.030684472993016243, -0.019904861226677895, -0.046774789690971375, -0.02291136048734188, 0.018625374883413315, -0.026476362720131874, 0.08640307188034058, -0.030970070511102676, 0.12245728820562363, 0.015862906351685524, 0.023790549486875534, 0.02856045588850975, -0.017749061807990074, -0.006408297456800938, -0.1119384914636612, 0.0261052418500185, -0.09004277735948563, -0.016494087874889374, -0.011517981998622417, 0.054618217051029205, 0.02873058244585991, -0.032099947333335876, 0.09116996824741364, 0.07568524777889252, -0.0036547640338540077, 0.0035351202823221684, 0.004389915149658918, -0.12915225327014923, 0.053394440561532974, 0.1008530780673027, 0.016166239976882935, 0.0012289657024666667, 0.03832874447107315, -0.04946145787835121, 0.061881016939878464, -0.0467788502573967, -0.101000115275383, -0.024068571627140045, 0.09620863199234009, -0.00880385097116232, -0.018086832016706467, 0.04201337322592735, -0.04128678888082504, -0.04389694333076477, -0.004535631276667118, -0.021913377568125725, 0.050095777958631516, 0.06476029008626938, -0.059010691940784454, 0.09559793025255203, 0.036684952676296234, -0.08523441851139069, 0.05906281992793083, 0.09906356781721115, -0.006980764679610729, -0.015841132029891014, -0.000611283874604851, -0.03821992501616478, 0.06991678476333618, 0.01696556620299816, -0.07361708581447601, -0.007018033880740404, 7.175470983388639e-33, 0.042275991290807724, -0.020692259073257446, -0.006886819377541542, 0.026243124157190323, -0.0042131030932068825, 0.05474615842103958, 0.07191864401102066, -0.00791735015809536, -0.05766785889863968, 0.01346278004348278, -0.08090125024318695, -0.05542859807610512, -0.043853629380464554, 0.04151512309908867, -0.0065492321737110615, -0.06407836079597473, 0.060540493577718735, 0.02918252721428871, -0.04571693390607834, 0.058968834578990936, 0.10996560007333755, -0.0005889051244594157, -0.1308664083480835, 0.052566710859537125, -0.09226983785629272, 0.047919780015945435, -0.0005824296385981143, -0.023035407066345215, 0.01767377182841301, 0.008859886787831783, -0.05511929467320442, 0.007793996017426252, -0.008458415977656841, 0.008373407647013664, 0.06652925908565521, -0.016983309760689735, -0.02140291966497898, 0.04227643460035324, -0.12639538943767548, -0.07142692059278488, -0.0014329706318676472, 0.050519831478595734, -0.0344478078186512, -0.021901845932006836, 0.004270854871720076, -0.11343809962272644, -0.0057964688166975975, 0.029644548892974854, -0.008703205734491348, 0.03236677497625351, 0.04418034851551056, 0.019158028066158295, -0.05307558923959732, -0.10450105369091034, 0.0384472981095314, -0.09320997446775436, 0.002759322291240096, 0.055058784782886505, 0.0824899971485138, 0.04039542004466057, -0.010829208418726921, -0.042694080621004105, -0.053523775190114975, -0.009695655666291714, 0.034187689423561096, 0.06060412898659706, -0.04157571867108345, 0.001134667661972344, 0.031517770141363144, 0.049261949956417084, -0.0395771749317646, 0.005632219836115837, 0.016817960888147354, 0.000992043875157833, 0.0024991307873278856, -0.01282689068466425, -0.012271937914192677, -0.01808893121778965, -0.09400799870491028, -0.10385473817586899, -0.11109387874603271, 0.012174418196082115, 0.06494241207838058, -0.02992234379053116, -0.04763028770685196, -0.034069012850522995, -0.021123550832271576, -0.008812615647912025, -0.027968253940343857, 0.0037106170784682035, -0.06589449197053909, 0.004280052147805691, -0.05358795449137688, -0.010632099583745003, -0.08749476820230484, -7.613779031347684e-33, 0.038130953907966614, 0.014181923121213913, 0.0005122675793245435, 0.004772900603711605, -0.1217070072889328, 0.043395571410655975, 0.05011989176273346, -0.014553540386259556, 0.061729226261377335, -0.0869988352060318, 0.02316841296851635, -0.05850617587566376, 0.06295216083526611, -0.11519386619329453, 0.04508330672979355, -0.03365069627761841, -0.07138057053089142, -0.02083396725356579, -0.020879823714494705, 0.0005915126530453563, -0.10578928887844086, 0.077532097697258, 0.06062605604529381, 0.05156216025352478, -0.07297161966562271, 0.06032319739460945, 0.011640237644314766, 0.08443550020456314, 0.03615756332874298, -0.062403324991464615, -0.005576703697443008, 0.006303233560174704, -0.1266590654850006, 0.04875155910849571, 0.050481706857681274, 0.04742744565010071, 0.02273840457201004, 0.007573880720883608, -0.020260833203792572, 0.05166735500097275, 0.0865185558795929, 0.038674063980579376, -0.022339770570397377, 0.022083833813667297, -0.03315483406186104, -0.018677979707717896, 0.02784144878387451, -0.01920698955655098, 0.03048255480825901, -0.07714510709047318, 0.01436267513781786, -0.038022805005311966, -0.013382230885326862, -0.02148585021495819, 0.0505124069750309, 0.03445415198802948, 0.045133236795663834, -0.033844105899333954, 0.046658482402563095, -0.025675121694803238, 0.008826536126434803, -0.08698267489671707, -0.03838719427585602, -0.01094968244433403, 0.06036505103111267, 0.0653759241104126, -0.09447522461414337, 0.02387535199522972, 0.023436594754457474, 0.11251235753297806, 0.021948279812932014, 0.02405599132180214, -0.012236692011356354, 0.0042494903318583965, -0.014822505414485931, -0.012019447982311249, -0.018896445631980896, 0.02235174924135208, 0.04366226866841316, 0.05827620252966881, -0.05733783170580864, 0.06640588492155075, 0.05792389065027237, 0.04639740660786629, -0.01721443422138691, 0.0115463612601161, -0.040431149303913116, 0.012831886298954487, 0.03668082132935524, 0.00451792124658823, -0.010316981934010983, 0.04111195355653763, 0.038714997470378876, 0.03644176945090294, 0.05132931470870972, -6.154192533358582e-08, -0.1083257794380188, 0.00046399104758165777, -0.05556038022041321, 0.02650729939341545, 0.06610175967216492, -0.014403695240616798, 0.04364975541830063, -0.006926259957253933, 0.042393021285533905, -0.06598778814077377, 0.03455880656838417, -0.10168864578008652, -0.010854830965399742, -0.023059533908963203, 0.07755865901708603, -0.07381085306406021, -0.07042408734560013, -0.07816257327795029, -0.020842958241701126, -0.000814917148090899, -0.011954497545957565, -0.0501275435090065, -0.01698673702776432, -0.04986027628183365, 0.00380155211314559, -0.06989617645740509, 0.03732728585600853, 0.014993586577475071, 0.02330704592168331, 0.07645206898450851, -0.03815807029604912, -0.019084975123405457, 0.09010037034749985, -0.004725828766822815, 0.008102734573185444, 0.08629126846790314, -0.008287600241601467, 0.04505399987101555, -0.030955610796809196, 0.008774230256676674, -0.06319626420736313, 0.11026301234960556, -0.02328530140221119, -0.010987434536218643, 0.018819842487573624, -0.0017679788870736957, 0.01539069227874279, 0.03827231004834175, 0.029923565685749054, 0.04560401663184166, -0.01634148508310318, 0.13736562430858612, -0.04287322983145714, 0.11060073226690292, -0.020277276635169983, -0.05309784412384033, -0.026169409975409508, -0.05232629179954529, -0.012727753259241581, 0.012429856695234776, 0.01682504639029503, -0.06929302215576172, -0.041000764816999435, -0.0003695122723001987 ] }, { "text": "builtin_code < BuiltinOperator_MIN) {\n ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~\n \n Sketch uses 153392 bytes (15%) of program storage space. Maximum is 983040 bytes.\n Global variables use 48248 bytes (18%) of dynamic memory, leaving 213896 bytes for local variables. Maximum is 262144 bytes.\n Device : nRF52840-QIAA\n Version : Arduino Bootloader (SAM-BA extended) 2.0 [Arduino:IKXYZ]\n Address : 0x0\n Pages : 256\n Page Size : 4096 bytes\n Total Size : 1024KB\n Planes : 1\n Lock Regions : 0\n Locked : none\n Security : false\n Erase flash\n \n Done in 0.000 seconds\n Write 153400 bytes to flash (38 pages)\n [==============================] 100% (38/38 pages)\n Done in 6.438 seconds`\n`", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_13", "embedding": [ -0.04019731283187866, -0.0038005004171282053, -0.11620338261127472, 0.018131326884031296, -0.05554799735546112, -0.053872473537921906, -0.021758267655968666, 0.07994239777326584, -0.04574126750230789, 0.02170332334935665, 0.003501852974295616, 0.0008675925200805068, 0.02466793917119503, -0.007052886299788952, -0.031972356140613556, 0.020572518929839134, -0.006451512686908245, -0.0945146307349205, -0.028785135596990585, 0.01729043573141098, 0.09472836554050446, -0.1094265803694725, -0.0028137709014117718, -0.1156131774187088, 0.03606607764959335, 0.04474254325032234, 0.014173871837556362, 0.011742689646780491, 0.013024143874645233, -0.12023013830184937, 0.11189109086990356, 0.0714632049202919, 0.04502255842089653, -0.0696278065443039, 0.10816487669944763, 0.008175414055585861, -0.05761375278234482, -0.034454017877578735, 0.00904904305934906, -0.03398055210709572, -0.05609217286109924, -0.005463621113449335, 0.03488750383257866, 0.0735728070139885, 0.04982208460569382, 0.014519549906253815, 0.018139781430363655, 0.03338918462395668, 0.05150378495454788, -0.03588204085826874, -0.09516496956348419, 0.05315454304218292, 0.005084318108856678, -0.02860722877085209, 0.04138602688908577, -0.05355324223637581, 0.04162801802158356, -0.09274961054325104, -0.012542709708213806, -0.026592958718538284, -0.04414278641343117, 0.04810331389307976, 0.01912413351237774, -0.0173212680965662, -0.026732437312602997, -0.01686701737344265, -0.012818455696105957, -0.08219971507787704, 0.03756013140082359, 0.02267974242568016, -0.06272685527801514, 0.035991642624139786, -0.0276540108025074, 0.08387332409620285, -0.013401924632489681, -0.07013759762048721, -0.00483196834102273, 0.018049433827400208, -0.02863580919802189, -0.07865753769874573, -0.013332558795809746, -0.06048852577805519, -0.01828000321984291, 0.0037471114192157984, 0.041757870465517044, 0.04262126609683037, 0.03192354366183281, -0.020994193851947784, 0.04060759022831917, 0.05284693464636803, 0.06386581808328629, 0.036829669028520584, 0.03209343180060387, 0.01766045019030571, 0.0036896660458296537, 0.0057911076582968235, 0.026290304958820343, -0.025745144113898277, -0.15484170615673065, 0.03136422485113144, 0.027709297835826874, -0.05399797484278679, 0.08164605498313904, 0.029292067512869835, 0.004986169282346964, -0.08355378359556198, 0.0682925283908844, 0.08578796684741974, -0.08019833266735077, 0.025473250076174736, 0.031376857310533524, -0.016399839892983437, -0.08710093796253204, 0.02679513208568096, 0.06913888454437256, 0.0166116151958704, -0.07521361112594604, 0.0564420111477375, 0.022499438375234604, 0.04982643947005272, 0.03772865980863571, 0.04708485305309296, -0.020763395354151726, -0.027957888320088387, -0.07293392717838287, -0.025639871135354042, -0.01719398982822895, 1.1227477887173806e-32, -0.024072887375950813, -0.005724853370338678, -0.12034109979867935, 0.04138676077127457, 0.0187733955681324, 0.030022095888853073, 0.007874305360019207, 0.024471748620271683, -0.03495314344763756, -0.00927160307765007, -0.059473007917404175, -0.05418640002608299, -0.033729519695043564, 0.07532331347465515, 0.07787547260522842, -0.05517153441905975, -0.03881916031241417, 0.01924596168100834, -0.012490999884903431, 0.019121579825878143, 0.08741020411252975, -0.02815076895058155, -0.08507082611322403, -0.04363919422030449, 0.026310008019208908, 0.08210289478302002, 0.00830571074038744, -0.08298928290605545, -0.021715596318244934, 0.04261760786175728, -0.06229548901319504, -0.007398008368909359, -0.07831180840730667, -0.051195524632930756, 0.04865705221891403, -0.11931077390909195, -0.014811553061008453, -0.04922566935420036, -0.07821685075759888, -0.05846313014626503, -0.017232896760106087, -0.029656514525413513, -0.045846931636333466, -0.04299842566251755, -0.027396369725465775, -0.03956833481788635, -0.017559638246893883, 0.08614516258239746, 0.002163597149774432, 0.09079626202583313, -0.01715596206486225, -0.0032209402415901423, 0.01824154146015644, 0.03902048617601395, 0.027453714981675148, -0.08594242483377457, -0.024827266111969948, -0.01636689528822899, 0.0695372000336647, 0.1063813716173172, -0.037302665412425995, 0.02952612191438675, 0.04626554623246193, -0.00359442550688982, -0.011289600282907486, -0.025134092196822166, 0.043790388852357864, -0.02422170527279377, -0.004956697579473257, 0.05361863970756531, -0.0070517901331186295, -0.10102872550487518, 0.12347260117530823, 0.008008851669728756, -0.0617230199277401, -0.06741032004356384, -0.0011543368455022573, -0.01350743230432272, -0.08504337072372437, -0.028162503615021706, -0.05874473229050636, -0.010094025172293186, 0.0092688649892807, -0.03733759745955467, 0.05517448112368584, -0.02274240553379059, 0.031274013221263885, -0.030049938708543777, -0.09611997753381729, 0.02897467650473118, -0.0022856174036860466, -0.10886387526988983, 0.010605528950691223, -0.05693624168634415, -0.084940105676651, -1.2484724196675937e-32, 0.053519103676080704, 0.010040007531642914, -0.024119453504681587, 0.021887755021452904, -0.06251897662878036, -0.07790490984916687, -0.010744973085820675, 0.0646096020936966, -0.039205700159072876, -0.051335789263248444, -0.05965762585401535, 0.02693544514477253, 0.0411352813243866, -0.0179511196911335, 0.04469917342066765, -0.10473629087209702, 0.011368200182914734, 0.012914500199258327, 0.03116457164287567, 0.011676216498017311, -0.07983504235744476, 0.039813894778490067, 0.0286379586905241, 0.01819818839430809, 0.009004083462059498, 0.014379345811903477, 0.011107441037893295, 0.0720624178647995, -0.0543145053088665, 0.02553023397922516, 0.030055448412895203, -0.008573138155043125, -0.1279604434967041, 0.03237656503915787, -0.029238106682896614, -0.06312933564186096, 0.08817500621080399, 0.027855193242430687, -0.02584097906947136, -0.09353666752576828, 0.11582780629396439, 0.012412266805768013, -0.060308218002319336, 0.02134116366505623, 0.041320037096738815, 0.01884455978870392, -0.038622308522462845, -0.01550216879695654, 0.0794481411576271, -0.03344428911805153, 0.05103346332907677, -0.007147093303501606, 0.059547580778598785, -0.011240523308515549, 0.0025595694314688444, -0.10371343791484833, 0.03690542280673981, 0.017131896689534187, 0.06932682543992996, -0.008359180763363838, 0.045001983642578125, -0.04527529701590538, 0.04936131834983826, -0.01806020922958851, 0.020397504791617393, -0.02567710541188717, 0.04112793505191803, 0.12836991250514984, -0.11661189794540405, 0.09226958453655243, 0.023734498769044876, 0.02134479209780693, 0.04614216089248657, 0.08583810180425644, 0.01834961213171482, 0.09229078888893127, 0.04874109476804733, 0.019810184836387634, 0.044856585562229156, -0.060470275580883026, -0.07399193197488785, -0.023282203823328018, -0.05140428990125656, -0.022154083475470543, -0.0646018460392952, -0.034023597836494446, -0.01983175054192543, 0.0643647238612175, 0.025896988809108734, -0.03632429614663124, -0.033805541694164276, 0.0683836117386818, -2.195896377088502e-05, 0.03163402900099754, -0.0035592366475611925, -6.896934934275123e-08, 0.01084075402468443, 0.05139444023370743, 0.015937723219394684, 0.03332282975316048, 0.08556988090276718, -0.015252775512635708, 0.027130575850605965, -0.038465600460767746, 0.06512686610221863, -0.04333346709609032, 0.10585954785346985, -0.03777790814638138, -0.029109155759215355, 0.05837678536772728, 0.020825471729040146, 0.019099760800600052, -0.08248687535524368, 0.012704349122941494, -0.02625999227166176, -0.041208747774362564, 0.024010544642806053, -0.04191241413354874, -0.0004692741495091468, -0.04155982285737991, 0.03555934503674507, -0.017954256385564804, 0.08810331672430038, -0.01686229556798935, -0.0009189998381771147, 0.005795173346996307, 0.007471201941370964, -0.019896334037184715, 0.050836529582738876, 0.08363725244998932, 0.0016060309717431664, -0.007403495255857706, -0.05126049369573593, 0.04812037944793701, 0.02480502985417843, 0.016061129048466682, -0.035025253891944885, 0.0010859929025173187, 0.010059061460196972, -0.03945387899875641, -0.02027055248618126, -0.06327996402978897, -0.09335625171661377, -0.0775068998336792, -0.0048898970708251, 0.012219397351145744, -0.06930026412010193, 0.0575876384973526, -0.027566948905587196, 0.0067716860212385654, 0.05132707580924034, 0.010020396672189236, -0.04618368297815323, 0.015440334565937519, 0.03042786754667759, 0.07974080741405487, 0.05707100033760071, -0.017109736800193787, -0.05682933330535889, 0.03165031969547272 ] }, { "text": "Open Serial Monitor for Live Classification. \nDespite the errors, live classification is working well:)\n\n Starting inferencing in 2 seconds...\n Sampling...\n Predictions (DSP: 21 ms., Classification: 0 ms., Anomaly: 0 ms.): \n circle: 0.00000\n idle: 0.03516\n left-right: 0.00000\n up-down: 0.96484\n \n Starting inferencing in 2 seconds...\n Sampling...\n Predictions (DSP: 20 ms., Classification: 0 ms., Anomaly: 0 ms.): \n circle: 0.91406\n idle: 0.00000\n left-right: 0.08594\n up-down: 0.00000\n \n Starting inferencing in 2 seconds...\n Sampling...\n Predictions (DSP: 20 ms., Classification: 0 ms., Anomaly: 0 ms.): \n circle: 0.00000\n idle: 0.99219\n left-right: 0.00781\n up-down: 0.00000", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_14", "embedding": [ -0.03196130692958832, -0.05745202302932739, -0.03418402373790741, 0.022366398945450783, 0.09550314396619797, -0.07608452439308167, -0.05036207661032677, -0.038058437407016754, -0.032120540738105774, -0.04319607838988304, -0.05236029624938965, -0.0483643040060997, -0.10270203649997711, -0.012953754514455795, -0.07390956580638885, -0.05090311914682388, -0.004739294294267893, -0.04765069857239723, -0.011096728034317493, 0.03223849833011627, 0.020060310140252113, 0.024299323558807373, -0.008266729302704334, 0.07195141166448593, -0.025267748162150383, 0.014784067869186401, -0.03031889721751213, 0.07741313427686691, 0.04410233348608017, -0.025871774181723595, -0.027976660057902336, 0.033603157848119736, -0.04009469598531723, -0.05426331236958504, -0.009213809855282307, 0.021121254190802574, 0.019097473472356796, -0.028708452358841896, -0.02503158524632454, -0.0328981950879097, 0.06417959928512573, 0.005356557201594114, -0.01487991027534008, 0.043410565704107285, 0.018099460750818253, -0.021723749116063118, -0.006373208481818438, -0.03835917264223099, -0.0029985348228365183, 0.004638066049665213, -0.09128465503454208, 0.043064337223768234, 0.06465175747871399, 0.008380649611353874, -0.040713172405958176, 0.04850393161177635, -0.0037711469922214746, 0.02029447816312313, 0.09930217266082764, -0.05492511764168739, 0.009359613060951233, -0.019299641251564026, 0.013559645973145962, -0.02988041378557682, -0.022438375279307365, 0.08339868485927582, -0.0059241848066449165, 0.010679482482373714, 0.08678794652223587, 0.03730744868516922, -0.002545637311413884, 0.07800335437059402, -0.07739482074975967, 0.05637592822313309, 0.021265212446451187, 0.026752077043056488, 0.02034478262066841, -0.024883056059479713, 0.0810268223285675, -0.08922842890024185, 0.010960147716104984, -0.04601452872157097, -0.019660454243421555, 0.0014713609125465155, 0.06920262426137924, 0.039925187826156616, -0.03777075931429863, 0.06913384795188904, -0.06886941194534302, -0.012131300754845142, 0.007260754704475403, 0.0326949842274189, -0.05577543377876282, -0.01855674758553505, -0.016119593754410744, 0.020146194845438004, 0.05195492506027222, 0.035775233060121536, -0.013405213132500648, 0.048883602023124695, -0.06060878187417984, -0.024955645203590393, -0.0020095345098525286, 0.11051774770021439, 0.04302928224205971, -0.011323221027851105, 0.044421933591365814, -0.024120336398482323, 0.02324477583169937, 0.05369392782449722, 0.03851175308227539, -0.004153451882302761, 0.017549805343151093, -0.026270130649209023, -0.017432671040296555, 0.11856162548065186, -0.13204512000083923, 0.03023189678788185, -0.05593211576342583, 0.06837496161460876, -0.007020733319222927, -0.007482951041311026, -0.04333709925413132, -0.06375135481357574, 0.1133313700556755, 0.014235577546060085, -0.036879394203424454, 7.29057245148528e-33, 0.03427993133664131, -0.07883398979902267, 0.006895536556839943, -0.006322793662548065, -0.072980135679245, -0.03254334256052971, 0.006090836599469185, 0.05531851947307587, 0.03263168781995773, 0.03220648318529129, -0.0430222786962986, -0.01193120889365673, 0.028304466977715492, 0.011157154105603695, 0.0029777551535516977, -0.037110526114702225, 0.040967125445604324, 0.04872395470738411, -0.06680013984441757, 0.022200673818588257, 0.01737247221171856, -0.05653790384531021, -0.029540181159973145, -0.08751967549324036, -0.02244887314736843, 0.16807004809379578, -0.006873262580484152, 0.015319634228944778, 0.026853187009692192, 0.05370822921395302, -0.0033689667470753193, 0.019612444564700127, 0.030454745516180992, -0.0025661832187324762, 0.05585630610585213, -0.038024477660655975, -0.0006681414670310915, 0.07781682908535004, -0.031018001958727837, -0.0458935871720314, -0.05308864265680313, 0.00044077844358980656, 0.017872821539640427, -0.035771261900663376, -0.009157759137451649, -0.03742987662553787, 0.03572988137602806, 0.020025914534926414, -0.0007882023346610367, 0.09082677960395813, -0.00824432261288166, -0.0161958746612072, -0.08854815363883972, -0.001427053939551115, -0.09651999175548553, -0.005884558893740177, 0.02513415925204754, 0.01420657243579626, -0.05271684005856514, 0.03898646682500839, -0.006709028035402298, 0.014617685228586197, -0.010781237855553627, -0.03782018646597862, 0.06279085576534271, 0.04251733794808388, -0.002061221981421113, -0.016233813017606735, -0.021173378452658653, -0.016502613201737404, 0.02082052081823349, 0.022706501185894012, 0.03655499219894409, 0.007166437339037657, 0.036154381930828094, 0.024984240531921387, 0.03484443575143814, 0.04867401719093323, -0.1153440847992897, 0.06063323840498924, 0.053490523248910904, -0.05416704714298248, -0.0065739997662603855, -0.06189887225627899, -0.013607979752123356, -0.010379582643508911, 0.010761784389615059, 0.02556864731013775, -0.10712746530771255, 0.07221387326717377, -0.06976263225078583, 0.05757182464003563, 0.05077680945396423, 0.0680738314986229, -0.11316385865211487, -7.15001859195746e-33, -0.046841371804475784, 0.054199885576963425, 0.0264021884649992, 0.01623058319091797, -0.08524611592292786, 0.02484705299139023, -0.010548753663897514, 0.07003334909677505, -0.025125203654170036, -0.04044581577181816, 0.025927230715751648, -0.041594330221414566, -0.056846894323825836, 0.017561154440045357, -0.03401758149266243, -0.0305460337549448, -0.06681007891893387, 0.045139379799366, 0.04428430274128914, 0.056477855890989304, 0.08758489042520523, 0.08985063433647156, -0.14012853801250458, 0.009601930156350136, -0.01519299577921629, 0.05505448207259178, 0.0670708417892456, 0.11169785261154175, -0.004408501088619232, -0.04820740967988968, -0.007263392210006714, 0.006621378939598799, -0.042198341339826584, 0.029981132596731186, 0.0478186272084713, 0.04892663657665253, 0.05386398732662201, -0.09605476260185242, -0.012826311402022839, 0.02312724106013775, 0.04211043938994408, 0.06412838399410248, -0.12398388236761093, 0.00223875162191689, 0.045459624379873276, -0.033742744475603104, 0.01542727742344141, 0.08634349703788757, -0.007214538753032684, -0.01714969612658024, 0.013891724869608879, 0.08896283805370331, -0.06170303747057915, 0.049401767551898956, 0.06347515434026718, 0.022487156093120575, -0.04145212844014168, 0.011029812507331371, -0.0866624116897583, 0.04926407337188721, -0.005557696800678968, 0.04856882244348526, -0.043303485959768295, -0.033286333084106445, 0.11847798526287079, 0.0935969427227974, 0.056541841477155685, -0.0022857722360640764, 0.05190481245517731, -0.00422681076452136, 0.01152854599058628, 0.07197596877813339, -0.08008258789777756, -0.013701663352549076, 0.028179097920656204, -0.011612322181463242, -0.1018485575914383, -0.008927267044782639, 0.014844912104308605, 0.03763706982135773, -0.08850590139627457, -0.0450117252767086, 0.062175292521715164, 0.11119803786277771, 0.057863179594278336, 0.0785990059375763, 0.03220224380493164, 0.03939151018857956, 0.05472815781831741, -0.04147277772426605, -0.028094487264752388, 0.04989985004067421, -0.0084462845697999, 0.12239891290664673, -0.022310899570584297, -6.541577590724046e-08, -0.024471821263432503, 0.02959909848868847, -0.017631156370043755, 0.0053314934484660625, 0.04181474447250366, -0.00418962212279439, -0.04824962466955185, -0.05661172792315483, -0.05709739029407501, -0.01653798297047615, 0.03449622169137001, -0.06135492026805878, -0.09252303093671799, -0.04090685769915581, 0.05677803233265877, -0.10114651173353195, -0.06677593290805817, -0.003947021439671516, -0.06860111653804779, -0.023303616791963577, 0.04714551940560341, -0.05414200574159622, 0.02934776246547699, -0.08804802596569061, 0.04108990356326103, -0.1038372740149498, 0.04387348145246506, 0.0626089945435524, -0.015940429642796516, 0.007882410660386086, -0.06851663440465927, 0.013546083122491837, -0.022068465128540993, -0.023779192939400673, 0.006715807598084211, 0.0044027334079146385, 0.054749228060245514, 0.03352072834968567, 0.07332610338926315, -0.011817759834229946, -0.03225339576601982, -0.0317307710647583, -0.1732034534215927, -0.0157014112919569, -0.0050701601430773735, 0.02037215791642666, 0.01960313692688942, -0.08374276757240295, 0.06045611947774887, -0.08417654782533646, -0.0088850948959589, -0.02508876845240593, -0.009579978883266449, 0.00957329012453556, 0.03442864865064621, -0.031659986823797226, -0.01984156109392643, -0.03930746763944626, -0.05139468237757683, 0.06281941384077072, 0.05699390172958374, -0.026224873960018158, -0.14078307151794434, 0.010311243124306202 ] }, { "text": "Let's open the metadata:\n \n C:\\Users\\pelin\\Documents\\Arduino\\libraries --> arduino_motion_inferencing --> src --> model_parameters\n\nOpen model_metadata.h.\n\nHere is the error: \n \n #error \"Cannot use full TensorFlow Lite with EON\"\n\nI installed Arduino TensorflowLite via: \n\n Open Arduino IDE: sketch --> include library --> manage libraries --> Arduino TensorflowLite. \n\nStart upload again. Same error :(", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_15", "embedding": [ -0.007758742198348045, -0.10344038903713226, -0.03256306052207947, -1.5482979506487027e-05, 0.09936611354351044, 0.038146886974573135, -0.02907750941812992, 0.03443560749292374, -0.0584888681769371, 0.002804151037707925, -0.019153639674186707, -0.03701578453183174, -0.12315760552883148, 0.09951845556497574, 0.07060129940509796, 0.03192892670631409, -0.054132603108882904, -0.029545597732067108, -0.052084360271692276, -0.00227681128308177, 0.010913356207311153, -0.0340491384267807, -0.024678654968738556, 0.05955647677183151, -0.009565616026520729, -0.07360081374645233, -0.02383584901690483, -0.03932375833392143, -0.039404790848493576, 0.026144666597247124, 0.06947053968906403, 0.017645692452788353, 0.029293926432728767, 0.010351204313337803, 0.028887437656521797, -0.005112077109515667, -0.04112105816602707, -0.09574266523122787, -0.0625075176358223, -0.03492896258831024, 0.04112512245774269, -0.0004797008878085762, -0.04310327395796776, 0.0015775533393025398, 0.002279577311128378, -0.027177980169653893, 0.11954879015684128, -0.061527885496616364, 0.06398037821054459, 0.05728704109787941, -0.021880028769373894, -0.06692831963300705, 0.018862413242459297, 0.01565801352262497, 0.04476059600710869, -0.10223153233528137, 0.013287145644426346, -0.007871013134717941, 0.047019943594932556, -0.07291938364505768, -0.016294872388243675, 0.018965160474181175, -0.008697262033820152, 0.003064507618546486, -0.08415935933589935, 0.055592793971300125, -0.015160748735070229, -0.055804621428251266, 0.000602985150180757, -0.03986018896102905, 0.0428282655775547, 0.008476333692669868, -0.09549258649349213, 0.036597687751054764, -0.04843185096979141, 0.0393349751830101, 0.06663484126329422, 0.03981005400419235, 0.0005164167960174382, -0.00386733072809875, -0.009962738491594791, -0.03190099447965622, 0.016485879197716713, -0.07096122950315475, -0.008453776128590107, -0.03173723444342613, 0.01629806123673916, 0.03863874822854996, 0.07903187721967697, 0.00884917937219143, 0.06591454893350601, -0.01284767221659422, -0.021123066544532776, 0.02575058490037918, 0.07777505367994308, -0.0031280633993446827, -0.03799290955066681, 0.03166557103395462, -0.10681574046611786, 0.020748812705278397, -0.06338941305875778, 0.0008527169702574611, 0.015370707027614117, 0.08566007018089294, 0.0015400892589241266, 0.026215054094791412, 0.09635011851787567, 0.04343035817146301, -0.05798153206706047, -0.0007141476380638778, 0.06161300837993622, -0.0030428331810981035, 0.07829222083091736, -0.0395624153316021, 0.026843471452593803, 0.0532008521258831, -0.0829736664891243, 0.07838897407054901, 0.001539456658065319, 0.0941367894411087, -0.06716644763946533, 0.05451974272727966, 0.009168339893221855, 0.009841617196798325, -0.059707559645175934, -0.05528482049703598, -0.06703409552574158, 3.401123192107389e-33, -0.038929034024477005, -0.01945883221924305, 0.03538048639893532, 0.02625192329287529, 0.03658090904355049, -0.03773680701851845, 0.019968174397945404, 0.02362709306180477, -0.019404901191592216, -0.11118501424789429, -0.06518924981355667, 0.027975065633654594, 0.024052171036601067, 0.12950094044208527, -0.06896418333053589, -0.0813557580113411, 0.03284576162695885, 0.026930969208478928, 0.03687971830368042, 0.09091294556856155, 0.061807047575712204, -0.05671245604753494, -0.04656823351979256, 0.033527955412864685, -0.10427836328744888, 0.04675847291946411, 0.03914457932114601, 0.04208913818001747, 0.014276149682700634, 0.018645772710442543, -0.01733282022178173, -0.0348396971821785, 0.009864925406873226, 0.047729723155498505, -0.004997641779482365, -0.06766767054796219, 0.06462015956640244, 0.05636659637093544, 0.00786456186324358, -0.08070969581604004, 0.07701727747917175, 0.03343363478779793, -0.05614816024899483, -0.030482808127999306, -0.03949328884482384, -0.030948618426918983, 0.006121763028204441, 0.05006210505962372, 0.09449324011802673, 0.006002324167639017, -0.03547603636980057, 0.004008627962321043, -0.03668899089097977, -0.034395746886730194, 0.048642661422491074, -0.042113661766052246, -0.03757152333855629, 0.034529123455286026, 0.10377158224582672, -0.08270473033189774, 0.00968097522854805, 0.0806703120470047, 0.012073183432221413, 0.04445166140794754, 0.07667027413845062, -0.012003972195088863, -0.06767236441373825, 0.008482163771986961, 0.04068398475646973, 0.02804163098335266, -0.06832843273878098, -0.01923326961696148, -0.010251308791339397, 0.02539040707051754, -0.013903212733566761, -0.04769371077418327, 0.06716173887252808, -0.029888497665524483, -0.020822864025831223, 0.06492804735898972, -0.16176101565361023, -0.023597288876771927, 0.015398602932691574, -0.028786147013306618, -0.06150210276246071, 0.047735024243593216, -0.020512655377388, 0.10447529703378677, -0.018863333389163017, -0.0023005432449281216, 0.03188128396868706, 0.028741227462887764, -0.053643304854631424, 0.03097080998122692, -0.02686343342065811, -3.1425566792547184e-33, 0.027530089020729065, 0.013820926658809185, -0.007954287342727184, -0.02640213817358017, -0.010767555795609951, 0.06654699891805649, 0.040019478648900986, 0.020765185356140137, 0.12102410942316055, 0.08358299732208252, 0.05934558063745499, -0.0278878603130579, 0.04656098410487175, -0.08758355677127838, 0.010114719159901142, -0.026884837076067924, -0.041677892208099365, -0.04902995750308037, 0.04049759358167648, 0.0005394191830419004, -0.09386450052261353, -0.02625897340476513, -0.09627464413642883, -0.005035645328462124, -0.038572195917367935, 0.015960095450282097, -0.04887939244508743, -0.006913879420608282, -0.046755578368902206, -0.03551383689045906, 0.024461926892399788, -0.048344358801841736, -0.07173784077167511, 0.02168351225554943, 0.0029704864136874676, 0.040754012763500214, 0.06052601709961891, -0.03370465338230133, 0.0031933877617120743, -0.031961921602487564, 0.015585112385451794, 0.05376772582530975, -0.059870488941669464, -0.01258022990077734, 0.003981256391853094, 0.000808263139333576, -0.04316167160868645, 0.01172619592398405, 0.03845691308379173, -0.06003722921013832, 0.020777277648448944, -0.022129228338599205, 0.04246107116341591, -0.08832572400569916, 0.036630481481552124, -0.04243495315313339, 0.11218356341123581, 0.015806695446372032, -0.041414640843868256, 0.0044831386767327785, 0.029734600335359573, -0.018371349200606346, -0.043190378695726395, -0.11651632189750671, -0.020628001540899277, -0.004386717453598976, -0.10973849892616272, 0.0335884764790535, -0.0008337096660397947, 0.036218270659446716, -0.04849989339709282, 0.027603555470705032, 0.059161800891160965, 0.05979516729712486, -0.007907913997769356, 0.07292497903108597, 0.03712709993124008, 0.02220040187239647, 0.058559488505125046, -0.07333392649888992, 0.06030803918838501, 0.014528083615005016, -0.007296958938241005, -0.0169888474047184, 0.04807170480489731, 0.020133428275585175, 0.01730397716164589, -0.04378090053796768, -0.0390668623149395, 0.011403191834688187, 0.017061902210116386, -0.0284601878374815, 0.07801967114210129, 0.08120733499526978, 0.05688728019595146, -4.496030925338346e-08, -0.00956753734499216, 0.04424230381846428, 0.011181947775185108, -0.034098874777555466, 0.04023103788495064, -0.04273039475083351, 0.15182675421237946, 0.047362081706523895, 0.041842348873615265, -0.026074713096022606, -0.021602734923362732, -0.07273770123720169, -0.005537156015634537, 0.05386846140027046, 0.016536206007003784, 0.015526791103184223, -0.07199376821517944, 0.08595602959394455, 0.03638989105820656, -0.00874604843556881, 0.06544747203588486, -0.05651179328560829, -0.06240156665444374, -0.07172603160142899, 0.013568740338087082, -0.006359349004924297, 0.09819954633712769, 0.0030336384661495686, -0.11472209542989731, 0.009438256733119488, -0.022412650287151337, -0.06103385612368584, -0.007892543449997902, -0.0327136404812336, -0.00448854174464941, 0.08163054287433624, 0.03008594736456871, -0.030640466138720512, -0.038096316158771515, 0.0132558923214674, -0.06748852133750916, 0.08323079347610474, 0.03845178708434105, -0.1201602965593338, -0.022884638980031013, -0.028819765895605087, -0.029399067163467407, 0.0462794229388237, -0.09115037322044373, 0.06452294439077377, 0.0668611228466034, 0.05333460122346878, 0.015541942790150642, 0.04256775602698326, -0.03251663222908974, 0.006684776861220598, -0.07015763968229294, -0.06028427183628082, -0.03943440690636635, -0.029033131897449493, 0.12456416338682175, 0.022557469084858894, 0.0018317510839551687, -0.003334824927151203 ] }, { "text": "C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\CMSIS\\NN\\Source\\PoolingFunctions\\arm_pool_q7_HWC.c:125:9: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]\n *__SIMD32(pCnt)++ = __QADD16(vo2, in);\n ^\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\dsp\\image\\processing.cpp: In function 'int ei::image::processing::yuv422_to_rgb888(unsigned char*, const unsigned char*, unsigned int, ei::image::processing::YUV_OPTIONS)':\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\dsp\\image\\processing.cpp:73:32: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_16", "embedding": [ -0.06796291470527649, 0.037010613828897476, 0.002681117272004485, -0.061572395265102386, -0.0023728180676698685, -0.059439767152071, 0.06899626553058624, 0.11014154553413391, -0.0341508574783802, -0.024875978007912636, 0.041924357414245605, -0.10878106206655502, -0.09989862143993378, 0.041067756712436676, -0.0187718253582716, 0.043386660516262054, -0.07438060641288757, 0.007106315344572067, 0.002944903215393424, 0.04561284929513931, 0.04619883373379707, -0.0047693438827991486, -0.026732180267572403, 0.011141196824610233, 0.008809950202703476, -0.005703580100089312, 0.020521804690361023, 0.050007473677396774, 0.054755862802267075, -0.07628589123487473, 0.03449203446507454, 0.12173883616924286, 0.036018066108226776, 0.00026956640067510307, 0.09655346721410751, 0.07475532591342926, -0.005452057812362909, -0.09753133356571198, 0.03832031041383743, -0.021468600258231163, 0.09804096072912216, 0.10843970626592636, -0.035907190293073654, -0.01420033909380436, 0.060749854892492294, 0.02249191701412201, 0.07745864242315292, 0.03863997757434845, -0.03552813082933426, 0.017448946833610535, -0.039508942514657974, 0.004676085896790028, 0.004066320136189461, -0.010166067630052567, 0.055689215660095215, -0.011939696036279202, -0.04670725017786026, 0.09513707458972931, 0.08683603256940842, 0.03242521733045578, -0.06938285380601883, -0.027908923104405403, 0.04127408564090729, -0.058920226991176605, -0.09075305610895157, -0.09713064879179001, 0.04146164655685425, 0.026843182742595673, -0.038027361035346985, 0.010053400881588459, -0.022991875186562538, 0.06853313744068146, -0.06724175065755844, 0.09024710208177567, -0.0013095474569126964, 0.0179864764213562, -0.028592197224497795, 0.01869102381169796, -0.033713314682245255, -0.1419898420572281, 0.04281444847583771, -0.10702954232692719, -0.027683379128575325, -0.042571138590574265, 0.11009350419044495, 0.05148312449455261, -0.11874353140592575, -0.04047461599111557, 0.01800576224923134, -0.039077162742614746, -0.030997108668088913, -0.05294770374894142, -0.08368512988090515, -0.01960507407784462, 0.08071295917034149, -0.027813592925667763, 0.05292978882789612, -0.024423915892839432, -0.01227660197764635, 0.10495223104953766, -0.039163362234830856, -0.028771676123142242, -0.05587420240044594, 0.10111511498689651, 0.03968933969736099, -0.006258801557123661, 0.05096329003572464, 0.016446799039840698, -0.06839431822299957, -0.0498330257833004, -0.06474742293357849, 0.006225018762052059, 0.011508308351039886, -0.061441920697689056, 0.03749028593301773, 0.056830212473869324, -0.04586857929825783, 0.023750189691781998, 0.073268361389637, -0.052187539637088776, -0.03058904968202114, -0.03336460888385773, -0.08834687620401382, 0.036863427609205246, -0.027808604761958122, -0.05416455864906311, -0.01507986057549715, 4.1497878299644266e-33, 0.06622806936502457, -0.03293044865131378, -0.013747149147093296, -0.022455181926488876, 0.01289468165487051, -0.021946759894490242, 0.02593294531106949, 0.006752802059054375, -0.0403350330889225, -0.06580284237861633, 0.005442322697490454, -0.16314241290092468, 0.04060841351747513, 0.04261459782719612, 0.006601101253181696, 0.001664861454628408, 0.042706917971372604, -0.021501485258340836, -0.07110800594091415, 0.029654180631041527, 0.09799149632453918, 0.05178988724946976, -0.12253710627555847, 0.03032301925122738, -0.1110786646604538, 0.0711415559053421, 0.028883017599582672, -0.02818365953862667, 0.15172645449638367, 0.01084798201918602, -0.047529857605695724, 0.034462910145521164, 0.0013798881554976106, -0.03263815864920616, 0.012946574948728085, 0.019177991896867752, -0.035786744207143784, 0.04690966755151749, -0.052621934562921524, -0.08163046836853027, 0.02215481363236904, 0.003603244898840785, -0.0351027213037014, -0.046811580657958984, 0.029152635484933853, -0.0559990294277668, 0.0260604340583086, 0.04445013776421547, -0.010814590379595757, 0.02603333257138729, -0.017246536910533905, 0.031636107712984085, 0.01831333339214325, -0.035721804946660995, 0.016967035830020905, -0.0922023132443428, -0.0035922632087022066, 0.03154045715928078, 0.0048523456789553165, 0.010082285851240158, 0.07597345113754272, 0.031185004860162735, -0.04984408989548683, 0.021337196230888367, -0.03676990047097206, 0.03010677732527256, -0.039556391537189484, -0.033136703073978424, 0.029012205079197884, 0.046823058277368546, -0.01554761454463005, -0.002284010173752904, -0.04421611130237579, 0.026274513453245163, -0.042662497609853745, -0.0032526752911508083, -0.07237344980239868, 0.02675461582839489, -0.015028731897473335, -0.016631755977869034, -0.0896902084350586, 0.05866570025682449, 0.02529304102063179, -0.05850537121295929, -0.04246316850185394, -0.11646800488233566, 0.037727560847997665, -0.06273212283849716, -0.015952039510011673, 0.04114443063735962, 0.005557809956371784, 0.006198400165885687, -0.012901535257697105, 0.055389225482940674, -0.05412295460700989, -6.495142607590701e-33, 0.03848949447274208, 0.11092378944158554, -0.007482605986297131, 0.02803126536309719, -0.1781798154115677, 0.040072742849588394, 0.07759226858615875, -0.06154966726899147, 0.026103340089321136, -0.0940469428896904, -0.031209850683808327, 0.0349244624376297, 0.03696117177605629, -0.05892739072442055, 0.044093336910009384, -0.00925406813621521, -0.0585528202354908, 0.007014831528067589, -0.04519163817167282, 0.027409926056861877, -0.027216712012887, 0.027676058933138847, 0.12589412927627563, 0.06352303922176361, -0.020004862919449806, 0.015530908480286598, 0.07490844279527664, -0.011247514747083187, -0.0419154092669487, -0.02877538837492466, -0.035642966628074646, -0.003604613244533539, -0.13280089199543, -0.030825627967715263, 0.016253823414444923, -0.038592081516981125, 0.03553516045212746, -0.022349117323756218, -0.0182111207395792, -0.03543136641383171, 0.07288782298564911, 0.0058691068552434444, -0.020939579233527184, 0.052382562309503555, 0.011771613731980324, -0.0067001823335886, 0.028215112164616585, 0.0036957846023142338, -0.013449233025312424, -0.009318617172539234, -0.0010743705788627267, 0.023541294038295746, 0.017327824607491493, -0.008535951375961304, 0.013027596287429333, 0.0055289617739617825, 0.035189587622880936, 0.05622994899749756, 0.04896474629640579, 0.014713402837514877, 0.020970962941646576, -0.07382207363843918, -0.1285976618528366, -0.10229948163032532, 0.04605378955602646, -0.022401221096515656, -0.0921437218785286, 0.008082048036158085, 0.06981860846281052, -0.023424271494150162, -0.04670039191842079, 0.04211166873574257, 0.002237450098618865, 0.012099661864340305, -0.07475457340478897, -0.01086122915148735, 0.06572842597961426, 0.0035445778630673885, 0.0429745577275753, 0.028019750490784645, -0.03149561956524849, 0.044199321419000626, 0.0045593236573040485, 0.06221253052353859, -0.066805399954319, 0.008822707459330559, -0.018365172669291496, 0.0007603149861097336, -0.02015218324959278, -0.019610490649938583, 0.008777010254561901, -0.03663896024227142, 0.05918377265334129, 0.11878948658704758, -0.03601875528693199, -5.425457771934816e-08, -0.03591782972216606, -0.02353510633111, -0.025008993223309517, 0.014368112199008465, 0.014493321068584919, -0.08104036748409271, -0.03805161640048027, -0.018659405410289764, 0.02271261438727379, -0.039815038442611694, 0.016096634790301323, -0.03027929551899433, 0.04500456526875496, -0.05570400133728981, 0.08910895884037018, -0.05612555518746376, -0.021079253405332565, 0.025522548705339432, -0.030689911916851997, 0.003431514836847782, -0.02626352570950985, -0.03381146490573883, -0.031305909156799316, -0.00115554581861943, -0.04487920552492142, -0.06207486242055893, 0.008718823082745075, -0.03837989270687103, -9.03220716281794e-05, 0.010026110336184502, 0.03867581486701965, 0.020750585943460464, 0.0539524145424366, 0.028867756947875023, 0.030417097732424736, 0.01935965195298195, -0.014441721141338348, 0.05837143957614899, 0.019213655963540077, 0.02667425014078617, -0.06717763841152191, 0.0969560444355011, -0.011403375305235386, -0.008384983986616135, 0.014871526509523392, -0.027403896674513817, 0.04121116176247597, 0.013260174542665482, -0.0026242167223244905, 0.04753093421459198, 0.01657884567975998, 0.07162895053625107, 0.039913278073072433, 0.037940721958875656, 0.00593092106282711, -0.016417186707258224, -0.00661547901108861, -0.04067464917898178, -0.061973605304956436, -0.0023466951679438353, 0.044547613710165024, -0.08524302393198013, -0.013960820622742176, 0.050844136625528336 ] }, { "text": "for (unsigned int i = 0; i < in_size_pixels; ++i) {\n ~~^~~~~~~~~~~~~~~~\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\tensorflow\\lite\\core\\api\\op_resolver.cpp: In function 'TfLiteStatus tflite::GetRegistrationFromOpCode(const tflite::OperatorCode*, const tflite::OpResolver&, tflite::ErrorReporter*, const TfLiteRegistration**)':\n C:\\Users\\pelin\\Documents\\Arduino\\libraries\\arduino_motion_inferencing\\src\\edge-impulse-sdk\\tensorflow\\lite\\core\\api\\op_resolver.cpp:34:20: warning: comparison is always false due to limited range of data type [-Wtype-limits]\n builtin_code < BuiltinOperator_MIN) {\n ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_17", "embedding": [ -0.0215819850564003, -0.020481860265135765, -0.05263853073120117, -0.012049390934407711, 0.018951810896396637, -0.10612445324659348, 0.03617282584309578, 0.08187692612409592, -0.051561787724494934, -0.032082002609968185, 0.024120530113577843, -0.09788087010383606, -0.0705161839723587, -0.013832038268446922, -0.056367360055446625, 1.7473417756264098e-05, -0.012308696284890175, -0.024487312883138657, -0.011454535648226738, -0.022415054962038994, 0.03283237665891647, 0.00937110185623169, -0.0496998205780983, 0.03823386877775192, -0.02330709435045719, 0.02256183512508869, -0.03318262845277786, -0.0015695608453825116, 0.044484980404376984, 0.020269351080060005, 0.055205851793289185, 0.08043370395898819, 0.028320031240582466, 0.03758587688207626, 0.08973505347967148, 0.09044073522090912, -0.06515494734048843, -0.08851809799671173, -0.019962264224886894, -0.05962873250246048, 0.06102998927235603, 0.04112444818019867, -0.017385000362992287, -0.0350782573223114, 0.036977991461753845, 0.04344950243830681, 0.10971373319625854, -0.03820795193314552, -0.0537022165954113, -0.022269459441304207, -0.0735481008887291, 0.0856972485780716, -0.0085498271510005, -0.04180007800459862, 0.0075730811804533005, -0.014000331982970238, 0.004381109960377216, 0.03944075107574463, 0.015474862419068813, 0.0006515068234875798, -0.024064380675554276, -0.04288960620760918, -0.0367991179227829, -0.05018521472811699, -0.030001478269696236, 0.030684472993016243, -0.019904861226677895, -0.046774789690971375, -0.02291136048734188, 0.018625374883413315, -0.026476362720131874, 0.08640307188034058, -0.030970070511102676, 0.12245728820562363, 0.015862906351685524, 0.023790549486875534, 0.02856045588850975, -0.017749061807990074, -0.006408297456800938, -0.1119384914636612, 0.0261052418500185, -0.09004277735948563, -0.016494087874889374, -0.011517981998622417, 0.054618217051029205, 0.02873058244585991, -0.032099947333335876, 0.09116996824741364, 0.07568524777889252, -0.0036547640338540077, 0.0035351202823221684, 0.004389915149658918, -0.12915225327014923, 0.053394440561532974, 0.1008530780673027, 0.016166239976882935, 0.0012289657024666667, 0.03832874447107315, -0.04946145787835121, 0.061881016939878464, -0.0467788502573967, -0.101000115275383, -0.024068571627140045, 0.09620863199234009, -0.00880385097116232, -0.018086832016706467, 0.04201337322592735, -0.04128678888082504, -0.04389694333076477, -0.004535631276667118, -0.021913377568125725, 0.050095777958631516, 0.06476029008626938, -0.059010691940784454, 0.09559793025255203, 0.036684952676296234, -0.08523441851139069, 0.05906281992793083, 0.09906356781721115, -0.006980764679610729, -0.015841132029891014, -0.000611283874604851, -0.03821992501616478, 0.06991678476333618, 0.01696556620299816, -0.07361708581447601, -0.007018033880740404, 7.175470983388639e-33, 0.042275991290807724, -0.020692259073257446, -0.006886819377541542, 0.026243124157190323, -0.0042131030932068825, 0.05474615842103958, 0.07191864401102066, -0.00791735015809536, -0.05766785889863968, 0.01346278004348278, -0.08090125024318695, -0.05542859807610512, -0.043853629380464554, 0.04151512309908867, -0.0065492321737110615, -0.06407836079597473, 0.060540493577718735, 0.02918252721428871, -0.04571693390607834, 0.058968834578990936, 0.10996560007333755, -0.0005889051244594157, -0.1308664083480835, 0.052566710859537125, -0.09226983785629272, 0.047919780015945435, -0.0005824296385981143, -0.023035407066345215, 0.01767377182841301, 0.008859886787831783, -0.05511929467320442, 0.007793996017426252, -0.008458415977656841, 0.008373407647013664, 0.06652925908565521, -0.016983309760689735, -0.02140291966497898, 0.04227643460035324, -0.12639538943767548, -0.07142692059278488, -0.0014329706318676472, 0.050519831478595734, -0.0344478078186512, -0.021901845932006836, 0.004270854871720076, -0.11343809962272644, -0.0057964688166975975, 0.029644548892974854, -0.008703205734491348, 0.03236677497625351, 0.04418034851551056, 0.019158028066158295, -0.05307558923959732, -0.10450105369091034, 0.0384472981095314, -0.09320997446775436, 0.002759322291240096, 0.055058784782886505, 0.0824899971485138, 0.04039542004466057, -0.010829208418726921, -0.042694080621004105, -0.053523775190114975, -0.009695655666291714, 0.034187689423561096, 0.06060412898659706, -0.04157571867108345, 0.001134667661972344, 0.031517770141363144, 0.049261949956417084, -0.0395771749317646, 0.005632219836115837, 0.016817960888147354, 0.000992043875157833, 0.0024991307873278856, -0.01282689068466425, -0.012271937914192677, -0.01808893121778965, -0.09400799870491028, -0.10385473817586899, -0.11109387874603271, 0.012174418196082115, 0.06494241207838058, -0.02992234379053116, -0.04763028770685196, -0.034069012850522995, -0.021123550832271576, -0.008812615647912025, -0.027968253940343857, 0.0037106170784682035, -0.06589449197053909, 0.004280052147805691, -0.05358795449137688, -0.010632099583745003, -0.08749476820230484, -7.613779031347684e-33, 0.038130953907966614, 0.014181923121213913, 0.0005122675793245435, 0.004772900603711605, -0.1217070072889328, 0.043395571410655975, 0.05011989176273346, -0.014553540386259556, 0.061729226261377335, -0.0869988352060318, 0.02316841296851635, -0.05850617587566376, 0.06295216083526611, -0.11519386619329453, 0.04508330672979355, -0.03365069627761841, -0.07138057053089142, -0.02083396725356579, -0.020879823714494705, 0.0005915126530453563, -0.10578928887844086, 0.077532097697258, 0.06062605604529381, 0.05156216025352478, -0.07297161966562271, 0.06032319739460945, 0.011640237644314766, 0.08443550020456314, 0.03615756332874298, -0.062403324991464615, -0.005576703697443008, 0.006303233560174704, -0.1266590654850006, 0.04875155910849571, 0.050481706857681274, 0.04742744565010071, 0.02273840457201004, 0.007573880720883608, -0.020260833203792572, 0.05166735500097275, 0.0865185558795929, 0.038674063980579376, -0.022339770570397377, 0.022083833813667297, -0.03315483406186104, -0.018677979707717896, 0.02784144878387451, -0.01920698955655098, 0.03048255480825901, -0.07714510709047318, 0.01436267513781786, -0.038022805005311966, -0.013382230885326862, -0.02148585021495819, 0.0505124069750309, 0.03445415198802948, 0.045133236795663834, -0.033844105899333954, 0.046658482402563095, -0.025675121694803238, 0.008826536126434803, -0.08698267489671707, -0.03838719427585602, -0.01094968244433403, 0.06036505103111267, 0.0653759241104126, -0.09447522461414337, 0.02387535199522972, 0.023436594754457474, 0.11251235753297806, 0.021948279812932014, 0.02405599132180214, -0.012236692011356354, 0.0042494903318583965, -0.014822505414485931, -0.012019447982311249, -0.018896445631980896, 0.02235174924135208, 0.04366226866841316, 0.05827620252966881, -0.05733783170580864, 0.06640588492155075, 0.05792389065027237, 0.04639740660786629, -0.01721443422138691, 0.0115463612601161, -0.040431149303913116, 0.012831886298954487, 0.03668082132935524, 0.00451792124658823, -0.010316981934010983, 0.04111195355653763, 0.038714997470378876, 0.03644176945090294, 0.05132931470870972, -6.154192533358582e-08, -0.1083257794380188, 0.00046399104758165777, -0.05556038022041321, 0.02650729939341545, 0.06610175967216492, -0.014403695240616798, 0.04364975541830063, -0.006926259957253933, 0.042393021285533905, -0.06598778814077377, 0.03455880656838417, -0.10168864578008652, -0.010854830965399742, -0.023059533908963203, 0.07755865901708603, -0.07381085306406021, -0.07042408734560013, -0.07816257327795029, -0.020842958241701126, -0.000814917148090899, -0.011954497545957565, -0.0501275435090065, -0.01698673702776432, -0.04986027628183365, 0.00380155211314559, -0.06989617645740509, 0.03732728585600853, 0.014993586577475071, 0.02330704592168331, 0.07645206898450851, -0.03815807029604912, -0.019084975123405457, 0.09010037034749985, -0.004725828766822815, 0.008102734573185444, 0.08629126846790314, -0.008287600241601467, 0.04505399987101555, -0.030955610796809196, 0.008774230256676674, -0.06319626420736313, 0.11026301234960556, -0.02328530140221119, -0.010987434536218643, 0.018819842487573624, -0.0017679788870736957, 0.01539069227874279, 0.03827231004834175, 0.029923565685749054, 0.04560401663184166, -0.01634148508310318, 0.13736562430858612, -0.04287322983145714, 0.11060073226690292, -0.020277276635169983, -0.05309784412384033, -0.026169409975409508, -0.05232629179954529, -0.012727753259241581, 0.012429856695234776, 0.01682504639029503, -0.06929302215576172, -0.041000764816999435, -0.0003695122723001987 ] }, { "text": "Yet, when I open:\n\n File -> examples -> arduino_motion_inferencing -> Arduino Nano 33 BLE Sense Accelerometer Contionuous\n\nUpload and open serial monitor:", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_18", "embedding": [ 0.05267263203859329, -0.08275409787893295, -0.04973416030406952, -0.04176901653409004, 0.042153775691986084, -0.06331344693899155, -0.023874979466199875, 0.006358535494655371, -0.018570316955447197, 0.06534191966056824, 0.040310606360435486, -0.06612882018089294, -0.01812327466905117, -0.04856550693511963, -0.0006428803317248821, 0.05427442863583565, -0.017494406551122665, -0.03620346635580063, 0.06464282423257828, 0.04752116650342941, -0.012048717588186264, -0.034867335110902786, 0.045929789543151855, 0.03988705202937126, -0.07786747068166733, 0.013256683014333248, -0.0574348159134388, 0.017089448869228363, -0.018152764067053795, -0.01637740060687065, -0.06598038971424103, 0.05301079526543617, 0.08425362408161163, 0.024871328845620155, 0.024361399933695793, -0.018980279564857483, -0.0035517809446901083, -0.05337802320718765, -0.10402335971593857, -0.10084439814090729, 0.006390959024429321, -0.010707945562899113, -0.024679120630025864, 0.06094300374388695, -0.014813913963735104, -0.016313206404447556, 0.041659098118543625, -0.051445599645376205, 0.026926221325993538, 0.044160883873701096, -0.08284223079681396, 0.05028603971004486, 0.0678936094045639, 0.017970010638237, -0.053740501403808594, -0.007746262010186911, -0.043379686772823334, 0.014968396164476871, 0.07456286996603012, -0.023713592439889908, 0.03383748605847359, 0.007896979339420795, -0.1023935079574585, -0.0070655457675457, 0.020598262548446655, 0.016707323491573334, 0.030244650319218636, -0.007402544375509024, 0.02739126980304718, -0.03123726323246956, 0.046608664095401764, 0.02659536339342594, 0.009395327419042587, 0.022298548370599747, -0.0074089993722736835, -0.043796882033348083, -0.0321660153567791, -0.05482504144310951, 0.012433449737727642, -0.08956734836101532, 0.043802302330732346, -0.07000280916690826, 0.006168591324239969, 0.05013422667980194, 0.0470692478120327, 0.06852491945028305, 0.0016211565816774964, -0.0041167717427015305, -0.019888920709490776, -0.008944693952798843, -0.024316469207406044, -0.036244940012693405, -0.11156734824180603, -0.016963103786110878, 0.012290796265006065, -0.071247398853302, 0.01166352815926075, 0.07866951823234558, 0.025019468739628792, 0.031183432787656784, 0.018467977643013, -0.013254336081445217, -0.033970873802900314, 0.19880926609039307, -0.06134644150733948, -0.02641443721950054, 0.05731066316366196, -0.022296331822872162, 0.06310093402862549, 0.08464595675468445, 0.0072953226044774055, -0.05966297909617424, -0.021229414269328117, 0.024980029091238976, -0.017001772299408913, 0.09713105112314224, -0.1027095690369606, 0.0893465206027031, -0.01880629174411297, 0.03230158984661102, 0.0010091993026435375, -0.026804044842720032, -0.12636739015579224, -0.07990188151597977, 0.009631088003516197, -0.059762611985206604, 0.045976463705301285, 3.522911019008301e-33, 0.00456073647364974, -0.01468463335186243, -0.012885885313153267, 0.0084454957395792, -0.003144695423543453, -0.06535105407238007, -0.05327731370925903, 0.07366719841957092, -0.012848948128521442, -0.03103812411427498, 0.033063847571611404, 0.0035832771100103855, 0.018804730847477913, 0.1175173968076706, -0.015174996107816696, -0.001418641651980579, -0.028846343979239464, 0.01590207777917385, 0.060014549642801285, -0.04459910839796066, 0.05863317847251892, -0.09770692884922028, -0.08809392154216766, 0.005078233312815428, -0.054260898381471634, 0.09496177732944489, 0.08302634954452515, 0.1451646238565445, 0.04382820799946785, 0.01438859011977911, 0.01562795229256153, -0.010736302472651005, 0.006296505685895681, -0.06046346202492714, 0.022233352065086365, -0.07891470938920975, 0.059725571423769, 0.040406715124845505, -0.06539484858512878, -0.052943672984838486, 0.014126584865152836, 0.009702450595796108, -0.02060377039015293, -0.028938379138708115, -0.06541883945465088, -0.05868484824895859, 0.006224322132766247, 0.004450359381735325, 0.01954551413655281, 0.124102383852005, 0.007283598184585571, -0.05026349797844887, 0.004588243551552296, -0.1111975684762001, -0.0027031542267650366, -0.028717830777168274, -0.015071413479745388, -0.02370249293744564, -0.05391590669751167, 0.014757884666323662, 0.03538428246974945, 0.009205417707562447, 0.06911687552928925, -0.008012930862605572, 0.004844683222472668, 0.04663436487317085, 0.002124020829796791, 0.05153842642903328, 0.032546237111091614, 0.05149796977639198, -0.15054544806480408, 0.007443305104970932, -0.018598932772874832, -0.07139480859041214, -0.01233324222266674, 0.06405724585056305, -0.08642669767141342, 0.023526206612586975, -0.04133569449186325, -0.031086962670087814, 0.027631321921944618, -0.08320078998804092, 0.05894644558429718, 0.05465775355696678, -0.04500601813197136, -0.009131236933171749, -0.08710449188947678, -0.04363657534122467, -0.013817916624248028, 0.05081866681575775, 0.10683740675449371, -0.012360649183392525, -0.032046206295490265, 0.02879607491195202, -0.08345603942871094, -4.168657820372986e-33, -0.0457802452147007, 0.0677928477525711, -0.0823676809668541, -0.0045054093934595585, -0.07780841737985611, 0.05769140273332596, 0.11451519280672073, 0.03878920525312424, 0.0321759358048439, -0.020846311002969742, 0.02506348118185997, 0.04563604295253754, 0.023538853973150253, -0.01220537256449461, 0.03840033337473869, 0.05330762267112732, -0.03499109297990799, 0.008171829394996166, -0.06675536185503006, -0.015523786656558514, -0.030078541487455368, 0.03266625851392746, 0.06955397129058838, -0.05035009607672691, 0.04453740641474724, 0.03626791387796402, 0.006553775630891323, 0.023629292845726013, 0.024843702092766762, -0.07063928991556168, 0.045884400606155396, 0.04280390590429306, -0.04059750586748123, -0.00017286995716858655, 0.059352975338697433, -0.014182837679982185, 0.03146248310804367, -0.04399390518665314, 0.030287420377135277, 0.0033763370011001825, 0.01742049865424633, 0.11548004299402237, -0.0701344907283783, -0.010061037726700306, 0.07207723706960678, 0.022063584998250008, -0.00023543920542579144, 0.017497893422842026, 0.009707649238407612, -0.07425689697265625, -0.01760311797261238, -0.010080442763864994, 0.004050891380757093, -0.11801303178071976, 0.04017394036054611, 0.09318484365940094, 0.05966142565011978, 0.03427422046661377, -0.013874324969947338, 0.0026920021045953035, 0.0885276049375534, 0.03606701269745827, -0.1033354327082634, -0.07627609372138977, 0.019756710156798363, 0.03079959750175476, 0.045099589973688126, 0.014370345510542393, 0.011921803466975689, 0.05157632380723953, -0.021099720150232315, 0.024144263938069344, 0.02582728862762451, -0.009013368748128414, 0.01476992480456829, 0.00930680800229311, 0.017658989876508713, -0.06416483968496323, -0.1135188415646553, 0.003361050970852375, 0.04454037547111511, 0.03181616589426994, 0.06839301437139511, 0.030207939445972443, -0.054862599819898605, 0.06951474398374557, -0.026055749505758286, -0.014519136399030685, 0.004850064404308796, 0.09356356412172318, -0.04613357037305832, 0.03528137505054474, 0.07382957637310028, 0.07766137272119522, -0.08327393233776093, -3.332673159661681e-08, -0.0016215903451666236, 0.03207991272211075, -0.008482260629534721, -0.015625473111867905, 0.00039094832027330995, -0.006724064704030752, -0.01735585927963257, 0.0066858441568911076, 0.0718148946762085, -0.08703815191984177, -0.0022949513513594866, -0.10535665601491928, -0.037996940314769745, 0.057087793946266174, 0.07950477302074432, -0.003621196374297142, 0.02334635518491268, 0.009493005461990833, -0.07543805986642838, 0.0005834681214764714, 0.07966413348913193, 0.017574528232216835, -0.018890663981437683, 0.03124319575726986, 0.045652590692043304, -0.024412542581558228, -0.026417022570967674, 0.016671188175678253, 0.00639344472438097, -0.0399724580347538, -0.07123574614524841, 0.03660871833562851, 0.044590942561626434, -0.03018908202648163, -0.041091907769441605, 0.11070630699396133, 0.013401554897427559, 0.03870948404073715, 0.009583325125277042, -0.05461915209889412, -0.02414996735751629, 0.03775586932897568, -0.12556995451450348, -0.011433848179876804, -0.02907736413180828, -0.05303354561328888, -0.01838957890868187, 0.002676278119906783, -0.04164479300379753, 0.051251646131277084, -0.040625523775815964, -0.014849597588181496, 0.03259199857711792, 0.05207855999469757, 0.018495991826057434, -0.021381860598921776, -0.03329174593091011, -0.12095732986927032, -0.017494749277830124, 0.002198603469878435, 0.03991677984595299, -0.056691691279411316, -0.07517851144075394, -0.022295456379652023 ] }, { "text": "Predictions (DSP: 28 ms., Classification: 0 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]\n Predictions (DSP: 28 ms., Classification: 1 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]\n Predictions (DSP: 28 ms., Classification: 0 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]\n Predictions (DSP: 28 ms., Classification: 0 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]\n Predictions (DSP: 28 ms., Classification: 1 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]\n Predictions (DSP: 28 ms., Classification: 1 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]\n Predictions (DSP: 28 ms., Classification: 1 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]\n Predictions (DSP: 28 ms., Classification: 1 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_19", "embedding": [ -0.023586316034197807, -0.04521484673023224, 0.011201199144124985, 0.0967351496219635, 0.06750788539648056, -0.03694066032767296, 0.054909586906433105, 0.0093294158577919, -0.024744316935539246, -0.0238743107765913, -0.056633997708559036, -0.05983207747340202, 0.008064530789852142, -0.006225012242794037, -0.08412335067987442, 0.025970596820116043, -0.009686333127319813, -0.044084735214710236, -0.05209597572684288, -0.05237574502825737, 0.024531882256269455, 0.06269534677267075, -0.020915372297167778, 0.026770880445837975, 0.07103098928928375, 0.04012070596218109, -0.016955308616161346, 0.06882013380527496, -0.015583740547299385, -0.03803034499287605, -0.10253557562828064, 0.013004754669964314, 0.0692346841096878, 0.0027056108228862286, -0.040447063744068146, -0.055773138999938965, -0.03754659369587898, 0.0468229204416275, -0.009799014776945114, 0.012370395474135876, 0.02207755483686924, -0.013933381997048855, 0.06203239783644676, 0.026482120156288147, 0.01115263532847166, 0.001587173668667674, -0.0591278113424778, -0.10226999223232269, -0.05198786035180092, 0.013851499184966087, -0.06219897046685219, 0.009913560003042221, -0.03771735355257988, 0.028600754216313362, 0.0011619433062151074, 0.005434962455183268, 0.0021250329446047544, -0.09260032325983047, 0.04606005921959877, -0.038038209080696106, -0.01628013700246811, -0.03222796693444252, -0.06474414467811584, 0.013322338461875916, 0.051703836768865585, 0.03197351098060608, 0.001220154226757586, 0.030756698921322823, 0.024126829579472542, 0.07656372338533401, -0.05290285125374794, 0.029187321662902832, -0.08468928933143616, -0.018105825409293175, 0.023540135473012924, -0.0058243549428880215, 0.05586763471364975, -0.010104058310389519, 0.027876731008291245, -0.05363650619983673, -0.04124064743518829, -0.005644530523568392, -0.004874580539762974, -0.01142751332372427, 0.014113182201981544, -0.019157567992806435, 0.004015106707811356, 0.07972697168588638, -0.008098515681922436, 0.023422997444868088, -0.008929290808737278, 0.013616585172712803, -0.05668552219867706, 0.003972485661506653, 0.03139684721827507, 0.09594763070344925, 0.03628319501876831, -0.05201198533177376, 0.036120668053627014, 0.052705321460962296, -0.034612588584423065, 0.04596525430679321, -0.008926622569561005, 0.012109089642763138, 0.06583254039287567, -0.0023013753816485405, 0.033594436943531036, -0.014752219431102276, 0.003209606744349003, -0.06942245364189148, -0.02789389342069626, -0.004631610121577978, 0.02275223098695278, -0.08907796442508698, -0.019364500418305397, 0.09936462342739105, -0.07899482548236847, 0.06282464414834976, -0.028783021494746208, 0.07793550193309784, 0.0377495251595974, 0.019843513146042824, 0.07203708589076996, -0.0208943709731102, -0.0022358016576617956, 0.0070341359823942184, -0.10912767797708511, 2.6376260195948818e-33, 0.07432308048009872, -0.061724673956632614, -0.012721911072731018, -0.006990631576627493, 0.0024643882643431425, 0.002415816066786647, -0.05884062126278877, -0.005798604805022478, -0.002819706918671727, -0.01358798798173666, -0.07869046181440353, 0.022901326417922974, -0.007350221276283264, -0.004058434162288904, 0.03735831379890442, -0.03583573177456856, 0.05389639362692833, 0.10268521308898926, -0.08028262853622437, -0.002360772807151079, 0.0310459453612566, -0.018229864537715912, -0.038844604045152664, -0.08212364464998245, 0.05887366086244583, 0.06581294536590576, -0.011109297163784504, -0.018420085310935974, -0.05772755667567253, 0.029336536303162575, 0.016006415709853172, 0.07168154418468475, -0.08308641612529755, 0.019633105024695396, 0.046779099851846695, -0.01773039996623993, -0.014446870423853397, 0.057017117738723755, 0.05430511385202408, -0.042373161762952805, -0.08726412802934647, -0.009195948950946331, -0.02472403459250927, -0.02657575160264969, 0.0640845000743866, -0.030797675251960754, 0.007908130064606667, -0.0007000181940384209, -0.0823087990283966, 0.061566311866045, 0.004447968676686287, -0.03966112434864044, -0.02769722416996956, -0.020080257207155228, -0.09081436693668365, 0.0193744208663702, 0.02076970785856247, -0.01321530994027853, -0.022228647023439407, 0.08242980390787125, 0.008017216809093952, 0.03880078345537186, -0.022446703165769577, -0.1378272920846939, 0.058369532227516174, 0.13678744435310364, -0.010887597687542439, 0.02747317962348461, 0.05790337920188904, 0.028802618384361267, 0.06311112642288208, 0.027263399213552475, 0.009749721735715866, -0.026627393439412117, 0.05082313343882561, 0.008584471419453621, 0.03318055719137192, -0.029918810352683067, -0.12678134441375732, 0.011308742687106133, -0.000220923509914428, -0.02984650433063507, -0.07180464267730713, -0.06764495372772217, -0.021206585690379143, -0.06979994475841522, -0.005359860602766275, 0.027207911014556885, -0.12133485078811646, -0.002858774270862341, -0.1664077192544937, 0.03001997247338295, 0.044192563742399216, 0.05051622912287712, -0.11301044374704361, -2.936453397634208e-33, -0.02856215462088585, 0.04027716442942619, -0.026079514995217323, 0.016510723158717155, 0.023591794073581696, -0.0035697128623723984, 0.008802011609077454, 0.03502533584833145, -0.022601010277867317, 0.020944438874721527, -0.024203762412071228, 0.004022855311632156, 0.04874064773321152, -0.02412109635770321, -0.00941429939121008, -0.022203879430890083, -0.043343883007764816, 0.03214548900723457, -0.06103333830833435, 0.08802204579114914, 0.009764078073203564, 0.08562247455120087, -0.172777459025383, 0.016207586973905563, 0.030712084844708443, 0.10228979587554932, -0.020034151151776314, 0.08881208300590515, -0.04649526625871658, -0.01762254908680916, -0.07436762750148773, -0.05456763505935669, -0.05646000802516937, -0.04100915789604187, 0.04563814774155617, 0.08849513530731201, 0.050611622631549835, -0.08274538815021515, -0.03957967460155487, 0.04856891185045242, 0.031301531940698624, 0.05003143101930618, -0.06065874919295311, 0.027273021638393402, 0.04882214218378067, 0.019347261637449265, -0.009227830916643143, 0.07215330004692078, -0.015393262729048729, 0.0009598728502169251, 0.018837761133909225, 0.09460624307394028, -0.08143366873264313, 0.08338164538145065, 0.015286236070096493, 0.03266843408346176, -0.04508291929960251, -0.05877811834216118, -0.06182226538658142, 0.01936315931379795, -0.026239724829792976, 0.029400186613202095, 0.0203571580350399, 0.028939126059412956, 0.08755698800086975, 0.011990949511528015, -0.016046853736042976, -0.047660913318395615, -0.018463484942913055, -0.0017984106671065092, 0.027982531115412712, 0.051696110516786575, -0.12886060774326324, -0.04306931793689728, 0.03996838256716728, -0.009234663099050522, 0.042166560888290405, -0.018621163442730904, -0.007378004491329193, 0.038290347903966904, -0.0968901664018631, -0.018750684335827827, 0.11336004734039307, 0.08483516424894333, -0.04164164513349533, 0.0748036801815033, 0.05853375047445297, 0.052302390336990356, 0.04427148401737213, -0.04227127507328987, -0.044935114681720734, 0.028847618028521538, -0.027326231822371483, 0.1544746458530426, -0.024861058220267296, -5.1613923801596684e-08, -0.0462702251970768, -0.0213212501257658, 0.04354652389883995, 0.04935505613684654, 0.06257294863462448, 0.01387918833643198, -0.02613428793847561, 0.02505243942141533, -0.04903215914964676, -0.02575077675282955, 0.11226219683885574, -0.03806641325354576, -0.0738634541630745, -0.01198125071823597, 0.1001831665635109, -0.07540912926197052, -0.03418992832303047, 0.020253872498869896, -0.06242404133081436, -0.073367178440094, 0.0705355703830719, -0.00929228588938713, -0.013579301536083221, 0.019334830343723297, 0.04287972301244736, -0.08388122171163559, 0.03537589684128761, 0.05584953352808952, 0.047889094799757004, 0.06372831016778946, 0.015996692702174187, 0.02096961997449398, 0.011291717179119587, -0.04603245109319687, -0.0028105953242629766, 0.029452204704284668, 0.011659604497253895, -0.008447243832051754, 0.035735052078962326, 0.007329373154789209, -0.04096655920147896, -0.019270306453108788, -0.07051555067300797, 0.05708540603518486, 0.09158690273761749, -0.036192428320646286, -0.007900967262685299, -0.09264352172613144, 0.07286659628152847, -0.06896626949310303, 0.00238664704374969, -0.04073192551732063, -0.01513510849326849, 0.06529994308948517, 0.0530000664293766, 0.02068343386054039, -0.013477672822773457, -0.030227741226553917, -0.04312056303024292, -0.014010691083967686, 0.07347465306520462, -0.01993762142956257, -0.11878924816846848, 0.0303011666983366 ] }, { "text": "Predictions (DSP: 28 ms., Classification: 1 ms., Anomaly: 0 ms.): idle [ 0, 10, 0, 0, 0, 0, ]\n Predictions (DSP: 28 ms., Classification: 0 ms., Anomaly: 0 ms.): uncertain [ 3, 0, 4, 0, 3, 0, ]\n Predictions (DSP: 26 ms., Classification: 0 ms., Anomaly: 0 ms.): uncertain [ 3, 0, 4, 0, 3, 0, ]\n Predictions (DSP: 26 ms., Classification: 1 ms., Anomaly: 0 ms.): uncertain [ 4, 0, 4, 0, 2, 0, ]\n Predictions (DSP: 28 ms., Classification: 0 ms., Anomaly: 0 ms.): uncertain [ 5, 0, 4, 0, 1, 0, ]\n Predictions (DSP: 28 ms., Classification: 1 ms., Anomaly: 0 ms.): uncertain [ 6, 0, 3, 0, 1, 0, ]\n ....\n Predictions (DSP: 28 ms., Classification: 1 ms., Anomaly: 0 ms.): up-down [1, 0, 1, 8, 0, 0, ]", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_20", "embedding": [ -0.031011195853352547, -0.06321839243173599, 0.005337497219443321, 0.053223758935928345, 0.025900334119796753, -0.06076113507151604, 0.031033890321850777, 0.029584217816591263, 0.000677703763358295, -0.03316201642155647, -0.0769525095820427, -0.06619695574045181, 0.03395838662981987, -0.012600255198776722, -0.10979475826025009, 0.01920817419886589, -0.013319861143827438, -0.03407799452543259, -0.06838662177324295, -0.01730765774846077, 0.029825298115611076, 0.041721656918525696, -0.04452122002840042, 0.03494697064161301, 0.0686730444431305, 0.03208404406905174, -0.017496269196271896, 0.06723364442586899, -0.02667522430419922, -0.03866453096270561, -0.09553952515125275, 0.00247878092341125, 0.03811288997530937, -0.026280488818883896, -0.020240047946572304, -0.05899368226528168, -0.04431852698326111, 0.04297341778874397, 0.048167385160923004, 0.03489137440919876, 0.014255600981414318, -0.02543766237795353, 0.06286561489105225, 0.022275667637586594, 0.015789523720741272, 0.005538918077945709, -0.05124693363904953, -0.08675026148557663, -0.06286889314651489, 0.0003618073824327439, -0.0520097091794014, 0.0022684193681925535, -0.045566923916339874, 0.026223469525575638, -0.04061846807599068, -0.014485886320471764, -0.03236859291791916, -0.07566486299037933, 0.06087224557995796, -0.03529852628707886, 0.010271934792399406, -0.02146153338253498, -0.056212812662124634, 0.004892231430858374, 0.05971696227788925, 0.04676387459039688, -0.019727597013115883, 0.018226344138383865, 0.05350375548005104, 0.07842019945383072, -0.0364682637155056, 0.056085433810949326, -0.0774141177535057, -0.007296479772776365, 0.03168623149394989, -0.009715151973068714, 0.07729348540306091, 0.010451634414494038, 0.008127626962959766, -0.024365181103348732, -0.040247198194265366, 0.02211131528019905, 0.00026491336757317185, -0.024441437795758247, 0.0025144279934465885, -0.02280881442129612, -0.019580364227294922, 0.068931445479393, -0.015746627002954483, 0.03457881137728691, -0.010495741851627827, -0.017267785966396332, -0.046180907636880875, 0.020649082958698273, 0.027403274551033974, 0.10415700823068619, 0.05208241939544678, -0.07640352100133896, 0.05744774639606476, 0.04987293854355812, -0.0302177295088768, 0.03892912715673447, -0.006303455214947462, 0.0029957739170640707, 0.08291513472795486, -0.009049196727573872, 0.014684329740703106, -0.039021946489810944, -0.006869490724056959, -0.08562187850475311, -0.04684239998459816, -0.03776576742529869, 0.005234453361481428, -0.09790495783090591, -0.022764693945646286, 0.07999580353498459, -0.07132256031036377, 0.07479394227266312, -0.040009755641222, 0.07287262380123138, 0.012968145310878754, 0.03457265719771385, 0.07496687769889832, -0.0004497590125538409, -0.004116555210202932, 0.015423711389303207, -0.11124621331691742, 1.3801798760531107e-33, 0.0627753958106041, -0.05465297773480415, -0.014320123940706253, -0.017677273601293564, 0.012954388745129108, 0.030819909647107124, -0.045886456966400146, -0.02768339216709137, -0.031270772218704224, -0.0058561209589242935, -0.0708414688706398, 0.006350304465740919, 0.003253509756177664, -0.029361236840486526, 0.06431183964014053, -0.038267236202955246, 0.04628544673323631, 0.0595073401927948, -0.0826616883277893, -0.013975384645164013, 0.03585057333111763, -0.00997658260166645, -0.03797805681824684, -0.0705610066652298, 0.05758075788617134, 0.05726999044418335, -0.013144705444574356, 0.017526203766465187, -0.06911023706197739, 0.02391219139099121, -0.019244974479079247, 0.06935915350914001, -0.05598706007003784, 0.004022980108857155, 0.06533484160900116, -0.03678577393293381, -0.050226546823978424, 0.04589047655463219, 0.046587083488702774, -0.056800950318574905, -0.0536792129278183, -0.038618046790361404, -0.041767287999391556, 0.0008372124284505844, 0.07871641963720322, -0.02738410234451294, 0.01563233509659767, -0.02882586605846882, -0.061631396412849426, 0.018061678856611252, -0.00847407802939415, -0.036046382039785385, -0.01904645748436451, 0.0011934114154428244, -0.07859177142381668, 0.0035979105159640312, 0.017923323437571526, -0.007267381995916367, -0.031239133328199387, 0.04803241416811943, 9.092639811569825e-05, 0.003852625610306859, -0.029777860268950462, -0.14186176657676697, 0.07561396807432175, 0.1444724053144455, -0.027148831635713577, 0.03676219657063484, 0.04317886382341385, 0.025769896805286407, 0.03530628979206085, 0.018217965960502625, 0.008487358689308167, -0.020287400111556053, 0.07758814841508865, 0.012149641290307045, 0.05442541837692261, 0.011894941329956055, -0.07819899916648865, -0.013872034847736359, -0.05033990740776062, -0.019840270280838013, -0.06128577142953873, -0.03060995787382126, -0.0510844849050045, -0.05488172546029091, -0.0013862455962225795, 0.034151334315538406, -0.10948667675256729, -0.012555204331874847, -0.159578338265419, 0.03307415172457695, 0.06592781096696854, 0.06264771521091461, -0.1055988147854805, -2.4404151690673498e-33, -0.04869287088513374, 0.05551835522055626, -0.012227168306708336, 0.024926133453845978, 0.006520189810544252, -0.001114317448809743, 0.019254453480243683, 0.056612253189086914, -0.005438751075416803, 0.00038804500945843756, -0.02155047468841076, 0.02750195562839508, 0.0404098704457283, -0.03531109169125557, -0.0243686493486166, -0.0011429485166445374, -0.046417463570833206, 0.017512792721390724, -0.03245433047413826, 0.07174861431121826, 0.023712540045380592, 0.07914477586746216, -0.16997389495372772, 0.05366050451993942, 0.028830891475081444, 0.10102619230747223, 0.0027846999000757933, 0.04821285232901573, -0.04084835201501846, -0.019263071939349174, -0.064297616481781, -0.04257551580667496, -0.010299365036189556, -0.018477316945791245, 0.04747249558568001, 0.048530448228120804, 0.060976698994636536, -0.06604352593421936, -0.033699873834848404, 0.04090873897075653, 0.01709899865090847, 0.05126051604747772, -0.04270051047205925, 0.031870242208242416, 0.05695165693759918, 0.01027517206966877, 0.018952496349811554, 0.08014626801013947, -0.0013954628957435489, -0.0015144282951951027, -0.007448853459209204, 0.08990702778100967, -0.09471967071294785, 0.106837697327137, 0.033338308334350586, 0.045645371079444885, -0.05314189940690994, -0.05502935126423836, -0.06994424015283585, 0.045287925750017166, -0.06679140776395798, 0.030032988637685776, 0.036239657551050186, 0.04082592949271202, 0.09824681282043457, 0.05398772284388542, -0.05779219791293144, -0.03218439593911171, -0.006901187356561422, 0.004531077574938536, 0.024424979463219643, 0.0356396809220314, -0.11609728634357452, -0.05960589647293091, 0.06907325237989426, -0.057479776442050934, 0.043323881924152374, -0.004979022312909365, 0.015003660693764687, 0.0733344703912735, -0.07264159619808197, 0.018511220812797546, 0.10943236947059631, 0.10449641942977905, -0.014032251201570034, 0.06567870825529099, 0.07691828906536102, 0.06007028743624687, 0.05663570016622543, -0.04357491433620453, -0.031243355944752693, 0.04269314184784889, -0.0017712739063426852, 0.11924631148576736, -0.009837505407631397, -5.584660200952385e-08, -0.05104842782020569, -0.0051233889535069466, 0.02818613499403, 0.03409635275602341, 0.07312306016683578, 0.03392321616411209, -0.059094902127981186, 0.012855813838541508, -0.049690574407577515, -0.05667717382311821, 0.1069469004869461, -0.03353627398610115, -0.10004894435405731, -0.022936636582016945, 0.0841752365231514, -0.070201076567173, -0.051463380455970764, 0.020477840676903725, -0.04649605229496956, -0.08037465065717697, 0.05659038946032524, -0.008515817113220692, -0.007501634769141674, 0.01711159385740757, 0.07690983265638351, -0.07242798060178757, 0.011577660217881203, 0.07128803431987762, 0.010588832199573517, 0.08664581179618835, 0.022579044103622437, -0.01154712587594986, 0.03385631740093231, -0.02931513451039791, -0.007566463202238083, 0.06252114474773407, -0.002396639669314027, -0.03590348735451698, 0.035701099783182144, 0.019288966432213783, -0.021162722259759903, -0.0012489838991314173, -0.06586208939552307, 0.07233061641454697, 0.061461932957172394, -0.029301736503839493, 0.0027033884543925524, -0.07546811550855637, 0.05515854060649872, -0.0790628045797348, -0.028322406113147736, -0.007811881601810455, -0.03973579406738281, 0.08749348670244217, 0.07424500584602356, 0.0186894703656435, -0.03779318556189537, -0.05946691706776619, -0.06272921711206436, -0.029261514544487, 0.11199845373630524, -0.02844807133078575, -0.10509807616472244, 0.03098233789205551 ] }, { "text": "No errors!\n\nFirst 4 numbers in the list represents:\n- 1: circle\n- 2: idle \n- 3: left_right\n- 4: up_down", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_21", "embedding": [ -0.052533045411109924, 0.043602898716926575, -0.06981473416090012, 0.006165009457617998, 0.05614234879612923, -0.04256926849484444, 0.08307696878910065, 0.016770197078585625, -0.031146960332989693, -0.02457808330655098, 0.06733103096485138, 0.025909384712576866, 0.027653498575091362, -0.03858457878232002, -0.01720048300921917, 0.06385425478219986, -0.09687551856040955, -0.031875889748334885, 0.011940443888306618, -0.0542411170899868, -0.04938681051135063, 0.03676433488726616, -0.021510595455765724, 0.10530522465705872, 0.04203123226761818, 0.014561748132109642, -0.05445059761404991, 0.037073343992233276, -0.012504205107688904, -0.10676922649145126, -0.07847151905298233, 0.050586774945259094, 0.03268367424607277, -0.04289671406149864, 0.023042436689138412, 0.02318144030869007, 0.0028217523358762264, -0.023720869794487953, -0.04875322803854942, 0.010275570675730705, 0.051900412887334824, -0.07740461826324463, 0.0079035060480237, -0.06985194236040115, -0.0927584320306778, 0.06400085240602493, -0.07933086156845093, -0.036411773413419724, 0.0706653892993927, -0.0084158293902874, -0.08665803074836731, 0.06849571317434311, -0.039562538266181946, 7.593601185362786e-05, -0.0022907063830643892, 0.03790348395705223, -0.014981123618781567, -0.051699355244636536, 0.05800279229879379, 0.004889199975878, 0.08805039525032043, -0.009409925900399685, 0.012121056206524372, -0.009318535216152668, -0.02932777814567089, -0.017803141847252846, -0.020945699885487556, -0.06767798960208893, -0.06715365499258041, 0.05154092609882355, -0.0055974009446799755, 0.010018365457654, -0.03177625685930252, -0.056644733995199203, 0.041809502989053726, 0.018802400678396225, 0.010806767269968987, -0.01913144439458847, -0.060117438435554504, -0.0836639478802681, 0.016080912202596664, -0.03703421726822853, 0.018485812470316887, 0.06355095654726028, -0.04643373563885689, -0.022717947140336037, -0.04897068440914154, -0.009200782515108585, 0.006719011813402176, -0.0191670972853899, -0.004050143528729677, 0.01334865391254425, -0.018132399767637253, 0.05348577722907066, -0.016644788905978203, -0.0018641077913343906, 0.040660310536623, -0.004222596529871225, -0.13957257568836212, 0.051703549921512604, -0.03322284668684006, 0.003259887220337987, 0.0196666456758976, 0.03128522261977196, -0.02799610234797001, -0.013187335804104805, 0.046400658786296844, -0.04383785277605057, -0.00831212941557169, 0.0025614211335778236, -0.014649618417024612, -0.06626255810260773, -0.004867325536906719, 0.0037218164652585983, -0.02509436383843422, 0.07606636732816696, -0.042772237211465836, 0.02891031838953495, 0.008517654612660408, 0.011748085729777813, 0.07520492374897003, 0.023807285353541374, -0.056490760296583176, -0.009651639498770237, -0.051996976137161255, -0.07697399705648422, -0.022270990535616875, 1.7715684343410686e-33, 0.011260805651545525, -0.049812108278274536, 0.024731852114200592, 0.039199650287628174, -0.0025082004722207785, -0.07578505575656891, -0.12928913533687592, -0.012039410881698132, -0.007881706580519676, 0.06494200974702835, -0.002487531863152981, -0.029209496453404427, -0.01726287417113781, 0.05512033402919769, 0.015503630973398685, -0.06609497219324112, 0.13597822189331055, -0.026218201965093613, -0.06803523004055023, -0.044520340859889984, 0.04902304336428642, -0.03835258632898331, -0.11456165462732315, -0.03052305243909359, -0.03303505852818489, 0.19342924654483795, -0.03087105043232441, -0.011315216310322285, 0.0490918830037117, 0.02916119433939457, 0.0019138890784233809, -0.0402129590511322, -0.0028466361109167337, -0.015391823835670948, 0.024112772196531296, 0.04068117216229439, -0.02604936622083187, 0.04592964053153992, -0.026635155081748962, -0.06561779975891113, -0.04347046837210655, 0.018644044175744057, -0.0760897621512413, 0.005703868810087442, 0.049373965710401535, 0.03745632618665695, 0.038921553641557693, 0.0946754738688469, 0.012768547981977463, 0.12682616710662842, -0.11108472943305969, 0.03507176414132118, -0.05934322625398636, 0.004118312615901232, -0.08418189734220505, -0.05729888379573822, -0.0010370585368946195, 0.12050876766443253, -0.02049226686358452, 0.0004694336967077106, 0.01510107796639204, 0.06143532320857048, -0.009438807144761086, -0.10886964946985245, 0.02110050618648529, 0.037967655807733536, -0.07809808105230331, 0.005312928464263678, 0.020947057753801346, 0.05774751678109169, -0.01691204309463501, 0.04435492306947708, 0.0784318819642067, 0.11121456325054169, -0.013779332861304283, -0.03630060330033302, -0.00849468819797039, -0.10578172653913498, -0.06819826364517212, -0.02414627932012081, 0.017009414732456207, 0.03495471552014351, -0.016190148890018463, -0.0718703344464302, 0.02600000612437725, -0.12468183785676956, 0.05410078912973404, 0.07129521667957306, -0.015073011629283428, 0.06439753621816635, -0.016576530411839485, 0.047060027718544006, 0.10453518480062485, 0.04141976684331894, -0.16643865406513214, -4.645436859698567e-33, -0.004524166230112314, 0.07939250767230988, -0.004481104668229818, -0.05163850635290146, -0.02840052731335163, 0.05097814276814461, 0.1073700562119484, 0.012942702509462833, -0.000467719481093809, 0.06283166259527206, -0.03948909044265747, 0.06861215829849243, -0.04073352739214897, -0.018658556044101715, 0.11079627275466919, -0.02024771273136139, -0.04932719096541405, 0.0417398177087307, 0.0031150865834206343, 0.03587255999445915, -0.07945439964532852, 0.03652511164546013, -0.051728107035160065, -0.014214134775102139, -0.003897530259564519, 0.08680212497711182, 0.07532920688390732, 0.004122970160096884, 0.0010243323631584644, 0.004342658445239067, -0.04641317203640938, 0.014563470147550106, -0.004654789809137583, 0.13861407339572906, 0.01887485571205616, -0.03656170889735222, -0.02876356802880764, -0.021194666624069214, -0.07261460274457932, -0.0660729929804802, 0.012999380938708782, 0.043879080563783646, 0.017674097791314125, 0.007341224700212479, -0.0006458064308390021, -0.025323696434497833, 0.04922879859805107, 0.06547365337610245, -0.1079292893409729, -0.025186812505126, 0.0201586801558733, 0.0020054043270647526, -0.0010672446805983782, 0.0002772621519397944, 0.06115325540304184, 0.11009158194065094, -0.011142912320792675, 0.07448387145996094, 0.018137922510504723, 0.0029834865126758814, -0.021302370354533195, -0.038394831120967865, 0.005276845768094063, -0.005929279141128063, 0.040897075086832047, -0.037711385637521744, -0.007520448882132769, -0.04874013736844063, -0.03970303758978844, -0.01705053448677063, -0.031908463686704636, 0.06621748954057693, -0.050852883607149124, -0.05941751226782799, -0.04705258831381798, -0.008579912595450878, 0.010482199490070343, 0.029206782579421997, -0.025322936475276947, -0.015825437381863594, -0.07749620079994202, -0.027550334110856056, 0.03302175924181938, 0.005964681971818209, -0.08359712362289429, 0.0004993496695533395, 0.046340636909008026, 0.09514887630939484, -0.008263494819402695, 0.010251141153275967, 0.07478202134370804, 0.04018566384911537, 0.08296135812997818, 0.16296599805355072, 0.052571818232536316, -3.125963843331192e-08, -0.0276287030428648, -0.044925324618816376, -0.016479726880788803, 0.008473747409880161, 0.03862909972667694, -0.037482187151908875, 0.0157441608607769, -0.019919488579034805, -0.053000763058662415, -0.045465607196092606, -0.01475093699991703, 0.003753241151571274, -0.02781842090189457, 0.004384937696158886, 0.07383054494857788, -0.037386078387498856, -0.03979683667421341, 0.05079631507396698, 0.02145266719162464, -0.01786830462515354, 0.003340699477121234, -0.0785769522190094, -0.008404168300330639, -0.03954124078154564, -0.030390454456210136, -0.022659476846456528, -0.0042534442618489265, 0.055169325321912766, 0.0367128923535347, -0.0015230710851028562, 0.07012301683425903, 0.009667902253568172, 0.019303448498249054, -0.037652481347322464, 0.0033043918665498495, -0.10273945331573486, -0.005750512238591909, 0.057139091193675995, 0.020026642829179764, -0.015506512485444546, -0.036639418452978134, -0.054382991045713425, -0.07658040523529053, -0.0015108550433069468, 0.012951541692018509, 0.030973387882113457, -0.00774203659966588, -0.046584196388721466, -0.04142873361706734, -0.07091245800256729, -0.05358636751770973, -0.007234782446175814, 0.0703880712389946, -0.0044234623201191425, 0.06530565768480301, -0.03551584854722023, 0.056152381002902985, 0.01779448427259922, -0.0385383702814579, 0.02122792787849903, -0.02151426672935486, 0.02363508567214012, -0.08697493374347687, 0.016089744865894318 ] }, { "text": "## Key Words\nTiny ML, Arduino, Edge Impulse, Deployment", "source": "2021-11-28-Deploy-To-Arduino.md", "type": "markdown", "chunk_id": "2021-11-28-Deploy-To-Arduino.md_22", "embedding": [ 0.022841451689600945, -0.06543907523155212, 0.02894446812570095, -0.0225983913987875, 0.0188773050904274, -0.05495224520564079, 0.06742576509714127, 0.00910708773881197, -0.10417500883340836, -0.010689995251595974, 0.1234516128897667, 0.02197163924574852, -0.004341976251453161, -0.07115171104669571, -0.06878533214330673, 0.11032164841890335, 0.04543948546051979, -0.04382731020450592, -0.06950441002845764, -0.029032327234745026, 0.05235778167843819, -0.01211889274418354, -0.06928324699401855, 0.010573936626315117, 0.0537661649286747, 0.08485481142997742, -0.020878175273537636, 0.03735394775867462, 0.06257740408182144, -0.09623660892248154, 0.06034693121910095, 0.07332608848810196, 0.10638654977083206, 0.04291265457868576, 0.08694209903478622, 0.035744886845350266, -0.023953000083565712, -0.018475081771612167, 0.014852697029709816, -0.012560244649648666, 0.010293983854353428, -0.09098923206329346, 0.007665520068258047, -0.005849093198776245, 0.033248767256736755, -0.0021299768704921007, -0.026093102991580963, -0.07067516446113586, -0.004834693390876055, -0.04200879856944084, -0.05863530561327934, -0.09577403217554092, -0.08548334240913391, -0.02246827632188797, -0.04834330454468727, -0.12202081084251404, -0.008362208493053913, -0.011193097569048405, 0.08854088187217712, 0.046161338686943054, 0.008087005466222763, 0.004262471571564674, -0.026974771171808243, 0.0019890288822352886, -0.04951244592666626, 0.026058316230773926, 0.031360119581222534, -0.019903773441910744, -0.03764418140053749, 0.04189060628414154, 0.056269653141498566, 0.07573522627353668, -0.03427083045244217, 0.05955012887716293, -0.011653623543679714, -0.0068497746251523495, 0.02096344716846943, -0.04945209249854088, -0.014832873828709126, 0.03318529576063156, -0.07107008993625641, -0.08615709096193314, -0.10286217927932739, 0.0860559418797493, 0.00807096716016531, 0.039585381746292114, -0.01790180802345276, 0.004003659822046757, 0.024204524233937263, -0.018511924892663956, -0.04939679056406021, -0.041684284806251526, -0.017353851348161697, 0.02912680245935917, -0.006134652066975832, 0.007343098986893892, 0.005953038576990366, -0.09352077543735504, -0.1030958816409111, 0.0615231916308403, -0.023192405700683594, -0.06362775713205338, 0.006718310061842203, -0.054666247218847275, -0.0550040565431118, -0.016609633341431618, 0.0479670986533165, 0.02746691182255745, 0.0848260223865509, 0.018105540424585342, -0.015091996639966965, -0.028181135654449463, -0.10534976422786713, -0.07255992293357849, 0.031992800533771515, -0.09023042023181915, -0.06317092478275299, -0.0245676189661026, 0.06893160939216614, -0.018844256177544594, -0.004548237659037113, 0.032767169177532196, -0.03970642015337944, -0.057168617844581604, -0.014631827361881733, -0.02514473721385002, -0.04538295790553093, 1.6910538900953317e-34, 0.016448646783828735, 0.017836954444646835, -0.08170153200626373, 0.06819538027048111, 0.07231094688177109, 0.009736910462379456, 0.014377113431692123, -0.04882713034749031, 0.0015562043990939856, 0.030006282031536102, -0.10090627521276474, -0.010433883406221867, -0.046467602252960205, 0.05901378020644188, 0.06428598612546921, -0.16136464476585388, 0.05373360589146614, 0.03265408053994179, -0.0123777249827981, -0.02555687353014946, 0.014137458987534046, 0.021910378709435463, -0.04892553389072418, 0.03842528164386749, -0.02473367005586624, 0.09171473979949951, 0.029708951711654663, -0.030398456379771233, 0.0811442956328392, 0.08571239560842514, -0.08910629153251648, 0.06632553786039352, -0.002594220684841275, -0.021108951419591904, -0.001447448623366654, 0.027776120230555534, -0.049814894795417786, -0.05260561406612396, 0.0013592388713732362, -0.021265704184770584, -0.004701347555965185, 0.03643135726451874, -0.03491378203034401, -0.09559464454650879, 0.00874432735145092, -0.03005235455930233, 0.02855827659368515, 0.028870493173599243, 0.03227236866950989, 0.005577820353209972, -0.034788183867931366, 0.0376649834215641, 0.09435419738292694, 0.008440288715064526, 0.07131960988044739, -0.025085821747779846, 0.00028732969076372683, 0.07869309186935425, 0.05967804417014122, 0.056759871542453766, -0.02739102393388748, -0.030379973351955414, 0.013193967752158642, 0.031347569078207016, 0.07881496101617813, -0.01661057583987713, 0.021146317943930626, 0.017293471843004227, -0.005886795464903116, 0.06962314993143082, -0.06851030141115189, 0.06009877845644951, 0.04763235151767731, -0.0397118479013443, -0.029702141880989075, -0.030606940388679504, -0.03300661966204643, 0.011252638883888721, -0.038602810353040695, -0.008968132548034191, -0.09786012768745422, 0.012277011759579182, -0.011181133799254894, -0.05633416771888733, 0.03523669019341469, 0.02532937377691269, 0.032542601227760315, -0.08200600743293762, -0.05802762135863304, 0.005777833983302116, -0.065175861120224, 0.008117451332509518, -0.07587889581918716, 0.0015583247877657413, -0.10370732843875885, -5.427825420290239e-34, -0.009582113474607468, 0.07323356717824936, 0.024050604552030563, 0.08098811656236649, -0.037880729883909225, 0.031810395419597626, 0.07343587279319763, 0.016259703785181046, 0.0006382537540048361, 0.04347812011837959, -0.010428632609546185, 0.034098073840141296, -0.040123697370290756, -0.03853195533156395, -0.0049027614295482635, -0.03172120451927185, 0.013472755439579487, -0.03701295703649521, 0.06330829858779907, 0.01124546304345131, -0.03838600963354111, 0.01699092611670494, -0.01622711680829525, 0.04524070397019386, 0.0031329563353210688, 0.003792352508753538, -0.08101750910282135, 0.11140929907560349, 0.07236137986183167, -0.018479783087968826, 0.03881751373410225, 0.03190504387021065, -8.960947161540389e-05, -6.804065924370661e-05, 0.02237781509757042, 0.050091832876205444, 0.09454844146966934, 0.03167562186717987, 0.026759784668684006, -0.019725440070033073, 0.06603097170591354, -0.04159855097532272, 0.00870540365576744, -0.0137336952611804, -0.03953428566455841, 0.03699420019984245, -0.007983607240021229, 0.0018720371881499887, -0.042775705456733704, -0.03664876148104668, -0.0018668713746592402, -0.0017629236681386828, -0.06332167237997055, -0.0011213197140023112, -0.018962182104587555, -0.011555126868188381, 0.035146117210388184, 0.06878505647182465, -0.016970409080386162, 0.009331618435680866, 0.0058250147849321365, -0.11160782724618912, 0.044307515025138855, -0.036600951105356216, -0.03107290528714657, 0.04412723705172539, -0.023132337257266045, -0.00258125108666718, -0.1458919495344162, 0.05094458535313606, 0.009584164246916771, 0.0671887919306755, 0.012697779573500156, -0.03696933388710022, -0.10833747684955597, -0.06510820239782333, -0.05375402048230171, -0.028110770508646965, 0.006967481691390276, 0.009801922366023064, 0.07374224811792374, 0.015724657103419304, -0.06672215461730957, 0.024852795526385307, -0.006967032793909311, -0.006615052931010723, 0.06461521983146667, 0.05089731514453888, -0.03805256634950638, -0.018614696338772774, -0.06905713677406311, 0.037475116550922394, 0.023585626855492592, 0.10107465833425522, -0.10085996240377426, -2.2154573287025414e-08, -0.0734768882393837, 0.04522031545639038, 0.0057964324951171875, 0.007192863617092371, 0.0380605012178421, 0.041699618101119995, -0.0324166864156723, 0.024534767493605614, 0.07915859669446945, -0.01482898648828268, 0.07202434539794922, -0.07928834110498428, -0.07431241124868393, 0.10001368820667267, 0.05363648012280464, 0.05538122355937958, -0.07735317200422287, 0.04029332101345062, 0.023983696475625038, -0.09841948747634888, -0.02464822493493557, 0.01960921287536621, 0.030860912054777145, -0.03179512917995453, 0.027629844844341278, -0.019487211480736732, -0.013045636005699635, 0.086983323097229, 0.026861725375056267, 0.026739073917269707, -0.032570526003837585, 0.030178703367710114, 0.03194576874375343, 0.046361394226551056, -0.08337142318487167, 0.0663662850856781, -0.025775810703635216, 0.058740559965372086, 0.06829950958490372, 0.021584929898381233, -0.03088071383535862, 0.07931548357009888, -0.08751467615365982, -0.019406933337450027, -0.040580134838819504, 0.009946702979505062, -0.005385315045714378, -0.06845813244581223, -0.0834287479519844, -0.022003646939992905, 0.026846272870898247, 0.04833824932575226, 0.05558142811059952, 0.06441416591405869, 0.07303459942340851, 0.07604116201400757, 0.05739528313279152, -0.04884837195277214, 0.04976845532655716, 0.07972511649131775, 0.07066939026117325, 0.01081943977624178, 0.0028157520573586226, 0.032792869955301285 ] }, { "text": "---\ntitle: \"NER\"\nid: \"ner\"\ncategory: \"deep-learning\"\ntags: [\"deep learning\", \"dl\", \"ner\", \"from scratch\", \"medium\"]\nrelated: [\"dl\"]\ndate: \"2023-08-16\"\ndescription: \"Build your NER data from scratch and learn the details of the NER model\"\n---\n\n\n[Read the full version on Medium](https://medium.com/@balci.pelin/ner-8eb9694ccad3) \n\nBuild your NER data from scratch and learn the details of the NER model.", "source": "2023-08-16-NER.md", "type": "markdown", "chunk_id": "2023-08-16-NER.md_0", "embedding": [ -0.0950629860162735, -0.06247982010245323, 0.018226545304059982, -0.030629366636276245, -0.01596766896545887, -0.07025427371263504, -0.04398128017783165, -0.033444520086050034, -0.06835838407278061, -0.05295476317405701, 0.01219229493290186, -0.08468688279390335, -0.052967362105846405, 0.0553581602871418, -0.054533183574676514, 0.01425338163971901, 0.0007031651912257075, -0.00578853627666831, -0.09809748083353043, -0.1088583916425705, -0.04227251559495926, 0.07958854734897614, 0.012208225205540657, -0.07460612058639526, 0.00876415241509676, -0.023725176230072975, 0.009459718130528927, -0.0013048365944996476, 0.03829878568649292, -0.04435311630368233, 0.04065600410103798, 0.004163164179772139, 0.013309461064636707, 0.024458350613713264, 0.009781813248991966, -0.003171013668179512, -0.09613562375307083, 0.05111861974000931, 0.011630739085376263, 0.03538314625620842, 0.08162038028240204, -0.03177082538604736, -0.015412859618663788, 0.009669174440205097, 0.03208470344543457, 0.06769508123397827, -0.06998122483491898, -0.055162928998470306, 0.0638299360871315, 0.03160925209522247, -0.09913988411426544, -0.04263831675052643, -0.018035240471363068, 0.06849034130573273, 0.03248654678463936, 0.057759840041399, -0.014456337317824364, -0.05743764340877533, -0.017070604488253593, 0.00035634738742373884, 0.02415466122329235, 0.016000205650925636, -0.013690329156816006, -0.017216188833117485, 0.02942236326634884, 0.048216596245765686, 0.01569374091923237, 0.05117451027035713, -0.003943097312003374, -0.01625588908791542, 0.025525718927383423, 0.04615266993641853, -0.02568143419921398, -0.024632653221488, -0.05184314027428627, -0.04609307646751404, 0.014850337989628315, 0.04005490988492966, 0.03405299410223961, -0.0219595804810524, 0.0018875644309446216, 0.0648365169763565, -0.014269172213971615, 0.06628680229187012, 0.06984498351812363, -0.026136497035622597, -0.012797828763723373, 0.0033723986707627773, -0.06355299800634384, -0.03324917331337929, -0.07960138469934464, -0.0678720623254776, -0.027655189856886864, -0.0068991100415587425, -0.03236354514956474, 0.03590492159128189, -0.025703614577651024, -0.032478999346494675, 0.0007372389663942158, 0.05783548578619957, -0.021051162853837013, 0.005971211474388838, 0.005506918765604496, 0.02227138914167881, -0.0869598239660263, 0.0053176069632172585, 0.0855458527803421, 0.08300311118364334, 0.05135100334882736, 0.03270162642002106, 0.04680219292640686, 0.07989522814750671, -0.005010034888982773, -0.047586485743522644, 0.07167705148458481, 0.00010612030746415257, -0.03633294999599457, 0.006443295162171125, 0.06929495185613632, 0.024500785395503044, -0.00380325666628778, -0.021273883059620857, -0.08296161144971848, -0.005683948285877705, -0.0010136488126590848, 0.014013072475790977, -0.06204536557197571, 3.6997061040559426e-33, 0.018832385540008545, 0.05127948150038719, 0.000371037662262097, 0.099952332675457, 0.0013193388003855944, -0.013560923747718334, -0.03868129104375839, 0.05808734521269798, -0.07166639715433121, 0.035624224692583084, -0.007867000997066498, -0.00264148972928524, -0.0989496260881424, 0.10242080688476562, -0.050703879445791245, -0.011342737823724747, -0.010297493077814579, -0.07024824619293213, -0.007733202073723078, 0.0010856392327696085, 0.05080009251832962, 0.0032957408111542463, -0.04417934641242027, -0.023929087445139885, 0.016059162095189095, -0.02751815877854824, -0.03778829798102379, -0.058734819293022156, -0.05407566949725151, -0.045090451836586, -0.031384967267513275, -0.0058494796976447105, 0.0179916825145483, 0.004369147587567568, 0.04694140702486038, 0.02191992476582527, 0.030418802052736282, 0.03466879948973656, 0.010673861019313335, -0.08224834501743317, 0.0685015395283699, 0.07577633112668991, -0.03408137336373329, -0.1155361458659172, -0.007136170286685228, 0.053894057869911194, 0.04437259957194328, -0.07521839439868927, 0.03775344789028168, -0.010755933821201324, 0.04829799011349678, -0.060958631336688995, -0.07901667058467865, -0.056732162833213806, -0.021195800974965096, -0.02075784094631672, -0.03803129121661186, 0.025584379211068153, 0.05746250972151756, 0.04249555617570877, 0.07019166648387909, -0.012882135808467865, 0.0008855566848069429, 0.01639159955084324, 0.061078161001205444, 0.03407910093665123, 0.03104836866259575, 0.01610868237912655, 0.08665738999843597, -0.07518022507429123, -0.05771098658442497, 0.07905250042676926, 0.05680699273943901, -0.004543935414403677, 0.007603372912853956, 0.01631893776357174, -0.05970234423875809, -0.12005376070737839, -0.0024545418564230204, 0.03302997723221779, 0.028347410261631012, 0.04597504064440727, -0.059631552547216415, -0.017892364412546158, -0.030235623940825462, 0.0026841768994927406, 0.02920488826930523, -0.04809599742293358, 0.021794991567730904, -0.02995442785322666, -0.012246505357325077, 0.008175558410584927, -0.09959592670202255, -0.053662098944187164, 0.005025950260460377, -4.003551189934349e-33, 0.02043398842215538, 0.028646547347307205, -0.061201419681310654, 0.015497593209147453, 0.018086997792124748, -0.016873177140951157, -0.016623826697468758, 0.08343922346830368, 0.005967378616333008, 0.011024928651750088, 0.0566127672791481, 0.02021787129342556, 0.041168611496686935, -0.018920069560408592, 0.03783949837088585, -0.02593826688826084, -0.11291643232107162, 0.026659617200493813, 0.01859777234494686, 0.030407505109906197, -0.003945161588490009, 0.09331925213336945, -0.12323077023029327, 0.040181227028369904, -0.005433079320937395, 0.029128005728125572, 0.05028984323143959, 0.09454993158578873, -0.02605830878019333, 0.013905692845582962, -0.05419159680604935, -0.030725330114364624, -0.0419476144015789, -0.030176253989338875, -0.017519567161798477, 0.026058653369545937, 0.050244178622961044, -0.06863456964492798, -0.00970632303506136, -0.10363662242889404, 0.08114970475435257, 0.10183874517679214, -0.04731040447950363, -0.0446065329015255, -0.030786987394094467, -0.05889005586504936, -0.02675361931324005, 0.01114386972039938, 0.013093952089548111, -0.04735285043716431, 0.0860266387462616, -0.08674028515815735, -0.03636801615357399, -0.07164574414491653, -0.014493772760033607, 0.05449756234884262, 0.09701626002788544, -0.041444554924964905, 0.0358753465116024, 0.038508880883455276, -0.06735213100910187, -0.029267357662320137, -0.030508384108543396, 0.011315401643514633, -0.10645505785942078, -0.03741798177361488, -0.05274563655257225, 0.07367131114006042, -0.08196695894002914, 0.004737996030598879, -0.028943007811903954, 0.10065288096666336, 0.04341841861605644, -0.03303031623363495, -0.028254348784685135, -0.1602829247713089, -0.021189158782362938, 0.07551323622465134, -0.01541779562830925, -0.0432698093354702, 0.022117171436548233, -0.04501143470406532, -0.042633458971977234, 0.11462845653295517, 0.08216170221567154, 0.09801635146141052, 0.03517117351293564, -0.028826678171753883, -0.0016648408491164446, -0.057688158005476, -0.09187953919172287, 0.013334422372281551, -0.006849908735603094, 0.07986391335725784, -0.029245465993881226, -5.2071822409516244e-08, 0.0025558904744684696, 0.026566823944449425, 0.007970771752297878, 0.01008895318955183, 0.04996390640735626, 0.026194721460342407, -0.0029008733108639717, 0.003145149676129222, -0.023857060819864273, 0.07711385935544968, 0.06447483599185944, -0.03220034018158913, -0.08834484219551086, 0.017265047878026962, 0.027595333755016327, 0.12576046586036682, 0.07532843202352524, 0.06273309886455536, 0.035912007093429565, -0.024674179032444954, 0.09159522503614426, 0.08086737990379333, 0.03767413645982742, 0.0009731013560667634, 0.09811567515134811, -0.07438725233078003, 0.002293969737365842, 0.0016754326643422246, 0.04633016884326935, -0.039713092148303986, -0.03940048813819885, 0.05366502329707146, 0.057461898773908615, -0.032104745507240295, 0.07924079149961472, 0.045544855296611786, 0.0028997871559113264, 0.018597811460494995, 0.030822616070508957, -0.0650620087981224, -0.011692346073687077, 0.07442569732666016, -0.06410371512174606, -0.016795536503195763, -0.0318404883146286, -0.02664005011320114, -0.07013020664453506, -0.1383945494890213, 0.008964990265667439, 0.0568457767367363, 0.08066907525062561, -0.0049336859956383705, 0.04513655975461006, 0.11491414159536362, 0.008838389068841934, 0.027978187426924706, -0.022966673597693443, 0.030775276944041252, 0.018469907343387604, 0.0590972974896431, 0.09462042152881622, 0.012235159985721111, -0.05670253559947014, 0.09104765206575394 ] }, { "text": "FFT_PSD\n\nFast Fourier Transform & Spectral Analysis¶\n\nThis month, I took a lecture from Coursera, Introduction to Embedded Machine Learning. In this course, we use the Arduino board to train audio and motion data. This is the first time I dealt with audio & vibration analysis. As you guess, the critical part of the training model is feature extraction. Thanks to edge impulse, I didn't need to deal with feature extraction during the project, since it analyses the data automatically and chooses the right data for the model. However, I don't want to use data that I have no idea about, therefore, I've searched fast Fourier transform and power spectral density.", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_0", "embedding": [ -0.03184099122881889, -0.024240005761384964, -0.049359969794750214, 0.05606849491596222, 0.020801633596420288, 0.02436167746782303, -0.030339829623699188, -0.04084700345993042, -0.06485936045646667, -0.038998570293188095, 0.00841562170535326, 0.016253231093287468, -0.11440829187631607, -0.016122134402394295, 0.02277323603630066, -0.014664482325315475, 0.06931095570325851, 0.06530884653329849, -0.007464835420250893, -0.0679016038775444, 0.038883794099092484, 0.04148084670305252, -0.025236601009964943, -0.023725833743810654, 0.05282646417617798, 0.06279704719781876, -0.0023334785364568233, -0.012705741450190544, 0.03871193155646324, 0.015954336151480675, 0.037895914167165756, 0.011672758497297764, -0.0030531452503055334, 0.020467769354581833, 0.007917688228189945, -0.05277355760335922, 0.07037528604269028, 0.036652546375989914, 0.002781360177323222, 0.013428626582026482, 0.0439378097653389, -0.017602328211069107, 0.021423276513814926, -0.03722153604030609, 0.004555311053991318, -0.04084619879722595, -0.06390950083732605, -0.10327199101448059, -0.033388666808605194, -0.035305749624967575, -0.010924031026661396, 0.014633755199611187, -0.014735564589500427, 0.06475602090358734, -0.0677645355463028, 0.0004014254664070904, 0.09768243879079819, -0.04796017333865166, 0.06835853308439255, -0.034549567848443985, -0.01887972094118595, -0.05205842852592468, -0.05536888167262077, -0.0036512077786028385, 0.035031840205192566, -0.025619585067033768, 0.014957309700548649, -0.004659626632928848, 0.05504029989242554, -0.08362314850091934, -0.09472541511058807, 0.05022399127483368, -0.05025701969861984, 0.04795216768980026, -0.018553921952843666, 0.02893863432109356, -0.039180442690849304, -0.01709132455289364, -0.01921731047332287, -0.018301650881767273, 0.07406675815582275, 0.014536949805915356, 0.06387283653020859, -0.014955389313399792, 0.0694955363869667, 0.08431461453437805, -0.029060855507850647, 0.06735291332006454, -0.10603201389312744, -0.0013961289077997208, -0.027051443234086037, -0.018463853746652603, -0.0022253654897212982, -0.021229373291134834, -0.018543310463428497, 0.05868567153811455, -0.030412225052714348, -0.07750353217124939, -0.03509131446480751, 0.019168980419635773, -0.04050656408071518, 0.007583640981465578, -0.012214811518788338, 0.09461333602666855, -0.1330346316099167, -0.03860286623239517, -0.07704431563615799, 0.019415853545069695, 0.030259251594543457, -0.018278932198882103, 0.007922785356640816, 0.022611035034060478, -0.15428972244262695, -0.04583078622817993, 0.09843730926513672, 0.06480958312749863, -0.05411700904369354, 0.030520416796207428, 0.012178156524896622, 0.044161710888147354, -0.05162600800395012, -0.05933758616447449, -0.0013864259235560894, 0.14438515901565552, 0.06455530971288681, -0.028676245361566544, -0.11501067131757736, -9.967306800790035e-34, -0.009866205044090748, 0.042216964066028595, -0.04955863952636719, -0.07413176447153091, -0.0021636926103383303, -0.03871038183569908, -0.002326009562239051, 0.027331160381436348, 0.10593241453170776, 0.09883193671703339, -0.01931873895227909, 0.10786677896976471, 0.0198249239474535, 0.02730398252606392, -0.021022656932473183, -0.0018479916034266353, -0.04740643501281738, 0.035099226981401443, 0.02002665586769581, -0.055449191480875015, 0.09816398471593857, 0.010368363000452518, 0.08231674134731293, 0.11503128707408905, 0.0014569939812645316, -0.003075973829254508, -0.0513879619538784, 0.01806553453207016, -0.012183566577732563, 0.04777347296476364, -0.03935174643993378, -0.028396839275956154, -0.027910668402910233, -0.053407248109579086, 0.03767269849777222, -0.035219673067331314, 0.03611927106976509, -0.027595827355980873, -0.0009084690827876329, -0.04873766005039215, 0.0036586360074579716, -0.04132336005568504, 0.002616085344925523, -0.05499112233519554, -0.09654563665390015, 0.014183299615979195, 0.014409338124096394, -0.03304368257522583, 0.0014184031169861555, 0.003806125372648239, -0.039434999227523804, 0.006312775891274214, -0.07446668297052383, 0.008818969130516052, -0.026813102886080742, 0.029260272160172462, 0.04077718406915665, -0.0019030774710699916, 0.06536246091127396, 0.009397645480930805, -0.012246566824615002, 0.021353641524910927, 0.06308001279830933, -0.026316890493035316, -0.06314872205257416, -0.054928410798311234, 0.00528209051117301, 0.0267336443066597, 0.08002490550279617, -0.011499013751745224, -0.022147418931126595, 0.0663810670375824, 0.04335431382060051, -0.06612756103277206, 0.09504936635494232, 0.00377945345826447, 0.02462991699576378, 0.06322403997182846, -0.12219574302434921, 0.03378964588046074, 0.009237206541001797, 0.02646748721599579, 0.04298487305641174, -0.04126818850636482, 0.028094837442040443, -0.023265236988663673, -0.00661721033975482, -0.08974745124578476, -0.06525129079818726, -0.051277998834848404, -0.08108041435480118, 0.07852336019277573, -0.01215666439384222, 0.031613539904356, -0.006016298662871122, -1.619189400109338e-34, 0.05839549005031586, 0.04474291577935219, 0.027455542236566544, -0.03351867198944092, 0.03712848573923111, 0.0031101105269044638, -0.0392100028693676, 0.09546347707509995, 0.01778903231024742, -0.0802229568362236, 0.043393880128860474, -0.04514678567647934, -0.03189036250114441, -0.07020235061645508, 0.015057062730193138, 0.01821879670023918, -0.13997527956962585, -0.05524055287241936, 0.026620041579008102, 0.07781007140874863, -0.07366357743740082, 0.03710974007844925, -0.007479427382349968, 0.07690572738647461, -0.04150013253092766, 0.01621551811695099, 0.002925300970673561, -0.08397220075130463, -0.003207945730537176, 0.02809588983654976, -0.08968419581651688, 0.01760144531726837, -0.0601918064057827, -0.024316787719726562, -0.0870802253484726, 0.03182949870824814, 0.036167994141578674, 0.044601716101169586, 0.053159378468990326, 0.011815625242888927, 0.023004038259387016, 0.08829667419195175, -0.020095720887184143, -0.05904741957783699, -0.024013886228203773, -0.00625896779820323, 0.028075240552425385, 0.05935308709740639, 0.06865136325359344, -0.015550517477095127, 0.1204301193356514, 0.027323007583618164, 0.014898138120770454, -0.03243488445878029, -0.020134784281253815, -0.0305307749658823, 0.06892022490501404, 0.01272452250123024, -0.031225761398673058, -0.004372012335807085, -0.055443938821554184, -0.02685372903943062, -0.003595692105591297, 0.018097534775733948, 0.036145832389593124, -0.005368832964450121, 0.060432665050029755, -0.02500160224735737, 0.013209718279540539, 0.07750654965639114, -0.042021796107292175, 0.028430359438061714, 0.03673228994011879, 0.13698215782642365, -0.04940946027636528, -0.032551683485507965, 0.01130848377943039, -0.05616864189505577, -0.03519473224878311, 0.05360138788819313, -0.007573842070996761, 0.017631586641073227, -0.04885495826601982, 0.04446600005030632, 0.06666801124811172, 0.0580732561647892, -0.01931721344590187, -0.10228285193443298, 0.01747722551226616, -0.08268318325281143, -0.03570128232240677, 0.10675951093435287, 0.03151411935687065, 0.04242532327771187, 0.055123280733823776, -4.692722299637353e-08, -0.0066087814047932625, -0.06438929587602615, -0.0019381737802177668, 0.0019316066754981875, 0.06798189878463745, -0.019986942410469055, 0.006335872691124678, 0.05960523337125778, -0.028880160301923752, -0.06985866278409958, -0.007417548913508654, -0.06340668350458145, -0.0009694105829112232, 0.03533439710736275, 0.017817651852965355, -0.032095201313495636, 0.050899263471364975, 0.07943500578403473, -0.010408242233097553, -0.07402626425027847, 0.035169970244169235, 0.04495900869369507, 0.13797925412654877, -0.061724953353405, 0.05574122071266174, -0.023499969393014908, -0.022380774840712547, -0.015307764522731304, 0.047989409416913986, 0.06841553747653961, -0.08890201151371002, -0.0005694365245290101, -0.0395079180598259, -0.030782457441091537, 0.09436242282390594, 0.06878162920475006, -0.0075991046614944935, -0.0733119398355484, -0.10593671351671219, 0.015415556728839874, -0.005843925755470991, 0.11818727850914001, -0.04367772489786148, -0.0196344293653965, -0.020052632316946983, -0.014066645875573158, 0.04574740305542946, -0.06122695282101631, 0.016029125079512596, 0.11064111441373825, 0.016349395737051964, 0.02833038941025734, -0.04005882516503334, 0.018650958314538002, -0.037963710725307465, 0.0885743498802185, -0.0071522025391459465, -0.06184156611561775, -0.030397923663258553, -0.021360697224736214, 0.0011216416023671627, -0.014043470844626427, -0.04117932543158531, 0.02512297034263611 ] }, { "text": "Below you will find codes & notes from various platforms (references are presented at the end of the notebook). Hope that this notebook will be a good start for you as well.\n\nFFT¶\n\nFourier transform outputs vibration amplitude as a function of frequency so that the analyzer can understand what is causing the vibration.\n\nThe frequency resolution in an FFT is directly proportional to the signal length and sample rate. [3]\n\nSpectrogram¶\n\nA spectrogram takes a series of FFTs and overlaps them to illustrate how the spectrum (frequency domain) changes with time. [3]\n\nPSD¶\n\nA power spectral density (PSD) takes the amplitude of the FFT, multiplies it by its complex conjugate and normalizes it to the frequency bin width.", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_1", "embedding": [ 0.010575899854302406, -0.0028472801204770803, -0.044890232384204865, -0.03445561230182648, -0.0622573159635067, -0.03454745188355446, -0.0365930050611496, 0.03853394463658333, 0.0076207853853702545, -0.015520147047936916, -0.01514729205518961, -0.008205877617001534, -0.06254788488149643, -0.0607621893286705, -0.010115368291735649, 0.0005300496122799814, 0.015087893232703209, 0.03047875501215458, -0.07385023683309555, -0.09707145392894745, 0.12932206690311432, -0.019940627738833427, -0.023292021825909615, -0.03950055316090584, 0.003286306979134679, 0.04663863033056259, -0.058587171137332916, -0.02034728229045868, 0.07055444270372391, 0.029042739421129227, 0.05228864401578903, 0.086880162358284, 0.015717510133981705, 0.08622289448976517, -0.014712970703840256, -0.05478989705443382, 0.04128652811050415, 0.024801302701234818, 0.03918686509132385, -0.006716510280966759, -0.02427881397306919, 0.02396826446056366, 0.023383529856801033, 0.017838487401604652, -0.029321694746613503, -0.049968425184488297, -0.058779217302799225, -0.05944979935884476, -0.11331982165575027, -0.05062095448374748, 0.046079136431217194, 0.04923709109425545, 0.06157979369163513, 0.005244557745754719, -0.028873389586806297, 0.008531393483281136, 0.10485110431909561, -0.033461835235357285, 0.08374498039484024, -0.018001627177000046, 0.03241134062409401, -0.004792931489646435, -0.011024771258234978, -0.02681354433298111, 0.09278500825166702, -0.026704618707299232, 0.0746900886297226, -0.004823066294193268, 0.02408553659915924, -0.11025972664356232, -0.07912786304950714, -0.020369011908769608, -0.0038002138026058674, 0.08271989226341248, 0.01241281908005476, -0.022692836821079254, -0.08384641259908676, 0.027335790917277336, 0.007499767933040857, -0.05042726919054985, 0.03785333409905434, 0.029095865786075592, 0.06369519233703613, 0.01618918403983116, 0.02097521908581257, 0.027398454025387764, 0.04871659353375435, 0.07893829047679901, -0.052630357444286346, 0.07249746471643448, -0.04541439563035965, -0.07211536169052124, -0.10822965204715729, -0.0004107596178073436, -0.06899303942918777, 0.03624327853322029, -0.007990123704075813, -0.06348734349012375, 0.08049050718545914, 0.001721204724162817, 0.04975500330328941, -0.004817535635083914, 0.011611169204115868, 0.09874403476715088, -0.12817351520061493, -0.025538640096783638, -0.03400715813040733, 0.07799439132213593, 0.006732738111168146, 0.050181955099105835, 0.02625175565481186, 0.06027299165725708, -0.06647611409425735, -0.0004785515193361789, 0.1163986325263977, 0.027469707652926445, -0.07449517399072647, 0.03609764948487282, 0.014003911055624485, -0.05714152753353119, 0.04713301733136177, -0.05788275972008705, -0.07570435106754303, 0.012101514264941216, 0.07560527324676514, 0.051371149718761444, -0.07657649368047714, 1.9031637412186775e-33, -0.028047973290085793, 0.031243382021784782, -0.07267071306705475, -0.002304638037458062, -0.007570164278149605, -0.02271907404065132, -0.10562670230865479, 0.022173237055540085, 0.04786785691976547, 0.08235888183116913, 0.06041993200778961, 0.09713996201753616, 0.05012688413262367, -0.0065618460066616535, -0.05596966668963432, -0.0208241306245327, -0.03241829201579094, 0.022193018347024918, 0.0019469077233225107, -0.027812384068965912, 0.012697926722466946, 0.054661478847265244, 0.08341314643621445, 0.06763304024934769, 0.008022761903703213, 0.010497909970581532, -0.09251806139945984, 0.012649907730519772, -0.01749328337609768, 0.006687898654490709, 0.007515389006584883, -0.004204471129924059, 0.00010346034832764417, -0.09261570870876312, 0.07649658620357513, -0.07058785855770111, 0.06688033044338226, 0.005328840110450983, -0.015817515552043915, -0.02637593075633049, -0.0037975863087922335, -0.04323442652821541, -0.025465674698352814, 0.0007819150341674685, 0.031767554581165314, -0.026948964223265648, -0.016209352761507034, 0.021730972453951836, 0.06408651918172836, 0.06384208053350449, -0.021004604175686836, -0.02590164914727211, 0.02156713977456093, 0.0024722861126065254, 0.041613925248384476, 0.056107498705387115, 0.04777306690812111, -0.1286897212266922, -0.011152047663927078, 0.05865081399679184, 0.016145823523402214, -0.029180336743593216, 0.05266473814845085, -0.03539859130978584, -0.00013206840958446264, -0.0380854457616806, -0.03519310802221298, -0.0033858248498290777, 0.012881736271083355, 0.0861252024769783, -0.05298781394958496, 0.06499733030796051, 0.10051441192626953, 0.013315225951373577, -0.008294329978525639, -0.02515447698533535, -0.05976773053407669, 0.06274347007274628, -0.15535661578178406, 0.020774947479367256, -0.05969048663973808, -0.01477652508765459, 0.012414367869496346, -0.017477361485362053, -0.06022973358631134, -0.058771707117557526, -0.006732589565217495, -0.06498311460018158, -0.036016516387462616, -0.10645224153995514, -0.05696588009595871, 0.03232835978269577, 0.003664574818685651, 0.004190413281321526, 0.05270477384328842, -5.032940041815073e-33, 0.06290214508771896, 0.08706678450107574, -0.022034132853150368, -0.00351266423240304, 0.043382514268159866, 0.0026875457260757685, -0.013167323544621468, 0.07572665810585022, -0.008223156444728374, -0.10785914957523346, 0.04331756755709648, -0.07704649865627289, -0.06193488463759422, -0.011441271752119064, -0.03376849740743637, 0.026356669142842293, -0.09726333618164062, -0.03997620567679405, 0.012868594378232956, 0.04285125806927681, -0.00190109817776829, -0.005872330628335476, -0.042989492416381836, -0.01819651573896408, 0.013223680667579174, 0.022958265617489815, -0.020324289798736572, -0.08762475848197937, 0.023108093068003654, -0.0393441803753376, -0.01488635316491127, 0.01523610856384039, 0.05057280883193016, -0.009751996956765652, -0.012725220061838627, 0.0033188776578754187, 0.06483232975006104, 0.008211400359869003, 0.016045574098825455, -0.053602270781993866, 0.022756975144147873, 0.0748610571026802, 0.051362019032239914, -0.08780240267515182, -0.01147422194480896, 0.06360035389661789, -0.003137768479064107, 0.0312553234398365, 0.05193932354450226, -0.05994536727666855, 0.1892756223678589, 0.04277842491865158, 0.06686654686927795, -0.008391824550926685, 0.013049589470028877, -0.020487532019615173, 0.02632158435881138, -0.024817436933517456, 0.013685913756489754, 0.0017753146821632981, -0.0953473448753357, -0.05879184976220131, 0.02789381891489029, 0.05549972504377365, -0.043504614382982254, -0.005599662195891142, 0.025575323030352592, -0.08205991238355637, -0.0020293667912483215, 0.04268522933125496, -0.08529558777809143, 0.002702203346416354, -0.0018898909911513329, 0.033975906670093536, 0.017173418775200844, -0.04701204597949982, -0.03520376607775688, -0.073513463139534, -0.0692732110619545, 0.01780366711318493, 0.05113615840673447, -0.028144188225269318, -0.02929820492863655, 0.011990131810307503, -0.048189301043748856, 0.01791049726307392, -0.03841504827141762, -0.024429330602288246, -0.04318483546376228, -0.007306251209229231, 0.023602193221449852, 0.0877859890460968, -0.03152598813176155, -0.04916558787226677, 0.10753148049116135, -5.142552694792357e-08, -0.04154063016176224, -0.10416705906391144, -0.09632159769535065, -0.0404670275747776, 0.06619718670845032, 0.014189141802489758, 0.040311671793460846, -0.0197930745780468, -0.03403890132904053, -0.01991303265094757, 0.022734887897968292, -0.024155640974640846, -0.018379636108875275, -0.001986950868740678, 0.02514912374317646, -0.027973202988505363, 0.008362971246242523, 0.027537543326616287, -0.007395988795906305, -0.06454723328351974, -0.05664581432938576, 0.006068251561373472, 0.03443523868918419, -0.059002552181482315, -0.016271835193037987, -0.011139926500618458, -0.06254515051841736, 0.011791608296334743, 0.020007090643048286, 0.07225305587053299, 0.03362712264060974, 0.03428340703248978, 0.004381485749036074, -0.06677375733852386, 0.02847769856452942, -0.016980670392513275, -0.10479345172643661, -0.04980397969484329, -0.0027324920520186424, 0.06286951899528503, -0.04092246666550636, 0.11058478057384491, -0.1260773092508316, -0.014818084426224232, 0.04563842713832855, -0.011811414733529091, 0.03671391308307648, 0.009066715836524963, -0.03086739592254162, 0.10805647820234299, 0.026304908096790314, 0.04057428985834122, -0.02409776672720909, -0.050146397203207016, -0.09173470735549927, 0.08022800832986832, -0.05812891945242882, 0.009956992231309414, -0.010166781023144722, -0.01686924137175083, 0.022876063361763954, 0.05555146560072899, -0.00808425061404705, -0.044566214084625244 ] }, { "text": "A power spectral density (PSD) takes the amplitude of the FFT, multiplies it by its complex conjugate and normalizes it to the frequency bin width.\n\nThis allows for accurate comparison of random vibration signals that have different signal lengths. [3]\n\nNotes¶\n\nwave length is length of one cycle. distance/number of cycles\n\namplitude is median value fo highest and lowest y values in a cycle\n\nperiod = time/number of cycles --> T\nfrequency = number of cycles / time --> 1/T --> 1/s --> s^-1 --> Hz\ni.e freq is number of cycles in a second. [1]\n\nRelationships\n\nwave length inc & freq dec & period inc & Energy dec\n\nwavelength ~ period (directly related)\n\nfreq ~ Energy (directly related) [1]\n\nSmall example¶\n\nIn [1]:\n\nperiod = 0.25\nfreq = 1/0.25\nfreq # --> 4 cycles in a second --> 4 Hz", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_2", "embedding": [ -0.007655911147594452, 0.007158189546316862, -0.05623582750558853, 0.0012719746446236968, -0.04031665250658989, -0.010763093829154968, -0.03522024676203728, 0.04542709141969681, 0.05331095680594444, -0.022243116050958633, -0.008476151153445244, -0.007433902472257614, 0.026502907276153564, -0.04951394721865654, 0.08684485405683517, 0.00025297689717262983, 0.07778390496969223, 0.003556225448846817, -0.07167749106884003, -0.026934869587421417, 0.1536133885383606, -0.01578674092888832, -0.01695059984922409, -0.039315056055784225, -0.01921483315527439, -0.030561167746782303, -0.08896708488464355, -0.002232208149507642, 0.08199229836463928, 0.043553486466407776, 0.05488595739006996, 0.10186739265918732, 0.0036254413425922394, 0.007431942503899336, 0.0435263030230999, -0.07183551788330078, 0.08216428011655807, 0.018097365275025368, 0.031260740011930466, 0.0246006827801466, 0.003666951321065426, 0.02539394050836563, 0.08371929824352264, 0.044436849653720856, -0.07400263100862503, -0.024265171959996223, -0.09969965368509293, -0.0713827982544899, -0.13794493675231934, -0.0721900463104248, 0.08448009938001633, 0.02365400455892086, 0.02090967632830143, 0.07052241265773773, -0.005994447506964207, 0.05344485491514206, 0.025344008579850197, -0.024542275816202164, 0.06061353534460068, 0.010085616260766983, 0.04611377790570259, -0.07263172417879105, -0.05663482844829559, -0.04348847270011902, 0.09582668542861938, -0.01916521042585373, 0.050874095410108566, -0.014891295693814754, 0.0046820081770420074, -0.07017625868320465, -0.06973669677972794, 0.0030216278973966837, -0.009298105724155903, 0.08136014640331268, 0.005318249575793743, 0.04632015526294708, -0.027775423601269722, -0.0115931686013937, -0.09600608795881271, -0.056391168385744095, -0.008457519114017487, 0.016511274501681328, 0.03204647824168205, -0.04808521643280983, 0.037361904978752136, 0.02083979733288288, 0.06433992087841034, 0.02595803700387478, -0.034868184477090836, 0.024500291794538498, -0.022386636584997177, -0.0056513166055083275, -0.09303396940231323, 0.02190605364739895, -0.06541691720485687, 0.03415501117706299, 0.030341994017362595, -0.03769233822822571, 0.07726595550775528, 0.01233516912907362, 0.0038012077566236258, -0.02992934361100197, -0.03686956688761711, 0.05907737836241722, -0.1348460465669632, -0.03942101448774338, -0.09391673654317856, 0.046569887548685074, -0.041283294558525085, 0.01959536410868168, 0.016222069039940834, 0.037435319274663925, -0.0584939643740654, 0.06799618154764175, 0.10662809014320374, -0.007878512144088745, -0.03499686345458031, 0.10122854262590408, 0.028271351009607315, -0.06417284905910492, 0.029928330332040787, -0.02237706258893013, -0.003775091841816902, 0.08413505554199219, 0.03777061775326729, 0.01117811631411314, -0.015803596004843712, 6.725701865509077e-33, -0.026979519054293633, 0.012897945940494537, 0.018427327275276184, -0.033097319304943085, 0.05091376602649689, 0.036779675632715225, -0.10807609558105469, 0.03953178972005844, 0.07300426810979843, 0.046377092599868774, 0.01777440309524536, 0.1064661294221878, 0.05872952938079834, -0.03593241050839424, 0.015263319946825504, -0.02659538947045803, 0.0018485314212739468, 0.032352156937122345, -0.013979669660329819, -0.10736644268035889, 0.011733736842870712, 0.024769101291894913, 0.08293010294437408, 0.07030246406793594, 0.049020156264305115, -0.08034783601760864, -0.035611286759376526, 0.07271113246679306, -0.04026024043560028, 0.002217329805716872, 0.019296444952487946, 0.024530047550797462, 0.0035954078193753958, -0.026384573429822922, 0.038993917405605316, -0.01706024818122387, 0.0815640240907669, 0.04902958869934082, -0.047832559794187546, -0.03099997341632843, 0.009084600023925304, -0.04339894279837608, 0.04848882928490639, 0.012637315317988396, -0.011389668099582195, -0.06045934557914734, 0.02625524438917637, -0.05062094330787659, -0.04003370553255081, 0.05207445099949837, -0.028479302302002907, -0.020365623757243156, -0.03015284053981304, 0.060939036309719086, 0.05985744670033455, 0.023560555651783943, 0.03918810933828354, -0.07269064337015152, -0.00619238568469882, 0.0795551985502243, -0.003924557473510504, -0.043591782450675964, 0.061555296182632446, -0.05616220086812973, 0.014068073593080044, 0.04179107025265694, -0.016384392976760864, -0.024088077247142792, 0.06683100014925003, 0.06562583893537521, 0.014426403678953648, 0.05619964003562927, 0.04152573272585869, -0.03695162758231163, 0.07166960835456848, -0.09418988972902298, -0.03199109807610512, 0.05931022763252258, -0.12328141927719116, 0.060855887830257416, -0.12808124721050262, 0.02380574308335781, -0.04791611433029175, -0.044632475823163986, -0.049705903977155685, -0.06440430879592896, 0.006731057073920965, -0.05580265074968338, -0.07075397670269012, -0.10748180001974106, -0.0502847284078598, 0.02046119049191475, 0.07111525535583496, 0.05056692659854889, -0.005001743324100971, -7.343867161299655e-33, -0.000649056863039732, 0.04343602806329727, 0.025515062734484673, 0.04955993592739105, 0.07272353023290634, -0.010157762095332146, -0.00463264063000679, 0.08836784958839417, 0.008916109800338745, -0.11088162660598755, 0.05914748087525368, -0.05374208837747574, -0.026445122435688972, 0.0012567482190206647, -0.033116962760686874, 0.03550991788506508, -0.016165360808372498, -0.0829625055193901, 0.02954593114554882, 0.0395992286503315, 0.04987462982535362, 0.015228750184178352, -0.03939301148056984, -0.010666025802493095, 0.036852315068244934, 0.0004356816643849015, -0.003842053934931755, -0.09699001163244247, -0.006059693172574043, 0.03247224912047386, -0.04409264400601387, 0.03968900069594383, 0.01351508405059576, -0.012413837015628815, -0.09391609579324722, -0.001303157303482294, 0.04537269473075867, 0.007285678293555975, 0.02390540950000286, 0.07187100499868393, -0.0235755555331707, 0.07616501301527023, 0.09847632050514221, -0.07952716946601868, -0.05273900181055069, 0.06261473149061203, 0.07119157910346985, 0.019914815202355385, 0.03502141684293747, -0.026286959648132324, 0.13029031455516815, 0.05176561698317528, -0.007219747640192509, 0.05305766314268112, 0.03912736102938652, -0.03455581143498421, -0.012958141975104809, 0.0303263571113348, -0.05198764055967331, -0.018382590264081955, -0.03438541293144226, -0.05633189529180527, -0.011344820261001587, 0.06595087051391602, 0.01931067742407322, -0.0028967701364308596, 0.027494728565216064, -0.08948546648025513, 0.05675060674548149, 0.025613581761717796, -0.04748048633337021, 0.006184698082506657, -0.041642192751169205, 0.009408879093825817, -0.026946010068058968, -0.07489588856697083, -0.0033385478891432285, -0.07884316146373749, -0.045635342597961426, 0.058339979499578476, -0.08978435397148132, 0.03447653725743294, -0.06576638668775558, -0.05029251426458359, -0.09084034711122513, -0.015938106924295425, -0.002823391929268837, -0.047779686748981476, -0.00038933666655793786, -0.021851684898138046, 0.018514467403292656, 0.08811861276626587, -0.03472490981221199, -0.014759263955056667, 0.07998280227184296, -6.4967764501489e-08, 0.016980167478322983, -0.10491284728050232, -0.041831206530332565, -0.0446588508784771, 0.09531724452972412, 0.003847084939479828, 0.022122928872704506, -0.018215453252196312, 0.002356981858611107, -0.019625624641776085, 0.058808114379644394, 0.0024757676292210817, -0.00899068359285593, -0.026297738775610924, -0.031453270465135574, -0.0778796449303627, -0.0368223711848259, -0.01034260168671608, 0.013405777513980865, -0.018947944045066833, -0.03447333350777626, -0.014951294288039207, -0.024349939078092575, -0.04200153425335884, -0.0178654957562685, 0.001500266487710178, -0.05528010055422783, -0.0035762442275881767, -0.01782478205859661, 0.04421934857964516, 0.024632807821035385, -0.035841204226017, 0.009326313622295856, -0.04619714245200157, -0.03494834899902344, 0.006717886310070753, -0.0639839693903923, -0.029813559725880623, -0.014420060440897942, 0.1128673106431961, 0.014933991245925426, -0.0010485135717317462, -0.03387985751032829, 0.04068257287144661, -0.009184028021991253, 0.0021943566389381886, 0.04947097226977348, -0.0323343351483345, -0.017502622678875923, 0.10408520698547363, 0.017851032316684723, 0.02881043404340744, 0.028388572856783867, -0.12706416845321655, -0.09696054458618164, 0.0432848259806633, -0.049251116812229156, -0.01824258081614971, -0.08932925015687943, -0.016001932322978973, 0.05512969195842743, 0.03862372040748596, 0.01268733385950327, -0.010982131585478783 ] }, { "text": "freq ~ Energy (directly related) [1]\n\nSmall example¶\n\nIn [1]:\n\nperiod = 0.25\nfreq = 1/0.25\nfreq # --> 4 cycles in a second --> 4 Hz\n\nOut[1]:\n\n4.0\n\nIn [2]:\n\nimport matplotlib.pyplot as plt\nimport numpy as np\n\nExample 1 -FFT [4]¶\n\nIn [3]:\n\nsampling_freq = 100 # time points\nsampling_interval = 1/sampling_freq\nbegin_time = 0\nend_time = 10\n\nsignal_1_freq = 2\nsignal_2_freq = 3\n\ntime = np.arange(begin_time, end_time, sampling_interval)\nprint(time[:10])\n\n[0. 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09]\n\nIn [4]:\n\n# create sin waves\nwave1 = np.sin(2*np.pi*signal_1_freq*time)\nwave2 = np.sin(2*np.pi*signal_2_freq*time)\n\nIn [5]:\n\nplt.figure(figsize=(12,5))\nplt.plot(time, wave1)\n\nplt.figure(figsize=(12,5))\nplt.plot(time, wave2)\nplt.show()\n\nIn [6]:\n\n# Add the sine waves", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_3", "embedding": [ -0.03327411785721779, -0.0033037341199815273, -0.03696928545832634, 0.026951665058732033, 0.041477229446172714, -0.05329485237598419, -0.01916607841849327, 0.02657659910619259, 0.015506552532315254, -0.05725303292274475, -0.03576449304819107, -0.08098159730434418, -0.012405511923134327, -0.03834066540002823, 0.13625985383987427, 0.01844928227365017, -0.05948559194803238, -0.039998993277549744, 0.028500523418188095, -0.05953265726566315, 0.0682043507695198, 0.02221234329044819, 0.029414860531687737, -0.08492957055568695, -0.011366878636181355, 0.007363548502326012, -0.0008235730929300189, 0.01724463701248169, 0.06730463355779648, 0.014141496270895004, 0.040701307356357574, 0.07158157229423523, -0.03729693219065666, 0.008962515741586685, 0.01852799579501152, 0.0030691989231854677, 0.017261335626244545, 0.0753411054611206, -0.044594306498765945, 0.054484449326992035, 0.011800097301602364, 0.0899343267083168, 0.041930630803108215, -0.05408383533358574, -0.03426973521709442, -0.024210233241319656, 0.0022131484001874924, -0.012057650834321976, -0.010305714793503284, -0.02858940325677395, 0.06816735863685608, 0.012960621155798435, -0.051727455109357834, -0.020827097818255424, -0.00880369357764721, -0.0044586570002138615, 0.017647884786128998, -0.11813262850046158, 0.04616629704833031, -0.07512398064136505, 0.017080048099160194, 0.056251537054777145, -0.019949935376644135, -0.05556684359908104, -0.01596788689494133, -0.02948886528611183, 0.04321522265672684, 0.028391774743795395, -0.0004090802976861596, 0.03453062102198601, -0.059626031666994095, -0.008610041812062263, -0.01726878434419632, 0.020350659266114235, -0.0009896050905808806, -0.00615213206037879, -0.010172245092689991, 0.0512225478887558, -0.04850640147924423, -0.06479056179523468, -0.02902907319366932, -0.04390846565365791, -0.042002636939287186, -0.04143397510051727, -0.03792034834623337, 0.015085326507687569, -0.004104894120246172, 0.055870264768600464, 0.02116633765399456, -0.0020885125268250704, 0.014294036664068699, 0.058286745101213455, -0.06527145206928253, 0.03405626863241196, 0.01966768503189087, 0.03581951931118965, 0.06245381757616997, 0.02686234749853611, 0.007145299110561609, 0.030714455991983414, 0.05337124317884445, -0.10718313604593277, 0.012814993038773537, 0.08605694770812988, 0.02207225188612938, 0.01523952279239893, -0.007961820811033249, 0.05889804661273956, -0.0008758381009101868, 0.009844682179391384, -0.006455960683524609, 0.0033850837498903275, -0.00978980865329504, 0.01678304933011532, 0.16455772519111633, 0.0890415608882904, -0.012986620888113976, 0.038790926337242126, 0.02498575486242771, 0.04063775762915611, 0.01950819417834282, 0.007948365062475204, 0.0028500172775238752, 0.06793689727783203, 0.022940415889024734, -0.03451824188232422, -0.06251472979784012, 5.94346951709637e-33, -0.020921412855386734, 0.08391711115837097, -0.01558506116271019, -0.08387316763401031, 0.03058115765452385, 0.05530295521020889, -0.07977958768606186, 0.0003631350409705192, 0.021881069988012314, 0.030897343531250954, -0.053323037922382355, 0.02821378968656063, 0.010014251805841923, -0.027621475979685783, -0.018366044387221336, -0.07871101051568985, 0.027651971206068993, -0.030975278466939926, 0.028749309480190277, -0.06775440275669098, 0.023114658892154694, 0.009641404263675213, 0.018288642168045044, 0.054850053042173386, -0.037462588399648666, -0.01342626940459013, -0.01757303811609745, 0.005621667951345444, -0.01852428913116455, 0.002900931052863598, -0.010930211283266544, 0.03193310275673866, -0.005588115658611059, -0.0823259949684143, 0.033862825483083725, -0.05910047888755798, 0.09994573146104813, 0.06501047313213348, -0.011722828261554241, -0.04691497981548309, 0.018759677186608315, -0.024102844297885895, 0.055222928524017334, 0.005489571485668421, 0.07572052627801895, -0.07782339304685593, 0.0069686430506408215, 0.1253630369901657, 0.06583146005868912, 0.1093268170952797, -0.06144774705171585, -0.05403991416096687, 0.004007727839052677, 0.043159909546375275, -0.017641713842749596, 0.007240795996040106, 0.06023658439517021, -0.06874106824398041, -0.07289466261863708, -0.059917643666267395, 0.0049489689990878105, -0.06708917766809464, 0.014550951309502125, -0.040545906871557236, 0.006871477235108614, 0.04745415598154068, 0.016494402661919594, 0.0018532882677391171, 0.0157220009714365, 0.1498361974954605, 0.007366498466581106, 0.03475002571940422, 0.007840840145945549, -0.07989731431007385, 0.07524856925010681, -0.09576325863599777, -0.04371018335223198, 0.10593553632497787, -0.1152753010392189, 0.043219346553087234, -0.0058480119332671165, -0.016550147905945778, 0.019320497289299965, -0.08869238197803497, -0.04019008204340935, -0.015248577110469341, 0.11519566923379898, -0.019465332850813866, -0.04395421966910362, -0.09213996678590775, -0.10987335443496704, 0.05353410169482231, 0.07254721969366074, 0.0059253498911857605, -0.06582214683294296, -5.760824510943465e-33, 0.016422558575868607, 0.0879707783460617, 0.07262905687093735, 0.006666160654276609, 0.03822840377688408, 0.01844882406294346, 0.024390889331698418, 0.037660863250494, 0.05075068399310112, -0.002658081939443946, -0.015791108831763268, -0.15125125646591187, 0.048121146857738495, -0.025032497942447662, 0.04839916154742241, -0.009123699739575386, 0.02873806655406952, -0.010687978938221931, 0.03846322000026703, 0.044014908373355865, -0.05724213644862175, -0.018596315756440163, -0.017941568046808243, -0.07297772169113159, -0.028187595307826996, 0.025890421122312546, 0.033448971807956696, -0.054767727851867676, -0.027025992050766945, -0.0868842825293541, -0.12523891031742096, 0.05005684122443199, 0.007862641476094723, -0.012850901111960411, -0.004910067189484835, 0.06498314440250397, 0.03908479958772659, 0.01269623264670372, -0.026026135310530663, -0.032736342400312424, 0.08126793801784515, 0.025125129148364067, 0.002220487454906106, -0.022541344165802002, -0.07002941519021988, 0.07750582695007324, 0.020989371463656425, 0.019482385367155075, -0.10324099659919739, 0.0066472310572862625, 0.009881936013698578, 0.008363761939108372, -0.030171487480401993, 0.036838263273239136, -0.027477947995066643, 0.022615201771259308, 0.004820116329938173, 0.04767962172627449, -0.04051942750811577, -0.054632559418678284, -0.06860338151454926, -0.11544256657361984, -0.045972444117069244, 0.045872390270233154, 0.09497911483049393, 0.009286344051361084, -0.039213743060827255, -0.052219830453395844, 0.06130531430244446, 0.03547588735818863, -0.06815740466117859, 0.03489210456609726, -0.030865278095006943, -0.07994098216295242, -0.03127870708703995, 0.029862241819500923, -0.034675367176532745, -0.07517753541469574, -0.10732367634773254, 0.018100814893841743, -0.04287952184677124, -0.0018409889889881015, -0.029092181473970413, 0.014411836862564087, -0.1118331253528595, -0.04349932447075844, -0.0060678087174892426, 0.01749184913933277, 0.0016339065041393042, -0.0104600228369236, 0.04448075592517853, 0.06304620951414108, 0.03802286460995674, 0.03595538064837456, 0.1138576790690422, -5.1117339694428665e-08, 0.019203059375286102, -0.010342600755393505, -0.043947819620370865, 0.012679419480264187, 0.0422423891723156, -0.05041131749749184, -0.022904347628355026, -0.07303214818239212, -0.0358075387775898, 0.011302810162305832, 0.013686122372746468, -0.024335838854312897, 0.017137467861175537, -0.024035921320319176, -0.008931219577789307, 0.011933684349060059, -0.08667795360088348, -0.03782251477241516, 0.07367505878210068, -0.07312718778848648, -0.015358568169176579, 0.011488715186715126, 0.03403849899768829, 0.03296690061688423, -0.058196648955345154, 0.06461446732282639, -0.0005047364975325763, -0.063067227602005, 0.02287156693637371, 0.08444982022047043, -0.044365108013153076, -0.0692225843667984, 0.030323680490255356, 0.0072510433383286, -0.012200377881526947, -0.06655923277139664, -0.08547072112560272, 0.017106343060731888, 0.018251711502671242, 0.10157773643732071, -0.024979574605822563, 0.12897931039333344, -0.09846328943967819, 0.023574840277433395, 0.050988733768463135, -0.026339029893279076, 0.02263885736465454, -0.02338152378797531, 0.118787482380867, 0.056355684995651245, -0.029595432803034782, 0.07427523285150528, 0.0034154269378632307, -0.1313108205795288, -0.01316090114414692, -0.0011732056736946106, -0.11311035603284836, 0.00909861084073782, -0.03731362149119377, 0.025644058361649513, -0.042903054505586624, 0.031634535640478134, -0.03994652256369591, -0.06059233471751213 ] }, { "text": "plt.figure(figsize=(12,5))\nplt.plot(time, wave1)\n\nplt.figure(figsize=(12,5))\nplt.plot(time, wave2)\nplt.show()\n\nIn [6]:\n\n# Add the sine waves\n\nwave = wave1 + wave2\nplt.figure(figsize=(12,5))\nplt.plot(time, wave)\nplt.show()\n\nIn [7]:\n\n# Frequency domain representation\n\nfourierTransform = np.fft.fft(wave)/len(wave) # Normalize amplitude\nfourierTransform = fourierTransform[range(int(len(wave)/2))] # Exclude sampling frequency\n\ntpCount = len(wave)\nvalues = np.arange(int(tpCount/2))\ntimePeriod = tpCount/sampling_freq\nfrequencies = values/timePeriod\n\nIn [8]:\n\nplt.figure(2)\nplt.title('FFT')\nplt.plot(frequencies, abs(fourierTransform))\nplt.axis([0, 6.5, 0, 0.5])\nplt.show()\n\nExample 2 - Waves - FFT - PSD [2]¶\n\nIn [9]:\n\nn = 1000 # number of points\nLx = 100 # time period\n\nx = np.linspace(0,Lx,n)", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_4", "embedding": [ -0.017035141587257385, -0.015368626452982426, -0.01940678432583809, -0.04597828909754753, 0.00349837401881814, -0.05726965516805649, -0.06517336517572403, 0.07454632222652435, -0.03569014370441437, -0.05613233894109726, -0.018060529604554176, -0.11034566164016724, -0.03863570839166641, -0.012504789046943188, 0.08348291367292404, -0.007616530638188124, -0.07578010857105255, -0.023574223741889, 0.016161739826202393, -0.0795062929391861, 0.0929909497499466, 0.042949091643095016, 0.031700249761343, -0.06584177166223526, 0.051135458052158356, 0.009099211543798447, 0.0295542124658823, 0.01899373158812523, 0.054415296763181686, 0.012092117220163345, 0.0013533709570765495, 0.04108615219593048, -0.011579686775803566, 0.021992631256580353, 0.013719845563173294, -0.04904963821172714, 0.040192123502492905, 0.051573339849710464, -0.03312746435403824, 0.02029796876013279, 0.030447103083133698, 0.0850948691368103, -0.010119129903614521, -0.09676440805196762, -0.025551585480570793, -0.0054738447070121765, 0.0018842237768694758, -0.04012713208794594, 0.02071554586291313, 0.0234916340559721, 0.07266848534345627, 0.07044518738985062, -0.06776652485132217, -0.005446939263492823, 0.02402457967400551, 0.027309048920869827, 0.04071516916155815, -0.09417922049760818, 0.06399748474359512, -0.10797889530658722, -0.06799834966659546, 0.04724530130624771, 0.006843022536486387, -0.02607288397848606, 0.005005694925785065, -0.041533373296260834, 0.021818114444613457, 0.03218907490372658, -0.028321562334895134, 0.038152582943439484, -0.053148094564676285, 0.013232968747615814, -0.022686464712023735, 0.049583617597818375, -0.039878133684396744, -0.011562180705368519, -0.051122818142175674, 0.05779615417122841, -0.03749637305736542, -0.08396134525537491, 0.007603055331856012, -0.04479800909757614, 0.00243044039234519, 0.024533849209547043, -0.055252742022275925, -0.01772434636950493, -0.02296089008450508, 0.042959991842508316, -0.04349752888083458, -0.04300776496529579, -0.004469283390790224, 0.013235623016953468, -0.019572777673602104, 0.04111538827419281, -0.03144368156790733, 0.05127226188778877, 0.021710829809308052, 0.07159540802240372, -0.026380717754364014, 0.03149944171309471, 0.04025481641292572, -0.11950046569108963, 0.01520309317857027, 0.03949810937047005, -0.03793647140264511, -0.0006866150652058423, 0.026882154867053032, 0.062198929488658905, 0.029876040294766426, 0.001682570786215365, -0.0048993355594575405, -0.014202212914824486, -0.04256565496325493, 0.024709852412343025, 0.1568635106086731, 0.08629149198532104, -0.04751481115818024, 0.029307402670383453, -0.002500694477930665, 0.007995939813554287, 0.011395057663321495, 0.037307702004909515, -0.017656484618782997, 0.06448887288570404, -0.0025159090291708708, -0.05223988741636276, -0.056527577340602875, 6.819537906115374e-33, -0.02507278323173523, 0.04552746191620827, -0.0558626726269722, -0.05730615183711052, -0.0036656444426625967, 0.07417906075716019, -0.028048358857631683, 0.00703277625143528, 0.04545681178569794, 0.024095257744193077, -0.06383924931287766, 0.04737039655447006, -0.04261269047856331, -0.05991672724485397, -0.032333049923181534, -0.0430404394865036, 0.034048739820718765, -0.0063077243976294994, 0.0335984081029892, -0.012457272037863731, 0.06293869018554688, 0.045680176466703415, 0.012103844434022903, 0.04285836219787598, -0.06276580691337585, -0.007115469314157963, -0.038164157420396805, -0.010381692089140415, -0.017538517713546753, -0.008876780979335308, -0.02899998426437378, 0.014732479117810726, -0.008839255198836327, -0.06257976591587067, 0.07787425071001053, -0.11335262656211853, 0.11781788617372513, 0.05816533789038658, -0.03549215570092201, -0.0480317696928978, 0.004536157939583063, -0.035908639430999756, 0.004006639588624239, -0.013027745299041271, 0.05100273713469505, -0.08625763654708862, 0.000493715750053525, 0.11862797290086746, 0.0882493108510971, 0.10440192371606827, -0.02344939112663269, -0.03407859802246094, 0.012390385381877422, 0.05129669979214668, -0.021488578990101814, 0.03883402794599533, 0.04675118625164032, -0.04938992112874985, -0.0535929910838604, -0.05339236184954643, -0.000347970228176564, -0.03580067679286003, 0.02969294600188732, -0.04744599014520645, -0.019681982696056366, 0.07044344395399094, 0.005134971346706152, -0.0009300920064561069, 0.021530548110604286, 0.09647236764431, 0.0073210918344557285, 0.0815771073102951, -0.03676213324069977, -0.02311924286186695, 0.059227705001831055, -0.11290238797664642, 0.007557177450507879, 0.10839954763650894, -0.13938777148723602, 0.037429969757795334, 0.03844253346323967, -0.0016220147954300046, -0.034310176968574524, -0.08134539425373077, -0.024891510605812073, -0.057060711085796356, 0.10532774776220322, -0.01705716736614704, -0.018668076023459435, -0.10769761353731155, -0.08744610100984573, 0.000886310066562146, 0.025649236515164375, 0.052550796419382095, -0.054112713783979416, -6.949761374351375e-33, 0.016480278223752975, 0.11628658324480057, 0.09465084969997406, -0.012818343006074429, 0.026016024872660637, 0.04955056682229042, 0.030640650540590286, 0.04699208214879036, 0.0481376051902771, -0.011205836199223995, -0.006100793369114399, -0.14584197103977203, 0.014363434165716171, -0.05210006609559059, 0.03977391868829727, -0.01898522861301899, -0.019247235730290413, 0.016747478395700455, 0.004480383358895779, -0.035528670996427536, -0.07932450622320175, -0.052453652024269104, -0.033784277737140656, -0.021610485389828682, -0.04501257836818695, 0.06562092900276184, 0.013536425307393074, -0.04632497578859329, 0.007281213067471981, -0.09657065570354462, -0.05570148676633835, 0.03825419023633003, -0.0010405776556581259, 0.015292452648282051, 0.0006800305563956499, 0.020000703632831573, 0.08716125786304474, 0.0368889719247818, -0.05937841907143593, -0.06992245465517044, 0.04520353674888611, 0.023501571267843246, 0.03273189812898636, -0.026852842420339584, -0.081422358751297, 0.08999883383512497, 0.018495284020900726, 0.02801482379436493, -0.03140793740749359, -0.018246784806251526, 0.004999959841370583, -0.000866744841914624, 0.06323393434286118, 0.0037681227549910545, -0.013303324580192566, 0.011885414831340313, -0.005361243616789579, 0.03507525473833084, 0.02244165912270546, -0.042297158390283585, -0.048361681401729584, -0.08859819918870926, -0.04576128348708153, 0.026857707649469376, 0.08935140818357468, 0.03265085071325302, -0.047342292964458466, -0.031894098967313766, 0.03401744365692139, 0.05734468251466751, -0.06296592950820923, -0.02304767817258835, -0.016433050855994225, -0.05200369656085968, 0.007959355600178242, 0.03369833901524544, -0.042286042124032974, -0.07558789849281311, -0.043539710342884064, 0.013545066118240356, 0.002885296242311597, -0.017428649589419365, -0.03491806238889694, 0.00853133387863636, -0.08075214177370071, -0.014842025004327297, 0.027811557054519653, 0.04995323717594147, -0.040656935423612595, -0.0032231630757451057, 0.03622237965464592, 0.08540011942386627, -0.00041401287307962775, 0.05658154934644699, 0.12524555623531342, -4.677640319528109e-08, 0.03155937045812607, -0.06210547313094139, -0.01783773861825466, 0.02494148723781109, 0.022130299359560013, -0.028727805241942406, -0.02895057201385498, -0.053595300763845444, -0.0031275281216949224, -0.03134656324982643, -0.020541604608297348, -0.04648079350590706, -0.01486800704151392, -0.061900317668914795, -0.006610591430217028, 0.0019181830575689673, -0.01611877977848053, -0.004520860500633717, 0.057318590581417084, -0.053069937974214554, -0.056377969682216644, -0.06274772435426712, 0.0565493106842041, 0.01792128197848797, -0.09521406143903732, 0.02349921502172947, -0.04571550711989403, -0.018171338364481926, 0.05735260993242264, 0.14197395741939545, -0.027087466791272163, -0.042032018303871155, 0.044325362890958786, 0.01275548618286848, 0.00024072961241472512, -0.08756750822067261, -0.05093945562839508, 0.029950805008411407, -0.017342418432235718, 0.10242508351802826, -0.05277751013636589, 0.14315344393253326, -0.05657804757356644, 0.0008733689319342375, 0.13242082297801971, -0.04173202067613602, 0.07513999938964844, -0.015947701409459114, 0.1161445751786232, 0.055006321519613266, -0.03916687145829201, 0.06502355635166168, 0.0010173256741836667, -0.10108630359172821, -0.03251837193965912, 0.02875807322561741, -0.0852280855178833, 0.001452118856832385, -0.013905512169003487, 0.052024975419044495, -0.08085217326879501, 0.02989560179412365, -0.00320266792550683, -0.019997911527752876 ] }, { "text": "Example 2 - Waves - FFT - PSD [2]¶\n\nIn [9]:\n\nn = 1000 # number of points\nLx = 100 # time period\n\nx = np.linspace(0,Lx,n)\n\nprint(x[:10])\n\n[0. 0.1001001 0.2002002 0.3003003 0.4004004 0.5005005 0.6006006\n0.7007007 0.8008008 0.9009009]\n\nIn [10]:\n\ny1 = 1*np.cos((2*np.pi/Lx)*x) # 1 is amplitude, 1 wave\ny2 = 2*np.sin((2*np.pi/Lx)*x) # 2 is amplitude, 1 wave\ny3 = 0.5*np.cos(3*(2*np.pi/Lx)*x) # 0.5 is amplitude, 3 waves\ny4 = 0.5*np.sin(5*(2*np.pi/Lx)*x) # 0.5 is amplitude, 5 waves\n\nprint(y1[:10])\nplt.plot(x,y1)\nplt.title('cos')\nplt.show()\n\nplt.plot(x,y3)\nplt.title('5cos')\nplt.show()\n\nplt.plot(x,y2)\nplt.title('sin')\nplt.show()\n\nplt.plot(x,y4)\nplt.title('10sin')\nplt.show()\n\n[1. 0.99998022 0.99992089 0.999822 0.99968356 0.99950557\n0.99928805 0.999031 0.99873443 0.99839835]\n\nIn [11]:", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_5", "embedding": [ -0.06284675002098083, -0.06847253441810608, -0.012488175183534622, -0.02168671041727066, 0.025571169331669807, -0.0377800315618515, -0.055037662386894226, 0.02669595740735531, -0.03439691290259361, -0.04327336698770523, 0.008135554380714893, -0.05030222237110138, -0.01880040019750595, -0.05912218615412712, 0.1181643009185791, 0.06642276048660278, -0.10904397815465927, -0.010749854147434235, 0.018917100504040718, -0.027066975831985474, 0.11133798211812973, 0.023367661982774734, -0.07545556873083115, -0.05283296853303909, 0.0784451961517334, 0.016263015568256378, 0.017947731539607048, -0.028859347105026245, 0.024083662778139114, 0.041928403079509735, 0.0636361688375473, 0.06197498366236687, -0.07155594229698181, 0.03079572506248951, 0.04670429974794388, -0.05566202476620674, 0.0603257454931736, 0.0429237000644207, -0.020695095881819725, 0.09114520251750946, 0.027901045978069305, 0.06632021069526672, 0.027153706178069115, -0.03941142186522484, 0.025883866474032402, 0.0026199480053037405, -0.10587809234857559, -0.040816593915224075, -0.04011541232466698, -0.07049702852964401, 0.06812737137079239, 0.02232176624238491, -0.05234230309724808, 0.027259044349193573, -0.10452043265104294, -0.03230765461921692, 0.02464008890092373, -0.037191107869148254, 0.07832838594913483, -0.06334444135427475, 0.03482484072446823, 0.05107644200325012, 0.007243070751428604, -0.042510904371738434, 0.08422476053237915, -0.03799545764923096, 0.01863400638103485, -0.03650149703025818, -0.02776801958680153, 0.06444516777992249, -0.06292975693941116, 0.03682508319616318, 0.020450768992304802, 0.005155040882527828, -0.006280745379626751, 0.010188772343099117, -0.03601398319005966, 0.0016380524029955268, -0.12843537330627441, -0.006613727193325758, -0.02091420814394951, -0.0076882243156433105, -0.008814717642962933, -0.007752958219498396, -0.10869592428207397, 0.04519164189696312, -0.05922592803835869, 0.054590970277786255, -0.04248621687293053, 0.03512870520353317, -0.031511370092630386, -0.024968625977635384, -0.0944451093673706, 0.05283075571060181, -0.04467543587088585, 0.05151435732841492, 0.002910395385697484, 0.027794180437922478, 0.012921430170536041, -0.010422090999782085, 0.021642077714204788, -0.040582649409770966, 0.012632749043405056, -0.009971900843083858, -0.04504245147109032, -0.010277287103235722, -0.001777412137016654, 0.04683768376708031, -0.012181149795651436, -0.024998480454087257, -0.05815131589770317, 0.008556324988603592, -0.016770265996456146, -0.018083807080984116, 0.09827098995447159, 0.07129456102848053, 0.009316950105130672, 0.013235670514404774, 0.005961664021015167, -0.024300681427121162, 0.07882632315158844, 0.011421960778534412, 0.054690469056367874, 0.13529373705387115, -0.06335116922855377, 0.007559188175946474, -0.06749939173460007, 8.901985657998566e-33, -0.009121254086494446, 0.06248092278838158, -0.01401084940880537, -0.05064563825726509, -0.02375812828540802, 0.031344085931777954, -0.061006490141153336, -0.027452347800135612, 0.008927733637392521, 0.018240146338939667, -0.07570043951272964, 0.12745992839336395, 0.02915145829319954, -0.03531870245933533, 0.030527696013450623, -0.020441614091396332, 0.07338427752256393, -0.011649498715996742, 0.030435824766755104, 0.03761635348200798, 0.047775138169527054, 0.05932960286736488, 0.01173457782715559, 0.005479794926941395, -0.06513761729001999, 0.006850329227745533, -0.05443210154771805, -0.019661560654640198, -0.0610511377453804, -0.0016725648893043399, -0.028987716883420944, 0.0008988386252894998, 0.030027547851204872, -0.013210935518145561, 0.09861584007740021, -0.06432972848415375, 0.09274131804704666, 0.04155046120285988, -0.0016478212783113122, -0.08765054494142532, -0.007758627645671368, 0.002952550770714879, 0.044200897216796875, 0.043539371341466904, 0.0277500469237566, -0.0771312415599823, -0.05897700414061546, 0.07796618342399597, 0.040782906115055084, 0.0998358204960823, 0.009949074126780033, -0.03735890984535217, -0.06846174597740173, 0.06751926243305206, 0.01944728009402752, 0.031489353626966476, 0.01551010087132454, -0.028202544897794724, -0.030269403010606766, -0.010280855000019073, 0.020602913573384285, -0.02668117731809616, 0.05753402039408684, -0.0450269915163517, -0.0013208891032263637, 0.06268983334302902, 0.06336268782615662, -0.0028055578004568815, 0.07807289808988571, 0.1208164244890213, -0.08371825516223907, 0.05911240354180336, 0.045567452907562256, -0.04834619536995888, 0.10386736690998077, -0.13984160125255585, 0.03852233663201332, 0.057357802987098694, -0.07997935265302658, 0.05240733548998833, -0.03955617919564247, 0.02471286803483963, -0.010116089135408401, -0.06338533759117126, -0.011454145424067974, 0.0073031592182815075, 0.047633878886699677, -0.0382114052772522, -0.09447937458753586, -0.11251860857009888, -0.09130716323852539, 0.010212438181042671, 0.05648886784911156, 0.024386616423726082, -0.07484351098537445, -1.0027790393243657e-32, -0.03760884329676628, 0.0442827045917511, 0.02571224234998226, -0.016880791634321213, 0.011389954946935177, 0.04319349303841591, 0.001667606527917087, 0.021563032642006874, 0.03580070659518242, 0.0011751583078876138, 0.026705551892518997, -0.06126648560166359, 0.024593917652964592, 0.08463099598884583, 0.0010834860149770975, -0.01935749500989914, 0.0372614711523056, 0.009384488686919212, 0.03642677515745163, -0.040504973381757736, -0.005041032563894987, 0.02979704737663269, 0.02030804753303528, -0.022155798971652985, -0.018496381118893623, 0.02456759102642536, 0.0043084570206701756, -0.09408917278051376, -0.014229418709874153, -0.05819239094853401, -0.04654498025774956, 0.08754038065671921, 0.05157158896327019, -0.008530749008059502, -0.022991662845015526, 0.061836957931518555, 0.03179488331079483, 0.020720385015010834, 0.01946309767663479, -0.09956811368465424, 0.011849825270473957, 0.00983608327805996, 0.03332093358039856, -0.116661936044693, -0.08002624660730362, 0.0656738132238388, 0.08633854240179062, -0.005146428477019072, -0.041384391486644745, 0.03749098628759384, -0.04482729732990265, -0.005464908201247454, -0.028807200491428375, 0.028565788641572, 0.001516231568530202, 0.022951258346438408, -0.05268615111708641, 0.00970574002712965, -0.0029669171199202538, -0.06677243858575821, -0.060371026396751404, -0.040464866906404495, -0.0016673196805641055, 0.058539144694805145, 0.05699592083692551, 0.03995372727513313, -0.018053650856018066, -0.07459640502929688, 0.019151762127876282, 0.03749238699674606, -0.08513061702251434, 0.024980001151561737, -0.03256583958864212, -0.035311322659254074, -0.044697362929582596, -0.04982111230492592, -0.051407650113105774, -0.03409135341644287, -0.0698699876666069, 0.02249188721179962, -0.019395368173718452, 0.024888280779123306, -0.017163243144750595, 0.05161416530609131, -0.05750078707933426, -0.0242079459130764, 0.015606844797730446, 0.09147723764181137, -0.02340741828083992, -0.040185946971178055, 0.09278908371925354, 0.10575667768716812, 0.012799267657101154, -0.034286126494407654, 0.11581768840551376, -6.330903090656648e-08, 0.012790610082447529, -0.060011573135852814, -0.01803199015557766, 0.011588947847485542, 0.02011873573064804, -0.02374364621937275, -0.05145639926195145, -0.048952143639326096, -0.017571335658431053, -0.07149186730384827, 0.013981548137962818, -0.014345423318445683, -0.04438237100839615, -0.0833808109164238, -0.01840088702738285, -0.03930748999118805, -0.06042218208312988, -0.0209866464138031, 0.03829321637749672, -0.013033037073910236, -0.02932998724281788, -0.028011657297611237, 0.0045973192900419235, -0.0015356302028521895, -0.07959200441837311, 0.012107889167964458, -0.03061707876622677, -0.04038672521710396, 0.027668436989188194, 0.10262595117092133, -0.006896510254591703, -0.08059980720281601, -0.006687170825898647, -0.007248359266668558, 0.009285387583076954, -0.05117566138505936, -0.054450664669275284, 0.012164412066340446, -0.018874801695346832, 0.05735689774155617, -0.07937805354595184, 0.08370660990476608, -0.02679264359176159, 0.03576371818780899, 0.10435114800930023, -0.002377731492742896, 0.07070355862379074, -0.0718424990773201, 0.07471943646669388, 0.044474177062511444, -0.02266724221408367, 0.05682731419801712, 0.010058781132102013, -0.0636591836810112, -0.02365903928875923, 0.06122909113764763, -0.11827843636274338, -0.045164868235588074, -0.0653989240527153, -0.03667835891246796, -0.09254556149244308, 0.08145249634981155, -0.010590409860014915, 0.03723865747451782 ] }, { "text": "[1. 0.99998022 0.99992089 0.999822 0.99968356 0.99950557\n0.99928805 0.999031 0.99873443 0.99839835]\n\nIn [11]:\n\ny = y1 + y2 + y3 + y4\nplt.plot(x,y)\nplt.show()\n\nIn [12]:\n\nfreqs = np.fft.fftfreq(n)\nfft_vals = np.fft.fft(y) # FFT values\nfft_theo = 2*np.abs(fft_vals/n) # True FFT\n\nIn [13]:\n\nplt.figure(1)\nplt.title('Original')\nplt.plot(x,y)\n\nplt.figure(2)\nplt.title('FFT')\nplt.plot(abs(freqs), abs(fft_theo))\nplt.axis([-0.01, 0.02, 0, 2.5])\nplt.show()\n\nplt.psd(y, 5000, 1 / sampling_freq)\nplt.show()\n\nExample 3 - PSD [5]¶\n\nIn [14]:\n\nimport matplotlib.pyplot as plt\nimport numpy as np\nimport matplotlib.mlab as mlab\nimport matplotlib.gridspec as gridspec\n\nIn [15]:", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_6", "embedding": [ 0.009442104957997799, -0.05074344202876091, -0.020479274913668633, -0.04433295130729675, 0.05543327331542969, -0.03440440446138382, 0.013132602907717228, 0.03069932572543621, 0.025888457894325256, -0.07165373116731644, -0.055863115936517715, -0.07314058393239975, -0.05562549829483032, 0.029199223965406418, 0.01346923504024744, -0.02107222191989422, -0.07040916383266449, -0.015687325969338417, -0.011924582533538342, -0.04280581325292587, 0.043116673827171326, -0.013428892940282822, -0.004674189258366823, -0.012280303053557873, 0.07998789101839066, 0.008363225497305393, -0.014145753346383572, 0.09841416776180267, 0.02122485637664795, -0.013740435242652893, 0.011854065582156181, 0.04625167325139046, 0.008015884086489677, 0.036360785365104675, 0.00737899960950017, -0.05991796776652336, 0.09587668627500534, 0.028450045734643936, -0.03746567666530609, 0.08334539830684662, -0.01335330493748188, 0.06086539849638939, 0.063794806599617, -0.04011911526322365, 0.0699576735496521, 0.011690224520862103, -0.06575974822044373, -0.06141948699951172, 0.053503792732954025, -0.025374680757522583, -0.011303582228720188, 0.07999704778194427, -0.05314512923359871, 0.024470102041959763, 0.0237579345703125, -0.03719137981534004, 0.04620853438973427, -0.1251014769077301, 0.08976873010396957, -0.07192466408014297, -0.02102367766201496, 0.05027856305241585, 0.03360138088464737, -0.018249891698360443, 0.04001691937446594, -0.015586803667247295, 0.019555101171135902, -0.033751945942640305, -0.03842092305421829, 0.0755910649895668, -0.05328918248414993, 0.047844916582107544, 0.002530583180487156, -0.032887816429138184, -0.040635500103235245, -0.02032574452459812, -0.03034065105021, -0.00896449014544487, -0.04546044394373894, -0.016787368804216385, 0.04123222082853317, -0.023068446666002274, 0.0026640521828085184, 0.014311994425952435, -0.05139446631073952, -0.08817340433597565, -0.008589754812419415, 0.032264966517686844, 0.03368425741791725, 0.020139453932642937, -0.03383910283446312, -0.005594934802502394, -0.058168310672044754, 0.04511552304029465, -0.05946038290858269, 0.10618529468774796, 0.00027399472310207784, 0.00021752009342890233, -0.0029953746125102043, 0.04452592507004738, 0.07420719414949417, -0.13442975282669067, -0.002425630809739232, 0.033844005316495895, 0.031521670520305634, 0.10450371354818344, 0.06340297311544418, 0.06034068018198013, 0.013762625865638256, -0.033498454838991165, -0.06348593533039093, -0.07471954077482224, -0.05416286736726761, 0.03403709456324577, 0.07344036549329758, 0.07607902586460114, -0.012662751600146294, 0.02419997751712799, -0.08638415485620499, -0.014644455164670944, 0.02859633043408394, 0.08295042812824249, 0.046188510954380035, 0.05826051905751228, -0.036994729191064835, 0.016250038519501686, -0.12372647225856781, 8.060624841713545e-33, -0.0674593448638916, 0.03494790196418762, -0.0009035324910655618, -0.0689130574464798, 0.01478688232600689, 0.036423176527023315, -0.039194896817207336, 0.022535845637321472, 0.026764700189232826, 0.02832041122019291, -0.031986262649297714, 0.07278888672590256, 0.014351933263242245, -0.08413732796907425, 0.00556892529129982, -0.08947473764419556, 0.04462846741080284, -0.019464142620563507, -0.011681160889565945, 0.019218796864151955, 0.03740820661187172, 0.03084007278084755, 0.05233895033597946, 0.03983191028237343, -0.08479082584381104, -0.024180389940738678, -0.050891000777482986, 0.03373361751437187, -0.01636561192572117, -0.0001755869889166206, -0.04331248253583908, 0.00307287136092782, -0.060603633522987366, -0.13356690108776093, 0.025374356657266617, -0.1039959043264389, 0.08242622762918472, 0.026007259264588356, 3.673400351544842e-05, -0.003960911650210619, -0.04996279999613762, 0.007802808191627264, -0.024194864556193352, -0.05274577811360359, 0.05327953025698662, -0.020773746073246002, -0.006772189866751432, 0.1300688087940216, 0.017786171287298203, 0.09793736040592194, -0.061317577958106995, -0.07854752987623215, -0.05596652626991272, 0.04441117122769356, -0.020552515983581543, 0.02107054553925991, 0.045278873294591904, -0.02098272740840912, 0.0009952964028343558, -0.08250090479850769, -0.03056771121919155, -0.06412482261657715, -0.020605148747563362, -0.038611456751823425, -0.012506477534770966, 0.074915811419487, 0.0783376470208168, -0.009634277783334255, -0.011088551953434944, 0.11244223266839981, -0.045521922409534454, 0.07339096069335938, 0.02678370475769043, -0.06493633985519409, 0.10577388852834702, -0.08776110410690308, -0.04002593830227852, 0.04896075278520584, -0.10920313745737076, -0.003939424175769091, 0.006118847522884607, 0.058321595191955566, 0.0005826525739394128, -0.12419091910123825, -0.01718679629266262, -0.09528827667236328, 0.03815830871462822, -0.010617520660161972, -0.025307275354862213, -0.09020425379276276, -0.07522261142730713, -0.03131259232759476, 0.003486228408291936, 0.04534086957573891, -0.0809112936258316, -7.746005248083898e-33, -0.018531661480665207, 0.0945080891251564, 0.06727233529090881, 0.012716084718704224, -0.003055364592000842, 0.021450571715831757, 0.003923153504729271, 0.02359742298722267, 0.07428573817014694, -0.028785238042473793, -0.006995480973273516, -0.10668078064918518, 0.03755618631839752, -0.0026480520609766245, 0.05945268273353577, -0.0142392348498106, -0.08138164132833481, 0.07296920567750931, -0.035446297377347946, -0.013856683857738972, -0.049265556037425995, -0.0035695007536560297, -0.01635395549237728, 0.012875489890575409, -0.043170470744371414, 0.0877811461687088, 0.021512532606720924, -0.034919559955596924, -0.00764549570158124, -0.04588814452290535, -0.03630205616354942, -0.0021541519090533257, -0.04491674527525902, 0.002120180521160364, -0.015676306560635567, -2.147773329852498e-06, 0.045753780752420425, -0.006802560295909643, -0.07491499185562134, -0.030303658917546272, 0.057698849588632584, 0.03849339485168457, 0.00885737407952547, -0.026733335107564926, -0.09899861365556717, 0.0947321355342865, 0.05067681521177292, 0.0816023200750351, 0.03277641534805298, -0.01207756157964468, -0.02191973105072975, 0.02926686964929104, -0.010902749374508858, 0.04460659623146057, -0.017006883397698402, 0.01930825598537922, -0.11287853866815567, 0.06926611065864563, -0.011866486631333828, -0.06264723837375641, -0.010686987079679966, -0.03161395713686943, -0.05701049044728279, 0.02989223785698414, 0.07893046736717224, 0.04207627847790718, -0.08067198842763901, 0.014271741732954979, 0.07734369486570358, 0.02988269366323948, -0.006116983015090227, -0.003140793414786458, -0.017718294635415077, -0.03993711248040199, 0.02340799942612648, 0.05174338072538376, -0.06697140634059906, -0.106411874294281, 0.02524653822183609, 0.08620791137218475, 0.006662130821496248, -0.029756957665085793, 0.04121912270784378, 0.046450406312942505, -0.0295333843678236, -0.03131261467933655, 0.03418298810720444, 0.12292037159204483, -0.009462807327508926, -0.05757195129990578, 0.07287938892841339, 0.08787959814071655, 0.03263755887746811, 0.02764347940683365, 0.11475648730993271, -4.8535632402035844e-08, -0.00431549409404397, -0.04327850043773651, 0.008195552043616772, 0.03386710584163666, -0.020803987979888916, 0.0058476366102695465, -0.04832535982131958, -0.006780765950679779, -0.03804123401641846, -0.03961164504289627, -0.012753981165587902, 0.02685576304793358, -0.01720186322927475, -0.02160707861185074, -0.04187890887260437, -0.011278304271399975, 0.002440680982545018, -0.021562112495303154, 0.04159059748053551, 0.000928207824472338, -0.040713559836149216, -0.03235228359699249, 0.04560520127415657, -0.024772947654128075, -0.10442811995744705, 0.020895885303616524, -0.04608061909675598, -0.006145614665001631, 0.04480619356036186, 0.12530727684497833, 0.044950906187295914, -0.07746116071939468, 0.05319547653198242, -0.0025753432419151068, 0.02670448273420334, -0.05202259495854378, -0.02063681185245514, 0.057444579899311066, 0.00621770741418004, 0.051041677594184875, -0.08861171454191208, 0.07630997896194458, -0.0573439784348011, -0.0187655258923769, 0.07938521355390549, 0.024699075147509575, 0.011108764447271824, -0.0413421206176281, 0.05691151320934296, -0.011977966874837875, -0.009664678946137428, 0.006762879900634289, -0.03347868472337723, 0.007844864390790462, -0.017363909631967545, -0.03197573497891426, -0.11280955374240875, 0.0445873960852623, -0.07419606298208237, 0.008993997238576412, -0.04218830540776253, 0.02740434929728508, 0.04564044624567032, -0.018006866797804832 ] }, { "text": "In [14]:\n\nimport matplotlib.pyplot as plt\nimport numpy as np\nimport matplotlib.mlab as mlab\nimport matplotlib.gridspec as gridspec\n\nIn [15]:\n\nsampling_freq = 0.01\nbegin_time = 0\nend_time = 10\ntime = np.arange(begin_time, end_time, sampling_interval)\nwave_ = 0.1 * np.sin(2 * np.pi * time)\n\nfig, (ax0, ax1, ax2) = plt.subplots(3, 1, figsize=(12,7))\nax0.plot(time, wave_)\nax1.psd(wave_, 512, 1 / sampling_freq)\nax2.specgram(wave_, Fs=sampling_freq)\n\nplt.show()\n\nAdd noise\n\nIn [16]:\n\nsampling_freq = 0.01\nbegin_time = 0\nend_time = 10\ntime = np.arange(begin_time, end_time, sampling_interval)\n\n# noise\nnp.random.seed(42)\nrandom_values = np.random.randn(len(time))\nexp_values = np.exp(-time / 0.05)\nnoise = np.convolve(random_values, exp_values) * sampling_freq\nnoise = noise[:len(time)]", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_7", "embedding": [ -0.050477415323257446, -0.052114952355623245, 0.007270366419106722, -0.005311037413775921, 0.04198328033089638, -0.11423447728157043, -0.014281360432505608, 0.028245072811841965, 0.010394440032541752, -0.04805992916226387, -0.039114825427532196, -0.04761076346039772, -0.016984043642878532, -0.0709601417183876, 0.022726355120539665, -0.007636586204171181, 0.0067352172918617725, -0.06841819733381271, 0.042101845145225525, -0.01311903353780508, 0.09033813327550888, 0.0029721278697252274, 0.009157259948551655, -0.03826160728931427, 0.08848538994789124, 0.005509522277861834, 0.015392255038022995, -0.0003214749158360064, 0.02498042769730091, 0.06418654322624207, 0.11778794974088669, 0.05418679863214493, -0.022941315546631813, 0.025169501081109047, 0.07073430716991425, -0.03111829236149788, 0.035068586468696594, 0.0906694084405899, 0.008510634303092957, 0.02376686967909336, 0.08825954049825668, 0.09359988570213318, -0.003534882329404354, -0.05717366188764572, 0.0028272834606468678, 0.01405094750225544, -0.002033479977399111, -0.08855018019676208, 0.027600448578596115, 0.05449950695037842, 0.04276930168271065, -0.027707988396286964, -0.018242940306663513, -0.05888036638498306, 0.017811056226491928, -0.006160445977002382, 0.0371713787317276, -0.08348895609378815, 0.08161506056785583, -0.05334024503827095, -0.002654476324096322, 0.02429031766951084, -0.01413975190371275, -0.017917180433869362, 0.020973248407244682, -0.023776192218065262, 0.01561182364821434, 0.026005569845438004, -0.014806604944169521, 0.09046190977096558, -0.043649666011333466, 0.06989407539367676, 0.010080240666866302, 0.028543435037136078, -0.0663304477930069, -0.022565724328160286, -0.006979368161410093, -0.07303881645202637, -0.051299408078193665, -0.09321074932813644, -0.038440413773059845, 0.003669195342808962, 0.01490737870335579, -0.03631771728396416, -0.04864033684134483, 0.02799290232360363, 0.10519838333129883, 0.049137894064188004, -0.058808065950870514, -0.05001252144575119, 0.035528283566236496, 0.06288285553455353, -0.10619650036096573, 0.06842096894979477, -0.023936733603477478, 0.03386286273598671, 0.07242247462272644, 0.03675953298807144, 0.0219833105802536, 0.04148140922188759, 0.024180779233574867, -0.06933487951755524, 0.005943472031503916, 0.034976717084646225, -0.00826161727309227, -0.010433455929160118, 0.04283623769879341, 0.04420541971921921, -0.07562460005283356, 0.08328063786029816, -0.021928204223513603, -0.026189621537923813, -0.06095815822482109, 0.033589087426662445, 0.1566220372915268, 0.06613529473543167, -0.004749007057398558, 0.05977926775813103, -0.07745695114135742, -0.02971568889915943, -0.0012946546776220202, -0.009264262393116951, -0.00599993159994483, 0.06357113271951675, 0.027685154229402542, 0.009722988121211529, -0.049405474215745926, 5.8502113054318994e-33, -0.00876874290406704, 0.03905908763408661, -0.08048617094755173, -0.06922975927591324, 0.03189059719443321, 0.021144140511751175, -0.05463306978344917, -0.07890988141298294, 0.01999550312757492, 0.10339658707380295, -0.04073452576994896, -0.021327268332242966, -0.0025324360467493534, -0.041926782578229904, -0.016884414479136467, -0.04033651575446129, 0.056928034871816635, -0.025528734549880028, -0.018878422677516937, -0.05506374314427376, 0.05179533734917641, -0.008367951959371567, 0.036312974989414215, 0.002859229687601328, -0.008309727534651756, -0.02271289937198162, -0.05145059898495674, -0.019167132675647736, -0.008283724077045918, 0.003730697324499488, -0.014035656116902828, 0.07938874512910843, -0.025015754625201225, -0.009144311770796776, 0.028500009328126907, -0.0690460130572319, 0.0917394682765007, 0.02836340107023716, 0.012440964579582214, -0.08236167579889297, 0.031820569187402725, -0.01873686909675598, 0.055225249379873276, 0.008458465337753296, 0.087080217897892, -0.05764085799455643, -0.029080083593726158, 0.08821401745080948, 0.06542593240737915, 0.04778240621089935, -0.038676366209983826, -0.029537491500377655, 0.014363736845552921, 0.03661553934216499, -0.0028096947353333235, 0.024957111105322838, 0.018831800669431686, -0.08528859913349152, 0.011289771646261215, -0.033369142562150955, -0.004946587141603231, -0.06597273796796799, 0.04879371449351311, -0.0661996379494667, 0.03710980340838432, 0.08687519282102585, 0.004217972047626972, 0.01190725527703762, 0.03416895493865013, 0.04558730870485306, -0.027606254443526268, 0.03986231982707977, -0.06824024021625519, -0.018196996301412582, -0.005360072944313288, -0.08241783082485199, -0.008614350110292435, 0.11970636993646622, -0.07495671510696411, 0.01912255957722664, -0.017291927710175514, -0.03699382022023201, -0.07511793822050095, -0.0873517170548439, -0.02560790441930294, -0.033312372863292694, 0.07006188482046127, -0.022938286885619164, -0.1453050822019577, -0.09531945735216141, -0.08439493924379349, 0.02566065639257431, 0.07247260957956314, 0.03641635552048683, -0.09121213108301163, -7.355863081149797e-33, 0.01039863470941782, 0.09163588285446167, 0.0414668470621109, 0.017243968322873116, -0.004970702342689037, 0.07494450360536575, 0.03996040299534798, 0.026280909776687622, 0.014363691210746765, 0.013774476945400238, -0.04153142496943474, -0.11848543584346771, 0.03836444392800331, -0.020428502932190895, 0.03329261764883995, -0.01149818580597639, 0.02447052299976349, 0.029738489538431168, 0.041290849447250366, -0.03866757079958916, 0.031297411769628525, 0.022987598553299904, 0.030513472855091095, -0.043097566813230515, -0.02330610156059265, 0.009126718156039715, -0.0321962796151638, -0.05734257027506828, -0.04372348263859749, -0.07952132076025009, -0.12511657178401947, 0.11835982650518417, 6.171275890665129e-05, -0.049315910786390305, -0.0125154173001647, 0.07664435356855392, 0.006475501693785191, -0.05146865174174309, -0.033343907445669174, -0.044126253575086594, 0.02998160757124424, 0.0529044046998024, 0.010414409451186657, -0.0958278477191925, -0.0716896802186966, 0.056906215846538544, 0.030102571472525597, 0.023297226056456566, -0.036586225032806396, -0.015483502298593521, 0.00845344364643097, 0.04886040836572647, 0.020598378032445908, 0.10066933184862137, 0.05213737487792969, -0.0007535478798672557, -0.021129652857780457, 0.04593673720955849, -0.03933326154947281, -0.06612899899482727, -0.06440316140651703, -0.024509944021701813, -0.10756103694438934, 0.01984333246946335, 0.0815356895327568, 0.03320828825235367, -0.03917200490832329, -0.06534834206104279, 0.03247804567217827, 0.0598427876830101, -0.02224891074001789, 0.0485219843685627, -0.039169881492853165, -0.06662246584892273, -0.012259850278496742, -0.0071005793288350105, -0.03454115241765976, -0.034173548221588135, -0.03830990940332413, -0.0030028929468244314, 0.014038551598787308, 0.03519110009074211, 0.018790382891893387, 0.06153077632188797, -0.08460790663957596, -0.05199002847075462, 0.019852500408887863, -0.023591119796037674, -0.0061555965803563595, -0.014238898642361164, 0.06736749410629272, -0.001833923626691103, 0.003828661050647497, 0.031356580555438995, 0.08474719524383545, -5.1325645955557775e-08, 0.012499967589974403, 0.039628274738788605, 0.051027748733758926, -0.06329379230737686, 0.04706227034330368, -0.062115591019392014, -0.04197949916124344, -0.05531700700521469, -0.02510673739016056, -0.030999930575489998, 0.07182326912879944, -0.03276940435171127, 0.016197022050619125, -0.0404081717133522, -0.03860636055469513, 0.004705595318228006, -0.07679334282875061, -0.027532603591680527, 0.036469459533691406, -0.07448797672986984, -0.04073043167591095, -0.04548471048474312, 0.010378345847129822, 0.021066876128315926, -0.03299815207719803, 0.039359644055366516, -0.033544693142175674, -0.0920642837882042, -0.007934831082820892, 0.06098559498786926, -0.027566421777009964, -0.0694342628121376, 0.06771675497293472, -0.022430799901485443, 0.028722362592816353, 0.017844047397375107, -0.06417679041624069, 0.05132441595196724, 0.033379536122083664, 0.059237223118543625, -0.11674962192773819, 0.05769254267215729, -0.027151241898536682, -0.0388299897313118, 0.035653386265039444, 0.026495907455682755, 0.05923561006784439, -0.07570315152406693, 0.034984614700078964, 0.06189155951142311, 0.06244741752743721, 0.04845545068383217, 0.06364424526691437, -0.11101759970188141, -0.01896594651043415, 0.04027572646737099, -0.14155463874340057, -0.009717277251183987, 0.005964401178061962, 0.02812129631638527, -0.01966666430234909, 0.037218306213617325, -0.08838735520839691, -0.06295965611934662 ] }, { "text": "wave_ = 0.1 * np.sin(2 * np.pi * time) + noise\n\nfig, (ax0, ax1, ax2) = plt.subplots(3, 1, figsize=(12,7))\nax0.plot(time, wave_)\nax1.psd(wave_, 512, 1 / sampling_freq)\nax2.specgram(wave_, Fs=sampling_freq)\n\nplt.show()\n\nExample 6 - Spectogram [7]¶\n\nIn [17]:\n\n# import the libraries\nimport matplotlib.pyplot as plot\nimport numpy as np\n\n# Define the list of frequencies\n\nfrequencies= np.arange(5,105,5)\n\n# Sampling Frequency\nsamplingFrequency = 400\n\n# Create two ndarrays\ns1 = np.empty([0]) # For samples\ns2 = np.empty([0]) # For signal\n\n# Start - stop Value of the sample\nstart = 1\nstop = samplingFrequency+1", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_8", "embedding": [ -0.018197908997535706, -0.08977082371711731, 0.0027185373473912477, -0.010621463879942894, 0.02232876606285572, -0.07275643199682236, -0.026577189564704895, 0.00805575493723154, -0.02338472753763199, -0.04222693666815758, -0.04562690109014511, -0.0504339300096035, -0.00044645898742601275, -0.041975945234298706, 0.06619695574045181, 0.008425277657806873, 0.011893162503838539, -0.0731428936123848, 0.050862330943346024, -0.04724734276533127, 0.09838348627090454, 0.02616814710199833, 0.011392885819077492, -0.048675283789634705, 0.030467532575130463, 0.005088690668344498, -0.015422819182276726, 0.014292622916400433, 0.03371591120958328, 0.017550602555274963, 0.0851198211312294, 0.03371217101812363, -0.012694700621068478, 0.04325465112924576, 0.035846684128046036, -0.03937028720974922, 0.0511557012796402, 0.1053776666522026, -0.0037125549279153347, 0.046870794147253036, 0.06479935348033905, 0.08753170818090439, -0.0017657841090112925, -0.04250035062432289, -0.029166830703616142, 0.018404902890324593, -0.055106714367866516, -0.05836343392729759, 0.019338132813572884, 0.021914085373282433, 0.054120924323797226, -0.022306684404611588, -0.04179063439369202, 0.0014730978291481733, 0.02652394212782383, 0.00401269318535924, 0.03630741685628891, -0.11561748385429382, 0.06964061409235, -0.057899460196495056, -0.006545708980411291, 0.029568782076239586, 0.00478679034858942, -0.034138720482587814, 0.05971670150756836, -0.03538509085774422, 0.058996230363845825, 0.041382744908332825, 0.004039337392896414, 0.09482806921005249, -0.06487157940864563, 0.06457974016666412, 0.027546044439077377, 0.059943828731775284, -0.0727715715765953, -0.005617983173578978, -0.023338034749031067, -0.05929650738835335, -0.05381261184811592, -0.11668220907449722, -0.0314534455537796, -0.02377593144774437, -0.024186663329601288, -0.02013091742992401, -0.06250559538602829, -0.0016481193015351892, 0.04295539855957031, 0.035194870084524155, -0.036963555961847305, -0.09971295297145844, -0.012800510041415691, 0.03589721769094467, -0.056578587740659714, 0.015991706401109695, -0.024428972974419594, 0.020533191040158272, 0.05087175965309143, 0.01228395663201809, 0.04877196252346039, 0.04818124696612358, 0.05724148079752922, -0.07491228729486465, 0.005189109593629837, 0.029244713485240936, -0.01772119477391243, -0.007349459454417229, -0.007549821864813566, 0.04524781182408333, -0.04893624037504196, 0.07767823338508606, -0.007952063344419003, -0.019304022192955017, -0.022978078573942184, 0.08947838842868805, 0.16511085629463196, 0.09986310452222824, -0.028065618127584457, 0.07941929250955582, -0.04756423085927963, -0.029491262510418892, 0.028133248910307884, -0.011469641700387001, -0.0029304036870598793, 0.03579949960112572, 0.021084504202008247, -0.052936848253011703, -0.054368212819099426, 5.4457990044208e-33, -0.043921805918216705, 0.02290504053235054, -0.07916875183582306, -0.03044542483985424, 0.025027628988027573, 0.0030057139229029417, -0.09483208507299423, -0.04012766852974892, 0.015187976881861687, 0.0954337939620018, -0.025173872709274292, 0.05611351877450943, 0.02465863898396492, -0.018781498074531555, -0.00730480533093214, -0.03894286975264549, 0.06701499968767166, -0.025307223200798035, -0.02009355090558529, -0.07273510843515396, -0.008631638251245022, 0.03141007199883461, 0.019801653921604156, 0.027656210586428642, -0.041014306247234344, -0.03591268137097359, -0.05821194872260094, 0.011665843427181244, -0.009209138341248035, -0.015764228999614716, -0.057406000792980194, 0.058416947722435, 0.02766537293791771, -0.0030546714551746845, 0.04755914956331253, -0.08494757115840912, 0.10178304463624954, 0.01811969093978405, 0.00452872458845377, -0.06080435961484909, 0.057481635361909866, -0.010065027512609959, 0.015534641221165657, 0.02121049165725708, 0.058633752167224884, -0.09587621688842773, -0.07189584523439407, 0.08997037261724472, 0.05904841423034668, 0.04010964184999466, -0.042132049798965454, -0.05772719904780388, -0.0022360309958457947, 0.0304282084107399, 0.011004364117980003, 0.011954142712056637, 0.0068686907179653645, -0.07845314592123032, -0.019034000113606453, 0.00031250229221768677, 0.033446718007326126, -0.06683244556188583, 0.029453987255692482, -0.059074800461530685, 0.014465883374214172, 0.08921879529953003, -0.01708754152059555, 0.052647270262241364, -0.0020852950401604176, 0.09948543459177017, -0.03165309131145477, 0.09136394411325455, -0.020860640332102776, -0.03361492231488228, 0.028317393735051155, -0.07787220180034637, -0.018645139411091805, 0.12492381036281586, -0.10896499454975128, 0.04542602598667145, 0.00460649561136961, -0.05139235034584999, -0.08208101987838745, -0.07312475889921188, -0.009640129283070564, -0.001081530936062336, 0.05928102135658264, 0.006654601078480482, -0.12273883074522018, -0.09713537245988846, -0.0700959712266922, 0.040844690054655075, 0.0455438457429409, 0.007617748808115721, -0.0370200090110302, -7.518845372891307e-33, 0.006286251358687878, 0.10711856186389923, 0.07778000086545944, 0.036942798644304276, 0.04580869898200035, 0.07845030725002289, 0.041309960186481476, -0.028629275038838387, -0.021339213475584984, -0.002806205302476883, -0.06217963993549347, -0.11053719371557236, 0.06333769112825394, -0.05931360647082329, 0.014053886756300926, -0.026923906058073044, 0.01752399280667305, 0.04259227216243744, 0.06178303807973862, -0.03570089116692543, -0.006587638054043055, 0.006572021637111902, -0.027772651985287666, -0.05882733687758446, -0.0629432201385498, 0.04136825352907181, -0.031689491122961044, -0.10279638320207596, -0.030536172911524773, -0.07927960902452469, -0.09773463755846024, 0.046847857534885406, 0.012123826891183853, -0.02554522082209587, 0.004138733725994825, 0.0776105523109436, 0.021463913843035698, -0.018103141337633133, -0.08563325554132462, -0.01886848732829094, 0.01787783019244671, 0.059796012938022614, 0.04329151287674904, -0.09766615182161331, -0.0701398253440857, 0.05969206243753433, 0.03504549711942673, 0.020903976634144783, -0.026366734877228737, -0.05286116153001785, 0.020448414608836174, 0.05368334800004959, -0.011580866761505604, 0.02533525973558426, 0.019527291879057884, 0.005503516178578138, -0.01995231583714485, 0.05643255263566971, 0.0013438038295134902, -0.0400080531835556, -0.046976037323474884, -0.042368654161691666, -0.10486602038145065, 0.016633864492177963, 0.07858353108167648, 0.010330894961953163, -0.0018282795790582895, -0.02241939678788185, 0.012736642733216286, 0.05371774360537529, -0.027023794129490852, 0.016883622854948044, -0.010922027751803398, -0.07965588569641113, -0.035819634795188904, 0.009389626793563366, -0.07483457773923874, -0.05917137861251831, -0.07574979960918427, 0.007977811619639397, 0.007796331774443388, -0.012869570404291153, 0.008747467771172523, 0.06686326861381531, -0.11855943500995636, 0.011371297761797905, 0.028069935739040375, 0.0015510350931435823, -0.0005307086394168437, -0.03147431090474129, 0.07383568584918976, 0.031220346689224243, 0.0011174649698659778, 0.012758634984493256, 0.10498883575201035, -5.177130191214019e-08, 0.04919831082224846, -0.0367688313126564, 0.0021314756013453007, -0.036210112273693085, 0.05850556865334511, -0.010898206382989883, -0.05340418964624405, -0.004136879462748766, -0.006754343397915363, -0.04567889869213104, 0.001696521183475852, -0.019141938537359238, 0.03135683387517929, -0.017606113106012344, -0.04782743752002716, 0.019734537228941917, -0.03513482213020325, 0.007196122780442238, 0.054506439715623856, -0.0670362189412117, -0.07665902376174927, -0.0426359698176384, 0.02915044128894806, -0.004451727494597435, -0.10114039480686188, 0.06048769876360893, 0.004033294506371021, -0.06583802402019501, 0.004931160714477301, 0.04938097670674324, -0.042310766875743866, -0.08026392012834549, 0.04209490865468979, -0.037842683494091034, 0.06075514853000641, -0.039886731654405594, -0.07405342161655426, 0.04742304980754852, 0.03603842481970787, 0.04873409494757652, -0.07420080155134201, 0.11506806313991547, -0.05501877889037132, 0.021551458165049553, 0.07206142693758011, 0.02203473076224327, 0.07157091796398163, -0.0663253515958786, 0.024536384269595146, 0.05721136927604675, 0.020531808957457542, 0.050703879445791245, 0.05495988205075264, -0.11454446613788605, -0.020459013059735298, 0.025546440854668617, -0.1414506435394287, -0.029301472008228302, -0.019966965541243553, 0.057069264352321625, -0.012446303851902485, 0.0249288659542799, -0.03283747285604477, -0.05529911816120148 ] }, { "text": "# Start - stop Value of the sample\nstart = 1\nstop = samplingFrequency+1\n\nfor frequency in frequencies:\nsub1 = np.arange(start, stop, 1)\n# Signal - Sine wave with varying frequency + Noise\nsub2 = np.sin(2*np.pi*sub1*frequency*1/samplingFrequency)+np.random.randn(len(sub1))\ns1 = np.append(s1, sub1)\ns2 = np.append(s2, sub2)\nstart = stop+1\nstop = start+samplingFrequency\n\n# Plot the signal\n\nplot.subplot(211)\nplot.plot(s1,s2)\nplot.xlabel('Sample')\nplot.ylabel('Amplitude')\n\n# Plot the spectrogram\n\nplot.subplot(212)\npowerSpectrum, freqenciesFound, time, imageAxis = plot.specgram(s2, Fs=samplingFrequency)\nplot.xlabel('Time')\nplot.ylabel('Frequency')\nplot.show()\n\nprint(powerSpectrum.shape)\nprint(powerSpectrum[0][:10])", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_9", "embedding": [ -0.034330643713474274, -0.06677810847759247, -0.012735515832901001, 0.015200790017843246, 0.026574868708848953, -0.08240406215190887, 0.002702983096241951, 0.01413654163479805, -0.0521785169839859, -0.0469854399561882, -0.016474109143018723, -0.08967757970094681, 0.01208640355616808, -0.06660570949316025, 0.06338859349489212, 0.03590546175837517, 0.023132847622036934, -0.08223026245832443, 0.05603617802262306, -0.07035337388515472, 0.08781883120536804, 0.030617941170930862, 0.03731577843427658, -0.023991061374545097, 0.021933872252702713, -0.009793763048946857, -0.026374096050858498, 0.004164988175034523, 0.058398645371198654, 0.006034110672771931, 0.0876493826508522, 0.04805028811097145, 0.017077062278985977, 0.048082251101732254, 0.056520529091358185, -0.04099791496992111, 0.038409315049648285, 0.05586201325058937, 0.018316201865673065, 0.08079086989164352, 0.03951515629887581, 0.048161912709474564, -0.0062403264455497265, -0.0665675476193428, -0.03534838184714317, 0.019551940262317657, -0.04105352237820625, -0.03193194419145584, 0.0316992811858654, 0.042308259755373, 0.0573447123169899, -0.01842099241912365, -0.038642704486846924, -0.011994672007858753, 0.04771113768219948, 0.019677728414535522, 0.07900597155094147, -0.10637795925140381, 0.08104978501796722, -0.08856505900621414, -0.017248904332518578, -0.010194865055382252, -0.025309935212135315, -0.06053106114268303, 0.04627794399857521, -0.0210752934217453, 0.018545977771282196, 0.045332107692956924, 0.04473796859383583, 0.075016550719738, -0.046108171343803406, 0.04368440806865692, -0.004137297626584768, 0.043496400117874146, -0.07816864550113678, 0.02929060161113739, -0.037325482815504074, -0.016827169805765152, -0.010125202126801014, -0.11637058109045029, -0.0036348123103380203, -0.0799245610833168, -0.01569070667028427, 0.031224217265844345, -0.011200555600225925, -0.04572905972599983, 0.049777790904045105, 0.0402163527905941, -0.009532776661217213, -0.07073533535003662, -0.02531960979104042, 0.06437373161315918, -0.07641186565160751, 0.008424467407166958, -0.041192274540662766, 0.03739788383245468, 0.046659402549266815, 0.0026498029474169016, 0.06511467695236206, 0.013720751740038395, 0.03929116949439049, -0.0911855548620224, 0.023704728111624718, 0.04289707913994789, -0.043480291962623596, -0.013914884999394417, -0.015945542603731155, 0.04514967277646065, -0.0020067617297172546, 0.060029536485672, -0.006547005847096443, 0.020289165899157524, -0.0059840925969183445, 0.04240492358803749, 0.14772509038448334, 0.1305849701166153, -0.01187996193766594, 0.09255213290452957, -0.07332602143287659, -0.017687588930130005, 0.04535609483718872, 0.021650634706020355, -0.018977580592036247, 0.013277173042297363, 0.009185027331113815, -0.023192573338747025, -0.004480237606912851, 8.647004035573919e-33, -0.021538710221648216, -0.002155630150809884, -0.07137495279312134, -0.03546333312988281, 0.028987886384129524, 0.05432499945163727, -0.10256517678499222, 0.007121667265892029, 0.007290232460945845, 0.11064672470092773, -0.08410725742578506, 0.05052545666694641, 0.01919141784310341, -0.0588216558098793, -0.05953997001051903, -0.0495326891541481, 0.03804948180913925, -0.048509590327739716, -0.003689245553687215, -0.02873023971915245, 0.05438651889562607, -0.04704460874199867, 0.009650667198002338, 0.02930954284965992, -0.035731274634599686, 0.00010364392073825002, -0.0067773740738630295, 0.02020314149558544, 0.023017674684524536, 0.0060838935896754265, -0.03302958607673645, 0.055890489369630814, 0.019735833629965782, -0.038035500794649124, 0.03285522013902664, -0.10375823825597763, 0.1257200837135315, 0.07851890474557877, -0.03139185532927513, -0.0658663809299469, 0.03087279573082924, -0.007001502439379692, 0.03114866465330124, -0.004049648065119982, 0.024755407124757767, -0.10869280248880386, -0.022508129477500916, 0.07375473529100418, 0.09988987445831299, 0.0976974368095398, -0.02486298605799675, -0.09717436879873276, 0.018341591581702232, -0.003016273956745863, -0.017675010487437248, 0.03208091855049133, 0.076319620013237, -0.027180230244994164, -0.024860035628080368, -0.018803967162966728, -0.0032411168795078993, -0.059653833508491516, 0.018165625631809235, -0.0748738944530487, 0.0408625490963459, 0.10412311553955078, 0.00016751207294873893, 0.004354370757937431, -0.01939431205391884, 0.05857645347714424, -0.005192095879465342, 0.05907778441905975, -0.025065571069717407, -0.02422400191426277, 0.013565954752266407, -0.05991007387638092, -0.04008108377456665, 0.11476405709981918, -0.11386381089687347, 0.03443748876452446, -0.03216392919421196, -0.008122796192765236, -0.05735793709754944, -0.04764515161514282, -0.0017651566304266453, -0.007884935475885868, 0.09789209812879562, 0.00873857457190752, -0.06806884706020355, -0.11103532463312149, -0.07004056125879288, 0.01420929841697216, 0.06887239217758179, -0.007737420499324799, -0.04381925240159035, -8.837198286852996e-33, 0.012013358063995838, 0.12999659776687622, 0.06284898519515991, 0.02355041168630123, 0.055168282240629196, 0.049566563218832016, 0.07404179871082306, 0.031822774559259415, 0.03258666396141052, -0.003667808137834072, -0.020570168271660805, -0.15107859671115875, 0.013728269375860691, -0.03904883936047554, 0.030606349930167198, -0.006301937624812126, -0.017656411975622177, 0.002565265167504549, -0.008698046207427979, 0.0136942770332098, -0.022235063835978508, -0.032273221760988235, -0.017441648989915848, -0.09226500242948532, -0.05283680558204651, 0.05127960816025734, -0.02903148904442787, -0.037509504705667496, 0.022789016366004944, -0.04209141805768013, -0.1053457036614418, 0.06342920660972595, -0.004611601587384939, 0.002649162895977497, 0.019329221919178963, 0.031634628772735596, 0.05438128486275673, -0.013571195304393768, -0.04614934325218201, -0.023403558880090714, 0.06143553555011749, 0.059185370802879333, 0.012882205657660961, -0.044818002730607986, -0.011212692596018314, 0.05581105127930641, 0.02581668645143509, 0.030436301603913307, -0.06335828453302383, -0.04817982017993927, -0.015876570716500282, 0.012669406831264496, -0.0006602996727451682, 0.04771473631262779, -0.014134997501969337, 0.013677675276994705, -0.020895591005682945, 0.05951656773686409, -0.04910161718726158, -0.04522015154361725, -0.02535645291209221, -0.05001306161284447, -0.061247605830430984, -0.044449806213378906, 0.07537047564983368, 0.05825391784310341, -0.01944444514811039, -0.04955286905169487, 0.0720309391617775, 0.022898005321621895, -0.04030093550682068, 0.004476016387343407, 0.0018437885446473956, -0.07702723890542984, 0.012488367035984993, 0.03792072460055351, -0.13840381801128387, -0.10249190032482147, -0.06784569472074509, -0.057570189237594604, -0.0012167554814368486, -0.015096844173967838, 0.0041109356097877026, 0.05968901887536049, -0.0866103544831276, -0.010451030917465687, -0.027919448912143707, 0.024975871667265892, 0.01214402262121439, -0.0545811764895916, 0.008823801763355732, 0.04041169956326485, 0.04323095455765724, 0.04189157485961914, 0.08021707087755203, -5.144869774653671e-08, 0.017219090834259987, 0.002261456800624728, -0.006251715589314699, 0.005664019379764795, 0.08076970279216766, 0.009880262427031994, -0.04191194102168083, -0.03712424263358116, 0.01071306224912405, -0.05698004737496376, 0.03018058091402054, -0.011349396780133247, -0.011775682680308819, -0.04104914888739586, -0.04050114378333092, 0.020080408081412315, -0.008743408136069775, 0.012355026789009571, 0.04734775424003601, -0.06149799004197121, -0.037680890411138535, -0.04437978193163872, 0.04260839894413948, -0.04236740618944168, -0.10042860358953476, 0.03909973427653313, -0.03174011781811714, -0.02736782468855381, 0.014081455767154694, -0.024595439434051514, 0.021542852744460106, -0.07308395206928253, 0.013155966997146606, 0.013988649472594261, 0.0021188745740801096, -0.054855912923812866, -0.07994679361581802, 0.029284581542015076, 0.0828171819448471, 0.058359041810035706, -0.03367488831281662, 0.08280203491449356, -0.11933020502328873, 0.008193086832761765, 0.038348495960235596, 0.011910499073565006, 0.05692881718277931, -0.07127677649259567, 0.07529371976852417, 0.09719981998205185, -0.01922094076871872, -0.04121372476220131, 0.008278341963887215, -0.12083554267883301, -0.01865409128367901, 0.0008101589046418667, -0.10306183248758316, 0.010308614000678062, -0.061769984662532806, 0.02849191427230835, -0.026393597945570946, 0.05861102417111397, -0.025112297385931015, -0.10397592186927795 ] }, { "text": "print(powerSpectrum.shape)\nprint(powerSpectrum[0][:10])\n\n(129, 61)\n[4.65115394e-03 2.30334436e-04 2.40199530e-04 2.62529327e-03\n4.42714257e-03 1.74208829e-04 5.96734856e-05 3.74071934e-04\n2.43757906e-04 1.12785127e-03]\n\nReferences:\n\n• https://www.youtube.com/watch?v=DSz4ZILAneQ [1]\n•\n\n• https://www.youtube.com/watch?v=su9YSmwZmPg [2]\n•\n\n• https://blog.endaq.com/vibration-analysis-fft-psd-and-spectrogram [3]\n-https://pythontic.com/visualization/signals/fouriertransform_fft [4]\n•\n\n• https://matplotlib.org/stable/gallery/lines_bars_and_markers/psd_demo.html [5]\n•\n\n• https://fairyonice.github.io/implement-the-spectrogram-from-scratch-in-python.html [6]\n•\n\n• https://pythontic.com/visualization/signals/spectrogram [7]\n•", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_10", "embedding": [ -0.09277108311653137, -0.01737871766090393, -0.0807153508067131, 0.017650693655014038, -0.0003941216564271599, -0.011642787605524063, -0.021695736795663834, 0.042125046253204346, 0.028219791129231453, -0.06641688942909241, 0.04350307956337929, -0.043475907295942307, -0.06382618099451065, -0.031449198722839355, 0.002337652025744319, 0.02413240447640419, -0.032386019825935364, -0.04034578427672386, -0.012564090080559254, 0.015906497836112976, 0.10890492796897888, 0.024594059213995934, -0.030074432492256165, 0.012125171720981598, 0.03957529366016388, 0.055512961000204086, -0.029987100511789322, 0.031401626765728, 0.022220054641366005, -0.023866675794124603, 0.011443656869232655, 0.049108441919088364, -0.006566687487065792, 0.030488258227705956, 0.09033931791782379, -0.05012914165854454, 0.10761301964521408, 0.02314787171781063, -0.0003278871881775558, 0.019005736336112022, 0.056621864438056946, 0.023677147924900055, 0.03323192894458771, -0.05541524663567543, -0.00778341805562377, 0.03964552655816078, -0.11332829296588898, -0.06298167258501053, -0.02848099358379841, -0.029925469309091568, 0.0016967769479379058, 0.005100746173411608, 0.009453928098082542, 0.027442913502454758, 0.04033480957150459, -0.0009126504883170128, 0.07570205628871918, -0.0919446125626564, 0.12313588708639145, -0.10865939408540726, 0.027645787224173546, -0.022960416972637177, -0.05742933228611946, -0.06929287314414978, 0.03150682896375656, 0.011073076166212559, 0.016654275357723236, -0.00849488377571106, 0.021530458703637123, -0.012641126289963722, -0.12091550976037979, 0.01143659558147192, -0.030715476721525192, -0.038579829037189484, -0.01273887325078249, -0.0031208593863993883, 0.020748121663928032, -0.04403147101402283, -0.06857439130544662, -0.07080613076686859, 0.010097311809659004, -0.020644495263695717, 0.06336379796266556, -0.032751020044088364, -0.012858202680945396, 0.02317974530160427, -0.04376279562711716, 0.028064096346497536, 0.020767658948898315, -0.00779598206281662, -0.029707584530115128, 0.00815168023109436, -0.07188936322927475, 0.0381104052066803, -0.039653901010751724, 0.07289441674947739, 0.018283486366271973, -0.04118141159415245, 0.012747501023113728, 0.032487064599990845, 0.021579425781965256, -0.06371726840734482, 0.0358448289334774, 0.05593818426132202, -0.049413297325372696, 0.04760619252920151, -0.03147413954138756, 0.034163858741521835, 0.011701270006597042, 0.02197274938225746, 0.015418368391692638, -0.03029916062951088, -0.06756701320409775, 0.009657996706664562, 0.07747996598482132, 0.07143603265285492, -0.07864449173212051, 0.10721322149038315, -0.0009103809134103358, 0.018173912540078163, 0.09909527748823166, -0.010616302490234375, 0.0007997949724085629, 0.06756186485290527, -0.0018927425844594836, -0.006690123584121466, -0.0657443180680275, 7.329314541236475e-33, 0.030036408454179764, 0.08545728772878647, 0.01782945916056633, -0.029742740094661713, 0.05289531871676445, 0.028690673410892487, -0.1000901386141777, -0.005414175800979137, 0.04274196922779083, 0.07951804250478745, -0.13177475333213806, 0.08380038291215897, 0.06536949425935745, -0.06068536639213562, -0.04979896545410156, -0.08489836752414703, 0.03688954934477806, 0.020878132432699203, -0.01883995719254017, -0.00626027025282383, 0.06369579583406448, 0.07846259325742722, 0.05418214946985245, 0.05675174295902252, -0.026423167437314987, 0.07456889748573303, -0.018227647989988327, -0.0003349814214743674, 0.023286698386073112, 0.033135347068309784, -0.03289772570133209, -0.002838731277734041, 0.013301117345690727, -0.04330190271139145, 0.05141633003950119, -0.017522472888231277, 0.05255477502942085, -0.08533118665218353, -0.041318271309137344, -0.06527091562747955, -0.03269419074058533, -0.032977934926748276, -0.015853602439165115, 0.009203638881444931, 0.004723456222563982, -0.08854953944683075, -0.022037260234355927, 0.05945650488138199, 0.07098246365785599, 0.037743620574474335, -0.06539483368396759, -0.0334630012512207, -0.009759018197655678, 0.00536261685192585, -0.017520027235150337, 0.01029624231159687, 0.03615933656692505, -0.04106738790869713, 0.014035608619451523, -0.016515640541911125, 0.049318622797727585, 0.02574881725013256, 0.02714436873793602, -0.0940118134021759, 0.0064710089936852455, 0.032955143600702286, -0.0380110926926136, 0.0062187141738832, 0.03472753241658211, 0.06040693819522858, -0.09268774837255478, 0.09496127814054489, 0.07290396094322205, 0.02289293147623539, 0.10652140527963638, -0.04330601543188095, -0.04939284548163414, 0.03614932671189308, -0.14260397851467133, 0.0028737057000398636, -0.08294060081243515, 0.0692082941532135, -0.040523067116737366, -0.05306122824549675, 0.001513415714725852, -0.03973019868135452, 0.033358216285705566, -0.07241622358560562, -0.07451879233121872, -0.0691404640674591, -0.1184796467423439, -0.007034925743937492, 0.023350847885012627, 0.02722281962633133, -0.03434780240058899, -8.647643945311148e-33, 0.04939562454819679, 0.11051524430513382, 0.03507610037922859, 0.04173450917005539, 0.03997303172945976, 0.009003128856420517, 0.05582735687494278, 0.11367712914943695, -0.00775766558945179, -0.04706185311079025, 0.12260285764932632, -0.10515021532773972, -0.08603934943675995, 0.006213681772351265, 0.08357842266559601, 0.025848599150776863, -0.0982782319188118, 0.006886526010930538, 0.02898983284831047, -0.02035757154226303, 0.032392892986536026, -0.0028811367228627205, -0.04449259489774704, 0.03662458062171936, -0.04138204827904701, 0.02254759706556797, 0.005039166193455458, -0.10623262077569962, 0.010405454784631729, 0.04023787006735802, -0.08248378336429596, 0.03709814324975014, -0.04984677582979202, 0.0501321442425251, -0.09366951882839203, 0.05179213732481003, 0.011058913543820381, -0.014429905451834202, -0.0005937537644058466, -0.043727219104766846, 0.027778511866927147, 0.12447773665189743, 0.03686347231268883, -0.0015285940608009696, -0.052756018936634064, 0.04844418168067932, 0.06308522075414658, 0.0632641389966011, -0.00878678634762764, -0.05160165950655937, 0.048450589179992676, -8.693466952536255e-06, -0.04589960724115372, 0.07912392914295197, 0.020752329379320145, -0.0036478594411164522, 0.048974841833114624, 0.017413979396224022, -0.07128185033798218, -0.02171466127038002, -0.019306693226099014, -0.06634801626205444, 0.004213201347738504, 0.038238827139139175, 0.07913703471422195, 0.030423516407608986, 0.03803456202149391, -0.06705952435731888, 0.07791279256343842, 0.016317380592226982, 0.025833267718553543, 0.01312000211328268, 0.020490961149334908, 0.034895189106464386, 0.027246760204434395, 0.008311610668897629, -0.024348361417651176, -0.0547812283039093, -0.04417842626571655, -0.012859294191002846, -0.001746263005770743, -0.03164687752723694, 0.04065359756350517, 0.05958544462919235, -0.01968485303223133, -0.016149932518601418, 0.009033647365868092, 0.09704156219959259, -0.005458582658320665, -0.03661533072590828, -0.015216365456581116, 0.09889819473028183, 0.0894743800163269, 0.04365795850753784, 0.11475279927253723, -7.15830736908174e-08, -0.016524897888302803, -0.020671391859650612, -0.06757629662752151, -0.0826033353805542, 0.04311716556549072, 0.0007700921851210296, 0.006430949550122023, -0.06440216302871704, -0.06963910162448883, -0.043557945638895035, 0.041754454374313354, -0.05012281984090805, -0.07745099067687988, -0.06587637215852737, -0.02077394537627697, 0.03636879473924637, -0.03143392875790596, 0.03961345925927162, -0.030959345400333405, -0.04983336851000786, -0.030647912994027138, -0.03946567326784134, 0.000742543488740921, -0.04266277700662613, -0.05465086176991463, -0.002874635858461261, -0.10381561517715454, 0.006876268424093723, 0.005886366590857506, 0.021501127630472183, 0.002238629385828972, -0.03494053706526756, 0.055440664291381836, -0.07646333426237106, -0.02554706670343876, 0.0018978666048496962, -0.09135720133781433, 0.0018214416923001409, 0.026524683460593224, 0.10117517411708832, -0.022113723680377007, 0.032071202993392944, -0.08070068806409836, 0.022087451070547104, 0.03810172900557518, -0.02638643980026245, 0.04489964619278908, -0.06222013756632805, -0.05177401378750801, 0.05453808605670929, -0.045568596571683884, 0.014047075062990189, -0.0019181903917342424, -0.03871748596429825, -0.056736137717962265, 0.050417959690093994, -0.11699825525283813, -0.04978358745574951, -0.014970014803111553, 0.052346207201480865, 0.008628133684396744, -0.00048485957086086273, 6.352448690449819e-05, 0.020276667550206184 ] }, { "text": "• https://pythontic.com/visualization/signals/spectrogram [7]\n•\n\n• https://analyticsindiamag.com/hands-on-tutorial-on-visualizing-spectrograms-in-python/\n•\n\nIn [19]:\n\n# !pip install nbconvert\n#!jupyter nbconvert --to html FFT_PSD.ipynb", "source": "notebook: 2021-12-19-Fast Fourier Tranform.html", "type": "html_notebook", "chunk_id": "notebook: 2021-12-19-Fast Fourier Tranform.html_11", "embedding": [ -0.015467793680727482, -0.05672436207532883, -0.08413464576005936, -0.009957742877304554, -0.0333179272711277, 0.007916628383100033, -0.058432482182979584, 0.022948723286390305, -0.030269918963313103, -0.06685668230056763, -0.0289723202586174, -0.026560746133327484, -0.028786316514015198, -0.025416376069188118, -0.00408308207988739, -0.04161767289042473, -0.0008669819217175245, -0.002369518857449293, 0.015897104516625404, -0.10418462008237839, 0.03629055246710777, -0.020092450082302094, 0.02824275754392147, -0.04032153636217117, 0.028602559119462967, 0.020770801231265068, -0.02353702113032341, 0.08448483794927597, 0.056802891194820404, 0.036565352231264114, 0.018631229177117348, 0.029833238571882248, 0.03406362980604172, 0.10655776411294937, 0.03171618655323982, -0.049029119312763214, 0.09863340109586716, 0.06289026886224747, -0.01600499264895916, 0.08316844701766968, 0.09592583030462265, 0.032468657940626144, -0.04488926753401756, -0.061953105032444, -0.027783066034317017, -0.025394797325134277, -0.16317646205425262, -0.09307517856359482, 0.008807922713458538, -0.024756133556365967, -0.09345044195652008, -0.0003766168956644833, 0.023953475058078766, 0.03108815848827362, 0.04283253848552704, 0.02403360605239868, 0.050555892288684845, -0.1030014231801033, 0.08378452062606812, -0.12155202776193619, -0.025380967184901237, 0.02466266043484211, 0.013943932019174099, 0.002373339608311653, 0.04006008431315422, 0.052434876561164856, -0.014649619348347187, 0.09999985992908478, 0.10316912829875946, -0.03929311782121658, -0.0866335779428482, -0.05761212110519409, -0.040167149156332016, 0.0014774102019146085, -0.05212513729929924, 0.0018974306294694543, -0.03125349432229996, -0.08585187792778015, -0.042044498026371, -0.12171397358179092, 0.011050487868487835, -0.013907412067055702, 0.02963976189494133, 0.060549553483724594, 0.01389755867421627, 0.000792396254837513, -0.01778235472738743, 0.05960405617952347, -0.0076957871206104755, -0.012865811586380005, -0.055376872420310974, -0.043664317578077316, -0.016632121056318283, -0.04195229336619377, -0.048673778772354126, 0.058110278099775314, -0.019760631024837494, -0.05925150588154793, -0.010326715186238289, 0.011271921917796135, 0.06376171857118607, -0.10889860987663269, 0.002302943030372262, 0.02560524269938469, -0.05512503907084465, -0.03252289816737175, 0.03611760959029198, 0.06184035912156105, 0.03707734867930412, 0.006544560194015503, 0.0028139897622168064, -0.022819017991423607, -0.029412055388092995, -0.023706426844000816, 0.07043146342039108, 0.09916375577449799, -0.08747173845767975, 0.08807136118412018, 0.030697695910930634, 0.026573117822408676, 0.048392973840236664, -0.010898774489760399, -0.06511785089969635, 0.06689217686653137, 0.056151967495679855, 0.0287079568952322, -0.001897835754789412, 2.3961228633526026e-34, 0.010900307446718216, 0.0033933434169739485, 0.005649426486343145, -0.05645289644598961, 0.04007432237267494, -0.008104062639176846, -0.06703273952007294, -0.04752025008201599, -0.014196199364960194, 0.03302520141005516, -0.007480490021407604, 0.10142699629068375, -0.013751319609582424, 0.051571741700172424, -0.09651456028223038, -0.051950838416814804, -0.02607622928917408, 0.06912685185670853, -0.007808484137058258, -0.003117718268185854, -0.006977487355470657, 0.06640109419822693, 0.061082594096660614, 0.0411967933177948, -0.0061715939082205296, 0.011049668304622173, -0.07952485233545303, 0.027333250269293785, 0.0015140017494559288, 0.05740824714303017, -0.03737201169133186, 0.05187717452645302, -0.03726377710700035, -0.04446028172969818, -0.03399132192134857, -0.06783628463745117, -0.03312693163752556, -0.06122040003538132, 0.005708588752895594, -0.02213851734995842, -0.046983253210783005, -0.06239375099539757, -0.07225588709115982, -0.004003550391644239, -0.05188034474849701, -0.030299382284283638, -0.0499298982322216, 0.06161893159151077, 0.10130468010902405, 0.04240912199020386, -0.038859348744153976, -0.030305715277791023, -0.007932210341095924, -0.037839509546756744, 0.04469532519578934, 0.04997294396162033, 0.07420387119054794, 0.016222326084971428, 0.06496801227331161, 0.010003011673688889, 0.04295272380113602, 0.04713128134608269, -0.021714137867093086, -0.07782814651727676, 0.021868815645575523, 0.021703092381358147, -0.08711438626050949, 0.05898057669401169, -0.030850345268845558, 0.11173772811889648, -0.11069545149803162, 0.09725500643253326, -0.015087592415511608, 0.03382927179336548, 0.08369245380163193, 0.038692258298397064, -0.02835228107869625, 0.054749008268117905, -0.12877538800239563, 0.01253095269203186, -0.00440621143206954, -0.052766330540180206, -0.034662358462810516, -0.0692477747797966, 0.026220420375466347, -0.016247309744358063, 0.05993824824690819, 0.01159728318452835, -0.08488791435956955, -0.0725705623626709, -0.01878749579191208, -0.004530302248895168, -0.062053751200437546, 0.03101934678852558, -0.077433280646801, -2.6191762684167414e-33, -0.043596118688583374, 0.12894093990325928, -0.028308667242527008, 0.03433043137192726, -0.06725887954235077, -0.024787914007902145, 0.03411141782999039, 0.0743081271648407, 0.004641138948500156, 0.02648143842816353, 0.03754587471485138, -0.08203408122062683, 0.018203437328338623, -0.049416668713092804, -0.0160593893378973, -0.014104066416621208, -0.060827434062957764, 0.022003792226314545, 0.015764733776450157, -0.0019094645977020264, -0.03881852328777313, -0.019277052953839302, -0.03220018371939659, -0.006522035226225853, -0.0848773941397667, 0.011681498028337955, 0.060020893812179565, -0.047015171498060226, -0.01176487933844328, -0.0009858356788754463, -0.017268788069486618, 0.06439189612865448, -0.05354741960763931, -0.023084327578544617, 0.013469389639794827, 0.07224395871162415, 0.09537506103515625, -0.039955027401447296, -0.006745756603777409, -0.03961051255464554, 0.023606372997164726, 0.08800911158323288, 0.028064507991075516, -0.03935573622584343, -0.027461683377623558, 0.060493629425764084, -0.020858336240053177, 0.07888343930244446, -0.009773360565304756, -0.08130618929862976, 0.038602739572525024, 0.06442536413669586, 0.051341764628887177, 0.011661590076982975, -0.038758691400289536, -0.017544159665703773, 0.07085064798593521, 0.04553457722067833, 0.03245336189866066, -0.018152674660086632, -0.07959599047899246, -0.10103527456521988, -0.030048785731196404, -0.07082849740982056, 0.013058168813586235, -0.037337783724069595, 0.022851429879665375, -0.03448275104165077, 0.05250825360417366, -0.003091922728344798, 0.10188112407922745, -0.007474805228412151, 0.0015840084524825215, 0.04703221842646599, -0.01860223151743412, 0.05163389816880226, -0.03446338698267937, 0.015092657878994942, -0.05728747695684433, 0.04019276797771454, 0.09823060035705566, -0.015166593715548515, 0.05916144698858261, 0.025992633774876595, 0.010961162857711315, 0.07946174591779709, -0.004415314644575119, 0.07689051330089569, 0.03274955600500107, 0.02811954915523529, 0.00781582947820425, 0.074181467294693, -0.009278323501348495, 0.0805572047829628, 0.09011548012495041, -3.993469022134377e-08, -0.02620236575603485, -0.03370217978954315, 0.04986572265625, 0.030165595933794975, 0.006467381026595831, -0.013851139694452286, 0.04113689437508583, -0.0644637942314148, -0.02029818668961525, -0.027885979041457176, 0.009788303636014462, -0.010452715680003166, -0.03325333073735237, 0.00519084045663476, -0.008364816196262836, 0.05716131627559662, 0.015027216635644436, 0.05488821864128113, 0.05571308359503746, 0.01409964170306921, -0.016990698873996735, -0.022028682753443718, 0.049188245087862015, 0.01372765563428402, -0.05898500233888626, 0.03862638771533966, -0.02669396810233593, 0.03326701000332832, -0.04351045936346054, -0.05757885426282883, 0.058624472469091415, -0.027680175378918648, 0.04071860760450363, -0.04975512996315956, -0.001929369056597352, 0.012243560515344143, -0.17612381279468536, 0.0069878739304840565, 0.0342143215239048, 0.04531625285744667, -0.07108323276042938, -0.01032850332558155, -0.09729087352752686, -0.004118966404348612, 0.023984253406524658, 0.04520167037844658, -0.010371602140367031, -0.03503021225333214, -0.054767265915870667, 0.014299453236162663, 0.023929543793201447, -0.05813973397016525, -0.005632584914565086, -0.025666505098342896, -0.0064668902195990086, 0.019802112132310867, -0.08867090940475464, -0.01873807981610298, -0.00908090453594923, 0.02140478789806366, 0.015322254970669746, 0.13803087174892426, -0.029936574399471283, -0.03519989550113678 ] }, { "text": "deep_dream_tutorial\n\nDeep Dream from Scratch with PyTorch¶\n\nUnderstanding How Neural Networks \"See\" Through Feature Visualization\n\nDeepDream is a computer vision program created by Google engineer Alexander Mordvintsev that uses a convolutional neural network to find and enhance patterns in images via algorithmic pareidolia, thus creating a dream-like appearance reminiscent of a psychedelic experience in the deliberately overprocessed images. [https://en.wikipedia.org/wiki/DeepDream]\n\nDeep Dream was introduced in 2015 and quickly became famous for its surreal, psychedelic images filled with swirling patterns, eyes, and dog faces. But beyond the trippy visuals, Deep Dream teaches us something fundamental: how neural networks perceive and represent visual information.", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_0", "embedding": [ -0.046426013112068176, -0.05889439582824707, 0.06991811841726303, 0.003930185455828905, -0.005076409317553043, -0.022771915420889854, -0.038402725011110306, -0.03155907243490219, 0.04213452339172363, -0.07454213500022888, -0.08837141841650009, -0.020476333796977997, -0.04152166098356247, -0.0305949617177248, -0.02822786197066307, 0.04957617446780205, -0.006074241828173399, 0.05983109027147293, -0.041021015495061874, -0.04848692938685417, 0.038930948823690414, -0.0287069883197546, 0.004982983693480492, -0.01708393730223179, 0.05803334340453148, 0.09449056535959244, 0.05513967573642731, -0.020012708380818367, 0.03340413048863411, 0.005104115232825279, 0.07420295476913452, 0.04663032665848732, -0.01518194004893303, 0.07281166315078735, -0.029850170016288757, 0.06666376441717148, -0.05034458637237549, 0.01127732452005148, -0.05050808563828468, -0.014125085435807705, 0.029036276042461395, 0.009475222788751125, -0.04373772814869881, 0.03463666886091232, 0.02524193562567234, 0.012791875749826431, -0.019669193774461746, -0.0690336525440216, 0.012255573645234108, -0.046785250306129456, -0.10647861659526825, -0.07601679116487503, -0.007411479484289885, -0.004218239337205887, -0.014683212153613567, 0.05927851423621178, 0.011135048232972622, 0.006960572674870491, -0.021650200709700584, -0.02705543115735054, 0.03448595479130745, 0.02741974964737892, 0.03263140469789505, 0.0011418728390708566, 0.004939042031764984, -0.006160839460790157, -0.03957875445485115, -0.030173903331160545, 0.1160416528582573, -0.13726498186588287, -0.004215019289404154, 0.0460086427628994, -0.0481603741645813, -0.03901198133826256, 0.026543520390987396, 0.01720501482486725, 0.0076044402085244656, -0.0703902617096901, -0.03583529591560364, -0.07338578253984451, 0.07060054689645767, 0.03975757956504822, 0.04461649805307388, 0.006800157018005848, 0.04748569801449776, 0.02928239293396473, -0.04816150665283203, 0.04241262748837471, -0.08639054000377655, 0.010823731310665607, 0.0028773148078471422, -0.12921281158924103, -0.11570034176111221, -0.033596962690353394, 0.016700774431228638, 0.014478689059615135, 0.012519686482846737, -0.1426706165075302, -0.037109192460775375, -0.017159808427095413, 0.008005793206393719, -0.07318075001239777, 0.04158216342329979, -0.017808444797992706, 0.006999350618571043, 0.004702296573668718, 0.12810197472572327, 0.006075859069824219, 0.02608225867152214, -0.051498204469680786, 0.018417807295918465, -0.024079427123069763, 0.011010999791324139, 0.031347889453172684, 0.004177794326096773, -0.0070836469531059265, -0.057807132601737976, 0.08645573258399963, -0.006368246860802174, -0.0004430152475833893, -0.014173547737300396, -0.004914664197713137, -0.0131424805149436, -0.024354612454771996, -0.02217663824558258, -0.017935197800397873, -0.09374292194843292, 6.485596858778055e-33, 0.03880070894956589, -0.018441779538989067, 0.03775274381041527, 0.0274688471108675, 0.1026429533958435, -0.034831687808036804, -0.021325625479221344, -0.03005056455731392, -0.05704173818230629, 0.01687362790107727, -0.014049516059458256, 0.028787093237042427, -0.037032898515462875, 0.22999462485313416, -0.03324973210692406, -0.06523596495389938, -0.09816039353609085, 0.013506915420293808, 0.05051366612315178, 0.005155371036380529, -0.039064619690179825, 0.0697997659444809, -0.01804625242948532, -0.04045497253537178, -0.026563169434666634, 0.05128655955195427, -0.048267509788274765, -0.0049827913753688335, 0.052154336124658585, 0.0020231010857969522, -0.03378765657544136, 0.10872618854045868, -0.05699532851576805, -0.0417054258286953, -0.021025193855166435, 0.05580870434641838, 0.028899088501930237, -0.06258310377597809, -0.01836526021361351, -0.020261654630303383, 0.026201767846941948, 0.04264792427420616, -0.05405821278691292, -0.02723202295601368, -0.07895719259977341, 0.08349420130252838, 0.04027840867638588, 0.08762942254543304, -0.022701868787407875, -0.006190999876707792, -0.031625717878341675, -0.02303595095872879, -0.07878007739782333, -0.07119601219892502, 0.003049277700483799, -0.015293147414922714, 0.05069729685783386, -0.012469514273107052, 0.09215658158063889, 0.01135165337473154, 0.05395365133881569, 0.04183081164956093, 0.036757975816726685, 0.017464183270931244, -0.023679642006754875, -0.02898005023598671, 0.009649747051298618, 0.007315910886973143, -5.253340532362927e-06, 0.047480158507823944, -0.06359191983938217, 0.07368931174278259, -0.026728451251983643, -0.03831719979643822, 0.0006764790741726756, 0.00985173974186182, 0.013215143233537674, -0.001213502255268395, -0.03060123324394226, 0.06802286207675934, -0.002283065812662244, -0.0009094335837289691, 0.01074345875531435, -0.05382951721549034, -0.008694090880453587, 0.1371382772922516, 0.019872009754180908, -0.0720352828502655, -0.06463724374771118, -0.0078034782782197, -0.0187760591506958, -0.05321143567562103, 0.052842944860458374, -0.01851748675107956, -0.07255882769823074, -5.743754496259602e-33, -0.020529741421341896, 0.020701471716165543, -0.05275160074234009, 0.06982763111591339, 0.04527194797992706, -0.062242209911346436, 0.025303039699792862, 0.010102624073624611, -0.003382289782166481, 0.03956815227866173, 0.07837627083063126, 0.009157638996839523, 0.0009640594944357872, -0.03397216275334358, 0.03692469000816345, -0.06855709105730057, 0.029332196339964867, -0.013123733922839165, -0.030871832743287086, -0.03548276424407959, -0.03392943739891052, 0.08989851176738739, -0.06925942003726959, -0.07142198085784912, -0.10951472073793411, 0.02543889917433262, 0.001614427543245256, 0.008197003975510597, -0.05857445299625397, 0.005142570473253727, -0.01846880279481411, -0.012839767150580883, -0.06990324705839157, -0.012262850068509579, 0.007886594161391258, 0.09608910232782364, 0.02181754820048809, -0.09973391145467758, -0.06787519156932831, -0.04821637272834778, 0.056110404431819916, -0.01327862124890089, -0.006767964921891689, 0.024289393797516823, 0.0022356498520821333, -0.013377182185649872, -0.032886069267988205, 0.029089095070958138, 0.028489746153354645, 0.07438456267118454, 0.03324323147535324, 0.054067544639110565, -0.04816039279103279, -0.022224165499210358, 0.0003582836943678558, -0.041919298470020294, 0.0073692407459020615, 0.07323971390724182, 0.07655036449432373, 0.061119917780160904, -0.04452741518616676, -0.04615024849772453, -0.07751555740833282, -0.019291935488581657, -0.02518600970506668, 0.0791432112455368, -0.07384628057479858, 0.08145757764577866, 0.06030827760696411, -0.024120820686221123, 0.06167859584093094, -0.02414575032889843, 0.03865405544638634, 0.1479545384645462, -0.010627630166709423, -0.06363480538129807, -0.006900124251842499, 0.022898389026522636, 0.017288032919168472, 0.03753949701786041, 0.02425854653120041, -0.11754617094993591, -0.005046319682151079, 0.10306260734796524, 0.09364697337150574, 0.03261442109942436, -0.02681092359125614, 0.027662500739097595, 0.013412600383162498, 0.018367916345596313, -0.03359739109873772, 0.03630206733942032, -0.07042092084884644, 0.1003110334277153, 0.05138352885842323, -4.368099126850211e-08, -0.058564670383930206, -0.07154209166765213, 0.0630040243268013, -0.0146669652312994, 0.021397719159722328, -0.08103255182504654, 0.08365838974714279, 0.07246559858322144, -0.09718279540538788, -0.03799416497349739, 0.020237289369106293, -0.037465911358594894, -0.04967683553695679, 0.03065236285328865, 0.06764175742864609, 0.10020454227924347, 0.011737906374037266, 0.058691784739494324, 0.03236153721809387, -0.005673565901815891, 0.03141746297478676, 0.010714907199144363, 0.016039134934544563, -0.04382936656475067, 0.021797381341457367, 0.008702094666659832, -0.06044119969010353, 0.06833764165639877, -0.06928156316280365, 0.005540571641176939, 0.062107305973768234, 0.022844241932034492, 0.05041708052158356, -0.0537535585463047, 0.0607929565012455, 0.04041529819369316, -0.05926688015460968, -0.017872091382741928, 0.01613365113735199, -0.04544911906123161, -0.04805390536785126, 0.016017887741327286, 0.07697771489620209, 0.0014792500296607614, -0.02853020653128624, -0.010164807550609112, 0.04529601335525513, -0.1132545918226242, 0.028177974745631218, 0.10054825246334076, 0.0205564983189106, 0.029785437509417534, 0.08695919811725616, 0.07558640092611313, 0.028350045904517174, -0.05970514193177223, -0.027405817061662674, 0.007045860402286053, -0.02408318780362606, 0.03590814396739006, 0.02418305166065693, 0.08539462834596634, -4.511865336098708e-05, -0.015452095307409763 ] }, { "text": "In this tutorial, we'll build Deep Dream from scratch using PyTorch. By the end, you'll understand:\n\n• How convolutional neural networks detect features at different layers\n•\n\n• How to use gradients to modify an image (instead of modifying model weights)\n•\n\n• Why Deep Dream images look the way they do\n•\n\n• How this connects to modern AI interpretability research\n•\n\nThe Core Idea:¶\n\nNormal use of a trained network:\n\nImage goes in → network detects features layer by layer (edges → shapes → textures → objects) → outputs a label like \"dog\"\nThe image is just read, never changed.\n\nDeep Dream flips the goal:\n\nInstead of asking \"what's in this image?\", you ask: \"Change this image so the patterns you're detecting become stronger.\"\n\nHere's the actual process:", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_1", "embedding": [ -0.043657444417476654, -0.00119382597040385, 0.0393274761736393, 0.025254936888813972, 0.0598873607814312, 0.0011400501243770123, -0.019765349105000496, -0.07004162669181824, 0.026038963347673416, -0.11300837993621826, -0.06902573257684708, -0.0164338406175375, -0.02231479063630104, 0.004629724659025669, -0.04629695788025856, 0.019882816821336746, 0.01043516956269741, 0.09501852840185165, -0.09189756214618683, -0.0573020838201046, 0.04341328144073486, -0.06980737298727036, 0.00839209370315075, -0.0436578243970871, 0.009539291262626648, 0.09190740436315536, -0.016217436641454697, -0.03277482092380524, 0.021481145173311234, -0.021539311856031418, 0.044317469000816345, 0.01833740435540676, 0.0362795814871788, 0.10644315928220749, -0.028429126366972923, 0.05209952965378761, -0.054142728447914124, 0.0064189075492322445, 0.01621563918888569, -0.05856000632047653, 0.05236499756574631, -0.06913299858570099, -0.029338950291275978, -0.012580009177327156, 0.029259096831083298, 0.05247683450579643, 0.01911216787993908, -0.06660444289445877, -0.0031573560554534197, -0.027911270037293434, -0.0705062747001648, -0.05609965696930885, -0.03923496976494789, 0.008645731955766678, 0.017978420481085777, 0.03615979105234146, 0.08826802670955658, 0.05063807964324951, 0.03589208424091339, -0.008735383860766888, 0.05979616940021515, 0.03331710770726204, 0.051118411123752594, 0.030684955418109894, 0.054392680525779724, -0.028434811159968376, -0.05092136189341545, 0.011651547625660896, 0.12345962971448898, -0.12137680500745773, 0.04913560301065445, 0.08458741754293442, 0.006260107737034559, -0.046499691903591156, 0.048637717962265015, 0.0015940297162160277, -0.015294432640075684, 0.0018810118781402707, 0.028811076655983925, -0.04964984953403473, 0.014517364092171192, -0.03253832459449768, 0.05303315445780754, 0.011362159624695778, 0.09975404292345047, 0.04083013907074928, -0.037453923374414444, -0.02699245512485504, -0.05268147215247154, -0.005767949856817722, 0.03036356158554554, -0.13562165200710297, -0.11128672957420349, 0.03450104221701622, 0.07438533753156662, 0.05269201472401619, -0.041236232966184616, -0.1557498723268509, -0.03135475516319275, -0.006505110301077366, -0.014649693854153156, -0.08039595931768417, 0.036270610988140106, -0.03149287775158882, 0.024854904040694237, -0.009814437478780746, 0.049096085131168365, -0.00995535496622324, 0.03522365167737007, -0.01598471775650978, 0.00441703898832202, -0.030435388907790184, 0.0191105417907238, -0.0058610644191503525, -0.0035465762484818697, -0.05084259808063507, -0.01979251578450203, 0.0909203588962555, -0.0271474439650774, 0.02548789046704769, -0.03425632044672966, 0.02008446678519249, -0.027137180790305138, -0.023866886273026466, -0.012419931590557098, 0.0270282831043005, -0.10732975602149963, 3.4410613473605454e-33, 0.05360936000943184, -0.019787665456533432, 0.014696690253913403, 0.0016379625303670764, 0.07049889117479324, -0.06962179392576218, 0.005235401913523674, -0.02522869221866131, 0.007060267496854067, 0.02378089912235737, -0.0019562141969799995, 0.021717295050621033, -0.06948446482419968, 0.16956432163715363, 0.013052446767687798, -0.021401097998023033, -0.09094590693712234, -0.04787788540124893, 0.07394873350858688, 0.03205049782991409, -0.05238070711493492, 0.02899012714624405, -0.03689064830541611, -0.043789058923721313, -0.04867411032319069, 0.03833039477467537, -0.032072532922029495, 0.008025350980460644, 0.02440331131219864, -0.014258024282753468, -0.016034383326768875, 0.01965203881263733, -0.04192320629954338, 0.002186171943321824, -0.03107202798128128, 0.027070680633187294, 0.0187044907361269, 0.012332220561802387, -0.04549078270792961, -0.0176639836281538, 0.042457450181245804, 0.007168041542172432, -0.05452213063836098, -0.004066546447575092, -0.001790377078577876, 0.08275122940540314, -0.006993662565946579, 0.050546884536743164, -0.0765007808804512, -0.02838888019323349, 0.03562537208199501, -0.005677713081240654, -0.04831406846642494, -0.07435568422079086, 0.01676790416240692, 0.003834438743069768, 0.048779360949993134, -0.012748967856168747, 0.07213275134563446, 0.00628720922395587, 0.10172410309314728, 0.008751126006245613, 0.0764332115650177, 0.10836658626794815, 5.69537551200483e-05, 0.0229510385543108, -0.006052832119166851, 0.02579445205628872, -0.041985757648944855, 0.019087819382548332, -0.0664481669664383, 0.06937062740325928, -0.03553982079029083, -0.06682213395833969, -0.010034257546067238, 0.015747228637337685, -0.038241758942604065, -0.011383354663848877, -0.05783660709857941, 0.020293470472097397, 0.002093542367219925, 0.0661727637052536, -0.004072276409715414, -0.00437045656144619, -0.059761352837085724, 0.12570270895957947, -0.013742529787123203, -0.14094507694244385, -0.01223643496632576, 0.03263147547841072, -0.0033417216036468744, -0.06115500628948212, 0.015959780663251877, 0.0004892104770988226, -0.026470206677913666, -4.195600885577802e-33, 0.015662340447306633, 0.05115874111652374, -0.0332091823220253, 0.0640874132514, -0.018060559406876564, -0.06617593765258789, -0.0013761160662397742, 0.01295274868607521, 0.01618003658950329, 0.051597710698843, 0.026767756789922714, -0.019659115001559258, -0.0455155186355114, -0.05648167431354523, -0.02539636753499508, -0.1080414205789566, -0.03420276567339897, 0.00840294361114502, -0.002689146203920245, 0.012239827774465084, -0.04106268286705017, 0.11965780705213547, -0.09094124287366867, 0.0020109086763113737, -0.1025380939245224, 0.017655372619628906, 0.011413970962166786, 0.003403107635676861, 0.00465982174500823, -0.03526021167635918, -0.04313090816140175, -0.047314561903476715, 0.0021365671418607235, 0.03541793301701546, -0.0010782087920233607, 0.07980953902006149, 0.03622784465551376, -0.10320910066366196, -0.04495356231927872, 0.0007795794517733157, 0.07623740285634995, 0.015002825297415257, -0.10418329387903214, -0.015455859713256359, -0.016042571514844894, -0.013434521853923798, -0.034042827785015106, 0.020009584724903107, 0.04537027329206467, 0.05494467541575432, 0.07335323840379715, 0.0009658963535912335, -0.06120886281132698, -0.018819337710738182, -0.010261155664920807, 0.01862935721874237, -0.014235387556254864, 0.07805564999580383, 0.07971179485321045, 0.07695689052343369, -0.09687291085720062, -0.043339475989341736, -0.09430882334709167, 0.0376143604516983, -0.06649830937385559, 0.028371233493089676, -0.09875369817018509, 0.039133235812187195, 0.03639008477330208, 0.0034039365127682686, 0.03220687806606293, 0.0010490623535588384, 0.06693634390830994, 0.127020001411438, 0.019965432584285736, -0.0533687099814415, -0.0360533632338047, -0.040673431009054184, -0.0036635608412325382, -0.00822480022907257, -0.03638516366481781, -0.11376034468412399, -0.020899610593914986, 0.11705911159515381, 0.07237089425325394, 0.07988332211971283, -0.04702522233128548, 0.006218057591468096, 0.0625368058681488, -0.012778022326529026, -0.03105061501264572, 0.03710932657122612, -0.02439839020371437, 0.06683354824781418, -0.003893487388268113, -5.102512190546804e-08, -0.054955191910266876, -0.026141488924622536, 0.05293096974492073, 0.010537593625485897, 0.015060357749462128, -0.025495829060673714, 0.05697264522314072, 0.059812769293785095, -0.03416441008448601, -0.03037717565894127, 0.006265354808419943, -0.019142795354127884, -0.09576353430747986, -0.02467777580022812, 0.010959490202367306, 0.11057689040899277, 0.04058156907558441, 0.008952409960329533, 0.04491608217358589, -0.04835137352347374, 0.02607163041830063, 3.87136594781623e-07, 0.00035412516444921494, 0.013062428683042526, 0.029294453561306, -0.047711703926324844, -0.026963192969560623, 0.039340790361166, -0.11835851520299911, 0.02074180170893669, 0.05187928304076195, -0.017336424440145493, 0.06690504401922226, 0.017286792397499084, 0.05750846117734909, 0.08546628803014755, -0.10316548496484756, -0.06561441719532013, 0.03170592337846756, 0.010671384632587433, -0.006097692996263504, 0.01351053174585104, 0.019321570172905922, -0.06310995668172836, -0.04909701272845268, 0.002995655406266451, 0.04510798305273056, -0.1265130639076233, -0.03893713653087616, 0.09512942284345627, 0.0301547572016716, 0.023746954277157784, 0.009928332641720772, 0.0694776326417923, 0.052150432020425797, -0.07256843149662018, 0.0042794314213097095, 0.0011188783682882786, -0.003928652964532375, 0.10132443159818649, 0.028110608458518982, 0.05504244565963745, 0.0016669320175424218, -0.05128788948059082 ] }, { "text": "Here's the actual process:\n\n• You feed your image into the pre-trained network\n•\n\n• You pick a layer in the network (each layer detects different things—early layers see edges, deeper layers see complex objects like faces or animals)\n•\n\n• The network looks at that layer's activations (how strongly it's detecting patterns)\n•\n\n• Now the key part: you calculate how to tweak each pixel in your original image to make those activations stronger\n•\n\n• You slightly modify the image pixels accordingly\n•\n\n• Repeat steps 1–5 many times\n•\n\nEach iteration, the image gets nudged to contain \"more\" of whatever that layer is detecting. After many loops, faint patterns snowball into vivid, exaggerated features.\n\nWe don't train a model.\n\nWe take a pre-trained model and freeze it.", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_2", "embedding": [ -0.03422386944293976, -0.03843144699931145, 0.08165698498487473, 0.02164653316140175, 0.048115648329257965, -0.05004182830452919, -0.0017918661469593644, -0.0256254430860281, 0.02443992905318737, -0.10496582090854645, -0.018907729536294937, -0.014578323811292648, 0.049848008900880814, -0.03429684042930603, -0.07366334646940231, -0.04408975690603256, -0.01690518483519554, 0.03986770287156105, -0.0882331132888794, -0.08353425562381744, 0.039131078869104385, -0.10208548605442047, -0.05196451395750046, -0.06842997670173645, 0.0033064777962863445, 0.09010371565818787, 0.020077437162399292, -0.010242486372590065, 0.07178248465061188, -0.06611137092113495, 0.04603942483663559, 0.027728863060474396, 0.036627717316150665, 0.07882239669561386, -0.05500064790248871, 0.06916499137878418, -0.01998933032155037, 0.032836392521858215, 0.022832108661532402, -0.0009523989865556359, 0.03676235303282738, -0.020638614892959595, 0.00786488689482212, -0.00816189032047987, 0.07283242791891098, 0.03928840160369873, -0.009451033547520638, -0.029609564691781998, -0.03229163959622383, -0.06741588562726974, -0.057919494807720184, -0.08424856513738632, -0.036015547811985016, 0.01161655131727457, 0.02488207444548607, 0.04658421501517296, 0.06900931149721146, 0.01652725227177143, 0.022487850859761238, -0.02332821488380432, 0.03560977429151535, -0.007669363636523485, -0.06285063922405243, 0.03446950390934944, 0.09319052845239639, -0.02546614035964012, 0.017286168411374092, -0.05605078861117363, 0.16376502811908722, -0.0738961473107338, 0.0488010048866272, 0.11560092121362686, -0.0004116116324439645, -0.009424167685210705, -0.014391284435987473, 0.038446731865406036, -0.022659845650196075, 0.024851424619555473, 0.04372725263237953, -0.09684740006923676, 0.02575070783495903, -0.015862204134464264, 0.027834346517920494, -0.0427590049803257, 0.1152203381061554, 0.03623008728027344, -0.0035888405982404947, -0.002349737798795104, -0.05842107906937599, 0.03269787132740021, -0.0012576172593981028, -0.03965000808238983, -0.17429585754871368, -0.020005205646157265, 0.011611944064497948, 0.09296652674674988, 0.044858142733573914, -0.08756321668624878, -0.03221359848976135, 0.03874251991510391, 0.01512171421200037, -0.09246844798326492, 0.04833473265171051, 0.04760058969259262, 0.08708816021680832, -0.03222161903977394, 0.04638321325182915, 0.03932827711105347, 0.07765049487352371, -0.011255115270614624, -0.00846139620989561, 0.03451228141784668, -0.039189066737890244, 0.009625457227230072, 0.01658625528216362, 0.015335115604102612, -0.04435817152261734, 0.052435096353292465, -0.028880327939987183, 0.020385319367051125, -0.012586603872478008, 0.014842668548226357, -0.08122896403074265, -0.0962885245680809, 0.006970326416194439, -0.008830630220472813, -0.1317708045244217, 2.507261859378767e-33, 0.05121954157948494, 0.024369793012738228, 0.016312450170516968, -0.02324075996875763, 0.019204385578632355, -0.04818582162261009, -0.012510777451097965, -0.05856648460030556, 0.04309011250734329, 0.10010521858930588, -0.031642165035009384, -0.000506042328197509, -0.05497344955801964, 0.1885867714881897, -0.0038833599537611008, -0.06267117708921432, -0.0668015107512474, -0.06507648527622223, 0.027932213619351387, 0.0570625402033329, -0.005314911250025034, -0.014417046681046486, 0.012661561369895935, -0.05181555077433586, -0.078785739839077, 0.0712401494383812, 0.0005577593110501766, 0.02076784521341324, -0.005376743618398905, 0.03267572075128555, 0.026594197377562523, 0.08724664151668549, -0.027543701231479645, 0.019563158974051476, -0.011264159344136715, 0.01087926421314478, 0.06780238449573517, 0.006496869493275881, 0.0768245980143547, -0.007227757479995489, 0.022723045200109482, -0.021335015073418617, -0.04228862747550011, -0.014062365517020226, 0.02196776680648327, 0.027813630178570747, 0.021786917001008987, -0.04566068574786186, -0.07677492499351501, 0.0691821351647377, 0.06631579250097275, -0.06249712035059929, -0.006843684706836939, -0.031193654984235764, -0.038670457899570465, 0.06714946031570435, 0.045323196798563004, -0.055924322456121445, 0.020515775308012962, 0.09909282624721527, 0.10678721219301224, -0.004577407147735357, -0.021566182374954224, 0.14839573204517365, -0.014170125126838684, -0.06629731506109238, 0.01179428305476904, 0.02870309352874756, -0.03969469666481018, 0.051131248474121094, -0.05004555732011795, 0.06538129597902298, -0.05943353846669197, -0.1119275689125061, 0.049715835601091385, -0.018348917365074158, -0.003487206529825926, 0.01961209625005722, -0.05477277934551239, 0.004497315268963575, -0.018587971106171608, 0.08175742626190186, 0.017824850976467133, -0.08364788442850113, -0.06931550055742264, 0.10024285316467285, -0.019661346450448036, -0.03260692581534386, -0.04098358750343323, -0.013381329365074635, 0.06160977482795715, -0.020416250452399254, 0.05045555159449577, -0.029500210657715797, -0.014410500414669514, -3.76004496376762e-33, 0.041842713952064514, 0.08232730627059937, -0.011981738731265068, 0.02024208940565586, -0.052935995161533356, -0.031594742089509964, 0.010595375671982765, 0.08623732626438141, -0.04549504071474075, -0.03272845968604088, -0.012012130580842495, 0.027778061106801033, -0.033476054668426514, -0.07574381679296494, -0.08290793746709824, -0.10909561067819595, 0.017447981983423233, -0.03360520303249359, 0.0342019721865654, -0.03290898725390434, -0.020250998437404633, 0.026414137333631516, -0.07792715728282928, -0.04556494206190109, -0.049887582659721375, 0.0370202399790287, -0.007327403873205185, 0.04800565540790558, 0.03707010671496391, -0.0050803739577531815, -0.04482471942901611, 0.0045775678008794785, 0.027548545971512794, -0.0020635975524783134, -0.00797214638441801, 0.07573965936899185, 0.02829880267381668, -0.02709558978676796, 0.03929603472352028, -0.05566567927598953, 0.0031482838094234467, -0.005182418040931225, -0.07586900144815445, 0.013602176681160927, 0.006993363611400127, -0.03548185154795647, -0.01919439062476158, 0.0029545528814196587, -0.0012288099387660623, 0.04835709556937218, 0.034088004380464554, 0.021525172516703606, -0.07577349245548248, -0.005086677148938179, -0.06584659218788147, 0.028951415792107582, -0.03431113809347153, 0.014080865308642387, 0.0551067590713501, 0.04544070363044739, -0.09082765132188797, -0.0509771890938282, -0.0851253792643547, -0.024248400703072548, -0.025919638574123383, 0.0038147815503180027, -0.07813121378421783, -0.03231799975037575, 0.07439583539962769, 0.05255821347236633, -0.019258053973317146, 0.04210967943072319, -0.05982309952378273, 0.012185627594590187, 0.01572514697909355, -0.09379956126213074, -0.08169680088758469, 0.001441198866814375, -0.00015923712635412812, -0.044667985290288925, -0.016015037894248962, -0.07865060120820999, -0.02990429289638996, 0.05342104658484459, 0.03195447474718094, 0.12421425431966782, -0.0463295504450798, -0.018442822620272636, 0.046218518167734146, 0.00103201053570956, -0.011377977207303047, 0.017308278009295464, -0.0005721045308746397, 0.03564254567027092, -0.019521959125995636, -5.586122853173947e-08, -0.0572618804872036, -0.07014399766921997, 0.05129057168960571, -0.045100610703229904, 0.06508666276931763, -0.034476861357688904, 0.04294656589627266, 0.10408700257539749, -0.007754443679004908, -0.0901736468076706, -0.01913701742887497, 0.012305773794651031, -0.07582756876945496, -0.008450465276837349, 0.05333868786692619, 0.051018018275499344, 0.027763329446315765, 0.0818849429488182, -0.006021048408001661, -0.011438513174653053, -0.019127216190099716, -0.04247233644127846, -0.010804994031786919, 0.008411649614572525, 0.0481632761657238, -0.04191996902227402, -0.0053874533623456955, 0.069972924888134, -0.054981112480163574, -0.00510416878387332, 0.01491615641862154, -0.03096773661673069, 0.02955523505806923, 0.0023876058403402567, 0.030607379972934723, 0.09562750160694122, -0.03279018774628639, -0.06459606438875198, 0.03262879699468613, -0.053748104721307755, -0.044987283647060394, 0.013617799617350101, 0.04732096567749977, -0.06029597297310829, -0.026212221011519432, 0.002384212799370289, 0.04271378740668297, -0.0960330069065094, 0.002040961291640997, 0.0176119115203619, 0.014451227150857449, 0.0383109487593174, -0.07589221000671387, 0.04357123747467995, -0.0023815480526536703, -0.030954666435718536, 0.04822998866438866, -0.034173231571912766, 0.028079330921173096, 0.07286660373210907, -0.021719293668866158, 0.009277979843318462, 0.0011810577707365155, -0.040018245577812195 ] }, { "text": "We don't train a model.\n\nWe take a pre-trained model and freeze it.\n\nWe forward pass an image through the model and capture the activations at a chosen layer.\n\nThen we compute gradients of those activations with respect to the input image pixels.\n\nFinally, we add these gradients back to the image—this amplifies whatever patterns the layer detected. Repeat this process, and the patterns snowball into the trippy Deep Dream effect.\n\n1. Setup and Imports¶\n\nWe'll use a pre-trained InceptionV3 model. This is the same architecture Google used in the original Deep Dream.\n\nIn [1]:\n\n# Install dependencies if needed\n!pip install torch torchvision pillow matplotlib numpy", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_3", "embedding": [ -0.037375833839178085, -0.08883781731128693, 0.08842895179986954, 0.01789713278412819, -0.006560548674315214, 0.009034973569214344, -0.07716161012649536, -0.052444856613874435, -0.050669584423303604, -0.11382491141557693, -0.07704232633113861, -0.040928829461336136, -0.031088287010788918, -0.010273678228259087, 0.029048748314380646, -0.0013901994097977877, 0.0023142045829445124, 0.04300267621874809, -0.022086868062615395, -0.028161557391285896, 0.049720268696546555, -0.032308001071214676, -0.0007860581972636282, 0.01357028167694807, -0.022386666387319565, 0.07065723836421967, 0.06301459670066833, 0.013983692042529583, 0.05464254319667816, -0.02733524516224861, 0.028960108757019043, 0.03961576893925667, -0.037467289716005325, 0.040053825825452805, 0.010812437161803246, 0.05062860623002052, -0.03179362788796425, -0.006395857781171799, -0.023320401087403297, 0.034736864268779755, 0.0337480828166008, -0.005530909635126591, -0.014054965227842331, 0.006992552895098925, 0.0414024293422699, 0.0070507219061255455, 0.030240559950470924, -0.01751658506691456, -0.008057779632508755, -0.010631243698298931, 0.014188161119818687, -0.06621666997671127, 0.014047514647245407, 0.06234157457947731, 0.020359262824058533, 0.019480537623167038, 0.07263927161693573, -0.007576335687190294, -0.006704042665660381, -0.09607840329408646, -0.031066184863448143, 0.012137130834162235, -0.002541603520512581, -0.0551573820412159, 0.009436308406293392, -0.006760543677955866, -0.07730910927057266, -0.023178283125162125, 0.15374597907066345, -0.057311050593853, -0.03332893177866936, 0.06521540135145187, 0.0001995702477870509, -0.005183567758649588, 0.018584946170449257, -0.02470674179494381, 0.06199847161769867, 0.01578783430159092, -6.686722826998448e-06, -0.09549389034509659, 0.03922196105122566, -0.05779275298118591, 0.07787482440471649, 0.007207812275737524, 0.03405042365193367, -0.03596290946006775, -0.029203353449702263, 0.047467563301324844, 0.021647008135914803, 0.016231674700975418, 0.013607410714030266, -0.08433838933706284, -0.12157055735588074, -0.02909192256629467, 0.006498685572296381, 0.06645110249519348, 0.0024593232665210962, -0.15051937103271484, -0.06372681260108948, 0.007744644768536091, 0.015592142939567566, -0.12387963384389877, 0.00011847180576296523, 0.04177263379096985, 0.038488272577524185, 0.07297060638666153, 0.06732067465782166, 0.0010244379518553615, 0.007311670575290918, -0.025219643488526344, 0.006083616521209478, -0.006554071791470051, 0.031642548739910126, -0.018360109999775887, 0.016745733097195625, -0.028431395068764687, -0.07388873398303986, 0.05159284546971321, -0.05691157281398773, 0.0474444217979908, -0.04161858558654785, 0.07116653770208359, 0.035062264651060104, -0.018651630729436874, -0.049900442361831665, -0.020314987748861313, -0.10327664762735367, 1.4132299099169371e-33, 0.058005183935165405, 0.024652717635035515, -0.015290087088942528, 0.02034952864050865, 0.07563205808401108, -0.016847021877765656, 0.03486286476254463, -0.008884073235094547, -0.051460523158311844, 0.003098155604675412, -0.0345846526324749, 0.020905209705233574, -0.044863633811473846, 0.16369828581809998, -0.02747827023267746, -0.03147229552268982, -0.06325633823871613, -0.05997760593891144, 0.02528083138167858, 0.08372175693511963, -0.012731356546282768, 0.03292924910783768, -0.030931256711483, -0.03133009001612663, -0.06856480985879898, 0.06237541511654854, -0.007332422770559788, 0.01887064054608345, 0.03548397123813629, 0.019838372245430946, 0.013105799444019794, -0.020952923223376274, -0.00941485445946455, -0.029415762051939964, 0.022012200206518173, 0.07195758819580078, 0.036570243537425995, -0.022399170324206352, 0.017895251512527466, -0.07036488503217697, 0.05371028184890747, 0.039554692804813385, -0.047030430287122726, -0.046320490539073944, -0.09157498180866241, 0.053856562823057175, 0.04592561721801758, 0.05643589422106743, 0.005904258228838444, 0.008266404271125793, 0.01657690666615963, -0.04546775296330452, -0.0790114551782608, -0.10720695555210114, -0.02915928140282631, 0.03588467836380005, 0.041162725538015366, 0.009050911292433739, 0.15964289009571075, -0.0034550190903246403, 0.07281734049320221, 0.007070869207382202, 0.030714349821209908, 0.05873483791947365, -0.01039877999573946, -0.024479808285832405, 0.00880309659987688, 0.05251016467809677, -0.06795237213373184, -0.021884461864829063, -0.07530629634857178, 0.041208744049072266, -0.004489257466048002, -0.03858412057161331, 0.012000571005046368, 0.0059193396009504795, -0.01598082296550274, -0.02439233474433422, -0.048903465270996094, 0.05726972967386246, -0.018467716872692108, 0.06042226031422615, 0.0010803769109770656, -0.07663078606128693, -0.002224011579528451, 0.13350766897201538, -0.011593165807425976, -0.05430646240711212, -0.04408195614814758, -0.02449801005423069, -0.016512032598257065, -0.055362045764923096, 0.054771408438682556, 0.00031028661760501564, -0.022960135713219643, -2.2043364141588865e-33, 0.03374167159199715, 0.06452378630638123, -0.015893306583166122, 0.035132646560668945, 0.05169457197189331, -0.037576355040073395, 0.032986290752887726, 0.006054870784282684, -0.03019692935049534, 0.07833121716976166, 0.034878168255090714, -0.013388898223638535, -0.031603626906871796, -0.05480799823999405, 0.0664442777633667, -0.08277325332164764, 0.018059197813272476, -0.009637153707444668, 0.027540042996406555, 0.002497294684872031, 0.004859068430960178, 0.050298061221838, -0.1678829789161682, -0.04742221161723137, -0.16723857820034027, 0.02730051428079605, -0.01264575868844986, 0.09330347925424576, 0.0006885171169415116, 0.03968021273612976, -0.04860794544219971, -0.0022799293510615826, -0.03554679453372955, -0.057511258870363235, -0.012044231407344341, 0.11176589131355286, 0.004927204921841621, -0.05244501680135727, -0.06119009852409363, -0.06119111180305481, 0.03626818582415581, -0.0085050193592906, -0.041156742721796036, 0.022816715762019157, 0.0007187403389252722, -0.030906440690159798, -0.04570753499865532, 0.06627502292394638, 0.08046514540910721, 0.05899830907583237, 0.014073736034333706, 0.0056869518011808395, -0.11193109303712845, 0.02574600651860237, -0.06647980213165283, -0.022193560376763344, -0.0016157327918335795, 0.055218007415533066, 0.01653921976685524, 0.06363493949174881, -0.10902044177055359, -0.022478898987174034, -0.06005018949508667, -0.08772531896829605, -0.024954309687018394, 0.0443870946764946, -0.13208742439746857, 0.017289239913225174, 0.07824701815843582, 0.03219211474061012, 0.03033064864575863, 0.049833983182907104, 0.08225202560424805, 0.07902255654335022, 0.0065668909810483456, -0.08459773659706116, -0.021484261378645897, 0.010514960624277592, 0.056050315499305725, -0.016083473339676857, -0.005316966213285923, -0.04815131798386574, -0.011568835936486721, 0.1258579045534134, 0.07821457833051682, 0.042519669979810715, -0.009206886403262615, 0.012805330567061901, -0.010942445136606693, -0.010617720894515514, -0.0025079206097871065, -0.017323380336165428, 0.019920550286769867, 0.046846915036439896, 0.03515336290001869, -4.821500354523778e-08, -0.06301932781934738, 0.011895935982465744, 0.10267341136932373, 0.035479046404361725, -0.00886409543454647, -0.043890126049518585, 0.07916172593832016, 0.062284912914037704, -0.025343727320432663, -0.03937425836920738, 0.02101138047873974, -0.0033925140742212534, -0.02257557027041912, 0.0429249107837677, -0.004451537970453501, 0.1270812302827835, 0.04245652258396149, 0.09737621992826462, -0.023253552615642548, -0.05301876366138458, 0.010148235596716404, -0.00117901258636266, 0.025670578703284264, 0.0006244782125577331, 0.07358831912279129, -0.02557871863245964, -0.005557307042181492, 0.0045266663655638695, -0.033006150275468826, -0.030709415674209595, -0.013406753540039062, -0.04281165450811386, 0.047720618546009064, -0.05098140239715576, -0.0037491286639124155, 0.04597454518079758, -0.08874236047267914, -0.0012612136779353023, 0.059078775346279144, -0.06425425410270691, 0.003268274711444974, 0.024100951850414276, 0.07379910349845886, -0.06744878739118576, -0.013241410255432129, 0.004950234200805426, -0.029713986441493034, -0.114702969789505, 0.011643825098872185, 0.11337534338235855, -0.013113056309521198, 0.008178358897566795, 0.00024148063675966114, 0.09351857751607895, 0.06213722005486488, -0.04064437374472618, -0.04151131212711334, -0.03729218244552612, -0.014895174652338028, 0.027450520545244217, 0.0006022893358021975, 0.014776479452848434, 0.01035599410533905, -0.0646706074476242 ] }, { "text": "Requirement already satisfied: torch in /usr/local/lib/python3.12/dist-packages (2.9.0+cu126)\nRequirement already satisfied: torchvision in /usr/local/lib/python3.12/dist-packages (0.24.0+cu126)\nRequirement already satisfied: pillow in /usr/local/lib/python3.12/dist-packages (11.3.0)\nRequirement already satisfied: matplotlib in /usr/local/lib/python3.12/dist-packages (3.10.0)\nRequirement already satisfied: numpy in /usr/local/lib/python3.12/dist-packages (2.0.2)\nRequirement already satisfied: filelock in /usr/local/lib/python3.12/dist-packages (from torch) (3.20.0)\nRequirement already satisfied: typing-extensions>=4.10.0 in /usr/local/lib/python3.12/dist-packages (from torch) (4.15.0)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_4", "embedding": [ -0.06298913061618805, -0.09579755365848541, 0.022952204570174217, -0.07806289196014404, 0.10732250660657883, -0.04700813814997673, -0.006179018411785364, 0.023587286472320557, -0.06630196422338486, -0.018711188808083534, 0.06034668907523155, 0.010683567263185978, -0.09886899590492249, 0.05828895792365074, 0.09377101063728333, 0.026637842878699303, -0.0017961666453629732, -0.00971168652176857, -0.023074418306350708, -0.027344178408384323, 0.032576024532318115, -0.06521809101104736, 0.058600690215826035, -0.025671808049082756, 0.0024074867833405733, -0.010232449509203434, -0.04158112406730652, -0.0016315606189891696, 0.019381975755095482, -0.009419119916856289, 0.033998407423496246, 0.08889859914779663, -0.06096090376377106, -0.04442464932799339, 0.10898897796869278, 0.07583102583885193, -0.03740384802222252, -0.015917830169200897, -0.06084523722529411, 0.03308800980448723, -0.020160313695669174, 0.04536774381995201, -0.01008585561066866, 0.00835113413631916, -0.0594918392598629, -0.017003143206238747, 0.04623284935951233, -0.014329091645777225, -0.006952350959181786, -0.036134373396635056, -0.038884446024894714, -0.0021082814782857895, -0.06813693791627884, 0.02140444703400135, 0.09039776027202606, -0.028213977813720703, -0.020006628707051277, -0.02855059690773487, -0.03429613262414932, -0.040812622755765915, -0.04769349843263626, 0.052353959530591965, -0.00018438053666613996, -0.013483182527124882, -0.06845612823963165, 0.03529209643602371, -0.004696278367191553, 0.010469261556863785, 0.07057894021272659, 0.010448712855577469, -0.10219687968492508, -0.010279365815222263, -0.03183360397815704, 0.049446284770965576, -0.08939458429813385, -0.019823888316750526, 0.12164212763309479, -0.006880095228552818, -0.01538353506475687, -0.10819004476070404, -0.011862405575811863, 0.02915116958320141, 0.03170746564865112, 0.04342449828982353, 0.02888399548828602, -0.04818537086248398, -0.0007867318345233798, 0.06515561789274216, 0.021411817520856857, -0.06542717665433884, 0.023263586685061455, -0.05955415591597557, 0.000637698860373348, 0.06928764283657074, -0.010890042409300804, 0.002213028958067298, 0.03584352880716324, 0.06526561081409454, -0.09824252128601074, 0.054323043674230576, -0.013601116836071014, -0.08038941025733948, 0.03186218440532684, 0.040524326264858246, 0.018048858270049095, 0.08959376811981201, -0.03150240704417229, -0.013123724609613419, -0.01677025854587555, 0.028896717354655266, 0.012860231101512909, -0.06147940456867218, -0.04541507735848427, -0.037463653832674026, 0.03885363042354584, 0.004479912109673023, -0.021746283397078514, 0.02792234532535076, 0.06709770113229752, 0.06364472210407257, -0.006122357677668333, 0.042549993842840195, 0.1233767420053482, -0.00774286687374115, -0.015677139163017273, -0.05904797464609146, -0.04078245535492897, 3.0949054443502445e-33, -0.04998559132218361, 0.04494238272309303, -0.1031743735074997, 0.0407588817179203, 0.0600067600607872, -0.010806942358613014, 0.019578538835048676, -0.001853783498518169, -0.07105904817581177, -0.01981356553733349, -0.008858093991875648, 0.015452091582119465, -0.039125602692365646, 0.0501878522336483, 0.019375164061784744, -0.07770677655935287, 0.09891057759523392, 0.08660023659467697, -0.026293903589248657, -0.022561203688383102, -0.006621026434004307, 0.05102478712797165, -0.03678767383098602, 0.04991866275668144, -0.020257551223039627, -0.03970533236861229, 0.04595090448856354, -0.010568937286734581, 0.05028524994850159, -0.03603675216436386, 0.01674972102046013, -0.013508995063602924, 0.0704701691865921, 0.038987964391708374, -0.025602107867598534, 0.020630167797207832, -0.05362492799758911, -0.09088853001594543, -0.0018443359294906259, -0.059139858931303024, 0.004143572878092527, 0.12049941718578339, -0.00889878161251545, -0.04317905753850937, 0.06734591722488403, 0.008256189525127411, -0.028445105999708176, 0.06104745715856552, -0.00453292578458786, -0.08459409326314926, -0.06270847469568253, 0.014147180132567883, 0.023930300027132034, -0.007330185268074274, -0.00266907992772758, -0.06017574667930603, -0.0010414610151201487, -0.05581972375512123, 0.1343887895345688, -0.06274913251399994, 0.017059585079550743, 0.021590454503893852, 0.0119403675198555, -0.006798031274229288, 0.040263138711452484, -0.03086739592254162, -0.03951716795563698, 0.026149237528443336, -0.02396664209663868, 0.07261919975280762, -0.15333181619644165, 0.017304088920354843, -0.047063909471035004, 0.04713393375277519, 0.036861564964056015, -0.011127258650958538, 0.03429507464170456, -0.06009199097752571, -0.013168277218937874, 0.008686000481247902, -0.07818099856376648, 0.002792022656649351, 0.001774508855305612, -0.021661093458533287, -0.00947872269898653, -0.027824698016047478, 0.02172539196908474, 0.060317512601614, -0.030420467257499695, -0.060218505561351776, -0.053092923015356064, -0.040435805916786194, 0.010551216080784798, -0.02414114587008953, -0.027236802503466606, -4.14092643926915e-33, 0.01926722750067711, 0.04147457331418991, 0.019465181976556778, 0.06035745143890381, 0.07098610699176788, 0.05393983796238899, -0.031075114384293556, -0.1092751994729042, 0.05361861363053322, -0.020723482593894005, -0.026831595227122307, -0.06456304341554642, 0.04023980721831322, -0.04109741374850273, 0.025866903364658356, 0.03600601106882095, -0.057481154799461365, 0.005996153689920902, -0.004076115321367979, 0.010492448695003986, -0.06092526391148567, 0.10979514569044113, -0.11872326582670212, 0.002387813525274396, -0.07354666292667389, 0.04301326721906662, 0.01930614560842514, -0.041983943432569504, -0.08608447015285492, 0.021657131612300873, -0.0187885370105505, -0.0009035028051584959, -0.13035108149051666, 0.005135346669703722, 0.018134519457817078, 0.04976506903767586, 0.004345250781625509, -0.01153230108320713, -0.1240520104765892, 0.08722060918807983, 0.13771164417266846, 0.0009390046470798552, -0.04053323715925217, 0.011937689036130905, -0.12645117938518524, -0.056978147476911545, 0.013332200236618519, 0.04124237224459648, -0.016987312585115433, 0.02139558270573616, -0.04373488947749138, -0.020404750481247902, -0.006875805091112852, 0.013307211920619011, 0.012579571455717087, 0.0186806321144104, 0.04037543758749962, 0.10725364089012146, -0.0569017268717289, -0.03347567841410637, -0.021398644894361496, -0.023633280768990517, 0.03193657100200653, -0.07482074201107025, -0.01531162578612566, -0.015460681170225143, -0.12148450314998627, 0.03091340884566307, -0.004375307820737362, 0.006732896901667118, -0.0035232275258749723, 0.11121231317520142, 0.035895995795726776, -0.024174625054001808, 5.386172779253684e-05, 0.04800766706466675, 0.08095099776983261, 0.03781287744641304, 0.062193937599658966, 0.006913331337273121, -0.03376827389001846, 0.006199509836733341, 0.04528403282165527, 0.07024195790290833, -0.016584334895014763, -0.0006695238407701254, 0.009555432014167309, -0.005854923743754625, 0.07078079879283905, -0.08142112195491791, 0.036540672183036804, 0.009139993228018284, 0.03060748055577278, 0.06420371681451797, 0.05389558896422386, -4.905645312192064e-08, -0.004174603149294853, 0.00895738136023283, -0.09153378009796143, 0.030587410554289818, 0.048343610018491745, 0.10642283409833908, 0.02452460676431656, 0.07768776267766953, -0.010933243669569492, 0.07276653498411179, 0.04688340798020363, 0.009116731584072113, -0.035843610763549805, -0.05773026868700981, -0.08630837500095367, 0.0844445452094078, -0.04904302954673767, 0.04792620986700058, -0.018477559089660645, -0.01294745597988367, 0.00035068896249867976, 0.026409653946757317, 0.028778858482837677, 0.002017923630774021, -0.0946064367890358, -0.012057323008775711, 0.056880831718444824, -0.04428528994321823, -0.030761150643229485, 0.04676389694213867, -0.002657183911651373, -0.058225084096193314, 0.028111938387155533, -0.022504840046167374, 0.1260029524564743, -0.05400224030017853, -0.10253270715475082, 0.0357472226023674, 0.03960473835468292, 0.056575268507003784, 0.014805952087044716, 0.00949075073003769, 0.034406062215566635, 0.021113106980919838, -0.0009551094844937325, -0.08275885879993439, -0.09612869471311569, -0.04583628475666046, -0.08231813460588455, 0.019025085493922234, -0.04043911024928093, 0.02995556779205799, -0.030742980539798737, 0.05190916731953621, 0.09011835604906082, 0.05252542346715927, -0.04761188104748726, -0.01584027335047722, -0.0014528881292790174, 0.01667954958975315, -0.01244128867983818, -0.08367085456848145, 0.031218575313687325, 0.0063851275481283665 ] }, { "text": "Requirement already satisfied: typing-extensions>=4.10.0 in /usr/local/lib/python3.12/dist-packages (from torch) (4.15.0)\nRequirement already satisfied: setuptools in /usr/local/lib/python3.12/dist-packages (from torch) (75.2.0)\nRequirement already satisfied: sympy>=1.13.3 in /usr/local/lib/python3.12/dist-packages (from torch) (1.14.0)\nRequirement already satisfied: networkx>=2.5.1 in /usr/local/lib/python3.12/dist-packages (from torch) (3.6.1)\nRequirement already satisfied: jinja2 in /usr/local/lib/python3.12/dist-packages (from torch) (3.1.6)\nRequirement already satisfied: fsspec>=0.8.5 in /usr/local/lib/python3.12/dist-packages (from torch) (2025.3.0)\nRequirement already satisfied: nvidia-cuda-nvrtc-cu12==12.6.77 in /usr/local/lib/python3.12/dist-packages (from torch) (12.6.77)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_5", "embedding": [ -0.05592041835188866, -0.06253447383642197, 0.04562201350927353, -0.07915467768907547, 0.05436638370156288, -0.06445632874965668, 0.0049151889979839325, 0.06069032847881317, -0.11051224172115326, 0.01204270776361227, 0.05234844237565994, -0.02181529626250267, -0.05625348538160324, 0.08642899245023727, 0.1026272177696228, 0.025411896407604218, 0.02586090937256813, -0.042041778564453125, 0.0003713893238455057, -0.05482993274927139, 0.056553635746240616, -0.07452531903982162, 0.09733669459819794, -0.05612893030047417, -0.023636801168322563, -0.0007002781494520605, -0.04650459438562393, 0.011007300578057766, 0.015632707625627518, -0.004408222157508135, 0.02155451662838459, 0.10084547102451324, -0.05131734162569046, -0.06977578997612, 0.08690369129180908, 0.03411960229277611, -0.00031884698546491563, -0.013638995587825775, -0.054926835000514984, 0.03716479614377022, 0.007458061911165714, 0.034640248864889145, -0.03111499547958374, -0.03531568497419357, -0.09344320744276047, -0.06722360849380493, 0.04831510782241821, 0.0015115435235202312, -0.019292354583740234, -0.04840053617954254, -0.03053169883787632, -0.01678561419248581, -0.044296760112047195, -0.008293080143630505, 0.06972496956586838, -0.013276452198624611, -0.043458156287670135, -0.004228478763252497, -0.04659527540206909, -0.03865677863359451, -0.01742914877831936, 0.03272794187068939, -0.06283547729253769, -0.028154730796813965, -0.050109609961509705, 0.010940393432974815, 0.010878697969019413, 0.0052940016612410545, 0.06116971746087074, 0.05904414504766464, -0.12414755672216415, -0.007727797143161297, -0.03398393094539642, 0.07296139001846313, -0.04443180188536644, 0.008122424595057964, 0.15588310360908508, 0.009164135903120041, -0.026883505284786224, -0.11032260209321976, -0.024379093199968338, 0.021131450310349464, 0.0018174267606809735, 0.040748223662376404, 0.027879182249307632, -0.04355825483798981, 0.0033514308743178844, 0.016865193843841553, 0.03590288758277893, -0.0046421242877841, 0.06107652187347412, -0.08004748076200485, 0.0022605122067034245, 0.04294842109084129, -0.004843014292418957, 0.038963645696640015, 0.010405823588371277, 0.05253134295344353, -0.04044872894883156, 0.07635488361120224, -0.03394405171275139, -0.09237616509199142, 0.07890170067548752, 0.028901591897010803, 0.02510954439640045, 0.07565444707870483, -0.0764903724193573, -0.003734460799023509, 0.033588554710149765, 0.006983595434576273, -0.02812233194708824, -0.0676197037100792, -0.012953653000295162, -0.10570546239614487, -0.01444565411657095, 0.045770131051540375, 0.004663173109292984, 0.00850988831371069, 0.06762424111366272, 0.02770795114338398, 0.012422176077961922, 0.04596300423145294, 0.11896324157714844, 0.027163805440068245, 0.0402219220995903, -0.016526276245713234, -0.05170273408293724, 3.744982473029771e-33, -0.03957643359899521, 0.028192784637212753, -0.07320692390203476, 0.06082139536738396, 0.04131413623690605, 0.003216155804693699, 0.05133439972996712, -0.0038088313303887844, -0.10584264993667603, -0.06408574432134628, -0.04431265965104103, 0.02826262265443802, -0.04445173963904381, 0.007669432088732719, 0.0074403900653123856, -0.10337775200605392, 0.0391961932182312, 0.08158789575099945, 0.04480878263711929, -0.006909634917974472, 0.020670004189014435, 0.023575782775878906, -0.01910579763352871, 0.04870946705341339, 0.030783960595726967, -0.04078269749879837, 0.06345424801111221, 0.008485645055770874, 0.014235380105674267, -0.021859049797058105, 0.02544472925364971, -0.030880387872457504, 0.06255663931369781, 0.0025752743240445852, -0.01334131509065628, 0.011071092449128628, -0.041580718010663986, -0.08363452553749084, 0.004722433164715767, -0.1033216193318367, 0.03161711245775223, 0.1130153089761734, -0.02673281915485859, -0.024816028773784637, 0.0759463980793953, -0.029564887285232544, -0.05904943868517876, 0.03331831470131874, 0.05961266905069351, -0.07448609918355942, -0.04672178998589516, -0.011851213872432709, 0.0680493414402008, 0.038518697023391724, -0.0026234250981360674, -0.05566839873790741, 0.020351728424429893, -0.011242936365306377, 0.1556594967842102, -0.050967536866664886, 0.006783786695450544, 0.019699329510331154, -0.026801051571965218, 0.030164748430252075, 0.07667900621891022, 0.005668055731803179, -0.019829923287034035, 0.029981223866343498, 0.007731068413704634, 0.02612299472093582, -0.1379520297050476, 0.0061509921215474606, -0.037014275789260864, 0.07648985832929611, 0.050105296075344086, -0.01914750225841999, 0.00819999910891056, -0.05056207999587059, -0.016416266560554504, 0.03189855441451073, -0.115789994597435, 0.04395337402820587, -0.02298198640346527, 0.019406594336032867, 0.02999834530055523, -0.038837678730487823, 0.02108081802725792, 0.00014247163198888302, -0.030968403443694115, -0.013530975207686424, -0.04042864590883255, -0.043166521936655045, 0.007989000529050827, 0.024779414758086205, -0.046580661088228226, -3.038113271500189e-33, 0.013071302324533463, 0.06262572109699249, 0.003979271277785301, 0.07687016576528549, 0.020635129883885384, 0.015389367006719112, 0.020819474011659622, -0.08946660161018372, 0.04389446973800659, -0.02962537668645382, -0.009255184791982174, -0.058690525591373444, 0.08504241704940796, -0.08673150837421417, 0.006394652649760246, 0.05247121304273605, -0.06242452189326286, -0.06269235163927078, 0.031842175871133804, 0.048421461135149, -0.04338832572102547, 0.12914437055587769, -0.09706175327301025, 0.0025493598077446222, -0.04110220819711685, 0.02175818756222725, 0.041828516870737076, 0.020442308858036995, -0.07638000696897507, 0.015072190202772617, 0.02049408107995987, -0.009097886271774769, -0.1148524060845375, -0.01859639771282673, 0.008069570176303387, 0.008924808353185654, -0.001747803995385766, 0.051939707249403, -0.05181320384144783, 0.06706027686595917, 0.15061601996421814, -0.0022134261671453714, -0.08599881827831268, 0.01877805031836033, -0.09044612944126129, -0.025305474177002907, 0.02169763296842575, -0.008969200775027275, -0.04597945138812065, -0.02393677458167076, -0.0519193597137928, -0.017300693318247795, -0.045819949358701706, 0.03305957093834877, -0.00956894364207983, 0.022549103945493698, 0.042057640850543976, 0.1075044497847557, -0.04018637165427208, 0.003554095746949315, 0.006909200921654701, -0.06272874772548676, 0.07111956179141998, -0.06497704982757568, 0.0097196064889431, 0.009066644124686718, -0.08385803550481796, 0.08006766438484192, -0.01835910975933075, 0.0007750901859253645, -0.008808908984065056, 0.1003355085849762, 0.029117917641997337, -0.03560338541865349, 0.038454074412584305, 0.058190587908029556, 0.05896475538611412, 0.06457377970218658, 0.04239634796977043, 0.006973182782530785, -0.09966975450515747, 0.058595169335603714, -0.006205268669873476, 0.02788473851978779, -0.021970665082335472, -0.012118467129766941, 0.026843583211302757, 0.026611585170030594, 0.06854376941919327, -0.049969546496868134, 0.04769667983055115, -0.007177514955401421, 0.048233047127723694, 0.07191891968250275, 0.05007104203104973, -4.74514330051079e-08, -0.00958709605038166, -0.008972521871328354, -0.10903617739677429, 0.050652001053094864, 0.0703960657119751, 0.10130524635314941, -0.005165798589587212, 0.05349941924214363, -0.0035882117226719856, 0.042777206748723984, 0.04417714104056358, 0.04157729819417, -0.04885156452655792, 0.012853272259235382, -0.0718989148736, 0.040447670966386795, -0.06385141611099243, 0.1022023931145668, -0.04155397415161133, -0.038654666393995285, 0.00253218668513, 0.032416872680187225, 0.017812486737966537, 0.016420908272266388, -0.05140941962599754, -0.010122045874595642, 0.02281017415225506, -0.060863472521305084, -0.020457798615098, 0.0024456223472952843, -0.014849384315311909, -0.026214733719825745, 0.0052316319197416306, -0.018348855897784233, 0.07434041053056717, -0.049040526151657104, -0.12566007673740387, 0.05502244085073471, 0.012439213693141937, 0.060957763344049454, 0.02508595399558544, -0.0060380250215530396, 0.010130505077540874, 0.017448648810386658, -0.009307618252933025, -0.08125057816505432, -0.11796212941408157, 0.0008476488874293864, -0.01884150318801403, -0.015332802198827267, -0.0179767906665802, 0.05022261664271355, -0.03375731781125069, -0.0020500950049608946, 0.06766903400421143, 0.019522346556186676, -0.05620185285806656, 0.00035426384420134127, -0.005567267071455717, -0.027924586087465286, -0.01128218974918127, -0.06950971484184265, 0.025401504710316658, 0.007381637580692768 ] }, { "text": "Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.6.77 in /usr/local/lib/python3.12/dist-packages (from torch) (12.6.77)\nRequirement already satisfied: nvidia-cuda-runtime-cu12==12.6.77 in /usr/local/lib/python3.12/dist-packages (from torch) (12.6.77)\nRequirement already satisfied: nvidia-cuda-cupti-cu12==12.6.80 in /usr/local/lib/python3.12/dist-packages (from torch) (12.6.80)\nRequirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /usr/local/lib/python3.12/dist-packages (from torch) (9.10.2.21)\nRequirement already satisfied: nvidia-cublas-cu12==12.6.4.1 in /usr/local/lib/python3.12/dist-packages (from torch) (12.6.4.1)\nRequirement already satisfied: nvidia-cufft-cu12==11.3.0.4 in /usr/local/lib/python3.12/dist-packages (from torch) (11.3.0.4)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_6", "embedding": [ -0.07805825769901276, -0.04399437829852104, -0.028127936646342278, -0.02692391909658909, 0.021492471918463707, -0.031009774655103683, -0.049252040684223175, 0.01826646737754345, -0.08050280809402466, -0.04916149005293846, 0.00044016007450409234, -0.0564601831138134, -0.09517744183540344, 0.05705669894814491, 0.044987753033638, -0.032088503241539, 0.04053555056452751, -0.03212270513176918, -0.07093359529972076, -0.0038932086899876595, 0.022223247215151787, -0.06514430791139603, 0.04747924953699112, -0.023218275979161263, -0.02111254632472992, -0.04092784225940704, 0.006607556249946356, -0.04938072711229324, 0.0337488055229187, -0.01649342104792595, 0.008901355788111687, 0.06180235370993614, -0.049223460257053375, 0.009468543343245983, 0.11405974626541138, -0.01523273903876543, -0.047280460596084595, -0.07029274106025696, -0.09103153645992279, 0.02303970791399479, 0.010292841121554375, 0.03902649134397507, 0.01612177863717079, 0.043760135769844055, -0.0238188449293375, -0.02730424702167511, 0.018835339695215225, 0.04322639852762222, 0.007438415661454201, -0.08810834586620331, 0.01346547994762659, -0.013351409696042538, -0.05722979083657265, 0.020995313301682472, 0.0772080197930336, 0.013412317261099815, -0.060595251619815826, -0.1259085237979889, -0.019271645694971085, -0.05488307774066925, 0.06313614547252655, -0.043363653123378754, -0.018591489642858505, 0.02643571048974991, -0.04060112312436104, -0.010596795938909054, 0.01724902167916298, -0.040405213832855225, 0.02387167699635029, 0.03278467431664467, -0.05330171808600426, 0.03896818682551384, -0.005811063572764397, 0.02168104611337185, -0.06121546030044556, 0.0006515712011605501, 0.13125447928905487, -0.014145486056804657, 0.019134121015667915, -0.06344389170408249, -0.013985609635710716, 0.07729364186525345, 0.02960272692143917, 0.020048102363944054, 0.08935599029064178, -0.05724910646677017, 0.018018392845988274, 0.03718244284391403, -0.008656356483697891, -0.10085060447454453, 0.04666323587298393, -0.015307381749153137, 0.022017626091837883, 0.04704723134636879, -0.05139101669192314, -0.005921601317822933, 0.0501098595559597, 0.02069701813161373, -0.06761819124221802, 0.047578610479831696, -0.01876293495297432, -0.038119684904813766, 0.031881462782621384, 0.08112085610628128, -0.05470127612352371, 0.1060054674744606, -0.08900044858455658, 0.06555180251598358, -0.024063508957624435, 0.05383434519171715, 0.007630686275660992, -0.007568558678030968, -0.01718488521873951, -0.03756100684404373, 0.02126096934080124, 0.008754491806030273, -0.04465966671705246, -0.02095852978527546, 0.09542568027973175, 0.06569667160511017, -0.03962545469403267, -0.016142360866069794, 0.01944594271481037, -0.019491171464323997, -0.017739078029990196, -0.008538861759006977, 0.05208608880639076, 2.347179548934934e-33, -0.026962775737047195, -0.008467628620564938, -0.04771701246500015, -0.014732838608324528, 0.09715914726257324, 0.06993620097637177, 0.02955324947834015, 0.011027579195797443, -0.023958297446370125, -0.03825988993048668, -0.05800206959247589, 0.047672659158706665, -0.06862033903598785, 0.047908004373311996, 0.010244886390864849, -0.023906733840703964, 0.017858846113085747, 0.07530355453491211, 0.0012384988367557526, 0.026644233614206314, 0.07150845974683762, 0.04468270391225815, -0.01494976133108139, 0.013715249486267567, -0.03416042774915695, -0.023870371282100677, -0.0011523045832291245, 0.03218624368309975, 0.04832017049193382, -0.029780331999063492, 0.04751461371779442, -0.029586395248770714, 0.04107001796364784, 0.017026836052536964, 0.0004513163585215807, 0.0008585754549130797, -0.036340925842523575, -0.03377081826329231, 0.03615845739841461, -0.037754952907562256, 0.03213914483785629, 0.14114941656589508, -0.03121344745159149, -0.09728357195854187, 0.04369960352778435, 0.017455104738473892, 0.004856289830058813, -0.012776426039636135, -0.013588480651378632, -0.04047093912959099, -0.07299385964870453, 0.039602700620889664, 0.014312077313661575, -0.021752886474132538, 0.01773713529109955, -0.04788411036133766, 0.05742386728525162, -0.025166649371385574, 0.16744732856750488, -0.06026637926697731, -0.02344255894422531, -0.02097867615520954, -0.029404882341623306, -0.03939380869269371, 0.032064288854599, 0.018834101036190987, -0.013282724656164646, 0.09081221371889114, -0.040029849857091904, -0.005499931983649731, -0.13225969672203064, 0.024974891915917397, -0.07475248724222183, 0.01657217927277088, 0.09400412440299988, -0.013303612358868122, -0.006850537844002247, -0.05201057344675064, -0.036158159375190735, 0.015573771670460701, -0.09454918652772903, 0.08487668633460999, 0.006096594966948032, 0.002849757671356201, -0.026358911767601967, -0.028326893225312233, -0.008894352242350578, 0.06732027977705002, -0.021238815039396286, 0.0042821369133889675, -0.061871327459812164, 0.012541309930384159, 0.01534499041736126, 0.02161424793303013, 0.057564813643693924, -3.0442443928946887e-33, 0.04385792836546898, -0.022370843216776848, 0.03317996487021446, 0.06015046685934067, 0.05748540535569191, 0.024684058502316475, -0.06105911359190941, -0.07742556184530258, 0.06961756199598312, -0.05075489357113838, 0.01794465258717537, -0.024620600044727325, 0.04443325102329254, -0.01341516524553299, -0.022687556222081184, 0.022020673379302025, -0.07480667531490326, 0.02471969649195671, -0.032316889613866806, -0.010128483176231384, -0.06706682592630386, 0.10902733355760574, -0.1546001434326172, -0.06011789292097092, -0.03621451184153557, 0.020299386233091354, 0.07370951771736145, -0.04509567469358444, -0.03281344845890999, 0.03802192583680153, 0.02227994240820408, -0.012273205444216728, -0.12851932644844055, 0.07547543197870255, -0.02091928943991661, 0.01069539412856102, 0.026478923857212067, 0.010009387508034706, -0.06397188454866409, 0.11884649097919464, 0.17484909296035767, 0.021448977291584015, -0.03259619325399399, 0.009022288955748081, -0.09020980447530746, 0.016047237440943718, 0.001032839878462255, 0.00952997524291277, 0.00015151506522670388, 0.03207548335194588, 0.0023773256689310074, -0.021111009642481804, -0.028896251693367958, 0.07121716439723969, -0.0016087261028587818, 0.01203449722379446, 0.09106903523206711, 0.05856766924262047, -0.021203717216849327, -0.04379988834261894, -0.014679634012281895, -0.0029681227169930935, 0.003161152359098196, -0.0822378545999527, -0.011530798859894276, -0.007095831912010908, -0.08697659522294998, 0.13697651028633118, 0.03573274612426758, -0.009912144392728806, -0.06445613503456116, 0.06743873655796051, 0.030313685536384583, -0.07012467831373215, -0.09914641082286835, 0.04996316134929657, 0.03483215719461441, 0.027113059535622597, 0.10973042994737625, 0.007771764416247606, -0.07759679108858109, -0.08789557963609695, 0.037938300520181656, 0.04584696888923645, 0.012216946110129356, 0.013829092495143414, 0.09148383885622025, -0.05805325135588646, 0.058624573051929474, 0.010118253529071808, -0.011076029390096664, -0.014924674294888973, 0.027015622705221176, 0.023234130814671516, 0.04243607074022293, -3.9300701359934465e-08, 0.02622022107243538, -0.02816466987133026, -0.07261839509010315, 0.038656219840049744, 0.05381257086992264, 0.03115350753068924, -0.02944842539727688, 0.06551918387413025, 0.004891970194876194, 0.028716128319501877, 0.11760623753070831, -0.00010668858158169314, -0.02596682496368885, -0.02157704345881939, -0.08366569131612778, 0.10038654506206512, -0.04929913207888603, 0.030171552672982216, 0.020321793854236603, 0.0001050955688697286, -0.06083628535270691, 0.02576621249318123, 0.047269489616155624, -0.014876414090394974, -0.08507697284221649, -0.0028036697767674923, 0.08630526810884476, -0.04474009945988655, -0.01666802354156971, -0.01516188494861126, -0.03229864686727524, -0.02745722606778145, 0.040846388787031174, -0.06660421192646027, 0.10688722133636475, -0.019222088158130646, -0.049710121005773544, 0.0012245690450072289, 0.09209920465946198, -0.00034567643888294697, 0.056608013808727264, 0.01714654453098774, -0.01527583971619606, -0.0003139539621770382, 0.020784197375178337, -0.06781967729330063, -0.05948534980416298, -0.03673312067985535, -0.09499148279428482, 0.026194753125309944, -0.05763687938451767, 0.017100827768445015, -0.033989422023296356, 0.047894373536109924, 0.048759568482637405, 0.02623893879354, -0.0632266253232956, -0.00834288727492094, -0.04102258011698723, 0.010614206083118916, 0.036643464118242264, -0.08565691858530045, 0.03583693876862526, 0.02607433870434761 ] }, { "text": "Requirement already satisfied: nvidia-cufft-cu12==11.3.0.4 in /usr/local/lib/python3.12/dist-packages (from torch) (11.3.0.4)\nRequirement already satisfied: nvidia-curand-cu12==10.3.7.77 in /usr/local/lib/python3.12/dist-packages (from torch) (10.3.7.77)\nRequirement already satisfied: nvidia-cusolver-cu12==11.7.1.2 in /usr/local/lib/python3.12/dist-packages (from torch) (11.7.1.2)\nRequirement already satisfied: nvidia-cusparse-cu12==12.5.4.2 in /usr/local/lib/python3.12/dist-packages (from torch) (12.5.4.2)\nRequirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /usr/local/lib/python3.12/dist-packages (from torch) (0.7.1)\nRequirement already satisfied: nvidia-nccl-cu12==2.27.5 in /usr/local/lib/python3.12/dist-packages (from torch) (2.27.5)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_7", "embedding": [ -0.11020120978355408, -0.048405054956674576, -0.010950524359941483, -0.022770771756768227, 0.036372438073158264, -0.041047777980566025, -0.026344286277890205, 0.020003072917461395, -0.0760728120803833, -0.07178018242120743, 0.004399644676595926, -0.06718268245458603, -0.07625099271535873, 0.06004646047949791, 0.03798399865627289, -0.031474240124225616, 0.053934548050165176, -0.03594542667269707, -0.0565103217959404, -0.014000178314745426, 0.0033476599492132664, -0.08539409190416336, 0.07302040606737137, -0.010881515219807625, -0.02031373418867588, -0.014894473366439342, -0.021285541355609894, -0.05875585973262787, 0.028694991022348404, -0.03360341489315033, -0.013386566191911697, 0.05032263696193695, -0.07363952696323395, 0.0016345466719940305, 0.11491956561803818, -0.004644590895622969, -0.042218174785375595, -0.057753391563892365, -0.1001778319478035, -0.009931491687893867, 0.028315328061580658, 0.016508186236023903, 0.018999014049768448, 0.05466461926698685, -0.02409636229276657, -0.01589217409491539, 0.03273613378405571, 0.05141765624284744, -0.0022353813983500004, -0.061273571103811264, -0.003943402785807848, 0.008907927200198174, -0.05855515971779823, 0.027565976604819298, 0.061963822692632675, 0.03335854783654213, -0.05446135252714157, -0.11356238275766373, -0.037390533834695816, -0.04088744893670082, 0.06525571644306183, -0.06335309892892838, -0.029096215963363647, 0.0249215979129076, -0.013782959431409836, 0.000983047066256404, 0.03674120455980301, -0.04864730313420296, 0.03279720991849899, 0.03848068788647652, -0.038938868790864944, 0.0378253236413002, -0.004475081339478493, 0.0038548714946955442, -0.019431892782449722, 0.02053980901837349, 0.10739355534315109, -0.009375049732625484, 0.005093295592814684, -0.06217673793435097, -0.010451764799654484, 0.0781773179769516, 0.035677485167980194, 0.00987335667014122, 0.08343301713466644, -0.03967535123229027, 0.0010739819845184684, 0.039189413189888, 0.015440843999385834, -0.09222254157066345, 0.03920548036694527, -0.015816345810890198, 0.02777486853301525, 0.04725818336009979, -0.03629981353878975, -0.003372166771441698, 0.036736298352479935, 0.04004090279340744, -0.08750874549150467, 0.053943876177072525, -0.02596817910671234, -0.04660472646355629, 0.039685364812612534, 0.08704685419797897, -0.032727524638175964, 0.07524702697992325, -0.07243875414133072, 0.0500064492225647, -0.023902488872408867, 0.02962498553097248, 0.011395718902349472, -0.020178312435746193, 0.007222297135740519, -0.028508711606264114, 0.0036148815415799618, 0.027739563956856728, -0.032027047127485275, -0.019261907786130905, 0.09714062511920929, 0.06814653426408768, -0.04250209406018257, -0.008564463816583157, 0.01245865412056446, -0.04153844714164734, -0.023457909002900124, 0.023428862914443016, 0.02775479480624199, 2.4549740339442685e-33, 0.0044901552610099316, 0.0019672790076583624, -0.040105607360601425, -0.022374168038368225, 0.04768407344818115, 0.08454206585884094, 0.009028194472193718, 0.027535373345017433, -0.015407918021082878, -0.06128460541367531, -0.031407151371240616, 0.05017770454287529, -0.0758729800581932, 0.04984527453780174, 0.01137018483132124, -0.04502418264746666, 0.03301910310983658, 0.09560641646385193, 0.009237990714609623, -0.004193736240267754, 0.04079153388738632, 0.05158306285738945, -0.027514342218637466, 0.0003512664989102632, -0.05812454596161842, 0.004696732386946678, -0.011010133661329746, 0.06252660602331161, 0.03577658534049988, -0.02331707440316677, 0.04413112998008728, -0.034227076917886734, 0.03692696616053581, 0.02156776748597622, -0.008916611783206463, 0.0241644736379385, -0.03308159112930298, -0.03168690204620361, 0.03733943775296211, -0.016569916158914566, 0.024849673733115196, 0.14132921397686005, -0.01876087300479412, -0.11983805149793625, 0.04991595074534416, -0.025850025936961174, -0.01681661419570446, 0.0003027180500794202, 0.016029318794608116, -0.0330270454287529, -0.05434643104672432, 0.0419783815741539, 0.015533914789557457, -0.027895061299204826, 0.026356978341937065, -0.04357912763953209, 0.04916370287537575, -0.013606647960841656, 0.15699195861816406, -0.07700762152671814, -0.013352488167583942, -0.048471104353666306, -0.032417118549346924, -0.03798390552401543, 0.057320307940244675, 0.04679890722036362, 0.00031514218426309526, 0.06876464188098907, -0.03458394855260849, -0.00659586489200592, -0.1348806768655777, 0.0270755123347044, -0.06605424731969833, 0.04008965194225311, 0.12321668863296509, -0.01976594142615795, -0.010837510228157043, -0.045819878578186035, 0.00416027894243598, -2.82978689938318e-05, -0.10808522999286652, 0.0982230082154274, -0.0033070233184844255, 0.034484364092350006, -0.04330703616142273, -0.03245973214507103, -0.026059536263346672, 0.04403497651219368, -0.019315604120492935, -0.02232300117611885, -0.09735731780529022, -0.001414415892213583, -0.01669030264019966, 0.008723882026970387, 0.06077379733324051, -3.1814251346486266e-33, 0.04989106208086014, -0.004181290045380592, 0.008296431973576546, 0.0739530399441719, 0.025442402809858322, 0.03982820361852646, -0.07146906107664108, -0.09121649712324142, 0.0796411782503128, -0.04011787101626396, 0.03202458843588829, -0.003427475690841675, 0.045164402574300766, -0.01584494300186634, -0.022313786670565605, 0.035023774951696396, -0.07963526993989944, 0.012146294116973877, -0.020631253719329834, -0.013919846154749393, -0.023169539868831635, 0.10430651158094406, -0.12373082339763641, -0.03703980892896652, -0.03144344314932823, 0.003383102361112833, 0.08133674412965775, -0.041117362678050995, -0.014077848754823208, 0.006581303663551807, 0.03317926451563835, -0.005356396548449993, -0.13013501465320587, 0.06829240173101425, -0.012457398697733879, -0.002628231653943658, 0.02506805770099163, 0.027863575145602226, -0.09221452474594116, 0.12600606679916382, 0.17077572643756866, 0.011465689167380333, -0.011518582701683044, -0.007363164331763983, -0.0866769328713417, 0.019773775711655617, 0.011707263998687267, 0.002768042264506221, 0.011001423932611942, 0.011531276628375053, -0.021500086411833763, -0.0061739967204630375, -0.03665294870734215, 0.06418594717979431, -0.018310997635126114, 0.03415680304169655, 0.08413411676883698, 0.060391757637262344, -0.027677971869707108, -0.039896443486213684, -0.008462431840598583, 0.020867113023996353, -0.012033862061798573, -0.10235143452882767, -0.0002806273114401847, -0.011365562677383423, -0.10136160254478455, 0.1253598928451538, 0.03298760578036308, 0.0035009721759706736, -0.06777536869049072, 0.03808841481804848, 0.05959571897983551, -0.07717829197645187, -0.06344763189554214, 0.033092521131038666, 0.05937051773071289, 0.01545181404799223, 0.11265911906957626, -0.01751299388706684, -0.07045299559831619, -0.08361827582120895, 0.05081455036997795, 0.04939369112253189, -0.017482081428170204, 0.02995695173740387, 0.07914776355028152, -0.04913122206926346, 0.09165357053279877, -0.0030523326713591814, -0.020248806104063988, -0.01832268387079239, 0.018530763685703278, 0.026594966650009155, 0.028928568586707115, -4.25032240514156e-08, 0.048348568379879, -0.008452584967017174, -0.07038074731826782, 0.046158988028764725, 0.018061432987451553, 0.047881897538900375, -0.06138279661536217, 0.06730610877275467, -0.01653164066374302, 0.031824544072151184, 0.09813157469034195, -0.006612548604607582, -0.017993763089179993, -0.02819584682583809, -0.08232450485229492, 0.09602302312850952, -0.02236788719892502, 0.0374877043068409, -0.01335904560983181, 0.005501567851752043, -0.0573480948805809, 0.021015919744968414, 0.06900504976511002, -0.04087734967470169, -0.08957655727863312, -0.0038462288212031126, 0.06712301075458527, -0.05168873071670532, -0.01252390444278717, 0.0011796778999269009, -0.02007831074297428, -0.015504139475524426, 0.07115903496742249, -0.07513632625341415, 0.08367566019296646, -0.0179941114038229, -0.03104786016047001, 0.025265252217650414, 0.11188057065010071, 0.02141468971967697, 0.053224220871925354, 0.02052626758813858, -0.01756678707897663, -0.0003973182465415448, 0.022352974861860275, -0.08379019796848297, -0.06119455024600029, -0.03812197223305702, -0.09337349981069565, 0.015622245147824287, -0.09591104090213776, 0.034844450652599335, -0.04354991391301155, 0.03489610180258751, 0.03230728581547737, 0.009099564515054226, -0.05182541161775589, -0.031123416498303413, -0.045757271349430084, -0.0012378814863041043, 0.06329215317964554, -0.07202202826738358, 0.018332161009311676, 0.044806528836488724 ] }, { "text": "Requirement already satisfied: nvidia-nccl-cu12==2.27.5 in /usr/local/lib/python3.12/dist-packages (from torch) (2.27.5)\nRequirement already satisfied: nvidia-nvshmem-cu12==3.3.20 in /usr/local/lib/python3.12/dist-packages (from torch) (3.3.20)\nRequirement already satisfied: nvidia-nvtx-cu12==12.6.77 in /usr/local/lib/python3.12/dist-packages (from torch) (12.6.77)\nRequirement already satisfied: nvidia-nvjitlink-cu12==12.6.85 in /usr/local/lib/python3.12/dist-packages (from torch) (12.6.85)\nRequirement already satisfied: nvidia-cufile-cu12==1.11.1.6 in /usr/local/lib/python3.12/dist-packages (from torch) (1.11.1.6)\nRequirement already satisfied: triton==3.5.0 in /usr/local/lib/python3.12/dist-packages (from torch) (3.5.0)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_8", "embedding": [ -0.09447389841079712, -0.02748788893222809, -0.021105529740452766, -0.011986831203103065, 0.04097282141447067, -0.03450825810432434, -0.0341598242521286, 0.027521323412656784, -0.06918895989656448, -0.05371389910578728, 0.0006031849188730121, -0.06372841447591782, -0.06264720112085342, 0.07055143266916275, 0.03378422185778618, -0.020125027745962143, 0.02592085860669613, -0.03261810913681984, -0.04468932002782822, -0.0039992863312363625, 0.01583557017147541, -0.04514032602310181, 0.08787976950407028, -0.03031267412006855, -0.03465403988957405, -0.02832033485174179, -0.008105490356683731, -0.04781292751431465, 0.0273283701390028, -0.033316005021333694, -0.010586690157651901, 0.07894478738307953, -0.08610844612121582, -0.02486967109143734, 0.12570470571517944, -0.016551993787288666, -0.07218525558710098, -0.03922555223107338, -0.08745105564594269, 0.0042363377287983894, -0.008238895796239376, 0.0107887489721179, 0.004507071804255247, 0.06318052858114243, -0.023038865998387337, -0.017746711149811745, 0.033724673092365265, 0.04553663730621338, 0.011995179578661919, -0.08577227592468262, -0.0020781143102794886, 0.012723039835691452, -0.042774397879838943, 0.012573473155498505, 0.0884072482585907, 0.028468087315559387, -0.092483289539814, -0.11890439689159393, -0.035290710628032684, -0.04491338133811951, 0.09350061416625977, -0.04455246403813362, -0.012337413616478443, 0.018176693469285965, -0.023055950179696083, 0.010192069225013256, 0.042966328561306, -0.04113631695508957, 0.023364732041954994, 0.022332876920700073, -0.07699936628341675, 0.023672498762607574, -0.001053239218890667, 0.010781031101942062, -0.05098729953169823, 0.0003698088985402137, 0.1189228817820549, 0.0076694185845553875, 0.021216334775090218, -0.0729706883430481, -0.01829521358013153, 0.08280310779809952, 0.04362567141652107, 0.011588983237743378, 0.08969300985336304, -0.022544952109456062, 0.036436934024095535, 0.01931709051132202, 0.0009077092399820685, -0.07437547296285629, 0.031126024201512337, -0.02888568863272667, 0.029796067625284195, 0.02459937147796154, -0.05033200979232788, -0.011692186817526817, 0.02406919375061989, 0.03619108349084854, -0.06782161444425583, 0.05500224605202675, -0.0064835152588784695, -0.03672975301742554, 0.026750609278678894, 0.08665832132101059, -0.05372004583477974, 0.1043609157204628, -0.056046102195978165, 0.0801544189453125, -0.026036862283945084, 0.0456230528652668, -0.02613009884953499, 0.001952130813151598, -0.04376241937279701, -0.055896319448947906, 0.004171670880168676, 0.03769216686487198, -0.02830316312611103, -0.0014961614506319165, 0.09321066737174988, 0.06335527449846268, -0.04135013744235039, -0.028589703142642975, -0.0006114878342486918, -0.01625823602080345, -0.031996436417102814, 0.013045773841440678, 0.05725234001874924, 3.65027693394585e-33, -0.033512819558382034, 0.0246465764939785, -0.03908829391002655, -0.01711898483335972, 0.06425460427999496, 0.07936323434114456, 0.05026146396994591, -0.0010352935642004013, -0.033340103924274445, -0.05954430624842644, -0.031862225383520126, 0.03839050978422165, -0.05194206163287163, 0.04751497507095337, -0.007540437858551741, -0.04330435395240784, -0.0012437102850526571, 0.06625807285308838, 0.0028607239946722984, 0.009752166457474232, 0.03861072286963463, 0.05753135681152344, 0.004717714618891478, -0.012406044639647007, -0.038033392280340195, -0.03331838175654411, -0.028885086998343468, 0.033522263169288635, 0.04623284935951233, -0.028815029188990593, 0.046988680958747864, -0.007971007376909256, 0.06030919402837753, 0.013858770951628685, 0.00811014324426651, 0.011347994208335876, -0.03652869910001755, -0.04836738854646683, 0.021933352574706078, -0.022815899923443794, 0.012225686572492123, 0.15847794711589813, -0.02193262241780758, -0.11502882838249207, 0.013478966429829597, 0.012344935908913612, -0.02751489356160164, 0.005640609189867973, -0.027109339833259583, -0.028767909854650497, -0.06358054280281067, 0.07310841232538223, 0.011311830021440983, -0.06432206928730011, 0.035964854061603546, -0.019355567172169685, 0.04293709620833397, -0.011315027251839638, 0.1449252963066101, -0.07729970663785934, -0.017650406807661057, -0.03856552019715309, -0.013549699448049068, -0.08199311047792435, 0.03545532748103142, 0.015261830762028694, -0.04266957938671112, 0.07639932632446289, -0.0478077158331871, -0.017546581104397774, -0.11655990779399872, 0.07292771339416504, -0.05404242128133774, 0.022218232974410057, 0.10948964953422546, -0.013266135938465595, -0.050586916506290436, -0.05698607861995697, 0.003998858854174614, 0.0009099931921809912, -0.08646076172590256, 0.06778530031442642, 0.009646410122513771, -0.0047996509820222855, 0.003857729025185108, -0.043609436601400375, -0.01630297861993313, 0.05785389244556427, -0.014879994094371796, -0.027070747688412666, -0.048489317297935486, -0.022895535454154015, 0.019440442323684692, 0.013543128035962582, 0.04378693923354149, -3.9490126601600106e-33, 0.051103513687849045, 0.0054403021931648254, 0.019414681941270828, 0.05761288106441498, 0.030703315511345863, 0.024192946031689644, -0.04380668327212334, -0.08545786887407303, 0.048047177493572235, -0.04267580434679985, 0.019278328865766525, 0.008849237114191055, 0.0459938608109951, -0.013926598243415356, -0.011218358762562275, 5.953792788204737e-05, -0.05738386884331703, 0.021521739661693573, 0.0023925271816551685, -0.02191914990544319, -0.04400763288140297, 0.08530651777982712, -0.1311403214931488, -0.04965539276599884, -0.04266683757305145, 0.033662017434835434, 0.08491586148738861, -0.02317177876830101, -0.020848453044891357, 0.009255991317331791, 0.02507656067609787, 0.02204100415110588, -0.11372561007738113, 0.04833443835377693, 0.010103913955390453, 0.0014262259937822819, 0.016839098185300827, 0.011499043554067612, -0.052889831364154816, 0.08755315095186234, 0.15304599702358246, 0.0210899468511343, -0.02953920140862465, -0.0038383924402296543, -0.07437211275100708, 0.004260938614606857, 0.00879454892128706, -0.002695414936169982, 0.016638124361634254, 0.016861164942383766, 0.0003073422994930297, -0.031151380389928818, -0.031055264174938202, 0.08647771179676056, 0.0005204888293519616, 0.06670035421848297, 0.08031885325908661, 0.0872810110449791, 0.0006786274025216699, -0.043795228004455566, -0.01160505972802639, 0.014341508969664574, -0.01599966175854206, -0.07494796812534332, 0.003476218320429325, -0.034541256725788116, -0.11388575285673141, 0.13472504913806915, 0.05204727128148079, 0.001668549026362598, -0.08677846193313599, 0.04820622503757477, 0.039498116821050644, -0.08714299649000168, -0.09154125303030014, 0.006613966077566147, 0.0772288516163826, 0.012136864475905895, 0.09872864931821823, -0.0101465480402112, -0.08678518980741501, -0.08735542744398117, 0.04401909187436104, 0.04572577401995659, -0.010378485545516014, 0.01976570300757885, 0.10122357308864594, -0.07988064736127853, 0.06252249330282211, 0.022376570850610733, -0.03412381932139397, -0.018090980127453804, 0.030516615137457848, 0.031036585569381714, 0.01954628899693489, -4.101393358268979e-08, 0.06062223017215729, -0.02254360355436802, -0.08602241426706314, 0.0584561824798584, 0.06651769578456879, 0.06079956889152527, -0.05132950469851494, 0.05551105737686157, -0.016905246302485466, 0.0413435734808445, 0.11783283948898315, -0.005746953655034304, -0.01227665226906538, -0.028150178492069244, -0.07304257899522781, 0.1198214590549469, -0.021592652425169945, 0.04944644123315811, 0.005187492351979017, -0.02521572820842266, -0.06918980181217194, 0.01901702955365181, 0.04029531031847, -0.0026525482535362244, -0.07533547282218933, 0.0017523416317999363, 0.0916738212108612, -0.05132698267698288, -0.011499403975903988, -0.03833535313606262, -0.05192515254020691, -0.010634329169988632, 0.05966130644083023, -0.06616610288619995, 0.0845794528722763, -0.033563170582056046, -0.047439221292734146, 0.01966315507888794, 0.10942259430885315, 0.0016437384765595198, 0.04628117382526398, 0.024230988696217537, -0.011434195563197136, -0.001596292364411056, 0.048622529953718185, -0.06811286509037018, -0.0721016377210617, -0.04664496332406998, -0.11479948461055756, 0.004883099813014269, -0.06819263845682144, 0.011637470684945583, -0.05061143636703491, 0.047082267701625824, 0.03848296403884888, 0.018071815371513367, -0.053423527628183365, -0.003753518918529153, -0.02717389352619648, -0.010611011646687984, 0.013889352791011333, -0.0692373663187027, 0.03563288226723671, 0.01826007105410099 ] }, { "text": "Requirement already satisfied: triton==3.5.0 in /usr/local/lib/python3.12/dist-packages (from torch) (3.5.0)\nRequirement already satisfied: contourpy>=1.0.1 in /usr/local/lib/python3.12/dist-packages (from matplotlib) (1.3.3)\nRequirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.12/dist-packages (from matplotlib) (0.12.1)\nRequirement already satisfied: fonttools>=4.22.0 in /usr/local/lib/python3.12/dist-packages (from matplotlib) (4.61.1)\nRequirement already satisfied: kiwisolver>=1.3.1 in /usr/local/lib/python3.12/dist-packages (from matplotlib) (1.4.9)\nRequirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.12/dist-packages (from matplotlib) (25.0)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_9", "embedding": [ -0.09330528974533081, -0.0595618411898613, -0.00693257711827755, -0.07697533071041107, 0.04972861334681511, -0.0527670681476593, -0.004046104848384857, 0.01832980290055275, -0.07522217929363251, -0.01837003231048584, 0.06311029940843582, -0.056996893137693405, -0.04959867149591446, 0.05309443920850754, 0.10327799618244171, 0.007347816601395607, -0.025044087320566177, -0.05452752113342285, 0.008283094502985477, -0.018717210739850998, 0.038372285664081573, -0.06347039341926575, 0.029248468577861786, -0.029467463493347168, 0.048798538744449615, 0.031074389815330505, -0.0317651592195034, -0.016524633392691612, 0.06285715103149414, -0.0208961833268404, 0.020698335021734238, 0.09746529906988144, -0.05055978521704674, -0.07356984913349152, 0.11189975589513779, 0.04896635562181473, 0.0015472066588699818, -0.00032290068338625133, -0.05561771243810654, 0.061447933316230774, -0.013310682959854603, 0.07361837476491928, -0.013875715434551239, 0.004017731640487909, -0.02387472614645958, -0.05110964924097061, 0.012288462370634079, 0.002154327230527997, 0.009509512223303318, 0.005735277198255062, -0.042774491012096405, -0.06693479418754578, -0.032649021595716476, -0.026504548266530037, 0.024481788277626038, -0.01108646672219038, -0.010412419214844704, -0.011771202087402344, -0.0024484917521476746, -0.02392568252980709, -0.03238826245069504, 0.0033666735980659723, -0.008932475000619888, 0.006882339715957642, -0.03096114844083786, -0.0019321423023939133, 0.013038825243711472, -0.02104576677083969, 0.06500842422246933, 0.048029713332653046, -0.08548782020807266, -0.046355120837688446, -0.01077474094927311, 0.0645969808101654, -0.09991037845611572, -0.018171077594161034, 0.11528795212507248, 0.005782049149274826, -0.030591681599617004, -0.07581610977649689, -0.03412714600563049, 0.04841672256588936, 0.023258352652192116, 0.02757951430976391, 0.052344828844070435, -0.0465879924595356, -0.04951919615268707, 0.04566548392176628, 0.008850947953760624, -0.06505227833986282, 0.06527799367904663, -0.03083428367972374, -0.012849252671003342, 0.07077738642692566, -0.06506393849849701, 0.037135109305381775, 0.028171155601739883, 0.08705569803714752, -0.0711168497800827, 0.05577364191412926, -0.02549281157553196, -0.12241897732019424, 0.04148362576961517, 0.03520261496305466, -0.00563222449272871, 0.02827863208949566, -0.006345406174659729, -0.01879279501736164, 0.020790226757526398, 0.03791658580303192, 0.015312711708247662, -0.08571791648864746, -0.011137877590954304, -0.04019103944301605, 0.052699554711580276, 0.016617780551314354, 0.0034695686772465706, 0.00017141629359684885, 0.06766963750123978, 0.05455880984663963, -0.020106932148337364, 0.021786518394947052, 0.10162583738565445, 0.000977279501967132, -0.007406308315694332, -0.03604728728532791, -0.001612979918718338, 3.828730568054105e-33, -0.01223115436732769, 0.091830775141716, -0.08638259023427963, 0.0098876953125, 0.034552473574876785, -0.07242093980312347, -0.02607939951121807, -0.023822909221053123, -0.06888048350811005, -0.06266622245311737, -0.016217343509197235, 0.05868667736649513, -0.08534543961286545, 0.03421153873205185, 0.00832801591604948, -0.09068934619426727, 0.05955181643366814, 0.07138245552778244, -0.021547939628362656, 0.003206668421626091, -0.031839411705732346, 0.005548205692321062, -0.04582059383392334, 0.040570810437202454, -0.08691630512475967, -0.0024289211723953485, 0.0706506296992302, 0.004201922100037336, -0.001257056021131575, -0.021152514964342117, 0.042656704783439636, -0.023771822452545166, 0.09605596959590912, 0.03113735280930996, -0.05297798290848732, -0.004385502077639103, -0.048499323427677155, -0.06767149269580841, 0.01022966019809246, 0.02019524946808815, -0.06330034136772156, 0.09581994265317917, 0.014429875649511814, -0.061286624521017075, 0.06617920100688934, 0.023851796984672546, -0.017736956477165222, 0.07761044800281525, 0.045465052127838135, -0.0925881564617157, -0.049937132745981216, 0.03039773739874363, 0.008441946469247341, 0.08017971366643906, -0.016863690689206123, -0.014841930009424686, 0.009296844713389874, -0.05359281972050667, 0.11004456132650375, -0.026561837643384933, 0.020662033930420876, -0.005497996229678392, 0.009264616295695305, 0.005196784157305956, 0.04047572612762451, -0.01121399737894535, -0.01969935931265354, -0.04617471992969513, -0.025729699060320854, 0.04797758162021637, -0.13116545975208282, 0.028223883360624313, 0.004504989832639694, 0.052637916058301926, 0.08940531313419342, 0.007056539412587881, 0.0015540773747488856, -0.007521639112383127, -0.05620544031262398, 0.03068743832409382, -0.11755649745464325, 0.0027739466167986393, 0.005342710297554731, -0.03997102379798889, -0.01007173117250204, -0.050125736743211746, 0.07047325372695923, 0.02851027250289917, 0.008099276572465897, -0.05647662654519081, -0.062443360686302185, -0.016506563872098923, 0.0009506660862825811, -0.00014550331979990005, -0.03720307722687721, -4.0989719438623484e-33, 0.020838908851146698, 0.06174460053443909, 0.01417632307857275, 0.05270795896649361, 0.015052733942866325, 0.10461913049221039, 0.01577555574476719, -0.07995399087667465, 0.07572904974222183, 0.008110545575618744, 0.006521946284919977, -0.048159193247556686, 0.05455489084124565, -0.028513111174106598, 0.010776311159133911, 0.05961175635457039, -0.016808021813631058, 0.015876831486821175, 0.008049333468079567, -0.03477495163679123, -0.02305789291858673, 0.09660718590021133, -0.1268642246723175, -0.02356846258044243, -0.035734985023736954, 0.04080488905310631, 0.008001506328582764, -0.06304080784320831, -0.07932452857494354, 0.03565284237265587, -0.023844411596655846, -0.037164147943258286, -0.1056826040148735, -0.0007078544003888965, -0.012924465350806713, 0.03565526008605957, 0.016365062445402145, 0.004491560626775026, -0.1103522926568985, 0.08495724946260452, 0.13729988038539886, -0.013763923197984695, -0.04256664216518402, 0.011800074018537998, -0.127204030752182, -0.06416364014148712, 0.005546102300286293, 0.023621173575520515, 0.024343032389879227, -0.0018878518603742123, -0.013452212326228619, 0.0291766170412302, 0.008696634322404861, 0.016180867329239845, -0.044551800936460495, 0.014716819860041142, 0.008148713037371635, 0.10947951674461365, -0.07670740783214569, -0.03871386498212814, -0.062977135181427, -0.032572902739048004, 0.003295677015557885, -0.09486136585474014, 0.01608925126492977, 0.008601570501923561, -0.06995140761137009, 0.056746143847703934, 0.0390595905482769, -0.005142612382769585, -0.035300370305776596, 0.09377632290124893, 0.09438282996416092, -0.02367827482521534, 0.005049185361713171, 0.046814996749162674, 0.0699959471821785, 0.0069495378993451595, 0.0400405079126358, -0.0017377401236444712, 0.005318742711097002, 0.05320079252123833, 0.012639973312616348, 0.07134725898504257, -0.026944074779748917, -0.008386834524571896, 0.015171917155385017, -0.015059445053339005, 0.09621323645114899, -0.10107901692390442, 0.021042702719569206, 0.031418267637491226, 0.03913620859384537, 0.04405822232365608, 0.08777851611375809, -5.217889764708161e-08, 0.030143434181809425, -0.007449655793607235, -0.10810837149620056, 0.0006178650073707104, 0.03901011869311333, 0.07192976027727127, 0.0237765833735466, 0.05340617895126343, -0.0770949274301529, 0.04218526557087898, 0.07820861786603928, 0.023558123037219048, -0.07730173319578171, -0.03821176290512085, -0.0652686357498169, 0.07143878191709518, -0.04502366855740547, 0.07398875057697296, -0.0034843271132558584, -0.032628826797008514, 0.014483346603810787, 0.03935771808028221, 0.035928092896938324, 0.007629366125911474, -0.15661029517650604, 0.02187330462038517, 0.043845780193805695, -0.02458459883928299, -0.02407718449831009, 0.02876504510641098, -0.013048418797552586, -0.036055587232112885, 0.001010374748148024, 0.04674924537539482, 0.07202471792697906, -0.066951222717762, -0.1309729516506195, 0.055647943168878555, 0.044997602701187134, 0.11753849685192108, -0.04592335596680641, 0.03715735673904419, -0.03268415108323097, 0.02490399405360222, 0.008107553236186504, -0.07700753211975098, -0.09772564470767975, -0.04059334471821785, -0.00030136879649944603, -0.0028925237711519003, -0.05724334716796875, 0.018772348761558533, -0.010738611221313477, 0.0024903123266994953, 0.06619523465633392, 0.01825769431889057, -0.07392757385969162, -0.0022994668688625097, -0.03967089578509331, 0.04064435139298439, -0.00704305712133646, -0.03537791222333908, 0.07600361853837967, -0.01784364879131317 ] }, { "text": "Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.12/dist-packages (from matplotlib) (25.0)\nRequirement already satisfied: pyparsing>=2.3.1 in /usr/local/lib/python3.12/dist-packages (from matplotlib) (3.2.5)\nRequirement already satisfied: python-dateutil>=2.7 in /usr/local/lib/python3.12/dist-packages (from matplotlib) (2.9.0.post0)\nRequirement already satisfied: six>=1.5 in /usr/local/lib/python3.12/dist-packages (from python-dateutil>=2.7->matplotlib) (1.17.0)\nRequirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.12/dist-packages (from sympy>=1.13.3->torch) (1.3.0)\nRequirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.12/dist-packages (from jinja2->torch) (3.0.3)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_10", "embedding": [ -0.028754116967320442, -0.07121804356575012, 0.019793543964624405, -0.09506286680698395, 0.0609915666282177, -0.05445600673556328, -0.05380761995911598, 0.027287732809782028, -0.07001665979623795, 0.010195323266088963, 0.022868070751428604, -0.015655476599931717, -0.05747983604669571, 0.04987991601228714, 0.09784206748008728, 0.01909223198890686, -0.017307644709944725, -0.0456584170460701, 0.003499506274238229, -0.031592871993780136, 0.041356027126312256, -0.06431706249713898, 0.04214823618531227, -0.01499428041279316, 0.004935558885335922, -0.010481645353138447, -0.02202410064637661, 0.020055199041962624, 0.00777931185439229, 0.028209513053297997, 0.04935514181852341, 0.08398763090372086, -0.01817684806883335, -0.07568856328725815, 0.11611869186162949, 0.09676697850227356, 0.003999694716185331, -0.032221950590610504, -0.02104935050010681, 0.043478090316057205, -0.005985188763588667, 0.01288082730025053, 0.008411039598286152, -0.0019075220916420221, -0.028654085472226143, -0.02203257381916046, 0.034338608384132385, -0.0034671600442379713, 0.017422107979655266, -0.02577623724937439, -0.05579741299152374, 0.006164952181279659, -0.073984295129776, -0.05676296353340149, 0.019769590348005295, -0.01845008134841919, -0.00336638861335814, -0.03866119310259819, -0.046153854578733444, -0.07665330916643143, -0.10996540635824203, 0.031072253361344337, -0.0374210961163044, 0.003108557080850005, -0.03843904286623001, -0.024388140067458153, -0.0016674731159582734, -0.01680644415318966, 0.06078637018799782, 0.07717586308717728, -0.1398363560438156, -0.018428588286042213, -0.00500247860327363, 0.040138233453035355, -0.09195546805858612, 0.006744449492543936, 0.0977589339017868, -0.01418822631239891, -0.033423736691474915, -0.12035901099443436, 0.008000816218554974, 0.004918680991977453, -0.04169224947690964, 7.958779315231368e-05, -0.02735820971429348, -0.05663876235485077, -0.001505594584159553, 0.08525505661964417, 0.03550482168793678, -0.08746907860040665, 0.07164101302623749, -0.02851850539445877, -0.047175612300634384, 0.10700791329145432, -0.0008868200820870697, -0.005641469731926918, 0.008585264906287193, 0.07016255706548691, -0.03771060332655907, 0.07144317030906677, -0.01162744965404272, -0.10190501809120178, 0.02514893189072609, 0.04111824557185173, 0.011496566236019135, 0.09497977793216705, -0.07862469553947449, -0.022507596760988235, -0.005452858284115791, 0.029685327783226967, -0.016230864450335503, -0.03777964040637016, -0.031850095838308334, -0.02175026945769787, 0.07900629192590714, 0.07493578642606735, 0.018003979697823524, 0.02634567767381668, 0.0664520114660263, 0.029663650318980217, -0.011391318403184414, 0.020850004628300667, 0.1667737513780594, 0.0025986458640545607, -0.02507280558347702, -0.04782625660300255, -0.016256313771009445, 3.048487927501157e-33, -0.07488907128572464, 0.013512956909835339, -0.018531333655118942, 0.014142262749373913, 0.018100984394550323, 0.02685353346168995, 0.03369716927409172, -0.03143881633877754, -0.027649041265249252, -0.040343012660741806, -0.02744845300912857, -0.007085615303367376, -0.017707645893096924, 0.0005568870110437274, 0.05745619535446167, -0.09818574786186218, 0.03855907544493675, 0.07544886320829391, -0.0107906898483634, -0.021781668066978455, -0.003988496493548155, -0.028168896213173866, -0.06570176780223846, 0.05956846475601196, -0.012462632730603218, -0.015438059344887733, 0.10277315229177475, 0.027961555868387222, 0.01718268357217312, -0.02164429798722267, 0.022894319146871567, 0.008073876611888409, 0.04620261490345001, -0.0027167696971446276, -0.02445989102125168, 0.04847949370741844, -0.06932667642831802, -0.08390168845653534, 0.002250162186101079, -0.06343182921409607, -0.008838491514325142, 0.05535047501325607, 0.018653331324458122, -0.04605639725923538, 0.07270205020904541, -0.011458202265202999, 0.001702339737676084, 0.05942952632904053, 0.056495752185583115, -0.04237857833504677, -0.030575336888432503, 0.02060372196137905, 0.010546731762588024, -0.027550142258405685, -0.011695894412696362, -0.06086646765470505, 0.004410662688314915, -0.04537898674607277, 0.08591633290052414, -0.02325676754117012, 0.013427488505840302, 0.0010525501566007733, 0.022060047835111618, -0.038591980934143066, 0.03383383899927139, 0.041334882378578186, -0.026424935087561607, -0.011436392553150654, -0.005547559354454279, 0.1125398799777031, -0.1253296136856079, 0.03001973032951355, -0.04585312306880951, 0.0461261086165905, 0.06698968261480331, 0.006430882960557938, 0.0367952324450016, -0.016781767830252647, -0.011596216820180416, -0.0013733548112213612, -0.11464916169643402, 0.052398983389139175, -0.0004845478106290102, -0.006512325722724199, -0.006759746465831995, -0.026065746322274208, 0.037432461977005005, 0.05610038712620735, -0.028344152495265007, -0.05356418713927269, -0.02070670574903488, -0.05913619324564934, -0.02101011388003826, 0.03625833988189697, -0.001356799271889031, -4.234352893562582e-33, 0.008485006168484688, 0.06185539811849594, 0.03719433769583702, 0.09633313864469528, 0.05514959618449211, 0.01931881718337536, 0.037326082587242126, -0.05005992203950882, 0.08583322912454605, 0.01735714077949524, -0.07718000560998917, -0.06538879126310349, 0.04534119367599487, -0.04738291725516319, 0.023948559537529945, 0.04786650836467743, -0.04300708323717117, -0.01470107026398182, 0.014630105346441269, 0.032067593187093735, -0.030915668234229088, 0.12714050710201263, -0.09095440804958344, 0.0039705317467451096, -0.015135773457586765, 0.03519545495510101, 0.039892297238111496, -0.07197695225477219, -0.06425657868385315, -0.016614167019724846, -0.026780109852552414, -0.025976017117500305, -0.14251986145973206, -0.01215015072375536, -0.02601827308535576, 0.03623812645673752, -0.02272334136068821, -0.011803116649389267, -0.0848531723022461, 0.12082972377538681, 0.07103728502988815, 0.042231958359479904, -0.0455840528011322, -0.019501401111483574, -0.11212887614965439, -0.03288841247558594, 0.03883298113942146, 0.028092991560697556, 0.022098299115896225, -0.012138031423091888, -0.09037097543478012, 0.028658688068389893, 0.018726693466305733, -0.01343783549964428, 0.011519785970449448, -0.004019696731120348, 0.0070751807652413845, 0.13767535984516144, -0.06229369714856148, -0.03909938037395477, -0.0477089062333107, 0.010683547705411911, 0.02403198555111885, -0.042951084673404694, 0.02692890353500843, 0.024286270141601562, -0.06476681679487228, -0.0007799141458235681, 0.007078296039253473, 0.0174031350761652, 0.014839613810181618, 0.08847081661224365, 0.010073469020426273, -0.04735875502228737, 0.006546469870954752, 0.07036813348531723, 0.04755409061908722, 0.07227479666471481, 0.02193986438214779, 0.00925753265619278, -0.0060374196618795395, 0.042721230536699295, 0.034272316843271255, 0.1170169860124588, -0.050385404378175735, -0.020097855478525162, 0.020061559975147247, -0.042792338877916336, 0.08029036223888397, -0.05527518689632416, 0.057225968688726425, 0.01646980084478855, 0.02584531530737877, 0.026624472811818123, 0.07256753742694855, -4.7350280141245094e-08, -0.00748900230973959, 0.004145368002355099, -0.09720102697610855, 0.006635802797973156, 0.04288598150014877, 0.12235290557146072, -0.014264779165387154, 0.0633176937699318, -0.027044517919421196, 0.06398440897464752, 0.04435541108250618, -0.02593456767499447, -0.057777561247348785, -0.014474663883447647, -0.11842301487922668, 0.05520487204194069, -0.08080638945102692, 0.06727688014507294, -0.03510677441954613, -0.012256982736289501, 0.01049803476780653, 0.030183415859937668, 0.0041379728354513645, 0.005835681688040495, -0.07689739018678665, -0.00857603084295988, 0.027238208800554276, -0.0012564308708533645, -0.004064520820975304, 0.0379054993391037, 0.011192310601472855, -0.07082995772361755, 0.012510749511420727, -0.008917891420423985, 0.11115645617246628, -0.042414430528879166, -0.13792090117931366, 0.049921177327632904, 0.03360438346862793, 0.08768127113580704, -0.005487329792231321, 0.015263046137988567, 0.02771138586103916, 0.019076209515333176, 0.015339171513915062, -0.02318514510989189, -0.16470077633857727, -0.07022032141685486, -0.06669832766056061, -0.004744519013911486, -0.037696775048971176, 0.02581779845058918, -0.04825572669506073, -0.008605080656707287, 0.083312027156353, 0.05212898179888725, -0.08305718749761581, -0.041555922478437424, -0.011648575775325298, -0.003923109266906977, -0.01666180044412613, -0.056516289710998535, 0.02588779479265213, 0.001147643430158496 ] }, { "text": "In [2]:\n\nimport torch\nimport torch.nn as nn\nfrom torchvision import models, transforms\nfrom PIL import Image\nimport matplotlib.pyplot as plt\nimport numpy as np\nfrom typing import List, Tuple, Optional\nimport requests\nfrom io import BytesIO\n\n# Check for GPU\ndevice = torch.device('cuda' if torch.cuda.is_available() else 'cpu')\nprint(f\"Using device: {device}\")\n\nUsing device: cuda\n\n2. Understanding the Core Idea¶\n\nIn normal neural network usage:\n\n• Input image → Network → Output prediction\n•\n\n• We adjust the network weights to improve predictions\n•\n\nIn Deep Dream:\n\n• Input image → Network → Layer activations\n•\n\n• We adjust the input image pixels to amplify those activations\n•", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_11", "embedding": [ -0.03820836544036865, -0.10478296875953674, 0.018663108348846436, 0.0305812805891037, 0.03992112725973129, -0.054530855268239975, -0.029160920530557632, -0.003495552344247699, 0.0019558146595954895, -0.09021490067243576, -0.0030098166316747665, -0.037183258682489395, -0.058336351066827774, -0.03161807730793953, -0.0413849800825119, 0.008872020058333874, 0.006172533147037029, -0.008137332275509834, -0.06522846221923828, -0.09330711513757706, 0.12348262220621109, -0.053080394864082336, 0.02777349017560482, -0.020798025652766228, 0.007730579003691673, -0.016112633049488068, 0.025351250544190407, 0.014736240729689598, 0.03699755668640137, -0.03413059934973717, 0.05829443782567978, 0.03024766780436039, -0.0307238157838583, 0.04724792018532753, 0.02167074754834175, -0.027352524921298027, -0.06426238268613815, -0.05589284747838974, -0.05060410872101784, -0.030174268409609795, 0.05982371047139168, -0.05568626523017883, -4.92486942675896e-05, -0.009769462049007416, 0.00027021876303479075, 0.03337739035487175, 0.0898544043302536, -0.05636901035904884, -0.014355278573930264, -0.061513181775808334, -0.016582053154706955, -0.027749978005886078, -0.024445289745926857, 0.0475849024951458, 0.052874837070703506, 0.025374898687005043, 0.023502444848418236, -0.10226178914308548, 0.043857332319021225, -0.1118987575173378, 0.04162072017788887, 0.032598257064819336, -0.018696453422307968, -0.028478581458330154, 0.02011711336672306, -0.02845083549618721, -0.0035536361392587423, -0.026445604860782623, 0.06093890964984894, -0.033801909536123276, 0.042687319219112396, 0.04066105931997299, -0.013099389150738716, 0.008488757535815239, -0.0010597157524898648, -0.03178437426686287, 0.1062832847237587, -0.019031599164009094, 0.014449619688093662, -0.06090923398733139, 0.009444806724786758, 0.03976953402161598, 0.09269026666879654, -0.008057708851993084, 0.056929443031549454, -0.012696441262960434, 0.0020228661596775055, 0.07452616095542908, -0.0075477054342627525, -0.07235531508922577, -0.041796062141656876, -0.016302838921546936, -0.09189221262931824, 0.03324076905846596, 0.025816310197114944, -0.009186074137687683, 0.026534169912338257, -0.08618154376745224, -0.11716502904891968, 0.021366635337471962, 0.017634116113185883, -0.04646061360836029, -0.012166562490165234, 0.01628676801919937, -0.015461654402315617, 0.08167383819818497, 0.05103817582130432, 0.07257738709449768, -0.02997557818889618, 0.016324207186698914, 0.04609677568078041, 0.024237550795078278, -0.0432334840297699, 0.011044155806303024, 0.09972160309553146, -0.02642635442316532, -0.041539207100868225, 0.07987067103385925, -0.042593955993652344, 0.06528787314891815, -0.07657617330551147, 0.037488870322704315, -0.06631815433502197, 0.004369211383163929, -0.08470627665519714, -0.015824533998966217, -0.07305579632520676, 6.735780994883409e-33, -0.013928543776273727, 0.06707529723644257, -0.06738260388374329, -0.0470736101269722, 0.050816573202610016, -0.012744016014039516, -0.014696911908686161, -0.07709228992462158, -0.010396585799753666, 0.012641600333154202, -0.06350476294755936, 0.059049900621175766, -0.0529392845928669, 0.15641199052333832, -0.032107722014188766, -0.05440196394920349, 0.049036167562007904, 0.002510905498638749, 0.08024818450212479, 0.010018514469265938, 0.013125833123922348, 0.10163886100053787, -0.02935813181102276, -0.03210272639989853, -0.07672590017318726, 0.026530100032687187, -0.044381577521562576, 0.0029859275091439486, 0.026258917525410652, 0.0032994879875332117, -0.025986939668655396, 0.016921335831284523, 0.03648490458726883, -0.03514532372355461, 0.02113451436161995, -0.00826851837337017, 0.05888151377439499, -0.002824242692440748, 0.009973306208848953, -0.024122172966599464, 0.040247805416584015, 0.08143558353185654, 0.013290150091052055, -0.04470363259315491, -0.0681045725941658, 0.04588877037167549, -0.05217970907688141, 0.05081304535269737, -0.03898910805583, -0.005362378433346748, -0.04014900326728821, -0.04268553480505943, -0.03846399113535881, -0.026501912623643875, 0.06450329720973969, -0.040914107114076614, 0.09261488169431686, -0.001260683173313737, 0.14326469600200653, -0.033887624740600586, 0.056851476430892944, 0.0006508550723083317, 0.010324835777282715, 0.02485589310526848, -0.040627140551805496, 0.033851128071546555, 0.00652420474216342, 0.06347602605819702, -0.037844445556402206, 0.00793450977653265, -0.13903465867042542, 0.08649330586194992, -0.0080028111115098, -0.027688628062605858, 0.02204364910721779, -0.01611912250518799, -0.050296079367399216, -0.09466250985860825, -0.09982332587242126, 0.09621845185756683, -0.06910941004753113, 0.06874821335077286, -0.016383782029151917, -0.09700673073530197, -0.035111792385578156, 0.018424740061163902, -0.004358239937573671, -0.004172165412455797, -0.04731613025069237, -0.018004849553108215, -0.07762204110622406, -0.035597771406173706, 0.05961236730217934, 0.006653027143329382, -0.07979357242584229, -5.941142038281742e-33, -0.016401229426264763, 0.08602350205183029, 0.03463170677423477, 0.09469268471002579, 0.005001208744943142, -0.02842639572918415, 0.03581598773598671, -0.06072411686182022, -0.0096000200137496, -0.011563547886908054, 0.030989956110715866, -0.06773188710212708, -0.03477958217263222, -0.04425181448459625, 0.10537748038768768, -0.08475439995527267, -0.05132555216550827, -0.012874189764261246, -0.031626760959625244, -0.006033707410097122, -0.07834287732839584, 0.11952684074640274, -0.07974214106798172, 0.005000930279493332, -0.10161302238702774, 0.03941340744495392, -0.014429877512156963, 0.004631336312741041, 0.002679571509361267, -0.03751339390873909, -0.01840452291071415, -0.03262089937925339, -0.07745321094989777, 0.0348036028444767, -0.004021853674203157, 0.10745564103126526, 0.07142692804336548, -0.048702601343393326, -0.05932697653770447, -0.03225279971957207, 0.11347411572933197, 0.04705103114247322, -0.04256836324930191, 0.05484773591160774, -0.09161259233951569, 0.016619831323623657, -0.0007949959835968912, 0.009475058875977993, 0.003895516972988844, 0.02860262244939804, 0.06964123994112015, 0.008365033194422722, -0.0693981796503067, 0.00559279415756464, 0.009113394655287266, -0.007771587930619717, 0.04051640257239342, 0.023701848462224007, 0.023836955428123474, -0.005886877421289682, -0.04204601049423218, -0.12624405324459076, -0.013822278939187527, 0.0033649434335529804, -0.03668797016143799, 0.01056759338825941, -0.09490976482629776, 0.09230632334947586, 0.06968706101179123, 0.06627023965120316, -0.008190791122615337, 0.07057251781225204, 0.0904276892542839, 0.04363478347659111, -0.02792523428797722, -0.004994474351406097, -0.03265661746263504, -0.011533419601619244, 0.06236917898058891, 0.011899945326149464, -0.04211035743355751, -0.06680864095687866, 0.025840342044830322, 0.04887177050113678, 0.06474028527736664, 0.04626910015940666, 0.038968563079833984, 0.021671662107110023, 0.049180950969457626, -0.05243757367134094, -0.010506472550332546, -0.004358751233667135, 0.03706016391515732, 0.05188654735684395, 0.04121730476617813, -4.5411876925527395e-08, -0.01826680637896061, 0.011735019274055958, 0.05857726186513901, 0.02692856267094612, -0.005191607866436243, -0.031055308878421783, 0.07673843950033188, 0.02743760123848915, 0.015299351885914803, 0.030855491757392883, 0.04099692404270172, -0.03962169960141182, 0.002130707958713174, -0.03055315464735031, 0.010493900626897812, 0.20594128966331482, 0.050687406212091446, 0.023149272426962852, 0.09367203712463379, -0.06147647649049759, -0.015268499031662941, 0.0026520274113863707, 0.00616284366697073, 0.03395652770996094, -0.034565653651952744, -0.03194701671600342, -0.03049851953983307, 0.03297358378767967, -0.09340832382440567, 0.026584289968013763, 0.007271369453519583, -0.08027217537164688, 0.07553349435329437, 0.0025997417978942394, 0.09636532515287399, 0.03667283058166504, -0.04406236112117767, 0.03818827122449875, 0.03948964178562164, -0.0012604002840816975, -0.038544557988643646, 0.019113829359412193, 0.0017069231253117323, -0.028127795085310936, 0.005901877302676439, 0.01458288449794054, 0.006788695231080055, -0.04818155989050865, -0.0414007268846035, 0.07899817079305649, 0.008409091271460056, 0.03410577401518822, -0.0018946947529911995, 0.031900543719530106, 0.03155652433633804, -0.02013429068028927, -0.011868651024997234, -0.030560864135622978, -0.04397887364029884, 0.03667905554175377, 0.017162708565592766, 0.04042736813426018, -0.03977813571691513, -0.07600507140159607 ] }, { "text": "In Deep Dream:\n\n• Input image → Network → Layer activations\n•\n\n• We adjust the input image pixels to amplify those activations\n•\n\nThe key insight: we compute gradients with respect to the input image, not the weights. Then we add those gradients to the image to make the detected patterns stronger.\n\n3. Load the Pre-trained Model¶\n\nWe'll use InceptionV3 and create a wrapper that lets us extract activations from any layer.\n\nIn [3]:\n\nclass DeepDreamModel(nn.Module):\n\"\"\"\nWrapper around InceptionV3 that captures intermediate layer activations.\n\"\"\"\ndef __init__(self):\nsuper().__init__()\n# Load pre-trained InceptionV3\nself.inception = models.inception_v3(weights=models.Inception_V3_Weights.DEFAULT)\nself.inception.eval()", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_12", "embedding": [ -0.05197366699576378, -0.05496884137392044, 0.07140003144741058, 0.035606883466243744, 0.01795360818505287, 0.015714256092905998, -0.028712181374430656, -0.09359566867351532, -0.037102844566106796, -0.11445222795009613, -0.05333823710680008, -0.05335986241698265, -0.010401218198239803, -0.019748196005821228, -0.005054888315498829, 0.026302285492420197, 0.051050469279289246, 0.13349267840385437, -0.11290640383958817, -0.02264946512877941, 0.08250993490219116, -0.0012961664469912648, 0.010485932230949402, -0.0007954538450576365, 0.011473198421299458, 0.02454221434891224, 0.009798431769013405, 0.003571597393602133, 0.08134523779153824, -0.058640994131565094, 0.07320719212293625, -0.023992007598280907, 0.02438396029174328, 0.08327281475067139, -0.045958228409290314, 0.036322928965091705, -0.08914808928966522, -0.017232146114110947, -0.004404792562127113, -0.050953738391399384, 0.023239916190505028, -0.028490427881479263, -0.012016474269330502, -0.032339878380298615, 0.03566281870007515, 0.020443718880414963, 0.037414174526929855, 0.0065374188125133514, 0.027790701016783714, -0.03817320615053177, -0.011084630154073238, -0.040178101509809494, 0.010856110602617264, 0.0874713808298111, 0.050468288362026215, 0.018530867993831635, 0.09997998923063278, -0.02428603731095791, -0.034532807767391205, -0.035031791776418686, 0.004589758347719908, 0.005707975476980209, -0.012749222107231617, -0.045148007571697235, 0.03240830823779106, 0.015475903637707233, -0.03437674418091774, 0.00849257130175829, 0.10663720965385437, -0.002172848442569375, 0.019651908427476883, 0.0834297314286232, -0.019139377400279045, -0.037975091487169266, 0.09066709131002426, 0.023139871656894684, 0.019453110173344612, 0.012808536179363728, 0.01499931886792183, -0.09862811863422394, 0.04346117377281189, -0.03168303892016411, 0.06630238145589828, 0.014805737882852554, 0.06915676593780518, -0.01949198916554451, -0.04415294900536537, -0.03286680206656456, -0.005784803535789251, -0.010992915369570255, 0.013406944461166859, -0.06733246147632599, -0.12560643255710602, 0.0018750240560621023, 0.08253225684165955, 0.01727188378572464, -0.034997209906578064, -0.11509878933429718, -0.04992489889264107, 0.012741982005536556, 0.0013263656292110682, -0.08199215680360794, -0.06845200806856155, 0.003978705499321222, 0.08123599737882614, 0.06428010761737823, 0.04565839841961861, 0.004911980126053095, -0.008855399675667286, -0.007146948948502541, -0.009744355455040932, -0.02137596346437931, 0.03952110558748245, 0.002707590814679861, 0.004331209696829319, 0.022160256281495094, 0.041749630123376846, 0.07763498276472092, -0.03636873885989189, 0.05032755434513092, -0.04716896638274193, 0.017234403640031815, 0.010044514201581478, -0.06150834262371063, -0.03827677294611931, 0.010089428164064884, -0.10574805736541748, 3.911155864591779e-33, 0.01773478463292122, -0.026291990652680397, -0.013047953136265278, 0.009364469908177853, 0.06877875328063965, 0.010384620167315006, 0.012122475542128086, -0.039755526930093765, -0.03009972907602787, 0.0004706112667918205, -0.08263522386550903, 0.02685198001563549, -0.0668501928448677, 0.12749843299388885, 0.0324447825551033, -0.004515416454523802, -0.06858973205089569, -0.07453401386737823, 0.03492836654186249, 0.042445484548807144, -0.006917144637554884, -0.03758544847369194, -0.058222342282533646, -0.040762435644865036, -0.07814966142177582, 0.033467378467321396, 0.022905046120285988, 0.051068246364593506, -0.05409225448966026, 0.010936280712485313, -0.003990585450083017, -0.031856488436460495, 0.0009604300139471889, -0.028655515983700752, 0.013616369105875492, 0.06687500327825546, 0.08463390171527863, 0.03511573001742363, -0.021364841610193253, -0.07859797775745392, 0.010332941077649593, 0.053844522684812546, -0.03826294094324112, -0.02602398209273815, -0.050347600132226944, 0.02167339436709881, -0.032097987830638885, 0.049881529062986374, 0.025127165019512177, -0.007561106234788895, 0.08651430159807205, -0.050309449434280396, -0.020584313198924065, -0.14361239969730377, -0.02415059693157673, 0.00043495267163962126, 0.04843420535326004, 0.05453896149992943, 0.1518705189228058, 0.01063411682844162, 0.0035721207968890667, -0.028989054262638092, 0.02984076365828514, 0.09701303392648697, -0.007406281773000956, -0.010822854936122894, -0.0573030523955822, 0.0408589132130146, -0.06390559673309326, 0.008994750678539276, -0.035726308822631836, 0.05451792851090431, -0.0231819748878479, -0.06528647989034653, 0.002445062156766653, 0.01146721187978983, -0.052195824682712555, -0.039479389786720276, -0.03976646065711975, 0.05495426803827286, 0.03133236616849899, 0.1223086342215538, 0.017643988132476807, -0.04755109176039696, -0.04377773031592369, 0.13519637286663055, 0.005444124806672335, -0.08339686691761017, -0.021337337791919708, 0.024327155202627182, -0.018433408811688423, -0.05608464404940605, -0.01801292970776558, -0.04745295271277428, -0.07051534950733185, -4.540185666919832e-33, 0.059543587267398834, 0.13164517283439636, -0.0028381505981087685, 0.03684789314866066, 0.03476960211992264, -0.031336914747953415, 0.02804594859480858, 0.04324044659733772, -0.06423152983188629, 0.02930169552564621, 0.06243784725666046, -0.030564794316887856, 0.00621108990162611, -0.014594837091863155, 0.07357510179281235, -0.13652583956718445, -0.06922704726457596, -0.002815275453031063, 0.04494548961520195, 0.03097786381840706, 0.002937927143648267, 0.03934169188141823, -0.14659853279590607, 0.017648573964834213, -0.12735357880592346, -0.017314886674284935, -0.06031004339456558, 0.15522722899913788, 0.014672588557004929, 0.025776268914341927, -0.05433720722794533, 0.0395362414419651, -0.05328596383333206, 0.011656994000077248, -0.006506652571260929, 0.07919133454561234, 0.030364030972123146, -0.014903230592608452, -0.01346439216285944, 0.004829323850572109, 0.02930677868425846, -0.007121719419956207, -0.08309269696474075, -0.02511385641992092, -0.012448515743017197, -0.04249735176563263, -0.020224330946803093, -0.0009920191951096058, 0.014992596581578255, 0.01996314339339733, 0.05100134760141373, -0.014155313372612, -0.08149421215057373, 0.07166889309883118, -0.04752274975180626, 0.011714096181094646, 0.00697752321138978, 0.046967558562755585, 0.08917582035064697, 0.0692737028002739, -0.04808486998081207, -0.022321101278066635, -0.05798877775669098, -0.04289870336651802, -0.03307350352406502, 0.061612457036972046, -0.05155831575393677, 0.039697811007499695, 0.02070900797843933, 0.015606566332280636, 9.857263648882508e-05, 0.015800291672348976, 0.08496928960084915, 0.060822270810604095, -0.020545199513435364, -0.07405202835798264, -0.09018905460834503, -0.001402498921379447, 0.047033414244651794, -0.035671114921569824, -0.03192754089832306, -0.09644919633865356, -0.029495354741811752, 0.0845126062631607, 0.05188444256782532, 0.06935910880565643, 0.006472571287304163, 0.05664544552564621, 0.005021409597247839, -0.017320208251476288, -0.036421723663806915, 0.005574102979153395, -0.04293579235672951, 0.003574737347662449, 0.01150234043598175, -5.476703179851938e-08, -0.05547712743282318, -0.000857088656630367, 0.10206224769353867, 0.0077521782368421555, 0.015112333931028843, -0.02037104405462742, 0.04067546874284744, 0.08105319738388062, 0.024264061823487282, -0.03460700809955597, 0.0019556849729269743, 0.005565496161580086, -0.06998045742511749, -0.03319719061255455, 0.0006542156916111708, 0.08495058864355087, 0.031397055834531784, 0.04412885010242462, -0.013838185928761959, -0.04835912212729454, 0.0013841070467606187, 0.06044428423047066, 0.03125916048884392, -0.001507895183749497, 0.0719766840338707, -0.05601481348276138, -0.013281432911753654, 0.025977637618780136, -0.040499910712242126, 0.012667386792600155, 0.012490219436585903, -0.030767085030674934, 0.033889446407556534, -0.055514946579933167, -0.02403024025261402, 0.13998273015022278, -0.09275709092617035, -0.007242122199386358, 0.011961360462009907, -0.0177324041724205, -0.020205294713377953, -0.037298716604709625, 0.012213783338665962, -0.08597497642040253, -0.026745915412902832, -0.0026379195041954517, -0.005940032657235861, -0.0840449333190918, -0.003190475283190608, 0.0685703307390213, 0.026582490652799606, -0.014624889008700848, -0.004843654111027718, 0.08242882043123245, -0.028749121353030205, -0.10179965198040009, -0.015602713450789452, -0.03594021126627922, -0.011464285664260387, 0.07380390167236328, 0.028834160417318344, -0.009212454780936241, 0.02689087763428688, -0.03458079323172569 ] }, { "text": "# Freeze all parameters\nfor param in self.inception.parameters():\nparam.requires_grad = False\n\n# Dictionary to store layer outputs\nself.layer_outputs = {}\nself.hooks = []\n\n# Register hooks on the actual module structure\nself._register_hooks()\n\ndef _register_hooks(self):\n\"\"\"Register forward hooks on layers we want to visualize.\"\"\"", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_13", "embedding": [ 0.011073799803853035, -0.046477530151605606, -0.07761476933956146, 0.039378076791763306, -0.053467459976673126, 0.0256543830037117, 0.005804918706417084, 0.014095458202064037, -0.09163395315408707, -0.10571353882551193, -0.049000561237335205, -0.10810498893260956, -0.03999059647321701, -0.021423839032649994, -0.03228296712040901, 0.0704050287604332, 0.005773970857262611, 0.005536142736673355, 0.02972550317645073, -0.05985943600535393, 0.006143407896161079, 0.08182404190301895, 0.03906142711639404, 0.05158419907093048, -0.04918378219008446, -0.02641684003174305, 0.04584462568163872, 0.02090153656899929, 0.09608811140060425, -0.0001921505609061569, 0.05148448050022125, -0.013468489050865173, -0.09704017639160156, 0.07426057755947113, 0.04970362409949303, 0.06520643830299377, -0.03708278387784958, -0.042534951120615005, -0.07550681382417679, -0.09702831506729126, 0.08716776967048645, 0.04540705308318138, -0.08810490369796753, -0.08096160739660263, 0.009059119038283825, 0.0777878537774086, 0.004137239884585142, 0.08267790824174881, -0.014413171447813511, -0.019973210990428925, 0.06138550117611885, -0.004319306463003159, -0.0772848129272461, 0.017513444647192955, 0.011053914204239845, -0.006275971420109272, 0.03703906387090683, -0.02742863819003105, -0.06312214583158493, -0.009402823634445667, -0.04679960012435913, -0.00830467976629734, 0.027004515752196312, -0.009959245100617409, 0.001434454694390297, 0.06496597826480865, 0.00799818616360426, 0.07417525351047516, 0.08801675587892532, 0.03894536942243576, -0.01722141169011593, -0.009679562412202358, -0.011974038556218147, -0.0348556786775589, 0.060240842401981354, -0.024067267775535583, 0.03916334733366966, -0.0013959163334220648, -0.08569084107875824, -0.12299767136573792, 0.03447093442082405, 0.014787815511226654, 0.043914616107940674, 0.06414032727479935, -0.007742493879050016, -0.010838937014341354, -0.06801028549671173, -0.023940550163388252, 0.02503623627126217, -0.0027750981971621513, -0.003960646688938141, -0.0944284051656723, -0.06411603838205338, -0.037987254559993744, 0.017659123986959457, 0.031356122344732285, -0.015799514949321747, -0.06028345227241516, -0.08403962850570679, 0.01412452757358551, 0.006379981525242329, -0.0737992599606514, 0.03840642049908638, 0.05163218080997467, 0.10231119394302368, 0.039161670953035355, 0.06993203610181808, -0.03187455236911774, -0.030225856229662895, -0.03597848489880562, -0.02105853706598282, 0.023874962702393532, 0.06015963852405548, -0.03274037688970566, 0.10179944336414337, 0.006170376669615507, 0.011472336016595364, 0.04526278376579285, 0.05025407299399376, -0.012828939594328403, 0.0033829312305897474, 0.07635758072137833, -0.01889057084918022, -0.016012253239750862, -0.015163409523665905, -0.08845207095146179, -0.0344843789935112, 1.7826089436069304e-34, 0.06167713552713394, -0.014639437198638916, 0.006779841613024473, 0.06638458371162415, -0.008047566749155521, 0.07387493550777435, 0.10043282061815262, -0.01480164285749197, -0.03025551326572895, 0.059500306844711304, -0.10260491073131561, -0.030109094455838203, -0.013856694102287292, 0.0792817622423172, 0.012967202812433243, 0.01590237021446228, 0.00044110024464316666, 0.015165452845394611, 0.011545754969120026, 0.04935787618160248, 0.017796482890844345, -0.034961920231580734, -0.04443983733654022, -0.00702850753441453, -0.038504064083099365, 0.053693246096372604, -0.03699035942554474, 0.023749731481075287, -0.09774011373519897, -0.016199897974729538, -0.04706517979502678, 0.03834432363510132, 0.037148237228393555, -0.057540588080883026, -0.008667491376399994, -0.032592788338661194, 0.053519394248723984, 0.06321215629577637, -0.04155460745096207, -0.061303336173295975, -0.05596289783716202, 0.03299513831734657, -0.022725369781255722, 0.04353170096874237, -0.06695541739463806, -0.07288124412298203, -0.056049056351184845, 0.09314495325088501, 0.025114741176366806, -0.002215662505477667, 0.04315480217337608, -0.016983991488814354, 0.03592752292752266, -0.1347612738609314, -0.00545848160982132, -0.03289477899670601, 0.022489523515105247, 0.03062973916530609, 0.05649818107485771, -0.035782188177108765, 0.043642912060022354, -0.014216439798474312, -0.09311702847480774, 0.05745043605566025, -0.004509100690484047, 0.08628594130277634, 0.026551060378551483, 0.027540428563952446, 0.005997834261506796, 0.014735846780240536, -0.11624512076377869, 0.03625881299376488, -0.1345982849597931, -0.0570649653673172, 0.03328865021467209, 0.004830347374081612, -0.03902794420719147, -0.07167866826057434, -0.014530180022120476, 0.03642208129167557, 0.09516694396734238, -0.00645858608186245, -0.06138748303055763, -0.022675752639770508, -0.01019927766174078, -0.033042289316654205, 0.03566718101501465, -0.01493190135806799, 0.017041241750121117, 0.03842376545071602, -0.038778841495513916, 0.011742665432393551, 0.012372847646474838, -0.0296800434589386, -0.05671560764312744, -2.9128292672605418e-33, 0.08873976022005081, 0.04871678352355957, -0.06897653639316559, 0.04094017669558525, 0.006075012031942606, 0.0049320487305521965, -0.008769876323640347, 0.08304228633642197, -0.02393423765897751, 0.003011126769706607, -0.03075689636170864, -0.02738010510802269, 0.06193739175796509, 0.04110768809914589, 0.08889073878526688, 0.00012895277177449316, -0.16907848417758942, 0.006618185434490442, 0.045028503984212875, -0.0820838212966919, -0.1283838003873825, 0.041495431214571, -0.08126337826251984, -0.04217572510242462, -0.1500086486339569, 0.002468657214194536, -0.037685319781303406, 0.07570283114910126, 0.1268477737903595, 0.007501465268433094, -0.024752220138907433, 0.005396166816353798, -0.027053622528910637, 0.04987563565373421, 0.01858675107359886, 0.05771760642528534, 0.04915798082947731, -0.02879675291478634, -0.023453300818800926, -0.05468621850013733, 0.04133567214012146, 0.05664905160665512, -0.06972744315862656, -0.004333027172833681, 0.03106260485947132, -0.020835287868976593, -0.019582314416766167, -0.014935467392206192, -0.04101485386490822, -0.028744257986545563, -0.015103671699762344, 0.012365163303911686, -0.051821645349264145, -0.024633169174194336, -0.07713127136230469, -0.009429927915334702, -0.026818880811333656, -0.03808065876364708, 0.1457808017730713, -0.013282714411616325, -0.03715818375349045, -0.10473636537790298, -0.007669537793844938, -0.07847946137189865, -0.016404954716563225, -0.04451843351125717, 0.0004745176702272147, -0.016437236219644547, -0.014674196019768715, 0.0014055243227630854, 0.07306092232465744, -0.023130672052502632, 0.029219472780823708, -0.010523160919547081, -0.041702255606651306, 0.0029417010955512524, -0.05836157500743866, -0.017316998913884163, 0.04920590668916702, -0.025653738528490067, 0.028679369017481804, -0.05735611170530319, 0.013416428118944168, 0.07060257345438004, 0.033510152250528336, 0.007601600140333176, 0.0550757497549057, 0.11620817333459854, -0.04323234036564827, -0.005719107575714588, 0.08132589608430862, 0.004118042532354593, -0.0009056096314452589, 0.062261685729026794, 0.004437328781932592, -4.25736601528115e-08, -0.030914030969142914, 0.07090606540441513, 0.009026847779750824, 0.06265518814325333, -0.03103315830230713, 0.057556603103876114, 0.11875872313976288, 0.0805264562368393, 0.004669992718845606, -0.031474750488996506, -0.039542533457279205, -0.005411077290773392, -0.037595730274915695, 0.0495879240334034, -0.02912905439734459, 0.08462239801883698, -0.05695224925875664, 0.05407008156180382, -0.0035593535285443068, -0.024976929649710655, -0.03094155713915825, 0.0019910349510610104, -0.06520713865756989, -0.03784870356321335, -0.041624609380960464, -0.01808442361652851, 0.07863306999206543, 0.05720718577504158, -0.03149336576461792, 0.014242148026823997, 0.013338087126612663, -0.05007009953260422, 0.027119366452097893, 0.0061781881377100945, -0.03433220833539963, 0.07830750942230225, -0.0657031312584877, 0.00651731388643384, 0.03315017744898796, 0.027305008843541145, -0.06968394666910172, 0.020931877195835114, -0.03399640694260597, -0.0494091771543026, -0.019787348806858063, -0.0038315001875162125, 0.02634342387318611, -0.030037378892302513, -0.03854845464229584, 0.11940054595470428, -0.012615310028195381, -0.03517011180520058, 0.023211132735013962, 0.03771359100937843, -0.021090520545840263, -0.0636509358882904, -0.0004539943183772266, -0.020412731915712357, 0.005498166661709547, 0.030153395608067513, -0.025964325293898582, 0.028433825820684433, 0.011264882981777191, 0.0015300181694328785 ] }, { "text": "def _register_hooks(self):\n\"\"\"Register forward hooks on layers we want to visualize.\"\"\"\n\n# Get actual layer references from the model\ntarget_layers = {\n'Conv2d_1a': self.inception.Conv2d_1a_3x3,\n'Conv2d_2b': self.inception.Conv2d_2b_3x3,\n'Mixed_5b': self.inception.Mixed_5b,\n'Mixed_5c': self.inception.Mixed_5c,\n'Mixed_5d': self.inception.Mixed_5d,\n'Mixed_6a': self.inception.Mixed_6a,\n'Mixed_6b': self.inception.Mixed_6b,\n'Mixed_6c': self.inception.Mixed_6c,\n'Mixed_6d': self.inception.Mixed_6d,\n'Mixed_6e': self.inception.Mixed_6e,\n'Mixed_7a': self.inception.Mixed_7a,\n'Mixed_7b': self.inception.Mixed_7b,\n'Mixed_7c': self.inception.Mixed_7c,\n}\n\nfor name, layer in target_layers.items():\nhook = layer.register_forward_hook(self._make_hook(name))\nself.hooks.append(hook)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_14", "embedding": [ 0.007232153322547674, -0.061582084745168686, -0.014038109220564365, 0.027709269896149635, 0.024129172787070274, -0.019074536859989166, 0.027870753780007362, 0.008810017257928848, -0.03190070390701294, -0.12025534361600876, -0.008898751810193062, -0.15094058215618134, -0.06392495334148407, -0.027917856350541115, -0.024804173037409782, 0.07846137881278992, 0.007680631708353758, 0.04368186742067337, 0.015378354117274284, -0.03614059463143349, -0.006988122593611479, 0.09802430123090744, 0.0512319877743721, 0.03362360969185829, -0.005935224238783121, -0.030224468559026718, 0.007305694278329611, 0.03004455752670765, 0.1321004033088684, -0.04066210612654686, 0.030049312859773636, 0.0668804943561554, -0.08286058157682419, 0.04869868606328964, 0.0009928836952894926, 0.05468535050749779, 0.0017934683710336685, -0.0368562713265419, -0.04231426119804382, -0.008221416734158993, 0.10087288916110992, 0.054182395339012146, -0.024728015065193176, -0.08152227103710175, 0.013490734621882439, 0.08689963072538376, -0.029938019812107086, 0.05103015527129173, -0.017513880506157875, -0.023594453930854797, 0.030006086453795433, -0.040880169719457626, -0.07750584930181503, 0.011229259893298149, -0.02051941119134426, -0.01695374771952629, 0.0706254169344902, -0.07366079837083817, -0.035102471709251404, 0.03327510878443718, -0.017921365797519684, -0.011512983590364456, -0.01734171435236931, -0.019991734996438026, 0.004975699353963137, 0.036787379533052444, -0.05459185317158699, 0.06270567327737808, 0.062253959476947784, 0.02232656069099903, -0.03266940265893936, -0.0008179765427485108, -0.0013600774109363556, -0.0483689159154892, 0.07130660116672516, 0.017981288954615593, 0.05300579220056534, 0.01313459686934948, -0.046440381556749344, -0.1616940200328827, -0.05387388914823532, -0.02073102816939354, 0.06079770252108574, 0.025480180978775024, 0.04063771292567253, -0.028972215950489044, -0.07980918139219284, -0.03854614496231079, -0.01643776148557663, 0.01230937335640192, -0.06472036242485046, -0.009048586711287498, -0.04015946388244629, -0.01159978099167347, 0.08291059732437134, 0.07048987597227097, 0.007543619722127914, -0.00971642229706049, -0.02862982451915741, 0.05365786701440811, -0.0245206356048584, -0.011499996297061443, 0.036360327154397964, 0.0505976676940918, 0.07823263108730316, 0.03960241749882698, 0.04025579243898392, -0.04502477869391441, -0.03718530386686325, -0.10205381363630295, -0.05252925306558609, -0.017566336318850517, 0.0874500423669815, -0.02510339766740799, 0.12532921135425568, 0.007660726550966501, 0.002324008848518133, 0.006704103201627731, 0.07547511905431747, 0.009117387235164642, 0.027706649154424667, 0.04076152294874191, 0.05723683163523674, -0.013322469778358936, -0.02694801613688469, -0.07552100718021393, -0.051739439368247986, 1.5109580536447799e-34, 0.06651312112808228, -0.037248771637678146, 0.023278746753931046, 0.07435540854930878, 0.0428890660405159, 0.0654175728559494, 0.03146151080727577, -0.06714773178100586, -0.048873171210289, 0.08045370131731033, -0.0788910835981369, -0.03284987062215805, -0.030502066016197205, 0.07519973069429398, 0.018397821113467216, -0.034639623016119, -0.05435168370604515, 0.02809867449104786, -0.04619918763637543, 0.0693618580698967, -0.0010697455145418644, 0.02137007936835289, -0.07879132032394409, -0.007738574407994747, -0.03356233984231949, 0.08675971627235413, -0.0857003778219223, 0.05488639324903488, -0.07024069875478745, -0.010651336051523685, -0.05306154489517212, 0.04443971440196037, 0.04379917308688164, -0.058047741651535034, 0.024686623364686966, -0.014185205101966858, 0.0616503544151783, 0.019037917256355286, -0.06119835004210472, -0.06498230248689651, 0.00032212550286203623, 0.011050730012357235, -0.04616769403219223, -0.005290730856359005, -0.08737961947917938, -0.06571301072835922, -0.10768549144268036, 0.08576645702123642, -0.015867754817008972, 0.02445213310420513, 0.09043728560209274, -0.008332323282957077, 0.030380403622984886, -0.0868215262889862, -0.06200966611504555, -0.033895451575517654, -0.012398770079016685, 0.08190957456827164, 0.048546768724918365, 0.03546469286084175, 0.04326379671692848, 0.0489632673561573, -0.11989874392747879, 0.07160157710313797, 0.0071260081604123116, 0.10267776250839233, 0.041780468076467514, -0.004928017500787973, 0.04328857734799385, 0.004586302675306797, -0.11125406622886658, 0.06488315016031265, -0.08414037525653839, -0.04260772466659546, 0.046289797872304916, -0.08981295675039291, -0.08290130645036697, -0.0774213895201683, -0.034086085855960846, 0.01978708989918232, 0.03555743023753166, 0.07280618697404861, -0.09265479445457458, -0.05430055409669876, -0.09482624381780624, -0.02795739285647869, 0.029850590974092484, -0.0774429515004158, -0.05656037852168083, 0.04069822281599045, -0.03688442334532738, -0.024163633584976196, 0.04836170747876167, -0.04471781104803085, -0.0197395421564579, -2.9342243664714613e-33, 0.06884858757257462, 0.05175982788205147, -0.0024296119809150696, 0.047745201736688614, 0.026518866419792175, -0.0461207814514637, 0.05165085941553116, 0.04102344438433647, 0.020009895786643028, 0.02144395373761654, 0.02881740964949131, -0.05278852581977844, 0.06831089407205582, 0.017101716250181198, 0.1243278905749321, -0.04525810480117798, -0.09428925067186356, 0.014393465593457222, 0.05302441492676735, -0.0442495122551918, -0.02536274865269661, 0.03961126133799553, -0.08471696078777313, 0.00044746906496584415, -0.1114504262804985, 0.011700155213475227, -0.031992778182029724, 0.07133789360523224, 0.06787027418613434, -0.07474856823682785, -0.056348543614149094, 0.022456899285316467, -0.030646855011582375, 0.08157575130462646, -0.019647283479571342, 0.025271816179156303, -0.0019398152362555265, -0.004182127304375172, -0.02199247106909752, -0.07130277901887894, 0.07427053153514862, 0.026525339111685753, -0.11727001518011093, 0.016732722520828247, 0.0027257234323769808, 0.024190371856093407, -0.0015544118359684944, 0.02359224669635296, -0.047234125435352325, -0.04480128362774849, -0.0406668446958065, -0.006897142622619867, -0.06589461117982864, 0.02599526010453701, -0.07883778214454651, -0.0045359255746006966, 0.03185899555683136, -0.054705094546079636, 0.1191864013671875, 0.029059892520308495, -0.03130978345870972, -0.08408428728580475, -0.02400149218738079, -0.023752344772219658, 0.027089698240160942, -0.03554169088602066, -0.041381511837244034, -0.02153516747057438, 0.011079860851168633, -0.026545777916908264, 0.07610800117254257, 0.0050539132207632065, 0.02490205131471157, -0.04416514188051224, 0.0074561540968716145, -0.011051921173930168, -0.07113391160964966, 0.009130713529884815, 0.01343514584004879, -0.03169221431016922, -0.07800918072462082, -0.10231342911720276, 0.05291189253330231, 0.09005051851272583, 0.041722945868968964, 0.020951732993125916, 0.03413733094930649, 0.10544056445360184, -0.0418362095952034, -0.04359296336770058, 0.008246689103543758, 0.010991044342517853, 0.0046553476713597775, 0.03877687454223633, -0.024764221161603928, -6.033424426732381e-08, -0.05049953609704971, 0.016066022217273712, 0.01918412186205387, 0.03374283388257027, -0.003496581921353936, 0.0757640078663826, 0.04008786380290985, 0.08029565960168839, -0.04693826287984848, -0.019121788442134857, -0.014869453385472298, 0.019292691722512245, -0.02590186335146427, 0.007282791193574667, -0.02339332178235054, 0.050793908536434174, -0.06991295516490936, 0.036510057747364044, 0.0014185737818479538, -0.011728386394679546, -0.04639766737818718, 0.023397646844387054, -0.007638473995029926, -0.007639696821570396, -0.06555421650409698, -0.03875494375824928, 9.657959890319034e-05, 0.08829975873231888, 0.03957800194621086, 0.0224441085010767, 0.07933257520198822, -0.005933256819844246, 0.016066180542111397, 0.00091869558673352, -0.02394917607307434, 0.05323752015829086, -0.05071529000997543, 0.010406453162431717, 0.026031048968434334, 0.03828538954257965, -0.03482635319232941, 0.018873652443289757, -0.053868185728788376, -0.04893593490123749, 0.028002291917800903, 0.026072870939970016, -0.0014996161917224526, -0.061966102570295334, 0.03438761830329895, 0.04573288932442665, -0.030704600736498833, -0.014619444496929646, 0.011999906040728092, 0.05503232404589653, -0.03452255576848984, -0.06487114727497101, 0.019655924290418625, 0.014982485212385654, -0.015319254249334335, 0.06279134005308151, -0.04496467858552933, 0.0418904647231102, 0.017502034083008766, 0.003770119044929743 ] }, { "text": "for name, layer in target_layers.items():\nhook = layer.register_forward_hook(self._make_hook(name))\nself.hooks.append(hook)\n\n# Store the layer names so we can report them\nself._layer_names = list(target_layers.keys())\n\ndef _make_hook(self, name):\n\"\"\"Create a hook function that saves the layer output.\"\"\"\ndef hook(module, input, output):\nself.layer_outputs[name] = output\nreturn hook\n\ndef forward(self, x):\n\"\"\"Forward pass - this populates self.layer_outputs.\"\"\"\nself.layer_outputs = {}\n_ = self.inception(x)\nreturn self.layer_outputs\n\ndef get_available_layers(self):\n\"\"\"Return list of layers we can dream on.\"\"\"\nreturn self._layer_names\n\n# Initialize the model\nmodel = DeepDreamModel().to(device)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_15", "embedding": [ 0.00556729594245553, -0.05371350795030594, -0.018052034080028534, 0.061910420656204224, 0.016097087413072586, 0.023668738082051277, -0.02474641054868698, 0.02684684284031391, -0.03254521265625954, -0.0752827525138855, 0.012849971652030945, -0.079991914331913, 0.022472165524959564, -0.04913937672972679, -0.03818010166287422, 0.007903927005827427, 0.06127876043319702, 0.09265903383493423, 0.0062201195396482944, -0.07405394315719604, 0.04265299066901207, 0.09220188856124878, 0.060436103492975235, 0.05611065402626991, -0.037250470370054245, -0.06891936808824539, 0.004986705258488655, 0.007494927383959293, -0.0039900788106024265, -0.010824378579854965, 0.03389104828238487, -0.03546092286705971, -0.06462836265563965, 0.08564446866512299, -0.007684195879846811, 0.021056650206446648, -0.05647026002407074, -0.05880603566765785, -0.06830183416604996, -0.09192358702421188, 0.07594185322523117, -0.04130276292562485, -0.031510528177022934, -0.08079617470502853, -0.04846496507525444, 0.027730144560337067, -0.011137842200696468, 0.0054045068100094795, 0.006318649277091026, -0.013529195450246334, 0.040630508214235306, 0.015757791697978973, -0.05326630175113678, 0.027264682576060295, -0.023636508733034134, 0.007272606715559959, 0.06415034085512161, -0.05569269880652428, -0.1000276431441307, 0.014171892777085304, -0.02929592691361904, -0.0065477085299789906, -0.03051755018532276, -0.049990296363830566, -0.044243279844522476, 0.0532609187066555, -0.04568997398018837, 0.10292000323534012, 0.07756863534450531, -0.0011446969583630562, -0.001141747459769249, 0.06098712608218193, -0.010588983073830605, -0.06128336489200592, 0.09181909263134003, -0.03553855046629906, 0.0736410990357399, 0.05364951863884926, -0.11305871605873108, -0.12969990074634552, 0.005993712227791548, 0.0012510616797953844, -0.01536048948764801, 0.02473646029829979, 0.014168130233883858, -0.016284635290503502, -0.0320122167468071, 0.042976006865501404, -0.0015644558006897569, -0.04928005486726761, -0.10514713078737259, -0.08294907212257385, -0.03192538022994995, -0.01229580957442522, 0.05331279709935188, 0.016204584389925003, 0.014006334356963634, -0.030282989144325256, -0.018651703372597694, -0.010388854891061783, -0.012299568392336369, -0.03759069740772247, 0.006672795861959457, -0.017047686502337456, 0.07929140329360962, 0.044726528227329254, 0.02321283519268036, -0.017473382875323296, -0.0203624926507473, -0.10190678387880325, -0.006434611510485411, 0.010803617537021637, 0.02647756040096283, -0.031023740768432617, 0.12554781138896942, -0.040095146745443344, -0.027767950668931007, 0.06625118106603622, 0.017135702073574066, -0.018280960619449615, 0.020844340324401855, 0.06296637654304504, 0.042904168367385864, -0.03366932272911072, -0.0061134095303714275, -0.018765339627861977, -0.05207755044102669, -1.6069643277374084e-33, 0.0661834254860878, 0.02265905775129795, 0.015569678507745266, 0.06565732508897781, 0.015316001139581203, 0.07178720086812973, 0.09097058326005936, -0.0064057051204144955, 0.012323434464633465, 0.05062304809689522, -0.10551667958498001, 0.02413221262395382, -0.0030989411752671003, 0.0339740552008152, 0.0050512636080384254, 0.0012248719576746225, -0.01900879107415676, 0.04061349481344223, 0.03251272067427635, 0.09253460168838501, 0.04741588234901428, 0.007383468560874462, -0.02376527152955532, -0.022470254451036453, -0.03145748749375343, 0.048404715955257416, -0.0614832267165184, 0.01314016804099083, -0.13316643238067627, -0.0036030160263180733, -0.02658716030418873, -0.0031000664457678795, 0.07222867012023926, -0.07120812684297562, 0.006403157487511635, 0.006918145343661308, 0.03728897497057915, 0.03247428685426712, -0.018627330660820007, -0.0681408941745758, 0.017374370247125626, 0.0004452898574527353, -0.08368177711963654, 0.02747204713523388, -0.07492536306381226, -0.06184833124279976, -0.10040843486785889, 0.060845114290714264, 0.027245668694376945, -0.02743258699774742, 0.06448975205421448, -0.05235555022954941, 0.004067921545356512, -0.10371565818786621, -0.07813024520874023, -0.048131268471479416, 0.0052131060510873795, 0.05229572579264641, 0.09137102961540222, -0.02081744559109211, 0.07053372263908386, 0.026317432522773743, -0.09366438537836075, 0.09200980514287949, -0.007381198927760124, 0.09859730303287506, 0.11630876362323761, 0.004101668484508991, 0.025212261825799942, -0.03477809205651283, -0.10550140589475632, 0.019260181114077568, -0.06097687408328056, -0.04849890619516373, 0.10103275626897812, -0.006639773491770029, -0.1078806221485138, -0.15582183003425598, -0.0014502372359856963, 0.039515189826488495, 0.02738427184522152, 0.05637650936841965, -0.11174597591161728, -0.01045580767095089, 0.015284828841686249, 0.07526861131191254, -0.033495139330625534, -0.049551695585250854, 0.00020697516447398812, 0.05247456952929497, -0.07609424740076065, -0.04231390729546547, 0.04159202054142952, -0.025111500173807144, -0.02620481699705124, -1.4142758243826805e-33, 0.10293418169021606, 0.08813059329986572, -0.05794370919466019, -0.020909707993268967, 0.029699185863137245, -0.07970032095909119, 0.008459877222776413, 0.0785025954246521, -0.023774614557623863, 0.004634120035916567, -0.05190090090036392, -0.06245929002761841, 0.07651105523109436, -0.017292944714426994, 0.08131752908229828, -0.006973745301365852, -0.07745233178138733, -0.038284316658973694, 0.02738475799560547, -0.08670759201049805, -0.1038702055811882, 0.012815599329769611, -0.04322165250778198, -0.021891318261623383, -0.08520521223545074, -0.0064989435486495495, 0.016824351623654366, 0.08772294968366623, 0.058444444090127945, -0.0637400895357132, -0.02024713344871998, 0.027236592024564743, -0.003140368266031146, 0.049156371504068375, -0.007649288047105074, 0.06909286230802536, 0.014146022498607635, -0.00842811819165945, 0.039471741765737534, 0.021723078563809395, 0.06874097138643265, -0.01667945273220539, -0.04451362043619156, -0.015114578418433666, -0.013216996565461159, -0.009483600966632366, -0.05277556926012039, 0.02286498434841633, -0.01553584448993206, -0.013856840319931507, 0.0334104523062706, -0.021498341113328934, -0.1182740330696106, -0.03853221610188484, -0.05479573830962181, 0.051892656832933426, 0.01851777918636799, -0.00771052110940218, 0.07605184614658356, 0.02466791868209839, -0.039681386202573776, -0.09235797077417374, 0.02998073399066925, 0.014103572815656662, -0.0232986006885767, -0.011037679389119148, -0.028611192479729652, 0.0032435052562505007, 0.07006202638149261, 0.0025355645921081305, 0.05099354311823845, 0.025591431185603142, 0.012938499450683594, 0.022285936400294304, 0.0019470266997814178, 0.05477600917220116, -0.10786224156618118, -0.015649976208806038, 0.012113788165152073, 0.034217435866594315, -0.02586035430431366, -0.0588248036801815, 0.020978616550564766, 0.02181429974734783, 0.07838606834411621, -0.031816449016332626, 0.07664045691490173, 0.1268419772386551, -0.03906382620334625, -0.07022025436162949, 0.03447313234210014, 0.012255676090717316, 0.0060369838029146194, 0.022373221814632416, -0.01874946802854538, -4.6687478771900714e-08, -0.006606443785130978, 0.06495312601327896, 0.05187862366437912, 0.06481295078992844, -0.060760509222745895, 0.08712182193994522, 0.08574610948562622, 0.0334772989153862, 0.026743438094854355, -0.01006245519965887, -0.03893541172146797, -0.03403265401721001, -0.006955962628126144, 0.04839620366692543, 0.004398158751428127, 0.06949815154075623, 0.007245291490107775, 0.022768216207623482, -0.001990077318623662, -0.04248904064297676, -0.0036411620676517487, 0.013645781204104424, -0.011760715395212173, -0.04644427075982094, -0.030915923416614532, -0.026204053312540054, -0.012669900432229042, 0.01910218596458435, -0.0543239526450634, 0.03452562540769577, 0.05373789742588997, -0.05504591017961502, -0.007070472463965416, 0.04975806921720505, 0.044549115002155304, 0.06239144131541252, -0.013828194700181484, 0.012214010581374168, 0.09959240257740021, 0.07510951906442642, -0.032559413462877274, 0.03225170075893402, -0.06175302714109421, -0.01279175840318203, 0.006300012115389109, -0.000575668178498745, -0.036299560219049454, -0.07732677459716797, 0.010973062366247177, 0.10410544276237488, -0.04306419938802719, -0.04323475435376167, -0.0059337615966796875, 0.005373615771532059, -0.023061227053403854, -0.03474455699324608, -0.02483941614627838, -0.03648655116558075, 0.008355237543582916, -0.0022701204288750887, -0.07225633412599564, 0.06053383648395538, 0.027839969843626022, 0.013348501175642014 ] }, { "text": "# Initialize the model\nmodel = DeepDreamModel().to(device)\n\n# Run a dummy forward pass to verify hooks work\ndummy = torch.randn(1, 3, 299, 299).to(device)\n_ = model(dummy)\nprint(f\"Model loaded!\")\nprint(f\"Available layers for dreaming: {model.get_available_layers()}\")\nprint(f\"Hooks captured {len(model.layer_outputs)} layers\")\n\nDownloading: \"https://download.pytorch.org/models/inception_v3_google-0cc3c7bd.pth\" to /root/.cache/torch/hub/checkpoints/inception_v3_google-0cc3c7bd.pth\n\n100%|██████████| 104M/104M [00:00<00:00, 177MB/s]\n\nModel loaded!\nAvailable layers for dreaming: ['Conv2d_1a', 'Conv2d_2b', 'Mixed_5b', 'Mixed_5c', 'Mixed_5d', 'Mixed_6a', 'Mixed_6b', 'Mixed_6c', 'Mixed_6d', 'Mixed_6e', 'Mixed_7a', 'Mixed_7b', 'Mixed_7c']\nHooks captured 13 layers\n\nWhat is hook?", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_16", "embedding": [ -0.03651062399148941, -0.08122999221086502, 0.013175993226468563, 0.03485304117202759, 0.059770915657281876, -0.03421057015657425, -0.04926585778594017, -0.03938528150320053, -0.031255148351192474, -0.05965837463736534, 0.0288770142942667, -0.07721014320850372, -0.11733858287334442, -0.018162453547120094, 0.016722576692700386, 0.016742954030632973, 0.014929313212633133, 0.022693783044815063, -0.035170797258615494, -0.0528867281973362, 0.07899392396211624, -0.010961836203932762, 0.09589197486639023, 0.03407325595617294, -0.02192225493490696, -0.026979323476552963, 0.01644689217209816, -0.01903637871146202, 0.06504446268081665, -0.018405627459287643, 0.024571038782596588, 0.028126772493124008, -0.09291937202215195, 0.04360059276223183, 0.11085362732410431, 0.002544460352510214, -0.09695020318031311, -0.05774763971567154, -0.07318727672100067, -0.02185051143169403, 0.08335009217262268, -0.06927024573087692, -0.0705590471625328, -0.03425505384802818, -0.017042677849531174, 0.05533052235841751, 0.03268556669354439, -0.019356390461325645, 0.007522529922425747, -0.0904449075460434, 0.03943219780921936, -0.0023482360411435366, -0.008496670052409172, 0.03402270749211311, -0.015295813791453838, 0.002340795937925577, 0.04570526257157326, -0.030642805621027946, 0.00217142840847373, -0.017612479627132416, -0.025840362533926964, -0.010702534578740597, -0.024522937834262848, -0.06112249195575714, 0.017535500228405, 0.07040806859731674, -0.046044472604990005, 0.020720263943076134, 0.09976821392774582, -0.02542179450392723, 0.016235141083598137, 0.06599113345146179, -0.03829261288046837, -0.04004988819360733, 0.05231662839651108, -0.035758450627326965, 0.10524050891399384, 0.02874702960252762, -0.025570383295416832, -0.14012929797172546, -0.013300594873726368, -0.04568047448992729, 0.06451795250177383, 0.0454888790845871, 0.0020815026946365833, 0.020573126152157784, -0.027195919305086136, 0.05611719563603401, 0.013620848767459393, -0.034031759947538376, -0.03623540326952934, -0.040876537561416626, -0.1141471192240715, 0.04341187700629234, 0.04082905128598213, 0.017136843875050545, 0.045954637229442596, -0.049746010452508926, -0.07814743369817734, 0.04906301572918892, 0.004810062702745199, -0.06537629663944244, -0.004423239268362522, -0.008746487088501453, 0.03604381904006004, 0.07049709558486938, 0.0015860912390053272, 0.002827680902555585, -0.03992258384823799, -0.041882455348968506, 0.06289379298686981, 0.023684851825237274, 0.1006225198507309, -0.006688675377517939, 0.09843277186155319, -0.024994047358632088, -0.058932919055223465, 0.07303380966186523, 0.026344556361436844, 0.07551691681146622, -0.0029122093692421913, 0.06790971010923386, 0.04357016831636429, -0.003491724841296673, -0.11093973368406296, -0.052881814539432526, -0.016993148252367973, 3.308899415471642e-33, 0.058497488498687744, -0.006768583785742521, -0.015468171797692776, 0.06486291438341141, 0.031145013868808746, 0.028273753821849823, 0.06109050661325455, -0.031026456505060196, -0.056705914437770844, 0.004677325487136841, -0.08464192599058151, -0.02821703441441059, -0.07233326882123947, 0.03887685760855675, -0.036896832287311554, 0.004918934311717749, -0.015430375933647156, 0.03429873660206795, 0.028034310787916183, 0.09396345168352127, 0.0357176847755909, -0.015789123252034187, -0.07512921839952469, -0.028535209596157074, -0.06730432063341141, 0.09236393868923187, -0.0503760501742363, 0.03720786049962044, -0.03029181994497776, 0.016567111015319824, -0.02877921797335148, -0.0005169346113689244, 0.02992267906665802, -0.02435186877846718, -0.019875943660736084, 0.013101745396852493, 0.03634254261851311, 0.0007222318090498447, -0.0897161215543747, -0.11075755208730698, -0.006268869154155254, 0.027362365275621414, -0.04457440599799156, -0.06523746252059937, -0.10394404828548431, -0.018595607951283455, -0.036264464259147644, 0.05420882999897003, 0.04185551404953003, 0.03557138890028, 0.05793684348464012, -0.023858314380049706, -0.04109308123588562, -0.0997009202837944, -0.029628455638885498, -0.057462893426418304, 0.0585329644382, 0.013879485428333282, 0.1410519778728485, 0.03182025998830795, 0.05886135622859001, 0.021901322528719902, -0.05064651742577553, 0.05509066954255104, -0.006361993495374918, 0.06040484830737114, -0.01946248486638069, 0.004624122753739357, 0.005164498463273048, -0.028146322816610336, -0.15033547580242157, -0.0017290770774707198, 0.02325529046356678, 0.003990542143583298, 0.030697965994477272, -0.046274084597826004, -0.047247420996427536, -0.07094462960958481, -0.09087135642766953, 0.05878007784485817, 0.016077356413006783, 0.02963406592607498, -0.05915820598602295, -0.05283398926258087, -0.03976134955883026, 0.016461152583360672, -0.01906007155776024, -0.09422466158866882, -0.06704306602478027, 0.06267600506544113, -0.0912017673254013, -0.044944070279598236, 0.09334929287433624, -0.03510468080639839, -0.07656172662973404, -3.4800954739895226e-33, 0.04410913959145546, 0.0533352829515934, -0.021327761933207512, 0.04079630970954895, 0.040274422615766525, -0.04877298325300217, 0.06558147072792053, -0.01104128360748291, -0.05197356641292572, 0.020274503156542778, 0.01648496277630329, -0.0607948899269104, 0.003509097034111619, -0.00012324584531597793, 0.10604231804609299, -0.05882866680622101, -0.048680294305086136, -0.05619557946920395, 0.06016240641474724, 0.05577171966433525, -0.021048346534371376, 0.07273353636264801, -0.10157520323991776, 0.012196754105389118, -0.12359011173248291, 0.020145637914538383, 0.00804969109594822, 0.08720933645963669, 0.03655368462204933, -0.032307010143995285, 0.027590282261371613, 0.01522138062864542, -0.10069829970598221, 0.06805271655321121, 0.02099539153277874, 0.05322282016277313, 0.06850139051675797, 0.009133853949606419, 0.0022067376412451267, -0.06160035356879234, 0.07839889079332352, 0.00660818163305521, -0.09383554011583328, 0.004789154510945082, -0.019410470500588417, 0.017510633915662766, 0.008711736649274826, -0.0041338722221553326, -0.00651768920943141, 0.018183918669819832, 0.029864389449357986, -0.02142977900803089, -0.0876154974102974, 0.026863429695367813, -0.011293507181107998, 0.0137002719566226, 0.027781032025814056, -0.04894264042377472, 0.05986723676323891, 0.03186444193124771, -0.016211818903684616, -0.11745752394199371, -0.0032037426717579365, -0.01652173325419426, -0.004049551673233509, 0.004969960544258356, -0.0282233078032732, 0.08111283928155899, 0.06669419258832932, 0.04492656886577606, 0.009413071908056736, 0.0769057422876358, 0.09916488826274872, 0.05398549512028694, 0.016658052802085876, 0.01593535579741001, -0.06571157276630402, -0.024783646687865257, 0.09515590220689774, -0.035460203886032104, -0.05101059377193451, -0.059669531881809235, 0.03940712660551071, 0.04126859828829765, 0.09481634944677353, 0.017175359651446342, 0.036788105964660645, 0.10856428742408752, -0.017298292368650436, -0.05700128525495529, -0.014296509325504303, 0.014951827935874462, 0.06276793032884598, 0.08487063646316528, 0.015917537733912468, -5.823372006830141e-08, -0.009899266995489597, 0.021082192659378052, 0.053749192506074905, 0.04483181983232498, -0.012553307227790356, -0.0317266620695591, 0.07219346612691879, 0.014680984430015087, 8.406092820223421e-05, -0.012307165190577507, 0.022151608020067215, -0.015083769336342812, 0.0017249465454369783, 0.043535083532333374, -0.00013967232371214777, 0.045688554644584656, -0.03273535147309303, 0.04499880224466324, -0.0053995405323803425, -0.056305982172489166, 0.006539118010550737, 0.03384321555495262, -0.009019555523991585, -0.05650196596980095, 0.024546697735786438, -0.07028177380561829, 0.005633235909044743, 0.08063954859972, -0.03871127590537071, -0.005793974734842777, 0.022307014092803, -0.05894890055060387, 0.04870009422302246, -0.006788166705518961, 0.029939934611320496, 0.07004400342702866, -0.04382957145571709, 0.038605544716119766, 0.07837466895580292, 0.035843625664711, 0.007361076306551695, 0.023503907024860382, 0.005095262546092272, -0.055480796843767166, 0.006307179573923349, -0.04477500170469284, -0.059331245720386505, -0.08000069111585617, -0.0011739017209038138, 0.13787159323692322, -0.007715640123933554, 0.016143109649419785, -0.017088308930397034, 0.08682463318109512, 0.012715082615613937, -0.05468602851033211, -0.008378245867788792, -0.020616749301552773, -0.030822554603219032, 0.0160220880061388, 0.03954043984413147, 0.04162316769361496, -0.03382208198308945, -0.008524695411324501 ] }, { "text": "What is hook?\n\nA hook is a way to \"spy on\" what's happening inside a neural network during the forward pass.\nNormally, when you run a model:\n\nInput → Layer1 → Layer2 → Layer3 → ... → Output\n↑\n(intermediate values are computed\nbut you never see them)\n\nWith a hook, you can intercept those intermediate values:\n\nInput → Layer1 → Layer2 → Layer3 → ... → Output\n│\n├──→ Hook captures this!\n│ (saved to a variable)\n\nWhy we need hooks for Deep Dream:\n\n• We need the activations from a middle layer (not the final output)\n•\n\n• We want to compute gradients with respect to those activations\n•\n\n• Hooks let us \"reach inside\" and grab those values\n•\n\nLet's look at the model:\n\nIn [4]:\n\nmodel\n\nOut[4]:", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_17", "embedding": [ -0.029540976509451866, -0.04606478288769722, 0.01923445053398609, 0.031630419194698334, 0.012679957784712315, 0.027303088456392288, -0.007899331860244274, -0.015673741698265076, 0.004792086314409971, -0.026328500360250473, -0.025594232603907585, -0.01890953816473484, -0.05159485340118408, -0.09342390298843384, -0.06453016400337219, 0.07511711120605469, -0.004706355277448893, 0.06240101158618927, -0.08110951632261276, -0.06360217928886414, 0.008521273732185364, -0.04455435648560524, -0.0027031961362808943, 0.008541226387023926, -0.07827544957399368, -0.004001233726739883, 0.013113712891936302, -0.00012517442519310862, 0.03531355410814285, -0.00160930713173002, -0.01642797328531742, 0.006413400638848543, -0.017228610813617706, 0.06766260415315628, -0.12309733778238297, 0.022656096145510674, 0.01471847202628851, -0.029779046773910522, -0.06594332307577133, -0.04346238076686859, 0.07552089542150497, -0.03073100931942463, -0.00301269325427711, -0.02500046044588089, 0.048403479158878326, 0.03071421943604946, 0.010203352198004723, -0.07771255820989609, -0.06832770258188248, 0.005122039467096329, 0.028258228674530983, 0.01170742604881525, -0.025539351627230644, 0.10583954304456711, -0.021563639864325523, -0.03760499879717827, 0.07766113430261612, -0.031000355258584023, -0.04975666478276253, -0.01317109540104866, 0.01915944553911686, -0.09494392573833466, -0.039294399321079254, 0.015390864573419094, 0.035615257918834686, -0.026545317843556404, -0.07084881514310837, 0.05568288639187813, 0.10186133533716202, -0.04666327312588692, -0.004958853591233492, -0.0015459214337170124, -0.05019407719373703, -0.13024432957172394, 0.09057172387838364, 0.03812980279326439, 0.08963741362094879, 0.04181034862995148, -0.0018662774236872792, -0.07274381816387177, 0.03187891095876694, 0.008294765837490559, 0.021212084218859673, -0.003187316469848156, 0.013266625814139843, 0.038243599236011505, -0.048112306743860245, -0.06557798385620117, 0.023441705852746964, -0.006676836870610714, -0.010159504599869251, -0.05564465373754501, -0.09523191303014755, 0.010946189984679222, -0.00856640562415123, 0.018211333081126213, 0.009336949326097965, -0.07807403802871704, -0.04214411973953247, 0.03661832958459854, 0.028051750734448433, 0.0447596050798893, 0.03643564134836197, -0.007977829314768314, 0.0604463666677475, 0.026695579290390015, 0.0357828289270401, -0.006496207322925329, -0.0237803403288126, -0.13910998404026031, -0.044607311487197876, -0.041385501623153687, 0.11558758467435837, -0.029804956167936325, 0.06237206235527992, 0.008747628889977932, 0.06750238686800003, 0.01620757207274437, 0.007480541709810495, -0.008947370573878288, -0.042026448994874954, 0.049812350422143936, 0.02244129404425621, 0.007201586849987507, -0.023404031991958618, -0.02102530188858509, -0.06397707015275955, -5.480086246088867e-34, 0.03713427856564522, -0.011168207041919231, -0.025330042466521263, 0.07955428957939148, -0.0021853873040527105, -0.03772733733057976, 0.027649354189634323, -0.006543273571878672, -0.053346745669841766, 0.12934955954551697, -0.05280118063092232, -0.027804842218756676, 0.03482198342680931, 0.11376231163740158, 0.05547449365258217, 0.02977813221514225, -0.01788094826042652, -0.09861242026090622, 0.059260692447423935, 0.08045700192451477, 0.026072988286614418, -0.06061580404639244, -0.03292454406619072, -0.02557855285704136, -0.0337940938770771, 0.11803657561540604, -0.010902347043156624, 0.08809030055999756, -0.07325543463230133, 0.001783067244105041, -0.006359507795423269, 0.014307375997304916, 0.03387775272130966, -0.05189414322376251, 0.012431700713932514, -0.01824323460459709, 0.092817522585392, 0.004336153157055378, -0.005877454299479723, -0.06808832287788391, 0.016087131574749947, 0.00913610216230154, -0.06478822231292725, 0.01764906756579876, 0.01706577092409134, -0.07048077881336212, -0.043045539408922195, 0.028307080268859863, 0.02936258725821972, 0.002269820310175419, 0.0667426586151123, 0.009081903845071793, 0.04513297975063324, -0.0759056955575943, -0.026336485520005226, 0.02988315187394619, 0.0518595352768898, 0.01994967833161354, 0.02251073531806469, 0.11867687106132507, -0.003929062280803919, 0.015817200765013695, -0.0366726815700531, 0.08232083171606064, -0.06312517076730728, 0.11248768121004105, -0.001995566301047802, 0.02933291345834732, 0.01256813295185566, 0.004392302129417658, -0.10876766592264175, 0.024152064695954323, -0.07152986526489258, -0.020125819370150566, 0.006131604313850403, 0.013457891531288624, -0.05360386148095131, -0.08176598697900772, 0.12854871153831482, 0.015128044411540031, 0.04985182732343674, 0.039111003279685974, -0.018621383234858513, 0.04007435962557793, -0.021780818700790405, 0.012253960594534874, -0.022258510813117027, -0.15054239332675934, 0.032158028334379196, 0.07844459265470505, -0.06876765191555023, -0.0023671803064644337, 0.010735520161688328, 0.01609211601316929, 0.012183739803731441, -2.7871843495209938e-33, 0.0933680608868599, 0.04282185807824135, -0.13978032767772675, 0.019862927496433258, -0.011558194644749165, -0.030331052839756012, -0.03778583183884621, -0.015541788190603256, 0.028954921290278435, 0.028164368122816086, -0.0013658246025443077, -0.008810574188828468, -0.015692461282014847, 0.06269852072000504, 0.1320877969264984, -0.06884725391864777, -0.07212182879447937, -0.10003398358821869, 0.01196197234094143, -0.01808064617216587, 0.021650584414601326, 0.029607750475406647, -0.04822760447859764, -0.013654224574565887, -0.11802144348621368, -0.005932777654379606, -0.023848453536629677, 0.08506171405315399, 0.010053283534944057, 0.013182210735976696, -0.04007870703935623, -0.0365980826318264, -0.019223175942897797, 0.06485594063997269, -0.006564180366694927, 0.04242122173309326, 0.06299591064453125, 0.02032868191599846, -0.0075250789523124695, -0.06320193409919739, 0.03609014302492142, -0.029410874471068382, -0.04149938374757767, -0.023440035060048103, -0.03174693509936333, 0.038889236748218536, -0.055692289024591446, 0.044772930443286896, -0.07526364177465439, 0.004424612503498793, 0.0323072150349617, 0.0018933594692498446, -0.0452241413295269, 0.04989943280816078, -0.07380174100399017, 0.04176934063434601, -0.0009063554462045431, -0.004708492662757635, 0.10075454413890839, 0.06154822185635567, -0.018394432961940765, -0.10203655809164047, -0.012547402642667294, -0.03585856035351753, -0.007320399396121502, 0.03557663783431053, 0.0037179989740252495, -0.020969144999980927, 0.022782305255532265, -0.018291831016540527, 0.09783671051263809, -0.024757150560617447, 0.024874068796634674, 0.01969686895608902, -0.015811480581760406, -0.009933069348335266, -0.10722436010837555, -0.12052507698535919, 0.04631056636571884, -0.023765364661812782, -0.06838778406381607, -0.09826841950416565, 0.052319061011075974, 0.03151307627558708, 0.05449017509818077, -0.025984905660152435, -0.02743777073919773, 0.056658610701560974, -0.03297996520996094, -0.11362982541322708, -0.0005008320440538228, 0.0432087667286396, -0.05993611738085747, -0.029302511364221573, -0.03414740040898323, -5.227262533935573e-08, -0.028348324820399284, 0.02408290095627308, -0.011242319829761982, 0.05446528643369675, -0.021367596462368965, 0.02199232578277588, 0.02951952815055847, 0.03800522908568382, -0.00537630170583725, -0.0018339509842917323, 0.05584390088915825, 0.03169262409210205, -0.045756254345178604, -0.01148541271686554, -0.007239989470690489, 0.07223252952098846, -0.02089552953839302, -0.026496512815356255, -0.02053229883313179, -0.03741077706217766, -0.03636522218585014, 0.09141353517770767, -0.019396714866161346, -0.06137816980481148, 0.024657592177391052, -0.08781209588050842, 0.0009873054223135114, 0.12921884655952454, 0.01912038028240204, 0.008445750921964645, 0.06032664328813553, -0.027788545936346054, 0.014527695253491402, 0.054925136268138885, 0.04514457657933235, 0.11468973010778427, 0.019900891929864883, -0.0056360275484621525, 0.03935550898313522, -0.017139611765742302, 0.022467974573373795, -0.0038687996566295624, -0.04425022006034851, -0.0634618028998375, -0.06695862114429474, 0.04134092107415199, -0.014821447432041168, -0.03797941654920578, 0.028696848079562187, 0.11191637814044952, -0.033303920179605484, 0.0011625943006947637, 0.0005692450795322657, 0.06253396719694138, -0.06360222399234772, -0.10193602740764618, 0.02346098981797695, -0.03391182795166969, -0.04274950921535492, 0.05307064950466156, -0.04059665650129318, 0.020174188539385796, 0.002308494411408901, -0.06571709364652634 ] }, { "text": "DeepDreamModel(\n(inception): Inception3(\n(Conv2d_1a_3x3): BasicConv2d(\n(conv): Conv2d(3, 32, kernel_size=(3, 3), stride=(2, 2), bias=False)\n(bn): BatchNorm2d(32, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(Conv2d_2a_3x3): BasicConv2d(\n(conv): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(32, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(Conv2d_2b_3x3): BasicConv2d(\n(conv): Conv2d(32, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(maxpool1): MaxPool2d(kernel_size=3, stride=2, padding=0, dilation=1, ceil_mode=False)\n(Conv2d_3b_1x1): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_18", "embedding": [ -0.02522408962249756, -0.10301227867603302, -0.04262770339846611, -0.024010607972741127, 0.00548231415450573, -0.06630191206932068, -0.04870696738362312, 0.0019591967575252056, -0.03929093852639198, -0.10110097378492355, -0.02576884999871254, -0.10060448199510574, -0.02927352301776409, -0.06172768026590347, -0.01206835824996233, 0.06199133023619652, 0.03337940201163292, 0.08391550928354263, -0.06880585849285126, -0.008645666763186455, 0.0329480804502964, 0.07155205309391022, 0.04655015096068382, 0.00989819597452879, 0.01022289413958788, 0.053947679698467255, 0.04982586205005646, 0.0067805275321006775, 0.029748890548944473, -0.1065128967165947, 0.07227206230163574, 0.03371080756187439, -0.03495839610695839, 0.027978839352726936, 0.053642258048057556, 0.021145431324839592, -0.06960434466600418, 0.02253742516040802, -0.05165605619549751, 0.012605670839548111, 0.028845489025115967, 0.04537133127450943, 0.04512988403439522, 0.008784083649516106, 0.07824128866195679, 0.09694505482912064, 0.004050426185131073, 0.009124347008764744, 0.044919852167367935, -0.054736100137233734, -0.013036523014307022, -0.03955812007188797, 0.03297252207994461, -0.004369488917291164, 0.01276277843862772, 0.07347779721021652, -0.010067099705338478, 0.019147884100675583, -0.02076934464275837, 0.006428583990782499, 0.04577721655368805, -0.025918763130903244, -0.03534206002950668, -0.04117728769779205, 0.049518268555402756, -0.09029287844896317, -0.02021557092666626, 0.0046022869646549225, 0.05500032380223274, 0.08920061588287354, 0.004464666359126568, 0.06353668868541718, -0.021765051409602165, -0.053056083619594574, 0.020488018169999123, -0.026849059388041496, 0.07784119248390198, -0.008581534959375858, -0.01980474218726158, -0.13627733290195465, 0.009100552648305893, -0.011560953222215176, 0.045952849090099335, -0.043366938829422, 0.0610860176384449, -0.021773722022771835, -0.017897499725222588, 0.001427255105227232, -0.014353926293551922, 0.012231170199811459, -0.002621250692754984, 0.03760921210050583, -0.10997311025857925, -0.016870960593223572, 0.04315493255853653, 0.0007616422954015434, 0.0263057891279459, -0.0016245387960225344, 0.01820245012640953, 0.05497322604060173, 0.04047100245952606, -0.0447722002863884, -0.0425613671541214, 0.07014978677034378, 0.04352615028619766, 0.012497806921601295, 0.1153712123632431, 0.04385306313633919, -0.0009290443849749863, -0.03913509473204613, 0.08019866794347763, -0.0002331837749807164, 0.05742805823683739, 0.023944366723299026, 0.06266404688358307, 0.014341079629957676, -0.028350643813610077, 0.0324813649058342, -0.011851868592202663, 0.027545539662241936, -0.11760803312063217, -0.014069768600165844, -0.0073142037726938725, -0.0031663277186453342, -0.1269150823354721, -0.03209856525063515, -0.09228046238422394, 8.475633122271353e-33, -0.04160061478614807, -0.0633542612195015, -0.0375695638358593, 0.0021856040693819523, 0.0389445498585701, 0.07462644577026367, -0.051294732838869095, -0.07576189190149307, -0.06432903558015823, -0.0027521958108991385, -0.08322929590940475, -0.08443598449230194, -0.05661186948418617, 0.0698573961853981, -0.011570216156542301, -0.09851320832967758, -0.016659492626786232, 0.08029727637767792, -0.008592106401920319, -0.0037089847028255463, 0.08970965445041656, 0.04205920174717903, -0.07668501883745193, -0.08860496431589127, -0.038072723895311356, 0.03466201201081276, 0.0232843030244112, -0.003706656862050295, -0.05084141343832016, 0.02789042890071869, -0.06528414040803909, 0.01260330155491829, -0.040265344083309174, -0.009381618350744247, -0.005699139554053545, 0.0020923404954373837, 0.02870240993797779, -0.0012539030285552144, 0.015191596001386642, -0.08546819537878036, -0.04704506695270538, 0.05657317861914635, -0.0018055514665320516, -0.09066884964704514, -0.12849263846874237, -0.0639391764998436, 0.00016251186025328934, 0.09888209402561188, 0.004646949004381895, 0.012656649574637413, 0.06110510975122452, -0.05551646277308464, 0.02656548283994198, -0.10173498094081879, 0.005128060467541218, -0.05377582460641861, 0.05070233717560768, 0.04480752348899841, 0.08594778925180435, 0.09726674854755402, -0.011689182370901108, 0.04473299905657768, -0.05736148729920387, -0.004144038073718548, -0.016453448683023453, 0.067969910800457, -0.053034089505672455, -0.004848843906074762, 0.04714323207736015, 0.0769607350230217, -0.06638377159833908, 0.057852987200021744, 0.00695244874805212, -0.002965854248031974, 0.07161024957895279, -0.04186491295695305, 0.011044532060623169, -0.03987036272883415, -0.06758598983287811, -0.014500404708087444, -0.018582254648208618, 0.11817273497581482, -0.04648524895310402, -0.07304387539625168, -0.09098652005195618, 0.00961504876613617, -0.062889963388443, -0.09880409389734268, -0.07247982919216156, 0.003000617725774646, -0.03383364528417587, -0.05108644813299179, 0.031195294111967087, 0.029020514339208603, -0.06731552630662918, -7.772379667896504e-33, 0.006868736352771521, 0.14288188517093658, 0.02724626660346985, 0.03937120363116264, -0.03282152861356735, 0.04208548739552498, 0.06535285711288452, -0.043757084757089615, -0.04359668865799904, -0.06199844926595688, 0.021626904606819153, -0.017949577420949936, -0.03874263912439346, 0.036872293800115585, 0.0985076054930687, -0.10410357266664505, -0.009793835692107677, -0.018333174288272858, 0.018876776099205017, -0.04497183859348297, 0.02979329787194729, 0.07246175408363342, -0.090655118227005, 0.008039199747145176, -0.06494594365358353, 0.02771332673728466, -0.03516010195016861, 0.07651417702436447, 0.016847509890794754, -0.01687745377421379, -0.02788129262626171, 0.02769329398870468, -0.10481999814510345, 0.043043352663517, -0.01990877278149128, 0.06520166993141174, 0.028738560155034065, 0.017649566754698753, -0.035935938358306885, -0.04872044920921326, 0.030472567304968834, 0.08630004525184631, -0.0427638404071331, 0.034845225512981415, -0.024336567148566246, 0.022349214181303978, 0.07214582711458206, 1.5960024029482156e-05, -0.00905501190572977, -0.001280995667912066, -0.04552313685417175, -0.041665103286504745, -0.03591316565871239, 0.0404437817633152, -0.003903230419382453, -0.005898118484765291, -0.05425938963890076, -0.04499141499400139, 0.08599865436553955, -0.018544817343354225, -0.04946378618478775, -0.03979334607720375, -0.003659716574475169, -0.03621580824255943, 0.057149503380060196, 0.047852642834186554, -0.08067687600851059, 0.08879704773426056, 0.00577713456004858, 0.07962387800216675, -0.005633728578686714, 0.06166265159845352, 0.02006620727479458, 0.030502617359161377, -0.0484468974173069, -0.04196713864803314, 0.01532160583883524, -0.0003210902796126902, 0.026349501684308052, 0.025624502450227737, -0.03131207823753357, -0.02095910534262657, 0.07202071696519852, 0.07903525233268738, 0.017342474311590195, 0.06910471618175507, 0.0047750212252140045, 0.09014864265918732, 0.041038062423467636, 0.022881299257278442, 0.028612399473786354, 0.06397261470556259, 0.0969996377825737, 0.10981857031583786, 0.012006440199911594, -5.877681985566596e-08, -0.05433546379208565, -0.038230378180742264, 0.02069047838449478, 0.05632007494568825, -0.005417858716100454, -0.034848928451538086, -0.010005303658545017, 0.04551565647125244, 0.02911573275923729, -0.08264247328042984, 0.00012206876272102818, -0.029921069741249084, -0.041781701147556305, -0.026137301698327065, -0.0005134050734341145, 0.029292577877640724, -0.03783036395907402, 0.005118831060826778, 0.018672313541173935, -0.027305621653795242, -0.033320311456918716, 0.0037562930956482887, -0.020671196281909943, 0.02469395473599434, 0.009954656474292278, -0.1052563488483429, -0.010390820913016796, 0.032925911247730255, 0.06019100174307823, 0.011581823229789734, -0.014818708412349224, 0.028734466060996056, 0.060139939188957214, 0.03178241848945618, -0.015570946037769318, 0.05564969405531883, -0.03774868696928024, 0.07294252514839172, -0.01917251944541931, 0.012321002781391144, -0.06592792272567749, 0.10428252816200256, 0.0071430387906730175, -0.0005720960325561464, 0.006336404476314783, -0.022335899993777275, -0.010174980387091637, -0.09000371396541595, 0.020801033824682236, -0.03374774754047394, 0.014966520480811596, 0.06991133838891983, 0.06102960184216499, 0.11399909108877182, 0.022502247244119644, -0.026915742084383965, -0.11144322901964188, -0.019449761137366295, -0.00904691033065319, 0.031802788376808167, -0.0333716981112957, -0.045555368065834045, -0.05481285601854324, -0.021282294765114784 ] }, { "text": ")\n(maxpool1): MaxPool2d(kernel_size=3, stride=2, padding=0, dilation=1, ceil_mode=False)\n(Conv2d_3b_1x1): BasicConv2d(\n(conv): Conv2d(64, 80, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(80, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(Conv2d_4a_3x3): BasicConv2d(\n(conv): Conv2d(80, 192, kernel_size=(3, 3), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(maxpool2): MaxPool2d(kernel_size=3, stride=2, padding=0, dilation=1, ceil_mode=False)\n(Mixed_5b): InceptionA(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(192, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch5x5_1): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_19", "embedding": [ -0.0020274182315915823, -0.05154634639620781, -0.04875033348798752, -0.04570350423455238, 0.053005509078502655, -0.10854467749595642, -0.03498613089323044, 0.0058102295733988285, -0.0714382529258728, -0.08292721211910248, 0.005995518062263727, -0.04333716258406639, 0.02826242335140705, -0.03468771278858185, -0.013764099217951298, 0.05362764000892639, 0.0299903005361557, 0.029628165066242218, -0.08557462692260742, -0.0031003598123788834, 0.041356462985277176, 0.02091931737959385, 0.013947154395282269, -0.01570306159555912, -0.024324582889676094, 0.062426745891571045, -0.012658928520977497, -0.006981839891523123, 0.0086811613291502, -0.08927298337221146, 0.043471064418554306, 0.040315065532922745, -0.06036097928881645, 0.01721039228141308, 0.08333402127027512, 0.0015398010145872831, -0.041281808167696, 0.0005162553279660642, -0.039725758135318756, 0.03358161449432373, 0.0297309048473835, 0.023040596395730972, 0.02846253477036953, 0.05090028792619705, 0.05934267118573189, 0.13863138854503632, -0.019375160336494446, 0.01314781978726387, 0.05260513350367546, -0.03450103476643562, -0.021646199747920036, -0.012996023520827293, 0.056496184319257736, -0.046827588230371475, 0.009577622637152672, 0.037297047674655914, -0.01263416837900877, -0.006559318862855434, 0.011906405910849571, 0.011357346549630165, 0.03747707977890968, -0.05170860141515732, 0.007541574537754059, 0.0047571794129908085, 0.02801564894616604, -0.12613245844841003, 0.02485300600528717, 0.024540385231375694, 0.007492516655474901, 0.07847416400909424, -0.031488385051488876, 0.08511372655630112, -0.03452124819159508, -0.021262124180793762, 0.050948090851306915, 0.01513685379177332, 0.06371966749429703, 0.002591213211417198, -0.030107632279396057, -0.1538383662700653, 0.00821889191865921, -0.01970501057803631, 0.044858574867248535, -0.11311767995357513, -0.00012542863260023296, -0.03419817239046097, -0.0029560935217887163, 0.03109719604253769, 0.02867155335843563, -0.013209141790866852, 0.06286835670471191, 0.10969646275043488, -0.10391739010810852, -0.012706215493381023, 0.02419274114072323, 0.024575769901275635, 0.015580793842673302, 0.026036398485302925, 0.015652623027563095, 0.03753439337015152, 0.021553805097937584, -0.05353843793272972, -0.019049951806664467, 0.09267724305391312, 0.0454210601747036, -0.021047070622444153, 0.052681855857372284, 0.09253168106079102, -0.008773092180490494, -0.04639556258916855, 0.10128764808177948, -0.004050179850310087, 0.08279652148485184, 0.002821449190378189, 0.08362485468387604, 0.05761762708425522, 0.016355125233530998, 0.03801250457763672, -0.008091524243354797, 0.01951325498521328, -0.06095176935195923, -0.01723325066268444, 0.0008416888886131346, 0.01831255666911602, -0.0811779573559761, 0.01761559769511223, -0.0514199435710907, 5.588391979305313e-33, -0.029844876378774643, -0.07549076527357101, -0.032886963337659836, -0.0432652123272419, -0.021695716306567192, 0.06409329175949097, -0.0020308997482061386, -0.06496430933475494, -0.03252597898244858, -0.030919767916202545, -0.0829039141535759, -0.06842254102230072, -0.053468361496925354, 0.013997846283018589, -0.043092843145132065, -0.08951103687286377, -0.0011508840834721923, 0.06783026456832886, 0.0035381002817302942, -0.03928567096590996, 0.09784263372421265, 0.04675595089793205, -0.03137291967868805, -0.05637848377227783, -0.00021812223712913692, -0.07374409586191177, 0.028361886739730835, -0.0539090558886528, -0.02193639613687992, 0.046313557773828506, -0.024725327268242836, -0.029023874551057816, -0.05150216817855835, 0.029467295855283737, -0.048065587878227234, 0.014943004585802555, -0.021872280165553093, 0.003271289635449648, 0.028758320957422256, -0.06330452114343643, -0.07871515303850174, 0.04606112092733383, 0.01059150230139494, -0.04838420823216438, -0.10904348641633987, -0.10216027498245239, 0.017648175358772278, 0.10320265591144562, -0.021235035732388496, 0.025029335170984268, 0.004651413764804602, -0.02162184566259384, 0.026254303753376007, -0.08626655489206314, -4.210625047562644e-05, -0.03229820355772972, 0.029021592810750008, 0.013967292383313179, 0.021695692092180252, 0.09118357300758362, -0.010519156232476234, 0.025534311309456825, -0.11573681235313416, -0.015599426813423634, -0.0075668576173484325, 0.06421048939228058, -0.028707213699817657, -0.016520246863365173, 0.057400915771722794, 0.07514917105436325, -0.05897312983870506, 0.04279408976435661, 0.03363309055566788, -0.008851964958012104, 0.07543224841356277, -0.042209092527627945, 0.048608195036649704, -0.008280085399746895, -0.09534209966659546, -0.04352707043290138, -0.062188416719436646, 0.14779894053936005, -0.06004754453897476, -0.05647442862391472, -0.10143224895000458, -0.051017481833696365, -0.03065141849219799, -0.05085717886686325, -0.07675869017839432, -0.04083934426307678, -0.014697120524942875, -0.037823837250471115, 0.07693326473236084, 0.023854149505496025, -0.03678817301988602, -4.9961507420541816e-33, 0.02193979173898697, 0.09335242956876755, 0.054457735270261765, 0.04747769236564636, -0.0316026397049427, 0.05780581384897232, 0.08970391005277634, -0.06764920800924301, -0.05219905450940132, -0.09304400533437729, -0.041292063891887665, -0.006317776627838612, -0.04385674372315407, 0.027602115646004677, 0.04733996093273163, -0.09176433831453323, 0.009135550819337368, 0.017530620098114014, 0.016349542886018753, 0.01033318042755127, 0.024608571082353592, 0.09146763384342194, -0.003642796305939555, 0.01655758172273636, -0.016336290165781975, 0.021054791286587715, -0.024034913629293442, -0.007469255942851305, 0.020878907293081284, -0.026812369003891945, -0.047280363738536835, 0.01778784580528736, -0.07357233762741089, 0.09582764655351639, -0.006144473794847727, 0.0024722651578485966, 0.030102040618658066, 0.03454148396849632, 0.010697603225708008, 0.024071918800473213, 0.08455435931682587, 0.05720710754394531, -0.07517512142658234, 0.03734581917524338, 0.006288196425884962, 0.05164428427815437, 0.059560488909482956, -0.05298243463039398, -0.03322334960103035, -0.014649322256445885, -0.09751489758491516, -0.05403938144445419, -0.02524181269109249, 0.07483527809381485, 0.02759329043328762, -0.03223128616809845, -0.04798658937215805, -0.002245209412649274, 0.006034134421497583, -0.05666326358914375, -0.011703360825777054, -0.016451502218842506, -0.00780187314376235, 0.0042521464638412, 0.05507839471101761, 0.023452410474419594, -0.08353790640830994, 0.03224457800388336, 0.020452244207262993, 0.07754043489694595, -0.04022466763854027, 0.07446205615997314, 0.005811683367937803, -0.010193819180130959, -0.04961037635803223, -0.013024874031543732, 0.03352344408631325, -0.03044034354388714, -0.009640703909099102, 0.045620258897542953, -0.09861934930086136, 0.06939654797315598, 0.07446044683456421, 0.08914532512426376, 0.005647815763950348, 0.06386630982160568, 0.007208750117570162, 0.056088875979185104, 0.06576131284236908, -0.02264304645359516, 0.021031063050031662, 0.0181164238601923, 0.11794781684875488, 0.09716422855854034, 0.004822080489248037, -4.4458374759415165e-08, 0.013071760535240173, -0.08093685656785965, -0.006265354808419943, 0.055318012833595276, 0.04718434810638428, -0.009656659327447414, -0.07232839614152908, 0.03188328444957733, 0.0037534572184085846, -0.03352964669466019, 0.021274244412779808, 0.014166993089020252, -0.02433553710579872, -0.08328253030776978, -0.008075942285358906, 0.020943237468600273, -0.012047958560287952, -0.07234523445367813, 0.016540396958589554, -0.045908838510513306, -0.06123407185077667, -0.02023538388311863, -0.05094962939620018, 0.08760002255439758, -0.0184338241815567, -0.04338913410902023, -0.007312924601137638, -0.04180179908871651, 0.07778763025999069, -0.035416994243860245, -0.025935161858797073, -0.041102923452854156, 0.053722184151411057, 0.01064144354313612, 0.04733061417937279, 0.008517837151885033, -0.05420661345124245, 0.08616046607494354, 0.02690187469124794, 0.04561373591423035, -0.08962500095367432, 0.1083286702632904, 0.028440527617931366, 0.0002912062336690724, 0.09332367777824402, -0.012927522882819176, -0.02213994413614273, -0.041296400129795074, -1.8048774563794723e-06, -0.07271381467580795, -0.006426644511520863, 0.02593364752829075, 0.04035472497344017, 0.1317817121744156, 0.017689814791083336, -0.04674249514937401, -0.13095195591449738, -0.005810198839753866, -0.002179970731958747, 0.020021092146635056, 0.011888541281223297, 0.008061631582677364, -0.0595213882625103, -0.041659899055957794 ] }, { "text": "(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch5x5_1): BasicConv2d(\n(conv): Conv2d(192, 48, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(48, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch5x5_2): BasicConv2d(\n(conv): Conv2d(48, 64, kernel_size=(5, 5), stride=(1, 1), padding=(2, 2), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_1): BasicConv2d(\n(conv): Conv2d(192, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_2): BasicConv2d(\n(conv): Conv2d(64, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_20", "embedding": [ -0.041639067232608795, -0.06316577643156052, -0.05145738273859024, -0.02544376812875271, 0.040978241711854935, -0.07387686520814896, -0.0508568175137043, 0.015005787834525108, -0.058972686529159546, -0.04870334267616272, 0.031249795109033585, -0.04838711395859718, -0.0026276034768670797, -0.06612241268157959, -0.005018663126975298, 0.09170641750097275, -0.021251952275633812, 0.04483785480260849, -0.08299154043197632, -0.01663995161652565, 0.013554246164858341, 0.05353052169084549, 0.01790919527411461, 0.009171602316200733, 0.020321926102042198, 0.029404358938336372, 0.020035395398736, 0.05106277018785477, -0.0015241389628499746, -0.12049954384565353, 0.05905985087156296, 0.04893799126148224, -0.05858490616083145, 0.010199221782386303, 0.048054151237010956, 0.011873203329741955, -0.007866542786359787, 0.014843611977994442, -0.04675913602113724, 0.027686985209584236, 0.034818101674318314, 0.05000719055533409, 0.061212021857500076, 0.030995817855000496, 0.09097368270158768, 0.1105959489941597, -0.033237628638744354, -0.007661634124815464, 0.042860161513090134, -0.04712564870715141, -0.03714727610349655, -0.04633563756942749, 0.027502041310071945, -0.0403439886868, -0.003966338932514191, 0.05519029498100281, -0.015219553373754025, -0.0071177976205945015, 0.05539631098508835, -0.017156243324279785, 0.04312542825937271, -0.0247010700404644, -0.028691066429018974, -0.02042866311967373, 0.035316698253154755, -0.08684378117322922, -0.009064443409442902, 0.022739794105291367, 0.04289476200938225, 0.08003948628902435, -0.03272479027509689, 0.009486701339483261, -0.0392799936234951, -0.04456615075469017, 0.020658552646636963, -0.013204701244831085, 0.05509046092629433, -0.009377215057611465, -0.023845653980970383, -0.15376226603984833, -0.03926381841301918, -0.017211858183145523, 0.005045642610639334, -0.10851432383060455, 0.012792212888598442, -0.0024947619531303644, 0.02056426927447319, 0.054441459476947784, 0.024684583768248558, -0.009154342114925385, 0.035186219960451126, 0.07092646509408951, -0.10736460983753204, -0.02517659217119217, 0.0195479579269886, 0.022092990577220917, 0.04049481078982353, 0.016884315758943558, 0.03538726642727852, 0.05889175087213516, 0.0451606810092926, -0.042289771139621735, -0.03751816973090172, 0.07662726193666458, -0.013231010176241398, 0.0033084223978221416, 0.09178581833839417, 0.07117914408445358, 0.0033541531302034855, -0.045349154621362686, 0.0883205309510231, 0.023790106177330017, 0.043442558497190475, 0.001019484712742269, 0.08666396886110306, 0.0431075319647789, -0.008456838317215443, 0.04285428300499916, -0.0034578063059598207, 0.011703133583068848, -0.07196590304374695, -0.015922529622912407, 0.009851458482444286, 0.05431634187698364, -0.11991088092327118, -0.03298070281744003, -0.0666976049542427, 5.955730657859416e-33, -0.06262118369340897, -0.06914114952087402, -0.060567475855350494, -0.02283693663775921, 0.010078513994812965, 0.060937874019145966, -0.05959244817495346, -0.07289675623178482, -0.061026956886053085, 0.026260530576109886, -0.10004333406686783, -0.0533367320895195, -0.06284599006175995, -0.01570820063352585, 0.002803186420351267, -0.11499055474996567, -0.013841734267771244, 0.08048240840435028, -0.012003477662801743, 0.0055280751548707485, 0.09099346399307251, 0.04617050662636757, -0.07307102531194687, -0.06879962235689163, 0.009755403734743595, -0.013119513168931007, 0.03069787099957466, -0.018623851239681244, -0.014482286758720875, 0.031487394124269485, -0.0019239044049754739, -0.001585752354003489, -0.053174085915088654, -0.015423213131725788, -0.013879199512302876, -0.004432485438883305, -0.019580665975809097, 0.00581607548519969, 0.009278710000216961, -0.056858573108911514, -0.025287924334406853, 0.042740385979413986, -0.03200019523501396, -0.02571975253522396, -0.09934735298156738, -0.07372476160526276, 0.006474577821791172, 0.09412196278572083, 0.03206690400838852, 0.007034534588456154, -0.0008944946457631886, -0.003981023095548153, 0.04198724776506424, -0.06434299796819687, 0.012628501281142235, -0.04076729342341423, 0.04432174563407898, 0.04197942838072777, 0.03911643475294113, 0.08446777611970901, 0.006114077754318714, 0.07067957520484924, -0.07244584709405899, -0.037382349371910095, -0.005419336259365082, 0.08603442460298538, -0.04195268452167511, -0.017952395603060722, 0.05585016682744026, 0.05815223976969719, -0.08166807889938354, 0.04544815421104431, 0.04344175383448601, 0.018875030800700188, 0.08702024072408676, -0.038260143250226974, 0.015704667195677757, 0.002550791949033737, -0.06061286851763725, -0.04062442108988762, -0.09094800055027008, 0.1028638631105423, -0.07956420630216599, -0.05202732980251312, -0.08229716122150421, -0.027507523074746132, -0.05174197629094124, -0.07941434532403946, -0.08157717436552048, -0.008584331721067429, -0.04308849200606346, -0.038085635751485825, 0.0247200895100832, 0.06323526799678802, -0.04997187480330467, -5.489643841680517e-33, -0.0046381233260035515, 0.1052367091178894, 0.060065314173698425, 0.042798154056072235, -0.0766497477889061, 0.06785157322883606, 0.08304843306541443, -0.1165829673409462, -0.03983726724982262, -0.05558596923947334, 0.0022914607543498278, -0.00829300843179226, -0.046271976083517075, 0.06557636708021164, 0.08217117935419083, -0.08328897505998611, 0.0290201585739851, 0.02062394469976425, 0.020503399893641472, -0.013726912438869476, 0.057494569569826126, 0.07687711715698242, -0.031466782093048096, 0.02754574827849865, -0.003978281281888485, 0.08512496203184128, 0.013812351040542126, 0.025132067501544952, 0.022741932421922684, -0.030549583956599236, -0.03826478496193886, 0.03713875263929367, -0.07911020517349243, 0.02440759539604187, -0.04639734700322151, 0.012631767429411411, 0.03112555854022503, 0.042596347630023956, -0.02651924267411232, -0.01411779411137104, 0.059703387320041656, 0.11528787761926651, -0.051589272916316986, 0.033652376383543015, -0.032153647392988205, 0.046025801450014114, 0.12074501067399979, -0.007117371074855328, -0.02036968618631363, -0.025526460260152817, -0.03782154619693756, -0.020117193460464478, -0.03934705629944801, 0.04026883840560913, 0.01710936240851879, -0.0032029380090534687, -0.05935801938176155, -0.02129618264734745, 0.024212507531046867, -0.07722718268632889, -0.030762486159801483, -0.04665442556142807, 0.03311382234096527, -0.03483905270695686, 0.06606127321720123, 0.02784855291247368, -0.06161407008767128, 0.05079490318894386, 0.02577248215675354, 0.0659121572971344, -0.05162495747208595, 0.0705963671207428, 0.03916921466588974, -0.020796481519937515, -0.02175460010766983, -0.00235829153098166, 0.028714746236801147, -0.03840143606066704, 0.006751683074980974, 0.03595724329352379, -0.08168743550777435, 0.024835925549268723, 0.08177730441093445, 0.08081437647342682, -0.007479114457964897, 0.08027366548776627, 0.0015275153564289212, 0.08345376700162888, 0.09264502674341202, -0.011127523146569729, 0.044904787093400955, 0.06806593388319016, 0.13193270564079285, 0.08180981874465942, -0.009726285003125668, -4.588243029957084e-08, -0.01834220066666603, -0.0769280418753624, -0.016562247648835182, 0.04385409131646156, -0.012090380303561687, 0.005848773289471865, -0.0761980190873146, -0.00983275193721056, -0.010870059952139854, -0.0956752598285675, 0.021009571850299835, -0.00036355879274196923, -0.06092270463705063, -0.03305402025580406, -0.029594995081424713, -0.001050311140716076, -0.07456804811954498, -0.023607825860381126, 0.021560797467827797, -0.058813903480768204, -0.04001584276556969, -0.02419385313987732, -0.0055081406608223915, 0.05918975919485092, -0.030373455956578255, -0.0659136101603508, -0.006237532012164593, 0.01297310646623373, 0.07455621659755707, -0.016618354246020317, 0.006207526661455631, 0.007536082528531551, 0.04483293741941452, 0.0339522659778595, 0.04534045234322548, 0.006287597585469484, -0.04621899873018265, 0.1013900563120842, 0.02616710215806961, 0.03176865726709366, -0.10404301434755325, 0.05848563462495804, 0.014595329761505127, 0.03696759045124054, 0.0548374243080616, -0.02977750636637211, -0.019032420590519905, -0.03389924764633179, 0.020949453115463257, -0.10638964176177979, 0.008549711667001247, 0.03780025616288185, 0.01781075820326805, 0.1273302435874939, 0.040449682623147964, -0.003268170403316617, -0.10415071994066238, -0.05270300433039665, -0.009856651537120342, 0.008217223919928074, -0.02662702649831772, -0.05135824531316757, -0.06276249140501022, -0.05977293476462364 ] }, { "text": ")\n(branch3x3dbl_2): BasicConv2d(\n(conv): Conv2d(64, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(96, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3): BasicConv2d(\n(conv): Conv2d(96, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(96, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(192, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(32, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_5c): InceptionA(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(256, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_21", "embedding": [ -0.01895609311759472, -0.07461293786764145, -0.08435079455375671, -0.03267616033554077, 0.029609527438879013, -0.09689193218946457, -0.030046356841921806, 0.022267993539571762, -0.044542960822582245, -0.05945355072617531, 0.019346222281455994, -0.045953404158353806, 0.0022292768117040396, -0.034450631588697433, 0.0007574514602310956, 0.06695668399333954, -0.033998098224401474, 0.06976506114006042, -0.08680421859025955, -0.0008995659300126135, 0.02715848758816719, 0.0591595284640789, 0.02017856203019619, 0.017799802124500275, 0.0210659708827734, -0.0023665395565330982, 0.026196477934718132, 0.0354071706533432, 0.02220838889479637, -0.08086583763360977, 0.07036897540092468, 0.06929697096347809, -0.03181786835193634, 0.007079921662807465, 0.06735467910766602, 0.0003669873985927552, -0.01788521558046341, -0.01520944107323885, -0.061511993408203125, 0.0657091736793518, 0.02977408841252327, 0.07637157291173935, 0.05860016122460365, 0.014674815349280834, 0.07135497033596039, 0.13652031123638153, -0.034178562462329865, -0.011077096685767174, 0.036252181977033615, -0.03876728564500809, -0.020387111231684685, -0.05076313763856888, 0.04622884839773178, -0.029264671728014946, -0.02359539084136486, 0.05768492817878723, -0.005295491777360439, -0.00047618374810554087, 0.02989988960325718, -0.017007451504468918, 0.051788605749607086, -0.029021890833973885, -0.0006979446043260396, -0.02680162526667118, 0.04088035970926285, -0.0860428735613823, -0.02875988557934761, 0.01598142459988594, 0.02967711351811886, 0.06042074039578438, -0.050630904734134674, 0.01973506063222885, -0.06146886572241783, -0.05278491601347923, 0.032279402017593384, -0.014542771503329277, 0.09446229785680771, 0.0065246387384831905, -0.017411718145012856, -0.14605726301670074, -0.027400456368923187, -0.017157772555947304, 0.00559265399351716, -0.08178751915693283, 0.011154990643262863, -0.007668155711144209, 0.014254102483391762, 0.05637368932366371, -0.015763238072395325, 0.011064332909882069, 0.023976892232894897, 0.08628065884113312, -0.11331763863563538, -0.035769399255514145, 0.020277775824069977, 0.014776771888136864, 0.05932994559407234, 0.02074054442346096, 0.03488095477223396, 0.05462999269366264, 0.04119688272476196, -0.038459472358226776, -0.008593207225203514, 0.07317560166120529, -0.018978474661707878, 0.008541502058506012, 0.09654442220926285, 0.08712421357631683, -0.017652474343776703, -0.0441427156329155, 0.07618899643421173, 0.005645549390465021, 0.05209957808256149, -0.01758922077715397, 0.07858114689588547, 0.061733048409223557, 0.016292709857225418, 0.028171785175800323, 0.013347279280424118, 0.03274944797158241, -0.07175692915916443, -0.036520861089229584, 0.004245957359671593, 0.051226161420345306, -0.10337202996015549, -0.016492385417222977, -0.050232015550136566, 4.937860548590797e-33, -0.05948234349489212, -0.03753481060266495, -0.09171432256698608, -0.030368026345968246, 0.012769053690135479, 0.07350987195968628, -0.038549818098545074, -0.0925220251083374, -0.05621736869215965, 0.016884762793779373, -0.11996231228113174, -0.06260881572961807, -0.03410186991095543, 0.004513416904956102, -0.037855952978134155, -0.09980648756027222, -0.02143269218504429, 0.06681894510984421, -0.02295614778995514, 0.02290862612426281, 0.10817538946866989, 0.0406096875667572, -0.04926475137472153, -0.061902426183223724, 0.007663135416805744, -0.04924856871366501, 0.0002235228312201798, -0.018841708078980446, -0.007244135718792677, 0.02452748827636242, 0.015687409788370132, -0.0022618297953158617, -0.046461235731840134, -0.03988977521657944, -0.02969563566148281, 0.009138393215835094, -0.039643991738557816, -0.004038368351757526, -0.0029443069361150265, -0.056371647864580154, -0.027620160952210426, 0.052275341004133224, 0.008679967373609543, -0.06034214794635773, -0.08682962507009506, -0.07007520645856857, 0.01706100068986416, 0.08291507512331009, 0.031364019960165024, 0.007474912330508232, 0.010699686594307423, 0.008713062852621078, 0.025816095992922783, -0.07009803503751755, 0.026267020031809807, -0.040229808539152145, 0.03840770199894905, 0.05886117368936539, 0.05002598837018013, 0.07194039970636368, -0.011378229595720768, 0.04786654934287071, -0.09787403047084808, -0.012513681314885616, -0.025967281311750412, 0.08172052353620529, -0.021260609850287437, 0.0072066569700837135, 0.035173483192920685, 0.03430639207363129, -0.11295903474092484, 0.03541731834411621, 0.006826955359429121, 0.009930828586220741, 0.06206924095749855, -0.03525089845061302, 0.022958343848586082, -0.016913622617721558, -0.04365606606006622, -0.06926998496055603, -0.07560063898563385, 0.11614905297756195, -0.056258197873830795, -0.060572560876607895, -0.08312589675188065, -0.056026119738817215, -0.04830656573176384, -0.06695728749036789, -0.07565509527921677, -0.026188522577285767, -0.01937059871852398, -0.06913819164037704, 0.038638241589069366, 0.0550994910299778, -0.025721827521920204, -5.215352887833691e-33, 0.005599396303296089, 0.09332643449306488, 0.04642549157142639, 0.020682720467448235, -0.07190270721912384, 0.061916038393974304, 0.07348315417766571, -0.09524936228990555, -0.04055517166852951, -0.0859842598438263, 0.008395831100642681, 0.009087003767490387, -0.05564571171998978, 0.06938401609659195, 0.08987436443567276, -0.0752001404762268, 0.01096240896731615, -0.002143305726349354, 0.0013418139424175024, -0.01306763757020235, 0.07038389891386032, 0.06892305612564087, -0.03179251030087471, 0.03396858274936676, -0.07535596191883087, 0.05912056192755699, -0.0035911984741687775, 0.012411949224770069, 0.03582581505179405, -0.01622960716485977, -0.07151228934526443, 0.023940686136484146, -0.06819073855876923, 0.03392098471522331, -0.04035363718867302, -0.009338404051959515, 0.03709186986088753, 0.03431040048599243, -0.020703304558992386, -0.013830685056746006, 0.07797760516405106, 0.09262389689683914, -0.05369611829519272, 0.026936674490571022, -0.029066165909171104, 0.06862930208444595, 0.09033424407243729, -0.027852660045027733, -0.032170310616493225, 0.0027720534708350897, -0.06389736384153366, -0.030158843845129013, 0.00080825638724491, 0.04959757626056671, 0.04082612693309784, 0.00023148594482336193, -0.054496537894010544, -0.010003199800848961, 0.043096840381622314, -0.06108598783612251, -0.04605330154299736, -0.03943382948637009, 0.031338170170784, -0.028449194505810738, 0.042345885187387466, 0.03213496878743172, -0.0876811221241951, 0.06296364217996597, 0.03915034234523773, 0.0837017148733139, -0.04735128581523895, 0.07657108455896378, 0.019788067787885666, -0.027147721499204636, -0.045424945652484894, -0.022934820502996445, 0.0002992188383359462, -0.03553283214569092, -0.001115822815336287, 0.04538998380303383, -0.061702050268650055, 0.045934613794088364, 0.07171189039945602, 0.1001293808221817, 0.029065541923046112, 0.06682424247264862, 0.012268259190022945, 0.09040863066911697, 0.046755965799093246, -0.059506699442863464, 0.047210171818733215, 0.05415003374218941, 0.12274909019470215, 0.09960704296827316, 0.02326635643839836, -4.850296875247295e-08, -0.02108699083328247, -0.057687144726514816, -0.007128898054361343, 0.04530705139040947, -0.019924532622098923, -0.02594662830233574, -0.045025721192359924, 0.008498191833496094, -0.046610359102487564, -0.08291129767894745, 0.01666349545121193, 0.00866815634071827, -0.05235127732157707, -0.06035759672522545, 0.023799525573849678, 0.03381259739398956, -0.07299640029668808, -0.05226278677582741, 0.025673534721136093, -0.05092104524374008, -0.05463779717683792, -0.020779667422175407, -0.003374415449798107, 0.08291750401258469, -0.04715344309806824, -0.04630938172340393, -0.009699046611785889, 0.02105305902659893, 0.06470681726932526, -0.030779743567109108, 0.02790892869234085, 0.01425298023968935, 0.04160933569073677, 0.04838612303137779, 0.009891333058476448, -0.004076050594449043, -0.033391278237104416, 0.07121194154024124, 0.027665693312883377, 0.03244379162788391, -0.09124608337879181, 0.0851929634809494, 0.02354862540960312, 0.004381345119327307, 0.055598631501197815, -0.004333104472607374, -0.016696872189641, -0.02125086821615696, 0.011128276586532593, -0.08468187600374222, 0.0004314063990022987, 0.040248967707157135, -0.008563805371522903, 0.14108432829380035, 0.04010893404483795, -0.012567722238600254, -0.13073007762432098, -0.039183732122182846, -0.00048392999451607466, 0.010964758694171906, -0.03821831941604614, -0.05737246200442314, -0.05152216926217079, -0.06594078987836838 ] }, { "text": ")\n)\n(Mixed_5c): InceptionA(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(256, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch5x5_1): BasicConv2d(\n(conv): Conv2d(256, 48, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(48, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch5x5_2): BasicConv2d(\n(conv): Conv2d(48, 64, kernel_size=(5, 5), stride=(1, 1), padding=(2, 2), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_1): BasicConv2d(\n(conv): Conv2d(256, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_22", "embedding": [ -0.03444947674870491, -0.07496115565299988, -0.01869131252169609, -0.016425911337137222, 0.01781308278441429, -0.08642809838056564, -0.05024949833750725, 0.017678329721093178, -0.05624109134078026, -0.08636254072189331, -0.013328216969966888, -0.07738469541072845, -0.03470189496874809, -0.06620049476623535, -0.03835936635732651, 0.08246573805809021, 0.005875684786587954, 0.08178748935461044, -0.07745559513568878, -0.03415966406464577, 0.007743149064481258, 0.054984625428915024, 0.01047908328473568, 0.01459647249430418, 0.015300208702683449, 0.03239396959543228, 0.010737222619354725, 0.04634430631995201, 0.04310379549860954, -0.1226712167263031, 0.10106711089611053, 0.08664131164550781, -0.06281919032335281, 2.7327627321938053e-05, 0.0037061681505292654, 0.025875648483633995, -0.04309937357902527, -0.001729705953039229, -0.01865002140402794, 0.0011353840818628669, 0.03890892490744591, 0.07726231962442398, 0.04209337383508682, -0.0024642806965857744, 0.07261434942483902, 0.08819524943828583, -0.019457688555121422, 0.02407381311058998, 0.04493850842118263, -0.05443920940160751, -0.016695037484169006, -0.05882422626018524, 0.018124675378203392, -0.040758803486824036, -0.019818980246782303, 0.044973377138376236, -0.00489319022744894, -0.025673482567071915, 0.03337395563721657, 0.004197658039629459, 0.019316304475069046, -0.03732318803668022, -0.022455386817455292, -0.010339832864701748, 0.029213065281510353, -0.09026502072811127, 0.005977509543299675, -0.013259487226605415, 0.05570394918322563, 0.0744631215929985, -0.015093459747731686, 0.013655919581651688, -0.01899752765893936, -0.03128070756793022, 0.01938430406153202, -0.010648436844348907, 0.05146991088986397, 3.438736166572198e-05, -0.007315638475120068, -0.1172834113240242, -0.020018886774778366, -0.005736430175602436, 0.019435375928878784, -0.09599434584379196, 0.023883340880274773, 0.005237367004156113, -0.001783233368769288, 0.04895137995481491, 0.0028273751959204674, 0.011335073038935661, 0.0270561370998621, 0.09048555791378021, -0.09804259240627289, -0.04830142483115196, 0.04135118052363396, -0.006617311853915453, 0.03028632327914238, -0.005884034559130669, 0.026335662230849266, 0.06422216445207596, 0.043339744210243225, -0.0733172819018364, -0.0285237655043602, 0.05203082785010338, -0.014226329512894154, -0.0010076522594317794, 0.12014297395944595, 0.05379465967416763, -0.0010655756341293454, -0.042194392532110214, 0.05186714977025986, 0.022014500573277473, 0.04059974476695061, -0.006786004640161991, 0.08260418474674225, 0.03825537487864494, -0.015373541973531246, 0.02474251762032509, -0.008420883677899837, 0.02355511300265789, -0.1295064389705658, -0.02598576433956623, 0.006064359098672867, 0.04433111101388931, -0.14080998301506042, -0.04190551117062569, -0.10139837861061096, 5.631088505521071e-33, -0.04911525920033455, -0.06981853395700455, -0.030276555567979813, -0.012991738505661488, 0.022505823522806168, 0.08337709307670593, -0.0433058887720108, -0.10016077011823654, -0.04134068265557289, 0.004079307429492474, -0.09491556137800217, -0.06814077496528625, -0.06708503514528275, 0.02318049594759941, -0.021213218569755554, -0.10502803325653076, -0.0072290655225515366, 0.05754164233803749, -0.024726897478103638, -5.500991392182186e-05, 0.07563883066177368, 0.02015385590493679, -0.07617277652025223, -0.0590970404446125, -0.012245283462107182, 0.022891253232955933, 0.02150370366871357, -0.024281451478600502, -0.018383974209427834, 0.027729028835892677, -0.0749591737985611, 0.003088693367317319, -0.04282335564494133, -0.02895549312233925, 0.02356615476310253, 0.019186481833457947, 0.0267531368881464, 0.03697831556200981, 0.002686229068785906, -0.049941107630729675, -0.00847266148775816, 0.07368122786283493, 0.016864527016878128, -0.06351169943809509, -0.09894188493490219, -0.06539377570152283, -0.03734242916107178, 0.11455759406089783, 0.03389368951320648, 0.025790510699152946, 0.026562390848994255, -0.032653991132974625, 0.03471173346042633, -0.07733581215143204, 0.00472536263987422, -0.011984582059085369, 0.050404105335474014, 0.058320194482803345, 0.057048022747039795, 0.10482172667980194, 0.01818278431892395, 0.03252894803881645, -0.0755748525261879, -0.03386268392205238, -0.03854970261454582, 0.08746959269046783, -0.07198922336101532, -0.011389555409550667, 0.051109980791807175, 0.0681104063987732, -0.08339682966470718, 0.07001455873250961, 0.03685339167714119, 0.02905084937810898, 0.08019790053367615, -0.047383252531290054, 0.011017221957445145, -0.005821106024086475, -0.07273708283901215, -0.004462932236492634, -0.051637325435876846, 0.13458885252475739, -0.04743329435586929, -0.07308458536863327, -0.08234310895204544, -0.006803848315030336, -0.04732154682278633, -0.06263358145952225, -0.09437676519155502, 0.007936535403132439, -0.007981223985552788, -0.04801278933882713, 0.07424500584602356, 0.052557941526174545, -0.05914441868662834, -6.204473711359059e-33, -0.007924223318696022, 0.0906081572175026, 0.06087494641542435, 0.053164042532444, -0.035988058894872665, 0.06206448748707771, 0.0766313225030899, -0.08618495613336563, -0.04015985131263733, -0.04888628423213959, 0.04062129557132721, 0.002024783054366708, -0.042852092534303665, 0.06269112229347229, 0.0895964652299881, -0.09633679687976837, 0.007388116791844368, 0.045199375599622726, 0.0543689988553524, -0.005303195212036371, 0.06385035812854767, 0.06191770359873772, -0.045314762741327286, 0.013164491392672062, -0.017436638474464417, 0.04360073432326317, -0.03496923670172691, 0.05385204032063484, 0.05221760272979736, -0.04325684532523155, -0.04423875734210014, 0.03187978267669678, -0.08980439603328705, 0.03469568490982056, -0.0005252971895970404, 0.016079258173704147, 0.016740307211875916, 0.03619155287742615, -0.028817707672715187, -0.016206251457333565, 0.03547849506139755, 0.10365056991577148, -0.06099258363246918, 0.03612540662288666, -0.028950154781341553, 0.03021252527832985, 0.07955684512853622, -0.007357488851994276, -0.03471144661307335, -0.027946824207901955, -0.0412614569067955, -0.019133228808641434, -0.05861043930053711, 0.0477285198867321, -0.023768292739987373, 0.002296725520864129, -0.02659878320991993, -0.010843266732990742, 0.0639258325099945, -0.041756678372621536, -0.042859554290771484, -0.046357106417417526, -0.005183541215956211, -0.05311630293726921, 0.05406444892287254, 0.025976156815886497, -0.05269623175263405, 0.058934394270181656, -0.006200831383466721, 0.07536490261554718, -0.04807335510849953, 0.04163120687007904, 0.02330322004854679, 0.009813982993364334, -0.021275704726576805, -0.03457336872816086, 0.028486602008342743, -0.027916260063648224, 0.027719771489501, 0.01596207544207573, -0.07296943664550781, 0.022900572046637535, 0.04296611249446869, 0.05364519730210304, 0.026611050590872765, 0.07523009181022644, 0.005924304481595755, 0.06870298832654953, 0.08003482967615128, 0.01762356609106064, 0.045510586351156235, 0.06399451196193695, 0.10079588741064072, 0.08007554709911346, 0.007433915976434946, -5.371623501559952e-08, -0.010663672350347042, -0.06284995377063751, -0.003592888591811061, 0.06765363365411758, 0.006217752583324909, -0.03397691622376442, -0.056051548570394516, -0.007910756394267082, 0.016984568908810616, -0.11457248777151108, 0.024535467848181725, 0.0007157968939282, -0.04851239547133446, -0.016960788518190384, -0.02461429312825203, 0.025577038526535034, -0.09800048917531967, -0.0010549355065450072, 0.038706060498952866, -0.03719942644238472, -0.054789941757917404, -0.020351601764559746, -0.016164636239409447, 0.033533528447151184, -0.04074973985552788, -0.10027535259723663, 0.009944639168679714, 0.053297970443964005, 0.07235417515039444, -0.03579787164926529, -0.021988529711961746, 0.02683486044406891, 0.025389479473233223, 0.023005982860922813, -0.0003512377734296024, 0.05098861828446388, -0.03878583386540413, 0.09098002314567566, -0.03490826487541199, 0.05071203038096428, -0.07210412621498108, 0.07038867473602295, 0.02501404844224453, -0.02655651792883873, 0.02650090679526329, -0.026047052815556526, 0.0051202173344790936, -0.067125104367733, 0.03848518803715706, -0.04100044444203377, 0.01707042008638382, 0.08297030627727509, 0.024767015129327774, 0.11315992474555969, 0.0424237996339798, -0.041588231921195984, -0.10101083666086197, -0.050201207399368286, -0.006741933524608612, -0.01362956129014492, -0.0389069989323616, -0.06382516026496887, -0.06659134477376938, -0.052771665155887604 ] }, { "text": "(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_2): BasicConv2d(\n(conv): Conv2d(64, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(96, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3): BasicConv2d(\n(conv): Conv2d(96, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(96, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(256, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_5d): InceptionA(\n(branch1x1): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_23", "embedding": [ -0.030540045350790024, -0.064955934882164, -0.07685361802577972, -0.031857531517744064, 0.024786004796624184, -0.08173973858356476, -0.03911556676030159, 0.02120891772210598, -0.052462901920080185, -0.06025286391377449, 0.019918499514460564, -0.06293754279613495, -0.0005891358596272767, -0.04091225564479828, 0.012046167626976967, 0.07596894353628159, -0.025368696078658104, 0.06654916703701019, -0.08722146600484848, 0.01078631542623043, 0.019373517483472824, 0.05459064245223999, 0.024995101615786552, 0.020688779652118683, 0.011220520362257957, 0.01343977265059948, 0.02661067806184292, 0.027145445346832275, 0.006214873865246773, -0.08741949498653412, 0.05191127210855484, 0.05708624795079231, -0.03325057029724121, -0.0011338976910337806, 0.07743839174509048, -0.008304635062813759, -0.014254886656999588, -0.007635442074388266, -0.0694606751203537, 0.03967106714844704, 0.02504502609372139, 0.06842876970767975, 0.058673638850450516, 0.019958749413490295, 0.07562730461359024, 0.13834181427955627, -0.022605793550610542, -0.02228561043739319, 0.03127674013376236, -0.030786385759711266, -0.018797926604747772, -0.059442292898893356, 0.027956491336226463, -0.030297283083200455, -0.016294686123728752, 0.07077702134847641, -0.017093880102038383, 0.021054459735751152, 0.030327798798680305, -0.019618453457951546, 0.04922096058726311, -0.034048572182655334, -0.009335783310234547, -0.026892485097050667, 0.044479500502347946, -0.08519382029771805, -0.021340489387512207, 0.018696287646889687, 0.038576889783144, 0.06838933378458023, -0.033842094242572784, 0.013533209450542927, -0.05865871161222458, -0.058793969452381134, 0.02307678945362568, -0.015566741116344929, 0.09221785515546799, -0.0076126838102936745, -0.01808781735599041, -0.14459151029586792, -0.025225400924682617, -0.02218647673726082, 0.0074197580106556416, -0.09604629874229431, 0.026414519175887108, -0.0030985514167696238, 0.02170613221824169, 0.04129251465201378, 0.0007590839522890747, 0.02047141268849373, 0.032241761684417725, 0.06971053779125214, -0.10468583554029465, -0.03863031044602394, 0.02460447885096073, 0.014794344082474709, 0.04593828320503235, 0.02720009721815586, 0.049509331583976746, 0.049242209643125534, 0.04809289798140526, -0.03188967704772949, -0.01620783470571041, 0.08376549929380417, -0.013961033895611763, 0.01756715215742588, 0.09431804716587067, 0.07797905802726746, -0.004207840654999018, -0.038596346974372864, 0.08263267576694489, 0.02125355787575245, 0.05772743374109268, -0.01876681111752987, 0.06534746289253235, 0.053093306720256805, 0.0028617349453270435, 0.03357725962996483, 0.0050473902374506, 0.04288062825798988, -0.07898654043674469, -0.03108317218720913, 0.0186407919973135, 0.058408863842487335, -0.09400492906570435, -0.018765153363347054, -0.05143612250685692, 5.689803713660675e-33, -0.06643550843000412, -0.045126914978027344, -0.09031806141138077, -0.03299877420067787, 0.002352445852011442, 0.07729066908359528, -0.044771790504455566, -0.0705079659819603, -0.06338046491146088, 0.009557578712701797, -0.11245313286781311, -0.0578860342502594, -0.04403160512447357, -3.648937490652315e-05, -0.03970791772007942, -0.10670524835586548, -0.028489291667938232, 0.07512575387954712, -0.01831597089767456, 0.016278455033898354, 0.11243893206119537, 0.0462275929749012, -0.054022058844566345, -0.06714824587106705, 0.0062439232133328915, -0.031003378331661224, 0.03566734865307808, -0.00945874024182558, -0.02312423661351204, 0.024752123281359673, 0.016807235777378082, -0.014079872518777847, -0.05617426708340645, -0.03300110995769501, -0.023212095722556114, 0.017968017607927322, -0.04331592842936516, -0.010225307196378708, 0.005805604159832001, -0.047660935670137405, -0.036655671894550323, 0.05103446915745735, -0.013292266987264156, -0.04902241751551628, -0.09159485250711441, -0.06313401460647583, 0.010416421107947826, 0.08561680465936661, 0.037845734506845474, 0.0004830931720789522, 0.012004426680505276, -0.003741687396541238, 0.02540910430252552, -0.06361918151378632, 0.01453381683677435, -0.045991599559783936, 0.03661481291055679, 0.046513572335243225, 0.04129853472113609, 0.05150937661528587, 0.001946292701177299, 0.06376402080059052, -0.09039199352264404, -0.022223854437470436, -0.018112389370799065, 0.08029844611883163, -0.01901417225599289, 0.005597058217972517, 0.0330631397664547, 0.0319979153573513, -0.09983012825250626, 0.026806384325027466, 0.009496938437223434, 0.015197157859802246, 0.07443347573280334, -0.026739129796624184, 0.02552822232246399, -0.005325580947101116, -0.04862000793218613, -0.06524449586868286, -0.07468625903129578, 0.11468417197465897, -0.06906329095363617, -0.06362144649028778, -0.08845478296279907, -0.05051935464143753, -0.05637248978018761, -0.07207698374986649, -0.07168973237276077, -0.024427130818367004, -0.023533755913376808, -0.05860741436481476, 0.024977507069706917, 0.0702589750289917, -0.04469894617795944, -5.6402364229643605e-33, 0.012627847492694855, 0.09150876849889755, 0.05273367464542389, 0.027208952233195305, -0.07921944558620453, 0.0645654946565628, 0.07763785123825073, -0.10682109743356705, -0.04549293965101242, -0.08753322064876556, 0.002900119870901108, -0.005192135460674763, -0.05447803810238838, 0.07025139778852463, 0.0852397158741951, -0.07625973224639893, 0.025298314169049263, 0.004670231137424707, 0.002128730993717909, -0.015485928393900394, 0.06351353973150253, 0.06075865030288696, -0.04341968894004822, 0.04322807490825653, -0.05271844193339348, 0.06484462320804596, -0.00016255039372481406, 0.011751444078981876, 0.040102507919073105, -0.01474215742200613, -0.052748531103134155, 0.03532438352704048, -0.06756848096847534, 0.021876493468880653, -0.049857500940561295, 0.009396216832101345, 0.02861196920275688, 0.034418173134326935, -0.022043362259864807, -0.01309254765510559, 0.06687327474355698, 0.1067853718996048, -0.05589380860328674, 0.027626169845461845, -0.028122620657086372, 0.07007192075252533, 0.10334372520446777, -0.022736303508281708, -0.023329269140958786, 0.00494903651997447, -0.05765996873378754, -0.0366181954741478, -0.006718933582305908, 0.038249801844358444, 0.03844745457172394, -0.0074179754592478275, -0.049814373254776, -0.029188545420765877, 0.018333353102207184, -0.06738100945949554, -0.030638743191957474, -0.023573433980345726, 0.04217477887868881, -0.04503851383924484, 0.044485848397016525, 0.03855394944548607, -0.06774170696735382, 0.06148383393883705, 0.033416539430618286, 0.07476737350225449, -0.037806104868650436, 0.07440992444753647, 0.015548830851912498, -0.02315659262239933, -0.04847043380141258, -0.011879315599799156, 0.02128099650144577, -0.03783489018678665, 0.0058348821476101875, 0.03743293881416321, -0.056942157447338104, 0.035384051501750946, 0.09093759953975677, 0.10670995712280273, 0.009935647249221802, 0.0821857899427414, -0.0022464401554316282, 0.08252555876970291, 0.06665124744176865, -0.03874541446566582, 0.04087443649768829, 0.054446883499622345, 0.13265635073184967, 0.09973681718111038, 0.004505108576267958, -4.9141743119207604e-08, -0.01278945803642273, -0.06686240434646606, -0.010675499215722084, 0.05213570594787598, -0.03332938626408577, -0.015044711530208588, -0.06592259556055069, 0.004004613496363163, -0.029871942475438118, -0.10409653931856155, 0.016815856099128723, -0.0035827176179736853, -0.05899663269519806, -0.055253930389881134, 0.00765529228374362, 0.01119585707783699, -0.07401393353939056, -0.04688279703259468, 0.027826573699712753, -0.05248810350894928, -0.045866161584854126, -0.01802876777946949, 0.002934572985395789, 0.0684329941868782, -0.04054512083530426, -0.04307204857468605, -0.00808817520737648, 0.025658899918198586, 0.06701692193746567, -0.0294828899204731, 0.027005473151803017, 0.008228844963014126, 0.04488237202167511, 0.0454409085214138, 0.016599394381046295, -0.006889608688652515, -0.028153089806437492, 0.08113859593868256, 0.037155017256736755, 0.02529686503112316, -0.095931775867939, 0.08285079151391983, 0.030461912974715233, 0.020617106929421425, 0.04790874198079109, -0.021900342777371407, -0.015377034433186054, -0.03987432271242142, 0.006418140139430761, -0.0921999141573906, 0.016205085441470146, 0.031862374395132065, -0.001266741193830967, 0.1526513397693634, 0.033671971410512924, 0.0006746436702087522, -0.12342046201229095, -0.041904568672180176, -0.009273843839764595, 0.008486328646540642, -0.03341023623943329, -0.06666287034749985, -0.05578117072582245, -0.06298043578863144 ] }, { "text": "(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_5d): InceptionA(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(288, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch5x5_1): BasicConv2d(\n(conv): Conv2d(288, 48, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(48, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch5x5_2): BasicConv2d(\n(conv): Conv2d(48, 64, kernel_size=(5, 5), stride=(1, 1), padding=(2, 2), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_1): BasicConv2d(\n(conv): Conv2d(288, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_24", "embedding": [ -0.040614716708660126, -0.07363653182983398, -0.03291601687669754, -0.011889917775988579, 0.02411103993654251, -0.07806703448295593, -0.052758075296878815, 0.027078721672296524, -0.052065130323171616, -0.07218912988901138, 0.001202713930979371, -0.0758025124669075, -0.01762184128165245, -0.06658517569303513, -0.01601511612534523, 0.08130653202533722, 0.0005356979090720415, 0.06656264513731003, -0.0757131576538086, -0.019549671560525894, 0.0011887772707268596, 0.05660446733236313, 0.017976410686969757, 0.02254028432071209, 0.01499179471284151, 0.036306384950876236, 0.013590761460363865, 0.0323464535176754, 0.024835292249917984, -0.12116877734661102, 0.07784663140773773, 0.07139327377080917, -0.05674901604652405, 0.007222278043627739, 0.039694640785455704, 0.024242807179689407, -0.020627247169613838, 0.008831929415464401, -0.03771282732486725, 0.0017928933957591653, 0.0395587794482708, 0.06237777695059776, 0.05122861638665199, 0.006186029873788357, 0.08092155307531357, 0.08949309587478638, -0.029035957530140877, 0.001617199508473277, 0.032592084258794785, -0.04556169733405113, -0.025828205049037933, -0.06036878377199173, 0.016927767544984818, -0.04090960696339607, -0.011455487459897995, 0.06070547178387642, -0.0037107362877577543, -0.011091754771769047, 0.04043082892894745, 0.00152186572086066, 0.019257651641964912, -0.04056278616189957, -0.027452316135168076, -0.025756392627954483, 0.0497986376285553, -0.08486080169677734, 0.0017609959468245506, 0.014076326042413712, 0.06333212554454803, 0.07753866910934448, -0.00948940496891737, 0.0164358988404274, -0.03588506206870079, -0.03556308150291443, 0.017646396532654762, -0.01691293902695179, 0.05036022886633873, -0.009403716772794724, -0.012373171746730804, -0.13763470947742462, -0.02888505719602108, -0.02083193138241768, 0.009861203841865063, -0.12008004635572433, 0.025115154683589935, 0.007428975775837898, 0.02450169064104557, 0.04750283062458038, 0.012688891962170601, 0.013894051313400269, 0.018490109592676163, 0.0775972306728363, -0.09199301898479462, -0.04500053450465202, 0.048057690262794495, 0.015504978597164154, 0.027173498645424843, 0.00891296286135912, 0.04464368149638176, 0.0555119514465332, 0.04951391741633415, -0.041918739676475525, -0.036843277513980865, 0.06057889014482498, -0.015116329304873943, -0.0025633173063397408, 0.10744592547416687, 0.04508261755108833, 0.002501784823834896, -0.04517810419201851, 0.08367731422185898, 0.031084878370165825, 0.05310956761240959, -0.0026594216469675303, 0.08268840610980988, 0.037345826625823975, -0.012366111390292645, 0.03181981295347214, -0.011077514849603176, 0.031702276319265366, -0.1034632995724678, -0.02084384486079216, 0.017546189948916435, 0.05018916353583336, -0.12826836109161377, -0.04251796007156372, -0.08310487866401672, 5.9081499526159915e-33, -0.05518566444516182, -0.07972647994756699, -0.03690497204661369, -0.01864626817405224, 0.01380503922700882, 0.07030759006738663, -0.0596449188888073, -0.08473382890224457, -0.047549981623888016, 0.011260727420449257, -0.09897148609161377, -0.05071764439344406, -0.075328029692173, 0.003872544737532735, -0.010271136648952961, -0.11773544549942017, -0.015037041157484055, 0.07685580849647522, -0.016387421637773514, -0.009424577467143536, 0.07703898847103119, 0.02984536811709404, -0.07370780408382416, -0.06929171830415726, 0.010182696394622326, 0.008893386460840702, 0.0376436747610569, -0.018306395038962364, -0.020945299416780472, 0.0303193312138319, -0.047791291028261185, 0.004916917998343706, -0.06490153819322586, -0.012524817138910294, 0.0033996785059571266, 0.014242002740502357, -0.0018706792034208775, 0.022023305296897888, 0.012335516512393951, -0.04986157268285751, -0.026929307729005814, 0.06248537823557854, -0.009004920721054077, -0.04592820629477501, -0.09942969679832458, -0.07525203377008438, -0.023581035435199738, 0.10217756032943726, 0.04136769473552704, 0.020792385563254356, 0.011472713202238083, -0.028165413066744804, 0.034774214029312134, -0.0792553648352623, 0.004806398414075375, -0.02390201948583126, 0.04553443565964699, 0.03846222534775734, 0.05549914762377739, 0.09057635068893433, 0.022489899769425392, 0.06063809245824814, -0.08509911596775055, -0.02307429537177086, -0.022766590118408203, 0.09243206679821014, -0.06433313339948654, -0.014715233817696571, 0.0467824712395668, 0.06599637866020203, -0.08078443259000778, 0.049573127180337906, 0.03226502239704132, 0.014536594040691853, 0.09552866220474243, -0.04481446370482445, 0.024912606924772263, 0.007202384993433952, -0.0724845826625824, -0.011907810345292091, -0.0646943747997284, 0.1190979853272438, -0.06785755604505539, -0.06929183006286621, -0.08424930274486542, -0.010742916725575924, -0.058683689683675766, -0.07530666887760162, -0.09757062047719955, -0.002073603682219982, -0.025821717455983162, -0.03033669851720333, 0.051248107105493546, 0.06714411824941635, -0.06302643567323685, -5.9898067697218155e-33, -0.012172802351415157, 0.09959493577480316, 0.07859741151332855, 0.05485430732369423, -0.04684970900416374, 0.06595847010612488, 0.07249314337968826, -0.10924592614173889, -0.04362265020608902, -0.052712127566337585, 0.01866414025425911, -0.010138390585780144, -0.05126648023724556, 0.058212995529174805, 0.08737693727016449, -0.09051070362329483, 0.029159005731344223, 0.03255467116832733, 0.040184155106544495, -0.0010893691796809435, 0.06066783517599106, 0.06988287717103958, -0.05007367953658104, 0.022075345739722252, -0.008677680045366287, 0.06304735690355301, -0.01590578816831112, 0.04248889163136482, 0.04618298262357712, -0.04110978916287422, -0.027871618047356606, 0.04818899556994438, -0.09272538125514984, 0.02805158868432045, -0.03545351326465607, 0.023216623812913895, 0.029638497158885002, 0.03076590597629547, -0.029070988297462463, -0.016861889511346817, 0.03741604834794998, 0.11670244485139847, -0.059996746480464935, 0.03271535038948059, -0.033294789493083954, 0.03423047065734863, 0.09843834489583969, -0.005013864953070879, -0.02566155418753624, -0.02886032499372959, -0.039946362376213074, -0.013655068352818489, -0.052224140614271164, 0.033778682351112366, -0.012369245290756226, -0.007606483064591885, -0.040594398975372314, -0.027975603938102722, 0.036615241318941116, -0.06217017397284508, -0.020522138103842735, -0.04221459478139877, 0.016469772905111313, -0.05419899523258209, 0.05210940167307854, 0.02492191269993782, -0.057338960468769073, 0.054276563227176666, -0.0013224722351878881, 0.07099556177854538, -0.03670846298336983, 0.05757690221071243, 0.027053948491811752, -0.0017945130821317434, -0.02274259738624096, -0.015189995057880878, 0.031429603695869446, -0.0419682115316391, 0.025877587497234344, 0.01839071698486805, -0.07375423610210419, 0.02921403758227825, 0.0628257617354393, 0.06754503399133682, 0.011260638944804668, 0.08630768209695816, -0.007157895248383284, 0.06813760101795197, 0.08830933272838593, 0.019584843888878822, 0.03737618774175644, 0.06496696174144745, 0.11562120914459229, 0.09527621418237686, -0.008049444295465946, -5.034840100393012e-08, -0.011675160378217697, -0.07359874993562698, -0.0037917722947895527, 0.06029333919286728, -0.006369310896843672, -0.01924494467675686, -0.08030200749635696, -0.010262939147651196, 0.008400538936257362, -0.11970384418964386, 0.017395302653312683, -0.00022056428133510053, -0.05191513150930405, -0.02110067568719387, -0.027878757566213608, 0.005914072971791029, -0.09320676326751709, -0.0031901539769023657, 0.029376698657870293, -0.040846411138772964, -0.030334213748574257, -0.01398221030831337, -0.0012583585921674967, 0.03629107400774956, -0.03632630035281181, -0.08271738886833191, 0.01016773097217083, 0.04716172814369202, 0.07175017893314362, -0.02727041393518448, -0.0035493767354637384, 0.019376585260033607, 0.03455498069524765, 0.029978351667523384, 0.017770539969205856, 0.02661401592195034, -0.024880914017558098, 0.10499030351638794, -0.013202317990362644, 0.029592545703053474, -0.08098048716783524, 0.067726731300354, 0.016821885481476784, 0.013302067294716835, 0.0314665250480175, -0.037578035145998, -0.00795735139399767, -0.05630509555339813, 0.029726078733801842, -0.07136449217796326, 0.019707150757312775, 0.061087049543857574, 0.02490328624844551, 0.12452615052461624, 0.04000473767518997, -0.011258496902883053, -0.10303943604230881, -0.04557998478412628, -0.020363416522741318, -0.005662949755787849, -0.022630849853157997, -0.06844700127840042, -0.0669034793972969, -0.05362814664840698 ] }, { "text": ")\n(branch3x3dbl_1): BasicConv2d(\n(conv): Conv2d(288, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_2): BasicConv2d(\n(conv): Conv2d(64, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(96, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3): BasicConv2d(\n(conv): Conv2d(96, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(96, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(288, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_25", "embedding": [ -0.02798716351389885, -0.07791612297296524, -0.086236871778965, -0.04145758971571922, 0.031692586839199066, -0.08325827866792679, -0.03599118813872337, 0.028213927522301674, -0.055384207516908646, -0.06148697808384895, 0.020340772345662117, -0.05733437463641167, -0.005285106599330902, -0.04887036979198456, 0.005109764635562897, 0.08574122935533524, -0.034098025411367416, 0.07699427008628845, -0.07534721493721008, 0.012662897817790508, 0.023733437061309814, 0.05133949592709541, 0.018583379685878754, 0.022261595353484154, 0.02246071957051754, 0.019509287551045418, 0.032860372215509415, 0.042197335511446, 0.008916349150240421, -0.09000540524721146, 0.07144655287265778, 0.043080683797597885, -0.03625115752220154, 0.005037091206759214, 0.04858065024018288, -0.01653381995856762, -0.01882144995033741, -0.005187658593058586, -0.06646993011236191, 0.05276694521307945, 0.01272596325725317, 0.07269682735204697, 0.06548597663640976, -0.0008563564042560756, 0.08028404414653778, 0.12502756714820862, -0.03260169178247452, -0.008545431308448315, 0.03749701753258705, -0.03782040253281593, -0.015683801844716072, -0.07054824382066727, 0.03700478374958038, -0.03138655051589012, -0.01573651097714901, 0.06458574533462524, -0.02050333097577095, 0.005781256128102541, 0.0360533632338047, -0.03594672307372093, 0.06121975928544998, -0.025381673127412796, -0.008951256982982159, -0.015097013674676418, 0.037811145186424255, -0.09029465913772583, -0.026888569816946983, 0.0049689533188939095, 0.028218073770403862, 0.06621215492486954, -0.055721476674079895, 0.013498503714799881, -0.04700685292482376, -0.0602024607360363, 0.035599153488874435, -0.02897827886044979, 0.08437523245811462, -8.72738310135901e-05, -0.01480424590408802, -0.13586431741714478, -0.02273719571530819, -0.01705930568277836, -0.002225035335868597, -0.07413957267999649, 0.016303788870573044, -0.0011851871386170387, 0.009939831681549549, 0.058030806481838226, -0.009345408529043198, 0.006367780733853579, 0.030368339270353317, 0.07700508832931519, -0.11023867875337601, -0.036071840673685074, 0.01910104602575302, 0.009202803485095501, 0.06412937492132187, 0.0046142409555613995, 0.048762429505586624, 0.05841100960969925, 0.04337151348590851, -0.044231075793504715, -0.009732818230986595, 0.08195801079273224, -0.01664687879383564, 0.01038778480142355, 0.09610574692487717, 0.08539872616529465, -0.012426454573869705, -0.027255484834313393, 0.07711338251829147, 0.0037846704944968224, 0.042425576597452164, -0.013808462768793106, 0.0788305476307869, 0.0566745288670063, 0.00105286983307451, 0.03480564057826996, 0.014170023612678051, 0.025082198902964592, -0.07136211544275284, -0.031713344156742096, 0.00859325286000967, 0.045183323323726654, -0.11130460351705551, -0.02741444669663906, -0.05933583527803421, 5.054043838832179e-33, -0.06916984170675278, -0.02377009019255638, -0.09143974632024765, -0.029618138447403908, 0.009941794909536839, 0.06841523200273514, -0.04622437059879303, -0.0784173384308815, -0.055258531123399734, 0.0254657119512558, -0.11528672277927399, -0.05406593531370163, -0.04792541638016701, 0.013881653547286987, -0.040270719677209854, -0.10608720034360886, -0.02154705859720707, 0.07736940681934357, -0.02456079237163067, 0.01779862493276596, 0.10461433976888657, 0.044478639960289, -0.05859070271253586, -0.055622849613428116, 0.0006815781816840172, -0.028095699846744537, 0.01166375819593668, -0.003614789107814431, -0.029699571430683136, 0.014765883795917034, 0.020818695425987244, -0.01849665306508541, -0.05162549763917923, -0.04447782784700394, -0.015514804981648922, 0.007703475654125214, -0.03707082197070122, -0.005493677221238613, 0.004192772321403027, -0.05070163309574127, -0.026069339364767075, 0.06669925153255463, 0.007218196056783199, -0.06772928684949875, -0.08987468481063843, -0.05131648853421211, 0.011986471712589264, 0.09220703691244125, 0.04407452791929245, 0.004509930033236742, 0.013883575797080994, 0.0026900311931967735, 0.030575647950172424, -0.056902918964624405, 0.022708363831043243, -0.04105619341135025, 0.039461590349674225, 0.055897485464811325, 0.041369665414094925, 0.05584483593702316, -0.013652858324348927, 0.038772281259298325, -0.07161756604909897, -0.031620025634765625, -0.02662617526948452, 0.08700422197580338, -0.03146744146943092, 0.010270911268889904, 0.045599766075611115, 0.04789261147379875, -0.1070629209280014, 0.03309541195631027, 0.03166602924466133, 0.009630762971937656, 0.074341781437397, -0.027101565152406693, 0.013445145450532436, -0.012782665900886059, -0.04835284501314163, -0.07087501138448715, -0.08625807613134384, 0.11371522396802902, -0.05888579040765762, -0.06154588237404823, -0.09344340115785599, -0.039090219885110855, -0.06255829334259033, -0.07129700481891632, -0.06844527274370193, -0.014514223672449589, -0.03772372007369995, -0.049450572580099106, 0.016539255157113075, 0.06238885223865509, -0.042890895158052444, -4.925227290397319e-33, 0.00693846121430397, 0.1031145453453064, 0.06178160384297371, 0.02165224589407444, -0.06787608563899994, 0.07644728571176529, 0.07557425647974014, -0.1013341099023819, -0.02369084022939205, -0.08175978064537048, 0.024748455733060837, -0.0023751279804855585, -0.061232030391693115, 0.07021649181842804, 0.08873582631349564, -0.06775370240211487, 0.007610399276018143, -0.002428211271762848, 0.008447574451565742, -0.026872418820858, 0.07174432277679443, 0.070908322930336, -0.04694770649075508, 0.031384192407131195, -0.056856390088796616, 0.06229797750711441, 0.01082555577158928, 0.011905292980372906, 0.037730466574430466, -0.00655773701146245, -0.049974385648965836, 0.03195786848664284, -0.055032145231962204, 0.04023418202996254, -0.04736423119902611, 0.010648868046700954, 0.038276344537734985, 0.034340597689151764, -0.019511466845870018, -0.019422300159931183, 0.06660763919353485, 0.10539032518863678, -0.04203636199235916, 0.027059948071837425, -0.023879189044237137, 0.06001691892743111, 0.10975179076194763, -0.018415167927742004, -0.024479107931256294, -7.830511458450928e-05, -0.06600459665060043, -0.03851458802819252, -0.0050587099976837635, 0.03614206239581108, 0.042928554117679596, -0.001601506839506328, -0.056991901248693466, -0.028604211285710335, 0.0398646779358387, -0.07351609319448471, -0.05701996758580208, -0.028056608512997627, 0.03124534897506237, -0.03404313698410988, 0.043098900467157364, 0.03145543485879898, -0.07455354928970337, 0.0519014336168766, 0.03151903301477432, 0.08947817981243134, -0.05301652476191521, 0.07189515233039856, 0.024157801643013954, -0.04087522253394127, -0.02966541238129139, -0.024503789842128754, 0.024124978110194206, -0.026551999151706696, 0.005189117509871721, 0.02981187403202057, -0.046942584216594696, 0.019849702715873718, 0.08690395951271057, 0.1007547527551651, 0.01592867448925972, 0.08424736559391022, -0.005344633478671312, 0.09029737859964371, 0.05898144468665123, -0.03740871325135231, 0.04874802380800247, 0.07101477682590485, 0.14146649837493896, 0.08316782116889954, 0.009052311070263386, -4.7225697130670596e-08, -0.017081664875149727, -0.06235164776444435, -0.01772138476371765, 0.041733939200639725, -0.03981202468276024, -0.013316425494849682, -0.04330628737807274, 0.002535875653848052, -0.04597952961921692, -0.10763304680585861, 0.02002570778131485, 0.0014258380979299545, -0.05379072204232216, -0.04722901061177254, 0.013749883510172367, 0.02214367501437664, -0.09026253968477249, -0.035861484706401825, 0.02229374274611473, -0.04734090715646744, -0.04318639636039734, -0.015156433917582035, 0.0024284066166728735, 0.060647450387477875, -0.03493167832493782, -0.04695228859782219, -0.022753329947590828, 0.01852654665708542, 0.06575755774974823, -0.0030908335465937853, 0.01894267462193966, 0.020672578364610672, 0.043832678347826004, 0.03802989795804024, 0.02778862975537777, -0.01134304329752922, -0.040057916194200516, 0.08394241333007812, 0.02370627224445343, 0.03489706292748451, -0.0755142942070961, 0.09120996296405792, 0.018660683184862137, 0.008996346965432167, 0.05334324762225151, -0.008032472804188728, -0.0100009236484766, -0.033515747636556625, 0.01318768598139286, -0.08844567835330963, 0.008603975176811218, 0.038143545389175415, 0.0032696151174604893, 0.13026177883148193, 0.035032592713832855, -0.006886976305395365, -0.13213005661964417, -0.027417898178100586, -0.005027837119996548, -0.00895604770630598, -0.02786843106150627, -0.06983684003353119, -0.039817992597818375, -0.057091567665338516 ] }, { "text": "(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_6a): InceptionB(\n(branch3x3): BasicConv2d(\n(conv): Conv2d(288, 384, kernel_size=(3, 3), stride=(2, 2), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_1): BasicConv2d(\n(conv): Conv2d(288, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(64, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_2): BasicConv2d(\n(conv): Conv2d(64, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(96, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3): BasicConv2d(\n(conv): Conv2d(96, 96, kernel_size=(3, 3), stride=(2, 2), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_26", "embedding": [ -0.04321657121181488, -0.09289839118719101, -0.06170373037457466, -0.035393450409173965, 0.0102292625233531, -0.07694174349308014, -0.043889135122299194, 0.012627975083887577, -0.04524565115571022, -0.0716521143913269, 0.009237349033355713, -0.08214197307825089, -0.017421307042241096, -0.0629207119345665, 0.008357901126146317, 0.09374004602432251, -0.00876934826374054, 0.07167734950780869, -0.07942616939544678, 0.011354900896549225, 0.009638805873692036, 0.048653505742549896, 0.02469305880367756, 0.040461692959070206, 0.02812555991113186, 0.04152144864201546, 0.037001509219408035, 0.03280694782733917, 0.02050221525132656, -0.11031001806259155, 0.07770420610904694, 0.07368224859237671, -0.043134454637765884, -0.004922616295516491, 0.05694599449634552, 0.008519620634615421, -0.030263246968388557, -0.013547219336032867, -0.07170889526605606, 0.010639171116054058, 0.03024088591337204, 0.0710398331284523, 0.06195627152919769, -0.002322270767763257, 0.0673418715596199, 0.11134044826030731, -0.027135411277413368, -0.013656499795615673, 0.0352449044585228, -0.048996809870004654, -0.02205655351281166, -0.08267280459403992, 0.015452437102794647, -0.009075411595404148, -0.007740351837128401, 0.07936876267194748, -0.03155897185206413, 0.013734408654272556, 0.030987922102212906, -0.007819296792149544, 0.03097957745194435, -0.0250661950558424, -0.016463667154312134, -0.020052531734108925, 0.08087825030088425, -0.07556379586458206, -0.025898437947034836, 0.000453199609182775, 0.04926586151123047, 0.067316435277462, -0.028669750317931175, 0.013543197885155678, -0.041933100670576096, -0.05193381756544113, 0.02681852877140045, -0.023126758635044098, 0.07427329570055008, -0.013109688647091389, -0.030323902145028114, -0.13554362952709198, -0.02452227845788002, -0.035734646022319794, 0.0053650978952646255, -0.07948638498783112, 0.0290693212300539, 0.008244344964623451, 0.0013955594040453434, 0.035701166838407516, -0.016727179288864136, 0.03122285008430481, 0.017440279945731163, 0.07201997190713882, -0.0935882180929184, -0.04544135928153992, 0.0309737641364336, 0.014204790815711021, 0.04289444535970688, 0.007789725437760353, 0.05892776697874069, 0.054595716297626495, 0.05591559782624245, -0.046637311577796936, -0.029794342815876007, 0.06836552917957306, -0.013746135868132114, 0.017351822927594185, 0.1010759100317955, 0.06849955767393112, 0.0018468023044988513, -0.021411439403891563, 0.08211062103509903, 0.03195462003350258, 0.05508238077163696, -0.01445839274674654, 0.05374687537550926, 0.05772808939218521, -0.010826907120645046, 0.028610698878765106, 0.0050539253279566765, 0.04131290689110756, -0.08797302842140198, -0.029842888936400414, 0.025283148512244225, 0.03846709802746773, -0.11761471629142761, -0.032972805202007294, -0.07475511729717255, 5.9765038470903536e-33, -0.047803815454244614, -0.05942801013588905, -0.05775047466158867, -0.0203345138579607, 0.011658326722681522, 0.06794792413711548, -0.05531098321080208, -0.0741046816110611, -0.0700249895453453, 0.014913772232830524, -0.11000707000494003, -0.043479014188051224, -0.04867786169052124, 0.028592549264431, -0.01842670515179634, -0.1260005235671997, -0.029981261119246483, 0.07681532949209213, -0.026151074096560478, 0.025179168209433556, 0.1045231893658638, 0.034592460840940475, -0.08017463982105255, -0.057214267551898956, -0.012011772952973843, 0.006330931559205055, 0.04102260246872902, 0.0006759504321962595, -0.028314631432294846, 0.02104177512228489, -0.02025773748755455, 0.007911691442131996, -0.07141479104757309, -0.01745394431054592, -0.0020418106578290462, 0.019652578979730606, -0.03002714179456234, -0.00033437268575653434, -0.006177232135087252, -0.04264766350388527, -0.027797197923064232, 0.06413881480693817, -0.022228606045246124, -0.06205325946211815, -0.08892066031694412, -0.057231463491916656, -0.01420680619776249, 0.09519803524017334, 0.04419294744729996, 0.017719358205795288, 0.028975028544664383, -0.02145650051534176, 0.033053912222385406, -0.06423397362232208, 0.020506812259554863, -0.02617320604622364, 0.04591638222336769, 0.04921668767929077, 0.06791270524263382, 0.07417279481887817, 0.012947117909789085, 0.06448355317115784, -0.08557944744825363, -0.007517921272665262, -0.03016424924135208, 0.09621050208806992, -0.047557830810546875, 0.005127560812979937, 0.044920776039361954, 0.04593553766608238, -0.1023993268609047, 0.03470120579004288, 0.03163399547338486, 0.015566142275929451, 0.09298916161060333, -0.03612397238612175, -0.014485878869891167, -0.0025343159213662148, -0.05431368574500084, -0.036358095705509186, -0.0692673772573471, 0.1110856831073761, -0.05336952954530716, -0.06452074646949768, -0.1080377846956253, -0.021068839356303215, -0.0730128213763237, -0.07691388577222824, -0.0765441358089447, 0.0036544858012348413, -0.031154800206422806, -0.05476630851626396, 0.025383178144693375, 0.05587116256356239, -0.0700274184346199, -5.707689594892405e-33, 0.003679660614579916, 0.09369226545095444, 0.06397931277751923, 0.03374995291233063, -0.05693136155605316, 0.06505812704563141, 0.08054177463054657, -0.0974678099155426, -0.018931115046143532, -0.0674181655049324, 0.04496303200721741, 0.0042554172687232494, -0.05444611608982086, 0.049696363508701324, 0.09126018732786179, -0.08236145973205566, 0.013900627382099628, -0.001652724458836019, 0.02429061010479927, -0.011720454320311546, 0.06017928943037987, 0.069756880402565, -0.0614461712539196, 0.028161782771348953, -0.044310495257377625, 0.06076021119952202, -0.004010249860584736, 0.047320324927568436, 0.06019875407218933, -0.023678364232182503, -0.032737016677856445, 0.04098176956176758, -0.08070490509271622, 0.03602743521332741, -0.05101466923952103, 0.023824021220207214, 0.034432001411914825, 0.023693636059761047, -0.03604942187666893, -0.05082986131310463, 0.050017815083265305, 0.11055033653974533, -0.06172817945480347, 0.04445374757051468, -0.018111681565642357, 0.049955133348703384, 0.09230032563209534, -0.014898024499416351, -0.024850113317370415, -0.003163813380524516, -0.0503421314060688, -0.03535620495676994, -0.022738613188266754, 0.028567533940076828, 0.015004550106823444, -0.02101638913154602, -0.0357251912355423, -0.04102728143334389, 0.04487806558609009, -0.05493684858083725, -0.025071024894714355, -0.031316738575696945, 0.037579748779535294, -0.059605922549963, 0.03455552086234093, 0.026882747188210487, -0.07015474140644073, 0.06513850390911102, 0.021566584706306458, 0.07416494190692902, -0.02880476601421833, 0.06859301775693893, 0.03064105473458767, -0.016654131934046745, -0.018114356324076653, -0.02062974125146866, 0.019083233550190926, -0.03132493793964386, 0.021182820200920105, 0.0100147295743227, -0.05971406400203705, 0.023893719539046288, 0.08247806131839752, 0.09319362044334412, 0.02789069153368473, 0.08301151543855667, -0.009898162446916103, 0.07710157334804535, 0.06498595327138901, -0.008159353397786617, 0.038266848772764206, 0.06755091995000839, 0.1237403005361557, 0.10010287165641785, 0.0025842292234301567, -4.983725787610638e-08, -0.010148542001843452, -0.06220296770334244, -0.009617158211767673, 0.04902726411819458, -0.02238204888999462, -0.009430655278265476, -0.04651481658220291, 0.007273158058524132, -0.011955799534916878, -0.12318961322307587, 0.010539492592215538, -0.009574750438332558, -0.05825343728065491, -0.0362185575067997, -0.0003706569841597229, 0.00850262213498354, -0.0979202538728714, -0.01937997154891491, 0.023060336709022522, -0.042005881667137146, -0.03347960487008095, -0.0031532691791653633, 0.016142485663294792, 0.0400761142373085, -0.025936564430594444, -0.052273448556661606, -0.0010817099828273058, 0.03729856386780739, 0.05684586614370346, -0.016170520335435867, -0.0021505143959075212, 0.014845123514533043, 0.036117833107709885, 0.03549185022711754, 0.0022353087551891804, 0.016330553218722343, -0.03651417791843414, 0.09388954192399979, 0.006838459055870771, 0.025975888594985008, -0.0815696194767952, 0.07009648531675339, 0.017367089167237282, 0.010484535247087479, 0.036195218563079834, -0.031502269208431244, -0.020310260355472565, -0.05639632046222687, 0.028293149545788765, -0.06462130695581436, 0.013174830935895443, 0.05201036483049393, -0.000842349196318537, 0.1280335783958435, 0.03786037117242813, -0.004520024172961712, -0.11664385348558426, -0.039143819361925125, -0.022163711488246918, -0.008553090505301952, -0.005874914582818747, -0.08181673288345337, -0.04200417175889015, -0.04950197786092758 ] }, { "text": ")\n(branch3x3dbl_3): BasicConv2d(\n(conv): Conv2d(96, 96, kernel_size=(3, 3), stride=(2, 2), bias=False)\n(bn): BatchNorm2d(96, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_6b): InceptionC(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_1): BasicConv2d(\n(conv): Conv2d(768, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_2): BasicConv2d(\n(conv): Conv2d(128, 128, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_27", "embedding": [ -0.03883221000432968, -0.0961407944560051, -0.055556103587150574, -0.025019437074661255, 0.01835360936820507, -0.08191923797130585, -0.03232717514038086, 0.015478599816560745, -0.0497836098074913, -0.08646483719348907, -0.01798637956380844, -0.06473179161548615, -0.017060134559869766, -0.047487758100032806, -0.009389996528625488, 0.08704715967178345, -0.0010511789005249739, 0.0759086161851883, -0.07771506905555725, 0.007301989011466503, -0.006159244105219841, 0.06034606695175171, 0.027844317257404327, 0.03786773979663849, 0.0318947359919548, 0.015843769535422325, 0.04000372439622879, 0.03725843504071236, 0.03971225023269653, -0.10774355381727219, 0.09693057835102081, 0.07273327559232712, -0.05834507197141647, 0.009882612153887749, 0.03542054444551468, 0.010293903760612011, -0.02514726296067238, -0.0026962733827531338, -0.0568012073636055, 0.026550373062491417, 0.03720118850469589, 0.08628416806459427, 0.07200788706541061, -0.016166260465979576, 0.06590034812688828, 0.11616364121437073, -0.02224733680486679, -0.003910647239536047, 0.03921936824917793, -0.062487486749887466, -0.021604452282190323, -0.08311803638935089, 0.031862445175647736, -0.016501931473612785, -0.01177137903869152, 0.06746578216552734, -0.03274862468242645, -0.029280036687850952, 0.034229785203933716, -0.013398388400673866, 0.04418328031897545, -0.02580656297504902, -0.010470972396433353, -0.020781371742486954, 0.05593029409646988, -0.0770636647939682, -0.023288847878575325, -0.004490652121603489, 0.0595768541097641, 0.055335596203804016, -0.028291674330830574, 0.025963440537452698, -0.05350180342793465, -0.03991378843784332, 0.03565193712711334, -0.016294032335281372, 0.07027053833007812, 0.005118122324347496, -0.03325112164020538, -0.129049152135849, -0.020621467381715775, -0.030232014134526253, -0.004702359903603792, -0.06392697989940643, 0.019311534240841866, 0.00826273113489151, -0.013290283270180225, 0.05473076552152634, -0.01944781094789505, 0.016057370230555534, 0.022292455658316612, 0.09216709434986115, -0.09999703615903854, -0.045922692865133286, 0.030551377683877945, -0.00757686048746109, 0.05138998478651047, 0.008779222145676613, 0.040524836629629135, 0.06787445396184921, 0.04868454113602638, -0.04436907544732094, -0.016129150986671448, 0.0661352202296257, -0.004440526477992535, 0.022117536514997482, 0.10900221019983292, 0.07825715094804764, -0.012118876911699772, -0.03240184113383293, 0.06663566827774048, 0.013174489140510559, 0.05227116867899895, -0.004463396035134792, 0.05982876941561699, 0.04646392539143562, 0.003548725973814726, 0.02431407943367958, -0.0057821935042738914, 0.05059225484728813, -0.1017807349562645, -0.022130558267235756, 0.010830611921846867, 0.043627262115478516, -0.12278935313224792, -0.02604297362267971, -0.06531750410795212, 6.1044284891865275e-33, -0.05694335699081421, -0.04893852025270462, -0.0533820316195488, -0.03341393545269966, 0.02365957200527191, 0.06742797791957855, -0.04683375358581543, -0.0980059877038002, -0.06027862802147865, 0.008509526960551739, -0.10975651443004608, -0.058365970849990845, -0.051586125046014786, 0.037882961332798004, -0.018322816118597984, -0.12101700901985168, -0.018111908808350563, 0.065013088285923, -0.023322908207774162, 0.024561569094657898, 0.09964587539434433, 0.03010953590273857, -0.08582968264818192, -0.058252476155757904, -0.023511279374361038, -0.0007746568298898637, 0.010975786484777927, 0.009516005404293537, -0.024822106584906578, 0.019272617995738983, -0.0265718474984169, 0.018918411806225777, -0.050117213279008865, -0.02278217114508152, -0.006158934440463781, 0.01843687705695629, -0.031577762216329575, 0.0030187221709638834, -0.011648906394839287, -0.03946298360824585, -0.01926504261791706, 0.0644301101565361, -0.008238052017986774, -0.06703069806098938, -0.09354863315820694, -0.053870026022195816, -0.017367230728268623, 0.11103027313947678, 0.03489554673433304, 0.014732204377651215, 0.020299429073929787, -0.015241017565131187, 0.02044489048421383, -0.07221614569425583, 0.028765646740794182, -0.031144654378294945, 0.04697701707482338, 0.061551667749881744, 0.06382112205028534, 0.08139993995428085, 0.0052225831896066666, 0.03437507525086403, -0.1041799783706665, -0.004757941234856844, -0.03475537896156311, 0.0900837630033493, -0.042969364672899246, 0.012106274254620075, 0.033967502415180206, 0.047751136124134064, -0.11480019986629486, 0.045580025762319565, 0.022940566763281822, 0.00781627744436264, 0.08667295426130295, -0.039562322199344635, -0.014450072310864925, -0.020054565742611885, -0.04405511915683746, -0.03490583971142769, -0.06367704272270203, 0.11580397933721542, -0.053422074764966965, -0.049939338117837906, -0.09942693263292313, -0.020682180300354958, -0.0665784403681755, -0.07165433466434479, -0.08622283488512039, 0.003621176118031144, -0.02684151567518711, -0.05473794415593147, 0.029523879289627075, 0.053962886333465576, -0.05668862909078598, -6.107152697344558e-33, 0.005404660478234291, 0.08770566433668137, 0.051445383578538895, 0.03935252130031586, -0.055006373673677444, 0.07362239807844162, 0.081056147813797, -0.08167868852615356, -0.03322487324476242, -0.07306518405675888, 0.044379156082868576, 0.0018650306155905128, -0.05915273725986481, 0.058391913771629333, 0.0941702350974083, -0.08932352066040039, 0.011699914000928402, 0.0020856414921581745, 0.03868221864104271, -0.01503860391676426, 0.059766218066215515, 0.06914746016263962, -0.06920143961906433, 0.021179795265197754, -0.0568259060382843, 0.058829449117183685, -0.01997184380888939, 0.05298462510108948, 0.04628828167915344, -0.014483537524938583, -0.05324302613735199, 0.02698364667594433, -0.07492787390947342, 0.026055488735437393, -0.03907320275902748, 0.031610287725925446, 0.033515021204948425, 0.03260086849331856, -0.02741958014667034, -0.04163794592022896, 0.05414304509758949, 0.10640019178390503, -0.06062532588839531, 0.032951563596725464, -0.015530778095126152, 0.04586780071258545, 0.0845893993973732, -0.018020888790488243, -0.03602460399270058, -0.0042580184526741505, -0.05720598250627518, -0.026916086673736572, -0.013302438892424107, 0.04205070063471794, 0.01876932382583618, -0.003744343528524041, -0.02749667875468731, -0.030940132215619087, 0.08156838268041611, -0.06351687759160995, -0.049921903759241104, -0.04490670561790466, 0.005396750755608082, -0.03518541902303696, 0.04108833521604538, 0.026178762316703796, -0.0830511674284935, 0.07744210213422775, 0.025126775726675987, 0.06776385009288788, -0.03806450217962265, 0.06829648464918137, 0.036272082477808, -0.012527727521955967, -0.020083291456103325, -0.03932710736989975, 0.012460223399102688, -0.02686113491654396, 0.00348631851375103, 0.013131549581885338, -0.05577932670712471, 0.018460823222994804, 0.06097608059644699, 0.07888120412826538, 0.05575684458017349, 0.07745620608329773, -0.008350731804966927, 0.07726848125457764, 0.058102771639823914, -0.022629698738455772, 0.051734525710344315, 0.061212413012981415, 0.10619959235191345, 0.09150160849094391, 0.017960134893655777, -5.269745884106669e-08, -0.017601069062948227, -0.05247407779097557, -0.010014910250902176, 0.04863777384161949, -0.007011790294200182, -0.022642401978373528, -0.02643500082194805, 0.016808900982141495, -0.03650673106312752, -0.10366294533014297, 0.013092203065752983, 0.002153703011572361, -0.049468155950307846, -0.033718131482601166, 0.010684586130082607, 0.018384385854005814, -0.10699354112148285, -0.022131668403744698, 0.02735878899693489, -0.038943659514188766, -0.046745117753744125, -0.011243181303143501, 0.0026859368663281202, 0.049810126423835754, -0.037104856222867966, -0.06322046369314194, -0.0006818266119807959, 0.03830090910196304, 0.061472877860069275, -0.01943337544798851, -0.0014661867171525955, 0.016928773373365402, 0.03569838032126427, 0.041900020092725754, -0.010523702949285507, 0.027926571667194366, -0.04691658914089203, 0.08177024126052856, -0.007423960138112307, 0.03317789360880852, -0.07291080802679062, 0.09004651010036469, 0.009722570888698101, -0.012625892646610737, 0.03923807293176651, -0.01914563588798046, -0.013895085081458092, -0.03854319080710411, 0.02644323743879795, -0.05033572018146515, 0.007574399001896381, 0.06891966611146927, 0.008563272655010223, 0.12144394963979721, 0.04740191251039505, -0.02434689737856388, -0.11954118311405182, -0.04759141802787781, -0.0167394932359457, -0.0007147585856728256, -0.01593990996479988, -0.07295210659503937, -0.050874121487140656, -0.05204933136701584 ] }, { "text": "(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_3): BasicConv2d(\n(conv): Conv2d(128, 192, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_1): BasicConv2d(\n(conv): Conv2d(768, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_2): BasicConv2d(\n(conv): Conv2d(128, 128, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_3): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_28", "embedding": [ -0.03994201496243477, -0.0674452856183052, -0.07586091011762619, -0.008917255327105522, 0.017481233924627304, -0.07224543392658234, -0.04608939215540886, 0.03402778506278992, -0.0742926225066185, -0.04598909616470337, 0.021959492936730385, -0.05594858154654503, 0.016522875055670738, -0.06516536325216293, -0.01350021455436945, 0.07166990637779236, -0.01772192306816578, 0.04821008816361427, -0.06402011215686798, -0.00885623600333929, -0.00015853127115406096, 0.06107111647725105, 0.02814699150621891, 0.013016898185014725, 0.018480509519577026, 0.02578839287161827, 0.022656850516796112, 0.04944748058915138, 0.013142517767846584, -0.12307937443256378, 0.05802405998110771, 0.04600583389401436, -0.038141489028930664, 0.03507168963551521, 0.07089893519878387, 0.0055899228900671005, 0.011660722084343433, 0.0011096651433035731, -0.0508575402200222, 0.018699748441576958, 0.03583039343357086, 0.05671590939164162, 0.057441964745521545, 0.02585281804203987, 0.07117797434329987, 0.10561439394950867, -0.02918180450797081, -0.021613871678709984, 0.042061347514390945, -0.03687829151749611, -0.028508344665169716, -0.0400676503777504, 0.027187956497073174, -0.017213983461260796, -0.00821307860314846, 0.060625649988651276, -0.022245066240429878, -0.008004855364561081, 0.05005498602986336, 0.01515777688473463, 0.04967953637242317, -0.0365038625895977, -0.02837766893208027, -0.01883227750658989, 0.034539468586444855, -0.09584443271160126, 0.006503421813249588, 0.02917386218905449, 0.048495206981897354, 0.06399889290332794, -0.022581610828638077, 0.0210812296718359, -0.05086711421608925, -0.02550545521080494, 0.01714564859867096, -0.0038690236397087574, 0.04819625988602638, -0.013703027740120888, -0.0229394119232893, -0.15905702114105225, -0.031099466606974602, -0.019150661304593086, 0.014125753194093704, -0.12223764508962631, 0.016330787912011147, -0.011194703169167042, 0.03397871181368828, 0.05105458199977875, 0.028487922623753548, -0.0035809760447591543, 0.04442119598388672, 0.06641118228435516, -0.08497559279203415, -0.036908671259880066, 0.022673752158880234, 0.024470267817378044, 0.05073236674070358, 0.02723653055727482, 0.045370299369096756, 0.06127287447452545, 0.03746706247329712, -0.013673996552824974, -0.038811974227428436, 0.06907414644956589, -0.024300282821059227, 0.0008805124089121819, 0.07762029021978378, 0.06885377317667007, -0.010965117253363132, -0.058408621698617935, 0.11434217542409897, 0.03589102253317833, 0.06651699542999268, 0.0037742499262094498, 0.08931811153888702, 0.022147195413708687, 0.0007036126917228103, 0.02580411732196808, -0.016658077016472816, 0.033789847046136856, -0.07773702591657639, -0.032388556748628616, 0.023071158677339554, 0.061113063246011734, -0.11175211519002914, -0.03377681225538254, -0.05631149932742119, 6.082600293775727e-33, -0.0462740957736969, -0.06895501166582108, -0.05230983346700668, -0.03683195635676384, 0.0032904455438256264, 0.07384487986564636, -0.06387640535831451, -0.06640660017728806, -0.05286455154418945, 0.020493345335125923, -0.09546084702014923, -0.06093864142894745, -0.06164536252617836, -0.011126339435577393, -0.010888246819376945, -0.10566515475511551, -0.011828475631773472, 0.0806795284152031, -0.014755374751985073, -0.01649109087884426, 0.0879894271492958, 0.050815314054489136, -0.06282729655504227, -0.05747295171022415, 0.019224723801016808, -0.017810991033911705, 0.037755295634269714, -0.007919528521597385, -0.015112440101802349, 0.030728811398148537, -0.007665337063372135, -0.004554652143269777, -0.05523095652461052, -9.3000395281706e-05, -0.020259276032447815, 0.003689591772854328, -0.0332808680832386, -0.005908600986003876, 0.021230055019259453, -0.04660957306623459, -0.03889356181025505, 0.04007643833756447, -0.022096842527389526, -0.039825573563575745, -0.098946712911129, -0.08027138561010361, 0.005932077299803495, 0.08345410972833633, 0.032687775790691376, -0.0035178258549422026, 0.010135325603187084, -0.006558551918715239, 0.01857122965157032, -0.05842243880033493, 0.02494756132364273, -0.04712638631463051, 0.05156548321247101, 0.024022359400987625, 0.06164621561765671, 0.08746761828660965, -0.0031936836894601583, 0.05872586742043495, -0.08315599709749222, -0.039095886051654816, 0.003449255134910345, 0.07576698809862137, -0.03671843186020851, -0.02075163461267948, 0.02641749568283558, 0.039126522839069366, -0.08449241518974304, 0.024877263233065605, 0.0445702001452446, 0.01281973347067833, 0.07838854193687439, -0.022357551380991936, 0.02308017387986183, -0.022698424756526947, -0.06997199356555939, -0.047771651297807693, -0.0720992162823677, 0.11736731231212616, -0.09869624674320221, -0.05859185755252838, -0.07314026355743408, -0.047324880957603455, -0.06841059029102325, -0.08952049165964127, -0.09485141187906265, -0.0252322219312191, -0.048546768724918365, -0.01635563373565674, 0.026085061952471733, 0.056493859738111496, -0.05784466117620468, -5.800710136292819e-33, -0.005030165426433086, 0.11168310046195984, 0.06791246682405472, 0.058894082903862, -0.08432315289974213, 0.06241592392325401, 0.08564276993274689, -0.10590966045856476, -0.060559168457984924, -0.0763477087020874, -9.110907558351755e-05, -0.035669367760419846, -0.048167645931243896, 0.05204601213335991, 0.07843369245529175, -0.06823348253965378, 0.03201543912291527, 0.029826616868376732, 0.01743822731077671, -0.003996094223111868, 0.03219674527645111, 0.08271387219429016, -0.030235333368182182, 0.04198065772652626, 0.0005391694721765816, 0.0583299957215786, -0.006711474619805813, 0.03855399042367935, 0.036147620528936386, 0.007614857982844114, -0.026857424527406693, 0.02127729170024395, -0.07771940529346466, 0.022016974166035652, -0.06254447251558304, 0.008933844044804573, 0.032748766243457794, 0.042551714926958084, -0.009303255937993526, -0.019007187336683273, 0.07047169655561447, 0.10040457546710968, -0.05284934863448143, 0.0013711652718484402, -0.02413530834019184, 0.04336946830153465, 0.11532499641180038, -0.02473226934671402, -0.016804350540041924, -0.026543589308857918, -0.02504795975983143, -0.0079666031524539, -0.026729010045528412, 0.05065082013607025, 0.01028920616954565, -0.005131906364113092, -0.06317884474992752, -0.02168019860982895, 0.029531877487897873, -0.08562346547842026, -0.003990579396486282, -0.05864982679486275, 0.03686278313398361, -0.04365511238574982, 0.052755262702703476, 0.017584897577762604, -0.08168164640665054, 0.06481218338012695, 0.005974550731480122, 0.04064037650823593, -0.042010966688394547, 0.05093125253915787, 0.04199756681919098, 0.007851438596844673, -0.021430369466543198, -0.023627566173672676, 0.02686849795281887, -0.05717511847615242, -0.006127362139523029, 0.046327076852321625, -0.08533597737550735, 0.0381983146071434, 0.08253033459186554, 0.0673680528998375, 0.006898765452206135, 0.09736113995313644, 0.007910857908427715, 0.07226290553808212, 0.09161503612995148, -0.006837792228907347, 0.032715532928705215, 0.0656767338514328, 0.1271444410085678, 0.08574346452951431, 0.0026938659138977528, -4.766259209532109e-08, -0.021608680486679077, -0.1063786968588829, 0.0009613845613785088, 0.0454503633081913, 0.010817648842930794, -0.01832531951367855, -0.08175262063741684, -0.006464751902967691, -0.01246165856719017, -0.10739147663116455, 0.029241690412163734, 0.012487724423408508, -0.0688018724322319, -0.02898501604795456, -0.025774391368031502, 0.01883387751877308, -0.058565523475408554, -0.029485788196325302, 0.019746050238609314, -0.05751539394259453, -0.02263699471950531, -0.02723013237118721, 0.0006926693604327738, 0.06076750159263611, -0.040274932980537415, -0.0595552884042263, -0.013101513497531414, 0.04322244971990585, 0.05909525230526924, -0.043114278465509415, 0.013327096588909626, -0.005483666900545359, 0.06183670461177826, 0.017631014809012413, 0.03345273435115814, 0.0025862057227641344, -0.01194193959236145, 0.10423286259174347, 0.029873032122850418, 0.013293213210999966, -0.10146664828062057, 0.06576645374298096, 0.01255789678543806, 0.043506644666194916, 0.03604656457901001, -0.033861711621284485, -0.020204655826091766, -0.009874602779746056, 0.012525176629424095, -0.0935095027089119, 0.03738544136285782, 0.0319497175514698, 0.02983075939118862, 0.11752983182668686, 0.04103823006153107, -0.010378094390034676, -0.11053470522165298, -0.03064747527241707, 0.0024998311419039965, 0.01963907852768898, -0.027765750885009766, -0.06417134404182434, -0.06221339479088783, -0.06447634845972061 ] }, { "text": "(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_3): BasicConv2d(\n(conv): Conv2d(128, 128, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_4): BasicConv2d(\n(conv): Conv2d(128, 128, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_5): BasicConv2d(\n(conv): Conv2d(128, 192, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_29", "embedding": [ -0.023735342547297478, -0.06222660467028618, -0.07637322694063187, -0.006180840078741312, 0.01436375267803669, -0.06169752776622772, -0.04781276732683182, 0.03841271996498108, -0.07486766576766968, -0.044310662895441055, 0.018637754023075104, -0.06122462823987007, 0.00772824278101325, -0.06493722647428513, -0.01776810735464096, 0.07542791962623596, -0.02103942073881626, 0.05701449140906334, -0.07198870927095413, -0.01718125492334366, -0.0024373799096792936, 0.06645753234624863, 0.042632341384887695, 0.019352441653609276, 0.005039386451244354, 0.020526641979813576, 0.021915307268500328, 0.023763472214341164, 0.011071448214352131, -0.1117662787437439, 0.06447415053844452, 0.046574730426073074, -0.019595714285969734, 0.034207750111818314, 0.08338887244462967, -0.0017872953321784735, 0.012444176711142063, -0.0009369056206196547, -0.035360224545001984, 0.022291772067546844, 0.037440214306116104, 0.052208613604307175, 0.05077280476689339, 0.027358025312423706, 0.06987491250038147, 0.10109692811965942, -0.029320992529392242, -0.027970168739557266, 0.05716179683804512, -0.03204162418842316, -0.017113078385591507, -0.03408076986670494, 0.025430915877223015, -0.02939913235604763, -0.018840322270989418, 0.04872521758079529, -0.025553131476044655, 0.006121028680354357, 0.04291241616010666, 0.01837334968149662, 0.05180561542510986, -0.046536918729543686, -0.018321234732866287, -0.024082167074084282, 0.017047077417373657, -0.09177470952272415, 0.007872927002608776, 0.03089863806962967, 0.05465954914689064, 0.07015594094991684, -0.01863153651356697, 0.023762838914990425, -0.04493192210793495, -0.02622678503394127, 0.012454967945814133, -0.01624126359820366, 0.06389754265546799, -0.0253150537610054, -0.014880905859172344, -0.14580903947353363, -0.03105550818145275, -0.01773713529109955, 0.02512631006538868, -0.1369636058807373, 0.018179582431912422, -0.006645833142101765, 0.03843693807721138, 0.04345577582716942, 0.02515723556280136, 0.013916553929448128, 0.04124410077929497, 0.059721581637859344, -0.10264450311660767, -0.040460869669914246, 0.02080357074737549, 0.026611212641000748, 0.049800727516412735, 0.02113564871251583, 0.040372684597969055, 0.058582551777362823, 0.04214463755488396, -0.011397948488593102, -0.04418245330452919, 0.08104453235864639, -0.025048481300473213, 0.00017720801406539977, 0.08600952476263046, 0.07287602871656418, -0.02200191095471382, -0.05561326444149017, 0.11793353408575058, 0.039150722324848175, 0.06300545483827591, 0.001269489643163979, 0.09480126947164536, 0.021621137857437134, 0.0029853645246475935, 0.01048962865024805, -0.03132101893424988, 0.03410501033067703, -0.08743224292993546, -0.02694147266447544, 0.016481749713420868, 0.06209331005811691, -0.1210390031337738, -0.03402400761842728, -0.060107044875621796, 6.192726114690528e-33, -0.04016096144914627, -0.05838235840201378, -0.04020378738641739, -0.04363178461790085, 0.005161546170711517, 0.07666785269975662, -0.058670129626989365, -0.059037841856479645, -0.049488041549921036, 0.02084028348326683, -0.08467850834131241, -0.08048983663320541, -0.056319642812013626, -0.006229782477021217, -0.029726093634963036, -0.10058852285146713, -0.027488894760608673, 0.075015127658844, -0.005114365369081497, -0.019342513754963875, 0.088858962059021, 0.0566788986325264, -0.061554405838251114, -0.05184314027428627, 0.004308858420699835, -0.00348473247140646, 0.041796453297138214, -0.0007480522035621107, -0.013097616843879223, 0.03162365406751633, -0.020158173516392708, -0.00023613458324689418, -0.056043557822704315, -0.025429489091038704, -0.010274953208863735, -0.001440451480448246, -0.021695390343666077, 0.003623051568865776, 0.034845512360334396, -0.04274166002869606, -0.044450338929891586, 0.04352588951587677, -0.00884327944368124, -0.03464166447520256, -0.09938223659992218, -0.07235804945230484, 0.0075034634210169315, 0.08843903243541718, 0.03837353736162186, 0.004758292343467474, 0.012381688691675663, -0.02177131362259388, 0.031259745359420776, -0.06003132462501526, 0.018918750807642937, -0.056534212082624435, 0.04932601377367973, 0.01786099560558796, 0.05605067312717438, 0.0608573779463768, 0.012955586425960064, 0.05196663737297058, -0.07536157220602036, -0.03981342911720276, 0.012331872247159481, 0.07305654883384705, -0.03199908509850502, -0.021670415997505188, 0.007367211859673262, 0.040224358439445496, -0.08011511713266373, 0.0324811190366745, 0.03621375560760498, 0.012323880568146706, 0.08241285383701324, -0.024180317297577858, 0.034381404519081116, -0.013260604813694954, -0.07557574659585953, -0.04623297601938248, -0.05143294110894203, 0.12800182402133942, -0.08577901124954224, -0.07236705720424652, -0.06408072263002396, -0.042998913675546646, -0.0630994364619255, -0.09300786256790161, -0.08492961525917053, -0.038098763674497604, -0.026522213593125343, -0.022647375240921974, 0.02527187392115593, 0.06536450982093811, -0.07229170948266983, -6.113590732967218e-33, 0.012427524663507938, 0.12045254558324814, 0.061091843992471695, 0.06736752390861511, -0.09002157300710678, 0.06323540210723877, 0.09160930663347244, -0.08839049190282822, -0.06572073698043823, -0.08045095950365067, 0.00982889998704195, -0.04429278150200844, -0.051237765699625015, 0.06250296533107758, 0.07414370030164719, -0.060035351663827896, 0.018455948680639267, 0.02232583984732628, 0.02024798095226288, -0.011426466517150402, 0.03505902364850044, 0.07025934010744095, -0.025782592594623566, 0.05330697074532509, 0.007383995223790407, 0.04309746250510216, -0.006458428222686052, 0.019207505509257317, 0.04324442893266678, 0.001147974282503128, -0.03175249323248863, 0.026735559105873108, -0.0724254623055458, 0.02444862388074398, -0.06280875205993652, 0.012158894911408424, 0.024548420682549477, 0.042693108320236206, -0.008982890285551548, -0.00935240276157856, 0.05489392951130867, 0.10696046054363251, -0.04622221365571022, -0.0006697690696455538, -0.022865144535899162, 0.03828829526901245, 0.11367394775152206, -0.01760374754667282, -0.015210110694169998, -0.010792381130158901, -0.027816610410809517, -0.012594501487910748, -0.024171244353055954, 0.04127831757068634, 0.01027966383844614, -0.009646378457546234, -0.06776203215122223, -0.029760608449578285, 0.02488168142735958, -0.08441659808158875, -0.0239406730979681, -0.04612285643815994, 0.040834564715623856, -0.05722085386514664, 0.04697519913315773, 0.03496884927153587, -0.08264980465173721, 0.07033319026231766, -0.0027733859606087208, 0.04213445633649826, -0.04982226341962814, 0.027562061324715614, 0.03282887488603592, 0.015884360298514366, -0.02954220585525036, -0.024383245036005974, 0.02317727729678154, -0.06073935329914093, -0.007308293133974075, 0.06217314675450325, -0.0723612904548645, 0.036618880927562714, 0.08928151428699493, 0.06299865990877151, 0.007097684312611818, 0.0927087813615799, 0.004961666185408831, 0.08599850535392761, 0.08774176985025406, 0.0021879603154957294, 0.03670599311590195, 0.06760015338659286, 0.1348564624786377, 0.09075623005628586, 0.0031971971038728952, -5.095108335240184e-08, -0.01874290406703949, -0.09058667719364166, -0.001061685266904533, 0.049283627420663834, 0.00931622926145792, -0.01961510255932808, -0.08500756323337555, -0.021335862576961517, 0.0032283298205584288, -0.11169705539941788, 0.023807503283023834, 0.0027713007293641567, -0.07641304284334183, -0.023925814777612686, -0.024783970788121223, 0.017234714701771736, -0.06647903472185135, -0.04137834534049034, 0.034199997782707214, -0.0555524080991745, -0.03307539224624634, -0.030938981100916862, -0.007567038759589195, 0.04279722273349762, -0.030851084738969803, -0.06777044385671616, -0.019777080044150352, 0.05400810390710831, 0.05579784885048866, -0.05374361202120781, 0.01464073546230793, -0.003510638140141964, 0.05074227228760719, 0.009525343775749207, 0.025536948814988136, 0.009882010519504547, -0.004781714640557766, 0.09396503865718842, 0.029650872573256493, 0.018064996227622032, -0.11436979472637177, 0.07295853644609451, 0.02233133465051651, 0.027167676016688347, 0.011135001666843891, -0.03711697459220886, -0.017202533781528473, -0.009676876477897167, 0.009384764358401299, -0.08470627665519714, 0.038958385586738586, 0.035974930971860886, 0.024843469262123108, 0.1173100620508194, 0.03919324651360512, -0.011596537195146084, -0.1110689640045166, -0.023696132004261017, -0.001673018909059465, 0.002897350350394845, -0.04701025411486626, -0.06715404242277145, -0.07294635474681854, -0.06447692215442657 ] }, { "text": "(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_6c): InceptionC(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_1): BasicConv2d(\n(conv): Conv2d(768, 160, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_2): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_30", "embedding": [ -0.026395561173558235, -0.08016281574964523, -0.034172870218753815, -0.00987986009567976, 0.022439463064074516, -0.06783276796340942, -0.03684571757912636, 0.013086548075079918, -0.040765516459941864, -0.09438179433345795, -0.02172653004527092, -0.08070264756679535, -0.009279191493988037, -0.05696839839220047, -0.023586776107549667, 0.07388492673635483, 0.016442568972706795, 0.06494717299938202, -0.07226531207561493, -0.013951056636869907, -0.034117892384529114, 0.07444842904806137, 0.027437910437583923, 0.005934256594628096, 0.02003278210759163, 0.03228679299354553, 0.0035541618708521128, 0.01963433250784874, 0.04753195121884346, -0.11590032279491425, 0.08602473884820938, 0.08228495717048645, -0.06569641083478928, 0.030899854376912117, 0.045592039823532104, 0.03716621920466423, -0.03492073714733124, 0.01311466470360756, -0.026491208001971245, 0.0015278916107490659, 0.05391211435198784, 0.07613719254732132, 0.06119067594408989, -0.01048363372683525, 0.07297699898481369, 0.11591251194477081, -0.020252637565135956, 0.017028246074914932, 0.039310380816459656, -0.05806000158190727, -0.009609722532331944, -0.061156999319791794, 0.018804235383868217, -0.017842590808868408, -0.0030729547142982483, 0.07414925843477249, -0.018133491277694702, -0.03806016594171524, 0.035011280328035355, 0.020398389548063278, 0.014616825617849827, -0.036675695329904556, -0.0176558680832386, -0.02534303069114685, 0.06468972563743591, -0.09480777382850647, -0.0010087030241265893, 0.03437383845448494, 0.07943563908338547, 0.0551278330385685, 0.011708843521773815, 0.036008208990097046, -0.05236545950174332, -0.033804286271333694, 0.00962329562753439, 0.00553037179633975, 0.056707389652729034, -0.0005405565607361495, -0.030507024377584457, -0.136367529630661, -0.014413222670555115, -0.026823626831173897, 0.009735341183841228, -0.10015226900577545, 0.03209715336561203, -0.017443383112549782, 0.0009387708851136267, 0.03209266439080238, -0.0023525601718574762, 0.020650403574109077, 0.02854965068399906, 0.08123905956745148, -0.08548805117607117, -0.057688694447278976, 0.04450204595923424, -0.001349379657767713, 0.004636423662304878, 0.02175116539001465, 0.02211783640086651, 0.06585817784070969, 0.04580504819750786, -0.0375988595187664, -0.03468769043684006, 0.051548413932323456, 0.011004260741174221, 0.014668142423033714, 0.09725414961576462, 0.06296628713607788, 0.013753083534538746, -0.03463047742843628, 0.07127750664949417, 0.03672529011964798, 0.06457671523094177, 0.0049954988062381744, 0.05332322046160698, 0.028286214917898178, 0.007207547780126333, 0.024889076128602028, -0.02326475828886032, 0.05308973416686058, -0.11059499531984329, -0.012169772759079933, 0.013482154347002506, 0.037536416202783585, -0.1201261579990387, -0.03572729229927063, -0.06535961478948593, 6.724839346529161e-33, -0.045647867023944855, -0.09209118783473969, -0.029310083016753197, -0.03492077812552452, 0.026270020753145218, 0.08141931891441345, -0.05298161134123802, -0.09652707725763321, -0.05520633980631828, -0.022375524044036865, -0.09066031128168106, -0.055186741054058075, -0.06829562783241272, 0.008845043368637562, -0.009118225425481796, -0.11932459473609924, -0.013383308425545692, 0.05365296080708504, -0.0020102239213883877, -0.0006027683266438544, 0.06116902828216553, 0.017804671078920364, -0.0741717591881752, -0.060050904750823975, -0.014585171826183796, -0.016601374372839928, 0.026459962129592896, -0.007173803634941578, -0.021038558334112167, 0.0367477722465992, -0.05304040387272835, 0.030007192865014076, -0.06008303910493851, -0.001983004854992032, -0.0037442483007907867, 0.01045942958444357, -0.003905688179656863, 0.00678496016189456, 0.007337954826653004, -0.059133753180503845, -0.04499936103820801, 0.06596679240465164, -0.023742886260151863, -0.057905953377485275, -0.10281629115343094, -0.08395825326442719, -0.009271201677620411, 0.11145639419555664, 0.00787294004112482, 0.02592957578599453, 0.02095424383878708, -0.04912475124001503, 0.01598883979022503, -0.08755117654800415, 0.015994353219866753, -0.031058548018336296, 0.052990637719631195, 0.04985824599862099, 0.05450481176376343, 0.11410048604011536, 0.03273705020546913, 0.05097663030028343, -0.11963029205799103, 0.0006387595203705132, -0.018199056386947632, 0.06449972093105316, -0.05350935459136963, 0.012406943365931511, 0.04368768259882927, 0.047848548740148544, -0.08904194831848145, 0.04086562991142273, 0.019481709226965904, 0.021290989592671394, 0.07482939213514328, -0.048137567937374115, 0.000849061063490808, -0.006151081994175911, -0.07075344026088715, -0.01511956937611103, -0.04534843564033508, 0.13520950078964233, -0.0652356967329979, -0.048631858080625534, -0.08799001574516296, -0.010460811667144299, -0.050883401185274124, -0.06278850138187408, -0.10091565549373627, 0.0036339720245450735, -0.021839922294020653, -0.03447499871253967, 0.048732955008745193, 0.05606624856591225, -0.051520176231861115, -6.636506088852651e-33, -0.01583627238869667, 0.10206672549247742, 0.044203851372003555, 0.053830452263355255, -0.038625527173280716, 0.05540183186531067, 0.0968829020857811, -0.09552976489067078, -0.0568537637591362, -0.060274455696344376, 0.007097342051565647, -0.008641242049634457, -0.046352263540029526, 0.04556221142411232, 0.08952348679304123, -0.11124598234891891, 0.02334362082183361, 0.03747323527932167, 0.03346797078847885, 0.017153838649392128, 0.04478011280298233, 0.06814950704574585, -0.07175661623477936, 0.003747380105778575, -0.04526446387171745, 0.05787982791662216, -0.04134359583258629, 0.0613577775657177, 0.03928764536976814, -0.02829752489924431, -0.037938375025987625, 0.029483146965503693, -0.09608548879623413, 0.02125496417284012, -0.012712350115180016, 0.02886444516479969, 0.03558441624045372, 0.03095216676592827, -0.02194012887775898, -0.031581901013851166, 0.0506819523870945, 0.10139436274766922, -0.08181746304035187, 0.016660690307617188, -0.02217080630362034, 0.03733713924884796, 0.08386455476284027, -0.012442326173186302, -0.05035463720560074, -0.023367980495095253, -0.04272829368710518, -0.005688006989657879, -0.05225913226604462, 0.0728238970041275, -0.021886583417654037, -0.01789282262325287, -0.018782099708914757, -0.026119088754057884, 0.05879058688879013, -0.051123861223459244, -0.01974097639322281, -0.052126456052064896, -0.005953409243375063, -0.046173229813575745, 0.05310507491230965, 0.022881057113409042, -0.05747972056269646, 0.07888620346784592, 0.00956510379910469, 0.04821961000561714, -0.029796572402119637, 0.0650230124592781, 0.044283729046583176, 0.0031972217839211226, -0.035070594400167465, -0.02840161696076393, 0.017179835587739944, -0.04020625725388527, 0.018866559490561485, 0.018286844715476036, -0.1000545397400856, 0.038140930235385895, 0.03888846933841705, 0.0803111121058464, 0.04875258728861809, 0.08087710291147232, 0.005490048322826624, 0.06100762262940407, 0.07012632489204407, 0.010041194967925549, 0.027854349464178085, 0.04149565100669861, 0.09283223003149033, 0.09145945310592651, 0.0034498136956244707, -5.3523439902392056e-08, -0.022250961512327194, -0.07307516038417816, 0.0001568118022987619, 0.07425393909215927, 0.01738310046494007, -0.02954680286347866, -0.06392978131771088, 0.008252114988863468, -0.00878323893994093, -0.09278971701860428, 0.015987226739525795, 0.009204994887113571, -0.0500713512301445, -0.03738143667578697, -0.016856929287314415, 0.009620626457035542, -0.07742966711521149, -0.008991438895463943, 0.023657092824578285, -0.025243766605854034, -0.02710156887769699, -0.016387976706027985, -0.011860557831823826, 0.059855300933122635, -0.04861745238304138, -0.0707104280591011, 0.01676458865404129, 0.0482187494635582, 0.06249137222766876, -0.036654576659202576, 0.0023146281018853188, -0.0005251677939668298, 0.031474120914936066, 0.024727769196033478, -0.0049325209110975266, 0.0458231046795845, -0.03657308965921402, 0.07949382066726685, -0.0013665080768987536, 0.030772512778639793, -0.07871521264314651, 0.06460949778556824, 0.018961651250720024, 0.006958508864045143, 0.03975697606801987, -0.02619035542011261, -0.01319908257573843, -0.04243098199367523, 0.03024737909436226, -0.03779718279838562, 0.023949846625328064, 0.05635100603103638, 0.031209047883749008, 0.1315436065196991, 0.05555594712495804, -0.032835256308317184, -0.09310301393270493, -0.06990882754325867, -0.023098789155483246, 0.021916598081588745, -0.0061342185363173485, -0.05093882977962494, -0.08492697030305862, -0.05031092092394829 ] }, { "text": ")\n(branch7x7_2): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_3): BasicConv2d(\n(conv): Conv2d(160, 192, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_1): BasicConv2d(\n(conv): Conv2d(768, 160, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_2): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_31", "embedding": [ -0.029488224536180496, -0.06503157317638397, -0.08314968645572662, -0.012901789508759975, 0.03269434720277786, -0.0665544867515564, -0.035000309348106384, 0.030796149745583534, -0.08127396553754807, -0.051600389182567596, 0.008480296470224857, -0.04887723550200462, 0.013263358734548092, -0.0659346878528595, -0.0123741514980793, 0.07309979200363159, -0.0032395166344940662, 0.05249721184372902, -0.04937274381518364, -0.023088032379746437, -0.005358822178095579, 0.07891260832548141, 0.028102993965148926, 0.009522256441414356, 0.016817040741443634, 0.023475365713238716, 0.02969708852469921, 0.05125340074300766, 0.02630363218486309, -0.11143679171800613, 0.06929686665534973, 0.04221101850271225, -0.037343189120292664, 0.04264836758375168, 0.05287671834230423, 0.0013795088743790984, 0.016992174088954926, 0.016774682328104973, -0.04367184638977051, 0.045347604900598526, 0.028660975396633148, 0.06467802077531815, 0.060930561274290085, 0.012406121008098125, 0.07365617156028748, 0.10264863818883896, -0.02261742204427719, -0.0161132849752903, 0.05906226858496666, -0.04774578660726547, -0.025032857432961464, -0.04314389452338219, 0.04568232223391533, -0.04111013188958168, -0.0065255677327513695, 0.03730933368206024, -0.02332994155585766, -0.03425072133541107, 0.05113080143928528, 0.0036889868788421154, 0.05723077803850174, -0.04984394088387489, -0.014476814307272434, -0.013496659696102142, 0.012498870491981506, -0.1105644628405571, 0.006657938938587904, 0.02577280066907406, 0.04129814729094505, 0.04535863921046257, -0.02423683926463127, 0.030003875494003296, -0.04428330436348915, -0.01057077944278717, 0.030035683885216713, -0.005933059845119715, 0.05388499051332474, -0.0011461368994787335, -0.01581060327589512, -0.16135075688362122, -0.019958514720201492, -0.00553995743393898, 0.01759277656674385, -0.11440509557723999, 0.0026535005308687687, -0.018814966082572937, 0.020373085513710976, 0.06166759133338928, 0.021745990961790085, -0.0055282944813370705, 0.052227865904569626, 0.08485030382871628, -0.09990569949150085, -0.03319339081645012, 0.01682557351887226, 0.015737101435661316, 0.056534022092819214, 0.01968202367424965, 0.021654171869158745, 0.07662695646286011, 0.03391410410404205, -0.011838016100227833, -0.03356489539146423, 0.07299025356769562, -0.020041249692440033, -0.004796935245394707, 0.07768449187278748, 0.07149919122457504, -0.002680650446563959, -0.058233823627233505, 0.09832598268985748, 0.018297115340828896, 0.05742688477039337, 0.004031019285321236, 0.089787557721138, 0.01217919122427702, 0.025198575109243393, 0.02083486132323742, -0.020886441692709923, 0.022440245375037193, -0.08161657303571701, -0.03512335941195488, 0.014308847486972809, 0.060513339936733246, -0.11988180130720139, -0.043092332780361176, -0.05933910980820656, 5.4066293285994934e-33, -0.05624036490917206, -0.05287155508995056, -0.056281011551618576, -0.03633032739162445, -0.002795514417812228, 0.06446918100118637, -0.04678383469581604, -0.07935618609189987, -0.03345537558197975, 0.008851069957017899, -0.10370984673500061, -0.08053762465715408, -0.0528654083609581, -0.0017867491114884615, -0.011930925771594048, -0.09546355158090591, 0.0019286632305011153, 0.061576444655656815, -0.00813994463533163, -0.022352581843733788, 0.07747314870357513, 0.0487547367811203, -0.057221025228500366, -0.044800274074077606, 0.008747606538236141, -0.030073750764131546, 0.017126118764281273, -0.01227643433958292, -0.01982775889337063, 0.028888585045933723, -0.017297562211751938, 0.010731644928455353, -0.02600923553109169, -0.007013439666479826, -0.025998562574386597, -0.013915864750742912, -0.020888162776827812, -0.008050360716879368, 0.01960829272866249, -0.05544758215546608, -0.03118341602385044, 0.04203130677342415, 0.004059793893247843, -0.042197421193122864, -0.10108641535043716, -0.084425188601017, 0.014547327533364296, 0.10093031078577042, 0.042371317744255066, 0.0026706214994192123, 0.007449260447174311, -0.00013295987446326762, 0.02665562741458416, -0.06706081330776215, 0.020555688068270683, -0.03911253809928894, 0.0446743369102478, 0.03981124982237816, 0.05577762797474861, 0.08544566482305527, -0.005881370510905981, 0.0378328338265419, -0.08162058144807816, -0.03775660693645477, -0.012907538563013077, 0.06905774027109146, -0.04177097976207733, -0.02753317728638649, 0.017433319240808487, 0.050529126077890396, -0.07830332219600677, 0.036236561834812164, 0.04059759899973869, 0.010711384937167168, 0.07687897980213165, -0.03509014844894409, 0.0262227151542902, -0.024908022955060005, -0.06264396756887436, -0.050924040377140045, -0.06161606311798096, 0.12408100068569183, -0.09117517620325089, -0.05784064531326294, -0.07024067640304565, -0.047417107969522476, -0.04882359877228737, -0.08289080858230591, -0.09352849423885345, -0.034132782369852066, -0.040299832820892334, -0.014870952814817429, 0.027576573193073273, 0.06778043508529663, -0.033834058791399, -5.420651506836865e-33, -0.0010352887911722064, 0.12691907584667206, 0.05321814492344856, 0.04659818485379219, -0.09142037481069565, 0.0625612735748291, 0.09237078577280045, -0.09904861450195312, -0.06727293133735657, -0.07763707637786865, 0.005185085814446211, -0.044080592691898346, -0.03889242932200432, 0.0646294504404068, 0.08440741896629333, -0.0711970254778862, 0.015867523849010468, 0.027519920840859413, 0.008792486973106861, -0.020065180957317352, 0.039036814123392105, 0.0752410814166069, -0.03313438966870308, 0.019278360530734062, -0.009920952841639519, 0.041676346212625504, -0.011483731679618359, 0.031325675547122955, 0.02294355072081089, 0.002762511372566223, -0.044676121324300766, 0.013317453674972057, -0.06746581941843033, 0.034870896488428116, -0.05276622250676155, 0.010811139829456806, 0.025729361921548843, 0.040108807384967804, -0.006314382888376713, -0.011346055194735527, 0.06465037167072296, 0.10154877603054047, -0.053154829889535904, -1.6480789781780913e-05, -0.013079204596579075, 0.03126860409975052, 0.1177387461066246, -0.026311779394745827, -0.02300993725657463, -0.029805930331349373, -0.045094143599271774, -0.005155656021088362, -0.021514343097805977, 0.04918042942881584, 0.013459370471537113, 0.013179047033190727, -0.07607580721378326, -0.0051251607947051525, 0.05547332763671875, -0.09258235991001129, -0.030539706349372864, -0.06446248292922974, 0.016385601833462715, -0.01892726495862007, 0.05741631239652634, 0.02179275080561638, -0.08575580269098282, 0.060499757528305054, 0.017888281494379044, 0.052904095500707626, -0.05849558860063553, 0.05711384862661362, 0.043583597987890244, 0.005393223371356726, -0.03183434531092644, -0.039714109152555466, 0.034578002989292145, -0.04223520681262016, -0.015807680785655975, 0.046860117465257645, -0.07217001169919968, 0.04059043526649475, 0.07153590768575668, 0.06542708724737167, 0.013275404460728168, 0.10195642709732056, 0.020697500556707382, 0.07613297551870346, 0.0808788612484932, -0.01953156664967537, 0.04254975914955139, 0.05609763413667679, 0.12021812051534653, 0.08587893843650818, 0.008377154357731342, -4.846704371175292e-08, -0.03929220885038376, -0.10391373187303543, -0.006581513211131096, 0.042179763317108154, 0.018514569848775864, -0.021760426461696625, -0.06898757070302963, -0.027781110256910324, -0.02282208949327469, -0.09448797255754471, 0.016653932631015778, 0.01797950640320778, -0.056901734322309494, -0.02758820727467537, -0.02717549167573452, 0.03131702169775963, -0.049101121723651886, -0.04292172193527222, 0.024811970070004463, -0.043479710817337036, -0.027056988328695297, -0.043924082070589066, -0.01509582344442606, 0.08313534408807755, -0.03205296769738197, -0.07967397570610046, -0.03052166849374771, 0.04418213665485382, 0.06712976098060608, -0.03910137712955475, 0.0007104018586687744, -0.00393975805491209, 0.06120350584387779, 0.023004200309515, 0.03278254345059395, 0.006808421108871698, -0.016803212463855743, 0.09152158349752426, 0.027186976745724678, 0.02641255035996437, -0.08779728412628174, 0.08694089204072952, 0.012726088985800743, 0.016794878989458084, 0.03969439119100571, -0.01619841903448105, -0.024292105808854103, -0.010945137590169907, 0.013121465221047401, -0.09233424812555313, 0.042697880417108536, 0.044530145823955536, 0.03755664452910423, 0.11596471071243286, 0.05760447680950165, -0.034280214458703995, -0.12104173749685287, -0.030308041721582413, 0.01430572010576725, 0.017647823318839073, -0.03403101861476898, -0.048444151878356934, -0.07084288448095322, -0.07019337266683578 ] }, { "text": ")\n(branch7x7dbl_2): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_3): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_4): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_5): BasicConv2d(\n(conv): Conv2d(160, 192, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_32", "embedding": [ -0.03262855112552643, -0.061097048223018646, -0.09284155815839767, -0.01914989948272705, 0.031202096492052078, -0.07110273092985153, -0.03470365330576897, 0.04406403750181198, -0.07826866954565048, -0.04643699526786804, 0.022136468440294266, -0.050485484302043915, 0.012373757548630238, -0.06297849863767624, -0.028867248445749283, 0.07474204897880554, -0.0232938714325428, 0.06335423141717911, -0.05466173216700554, -0.015980053693056107, 0.0013761898735538125, 0.06188024953007698, 0.021018264815211296, 0.022033685818314552, 0.02451893873512745, 0.017893416807055473, 0.029484963044524193, 0.060274798423051834, 0.018730944022536278, -0.11536421626806259, 0.07213679701089859, 0.05025770142674446, -0.02311839908361435, 0.03848562762141228, 0.05196745693683624, -0.0009439495042897761, 0.021394995972514153, -0.01180792786180973, -0.04454454779624939, 0.03470362350344658, 0.02336006425321102, 0.060748785734176636, 0.05740312486886978, 0.023883240297436714, 0.06538420170545578, 0.09700243920087814, -0.023145221173763275, -0.022102104499936104, 0.05693354085087776, -0.04662153497338295, -0.014017635025084019, -0.03526455536484718, 0.03355466201901436, -0.045269500464200974, -0.011513047851622105, 0.045291293412446976, -0.02457641437649727, -0.01224631629884243, 0.05480731278657913, 0.014860405586659908, 0.056018244475126266, -0.04105835407972336, -0.01346716471016407, -0.005645305383950472, 0.0027247206307947636, -0.10878569632768631, -0.010670473799109459, 0.016281966120004654, 0.04449582099914551, 0.05145817622542381, -0.04510260000824928, 0.0237432848662138, -0.03683982789516449, -0.022598039358854294, 0.023998785763978958, -0.011778530664741993, 0.06205083802342415, -0.008604805916547775, 0.0015952696558088064, -0.15488743782043457, -0.03458108380436897, -0.010705044493079185, 0.009693115018308163, -0.12097097188234329, 0.01246372889727354, -0.007000532001256943, 0.038615938276052475, 0.05302733555436134, 0.020579461008310318, -0.00627110293135047, 0.05088021233677864, 0.07954561710357666, -0.09805987030267715, -0.03152991831302643, 0.006845733616501093, 0.02209802344441414, 0.05962346866726875, 0.017944306135177612, 0.03273575007915497, 0.07860033959150314, 0.03654671087861061, -0.011625131592154503, -0.02298027276992798, 0.0768873319029808, -0.027667609974741936, -0.021255478262901306, 0.07739779353141785, 0.0789974182844162, -0.035507891327142715, -0.06117096543312073, 0.10184251517057419, 0.02246997132897377, 0.048912208527326584, 0.0019609536975622177, 0.09068922698497772, 0.029318436980247498, 0.006597637664526701, 0.000979183241724968, -0.014855016022920609, 0.014372322708368301, -0.06825731694698334, -0.03448677435517311, 0.006926851347088814, 0.060784947127103806, -0.12101449072360992, -0.03985145315527916, -0.05182275548577309, 6.1128167434055985e-33, -0.04548998922109604, -0.0443076491355896, -0.04497915506362915, -0.03879021108150482, -0.007764274720102549, 0.06920217722654343, -0.056943006813526154, -0.07694143801927567, -0.03440629318356514, 0.023291638121008873, -0.10557196289300919, -0.07775082439184189, -0.05200644209980965, -0.0017419088399037719, -0.02059199847280979, -0.0997210368514061, -0.008450412191450596, 0.07727871835231781, -0.011027141474187374, -0.011416854336857796, 0.07916580140590668, 0.06135322526097298, -0.062228232622146606, -0.050305139273405075, 0.021129373461008072, -0.010122853331267834, 0.01558070257306099, -0.02335767261683941, -0.021038442850112915, 0.03212040290236473, -0.012692127376794815, -0.007116470020264387, -0.03727635741233826, -0.017399834468960762, -0.02664334513247013, -0.003071604995056987, -0.02397727593779564, -0.0055764708667993546, 0.020381635054945946, -0.044247522950172424, -0.026291824877262115, 0.048946306109428406, 0.006765359081327915, -0.05305059626698494, -0.08907196670770645, -0.07058348506689072, 0.016410209238529205, 0.09268414974212646, 0.04003412276506424, 0.0015496766427531838, 0.013204017654061317, 0.0057493653148412704, 0.02723216451704502, -0.061731986701488495, 0.022038843482732773, -0.03159370273351669, 0.05130905658006668, 0.03674164414405823, 0.067950539290905, 0.08970089256763458, -0.01869046315550804, 0.040613461285829544, -0.08512471616268158, -0.0437140017747879, -0.005163467023521662, 0.07348257303237915, -0.03877469152212143, -0.02986355498433113, 0.01429225318133831, 0.04974507540464401, -0.08651453256607056, 0.03211153298616409, 0.05123290792107582, 0.008042693138122559, 0.0797085091471672, -0.025586308911442757, 0.036500681191682816, -0.03462877869606018, -0.07807951420545578, -0.052725899964571, -0.07649172097444534, 0.12352877110242844, -0.0829358845949173, -0.069112129509449, -0.06804809719324112, -0.056574996560811996, -0.05387306213378906, -0.07636833935976028, -0.09341767430305481, -0.03358019143342972, -0.039840370416641235, -0.023070799186825752, 0.028502272441983223, 0.058943260461091995, -0.043832018971443176, -5.735297549089405e-33, 0.011742524802684784, 0.11072782427072525, 0.07242267578840256, 0.052284806966781616, -0.07900696992874146, 0.06293768435716629, 0.08747521787881851, -0.08847539126873016, -0.06910635530948639, -0.0789172574877739, 0.0201745443046093, -0.044609397649765015, -0.04187968000769615, 0.06738562881946564, 0.07553572952747345, -0.05293086916208267, -0.0021447555627673864, 0.024062255397439003, 0.009765789844095707, -0.007724428549408913, 0.044410958886146545, 0.08857236802577972, -0.02098185010254383, 0.030195150524377823, -0.0020955754444003105, 0.03659886121749878, -0.001467933296225965, 0.014415730722248554, 0.03223518654704094, 0.009512664750218391, -0.039167534559965134, -0.0003800299600698054, -0.06552613526582718, 0.036650002002716064, -0.062302883714437485, -0.006338625680655241, 0.02741062268614769, 0.040752340108156204, -0.009939100593328476, -0.007395220920443535, 0.061936698853969574, 0.10368100553750992, -0.0459974929690361, -0.01012269128113985, -0.019191954284906387, 0.03198939189314842, 0.11664818972349167, -0.025563521310687065, -0.010297982953488827, -0.024936456233263016, -0.03967408835887909, -0.011905987747013569, -0.021294908598065376, 0.043533582240343094, 0.007654803339391947, 0.00863239448517561, -0.07027488946914673, -0.008441630750894547, 0.049522459506988525, -0.08395498245954514, -0.026682714000344276, -0.057835862040519714, 0.030305897817015648, -0.04296180233359337, 0.06278210878372192, 0.013777750544250011, -0.10150324553251266, 0.06592977792024612, -0.005706661380827427, 0.0517692044377327, -0.06398462504148483, 0.044582922011613846, 0.03968794271349907, 0.013137277215719223, -0.01411725115031004, -0.039929844439029694, 0.026079410687088966, -0.04301779717206955, 0.004342644941061735, 0.05942636728286743, -0.07606828957796097, 0.04111205041408539, 0.0813087448477745, 0.059935785830020905, 0.017700595781207085, 0.09495606273412704, 0.006510711740702391, 0.08776681870222092, 0.08492767065763474, -0.023140009492635727, 0.03981726989150047, 0.06375853717327118, 0.12540972232818604, 0.10289348661899567, 0.007121242582798004, -4.9844580018998386e-08, -0.03213219717144966, -0.09476436674594879, -0.00236730114556849, 0.03332531452178955, 0.02321859635412693, -0.028333935886621475, -0.058454882353544235, -0.010381502099335194, -0.013321897946298122, -0.10449434816837311, 0.0304720439016819, 0.02064846083521843, -0.06533479690551758, -0.02357824146747589, -0.019821839407086372, 0.03602512180805206, -0.06660126894712448, -0.03872985765337944, 0.023470142856240273, -0.05039791762828827, -0.03360692411661148, -0.029903188347816467, -0.021238306537270546, 0.05556783080101013, -0.0383279025554657, -0.08222731202840805, -0.028924262151122093, 0.06465918570756912, 0.06882424652576447, -0.04260207712650299, 0.0068777380511164665, 0.015709329396486282, 0.06506728380918503, 0.0017609205096960068, 0.025061411783099174, 0.005583430174738169, -0.005763827823102474, 0.09701640903949738, 0.021885119378566742, 0.03087613172829151, -0.09238593280315399, 0.08141028136014938, 0.02223861590027809, 0.008202554658055305, 0.033962685614824295, -0.012602784670889378, -0.011695842258632183, -0.0033705963287502527, 0.00863091554492712, -0.07958018034696579, 0.040617503225803375, 0.0370606929063797, 0.02654423750936985, 0.09839911758899689, 0.057424500584602356, -0.02605142816901207, -0.12399850785732269, -0.02323342300951481, 0.010309392586350441, -0.005955620668828487, -0.04620492085814476, -0.06747957319021225, -0.045110661536455154, -0.05987507477402687 ] }, { "text": ")\n(branch7x7dbl_5): BasicConv2d(\n(conv): Conv2d(160, 192, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_6d): InceptionC(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_1): BasicConv2d(\n(conv): Conv2d(768, 160, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_33", "embedding": [ -0.02386719174683094, -0.0754077136516571, -0.05370975285768509, -0.01051243208348751, 0.02288055792450905, -0.08029472082853317, -0.03149009123444557, 0.011032525449991226, -0.046081069856882095, -0.08904273062944412, -0.01933683454990387, -0.06684142351150513, -0.002307649701833725, -0.05618664622306824, -0.040154505521059036, 0.0676361545920372, -0.0024909810163080692, 0.06792246550321579, -0.0752682089805603, -0.02285498008131981, -0.02235552668571472, 0.06848134845495224, 0.01144292950630188, 0.003408926771953702, 0.02163202501833439, 0.01724310591816902, 0.016850078478455544, 0.035215962678194046, 0.044784847646951675, -0.11924692243337631, 0.07508253306150436, 0.07921847701072693, -0.0565771721303463, 0.04513247683644295, 0.03283209353685379, 0.018915250897407532, -0.010640187188982964, -0.004324273206293583, -0.019769348204135895, 0.024874603375792503, 0.04496469348669052, 0.06198646128177643, 0.06883219629526138, 0.0025668477173894644, 0.06110323220491409, 0.12209513783454895, -0.026143429800868034, 0.020243866369128227, 0.05469278618693352, -0.0577843002974987, -0.009706873446702957, -0.05693579837679863, 0.0419473722577095, -0.02301015518605709, -0.0007883593789301813, 0.05533836409449577, 0.01128182839602232, -0.04505094885826111, 0.03432315215468407, 0.025304080918431282, 0.044824469834566116, -0.04265287145972252, -0.0012654667953029275, -0.013060986995697021, 0.034505732357501984, -0.12182000279426575, -0.004810383543372154, 0.03251912444829941, 0.06479968875646591, 0.03618314489722252, -0.0025625494308769703, 0.04427196830511093, -0.056161243468523026, -0.018737200647592545, 0.02157282456755638, -0.004601805470883846, 0.049944162368774414, -0.0038064157124608755, -0.00962947215884924, -0.1264123022556305, -0.04207657650113106, -0.01941891387104988, 0.02105184830725193, -0.10250068455934525, 0.024586299434304237, -0.012450487352907658, 0.015150385908782482, 0.05984600633382797, -0.016006024554371834, 0.00721236877143383, 0.03152551129460335, 0.11816646158695221, -0.0961323007941246, -0.05605051666498184, 0.021374015137553215, 0.014086497947573662, 0.013835457153618336, 0.010304121300578117, -0.002831085119396448, 0.06886006146669388, 0.04899311810731888, -0.027279525995254517, -0.02584914118051529, 0.06275499612092972, -0.0012634354643523693, 0.0004031427961308509, 0.09036749601364136, 0.07972811162471771, -0.015334434807300568, -0.052651725709438324, 0.0733036994934082, 0.02027885615825653, 0.05961959436535835, 0.010478279553353786, 0.0729193463921547, 0.036429766565561295, -0.0013463968643918633, 0.0163795817643404, -0.030694197863340378, 0.03968679532408714, -0.10045187920331955, -0.006458741147071123, -0.0059610409662127495, 0.05047119781374931, -0.12173539400100708, -0.01305788941681385, -0.055733080953359604, 6.1258092620600464e-33, -0.04734174534678459, -0.08578062802553177, -0.037875477224588394, -0.04695199429988861, 0.017142437398433685, 0.05878815799951553, -0.06452600657939911, -0.09950266033411026, -0.04146379977464676, -0.002834388054907322, -0.10490801930427551, -0.07099932432174683, -0.060190558433532715, -0.0020992853678762913, -0.004751462023705244, -0.11073660105466843, -0.010077787563204765, 0.06327824294567108, -0.006233139429241419, -0.008361675776541233, 0.058371156454086304, 0.026676500216126442, -0.06138819828629494, -0.0546608492732048, -0.004639048129320145, -0.018490733578801155, 0.004945097491145134, -0.020003542304039, -0.014650948345661163, 0.03685062378644943, -0.05526304244995117, 0.0023683381732553244, -0.04652508720755577, -0.00807282142341137, -0.022558940574526787, 0.01182906236499548, -0.008560210466384888, 0.014085489325225353, 0.018129443749785423, -0.06199545040726662, -0.031854745000600815, 0.06042058765888214, 0.006547362077981234, -0.05834072828292847, -0.09635686874389648, -0.07625718414783478, 0.01139916107058525, 0.09603694081306458, 0.005488245282322168, 0.031539186835289, 0.019608525559306145, -0.038519345223903656, 0.020850306376814842, -0.07904917001724243, 0.034132976084947586, -0.018779568374156952, 0.059444453567266464, 0.0639275461435318, 0.061482302844524384, 0.1303098350763321, 0.004388429690152407, 0.03268349543213844, -0.11772722750902176, -0.013079359196126461, -0.016067733988165855, 0.08187355846166611, -0.034969527274370193, 0.007194067817181349, 0.037542134523391724, 0.04213784635066986, -0.11021056026220322, 0.04787840694189072, 0.02571457251906395, 0.016630569472908974, 0.05929771810770035, -0.041524264961481094, 0.0024433154612779617, -0.030835511162877083, -0.07440552115440369, -0.025895889848470688, -0.05484537407755852, 0.14605852961540222, -0.07254888117313385, -0.058497171849012375, -0.08876567333936691, -0.026722416281700134, -0.04089144244790077, -0.05780318006873131, -0.08833414316177368, -0.015661688521504402, -0.0171347726136446, -0.0454612635076046, 0.052591584622859955, 0.04111587256193161, -0.02526853419840336, -6.560374462537676e-33, -0.001989996526390314, 0.09191170334815979, 0.05302400514483452, 0.04917161539196968, -0.03211725503206253, 0.053630903363227844, 0.09177415072917938, -0.09955379366874695, -0.05908169969916344, -0.07101563364267349, 0.008028886280953884, -0.0019900465849786997, -0.054331373423337936, 0.05709301680326462, 0.08186537772417068, -0.0942993089556694, 0.0019121099030598998, 0.03438037633895874, 0.03593562915921211, 0.004399964585900307, 0.046103715896606445, 0.07954984903335571, -0.03925485908985138, 0.024514444172382355, -0.041337743401527405, 0.038754161447286606, -0.04358789324760437, 0.0212479867041111, 0.05545036867260933, -0.009433029219508171, -0.03258642181754112, 0.01694590039551258, -0.08740420639514923, 0.02433467097580433, -0.01853303052484989, -0.009497304446995258, 0.03758339583873749, 0.049993131309747696, -0.005328285973519087, -0.015885211527347565, 0.053510501980781555, 0.10341745615005493, -0.06694693863391876, 0.00522511824965477, -0.030900822952389717, 0.04810967668890953, 0.09058910608291626, -0.027846213430166245, -0.059344977140426636, -0.02734374813735485, -0.057610608637332916, -0.009744909591972828, -0.034594371914863586, 0.06267721205949783, -0.005146982613950968, -0.008174938149750233, -0.021656060591340065, 0.00334337935782969, 0.06683824211359024, -0.04948806017637253, -0.022359976544976234, -0.054004967212677, -0.017594922333955765, -0.04564724862575531, 0.04268651455640793, 0.015217498876154423, -0.0786520317196846, 0.08394484966993332, 0.0036725455429404974, 0.05577264353632927, -0.05604908987879753, 0.0613672249019146, 0.04278626665472984, -0.0024033114314079285, -0.03620299696922302, -0.04283197969198227, 0.012799200601875782, -0.029541611671447754, 0.014062409289181232, 0.04657852649688721, -0.10243737697601318, 0.06978438049554825, 0.022033454850316048, 0.06823045760393143, 0.05915314331650734, 0.061429448425769806, 0.01663476973772049, 0.0738668218255043, 0.06221364438533783, -0.019077979028224945, 0.03186744451522827, 0.054772283881902695, 0.08968459069728851, 0.08786168694496155, 0.005395920015871525, -5.4183967534982e-08, -0.03332499787211418, -0.07551009953022003, 0.010709153488278389, 0.05516137555241585, 0.03532930836081505, -0.036045629531145096, -0.05365924909710884, 0.01720562018454075, -0.007183123845607042, -0.07782832533121109, 0.029359277337789536, 0.02298922650516033, -0.045950546860694885, -0.03125474974513054, -0.011737324297428131, 0.031532566994428635, -0.07680758833885193, -0.03452112153172493, 0.032627806067466736, -0.03580101951956749, -0.0336369089782238, -0.04324014484882355, -0.026787856593728065, 0.06837877631187439, -0.05205775052309036, -0.08598431944847107, 0.006581185385584831, 0.039724551141262054, 0.06726684421300888, -0.04525047540664673, 0.009945761412382126, -0.0012889279751107097, 0.04646898806095123, 0.02374081499874592, 0.019710712134838104, 0.04108452796936035, -0.03099728189408779, 0.08153073489665985, 0.011893183924257755, 0.04741186276078224, -0.08746257424354553, 0.07062144577503204, 0.028406843543052673, -0.014081666246056557, 0.041927240788936615, -0.029510943219065666, -0.003948601428419352, -0.017336850985884666, 0.02389109879732132, -0.05020374432206154, 0.010945439338684082, 0.044038694351911545, 0.038223978132009506, 0.10490401834249496, 0.07176907360553741, -0.028480054810643196, -0.11844868212938309, -0.06272919476032257, -0.008809724822640419, 0.0257533248513937, -0.011173974722623825, -0.045522429049015045, -0.06324215978384018, -0.05418768152594566 ] }, { "text": "(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_2): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_3): BasicConv2d(\n(conv): Conv2d(160, 192, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_1): BasicConv2d(\n(conv): Conv2d(768, 160, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_2): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_34", "embedding": [ -0.03718630224466324, -0.05809427425265312, -0.07504402101039886, -0.020314550027251244, 0.034608956426382065, -0.06400920450687408, -0.04942319914698601, 0.02427101880311966, -0.07266565412282944, -0.04293741285800934, 0.022722668945789337, -0.05542886257171631, 0.01596594788134098, -0.06192522868514061, -0.004182324279099703, 0.07570888847112656, -0.015276598744094372, 0.046240244060754776, -0.07110775262117386, -0.01901274546980858, -0.003297662129625678, 0.06398439407348633, 0.02292850986123085, 0.016855865716934204, 0.01311227586120367, 0.03365640714764595, 0.028952285647392273, 0.04117391258478165, 0.0092407101765275, -0.12157732993364334, 0.0444851815700531, 0.03809518739581108, -0.03661594167351723, 0.02469976618885994, 0.06485213339328766, 0.0019445634679868817, 0.0043183015659451485, 0.01714360900223255, -0.04792974889278412, 0.025137141346931458, 0.041119497269392014, 0.05728237330913544, 0.05521664768457413, 0.015984978526830673, 0.07532752305269241, 0.10994558036327362, -0.03428398817777634, -0.022444861009716988, 0.04660611227154732, -0.04074515402317047, -0.024887295439839363, -0.03956432268023491, 0.029162129387259483, -0.01969246007502079, -0.0066211167722940445, 0.05115493759512901, -0.027697661891579628, 1.7390331777278334e-05, 0.05814256891608238, 0.011318429373204708, 0.040769949555397034, -0.040107399225234985, -0.02764466032385826, -0.016989385709166527, 0.03627381473779678, -0.10102714598178864, -0.0047148787416517735, 0.02669994905591011, 0.04372742772102356, 0.0686042383313179, -0.013742994517087936, 0.01643221452832222, -0.0528421476483345, -0.03244221955537796, 0.014957156032323837, 0.0010168825974687934, 0.053965963423252106, -0.0017225396586582065, -0.027244331315159798, -0.1641227900981903, -0.026915986090898514, -0.01757187768816948, 0.012341036461293697, -0.11582312732934952, 0.01983114518225193, -0.012832771055400372, 0.02583266794681549, 0.04561319947242737, 0.024394921958446503, 0.003110639052465558, 0.054894428700208664, 0.0659535676240921, -0.08559998869895935, -0.028650011867284775, 0.02447335794568062, 0.026309514418244362, 0.046487897634506226, 0.0280783511698246, 0.04765347018837929, 0.06903720647096634, 0.04037002846598625, -0.014934810809791088, -0.037846922874450684, 0.08095060288906097, -0.01966049335896969, -0.0025860632304102182, 0.07782202214002609, 0.06348948925733566, 0.0033138771541416645, -0.050926558673381805, 0.10999612510204315, 0.03064599819481373, 0.07096453756093979, 0.0122854458168149, 0.0744650661945343, 0.019148994237184525, 0.013451595790684223, 0.03421422094106674, -0.013672552071511745, 0.031009718775749207, -0.0648454949259758, -0.027263177558779716, 0.030821776017546654, 0.054831501096487045, -0.11030907183885574, -0.04103982076048851, -0.04489615187048912, 6.034087641917291e-33, -0.05247831717133522, -0.07568284124135971, -0.06021669879555702, -0.032386016100645065, 0.0024759317748248577, 0.06525690108537674, -0.06320041418075562, -0.06070634722709656, -0.04623570293188095, 0.013641093857586384, -0.09238787740468979, -0.057787902653217316, -0.06012824550271034, -0.020631218329072, -0.014735894277691841, -0.0928003340959549, -0.008035918697714806, 0.0766807571053505, -0.012854468077421188, -0.012794798240065575, 0.08016008883714676, 0.04781406745314598, -0.061831872910261154, -0.060702499002218246, 0.010962532833218575, -0.022423170506954193, 0.036183733493089676, -0.007366952486336231, -0.027551759034395218, 0.030497735366225243, -0.002462092088535428, 0.004872553050518036, -0.04681604355573654, -0.006171122658997774, -0.03023846074938774, 0.0012711631134152412, -0.019419919699430466, -0.014653859660029411, 0.016306260600686073, -0.04321670904755592, -0.03790627419948578, 0.038147080689668655, -0.02135116420686245, -0.037640925496816635, -0.08877043426036835, -0.08333618938922882, 0.011842052452266216, 0.0913584902882576, 0.031115731224417686, 0.003257069271057844, 0.0032279544975608587, -0.004250186495482922, 0.028911078348755836, -0.07223686575889587, 0.010959804989397526, -0.044538430869579315, 0.04613443836569786, 0.028335915878415108, 0.056720953434705734, 0.08300662785768509, -0.0009503339533694088, 0.06377562880516052, -0.08937067538499832, -0.031207647174596786, -0.007887937128543854, 0.07109192758798599, -0.037493325769901276, -0.02994593419134617, 0.02782096527516842, 0.04684394598007202, -0.07418721914291382, 0.02546103298664093, 0.035976607352495193, 0.014958561398088932, 0.07398166507482529, -0.0339997261762619, 0.023865843191742897, -0.010438358411192894, -0.06690945476293564, -0.05425039678812027, -0.07457127422094345, 0.12058194726705551, -0.10178983211517334, -0.05222134664654732, -0.07718745619058609, -0.043972183018922806, -0.06125744432210922, -0.08641333878040314, -0.09566959738731384, -0.024663936346769333, -0.05552570894360542, -0.010255478322505951, 0.015406045131385326, 0.07378990948200226, -0.046356961131095886, -5.667544626101901e-33, -0.0006277933716773987, 0.12674744427204132, 0.06562437862157822, 0.04784183204174042, -0.08595256507396698, 0.06053180992603302, 0.1014125719666481, -0.10841645300388336, -0.06277593970298767, -0.0617913194000721, -0.006014554761350155, -0.03958546742796898, -0.04209147393703461, 0.058770712465047836, 0.07488621771335602, -0.06227226182818413, 0.03236781060695648, 0.025039518252015114, 0.004204202443361282, -0.01088052336126566, 0.04513563588261604, 0.07797876745462418, -0.0445345900952816, 0.038512758910655975, -0.005502861458808184, 0.06507357954978943, -0.008304125629365444, 0.03362852707505226, 0.020067160949110985, -0.0070993793196976185, -0.032357536256313324, 0.015673324465751648, -0.07824492454528809, 0.02212587557733059, -0.0641530379652977, 0.016480211168527603, 0.025441154837608337, 0.050618406385183334, -0.015216674655675888, -0.01676194556057453, 0.06797105818986893, 0.1083466038107872, -0.056469570845365524, 0.0028640329837799072, -0.02130221202969551, 0.03467298671603203, 0.12450038641691208, -0.01739211194217205, -0.016880281269550323, -0.025448840111494064, -0.031239263713359833, -0.011682235635817051, -0.027632320299744606, 0.05413011088967323, 0.006035642698407173, -0.006198338232934475, -0.06514690816402435, -0.024138864129781723, 0.025472965091466904, -0.08021451532840729, -0.004442261531949043, -0.05518067628145218, 0.03223615884780884, -0.03441952168941498, 0.05826636403799057, 0.026479044929146767, -0.08029849082231522, 0.05930143967270851, 0.026497486978769302, 0.04583539813756943, -0.048078060150146484, 0.05787116289138794, 0.045603957027196884, -0.0008847098797559738, -0.02623278647661209, -0.017399007454514503, 0.032331280410289764, -0.055969592183828354, -0.007265953347086906, 0.04536731168627739, -0.08162938058376312, 0.03360193595290184, 0.08380985260009766, 0.06986182183027267, -6.15472745266743e-05, 0.11061139404773712, 0.007565110456198454, 0.07179402559995651, 0.1009112223982811, -0.004735174588859081, 0.03264803811907768, 0.058623820543289185, 0.1261189728975296, 0.08887435495853424, -0.010626419447362423, -4.711630907650033e-08, -0.027055196464061737, -0.10828918218612671, -0.008923480287194252, 0.05612935498356819, -0.008467652834951878, -0.01949596032500267, -0.08022696524858475, -0.018326519057154655, -0.018095508217811584, -0.10861839354038239, 0.019093716517090797, 0.0050218962132930756, -0.06445613503456116, -0.026899192482233047, -0.0277260635048151, 0.014640329405665398, -0.05690143257379532, -0.030020607635378838, 0.017426572740077972, -0.04984324052929878, -0.02522900328040123, -0.029108654707670212, -0.004992840811610222, 0.06823969632387161, -0.03376961871981621, -0.06321412324905396, -0.019262179732322693, 0.043720729649066925, 0.06250506639480591, -0.033540233969688416, 0.012387383729219437, -0.004725452046841383, 0.06268581748008728, 0.023331496864557266, 0.030648574233055115, -0.008340047672390938, -0.014904062263667583, 0.10085394233465195, 0.032555822283029556, 0.016047976911067963, -0.0992814376950264, 0.06626404076814651, 0.008247976191341877, 0.03957625478506088, 0.042340826243162155, -0.041712772101163864, -0.025673218071460724, -0.011259655468165874, 0.014495856128633022, -0.09699474275112152, 0.039728034287691116, 0.023307520896196365, 0.038811635226011276, 0.12410278618335724, 0.049937326461076736, -0.023670047521591187, -0.10163731127977371, -0.03462592512369156, -0.002162329154089093, 0.017102323472499847, -0.026968222111463547, -0.05652933195233345, -0.06324702501296997, -0.0641329362988472 ] }, { "text": "(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_2): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_3): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_4): BasicConv2d(\n(conv): Conv2d(160, 160, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_5): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_35", "embedding": [ -0.028910264372825623, -0.062230825424194336, -0.0796399936079979, -0.010075198486447334, 0.02746134251356125, -0.06704398989677429, -0.05390314757823944, 0.04505620151758194, -0.07258660346269608, -0.045665841549634933, 0.02150707133114338, -0.06254135817289352, 0.0110780019313097, -0.07006550580263138, -0.014270365238189697, 0.08110513538122177, -0.014157594181597233, 0.04744575172662735, -0.0643853023648262, -0.017328456044197083, 0.0002119730197591707, 0.06778942048549652, 0.03507222235202789, 0.019933097064495087, 0.009870014153420925, 0.027367735281586647, 0.01755414716899395, 0.030448568984866142, -0.001114630256779492, -0.11600241810083389, 0.06079581007361412, 0.03660297766327858, -0.02318703383207321, 0.028463441878557205, 0.08351217955350876, -0.008079101331532001, 0.006840038578957319, -0.0006034777034074068, -0.04580244794487953, 0.01635162904858589, 0.036385588347911835, 0.04463928937911987, 0.04022160544991493, 0.021269669756293297, 0.0689333826303482, 0.10308986157178879, -0.03102375939488411, -0.02320309728384018, 0.05616946145892143, -0.02936638705432415, -0.01702965423464775, -0.04022650048136711, 0.02610182762145996, -0.03430000692605972, -0.01386185921728611, 0.05329392850399017, -0.020427996292710304, 0.012908409349620342, 0.0482485368847847, 0.014259396120905876, 0.04503059387207031, -0.041446756571531296, -0.021144436672329903, -0.02029954083263874, 0.024652589112520218, -0.10221358388662338, 0.0010212407214567065, 0.026506559923291206, 0.05192848667502403, 0.06493382155895233, -0.0210886187851429, 0.017752675339579582, -0.03904833644628525, -0.033788662403821945, 0.011903412640094757, -0.017090309411287308, 0.06367402523756027, -0.01749601401388645, -0.01097700372338295, -0.15191954374313354, -0.03634624555706978, -0.019454464316368103, 0.02096647024154663, -0.13817113637924194, 0.011491824872791767, -0.004911354277282953, 0.04227447137236595, 0.04286081716418266, 0.01772053726017475, 0.01343429833650589, 0.04546230658888817, 0.05997556820511818, -0.093341164290905, -0.029687581583857536, 0.024038396775722504, 0.03150039538741112, 0.04911777004599571, 0.023217057809233665, 0.044858336448669434, 0.05777020752429962, 0.036155130714178085, -0.013591359369456768, -0.03195055201649666, 0.08599428832530975, -0.02110397070646286, -0.009697040542960167, 0.07838058471679688, 0.06076885759830475, -0.016505759209394455, -0.05131644010543823, 0.11704923212528229, 0.0426369309425354, 0.06398403644561768, -0.0005273240385577083, 0.09124702215194702, 0.024818485602736473, 0.009929807856678963, 0.010648445226252079, -0.02983085624873638, 0.02637057937681675, -0.07439130544662476, -0.036677371710538864, 0.020411863923072815, 0.05775691568851471, -0.11517254263162613, -0.041596587747335434, -0.04954782873392105, 6.262716517706426e-33, -0.05058177560567856, -0.06824108213186264, -0.0564441978931427, -0.03930268436670303, -0.0011151201324537396, 0.07445615530014038, -0.05885067209601402, -0.05598393827676773, -0.044057801365852356, 0.01756366342306137, -0.09222995489835739, -0.07189544290304184, -0.05868697538971901, -0.010311421938240528, -0.0349089689552784, -0.10100901871919632, -0.02158583514392376, 0.07726480066776276, -0.006957709789276123, -0.01974324882030487, 0.0854877382516861, 0.05458415299654007, -0.0571315735578537, -0.049808427691459656, 0.01596454530954361, -0.011648815125226974, 0.04122837260365486, -0.009974585846066475, -0.018947124481201172, 0.03233359381556511, -0.008274773135781288, 0.001533546019345522, -0.052027713507413864, -0.020199134945869446, -0.019891362637281418, 0.004124732688069344, -0.0199141725897789, -0.005957887973636389, 0.03282957524061203, -0.03749541938304901, -0.04399572312831879, 0.0479186587035656, -0.013940807431936264, -0.034269433468580246, -0.09456159174442291, -0.07508564740419388, 0.004649158101528883, 0.09014394879341125, 0.04351121559739113, -0.0001865697413450107, 0.0034587671980261803, -0.017261121422052383, 0.034533705562353134, -0.06237722933292389, 0.01198983658105135, -0.04422985389828682, 0.047016508877277374, 0.021251220256090164, 0.05589353293180466, 0.0645408108830452, 0.005999860353767872, 0.05686122924089432, -0.07502099871635437, -0.04000130295753479, 0.004283326677978039, 0.07100867480039597, -0.03381872549653053, -0.022091681137681007, 0.01323791965842247, 0.053828343749046326, -0.07332403212785721, 0.026494110003113747, 0.04071636497974396, 0.015002777799963951, 0.08916330337524414, -0.029932057484984398, 0.04297840595245361, -0.008338868618011475, -0.07842326909303665, -0.047671884298324585, -0.055233608931303024, 0.12526489794254303, -0.09228488057851791, -0.07273746281862259, -0.060402050614356995, -0.04635068029165268, -0.06786041706800461, -0.0869721844792366, -0.0929965227842331, -0.03585539013147354, -0.031193172559142113, -0.012769028544425964, 0.02571800909936428, 0.07352560013532639, -0.05764531344175339, -6.0886063352244596e-33, 0.019007036462426186, 0.12334505468606949, 0.06955577433109283, 0.054843008518218994, -0.08292249590158463, 0.06839334964752197, 0.09502348303794861, -0.09615478664636612, -0.0650053322315216, -0.06833156943321228, 0.002391173504292965, -0.049261558800935745, -0.05185623839497566, 0.06469044834375381, 0.067330002784729, -0.0628533586859703, 0.01877496764063835, 0.025020048022270203, 0.00905210617929697, -0.005488178692758083, 0.03684372827410698, 0.07655605673789978, -0.03362990543246269, 0.042464859783649445, 0.001636253553442657, 0.04254947230219841, -0.01314124371856451, 0.018469313159585, 0.027231302112340927, -0.011391988955438137, -0.03288192301988602, 0.0306431595236063, -0.06780745089054108, 0.02672625333070755, -0.06025618314743042, 0.012450051493942738, 0.023549946025013924, 0.037780873477458954, -0.012841161340475082, -0.01316588930785656, 0.057366855442523956, 0.1182958334684372, -0.05270012468099594, -0.007243952248245478, -0.022337118163704872, 0.0381748266518116, 0.11686212569475174, -0.026785125955939293, -0.013881966471672058, -0.023938586935400963, -0.029345236718654633, -0.013477669097483158, -0.024414950981736183, 0.04787090793251991, 0.012422212399542332, -0.009839475154876709, -0.06284598261117935, -0.023538609966635704, 0.0173563901335001, -0.08667860925197601, -0.011633962392807007, -0.04328188672661781, 0.040002960711717606, -0.053400978446006775, 0.04985241964459419, 0.03029937855899334, -0.08142043650150299, 0.06922481954097748, 0.00626899441704154, 0.05086705461144447, -0.05215856805443764, 0.03838624432682991, 0.039096586406230927, 0.014508973807096481, -0.030096685513854027, -0.01722966507077217, 0.026284052059054375, -0.058201003819704056, -0.0016215001232922077, 0.05437418445944786, -0.06843893229961395, 0.036406636238098145, 0.09218748658895493, 0.06632649898529053, -0.00016867084195837379, 0.10291551053524017, -0.002906013047322631, 0.08331917226314545, 0.08681554347276688, -0.0009087556973099709, 0.03532153740525246, 0.06067615747451782, 0.13231851160526276, 0.0963275358080864, 0.004086621571332216, -5.0888214531141784e-08, -0.016024688258767128, -0.09185205399990082, -0.001005832338705659, 0.055229585617780685, 0.006092725321650505, -0.01888161711394787, -0.08561481535434723, -0.01704472303390503, 3.654684405773878e-05, -0.10787591338157654, 0.019977504387497902, 0.005537193268537521, -0.0674424022436142, -0.02636466547846794, -0.029930422082543373, 0.015023727901279926, -0.06350483000278473, -0.03370584547519684, 0.03306734561920166, -0.055317942053079605, -0.028443897143006325, -0.023365652188658714, -0.009394517168402672, 0.05259821563959122, -0.02768799103796482, -0.06460800766944885, -0.019789336249232292, 0.05375504121184349, 0.056192316114902496, -0.04730549454689026, 0.01385103166103363, -0.0033355574123561382, 0.0524086132645607, 0.01214541308581829, 0.025876551866531372, 0.004647670313715935, -0.007425508461892605, 0.09981716424226761, 0.027572086080908775, 0.018821517005562782, -0.09957492351531982, 0.07582753151655197, 0.024756737053394318, 0.02551378682255745, 0.02070961706340313, -0.030459579080343246, -0.019005727022886276, -0.015024089254438877, 0.006281179841607809, -0.09537772089242935, 0.0465589314699173, 0.028573285788297653, 0.02686488628387451, 0.12036055326461792, 0.041885774582624435, -0.012855048291385174, -0.11766684055328369, -0.018665608018636703, -0.00657928641885519, 2.60288124991348e-05, -0.04120585322380066, -0.0658457800745964, -0.06795338541269302, -0.06941939890384674 ] }, { "text": "(bn): BatchNorm2d(160, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_5): BasicConv2d(\n(conv): Conv2d(160, 192, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_6e): InceptionC(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_36", "embedding": [ -0.02949242666363716, -0.0719471201300621, -0.04739558696746826, -0.0036166205536574125, 0.02958390861749649, -0.08368634432554245, -0.040725674480199814, 0.02271493524312973, -0.04007064923644066, -0.0770602598786354, 0.0031696553342044353, -0.07585664838552475, -0.0016763432649895549, -0.051903948187828064, -0.012248282320797443, 0.06779821962118149, 0.00662428280338645, 0.05091026425361633, -0.08373692631721497, -0.003014958230778575, -0.023118801414966583, 0.05984926223754883, 0.026891889050602913, 0.005261117126792669, -0.0028535460587590933, 0.019457882270216942, 0.0098525146022439, 0.020407501608133316, 0.028438366949558258, -0.1175709068775177, 0.06485243141651154, 0.07726874947547913, -0.057268161326646805, 0.037170782685279846, 0.06525984406471252, 0.03121045231819153, -0.0030538050923496485, 0.006881631910800934, -0.02787882089614868, 0.01923179067671299, 0.04727434739470482, 0.055904388427734375, 0.06218956783413887, 0.014711578376591206, 0.07481356710195541, 0.12191368639469147, -0.025386936962604523, 0.00549342529848218, 0.0437578484416008, -0.045655276626348495, -0.018871307373046875, -0.0482897087931633, 0.025625767186284065, -0.03248807042837143, 0.0018968721851706505, 0.069195456802845, 0.0026182292494922876, -0.019151834771037102, 0.032364461570978165, 0.01245474349707365, 0.030203931033611298, -0.0363113135099411, -0.010959786362946033, -0.01633600704371929, 0.04112490266561508, -0.11440353840589523, -0.001441636006347835, 0.03954392671585083, 0.07202206552028656, 0.04380670189857483, 0.013614990748465061, 0.03120834194123745, -0.05930367857217789, -0.02054811641573906, 0.013775201514363289, -0.0009285318665206432, 0.04675973579287529, -0.009749350138008595, -0.01920139417052269, -0.14258284866809845, -0.03332344442605972, -0.03495727851986885, 0.017217028886079788, -0.1194583848118782, 0.033530671149492264, -0.015409489162266254, 0.035766810178756714, 0.04599267616868019, 0.0018250575521960855, 0.024857470765709877, 0.031138742342591286, 0.08868876844644547, -0.08689422160387039, -0.04155066981911659, 0.04435868561267853, 0.023225560784339905, 0.01751626469194889, 0.02085108682513237, 0.009469462558627129, 0.0592975951731205, 0.055974651128053665, -0.015555026941001415, -0.03131893277168274, 0.07039763778448105, -0.0009497251594439149, 0.0028622252866625786, 0.10012053698301315, 0.061630312353372574, -0.004105811007320881, -0.047624439001083374, 0.08919873088598251, 0.03079638071358204, 0.07157537341117859, 0.009313934482634068, 0.06614938378334045, 0.04280896484851837, -0.005042985547333956, 0.02135797031223774, -0.034121155738830566, 0.04395528882741928, -0.09009844809770584, -0.008039789274334908, -0.0008383130771107972, 0.0515647828578949, -0.11667606979608536, -0.008509171195328236, -0.047172266989946365, 5.52123635438482e-33, -0.04324061796069145, -0.0960785299539566, -0.0515645369887352, -0.04760738089680672, 0.010129302740097046, 0.0646686777472496, -0.06407956033945084, -0.08000028878450394, -0.04878399893641472, -0.011594589799642563, -0.0966586098074913, -0.05958416312932968, -0.06334173679351807, -0.0013627179432660341, -0.009075229056179523, -0.10876458883285522, -0.009267454035580158, 0.0590287484228611, 0.0002902364358305931, -0.006386679597198963, 0.07488036900758743, 0.029344012960791588, -0.06521853059530258, -0.06862732768058777, 0.003978067543357611, -0.020346682518720627, 0.020623471587896347, -0.006378524471074343, -0.016927823424339294, 0.04029902070760727, -0.04470372200012207, 0.0038913439493626356, -0.05328448861837387, -0.006967432331293821, -0.030814707279205322, 0.00843102764338255, -0.02190634422004223, -0.0013525085523724556, 0.018705880269408226, -0.05434741824865341, -0.048519350588321686, 0.058719996362924576, -0.01914602518081665, -0.049221668392419815, -0.09509541094303131, -0.09440673142671585, 0.007359336130321026, 0.09832651913166046, 0.004359782673418522, 0.03109372779726982, 0.0028698730748146772, -0.03708793967962265, 0.022158870473504066, -0.07926595211029053, 0.010990546084940434, -0.03360844403505325, 0.06048602983355522, 0.04462333396077156, 0.04611237347126007, 0.10474329441785812, 0.02697042189538479, 0.05877309665083885, -0.11429246515035629, -0.01243288628757, -0.013589316979050636, 0.07761090248823166, -0.04582202434539795, 0.009777810424566269, 0.03710463270545006, 0.04661816358566284, -0.09332354366779327, 0.03794531524181366, 0.024756431579589844, 0.01596054807305336, 0.08539248257875443, -0.05043540522456169, 0.019698215648531914, -0.01575682871043682, -0.08126982301473618, -0.033860888332128525, -0.04802125319838524, 0.1355944722890854, -0.07406309247016907, -0.055004216730594635, -0.08918289840221405, -0.019802819937467575, -0.053685612976551056, -0.061880189925432205, -0.09633877128362656, -0.005224593915045261, -0.00963390339165926, -0.03727114945650101, 0.04412224516272545, 0.061874985694885254, -0.036665406078100204, -5.5659554655679617e-33, -0.011365449987351894, 0.10095828026533127, 0.05431923270225525, 0.05751911178231239, -0.04230175539851189, 0.06178223341703415, 0.10435962677001953, -0.10316731035709381, -0.06568799912929535, -0.07574243098497391, -0.009253709577023983, -0.013611587695777416, -0.05282153561711311, 0.05820804461836815, 0.07943229377269745, -0.09804525226354599, 0.02304690331220627, 0.040686339139938354, 0.038134921342134476, 0.00896553322672844, 0.04381734877824783, 0.0779004767537117, -0.04400463402271271, 0.023822646588087082, -0.025088127702474594, 0.06170715391635895, -0.04217512533068657, 0.025028521195054054, 0.033689528703689575, -0.01982828602194786, -0.022805027663707733, 0.03426442667841911, -0.0915764644742012, 0.01890438050031662, -0.032761167734861374, 0.005157588981091976, 0.03912242874503136, 0.03461316600441933, -0.015576192177832127, -0.008876953274011612, 0.059812016785144806, 0.10897357016801834, -0.06130838021636009, 0.016557257622480392, -0.02876408025622368, 0.04913073405623436, 0.09871571511030197, -0.0308309905230999, -0.04078347608447075, -0.02812209352850914, -0.046845585107803345, -0.015859033912420273, -0.027662593871355057, 0.06405766308307648, 0.001489525893703103, -0.010682809166610241, -0.030633000656962395, -0.012036008760333061, 0.03030528873205185, -0.0610227957367897, -0.0036360728554427624, -0.037566300481557846, -0.006455537397414446, -0.05328184366226196, 0.05226488411426544, 0.02550048753619194, -0.07325025647878647, 0.08382640033960342, 0.011373323388397694, 0.050041694194078445, -0.05003730207681656, 0.057654157280921936, 0.029132533818483353, -0.007714555133134127, -0.041591886430978775, -0.018750762566924095, 0.021289436146616936, -0.04166542738676071, 0.014049166813492775, 0.03985156863927841, -0.09638971090316772, 0.06050209328532219, 0.044444065541028976, 0.07045672833919525, 0.028348758816719055, 0.07389967143535614, -0.0054863677360117435, 0.06645354628562927, 0.06580102443695068, -0.012337654829025269, 0.025276638567447662, 0.05462805554270744, 0.09990458190441132, 0.09674683958292007, 0.005933248903602362, -5.1301000780767936e-08, -0.017746619880199432, -0.08403726667165756, 0.006439659744501114, 0.06780113279819489, 0.021413199603557587, -0.026451943442225456, -0.07581648230552673, 0.0024062390439212322, -0.006135998293757439, -0.08083609491586685, 0.013317348435521126, 0.013216645456850529, -0.05557366460561752, -0.040006790310144424, -0.012954777106642723, 0.009741008281707764, -0.07427050918340683, -0.029010653495788574, 0.022186094895005226, -0.04599989205598831, -0.024542372673749924, -0.025844812393188477, -0.03003411553800106, 0.07153201848268509, -0.0501968115568161, -0.06389114260673523, 0.010865675285458565, 0.04296832159161568, 0.0627446323633194, -0.05048782378435135, 0.009578163735568523, -0.009269759990274906, 0.03716444969177246, 0.02073359303176403, 0.007835873402655125, 0.03273541107773781, -0.02580641396343708, 0.08774814009666443, 0.027222851291298866, 0.031884562224149704, -0.08489128202199936, 0.06815431267023087, 0.025409646332263947, 0.006001893896609545, 0.04168469086289406, -0.0441768541932106, -0.010887295007705688, -0.035783614963293076, 0.023240922018885612, -0.06468671560287476, 0.02541344054043293, 0.03766993433237076, 0.032047271728515625, 0.1294618546962738, 0.05941839516162872, -0.020286673679947853, -0.11251921206712723, -0.06424891948699951, -0.022219736129045486, 0.025881174951791763, -0.00425198907032609, -0.05333775654435158, -0.07629654556512833, -0.050980910658836365 ] }, { "text": ")\n(branch7x7_1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_2): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7_3): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_37", "embedding": [ -0.02095717191696167, -0.059758685529232025, -0.07118820399045944, -0.004135234747081995, 0.0337931290268898, -0.06494782865047455, -0.031710196286439896, 0.011872699484229088, -0.08127200603485107, -0.05578761547803879, 0.023783382028341293, -0.04225300997495651, 0.013589332811534405, -0.05588376149535179, -0.007266519125550985, 0.0670805424451828, -0.01737944595515728, 0.06212691217660904, -0.05435825139284134, -0.04032134264707565, -0.0001996537612285465, 0.0719175860285759, 0.02497897297143936, 0.009690805338323116, 0.013747647404670715, 0.022404145449399948, 0.02845611795783043, 0.05034695193171501, 0.01871555671095848, -0.11821579933166504, 0.05811971426010132, 0.045663945376873016, -0.03940218314528465, 0.051820315420627594, 0.044498611241579056, 0.001376844709739089, 0.004355094861239195, 0.031794093549251556, -0.03137335553765297, 0.046084556728601456, 0.04377760365605354, 0.05589637905359268, 0.07214819639921188, 0.002892702119424939, 0.06637678295373917, 0.09988771378993988, -0.032017599791288376, 0.0001979907538043335, 0.05430518835783005, -0.03726055473089218, -0.029475023970007896, -0.04849221184849739, 0.04427393525838852, -0.02117864601314068, 0.004164950456470251, 0.047315582633018494, -0.0019572824239730835, -0.04569417983293533, 0.05149015784263611, -0.002027864335104823, 0.05316958576440811, -0.051165517419576645, -0.020520541816949844, -0.015165423974394798, 0.011976155452430248, -0.12073351442813873, 0.004031658172607422, 0.03221121430397034, 0.04655718430876732, 0.06109052151441574, -0.009466467425227165, 0.029989030212163925, -0.042905423790216446, -0.015367462299764156, 0.012690681032836437, 0.005120302550494671, 0.0506279394030571, 0.005344998091459274, -0.033443327993154526, -0.16457083821296692, -0.01949692703783512, -0.004443074110895395, 0.012919683009386063, -0.09409227967262268, 0.006333330180495977, -0.019469838589429855, 0.0016856793081387877, 0.058921389281749725, 0.02402520179748535, -0.009541668929159641, 0.04421611502766609, 0.09043630212545395, -0.09526987373828888, -0.042819734662771225, 0.027309544384479523, 0.01485832966864109, 0.04255956411361694, 0.012110710144042969, 0.024599017575383186, 0.07666858285665512, 0.03231523931026459, -0.015223654918372631, -0.036101434379816055, 0.07343273609876633, -0.014388788491487503, 0.004230187274515629, 0.06049833446741104, 0.06564881652593613, -0.004965627565979958, -0.053397055715322495, 0.08629777282476425, 0.0033861014526337385, 0.07390174269676208, 0.009997028857469559, 0.0835537537932396, 0.015717031434178352, 0.032459065318107605, 0.04314613342285156, -0.009565133601427078, 0.0227342676371336, -0.07894063740968704, -0.030443107709288597, 0.035197220742702484, 0.05737666040658951, -0.10908278077840805, -0.044166963547468185, -0.05219901353120804, 4.914450578594171e-33, -0.05956953391432762, -0.07238774746656418, -0.06262227147817612, -0.03839130327105522, 0.016897721216082573, 0.048142749816179276, -0.044469043612480164, -0.08295665681362152, -0.04297064244747162, 0.006479973904788494, -0.10297254472970963, -0.07237285375595093, -0.045345935970544815, -0.018987881019711494, -0.009061036631464958, -0.08801651000976562, 0.011410294100642204, 0.06498550623655319, -0.009141907095909119, -0.022984512150287628, 0.07858280837535858, 0.029352836310863495, -0.05160732567310333, -0.046716779470443726, 0.008306172676384449, -0.03994985297322273, -0.0005486210575327277, -0.0019395106937736273, -0.021496299654245377, 0.01910698600113392, -0.014628497883677483, 0.009138371795415878, -0.02718387171626091, -0.002019226783886552, -0.02424541302025318, -0.019516486674547195, -0.00908549316227436, -0.013601165264844894, 0.03078855387866497, -0.04764667525887489, -0.036805976182222366, 0.03439577296376228, 0.007542131002992392, -0.053500112146139145, -0.09844715893268585, -0.08532486110925674, -0.000908060057554394, 0.11209721863269806, 0.030737049877643585, 0.017174748703837395, 0.02228464186191559, -0.008450423367321491, 0.03308434411883354, -0.0870777890086174, 0.021559253334999084, -0.05149587243795395, 0.026912622153759003, 0.054795052856206894, 0.06346544623374939, 0.09476255625486374, -0.007914100773632526, 0.03918910026550293, -0.0933290347456932, -0.026975532993674278, -0.012143800035119057, 0.06414313614368439, -0.04142726957798004, -0.020860441029071808, 0.03150983154773712, 0.05705096200108528, -0.09048385918140411, 0.03717255964875221, 0.01693096198141575, 0.01343526691198349, 0.0680115595459938, -0.03505147248506546, 0.009902793914079666, -0.02545923739671707, -0.06360702961683273, -0.048574578016996384, -0.06733247637748718, 0.13004927337169647, -0.10525866597890854, -0.030093509703874588, -0.0720478817820549, -0.040879569947719574, -0.04301176220178604, -0.08926389366388321, -0.08294785767793655, -0.025000981986522675, -0.05887768790125847, -0.012625917792320251, 0.013839634135365486, 0.06731195002794266, -0.021269602701067924, -5.34419074210366e-33, -0.005628840532153845, 0.13875356316566467, 0.05490667372941971, 0.03835359215736389, -0.07899067550897598, 0.05543220415711403, 0.08824275434017181, -0.11053206026554108, -0.061808992177248, -0.07082188129425049, -0.03761813044548035, -0.030837656930088997, -0.03487890213727951, 0.036283474415540695, 0.08428288251161575, -0.06535562872886658, 0.02591514401137829, 0.03595888987183571, 0.007860969752073288, -0.014291364699602127, 0.03724335506558418, 0.06698841601610184, -0.048083264380693436, 0.02994604781270027, -0.018642542883753777, 0.04779612645506859, -0.0049590361304581165, 0.03388435021042824, 0.019150564447045326, -0.006867836229503155, -0.03831532970070839, -0.0008262442424893379, -0.07109880447387695, 0.040487583726644516, -0.040029238909482956, 0.01724865846335888, 0.02549213171005249, 0.05539368838071823, -0.006487175822257996, 0.0018873483641073108, 0.07971752434968948, 0.09668299555778503, -0.05322358012199402, 0.00899601262062788, -0.022470006719231606, 0.03581378608942032, 0.11886230856180191, -0.012546855956315994, -0.050244979560375214, -0.0366629883646965, -0.04726418852806091, -0.004316767677664757, -0.03551935777068138, 0.057654544711112976, 0.007641148753464222, 0.017623722553253174, -0.0567253902554512, -0.011778843589127064, 0.06255542486906052, -0.0891093835234642, -0.022318389266729355, -0.091588094830513, 0.004629923962056637, -0.00019932376744691283, 0.0541682131588459, 0.012369111180305481, -0.07055570185184479, 0.05447185039520264, 0.003733846126124263, 0.05245036631822586, -0.048791732639074326, 0.06336784362792969, 0.042476460337638855, -0.006967942230403423, -0.029069531708955765, -0.03538452088832855, 0.021122340112924576, -0.037366654723882675, -0.03176740184426308, 0.05097566172480583, -0.07669996470212936, 0.027471762150526047, 0.05866013839840889, 0.05788472667336464, 0.016708604991436005, 0.11425752192735672, 0.027016256004571915, 0.08467692881822586, 0.09422896057367325, -0.020426718518137932, 0.047710709273815155, 0.06224064901471138, 0.11826204508543015, 0.06978054344654083, 0.0014560491545125842, -4.622496518891239e-08, -0.03496886417269707, -0.10877933353185654, -0.0013568861177191138, 0.051366861909627914, 0.0051577771082520485, -0.011358549818396568, -0.062189336866140366, -0.010380784049630165, -0.027072511613368988, -0.09095108509063721, 0.014057421125471592, 0.025826310738921165, -0.04573033004999161, -0.026449184864759445, -0.03107563965022564, 0.03550942614674568, -0.053386855870485306, -0.043816208839416504, 0.023681562393903732, -0.036358579993247986, -0.04360356554389, -0.05018887668848038, -0.01780191995203495, 0.09719662368297577, -0.04419071227312088, -0.07438919693231583, -0.022178933024406433, 0.026971429586410522, 0.05937398225069046, -0.024425137788057327, 0.021227197721600533, -0.007416548673063517, 0.06602555513381958, 0.03267340734601021, 0.03232485428452492, -0.0038659952115267515, -0.01820625178515911, 0.09389521926641464, 0.036567505449056625, 0.019193118438124657, -0.0986998900771141, 0.07561079412698746, 2.5980689315474592e-05, 0.026577692478895187, 0.05152877792716026, -0.038270097225904465, -0.025797033682465553, -0.013455729931592941, 0.01939699985086918, -0.0955464318394661, 0.025554904714226723, 0.03619310259819031, 0.045948326587677, 0.10544226318597794, 0.05203019827604294, -0.03833543136715889, -0.11192473769187927, -0.04887847229838371, 0.020824478939175606, 0.02576581947505474, -0.02934275195002556, -0.04110834747552872, -0.06474107503890991, -0.07587984949350357 ] }, { "text": "(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_2): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_3): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_4): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_5): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_38", "embedding": [ -0.011827779933810234, -0.06494178622961044, -0.06849739700555801, -0.004019211512058973, 0.02887541428208351, -0.05943211168050766, -0.05092047154903412, 0.009782884269952774, -0.07328050583600998, -0.04262611269950867, 0.017109952867031097, -0.04939920827746391, 0.025853468105196953, -0.06351860612630844, -0.012617993168532848, 0.07249264419078827, -0.01475501898676157, 0.041418951004743576, -0.06420250236988068, -0.03531073033809662, -0.004898635670542717, 0.08036962896585464, 0.04269262030720711, 0.009429395198822021, -0.0021608038805425167, 0.03368150070309639, 0.02864230051636696, 0.031496625393629074, 0.01203182153403759, -0.12081611901521683, 0.05410250276327133, 0.0390496663749218, -0.040247175842523575, 0.04716421663761139, 0.0756121426820755, -0.0010202322155237198, 0.008272702805697918, 0.023675689473748207, -0.034692540764808655, 0.03950868919491768, 0.051115553826093674, 0.04985702782869339, 0.05383940786123276, 0.026130521669983864, 0.06165987253189087, 0.10893535614013672, -0.046650249511003494, -0.007687896024435759, 0.0647866427898407, -0.04106632247567177, -0.024676639586687088, -0.039742473512887955, 0.03899833559989929, -0.01644880510866642, 0.003559619188308716, 0.05399410426616669, -0.004327191039919853, -0.010518159717321396, 0.05468274652957916, 0.016968291252851486, 0.05449898540973663, -0.0393526628613472, -0.02013767696917057, -0.02451474964618683, 0.029689179733395576, -0.10355594009160995, 0.0007970384322106838, 0.054958462715148926, 0.05019134655594826, 0.06584254652261734, -0.008952311240136623, 0.029462354257702827, -0.05869326740503311, -0.019205676391720772, 0.0027694215532392263, 0.008691499941051006, 0.05910026282072067, -0.015177309513092041, -0.03232957795262337, -0.15628989040851593, -0.03569548949599266, -0.013624507933855057, 0.007600214798003435, -0.12305228412151337, 0.016636855900287628, -0.026633216068148613, 0.011888519860804081, 0.03875823691487312, 0.02274760790169239, -0.002476527588441968, 0.04270002990961075, 0.06913769245147705, -0.10025949031114578, -0.037506669759750366, 0.028199011459946632, 0.020253442227840424, 0.03184197098016739, 0.011152430437505245, 0.033800918608903885, 0.06523244827985764, 0.03551587834954262, -0.006026452872902155, -0.05221622437238693, 0.06721530854701996, -0.010868088342249393, 0.010186409577727318, 0.057200249284505844, 0.061738599091768265, -0.012996655888855457, -0.04980536550283432, 0.1091378852725029, 0.02027251198887825, 0.07140854746103287, 0.007864512503147125, 0.07978744804859161, 0.019792892038822174, 0.03331251069903374, 0.026947779580950737, -0.02564604952931404, 0.01909630373120308, -0.08197999745607376, -0.028923163190484047, 0.03204905986785889, 0.05403728783130646, -0.10765890777111053, -0.044527020305395126, -0.046671412885189056, 5.9861447374770195e-33, -0.052257832139730453, -0.08356237411499023, -0.06180448830127716, -0.036176737397909164, 0.024230629205703735, 0.06658739596605301, -0.051687754690647125, -0.06172232702374458, -0.04990653693675995, 0.012319797649979591, -0.09472861140966415, -0.0731516182422638, -0.04242492467164993, -0.031238947063684464, -0.010176659561693668, -0.08694121986627579, -0.0009044866310432553, 0.06961808353662491, -0.013827851973474026, -0.013644001446664333, 0.07643687725067139, 0.040448516607284546, -0.04963243380188942, -0.0461694598197937, 0.0013870644615963101, -0.04591044411063194, 0.020303238183259964, -0.008802424184978008, -0.006476232316344976, 0.030360329896211624, -0.020477857440710068, 0.014989536255598068, -0.049123868346214294, -0.0031381091102957726, -0.026094628497958183, -0.01170220598578453, -0.010579942725598812, -0.018351079896092415, 0.02945408783853054, -0.045148178935050964, -0.052144937217235565, 0.031838562339544296, -0.019277725368738174, -0.03719916567206383, -0.09541622549295425, -0.07510014623403549, 0.0008714873692952096, 0.10097954422235489, 0.020545251667499542, 0.0072316015139222145, 0.01204006653279066, -0.015915747731924057, 0.03108168952167034, -0.0774906575679779, 0.01739361509680748, -0.06174015626311302, 0.035449735820293427, 0.030109135434031487, 0.07024945318698883, 0.09129872173070908, -0.0044891368597745895, 0.06362415850162506, -0.08929789811372757, -0.021572481840848923, 0.008343714289367199, 0.05983416363596916, -0.031582482159137726, -0.01960623636841774, 0.03377982974052429, 0.048640768975019455, -0.07238824665546417, 0.03369561955332756, 0.026962999254465103, 0.02047501504421234, 0.07814809679985046, -0.03477278724312782, 0.009271681308746338, -0.01670505292713642, -0.06213541701436043, -0.042048174887895584, -0.0481477752327919, 0.13067743182182312, -0.10925187915563583, -0.041392575949430466, -0.06298553198575974, -0.03810552507638931, -0.051943905651569366, -0.08763014525175095, -0.08808894455432892, -0.022645091637969017, -0.04920213297009468, -0.00755159929394722, 0.022324668243527412, 0.06221645325422287, -0.04160415381193161, -5.878002563279231e-33, 0.0056542158126831055, 0.13707415759563446, 0.050655901432037354, 0.047348253428936005, -0.08426716178655624, 0.05175092816352844, 0.09354332834482193, -0.11614517867565155, -0.06916730105876923, -0.0627451241016388, -0.032668586820364, -0.04552885517477989, -0.03167742118239403, 0.04904669523239136, 0.07527052611112595, -0.06603235751390457, 0.0350579097867012, 0.02823460102081299, 0.0008641083259135485, 0.0021501046139746904, 0.0371568389236927, 0.0687488541007042, -0.04652363806962967, 0.030717048794031143, -0.00548373581841588, 0.059359610080718994, -0.014787939377129078, 0.03430590033531189, 0.01609177514910698, -0.005422120913863182, -0.03764777258038521, 0.014304395765066147, -0.0758410394191742, 0.019225606694817543, -0.054617732763290405, 0.014496621675789356, 0.03201983496546745, 0.05420206859707832, -0.00909310020506382, -0.014593962579965591, 0.0730428546667099, 0.10512024164199829, -0.060879167169332504, 0.01169505249708891, -0.02420758455991745, 0.039687857031822205, 0.11492906510829926, -0.01698874682188034, -0.047072429209947586, -0.025262273848056793, -0.03646691143512726, -0.0019631781615316868, -0.028234709054231644, 0.0699043869972229, 0.012937868013978004, -0.002748404862359166, -0.06943832337856293, -0.02169834077358246, 0.04235963895916939, -0.0776059627532959, -0.003570527071133256, -0.07289547473192215, 0.022791597992181778, -0.01142694242298603, 0.05566086620092392, 0.019548529759049416, -0.06222205236554146, 0.06382784992456436, 0.004590310156345367, 0.036017972975969315, -0.047588638961315155, 0.052582621574401855, 0.050849344581365585, 0.011450240388512611, -0.02784622460603714, -0.013950521126389503, 0.01496768556535244, -0.050267335027456284, -0.024942321702837944, 0.07214879989624023, -0.09358777105808258, 0.03214630112051964, 0.07278315722942352, 0.0606030710041523, 0.01617606356739998, 0.10305260866880417, 0.020930202677845955, 0.0842665433883667, 0.08757080882787704, -0.008963831700384617, 0.03386365622282028, 0.06146262586116791, 0.11515104025602341, 0.06746989488601685, 0.012311299331486225, -4.939656506053325e-08, -0.02709425427019596, -0.10465870797634125, -0.00535066332668066, 0.048241447657346725, 0.0128394840285182, -0.016194289550185204, -0.07957259565591812, -0.009551400318741798, -0.0009932134998962283, -0.08958006650209427, 0.014794640243053436, 0.012710945680737495, -0.06298224627971649, -0.027417784556746483, -0.03671584278345108, 0.02153494767844677, -0.0480816587805748, -0.05462485924363136, 0.029139850288629532, -0.04141530767083168, -0.03233128413558006, -0.03752128407359123, -0.02349552884697914, 0.08154141902923584, -0.03948807343840599, -0.05829508230090141, -0.011315178126096725, 0.03358110412955284, 0.05551035329699516, -0.03848192095756531, 0.026098983362317085, -0.016227032989263535, 0.05893745645880699, 0.02186288684606552, 0.02425883524119854, -0.0017895508790388703, -0.009930726140737534, 0.10608530789613724, 0.03584190085530281, 0.013510101474821568, -0.12288425862789154, 0.05713102966547012, 0.007249737624078989, 0.03951706737279892, 0.041525449603796005, -0.04746328666806221, -0.028936859220266342, -0.006857193075120449, 0.010641871951520443, -0.09722652286291122, 0.030208418145775795, 0.022730154916644096, 0.050532545894384384, 0.11874224990606308, 0.05180070921778679, -0.020421119406819344, -0.10576532781124115, -0.049391090869903564, 0.003844646504148841, 0.03560416027903557, -0.032135430723428726, -0.04825453460216522, -0.08056068420410156, -0.07230132818222046 ] }, { "text": "(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7dbl_5): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(AuxLogits): InceptionAux(\n(conv0): BasicConv2d(\n(conv): Conv2d(768, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(128, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(conv1): BasicConv2d(\n(conv): Conv2d(128, 768, kernel_size=(5, 5), stride=(1, 1), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_39", "embedding": [ -0.015092606656253338, -0.05498261749744415, -0.0575769804418087, -0.014743377454578876, 0.0287860669195652, -0.07804055511951447, -0.0324021615087986, 0.014121203683316708, -0.0517197884619236, -0.06711814552545547, 0.022230325266718864, -0.06051861122250557, 0.020364640280604362, -0.035697534680366516, -0.012764997780323029, 0.06304071098566055, 0.002196140354499221, 0.034625161439180374, -0.05837355554103851, -0.03126901760697365, -0.0037563862279057503, 0.06838783621788025, 0.024077745154500008, -0.008551277220249176, 0.0016437413869425654, -0.005260853562504053, 0.003518697340041399, 0.011431305669248104, 0.02940332144498825, -0.11533956229686737, 0.04352506250143051, 0.08400647342205048, -0.05437707155942917, 0.03001144528388977, 0.07991603761911392, 0.02678649127483368, 0.0007798639708198607, 0.0016195203643292189, -0.0378822386264801, 0.039547547698020935, 0.0586092472076416, 0.04393235966563225, 0.0441366471350193, 0.03888881206512451, 0.05225353315472603, 0.11023256182670593, -0.029113592579960823, 0.009471992962062359, 0.035310205072164536, -0.038596175611019135, -0.003718853695318103, -0.022017288953065872, 0.0362725704908371, -0.023656075820326805, 0.015796126797795296, 0.05432750657200813, 0.008930077776312828, -0.016526708379387856, 0.029095392674207687, 0.01959623396396637, 0.04666673764586449, -0.04564173147082329, -0.03001413680613041, -0.03569544479250908, 0.02902478724718094, -0.10956943035125732, -0.0056565310806035995, 0.04131447896361351, 0.0726877748966217, 0.059717003256082535, 0.0009815776720643044, 0.024717256426811218, -0.08126136660575867, -0.011194097809493542, 0.003959732595831156, 0.022302329540252686, 0.058595091104507446, 0.004950028378516436, -0.019069453701376915, -0.17667576670646667, -0.02978871949017048, -0.003146224655210972, 0.024226095527410507, -0.12182842940092087, 0.023785807192325592, -0.03184933215379715, 0.026415469124913216, 0.05352191627025604, 0.029120005667209625, 0.01430486235767603, 0.01379507128149271, 0.06833437830209732, -0.08604311943054199, -0.03347516804933548, 0.03792417049407959, 0.030444232746958733, -0.005347910337150097, 0.02164212055504322, 0.015299712307751179, 0.07331938296556473, 0.04271556809544563, -0.009452886879444122, -0.0415840744972229, 0.058240730315446854, -0.01547639537602663, 0.016924148425459862, 0.07245353609323502, 0.06432528793811798, -0.006718425080180168, -0.06267201900482178, 0.09448491781949997, 0.020161626860499382, 0.07616084814071655, -0.002734964247792959, 0.0657864436507225, 0.03664049133658409, 0.001678859582170844, 0.030454596504569054, -0.02284768596291542, 0.0393671877682209, -0.07819207012653351, -0.009617378935217857, 0.012733896262943745, 0.052025292068719864, -0.1063683032989502, -0.0014632967067882419, -0.04631740227341652, 5.874180369929135e-33, -0.028673376888036728, -0.07648701965808868, -0.05407115817070007, -0.04612928628921509, 0.019407786428928375, 0.07413015514612198, -0.045647505670785904, -0.06710349768400192, -0.05196640267968178, -0.01913970150053501, -0.09972506761550903, -0.06953637301921844, -0.05623596906661987, -0.025815701112151146, -0.009071961045265198, -0.10088381171226501, -0.0061429524794220924, 0.07145006954669952, -0.0048053995706140995, -0.008108316920697689, 0.07444053888320923, 0.017487183213233948, -0.06122323125600815, -0.0675988644361496, 0.024352753534913063, -0.044640980660915375, 0.014058087021112442, -0.035646576434373856, 0.000798418652266264, 0.049996230751276016, -0.029082411900162697, 0.003224908374249935, -0.05008682236075401, -0.0016778352437540889, -0.03492860868573189, -0.005456762854009867, -0.018306532874703407, -0.010222423821687698, 0.02087993547320366, -0.07264833152294159, -0.049669038504362106, 0.04621603339910507, -0.018688322976231575, -0.03863219916820526, -0.10983016341924667, -0.09543547034263611, 0.009679780341684818, 0.1051795482635498, -0.0030695719178766012, 0.02479756623506546, 0.01672784797847271, -0.019018832594156265, 0.008264819160103798, -0.10028651356697083, 0.0034375530667603016, -0.05320315435528755, 0.04465314745903015, 0.05137677118182182, 0.04872836545109749, 0.10828909277915955, 0.023367522284388542, 0.0704970434308052, -0.11652947962284088, -0.0021716782357543707, -0.013935131020843983, 0.06817581504583359, -0.027594037353992462, -0.003125616814941168, 0.043139055371284485, 0.03519558161497116, -0.08956768363714218, 0.03968349099159241, 0.0046153017319738865, 0.015666671097278595, 0.0764126405119896, -0.046733442693948746, 0.03727024421095848, -0.020688597112894058, -0.07731511443853378, -0.0275704525411129, -0.06547624617815018, 0.12493236362934113, -0.08870897442102432, -0.05617672950029373, -0.06779445707798004, -0.045566827058792114, -0.03169563040137291, -0.05984712019562721, -0.08501382172107697, -0.01828765869140625, -0.02736339531838894, -0.026249419897794724, 0.05153123289346695, 0.06381590664386749, -0.03202810883522034, -5.600717772257654e-33, -0.015840085223317146, 0.10555800050497055, 0.054147765040397644, 0.03158111870288849, -0.04780052229762077, 0.05015440285205841, 0.09031625092029572, -0.10122467577457428, -0.08313330262899399, -0.07141972333192825, -0.03946073725819588, -0.009150299243628979, -0.03478366881608963, 0.04378645494580269, 0.06955235451459885, -0.09431182593107224, 0.02042432688176632, 0.04004908353090286, -0.007212172728031874, 0.024436896666884422, 0.030113250017166138, 0.08220505714416504, -0.0373559407889843, 0.03280173987150192, -0.021089697256684303, 0.06608032435178757, -0.0358753427863121, 0.04260821267962456, 0.020351272076368332, -0.007498572114855051, -0.02096066065132618, 0.00982960406690836, -0.11553125828504562, 0.01521030068397522, -0.02702115848660469, -0.0010805870406329632, 0.04377737268805504, 0.05062764510512352, -0.01685897447168827, 0.010036006569862366, 0.07528513669967651, 0.09515642374753952, -0.06503240019083023, 0.014990762807428837, -0.04908259958028793, 0.03919699788093567, 0.10287225246429443, -0.038870349526405334, -0.04410645738244057, -0.03263420984148979, -0.047974590212106705, -0.018843432888388634, -0.011684168130159378, 0.09263462573289871, -0.005560208577662706, 0.009246631525456905, -0.024232249706983566, 0.0026231533847749233, 0.037422455847263336, -0.05825795605778694, 0.010794134810566902, -0.058401599526405334, 0.017139112576842308, -0.023803232237696648, 0.06001150608062744, -0.0048805889673531055, -0.06750201433897018, 0.0820249393582344, -0.005658934824168682, 0.04671112075448036, -0.03755296394228935, 0.0633559301495552, 0.029268741607666016, 0.0176798515021801, -0.04761010408401489, -0.005776956211775541, 0.019823595881462097, -0.07180067896842957, -0.017938388511538506, 0.04684378579258919, -0.11536657810211182, 0.059721462428569794, 0.049478791654109955, 0.07646655291318893, 0.03637219965457916, 0.06255411356687546, 0.015164999291300774, 0.06790328025817871, 0.08521115034818649, -0.009422329254448414, 0.015251506119966507, 0.040985025465488434, 0.08480027318000793, 0.10503331571817398, 0.013077566400170326, -5.042934247967423e-08, -0.0368223711848259, -0.08984025567770004, 0.009856841526925564, 0.0711911991238594, 0.04754241555929184, -0.025929799303412437, -0.07638975232839584, 0.019729983061552048, -0.0070490762591362, -0.07385870069265366, 0.012418120168149471, 0.0163730438798666, -0.06346423178911209, -0.04815142601728439, -0.012383182533085346, 0.012245810590684414, -0.026987476274371147, -0.016869693994522095, 0.01498236134648323, -0.04226789250969887, -0.04734848812222481, -0.024112440645694733, -0.03386380523443222, 0.07567630708217621, -0.0729217454791069, -0.05862069129943848, 0.024767011404037476, 0.03498784825205803, 0.07397685945034027, -0.05515548959374428, 0.023092258721590042, 0.004090922884643078, 0.045619383454322815, 0.02061440981924534, -0.010244835168123245, 0.03224269673228264, -0.022099418565630913, 0.0949554294347763, 0.02309320867061615, 0.012109379284083843, -0.09051483869552612, 0.06378275901079178, 0.02411467954516411, 0.024130111560225487, 0.05190783366560936, -0.04713594168424606, -0.031135600060224533, -0.024708252400159836, 0.01399659551680088, -0.06904630362987518, 0.01715937629342079, 0.02599399723112583, 0.037977684289216995, 0.13179583847522736, 0.051263462752103806, -0.02484673075377941, -0.1124616488814354, -0.06388295441865921, -0.0013482080539688468, 0.038900893181562424, -0.018834881484508514, -0.037885863333940506, -0.05286971479654312, -0.0572589673101902 ] }, { "text": ")\n(conv1): BasicConv2d(\n(conv): Conv2d(128, 768, kernel_size=(5, 5), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(768, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(fc): Linear(in_features=768, out_features=1000, bias=True)\n)\n(Mixed_7a): InceptionD(\n(branch3x3_1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_2): BasicConv2d(\n(conv): Conv2d(192, 320, kernel_size=(3, 3), stride=(2, 2), bias=False)\n(bn): BatchNorm2d(320, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7x3_1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_40", "embedding": [ -0.01526340376585722, -0.07462575286626816, -0.04126381501555443, -0.020115569233894348, 0.05005674064159393, -0.07287631928920746, -0.04169053956866264, 0.005623347591608763, -0.07328926771879196, -0.0862085297703743, -0.009002989158034325, -0.08271359652280807, -0.007864928804337978, -0.057945579290390015, -0.0036444116849452257, 0.07469496876001358, 0.024279586970806122, 0.0603320375084877, -0.06404732167720795, -0.033589910715818405, -0.0037005655467510223, 0.06664304435253143, 0.02263888344168663, 0.006182260811328888, 0.026845507323741913, 0.03666195645928383, 0.027678554877638817, 0.03147969767451286, 0.03358975052833557, -0.09638819843530655, 0.07478853315114975, 0.09734640270471573, -0.062497787177562714, 0.015615650452673435, 0.022830821573734283, 0.036755628883838654, -0.017915144562721252, 0.012566952966153622, -0.06711821258068085, 0.02472648397088051, 0.04882097244262695, 0.08310277760028839, 0.06268172711133957, -0.01198713481426239, 0.06891912966966629, 0.11239950358867645, -0.04200797528028488, 0.008232960477471352, 0.06710060685873032, -0.07943407446146011, -0.05551491305232048, -0.05275239422917366, 0.011506329290568829, -0.019069211557507515, 0.003270346438512206, 0.04722397401928902, -0.007242641411721706, -0.03641129285097122, 0.0321693979203701, 0.008321383036673069, 0.036863114684820175, -0.026911597698926926, -0.003474092809483409, -0.009438338689506054, 0.044355086982250214, -0.10945282131433487, -0.02379915677011013, 0.005851486697793007, 0.04404665529727936, 0.04685593396425247, -0.028628064319491386, 0.03599152714014053, -0.05266401916742325, -0.03790586441755295, 0.007872414775192738, 0.02103927917778492, 0.07250814139842987, 0.014775503426790237, -0.039404068142175674, -0.1638316810131073, -0.015304164960980415, -0.005878447089344263, 0.008418927900493145, -0.09757508337497711, 0.021269984543323517, -0.022024644538760185, -0.021239442750811577, 0.03033166192471981, -0.033828992396593094, 0.024857841432094574, 0.03662537410855293, 0.08091994374990463, -0.0787382572889328, -0.040804069489240646, 0.053208138793706894, 0.015212498605251312, 0.04133254662156105, -0.006190713960677385, 0.019643427804112434, 0.08032108843326569, 0.023611601442098618, -0.04840824007987976, -0.022745836526155472, 0.060057539492845535, 0.00873255729675293, 0.024512415751814842, 0.0876753032207489, 0.048851534724235535, -0.005524009466171265, -0.03804892301559448, 0.06630119681358337, -0.006791079882532358, 0.0647464394569397, -0.01210060715675354, 0.06241835653781891, 0.05009552091360092, 0.029255423694849014, 0.0230819433927536, 0.012946227565407753, 0.04431324079632759, -0.0830453485250473, -0.044894665479660034, 0.02558588795363903, 0.04074694961309433, -0.09773043543100357, -0.040671899914741516, -0.06913451850414276, 5.8137610623228235e-33, -0.05697324499487877, -0.08452540636062622, -0.07210418581962585, -0.022662151604890823, 0.012272313237190247, 0.07078877091407776, -0.018749374896287918, -0.09150777012109756, -0.0285029299557209, 0.011424124240875244, -0.11286621540784836, -0.055508803576231, -0.06299316138029099, 0.009108759462833405, 0.01258216705173254, -0.11450464278459549, -0.009208901785314083, 0.048128124326467514, -0.012977233156561852, -0.0027794877532869577, 0.08187767118215561, 0.007707023993134499, -0.06568816304206848, -0.04938541725277901, -0.004968354478478432, -0.037838563323020935, -0.004859592765569687, -0.022998793050646782, -0.02961314655840397, 0.016529399901628494, -0.044995568692684174, 0.03417534753680229, -0.046014633029699326, 0.01715186983346939, -0.04079333692789078, -0.007722276262938976, 0.0035504139959812164, -0.018074307590723038, -0.013973763212561607, -0.053778450936079025, -0.03614620864391327, 0.05521203204989433, -0.002977380994707346, -0.07477428019046783, -0.09986203163862228, -0.0684782862663269, -0.016671394929289818, 0.10735581070184708, 0.019091855734586716, 0.020781515166163445, 0.031043127179145813, -0.012501782737672329, 0.02627493441104889, -0.09036040306091309, -0.005342470481991768, -0.01703522726893425, 0.047114450484514236, 0.05000343918800354, 0.06680954992771149, 0.10124995559453964, -0.021638670936226845, 0.04466567561030388, -0.09864895790815353, -0.011418911628425121, -0.032875824719667435, 0.08322127163410187, -0.042849086225032806, -0.0022703632712364197, 0.05680478736758232, 0.06613370776176453, -0.08178479969501495, 0.046321455389261246, 0.03356243669986725, -0.004047967493534088, 0.08820734918117523, -0.05443476140499115, -0.0054778289049863815, -0.03760417923331261, -0.05718186870217323, -0.0344015397131443, -0.04145853593945503, 0.14309431612491608, -0.06184679642319679, -0.026571424677968025, -0.07396034896373749, -0.013568484224379063, -0.05525539070367813, -0.06331782042980194, -0.09682053327560425, 0.007043279241770506, -0.051112428307533264, -0.0006291567697189748, 0.06367910653352737, 0.04585373401641846, -0.024977300316095352, -5.538560937064033e-33, -0.015368807129561901, 0.11489306390285492, 0.05997208505868912, 0.040731459856033325, -0.027725445106625557, 0.05022164061665535, 0.06257856637239456, -0.08742694556713104, -0.04077645763754845, -0.06112710013985634, 0.0035118183586746454, -0.028133684769272804, -0.027582930400967598, 0.016870923340320587, 0.06806135177612305, -0.0916328951716423, -0.00891770888119936, 0.01579274982213974, 0.030513793230056763, 0.021994246169924736, 0.04110896214842796, 0.08719981461763382, -0.07141556590795517, 0.002661332720890641, -0.04961260408163071, 0.04874490946531296, -0.0388389527797699, 0.04844558984041214, 0.019383249804377556, -0.03471909463405609, -0.041835635900497437, 0.0161496140062809, -0.10614030063152313, 0.04784708470106125, -0.021224239841103554, 0.0026641942095011473, 0.026277311146259308, 0.01121128536760807, -0.026934564113616943, -0.0055417572148144245, 0.0817456990480423, 0.09780318289995193, -0.07824059575796127, 0.031335607171058655, -0.03319273516535759, 0.03327375277876854, 0.09126560389995575, -0.013844017870724201, -0.030748974531888962, -0.03029489330947399, -0.05062706023454666, -0.004483632277697325, -0.036804601550102234, 0.0535895898938179, -0.0008264334755949676, 0.01997125707566738, -0.021865209564566612, -0.014828372746706009, 0.09244835376739502, -0.05868379399180412, -0.024287976324558258, -0.07228994369506836, 0.007986641488969326, -0.013471405021846294, 0.0841507688164711, 0.024822155013680458, -0.07167995721101761, 0.08205040544271469, -0.0015248410636559129, 0.06646224856376648, -0.0481753796339035, 0.061240024864673615, 0.03930871933698654, -0.0030810260213911533, -0.01427176408469677, -0.04799925908446312, 0.01706293411552906, -0.03299655020236969, 0.02079809084534645, 0.027306901291012764, -0.06477127969264984, 0.015133000910282135, 0.050283897668123245, 0.09053000062704086, 0.037783361971378326, 0.10447312891483307, 0.004835920408368111, 0.064048171043396, 0.06947611272335052, -0.006068573798984289, 0.037886664271354675, 0.06637496501207352, 0.09196241945028305, 0.09091373533010483, 0.018056808039546013, -4.9551275083103974e-08, -0.028872549533843994, -0.07232717424631119, -0.020415401086211205, 0.05195885896682739, 0.018051624298095703, -0.03536108508706093, -0.05147046223282814, 0.020434057340025902, -0.015895817428827286, -0.08875654637813568, 0.005173682235181332, 0.012681800872087479, -0.05567224323749542, -0.019808899611234665, -0.016406020149588585, 0.02149977907538414, -0.06105705350637436, -0.013440378941595554, 0.023341968655586243, -0.02164268121123314, -0.01276271604001522, -0.015853673219680786, -0.01834888383746147, 0.06976916640996933, -0.029330626130104065, -0.08649912476539612, 0.005632755812257528, 0.04959898069500923, 0.08941061794757843, 0.00016660013352520764, -0.02644966170191765, 0.002361799357458949, 0.049810390919446945, 0.03426651284098625, 0.011339436285197735, 0.022480187937617302, -0.027913665398955345, 0.08003389090299606, -0.01113984640687704, 0.022172924131155014, -0.0694451779127121, 0.10300878435373306, 0.0012632482685148716, -0.007224041502922773, 0.03653072938323021, -0.027286820113658905, 0.0010689471382647753, -0.06000436469912529, 0.04424691200256348, -0.03930819407105446, 0.02352983132004738, 0.059276703745126724, 0.04854806512594223, 0.12639954686164856, 0.06561089307069778, -0.05161122605204582, -0.09936989098787308, -0.027443990111351013, 0.006897352170199156, 0.014113077893853188, -0.018982794135808945, -0.05811047926545143, -0.06538408249616623, -0.05389576405286789 ] }, { "text": ")\n(branch7x7x3_1): BasicConv2d(\n(conv): Conv2d(768, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7x3_2): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(1, 7), stride=(1, 1), padding=(0, 3), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7x3_3): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(7, 1), stride=(1, 1), padding=(3, 0), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch7x7x3_4): BasicConv2d(\n(conv): Conv2d(192, 192, kernel_size=(3, 3), stride=(2, 2), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_41", "embedding": [ -0.02499602548778057, -0.05985114350914955, -0.07687651365995407, -0.010869817808270454, 0.04086229205131531, -0.06142193078994751, -0.03312675282359123, 0.010645917616784573, -0.07932896912097931, -0.050747647881507874, 0.01433869730681181, -0.04745429754257202, 0.013807589188218117, -0.05678771436214447, -0.00608344841748476, 0.07128480076789856, -0.012391872704029083, 0.05880778655409813, -0.04925128445029259, -0.028589924797415733, 0.007856166921555996, 0.08048257976770401, 0.03236052021384239, -0.0002923480060417205, 0.010294124484062195, 0.031424134969711304, 0.033671118319034576, 0.051157090812921524, 0.021736938506364822, -0.11170808225870132, 0.06363502889871597, 0.03928906470537186, -0.04350529611110687, 0.04913678020238876, 0.05086645483970642, 0.0015797902597114444, 0.006418966688215733, 0.031898315995931625, -0.04334419593214989, 0.05554411560297012, 0.040168680250644684, 0.06633064895868301, 0.07049086689949036, 0.00033902644645422697, 0.06894475966691971, 0.10515494644641876, -0.031145285815000534, -0.010267338715493679, 0.06477554142475128, -0.04729028418660164, -0.02753225713968277, -0.052408989518880844, 0.04661090672016144, -0.034160491079092026, 0.006005417089909315, 0.045074380934238434, -0.01217483077198267, -0.04669289290904999, 0.049684569239616394, -0.0016072334256023169, 0.05830096825957298, -0.042262036353349686, -0.013880475424230099, -0.011612895876169205, 0.020838871598243713, -0.10818186402320862, 0.002275870181620121, 0.03304610401391983, 0.04012444615364075, 0.05298676714301109, -0.021999219432473183, 0.031143561005592346, -0.04431844875216484, -0.021883951500058174, 0.020993392914533615, 0.009377529844641685, 0.05444560945034027, 0.001880902098491788, -0.024353817105293274, -0.170181542634964, -0.018587574362754822, -0.004879218991845846, 0.006212596781551838, -0.09211088716983795, 0.005623239558190107, -0.027441782876849174, -0.0036386563442647457, 0.05198408663272858, 0.024423735216259956, -0.0131149310618639, 0.045699816197156906, 0.09394102543592453, -0.1030229926109314, -0.033653855323791504, 0.0287541002035141, 0.01549938041716814, 0.04490993171930313, 0.006440918892621994, 0.017987266182899475, 0.07558485120534897, 0.03410943225026131, -0.014608870260417461, -0.03748411685228348, 0.07013167440891266, -0.01175743993371725, 0.009348401799798012, 0.06505151838064194, 0.06975457817316055, -0.01327467616647482, -0.04891055449843407, 0.08890005201101303, 0.005781284533441067, 0.06247902289032936, 0.0042222426272928715, 0.07511572539806366, 0.023825477808713913, 0.03879854828119278, 0.03464183956384659, -0.008334212005138397, 0.018945788964629173, -0.07800785452127457, -0.03353693336248398, 0.027029260993003845, 0.05311030149459839, -0.10971461981534958, -0.046320654451847076, -0.055457424372434616, 5.7459658950070865e-33, -0.06186157092452049, -0.06463626027107239, -0.0715617761015892, -0.030938172712922096, 0.007274344563484192, 0.059483129531145096, -0.03178659453988075, -0.09195379912853241, -0.03994312509894371, 0.005472551565617323, -0.0984334722161293, -0.067594014108181, -0.04845202714204788, -0.011507348157465458, -0.006793631706386805, -0.08727135509252548, 0.011322090402245522, 0.06078442931175232, -0.005810553207993507, -0.017802651971578598, 0.07870469242334366, 0.029836276546120644, -0.05547577887773514, -0.04537898674607277, 0.0027108595240861177, -0.047939687967300415, 0.004335978999733925, -0.004328996874392033, -0.01703132688999176, 0.02036774344742298, -0.004207985009998083, 0.010850167833268642, -0.030681587755680084, -0.0011037939693778753, -0.026950256898999214, -0.01597452163696289, -0.016931399703025818, -0.016059963032603264, 0.016759825870394707, -0.04713750258088112, -0.038372479379177094, 0.0311160609126091, 0.0024688332341611385, -0.057864710688591, -0.10212168842554092, -0.085371233522892, 0.0059500206261873245, 0.10690580308437347, 0.032876402139663696, 0.004958265461027622, 0.021262144669890404, 0.0008275909931398928, 0.03673355281352997, -0.0795430988073349, 0.023094793781638145, -0.055814873427152634, 0.027767859399318695, 0.05372045561671257, 0.06411091238260269, 0.09159906953573227, -0.02255680225789547, 0.03554367646574974, -0.08980998396873474, -0.0229511596262455, -0.01540229469537735, 0.07022786885499954, -0.0378873236477375, -0.024520227685570717, 0.03163590282201767, 0.05468365177512169, -0.08322780579328537, 0.03123144432902336, 0.028837960213422775, 0.018138417974114418, 0.06982166320085526, -0.035971567034721375, 0.005862105172127485, -0.025929192081093788, -0.056660305708646774, -0.054463889449834824, -0.057066429406404495, 0.12397992610931396, -0.0930338203907013, -0.024206917732954025, -0.0774131715297699, -0.04058630391955376, -0.04413183033466339, -0.08321794122457504, -0.08860895037651062, -0.01830965466797352, -0.05483831837773323, -0.013870959170162678, 0.024603979662060738, 0.06282191723585129, -0.026772640645503998, -5.5344331151827235e-33, -0.00980073120445013, 0.1341741532087326, 0.04894303157925606, 0.03392800688743591, -0.0854763463139534, 0.05422481894493103, 0.08773572742938995, -0.10868848115205765, -0.06109295412898064, -0.07333870977163315, -0.022116435691714287, -0.03966443985700607, -0.035110097378492355, 0.04117501899600029, 0.07742494344711304, -0.06517736613750458, 0.025875702500343323, 0.02792290598154068, 0.004605904221534729, -0.011887727305293083, 0.05091661587357521, 0.07210808992385864, -0.04711628332734108, 0.018043115735054016, -0.018729764968156815, 0.05751766264438629, -0.006203740835189819, 0.038694415241479874, 0.01290061790496111, 0.0028543302323669195, -0.04063772037625313, 0.0021577165462076664, -0.06505730748176575, 0.04391729459166527, -0.03827054798603058, 0.013528901152312756, 0.030419297516345978, 0.042567625641822815, -0.01010646391659975, -0.006671402137726545, 0.08062278479337692, 0.09275948256254196, -0.05911282077431679, 0.011907754465937614, -0.02185545302927494, 0.03945218399167061, 0.12407563626766205, -0.01537014078348875, -0.044308144599199295, -0.03278452157974243, -0.05652995780110359, -0.0011475682258605957, -0.030682871118187904, 0.06141097471117973, 0.020819010213017464, 0.018328486010432243, -0.06275921314954758, -0.011067225597798824, 0.06823728233575821, -0.08499398082494736, -0.01995706744492054, -0.08172385394573212, 0.013780424371361732, -0.0043304115533828735, 0.07061012834310532, 0.014055567793548107, -0.06680143624544144, 0.05384219437837601, 0.013934391550719738, 0.05606149509549141, -0.050529204308986664, 0.06388983130455017, 0.049748826771974564, -0.0073834313079714775, -0.02403980866074562, -0.03286102041602135, 0.030806005001068115, -0.03313055261969566, -0.023879969492554665, 0.054836198687553406, -0.07338038086891174, 0.02221633680164814, 0.06390220671892166, 0.06954070180654526, 0.020073583349585533, 0.10591169446706772, 0.027355704456567764, 0.08824969083070755, 0.09019617736339569, -0.026062192395329475, 0.04180746152997017, 0.059843458235263824, 0.11479885131120682, 0.07430426776409149, 0.010697864927351475, -4.680217102759343e-08, -0.035357821732759476, -0.11022103577852249, -0.010477852076292038, 0.04207426309585571, 0.001012301305308938, -0.016730783507227898, -0.06435505300760269, -0.02190995030105114, -0.031231816858053207, -0.08866774290800095, 0.01518300548195839, 0.01580752432346344, -0.04770442470908165, -0.03513820469379425, -0.029487144201993942, 0.029907269403338432, -0.04839344695210457, -0.04217655211687088, 0.019903821870684624, -0.039902716875076294, -0.033943235874176025, -0.04574942961335182, -0.02486894279718399, 0.09519048780202866, -0.03896603733301163, -0.06820015609264374, -0.024818474426865578, 0.02416977286338806, 0.06978298723697662, -0.021760551258921623, 0.011090527288615704, -0.010410802438855171, 0.07386759668588638, 0.03209501504898071, 0.0313301756978035, 0.0028906131628900766, -0.021197926253080368, 0.08833006024360657, 0.03588993102312088, 0.016882020980119705, -0.09574391692876816, 0.08093170076608658, -0.0004434804432094097, 0.026736365631222725, 0.05580803006887436, -0.0326462984085083, -0.0282297246158123, -0.011858707293868065, 0.015666767954826355, -0.09387968480587006, 0.027996422722935677, 0.032648105174303055, 0.047931671142578125, 0.11541955918073654, 0.05301429703831673, -0.04291492700576782, -0.11467099189758301, -0.04377805441617966, 0.020805399864912033, 0.03039475902915001, -0.028551176190376282, -0.0447852686047554, -0.07791122794151306, -0.07093607634305954 ] }, { "text": "(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_7b): InceptionE(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(1280, 320, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(320, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_1): BasicConv2d(\n(conv): Conv2d(1280, 384, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_2a): BasicConv2d(\n(conv): Conv2d(384, 384, kernel_size=(1, 3), stride=(1, 1), padding=(0, 1), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_2b): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_42", "embedding": [ -0.040345653891563416, -0.08373497426509857, -0.04758983850479126, -0.02271689474582672, 0.024677380919456482, -0.08082858473062515, -0.04237359017133713, 0.020985713228583336, -0.05070403590798378, -0.07351630926132202, 0.0009612701833248138, -0.07726753503084183, 0.006876796949654818, -0.062131233513355255, 0.005634027533233166, 0.0825793594121933, -0.015028238296508789, 0.0799202024936676, -0.07185184955596924, -0.00407367991283536, -0.0019580498337745667, 0.06290674954652786, 0.020096803084015846, 0.024063492193818092, 0.021845297887921333, 0.03240850567817688, 0.017106885090470314, 0.0319594070315361, 0.022900991141796112, -0.1222429946064949, 0.07661953568458557, 0.05835855007171631, -0.05135608837008476, 0.013645036146044731, 0.04466152936220169, 0.019285840913653374, -0.020947501063346863, 0.01093811634927988, -0.06664137542247772, 0.014899756759405136, 0.046846892684698105, 0.0726546049118042, 0.059534817934036255, -0.016661526635289192, 0.06838973611593246, 0.1040482372045517, -0.0324472077190876, -0.0072237360291182995, 0.039229098707437515, -0.05188016965985298, -0.025193901732563972, -0.07456433027982712, 0.014376155100762844, -0.014371111989021301, -0.00797929335385561, 0.06374102830886841, -0.022310640662908554, -0.0023844032548367977, 0.033935822546482086, 0.008111276663839817, 0.026458052918314934, -0.021768199279904366, -0.02171315625309944, -0.02162759192287922, 0.06547561287879944, -0.0725562572479248, -0.010672930628061295, 0.0141855264082551, 0.05417751893401146, 0.06885119527578354, -0.013056309893727303, 0.009960994124412537, -0.056962721049785614, -0.04048742726445198, 0.01513511873781681, 0.0007851829868741333, 0.0671243742108345, 0.007725991774350405, -0.028620557859539986, -0.14886416494846344, -0.024854956194758415, -0.030976029112935066, 0.007364645600318909, -0.1132800355553627, 0.02221548743546009, -0.0032522189430892467, 0.0012298213550820947, 0.038966886699199677, 0.0002477431553415954, 0.017567215487360954, 0.031804051250219345, 0.08345868438482285, -0.08655275404453278, -0.04096849635243416, 0.04671020433306694, 0.016569437459111214, 0.032389648258686066, 0.019131090492010117, 0.054121650755405426, 0.06125682219862938, 0.04233108088374138, -0.0269758477807045, -0.032919079065322876, 0.06351315230131149, -0.02167930267751217, 0.013592073693871498, 0.09691748768091202, 0.05445495620369911, 0.008402404375374317, -0.04129427671432495, 0.09217424690723419, 0.025524618104100227, 0.06822214275598526, 0.004567276686429977, 0.056452471762895584, 0.04513083025813103, 0.014494002796709538, 0.017302628606557846, -0.0016388451913371682, 0.03916383534669876, -0.09466125816106796, -0.027248334139585495, 0.03659575432538986, 0.03902381286025047, -0.12110019475221634, -0.04149487987160683, -0.06562546640634537, 6.17647490529041e-33, -0.057249974459409714, -0.07398980110883713, -0.052996791899204254, -0.02759113721549511, 0.010862120427191257, 0.0780581533908844, -0.060605429112911224, -0.0826420709490776, -0.051167864352464676, 0.005854148417711258, -0.1087430790066719, -0.04614409804344177, -0.06651025265455246, 0.013590864837169647, -0.014529244974255562, -0.11462808400392532, -0.015471416525542736, 0.06690758466720581, -0.010492103174328804, 0.0024395734071731567, 0.08547765761613846, 0.02355404756963253, -0.07955344766378403, -0.04856292903423309, -0.0014121879357844591, -0.02081049419939518, 0.04304688423871994, -0.004456713330000639, -0.030804460868239403, 0.018210018053650856, -0.02744373120367527, 0.0036479169502854347, -0.06719119846820831, -0.0027670192066580057, -0.014307062141597271, 0.018348410725593567, -0.011717484332621098, 0.00242863642051816, 0.0062224664725363255, -0.03855343535542488, -0.02754097618162632, 0.04703943803906441, -0.010274882428348064, -0.050981104373931885, -0.09240751713514328, -0.08153609931468964, -0.018159355968236923, 0.10519102215766907, 0.03511262312531471, 0.015107785351574421, 0.020497391000390053, -0.014401423744857311, 0.030186712741851807, -0.07354166358709335, 0.015024184249341488, -0.01900665834546089, 0.047747835516929626, 0.04969225823879242, 0.06397856026887894, 0.08720850199460983, 0.006643312517553568, 0.05711560323834419, -0.09500820934772491, -0.009631726890802383, -0.02264142595231533, 0.09700112044811249, -0.05370223522186279, -0.01157013326883316, 0.04251531511545181, 0.04917795583605766, -0.08783864229917526, 0.03232216462492943, 0.038451891392469406, 0.01241371314972639, 0.08950544893741608, -0.03802361339330673, -0.002721738535910845, -0.002174932509660721, -0.049454789608716965, -0.02969519793987274, -0.06862695515155792, 0.12915141880512238, -0.06699918955564499, -0.045270901173353195, -0.09324519336223602, -0.02188022807240486, -0.057249873876571655, -0.07396506518125534, -0.0932905450463295, 0.0008179658907465637, -0.035305753350257874, -0.00886478554457426, 0.03430982306599617, 0.06488678604364395, -0.055619243532419205, -5.6617637652897476e-33, -0.011068320833146572, 0.11157537251710892, 0.07274062186479568, 0.04685520753264427, -0.05870594084262848, 0.06258392333984375, 0.08472733199596405, -0.11155307292938232, -0.03532344475388527, -0.06087138503789902, 0.020458677783608437, -0.016758428886532784, -0.04578005522489548, 0.03591648116707802, 0.08669745922088623, -0.0863761454820633, 0.025527147576212883, 0.016228973865509033, 0.02303818240761757, -0.003909711260348558, 0.056330498307943344, 0.08182957023382187, -0.054538384079933167, 0.019781488925218582, -0.035006944090127945, 0.05904093012213707, -0.015283521264791489, 0.05957083776593208, 0.04434456303715706, -0.018143413588404655, -0.030504772439599037, 0.041820209473371506, -0.08021628111600876, 0.02918846160173416, -0.0474972128868103, 0.026976319029927254, 0.0376245379447937, 0.029321279376745224, -0.018522687256336212, -0.03699539601802826, 0.04843830317258835, 0.1075604259967804, -0.07385699450969696, 0.028663743287324905, -0.022510936483740807, 0.055032484233379364, 0.10020890831947327, -0.025956392288208008, -0.022142423316836357, -0.029008759185671806, -0.042004380375146866, -0.012734747491776943, -0.03263094276189804, 0.04197828471660614, -0.0056908996775746346, -0.013190770521759987, -0.041629496961832047, -0.03224742412567139, 0.04165646806359291, -0.07009442150592804, -0.023800406605005264, -0.04658379405736923, 0.03287153318524361, -0.04206705465912819, 0.047652468085289, 0.02408004365861416, -0.07779263705015182, 0.06055018678307533, 0.024226000532507896, 0.06320710480213165, -0.0369742289185524, 0.06641322374343872, 0.04572935029864311, -0.0037298426032066345, -0.02159895934164524, -0.025242377072572708, 0.01693487912416458, -0.047865256667137146, 0.012590346857905388, 0.01398778147995472, -0.06954016536474228, 0.03762732446193695, 0.06624003499746323, 0.0752786174416542, 0.01953946240246296, 0.08493338525295258, -0.012902162037789822, 0.07636698335409164, 0.08551034331321716, -0.006991742178797722, 0.03845427185297012, 0.06490346789360046, 0.11147357523441315, 0.09733825922012329, 0.002653684699907899, -4.880175907828743e-08, -0.004459355492144823, -0.07945610582828522, -0.006213821470737457, 0.05849756300449371, -0.009631356224417686, -0.01851664111018181, -0.0716380625963211, -0.0034227236174046993, -0.006512050982564688, -0.12159452587366104, 0.007935205474495888, 0.003964782692492008, -0.06083057075738907, -0.03663456067442894, -0.019398817792534828, 0.01617606356739998, -0.08209111541509628, -0.021784180775284767, 0.02388519048690796, -0.040857601910829544, -0.022541066631674767, -0.005947941914200783, 0.00040828960482031107, 0.0540044866502285, -0.0284452885389328, -0.068236343562603, 0.0001739082217682153, 0.04194840043783188, 0.06533104181289673, -0.01723274029791355, 0.0009041214361786842, 0.003257205942645669, 0.03889532759785652, 0.03835359960794449, 0.01658986508846283, 0.014230507425963879, -0.028053121641278267, 0.10716092586517334, 0.010553115978837013, 0.022122060880064964, -0.08024012297391891, 0.06701461970806122, 0.00997447781264782, 0.01813742332160473, 0.03272251784801483, -0.0402841679751873, -0.029135050252079964, -0.038341887295246124, 0.038036368787288666, -0.07036997377872467, 0.02734239399433136, 0.05075501650571823, 0.02424180693924427, 0.1292625367641449, 0.03461304306983948, -0.022761458531022072, -0.10809725522994995, -0.03951498866081238, -0.009684231132268906, 0.003125684102997184, -0.01734585128724575, -0.06838704645633698, -0.05373341217637062, -0.06263337284326553 ] }, { "text": "(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_2b): BasicConv2d(\n(conv): Conv2d(384, 384, kernel_size=(3, 1), stride=(1, 1), padding=(1, 0), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_1): BasicConv2d(\n(conv): Conv2d(1280, 448, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(448, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_2): BasicConv2d(\n(conv): Conv2d(448, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3a): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_43", "embedding": [ -0.0357334204018116, -0.06737654656171799, -0.08440610766410828, -0.04372197389602661, 0.02111297845840454, -0.08167267590761185, -0.041600171476602554, 0.024647070094943047, -0.05082818493247032, -0.05962174013257027, 0.03488028794527054, -0.06096987426280975, 0.01274437177926302, -0.059066906571388245, 0.013793695718050003, 0.08406572043895721, -0.025349991396069527, 0.047621238976716995, -0.07880119234323502, 0.010618943721055984, 0.015908947214484215, 0.05420839041471481, 0.021670516580343246, 0.02264327183365822, 0.026273876428604126, 0.021218489855527878, 0.03106061927974224, 0.044813767075538635, 0.0044351802207529545, -0.10776450484991074, 0.06980423629283905, 0.040313608944416046, -0.0425163209438324, -0.0038072282914072275, 0.08060367405414581, -0.0015847582835704088, -0.016329385340213776, -0.00923194456845522, -0.07454174011945724, 0.036075785756111145, 0.04018726944923401, 0.07571659237146378, 0.05192345380783081, 0.016229653730988503, 0.07567133754491806, 0.12606632709503174, -0.021879704669117928, -0.02238381654024124, 0.03712784871459007, -0.03906908631324768, -0.017911454662680626, -0.06716299057006836, 0.02539086528122425, -0.01357007771730423, -0.02256382815539837, 0.062304072082042694, -0.029246773570775986, 0.032680779695510864, 0.0439409501850605, -0.013252831995487213, 0.044555872678756714, -0.007078852504491806, -0.01966920867562294, -0.016877105459570885, 0.055201951414346695, -0.05942791327834129, -0.02367251366376877, 0.0025120822247117758, 0.026249395683407784, 0.07282546162605286, -0.04550698772072792, -0.003256533294916153, -0.05731024965643883, -0.05704369768500328, 0.028684215620160103, -0.02079755626618862, 0.07866337895393372, -0.003321070456877351, -0.010397598147392273, -0.16052590310573578, -0.03448276221752167, -0.029645267874002457, 0.001797024393454194, -0.09498057514429092, 0.012212046422064304, -0.00010231667693005875, 0.010508275590837002, 0.049065060913562775, 0.009929569438099861, 0.007360031828284264, 0.04566720128059387, 0.0574868842959404, -0.10929879546165466, -0.02872692048549652, 0.021594062447547913, 0.011709894053637981, 0.05669821426272392, 0.027372676879167557, 0.05638016387820244, 0.05603557452559471, 0.05069347098469734, -0.040348120033741, -0.020840374752879143, 0.08378256112337112, -0.028575344011187553, 0.027468157932162285, 0.09160599857568741, 0.07241301238536835, -0.00609583267942071, -0.029445026069879532, 0.09089721739292145, 0.02888648211956024, 0.04215754196047783, -0.020651640370488167, 0.05674295872449875, 0.05075869336724281, 0.007477354258298874, 0.028122011572122574, 0.0033914782106876373, 0.014391162432730198, -0.07006222009658813, -0.03889432176947594, 0.028546985238790512, 0.04129399359226227, -0.11045479029417038, -0.0270743016153574, -0.06919346749782562, 6.610542357378864e-33, -0.05428115651011467, -0.04385452717542648, -0.08168355375528336, -0.03188345953822136, -0.0019281540298834443, 0.07824477553367615, -0.043822187930345535, -0.06829801201820374, -0.06295265257358551, 0.025381533429026604, -0.10581708699464798, -0.04818129166960716, -0.05159691721200943, -0.005683912895619869, -0.027904776856303215, -0.11291356384754181, -0.028912371024489403, 0.08113524317741394, -0.016754809767007828, 0.03082641400396824, 0.10414765030145645, 0.04322825372219086, -0.06343995779752731, -0.05709422007203102, 0.004414378199726343, -0.01968863606452942, 0.044691696763038635, -0.006446411833167076, -0.031152896583080292, 0.02366267330944538, 0.01520799845457077, -0.0019845692440867424, -0.05936308577656746, -0.03507465496659279, -0.018097741529345512, 0.011889954097568989, -0.03604267165064812, -0.010271633975207806, -0.002268559765070677, -0.04218846559524536, -0.023451216518878937, 0.04300130531191826, -0.014883961528539658, -0.04685986414551735, -0.0857795774936676, -0.06212183088064194, -0.00012057348067173734, 0.07638035714626312, 0.034919291734695435, -0.0015547614311799407, 0.010598590597510338, 0.007691801525652409, 0.03432059660553932, -0.04664728045463562, 0.01896282471716404, -0.041994478553533554, 0.04030648246407509, 0.04448829963803291, 0.045606061816215515, 0.06025319918990135, -0.005385338328778744, 0.06490805745124817, -0.08435218781232834, -0.02440560981631279, -0.015097747556865215, 0.0926719382405281, -0.03133699670433998, 0.004714925307780504, 0.0417306125164032, 0.03358490765094757, -0.09931764751672745, 0.025860635563731194, 0.04094685986638069, 0.014315430074930191, 0.06896030902862549, -0.02343306690454483, 0.00670555280521512, 0.005906345788389444, -0.04087457433342934, -0.057099681347608566, -0.09159965813159943, 0.10763148218393326, -0.05793825536966324, -0.05839317664504051, -0.09235111624002457, -0.04755580425262451, -0.06134414300322533, -0.0779540091753006, -0.07834059745073318, -0.012682628817856312, -0.042681772261857986, -0.03795372322201729, 0.024086182937026024, 0.06624138355255127, -0.058759428560733795, -5.812193614074399e-33, -0.0006336141377687454, 0.09476730227470398, 0.06313614547252655, 0.03712635114789009, -0.08816194534301758, 0.06251663714647293, 0.08678041398525238, -0.10169986635446548, -0.03294222056865692, -0.06106393784284592, 0.01911108009517193, -0.005428362637758255, -0.047673676162958145, 0.058756377547979355, 0.08359545469284058, -0.068476103246212, 0.024549586698412895, 0.001958245411515236, -0.0021757178474217653, -0.01942913793027401, 0.07041788846254349, 0.0787266343832016, -0.04112391546368599, 0.04128480330109596, -0.039734579622745514, 0.07225005328655243, 0.010304149240255356, 0.03214414417743683, 0.0432378314435482, -0.011513302102684975, -0.042943257838487625, 0.03628598153591156, -0.05875847861170769, 0.027051454409956932, -0.0645623430609703, 0.008246118202805519, 0.028991229832172394, 0.03825343772768974, -0.019862253218889236, -0.0299240592867136, 0.06517104804515839, 0.11142192035913467, -0.05862649530172348, 0.04088478535413742, -0.03326711058616638, 0.06319914758205414, 0.10838403552770615, -0.021907048299908638, -0.017598412930965424, 0.0023060550447553396, -0.052291981875896454, -0.029163183644413948, -0.012698525562882423, 0.049537912011146545, 0.029915375635027885, -0.01394844613969326, -0.05243983492255211, -0.02964773401618004, 0.010564773343503475, -0.07091917097568512, -0.028410654515028, -0.027913810685276985, 0.06187596172094345, -0.03427748382091522, 0.06243441253900528, 0.019570795819163322, -0.07716546952724457, 0.048108622431755066, 0.04324829950928688, 0.07096190005540848, -0.0342438630759716, 0.07321233302354813, 0.03043348900973797, -0.023628288879990578, -0.015808384865522385, -0.0045012375339865685, 0.014050268568098545, -0.05200888216495514, 0.0004275004321243614, 0.02893931046128273, -0.0639767050743103, 0.02916891500353813, 0.08773856610059738, 0.10625812411308289, 0.007161028683185577, 0.08034414052963257, -0.013567257672548294, 0.08357265591621399, 0.07568620145320892, -0.03562014922499657, 0.033612240105867386, 0.06036454066634178, 0.13200296461582184, 0.10185530036687851, 0.002290080999955535, -4.6381725127275786e-08, -0.01838086172938347, -0.067306749522686, -0.017342304810881615, 0.04744695872068405, -0.04001525789499283, -0.00928990077227354, -0.06237049028277397, -0.006833705119788647, -0.02809581346809864, -0.11158079653978348, 0.014699313789606094, -0.0023095852229744196, -0.06702059507369995, -0.052533891052007675, 0.001518573728390038, 0.01142339687794447, -0.0736149400472641, -0.041831325739622116, 0.02069869637489319, -0.06447727978229523, -0.032885946333408356, -0.013850904069840908, 0.01881742849946022, 0.058386147022247314, -0.03639649599790573, -0.04416990652680397, -0.02416745014488697, 0.027005059644579887, 0.060605041682720184, -0.008512470871210098, 0.01258044596761465, 0.007831251248717308, 0.04547032341361046, 0.033390991389751434, 0.02993515133857727, -0.007391129154711962, -0.03196483105421066, 0.09184326231479645, 0.04096918925642967, 0.03417450934648514, -0.09129607677459717, 0.06674473732709885, 0.01940648816525936, 0.03215456381440163, 0.04324163869023323, -0.02257983386516571, -0.03298570215702057, -0.028579367324709892, 0.011581304483115673, -0.09505421668291092, 0.022386649623513222, 0.030815403908491135, -0.003837269265204668, 0.13272787630558014, 0.027884840965270996, -0.004452181980013847, -0.1152031198143959, -0.03955044969916344, 0.005544339306652546, 0.005325281526893377, -0.017308590933680534, -0.07200317084789276, -0.04659741371870041, -0.06302310526371002 ] }, { "text": "(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3a): BasicConv2d(\n(conv): Conv2d(384, 384, kernel_size=(1, 3), stride=(1, 1), padding=(0, 1), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3b): BasicConv2d(\n(conv): Conv2d(384, 384, kernel_size=(3, 1), stride=(1, 1), padding=(1, 0), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(1280, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_7c): InceptionE(\n(branch1x1): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_44", "embedding": [ -0.03236101195216179, -0.06736545264720917, -0.08274836838245392, -0.03939452022314072, 0.02427869476377964, -0.0718884989619255, -0.033014554530382156, 0.025547081604599953, -0.049708232283592224, -0.05486905947327614, 0.025560613721609116, -0.06620677560567856, 0.010003961622714996, -0.05065186694264412, 0.014086965471506119, 0.0886252149939537, -0.0201589222997427, 0.0499502569437027, -0.08862480521202087, 0.01313396543264389, 0.007688823156058788, 0.06217119097709656, 0.028456877917051315, 0.032351523637771606, 0.011243581771850586, 0.013051263056695461, 0.02602474018931389, 0.0275765098631382, 0.0009026160696521401, -0.10518708825111389, 0.06292904913425446, 0.04004110023379326, -0.030056538060307503, -0.0044956691563129425, 0.09024111181497574, -0.0028450030367821455, -0.023839222267270088, -0.009645531885325909, -0.0680568739771843, 0.04453577101230621, 0.032769542187452316, 0.06846428662538528, 0.051908016204833984, 0.025402335450053215, 0.07947386801242828, 0.13600800931453705, -0.022324856370687485, -0.026832247152924538, 0.0366281196475029, -0.02550056204199791, -0.012666355818510056, -0.06651315838098526, 0.022761819884181023, -0.022911863401532173, -0.023332195356488228, 0.057663604617118835, -0.02992122806608677, 0.020343724638223648, 0.039052870124578476, -0.01502652931958437, 0.049525365233421326, -0.02104162983596325, -0.012798286974430084, -0.026526130735874176, 0.049292515963315964, -0.06787208467721939, -0.020791305229067802, 0.018867887556552887, 0.04010307788848877, 0.0684502050280571, -0.027135521173477173, 0.003399187931790948, -0.05956026166677475, -0.06280148029327393, 0.025390801951289177, -0.01885339990258217, 0.08739054203033447, -0.0060767484828829765, -0.012197792530059814, -0.14953294396400452, -0.032498717308044434, -0.019198982045054436, 0.0052865720354020596, -0.10013605654239655, 0.015058092772960663, -0.004086705390363932, 0.015738656744360924, 0.036518167704343796, 0.011672945693135262, 0.020793676376342773, 0.039237648248672485, 0.07016704231500626, -0.11040975153446198, -0.03649086132645607, 0.022711845114827156, 0.009391695261001587, 0.04739025607705116, 0.022505607455968857, 0.04631035029888153, 0.05328553169965744, 0.05062432214617729, -0.03363440930843353, -0.01805136725306511, 0.08470331877470016, -0.022993341088294983, 0.020956477150321007, 0.09952302277088165, 0.07652641832828522, 0.005667067598551512, -0.03257026523351669, 0.08474943786859512, 0.03359632566571236, 0.0476309172809124, -0.02102668024599552, 0.05497744679450989, 0.05996442213654518, 0.005433883983641863, 0.019486209377646446, -0.005261469166725874, 0.02536775916814804, -0.07032885402441025, -0.03174050897359848, 0.024380095303058624, 0.03858499974012375, -0.10766661912202835, -0.023297766223549843, -0.06037108600139618, 6.374279747807092e-33, -0.05092062056064606, -0.04857703298330307, -0.08073408156633377, -0.03486734256148338, -0.005619523581117392, 0.06981206685304642, -0.038998473435640335, -0.07410341501235962, -0.06422130018472672, 0.011732407845556736, -0.10889644175767899, -0.059614043682813644, -0.050151608884334564, -0.003658544970676303, -0.03452841937541962, -0.10923852771520615, -0.02896893583238125, 0.07075010240077972, -0.00981451477855444, 0.03132512420415878, 0.10544298589229584, 0.04663179814815521, -0.06555365025997162, -0.06241533160209656, 0.004331184551119804, -0.025589384138584137, 0.03702331334352493, -0.0031428574584424496, -0.029598508030176163, 0.03446334972977638, 0.014947802759706974, -0.003290729131549597, -0.060609083622694016, -0.04541511833667755, -0.02490982785820961, 0.013278977014124393, -0.039019908756017685, -0.008314787410199642, 0.001357636065222323, -0.05014291778206825, -0.0328604020178318, 0.04011544585227966, -0.020897310227155685, -0.041227612644433975, -0.09387154132127762, -0.06521628051996231, 0.008546019904315472, 0.08742549270391464, 0.03429080918431282, 0.006282563786953688, 0.008338697254657745, -0.003925764001905918, 0.037420567125082016, -0.055775754153728485, 0.015840798616409302, -0.040216151624917984, 0.0363946296274662, 0.04410776123404503, 0.034645017236471176, 0.05439726263284683, 0.020008401945233345, 0.06005887687206268, -0.08958172053098679, -0.021822648122906685, -0.013066308572888374, 0.08609391003847122, -0.0305173359811306, 0.006908891256898642, 0.045318782329559326, 0.019397441297769547, -0.09948154538869858, 0.025946157053112984, 0.016585305333137512, 0.013622217811644077, 0.07038260251283646, -0.03337762504816055, 0.018290497362613678, 0.01236861664801836, -0.04167291149497032, -0.060352299362421036, -0.07885158807039261, 0.10797891765832901, -0.06018310785293579, -0.05688370764255524, -0.09713510423898697, -0.041167061775922775, -0.04413873329758644, -0.08048407733440399, -0.07685641199350357, -0.026104815304279327, -0.03249093517661095, -0.052349239587783813, 0.028878724202513695, 0.07201364636421204, -0.0498180165886879, -5.9415927668968855e-33, 0.0169074609875679, 0.09036459028720856, 0.057444121688604355, 0.03452019765973091, -0.08595028519630432, 0.06328581273555756, 0.09080662578344345, -0.10198796540498734, -0.04205630347132683, -0.06779519468545914, 0.00632883794605732, -0.0041559855453670025, -0.05223815143108368, 0.0632023736834526, 0.08411526679992676, -0.07209885865449905, 0.023919709026813507, -0.0004712838854175061, -0.0057187629863619804, -0.016369840130209923, 0.06429366767406464, 0.06253869086503983, -0.035804055631160736, 0.03481552004814148, -0.04177030175924301, 0.06720603257417679, -0.0034137475304305553, 0.010257281363010406, 0.05186162889003754, -0.012508576735854149, -0.05214591324329376, 0.04254861921072006, -0.05985993891954422, 0.021498288959264755, -0.07002214342355728, 0.007307690102607012, 0.029538845643401146, 0.0372326523065567, -0.01636817678809166, -0.017641156911849976, 0.0626634880900383, 0.1111108586192131, -0.05697568878531456, 0.03591679781675339, -0.02715052105486393, 0.06662329286336899, 0.10682058334350586, -0.018624993041157722, -0.01613404043018818, 0.010470177978277206, -0.05128418654203415, -0.027239155024290085, -0.006918920669704676, 0.04455950856208801, 0.034521982073783875, -0.008558864705264568, -0.052789125591516495, -0.03484596312046051, 0.008868689648807049, -0.07364240288734436, -0.03234482556581497, -0.02199850045144558, 0.05083407461643219, -0.03896002098917961, 0.051518917083740234, 0.027503805235028267, -0.07702803611755371, 0.05675924941897392, 0.04614584520459175, 0.06776528805494308, -0.041971635073423386, 0.07471723854541779, 0.023161454126238823, -0.018815042451024055, -0.023272402584552765, -0.009021167643368244, 0.02051594853401184, -0.049444880336523056, 0.0014223746256902814, 0.030958589166402817, -0.06485190242528915, 0.03744450956583023, 0.09275450557470322, 0.10193909704685211, 0.005473506171256304, 0.0817786157131195, 0.0026017692871391773, 0.08289274573326111, 0.0647377222776413, -0.03403949365019798, 0.029234860092401505, 0.05023299157619476, 0.1345602124929428, 0.11468914151191711, -0.006099903490394354, -4.852515189668338e-08, -0.019472816959023476, -0.05885392427444458, -0.011663137935101986, 0.056954529136419296, -0.03646111860871315, -0.000617700454313308, -0.06956227868795395, -0.01097591407597065, -0.017627624794840813, -0.09886476397514343, 0.007725556846708059, -0.0007833318086341023, -0.0641220211982727, -0.048536039888858795, -0.009890674613416195, 0.014669285155832767, -0.07207725197076797, -0.046144966036081314, 0.027072571218013763, -0.06073963642120361, -0.04304854944348335, -0.022561123594641685, 0.010129643604159355, 0.06520889699459076, -0.03636455908417702, -0.04234672710299492, -0.02347773313522339, 0.03020956739783287, 0.061965424567461014, -0.02049771323800087, 0.02441074140369892, 0.010538698174059391, 0.048206400126218796, 0.030901920050382614, 0.01989884302020073, 0.00011206707131350413, -0.035955868661403656, 0.0812184289097786, 0.042875442653894424, 0.04684361815452576, -0.09418460726737976, 0.07549314945936203, 0.03174751251935959, 0.024475570768117905, 0.04374049976468086, -0.018128283321857452, -0.03352029249072075, -0.035878539085388184, 0.004937572870403528, -0.09011796116828918, 0.019278427585959435, 0.02564779296517372, -0.007314533926546574, 0.15064020454883575, 0.03738761320710182, 0.010489852167665958, -0.11233817040920258, -0.04692928493022919, -0.003796381875872612, 0.0006690809968858957, -0.022278092801570892, -0.06386782228946686, -0.06165493279695511, -0.06625067442655563 ] }, { "text": "(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(Mixed_7c): InceptionE(\n(branch1x1): BasicConv2d(\n(conv): Conv2d(2048, 320, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(320, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_1): BasicConv2d(\n(conv): Conv2d(2048, 384, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_2a): BasicConv2d(\n(conv): Conv2d(384, 384, kernel_size=(1, 3), stride=(1, 1), padding=(0, 1), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_2b): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_45", "embedding": [ -0.040772419422864914, -0.08590508252382278, -0.045883066952228546, -0.021170809864997864, 0.028530457988381386, -0.07921354472637177, -0.04534146562218666, 0.021345101296901703, -0.047830939292907715, -0.0688708946108818, 0.00015826414164621383, -0.07645527273416519, 0.00485453475266695, -0.058830078691244125, 0.0041626677848398685, 0.08309657126665115, -0.017380477860569954, 0.0824446752667427, -0.0696914866566658, -0.004987349733710289, -0.00014675933925900608, 0.06347625702619553, 0.0202117171138525, 0.026436394080519676, 0.020749831572175026, 0.035779546946287155, 0.015907732769846916, 0.03749515861272812, 0.021461108699440956, -0.12272463738918304, 0.07504279911518097, 0.057085633277893066, -0.04977872595191002, 0.011262490414083004, 0.04499262943863869, 0.01736513525247574, -0.02328299731016159, 0.009534054435789585, -0.06644059717655182, 0.016327515244483948, 0.04511921852827072, 0.07031125575304031, 0.05769195035099983, -0.019199436530470848, 0.0690956562757492, 0.10377322882413864, -0.03403281047940254, -0.008614743128418922, 0.04016256332397461, -0.05235016345977783, -0.022347865626215935, -0.07345348596572876, 0.010062379762530327, -0.017704837024211884, -0.006393325049430132, 0.06146744638681412, -0.02032576873898506, -0.005346223711967468, 0.04114998131990433, 0.00863860547542572, 0.027118369936943054, -0.024154333397746086, -0.0222920011729002, -0.021311109885573387, 0.06552159786224365, -0.07640594989061356, -0.01061620656400919, 0.018303925171494484, 0.05554337799549103, 0.07004592567682266, -0.014228835701942444, 0.009110809303820133, -0.05183561146259308, -0.04087928310036659, 0.013796539977192879, 0.0026549631729722023, 0.06758099794387817, 0.004817530512809753, -0.02937318943440914, -0.1504809409379959, -0.024059265851974487, -0.028343306854367256, 0.005113854538649321, -0.11323986947536469, 0.02099074050784111, 0.0008297698223032057, 0.0034943637438118458, 0.039845217019319534, 0.004385297652333975, 0.017387475818395615, 0.030147597193717957, 0.08610648661851883, -0.08694128692150116, -0.04399125650525093, 0.04572436213493347, 0.016012664884328842, 0.03539634123444557, 0.017375245690345764, 0.0551782101392746, 0.059766389429569244, 0.0419032946228981, -0.027843672782182693, -0.0321660153567791, 0.061026137322187424, -0.019361987709999084, 0.012143315747380257, 0.09749681502580643, 0.055544812232255936, 0.008996504358947277, -0.040559642016887665, 0.08600996434688568, 0.025781175121665, 0.06554283201694489, 0.0041345879435539246, 0.05433332175016403, 0.04575215280056, 0.013825037516653538, 0.01341758668422699, -0.0032983238343149424, 0.04088041931390762, -0.09177452325820923, -0.03336336836218834, 0.03676337003707886, 0.04205165430903435, -0.11799240112304688, -0.0433344729244709, -0.06462268531322479, 6.1341534352409615e-33, -0.06155954673886299, -0.07205579429864883, -0.05326710641384125, -0.02712194062769413, 0.0126822330057621, 0.07874477654695511, -0.05806979537010193, -0.0819983184337616, -0.046717215329408646, 0.006709816865622997, -0.11072593927383423, -0.04355790466070175, -0.06655379384756088, 0.01213554386049509, -0.013901863247156143, -0.11544214934110641, -0.015963111072778702, 0.06862328201532364, -0.013103810139000416, 0.0011078922543674707, 0.08442598581314087, 0.02224240079522133, -0.07672102004289627, -0.049829576164484024, 0.0022388952784240246, -0.02245200425386429, 0.040594108402729034, -0.005753056146204472, -0.02685476467013359, 0.017818927764892578, -0.02408524788916111, 0.00551559217274189, -0.06756134331226349, -0.003053187159821391, -0.01062230858951807, 0.017807461321353912, -0.012689643539488316, -6.116295844549313e-05, 0.0058377571403980255, -0.03498964384198189, -0.02964981272816658, 0.04514914005994797, -0.009431061334908009, -0.051400478929281235, -0.09419767558574677, -0.08081278949975967, -0.017392989248037338, 0.10800591111183167, 0.03595760464668274, 0.0161910280585289, 0.021929530426859856, -0.012879224494099617, 0.03036772646009922, -0.07730723172426224, 0.012968631461262703, -0.01799980364739895, 0.04365752264857292, 0.04745660722255707, 0.062003616243600845, 0.08519737422466278, 0.005608875770121813, 0.054981838911771774, -0.0993388295173645, -0.014350464567542076, -0.02018498256802559, 0.09302708506584167, -0.05437159910798073, -0.009414617903530598, 0.04613231495022774, 0.04802422598004341, -0.08614475280046463, 0.030158253386616707, 0.03793748840689659, 0.011878005228936672, 0.08957468718290329, -0.03847339376807213, -0.0012910753721371293, 0.0022028195671737194, -0.050012461841106415, -0.0332195907831192, -0.0706113949418068, 0.12903721630573273, -0.06900232285261154, -0.04898393154144287, -0.08871351182460785, -0.024236470460891724, -0.056313276290893555, -0.07238218188285828, -0.09907939285039902, -0.0011188425123691559, -0.0379968024790287, -0.013403961434960365, 0.03609209880232811, 0.06621957570314407, -0.05514592304825783, -5.72715320994813e-33, -0.008869613520801067, 0.11273010075092316, 0.0735802873969078, 0.04399899020791054, -0.055901285260915756, 0.06347495317459106, 0.08141820132732391, -0.11166612803936005, -0.037222545593976974, -0.060600802302360535, 0.019809233024716377, -0.016514282673597336, -0.04204443469643593, 0.03800976648926735, 0.08531542867422104, -0.08724662661552429, 0.02194700948894024, 0.017081735655665398, 0.020311575382947922, -0.0013126059202477336, 0.05631379783153534, 0.07979586720466614, -0.05608082190155983, 0.01866808347404003, -0.036613695323467255, 0.059391867369413376, -0.016587330028414726, 0.05863068252801895, 0.04435222968459129, -0.017805950716137886, -0.0339951254427433, 0.0383293442428112, -0.08204539120197296, 0.03316977247595787, -0.04509545862674713, 0.025312108919024467, 0.03761868178844452, 0.028277894482016563, -0.018056122586131096, -0.03509383276104927, 0.05122761428356171, 0.1057853251695633, -0.07498595863580704, 0.02514217607676983, -0.022981971502304077, 0.05217721313238144, 0.10354095697402954, -0.020588994026184082, -0.020151881501078606, -0.028597185388207436, -0.040122441947460175, -0.01156679354608059, -0.03880124166607857, 0.04162018001079559, -0.005274930503219366, -0.012430302798748016, -0.03959737718105316, -0.03377917408943176, 0.040386099368333817, -0.07220201194286346, -0.0236252099275589, -0.04891231656074524, 0.033078450709581375, -0.040774114429950714, 0.0483468659222126, 0.023618703708052635, -0.07648468762636185, 0.058891769498586655, 0.023196063935756683, 0.06292727589607239, -0.037186916917562485, 0.06507935374975204, 0.042823128402233124, -0.004893998149782419, -0.023711243644356728, -0.03155997395515442, 0.018122835084795952, -0.04950053244829178, 0.011535266414284706, 0.013652081601321697, -0.07027685642242432, 0.03673156723380089, 0.06895965337753296, 0.0756845772266388, 0.020260322839021683, 0.08947116881608963, -0.011037804186344147, 0.07433666288852692, 0.08795333653688431, -0.0104060722514987, 0.042349185794591904, 0.06594066321849823, 0.11431838572025299, 0.0985858142375946, 0.0014169336063787341, -4.873903947100189e-08, -0.0035827693063765764, -0.07968482375144958, -0.003931823186576366, 0.05805554240942001, -0.008642802946269512, -0.02030380442738533, -0.07203420251607895, -0.004898888058960438, -0.00852990336716175, -0.12152274698019028, 0.012479840777814388, 0.007358301896601915, -0.05729367583990097, -0.037230007350444794, -0.01921091042459011, 0.013362938538193703, -0.08268573880195618, -0.019923647865653038, 0.024152198806405067, -0.04203628748655319, -0.024584880098700523, -0.008170654065907001, -0.0008391665760427713, 0.057424962520599365, -0.027145730331540108, -0.06907431781291962, -0.0009841041173785925, 0.042901553213596344, 0.06701328605413437, -0.016720514744520187, 0.005036524496972561, 0.0029873300809413195, 0.040114860981702805, 0.036226242780685425, 0.0176631398499012, 0.013711230829358101, -0.025801939889788628, 0.10862847417593002, 0.005464899353682995, 0.02295849472284317, -0.07704220712184906, 0.06920697540044785, 0.008345235139131546, 0.017688654363155365, 0.03758598119020462, -0.03631828352808952, -0.029173506423830986, -0.039625465869903564, 0.0400017574429512, -0.06992489099502563, 0.025883657857775688, 0.04733053222298622, 0.02341540716588497, 0.12761664390563965, 0.03820723667740822, -0.025660201907157898, -0.109281025826931, -0.0391959510743618, -0.010610759258270264, 0.0017240962479263544, -0.016538843512535095, -0.06583120673894882, -0.05160219967365265, -0.06232548505067825 ] }, { "text": "(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3_2b): BasicConv2d(\n(conv): Conv2d(384, 384, kernel_size=(3, 1), stride=(1, 1), padding=(1, 0), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_1): BasicConv2d(\n(conv): Conv2d(2048, 448, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(448, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_2): BasicConv2d(\n(conv): Conv2d(448, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3a): BasicConv2d(", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_46", "embedding": [ -0.0346931628882885, -0.06732448935508728, -0.08298683166503906, -0.044480349868535995, 0.02364017628133297, -0.08016432076692581, -0.04352131858468056, 0.0232766792178154, -0.04877522960305214, -0.05862892419099808, 0.033857859671115875, -0.05976541340351105, 0.012858092784881592, -0.058240167796611786, 0.013601155951619148, 0.08588505536317825, -0.02648661471903324, 0.04789681360125542, -0.07854803651571274, 0.009396493434906006, 0.017492612823843956, 0.05377471074461937, 0.02064581960439682, 0.023360034450888634, 0.02573632448911667, 0.02271377667784691, 0.031245550140738487, 0.04652594029903412, 0.003234364092350006, -0.10865110903978348, 0.07029013335704803, 0.039855312556028366, -0.041853826493024826, -0.005507714580744505, 0.07963075488805771, -0.0027080464642494917, -0.017246689647436142, -0.009568503126502037, -0.07524313777685165, 0.037489261478185654, 0.04007844254374504, 0.0743086040019989, 0.05067345127463341, 0.01575896330177784, 0.0757518783211708, 0.1260182410478592, -0.022625155746936798, -0.02293245494365692, 0.03645147755742073, -0.04007373005151749, -0.017314549535512924, -0.06886357814073563, 0.023743439465761185, -0.013679307885468006, -0.02107861451804638, 0.06133020669221878, -0.027318457141518593, 0.032614197582006454, 0.04623245820403099, -0.013953532092273235, 0.04484851658344269, -0.008008388802409172, -0.019873717799782753, -0.016914917156100273, 0.055828630924224854, -0.05809289216995239, -0.024190494790673256, 0.003293248824775219, 0.026143960654735565, 0.0734129548072815, -0.0465187169611454, -0.004675168078392744, -0.05594127997756004, -0.05771820247173309, 0.027450980618596077, -0.020388931035995483, 0.07920125871896744, -0.0030280251521617174, -0.010545233264565468, -0.16196738183498383, -0.03445421904325485, -0.029099971055984497, 0.00035097834188491106, -0.09434568881988525, 0.011852005496621132, 0.0013297712430357933, 0.010238610208034515, 0.04894854128360748, 0.010440954938530922, 0.007744538597762585, 0.04431355744600296, 0.05866483598947525, -0.10974534600973129, -0.028429927304387093, 0.020123805850744247, 0.01235943753272295, 0.05660906434059143, 0.025133520364761353, 0.05836945399641991, 0.05518658831715584, 0.05006371811032295, -0.04075194150209427, -0.02047763764858246, 0.08254189044237137, -0.027941901236772537, 0.02599521353840828, 0.09187722951173782, 0.07138674706220627, -0.005764256231486797, -0.0290871299803257, 0.08873850107192993, 0.028468362987041473, 0.04104007035493851, -0.020005082711577415, 0.054714228957891464, 0.05084273964166641, 0.007263348437845707, 0.02800510637462139, 0.0036836317740380764, 0.013316567055881023, -0.06702899187803268, -0.040272846817970276, 0.029896704480051994, 0.04170895367860794, -0.10846975445747375, -0.02763325162231922, -0.06987029314041138, 6.628268812189264e-33, -0.05602050945162773, -0.04344115033745766, -0.08265034109354019, -0.03151543438434601, -0.0011370523134246469, 0.07870421558618546, -0.04190057888627052, -0.0683012381196022, -0.06153266504406929, 0.025657860562205315, -0.10781950503587723, -0.04647161811590195, -0.051416389644145966, -0.006027114111930132, -0.02615058422088623, -0.11382249742746353, -0.02975187636911869, 0.0828411728143692, -0.018630441278219223, 0.0310879684984684, 0.10297518968582153, 0.042068641632795334, -0.06283333897590637, -0.057338498532772064, 0.006203881930559874, -0.02184629626572132, 0.045155350118875504, -0.007881752215325832, -0.031249597668647766, 0.023518893867731094, 0.015481765381991863, -0.00149040506221354, -0.06094488874077797, -0.03521694988012314, -0.01758899725973606, 0.011128324083983898, -0.03656754270195961, -0.011251832358539104, -0.003520132275298238, -0.041134778410196304, -0.024378882721066475, 0.04222642257809639, -0.015852950513362885, -0.04686971753835678, -0.08543311804533005, -0.062169890850782394, -0.0008299059700220823, 0.07741720974445343, 0.03506128489971161, -0.0017234672559425235, 0.011245010420680046, 0.008335613645613194, 0.03686835989356041, -0.048560284078121185, 0.017738353461027145, -0.04060928523540497, 0.03765285015106201, 0.04423496872186661, 0.045556746423244476, 0.06043194606900215, -0.006372771691530943, 0.06515035778284073, -0.08629141002893448, -0.025710705667734146, -0.015038035809993744, 0.09229201823472977, -0.030329419299960136, 0.006083656568080187, 0.04342004656791687, 0.033884692937135696, -0.09715861082077026, 0.025470927357673645, 0.04040119796991348, 0.014438409358263016, 0.06844004988670349, -0.02454785816371441, 0.0074996789917349815, 0.008360084146261215, -0.0417466014623642, -0.05727260559797287, -0.09230932593345642, 0.1067332774400711, -0.057184137403964996, -0.06034684181213379, -0.09136570245027542, -0.04801296815276146, -0.05960686132311821, -0.07730351388454437, -0.08071775734424591, -0.012894581072032452, -0.04426742345094681, -0.03883528709411621, 0.02524428442120552, 0.06761698424816132, -0.0579911544919014, -5.825789675609597e-33, 0.0009634934249334037, 0.09545917809009552, 0.0651700347661972, 0.03515041619539261, -0.08556457608938217, 0.062145888805389404, 0.08529918640851974, -0.10234211385250092, -0.03204500675201416, -0.05946645885705948, 0.016661252826452255, -0.0045555345714092255, -0.04584070295095444, 0.058489371091127396, 0.08314526081085205, -0.06791426986455917, 0.023318085819482803, 0.0014585560420528054, -0.004184521734714508, -0.018895627930760384, 0.07042233645915985, 0.07884228229522705, -0.04296330362558365, 0.04023529216647148, -0.04147585853934288, 0.07301304489374161, 0.009783467277884483, 0.03255021572113037, 0.04280107095837593, -0.012531951069831848, -0.04345612972974777, 0.03388286754488945, -0.05894627794623375, 0.02802547998726368, -0.06312704086303711, 0.008303374983370304, 0.029118848964571953, 0.03829526901245117, -0.01988261751830578, -0.028817670419812202, 0.06527496129274368, 0.11127342283725739, -0.060084644705057144, 0.04082168638706207, -0.032545361667871475, 0.06294818967580795, 0.10791314393281937, -0.019594477489590645, -0.017561741173267365, 0.0021887621842324734, -0.052154622972011566, -0.027319449931383133, -0.015396254137158394, 0.049228813499212265, 0.02982703410089016, -0.014558487571775913, -0.052010562270879745, -0.03073953092098236, 0.00938373152166605, -0.07180695235729218, -0.028710242360830307, -0.029126562178134918, 0.06264418363571167, -0.03179800137877464, 0.06295809149742126, 0.019382387399673462, -0.07543846219778061, 0.04508059471845627, 0.042419157922267914, 0.07324782013893127, -0.032951075583696365, 0.07453130185604095, 0.028593193739652634, -0.023183638229966164, -0.015898413956165314, -0.004091823939234018, 0.014067418873310089, -0.05248865857720375, -0.0013469173572957516, 0.029698176309466362, -0.06446263939142227, 0.029152220115065575, 0.08914904296398163, 0.1073632761836052, 0.00659739226102829, 0.08181663602590561, -0.013215226121246815, 0.0824611485004425, 0.07697693258523941, -0.0365983285009861, 0.0345974899828434, 0.06020168960094452, 0.13208428025245667, 0.10279981791973114, 0.0019680489785969257, -4.633059447201049e-08, -0.01754632405936718, -0.06769679486751556, -0.016235647723078728, 0.04815009608864784, -0.04056858271360397, -0.010494726710021496, -0.06160809099674225, -0.006893324665725231, -0.0277516171336174, -0.11193147301673889, 0.015180431306362152, -0.0011791009455919266, -0.06602513045072556, -0.0517599917948246, 0.0012443764135241508, 0.010293166153132915, -0.0729282796382904, -0.04178314656019211, 0.02018442191183567, -0.06365672498941422, -0.033292751759290695, -0.013714541681110859, 0.018254688009619713, 0.06045506149530411, -0.03445703163743019, -0.04510368034243584, -0.024258052930235863, 0.026665473356842995, 0.06239376962184906, -0.007972373627126217, 0.014900351874530315, 0.008337135426700115, 0.04664080590009689, 0.03289464861154556, 0.029759544879198074, -0.007309985812753439, -0.031085282564163208, 0.09310031682252884, 0.039416976273059845, 0.035535503178834915, -0.09052995592355728, 0.06614307314157486, 0.019251596182584763, 0.03202719986438751, 0.046159494668245316, -0.022664492949843407, -0.034771546721458435, -0.030566060915589333, 0.011733160354197025, -0.0962057039141655, 0.022226540371775627, 0.028942015022039413, -0.0048062060959637165, 0.13330861926078796, 0.0284917913377285, -0.0041365367360413074, -0.1154390349984169, -0.0402306392788887, 0.006762439385056496, 0.003924030344933271, -0.016701705753803253, -0.07045450061559677, -0.0439874567091465, -0.06266368925571442 ] }, { "text": "(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3a): BasicConv2d(\n(conv): Conv2d(384, 384, kernel_size=(1, 3), stride=(1, 1), padding=(0, 1), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch3x3dbl_3b): BasicConv2d(\n(conv): Conv2d(384, 384, kernel_size=(3, 1), stride=(1, 1), padding=(1, 0), bias=False)\n(bn): BatchNorm2d(384, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n(branch_pool): BasicConv2d(\n(conv): Conv2d(2048, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)\n(bn): BatchNorm2d(192, eps=0.001, momentum=0.1, affine=True, track_running_stats=True)\n)\n)\n(avgpool): AdaptiveAvgPool2d(output_size=(1, 1))\n(dropout): Dropout(p=0.5, inplace=False)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_47", "embedding": [ -0.03236101195216179, -0.06736545264720917, -0.08274836838245392, -0.03939452022314072, 0.02427869476377964, -0.0718884989619255, -0.033014554530382156, 0.025547081604599953, -0.049708232283592224, -0.05486905947327614, 0.025560613721609116, -0.06620677560567856, 0.010003961622714996, -0.05065186694264412, 0.014086965471506119, 0.0886252149939537, -0.0201589222997427, 0.0499502569437027, -0.08862480521202087, 0.01313396543264389, 0.007688823156058788, 0.06217119097709656, 0.028456877917051315, 0.032351523637771606, 0.011243581771850586, 0.013051263056695461, 0.02602474018931389, 0.0275765098631382, 0.0009026160696521401, -0.10518708825111389, 0.06292904913425446, 0.04004110023379326, -0.030056538060307503, -0.0044956691563129425, 0.09024111181497574, -0.0028450030367821455, -0.023839222267270088, -0.009645531885325909, -0.0680568739771843, 0.04453577101230621, 0.032769542187452316, 0.06846428662538528, 0.051908016204833984, 0.025402335450053215, 0.07947386801242828, 0.13600800931453705, -0.022324856370687485, -0.026832247152924538, 0.0366281196475029, -0.02550056204199791, -0.012666355818510056, -0.06651315838098526, 0.022761819884181023, -0.022911863401532173, -0.023332195356488228, 0.057663604617118835, -0.02992122806608677, 0.020343724638223648, 0.039052870124578476, -0.01502652931958437, 0.049525365233421326, -0.02104162983596325, -0.012798286974430084, -0.026526130735874176, 0.049292515963315964, -0.06787208467721939, -0.020791305229067802, 0.018867887556552887, 0.04010307788848877, 0.0684502050280571, -0.027135521173477173, 0.003399187931790948, -0.05956026166677475, -0.06280148029327393, 0.025390801951289177, -0.01885339990258217, 0.08739054203033447, -0.0060767484828829765, -0.012197792530059814, -0.14953294396400452, -0.032498717308044434, -0.019198982045054436, 0.0052865720354020596, -0.10013605654239655, 0.015058092772960663, -0.004086705390363932, 0.015738656744360924, 0.036518167704343796, 0.011672945693135262, 0.020793676376342773, 0.039237648248672485, 0.07016704231500626, -0.11040975153446198, -0.03649086132645607, 0.022711845114827156, 0.009391695261001587, 0.04739025607705116, 0.022505607455968857, 0.04631035029888153, 0.05328553169965744, 0.05062432214617729, -0.03363440930843353, -0.01805136725306511, 0.08470331877470016, -0.022993341088294983, 0.020956477150321007, 0.09952302277088165, 0.07652641832828522, 0.005667067598551512, -0.03257026523351669, 0.08474943786859512, 0.03359632566571236, 0.0476309172809124, -0.02102668024599552, 0.05497744679450989, 0.05996442213654518, 0.005433883983641863, 0.019486209377646446, -0.005261469166725874, 0.02536775916814804, -0.07032885402441025, -0.03174050897359848, 0.024380095303058624, 0.03858499974012375, -0.10766661912202835, -0.023297766223549843, -0.06037108600139618, 6.374279747807092e-33, -0.05092062056064606, -0.04857703298330307, -0.08073408156633377, -0.03486734256148338, -0.005619523581117392, 0.06981206685304642, -0.038998473435640335, -0.07410341501235962, -0.06422130018472672, 0.011732407845556736, -0.10889644175767899, -0.059614043682813644, -0.050151608884334564, -0.003658544970676303, -0.03452841937541962, -0.10923852771520615, -0.02896893583238125, 0.07075010240077972, -0.00981451477855444, 0.03132512420415878, 0.10544298589229584, 0.04663179814815521, -0.06555365025997162, -0.06241533160209656, 0.004331184551119804, -0.025589384138584137, 0.03702331334352493, -0.0031428574584424496, -0.029598508030176163, 0.03446334972977638, 0.014947802759706974, -0.003290729131549597, -0.060609083622694016, -0.04541511833667755, -0.02490982785820961, 0.013278977014124393, -0.039019908756017685, -0.008314787410199642, 0.001357636065222323, -0.05014291778206825, -0.0328604020178318, 0.04011544585227966, -0.020897310227155685, -0.041227612644433975, -0.09387154132127762, -0.06521628051996231, 0.008546019904315472, 0.08742549270391464, 0.03429080918431282, 0.006282563786953688, 0.008338697254657745, -0.003925764001905918, 0.037420567125082016, -0.055775754153728485, 0.015840798616409302, -0.040216151624917984, 0.0363946296274662, 0.04410776123404503, 0.034645017236471176, 0.05439726263284683, 0.020008401945233345, 0.06005887687206268, -0.08958172053098679, -0.021822648122906685, -0.013066308572888374, 0.08609391003847122, -0.0305173359811306, 0.006908891256898642, 0.045318782329559326, 0.019397441297769547, -0.09948154538869858, 0.025946157053112984, 0.016585305333137512, 0.013622217811644077, 0.07038260251283646, -0.03337762504816055, 0.018290497362613678, 0.01236861664801836, -0.04167291149497032, -0.060352299362421036, -0.07885158807039261, 0.10797891765832901, -0.06018310785293579, -0.05688370764255524, -0.09713510423898697, -0.041167061775922775, -0.04413873329758644, -0.08048407733440399, -0.07685641199350357, -0.026104815304279327, -0.03249093517661095, -0.052349239587783813, 0.028878724202513695, 0.07201364636421204, -0.0498180165886879, -5.9415927668968855e-33, 0.0169074609875679, 0.09036459028720856, 0.057444121688604355, 0.03452019765973091, -0.08595028519630432, 0.06328581273555756, 0.09080662578344345, -0.10198796540498734, -0.04205630347132683, -0.06779519468545914, 0.00632883794605732, -0.0041559855453670025, -0.05223815143108368, 0.0632023736834526, 0.08411526679992676, -0.07209885865449905, 0.023919709026813507, -0.0004712838854175061, -0.0057187629863619804, -0.016369840130209923, 0.06429366767406464, 0.06253869086503983, -0.035804055631160736, 0.03481552004814148, -0.04177030175924301, 0.06720603257417679, -0.0034137475304305553, 0.010257281363010406, 0.05186162889003754, -0.012508576735854149, -0.05214591324329376, 0.04254861921072006, -0.05985993891954422, 0.021498288959264755, -0.07002214342355728, 0.007307690102607012, 0.029538845643401146, 0.0372326523065567, -0.01636817678809166, -0.017641156911849976, 0.0626634880900383, 0.1111108586192131, -0.05697568878531456, 0.03591679781675339, -0.02715052105486393, 0.06662329286336899, 0.10682058334350586, -0.018624993041157722, -0.01613404043018818, 0.010470177978277206, -0.05128418654203415, -0.027239155024290085, -0.006918920669704676, 0.04455950856208801, 0.034521982073783875, -0.008558864705264568, -0.052789125591516495, -0.03484596312046051, 0.008868689648807049, -0.07364240288734436, -0.03234482556581497, -0.02199850045144558, 0.05083407461643219, -0.03896002098917961, 0.051518917083740234, 0.027503805235028267, -0.07702803611755371, 0.05675924941897392, 0.04614584520459175, 0.06776528805494308, -0.041971635073423386, 0.07471723854541779, 0.023161454126238823, -0.018815042451024055, -0.023272402584552765, -0.009021167643368244, 0.02051594853401184, -0.049444880336523056, 0.0014223746256902814, 0.030958589166402817, -0.06485190242528915, 0.03744450956583023, 0.09275450557470322, 0.10193909704685211, 0.005473506171256304, 0.0817786157131195, 0.0026017692871391773, 0.08289274573326111, 0.0647377222776413, -0.03403949365019798, 0.029234860092401505, 0.05023299157619476, 0.1345602124929428, 0.11468914151191711, -0.006099903490394354, -4.852515189668338e-08, -0.019472816959023476, -0.05885392427444458, -0.011663137935101986, 0.056954529136419296, -0.03646111860871315, -0.000617700454313308, -0.06956227868795395, -0.01097591407597065, -0.017627624794840813, -0.09886476397514343, 0.007725556846708059, -0.0007833318086341023, -0.0641220211982727, -0.048536039888858795, -0.009890674613416195, 0.014669285155832767, -0.07207725197076797, -0.046144966036081314, 0.027072571218013763, -0.06073963642120361, -0.04304854944348335, -0.022561123594641685, 0.010129643604159355, 0.06520889699459076, -0.03636455908417702, -0.04234672710299492, -0.02347773313522339, 0.03020956739783287, 0.061965424567461014, -0.02049771323800087, 0.02441074140369892, 0.010538698174059391, 0.048206400126218796, 0.030901920050382614, 0.01989884302020073, 0.00011206707131350413, -0.035955868661403656, 0.0812184289097786, 0.042875442653894424, 0.04684361815452576, -0.09418460726737976, 0.07549314945936203, 0.03174751251935959, 0.024475570768117905, 0.04374049976468086, -0.018128283321857452, -0.03352029249072075, -0.035878539085388184, 0.004937572870403528, -0.09011796116828918, 0.019278427585959435, 0.02564779296517372, -0.007314533926546574, 0.15064020454883575, 0.03738761320710182, 0.010489852167665958, -0.11233817040920258, -0.04692928493022919, -0.003796381875872612, 0.0006690809968858957, -0.022278092801570892, -0.06386782228946686, -0.06165493279695511, -0.06625067442655563 ] }, { "text": ")\n)\n(avgpool): AdaptiveAvgPool2d(output_size=(1, 1))\n(dropout): Dropout(p=0.5, inplace=False)\n(fc): Linear(in_features=2048, out_features=1000, bias=True)\n)\n)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_48", "embedding": [ -0.014884580858051777, 0.028549082577228546, -0.05572544410824776, 0.03398427367210388, 0.015962721779942513, 0.010218622162938118, 0.01829247921705246, -0.06414689868688583, -0.10101615637540817, -0.0924234390258789, -0.04749864712357521, -0.02073565497994423, -0.034268785268068314, -0.07406821101903915, -0.0639113038778305, 0.01838301122188568, 0.019126633182168007, 0.057895977050065994, -0.06227722018957138, -0.11154290288686752, 0.03765686973929405, -0.025567343458533287, -0.0681895837187767, 0.01848250813782215, 0.04573088884353638, -0.07233432680368423, -0.016802970319986343, 0.024382347241044044, 0.02548888884484768, -0.059036366641521454, 0.04044611379504204, 0.09730087965726852, 0.03207624703645706, -0.06129513680934906, 0.011540932580828667, -0.04525800421833992, -0.09089964628219604, 0.04032023251056671, 0.0024726898409426212, 0.0075836204923689365, 0.05117369070649147, 0.029232431203126907, 0.020137973129749298, -0.07445751130580902, 0.00022746571630705148, 0.01925566978752613, -0.03861362114548683, 0.004233912564814091, 0.016818467527627945, -0.03413395211100578, 0.013193236663937569, 0.08639898151159286, -0.04214388132095337, 0.025705412030220032, -0.0019546214025467634, -0.025856630876660347, -0.04235270619392395, -0.022753451019525528, -0.0876753032207489, -0.04909469559788704, -0.005525647196918726, 0.0034789149649441242, 0.03083029016852379, 0.057578928768634796, -0.11141065508127213, -0.024413086473941803, 0.05467512086033821, 0.025290120393037796, 0.028928540647029877, 0.09666381776332855, -0.041603196412324905, 0.06336383521556854, -0.043547846376895905, 0.0002762417134363204, 0.04933804273605347, -0.02240728959441185, 0.10478586703538895, 0.004117661155760288, 0.09672201424837112, -0.0029816250316798687, 0.04588428512215614, -6.583168578799814e-05, 0.02667848952114582, -0.06128140911459923, -0.02036120556294918, -0.08128812164068222, 0.04425010085105896, -0.021267862990498543, -0.018616195768117905, 0.02993561327457428, 0.010041291825473309, 0.03367752209305763, -0.007139846216887236, -0.02133067697286606, -0.05447614565491676, 0.008248641155660152, 0.03183548152446747, -0.13288754224777222, 0.017878657206892967, 0.05493437126278877, -0.026017405092716217, -0.0492992103099823, 0.04497707262635231, 0.04697456583380699, -0.012557759881019592, -0.0004569042648654431, 0.05784083902835846, -0.03397728130221367, 0.022590016946196556, -0.026852935552597046, 0.0369209423661232, 0.010832667350769043, 0.07136033475399017, 0.016159983351826668, 0.08492493629455566, 0.05913320556282997, 0.05312810838222504, 0.017210204154253006, -0.032921213656663895, 0.04649650305509567, -0.1061568558216095, 0.008592629805207253, -0.02240472286939621, 0.045832227915525436, -0.07791760563850403, 0.0007759857107885182, -0.09033823013305664, 9.67355351758443e-34, -0.06184553727507591, -0.047487370669841766, -0.00987793505191803, -0.10596952587366104, 0.031045999377965927, 0.03313102945685387, 0.03287171199917793, -0.030695060268044472, 0.01060735434293747, 0.013876315206289291, -0.06675917655229568, -0.08100085705518723, -0.01279154047369957, 0.08093773573637009, 0.0532902367413044, -0.03103206865489483, -0.00641589192673564, 0.09359484910964966, 0.06459492444992065, 0.0003033411339856684, -0.01285954937338829, -0.0173904187977314, -0.052423376590013504, -0.03281678631901741, -0.004404799547046423, 0.0014335440937429667, -0.013791268691420555, -0.0007109979051165283, -0.06114625930786133, 0.03225001320242882, -0.03006921149790287, 0.008617266081273556, -0.03380804508924484, -0.06331194192171097, -0.03349427133798599, -0.10284759104251862, -0.053562648594379425, 0.0631580650806427, 0.030447861179709435, -0.016327092424035072, 0.01317649707198143, 0.06073010340332985, -0.007153353188186884, -0.0005601485027000308, -0.07068251073360443, -0.028813524171710014, 0.09777738898992538, 0.007256522309035063, 0.00261229882016778, 0.09054533392190933, 0.023928605020046234, -0.04900664836168289, 0.017717929556965828, 0.03185560181736946, 0.0046857912093400955, -0.01746368035674095, 0.004808456636965275, 0.08618766069412231, 0.07115918397903442, -0.017365964129567146, -0.005648341495543718, 0.013220075517892838, -0.017270592972636223, -0.08294139802455902, 0.040757566690444946, 0.0065232496708631516, 0.059827230870723724, -0.057708241045475006, -0.058417558670043945, 0.020875290036201477, -0.033476151525974274, -0.031114187091588974, -0.07358492165803909, 0.017169663682579994, -0.01778322644531727, -0.03763524442911148, 0.04336893931031227, -0.08578679710626602, 0.0012762394035235047, -0.008325846865773201, -0.041154682636260986, 0.1827583611011505, 0.05995754897594452, -0.16006140410900116, 0.045209262520074844, -0.05029839277267456, 0.06431759893894196, -0.02538394369184971, -0.019905831664800644, -0.06254418194293976, -0.09465068578720093, -0.030970469117164612, 0.0694974884390831, -0.036072682589292526, 0.03654645383358002, -2.8999730324823923e-33, 0.03247535973787308, 0.0748525857925415, 0.05032884702086449, 0.03366665542125702, -0.06572475284337997, 0.044210512191057205, 0.0905752182006836, 0.05475897714495659, 0.07414329051971436, 0.006367692723870277, -0.04307449981570244, -0.011828809976577759, 0.03851186856627464, -0.0009850101778283715, 0.014882393181324005, -0.03484894335269928, -0.07254074513912201, -0.024173712357878685, -0.06367796659469604, 0.03706139326095581, 0.005048204213380814, -0.03380653262138367, 0.014311612583696842, 0.09155699610710144, -0.01984034664928913, -0.02866879105567932, 0.019519582390785217, 0.060750339180231094, 0.04954405501484871, -0.08473678678274155, -0.03879354149103165, 0.011740787886083126, -0.1033245250582695, 0.01236687321215868, 0.022994836792349815, -0.0324103869497776, 0.05284588411450386, -0.032272543758153915, -0.05425107106566429, 0.10099869966506958, 0.024553392082452774, 0.05087855085730553, -0.041921213269233704, 0.06392908841371536, 0.002981544006615877, 0.015091599896550179, 0.01510530523955822, 0.005463678855448961, 0.0033849379979074, 0.0078055644407868385, -0.06966166943311691, 0.017389515414834023, -0.032010093331336975, 0.1650746613740921, -0.011325222440063953, -0.008293257094919682, 0.06127852946519852, 0.08809643983840942, -0.06429436057806015, 0.05428102985024452, -0.04200012609362602, -0.08928218483924866, -0.03594822809100151, -0.03362284600734711, 0.06277580559253693, 0.05352262780070305, -0.013228356838226318, 0.08426332473754883, -0.054921746253967285, 0.04093189164996147, 0.05983370542526245, 0.009774782694876194, -0.002692085225135088, 0.00976602267473936, 0.005222025793045759, 0.005157623905688524, -0.040333401411771774, -0.07571756839752197, 0.09439568221569061, -0.026966236531734467, -0.06447818130254745, 0.028443660587072372, 0.04348231106996536, 0.08643868565559387, 0.0016614050837233663, -0.021992400288581848, -0.02051655203104019, 0.030537238344550133, 0.06635045260190964, 0.04061069339513779, 0.015194231644272804, 0.04857148975133896, 0.08311297744512558, 0.027764305472373962, -0.02711489424109459, -4.1151373864067864e-08, 0.01683555357158184, -0.0577191598713398, 0.015815315768122673, 0.055876608937978745, -0.014027302153408527, -0.04953860491514206, -0.06808379292488098, -0.014217565767467022, -0.01272202655673027, -0.12962737679481506, 0.015378995798528194, 0.01542399637401104, -0.007458406034857035, 0.07351689785718918, 0.0937616229057312, 0.0008296099840663373, 0.01157737523317337, 0.05080399662256241, 0.025625990703701973, -0.011990535072982311, 0.0034788656048476696, 0.014606097713112831, -0.0643564835190773, -0.024676689878106117, 0.01184952910989523, -0.1140822023153305, 0.033474963158369064, 0.03286319971084595, 3.424329042900354e-05, -0.0641147717833519, 0.0017462143441662192, 0.011782321147620678, -0.0014191828668117523, -0.0009764634305611253, 0.10587437450885773, 0.06176554411649704, 0.02976606786251068, -0.012604412622749805, -0.017331821843981743, -0.013162054121494293, -0.07224485278129578, -0.005408911034464836, -0.05265005677938461, -0.11725173145532608, -0.04359057918190956, 0.019637754186987877, 0.01754407025873661, -0.08746658265590668, -0.0015234444290399551, -0.0227933619171381, 0.02917136438190937, 0.049242615699768066, -0.02242465503513813, 0.020050792023539543, 0.06384428590536118, -0.11941912770271301, -0.05338415503501892, -0.01048823818564415, -0.01179935410618782, -0.020920785143971443, -0.08662445098161697, -0.01873953640460968, 0.01711985282599926, -0.049837592989206314 ] }, { "text": "Mixed_5c is not a single layer—it's an Inception module, which is a mini-network with multiple parallel branches.\nHere's what's happening inside Mixed_5c:\n\nInput\n│\n┌──────────────┼──────────────┬──────────────┐\n│ │ │ │\n▼ ▼ ▼ ▼\nbranch1x1 branch5x5 branch3x3dbl branch_pool\n(1x1 conv) (1x1 → 5x5) (1x1 → 3x3 → 3x3) (pool → 1x1)\n│ │ │ │\n└──────────────┴──────────────┴──────────────┘\n│\nConcatenate\n│\nOutput\n\nThe key insight of the Inception architecture is: we don't know which filter size is best for detecting a feature, so let's use multiple sizes in parallel.", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_49", "embedding": [ 0.00858396664261818, -0.038305044174194336, 0.09051892161369324, -0.007216300815343857, 0.09815477579832077, -0.04470530524849892, 0.010374423116445541, -0.06316187977790833, -0.025570720434188843, -0.08062587678432465, -0.022380109876394272, -0.11343692988157272, -0.08136734366416931, 0.004063263535499573, -0.12429641932249069, 0.08306507766246796, -0.018430469557642937, 0.05574512854218483, -0.11145039647817612, -0.062082063406705856, -0.0185938011854887, 0.036833152174949646, -0.050709068775177, 0.016392705962061882, -0.020144855603575706, 0.03238610923290253, -0.06525439023971558, -0.003052279818803072, 0.05483054369688034, -0.0676564872264862, 0.07563228160142899, 0.1425764113664627, -0.05584171786904335, 0.03904957324266434, -0.043543606996536255, 0.002376918215304613, -0.060952894389629364, -0.061896659433841705, 0.032012540847063065, -0.01539013721048832, 0.049837272614240646, 0.05643566697835922, -0.005757241975516081, -0.018001794815063477, -0.06494860351085663, 0.06479006260633469, -0.06699547916650772, 0.027825510129332542, 0.03679713234305382, -0.05535060912370682, 0.015428315848112106, -0.03379208967089653, -0.07441336661577225, 0.05591195449233055, 0.016273489221930504, -0.057433828711509705, -0.05874588340520859, -0.03266541287302971, -0.01509130373597145, 0.018730031326413155, -0.05075403302907944, -0.059510450810194016, 0.014033563435077667, -0.02924175187945366, 0.044860657304525375, 0.014616554602980614, -0.10062949359416962, -0.03581284359097481, 0.06308276206254959, 0.0035607065074145794, 0.05344214662909508, 0.02137061022222042, -0.022905001416802406, -0.01251157931983471, 0.015721729025244713, -0.014331314712762833, 0.05542303994297981, 0.014366968534886837, 0.0028372055385261774, -0.03185659646987915, -0.06756050139665604, -0.03159463778138161, -0.014258510433137417, -0.039389148354530334, 0.069388248026371, 0.005834799259901047, -0.09645697474479675, -0.06487800925970078, -0.047194208949804306, -0.003786864224821329, -0.00799292977899313, 0.02923433668911457, -0.08044005185365677, -0.06194290891289711, 0.05524260178208351, -0.057597409933805466, -0.03832269459962845, 0.03402780741453171, -0.05942467600107193, 0.021572163328528404, 0.005762014072388411, -0.056778568774461746, 0.08941095322370529, 0.00335550750605762, 0.027684587985277176, 0.012214044108986855, 0.09240438044071198, 0.023926598951220512, 0.005468518007546663, -0.0697842463850975, -0.02595190703868866, 0.040361445397138596, 0.04301983118057251, -0.041860178112983704, 0.055903110653162, 0.07013415545225143, 0.03622537478804588, -0.04829392209649086, 0.012388788163661957, 0.06290894001722336, -0.10055780410766602, 0.02554824948310852, -0.04694860801100731, -0.026620661839842796, -0.04534380882978439, 0.04829376935958862, -0.012182035483419895, 6.648333766073831e-33, -0.06873606890439987, -0.010282316245138645, -0.026773998513817787, 0.04473702982068062, -0.006378054618835449, 0.09912116825580597, 0.048622142523527145, -0.023282421752810478, -0.02667282149195671, 0.03105492889881134, -0.08597292006015778, 0.0065429843962192535, -0.042342860251665115, 0.07324521988630295, 0.004940408747643232, -0.05963560566306114, -0.029930397868156433, -0.02776704728603363, -0.009328220970928669, 0.03802037239074707, 0.0034654387272894382, -0.00916376430541277, -0.05694304034113884, -0.037552691996097565, 0.010129626840353012, -0.045791614800691605, -0.026030806824564934, -0.011137017980217934, 0.054492417722940445, 0.04807437211275101, -0.12064480781555176, 0.0625016987323761, 0.02777349017560482, 0.0031687601003795862, 0.060110319405794144, 0.07007887959480286, 0.03420673683285713, 0.06255149096250534, -0.03604339435696602, -0.026433030143380165, 0.024559255689382553, -0.008328971453011036, -0.03141742944717407, -0.0805874690413475, -0.04904625564813614, 0.008962731808423996, -0.09073258191347122, 0.05531151965260506, -0.04295879602432251, 0.027847938239574432, 0.06850142031908035, 0.007796422578394413, 0.012605562806129456, -0.04517750442028046, 0.062436576932668686, 0.029767487198114395, 0.0025031419936567545, 0.08046102523803711, 0.03625739365816116, 0.09346743673086166, 0.047357913106679916, -0.007820258848369122, -0.08201389759778976, 0.0715252012014389, -0.0026895354967564344, 0.07353519648313522, 0.035126492381095886, 0.0556640662252903, 0.07538480311632156, -0.030771270394325256, -0.08155609667301178, 0.02508755587041378, 0.022466396912932396, 0.03963569551706314, 0.011031865142285824, -0.07401852309703827, -0.034786656498909, -0.044862180948257446, 0.00018820045806933194, 0.039303239434957504, -0.021263275295495987, 0.059819113463163376, 0.06845802813768387, -0.020068002864718437, -0.07221173495054245, 0.03861895948648453, 0.008249189704656601, 0.002831042977049947, -0.06385058909654617, 0.00633675092831254, 0.024941707029938698, -0.059391994029283524, 0.0999496728181839, -0.023622097447514534, 0.013267969712615013, -7.998604290396222e-33, 0.005388606805354357, -0.01731845922768116, -0.010515687055885792, 0.01022143941372633, -0.027927765622735023, -0.03998642787337303, 0.017554406076669693, -0.0328155942261219, -0.00555390166118741, 0.03546968102455139, 0.08867121487855911, 0.050821807235479355, -0.035662584006786346, -0.0192561112344265, 0.024718457832932472, 0.011950448155403137, -0.025691797956824303, -0.0031826323829591274, 0.13994142413139343, 0.04182371124625206, 0.06896114349365234, -0.004794141743332148, -0.01554606668651104, 0.02833794802427292, -0.07934819161891937, 0.03532140702009201, -0.044382382184267044, -0.040575604885816574, 0.14906048774719238, -0.05061257258057594, -0.08429663628339767, 0.03119528666138649, -0.02476363070309162, 0.06362400949001312, 0.046213746070861816, -0.0732097253203392, -0.05320003256201744, 0.00959817785769701, 0.026255711913108826, -0.032205138355493546, -0.009673421271145344, 0.03635242581367493, -0.08961138874292374, 0.03739706799387932, -0.030542762950062752, 0.02741357311606407, 0.022303888574242592, 0.02622058242559433, -0.03562714904546738, -0.024426395073533058, -0.048447560518980026, 0.013479559682309628, -0.05651646479964256, 0.07392428815364838, -0.027978666126728058, 0.04092774540185928, 0.09792905300855637, 0.0461738258600235, 0.0978505089879036, 0.025667620822787285, -0.04957146942615509, -0.06473609805107117, -0.045693233609199524, -0.09134332835674286, 0.04494451358914375, 0.04645628109574318, 0.0002238611486973241, 0.04257982596755028, -0.02701616659760475, -0.009883435443043709, -0.005135051906108856, 0.026272805407643318, 0.010101609863340855, -0.025454474613070488, -0.10895437002182007, -0.034497544169425964, -0.04397885128855705, 0.022433241829276085, 0.07319402694702148, 0.07830119132995605, -0.11708714067935944, 0.022281436249613762, -0.04683059826493263, 0.09032982587814331, 0.11776580661535263, -0.015534615144133568, 0.006869859993457794, 0.050005581229925156, 0.031080542132258415, 0.014760672114789486, -0.005258618853986263, 0.045829471200704575, -0.032504335045814514, 0.025459889322519302, -0.0037089057732373476, -5.0748294455615905e-08, 0.017105545848608017, -0.020243216305971146, -0.0806438997387886, -0.007838120684027672, 0.01823720708489418, -0.02424992434680462, -0.019056420773267746, 0.0574844591319561, -0.0022019115276634693, 0.04711715131998062, 0.022953996434807777, 0.022872865200042725, -0.05192958191037178, 0.021411588415503502, 0.03370799869298935, -0.024926194921135902, -0.09884218871593475, -0.0465865358710289, 0.03860335424542427, -0.008241312578320503, -0.003541807411238551, 0.016116993501782417, 0.016162285581231117, 0.03637363761663437, -0.05737096071243286, -0.10037021338939667, 0.02118859253823757, 0.10325127840042114, 0.0045011467300355434, -0.07637919485569, -0.0015613040886819363, 0.07319549471139908, -0.08519111573696136, 0.009770361706614494, -0.03141140937805176, 0.12239816784858704, -0.0009359521209262311, 0.03518710657954216, -0.009877256117761135, 0.03215629234910011, -0.049471959471702576, -0.030014842748641968, 0.039085958153009415, -0.10416801273822784, 0.0015966681530699134, -0.009208601899445057, 0.03234757110476494, -0.06188371777534485, 0.042192697525024414, 0.08701401203870773, -0.014332883059978485, 0.06670597195625305, 0.03854347765445709, 0.09215202182531357, 0.03599472716450691, -0.05470430105924606, -0.04158969596028328, -0.089478999376297, -0.04586506634950638, -0.015598861500620842, -0.05285651236772537, -0.04112379252910614, -0.05192523077130318, -0.017340021207928658 ] }, { "text": "branch1x1: Captures fine-grained, pixel-level features\nbranch5x5: Captures medium-sized patterns (done as 1x1 → 5x5 to reduce computation)\nbranch3x3dbl: Captures larger patterns via stacked 3x3 convolutions\nbranch_pool: Preserves spatial information through pooling\n\nAll four branches process the same input, then their outputs are concatenated along the channel dimension.\n\n4. Image Preprocessing¶\n\nWe need to:\n\n• Normalize the image for InceptionV3 (it expects specific mean/std)\n•\n\n• Be able to convert back for display\n•\n\nIn [5]:\n\n# ImageNet normalization values\nIMAGENET_MEAN = torch.tensor([0.485, 0.456, 0.406]).view(1, 3, 1, 1).to(device)\nIMAGENET_STD = torch.tensor([0.229, 0.224, 0.225]).view(1, 3, 1, 1).to(device)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_50", "embedding": [ 0.02260865829885006, -0.08943255990743637, 0.05379890650510788, -0.035832177847623825, 0.026542598381638527, -0.07214151322841644, -0.0013759054709225893, -0.02225995622575283, -0.06461157649755478, -0.0999140739440918, -0.059264324605464935, -0.04235874488949776, -0.046780575066804886, 0.06666194647550583, -0.052203547209501266, 0.03477098420262337, -0.048035021871328354, 0.09160658717155457, -0.10225959867238998, -0.0565752238035202, 0.10038589686155319, 0.030261697247624397, 0.03263795003294945, -0.011234673671424389, 0.042545877397060394, 0.005345946177840233, 0.011914975009858608, -0.058854445815086365, 0.06133672595024109, -0.025074485689401627, 0.03775535896420479, 0.07818321138620377, 0.008322910405695438, 0.02924930676817894, 0.01750423200428486, 0.008235245943069458, -0.05093130096793175, -0.025751756504178047, -0.020952338352799416, 0.039344076067209244, 0.04156934469938278, 0.02659253589808941, 0.012690611183643341, -0.04729480296373367, -0.02736106514930725, 0.07834354788064957, 0.04929813742637634, -0.011210314929485321, 0.0660586953163147, -0.09012006223201752, 0.029082372784614563, -0.03462974727153778, -0.038041431456804276, 0.0655735433101654, -0.006963251158595085, -0.0004920127103105187, 0.01729167252779007, -0.0783066526055336, -0.0004562130488920957, -0.046812936663627625, 0.023585578426718712, 0.013971168547868729, 0.005520165432244539, -0.034253042191267014, 0.030707580968737602, 0.0008843200048431754, -0.02546735107898712, -0.015171627514064312, 0.059871092438697815, -0.050361208617687225, 0.00019023365166503936, 0.029471414163708687, -0.03847488760948181, 0.015508591197431087, 0.029778702184557915, -0.0012897391570731997, 0.09838954359292984, 0.062353700399398804, 0.006445655599236488, -0.11849890649318695, 0.043704140931367874, 0.008509265258908272, 0.048275839537382126, 0.015201712027192116, 0.0620247907936573, 0.008893764577805996, -0.06809492409229279, 0.07012949138879776, -0.0013989557046443224, 0.014058724977076054, -0.129876971244812, 0.017574258148670197, -0.08449295908212662, -0.03700410574674606, 0.02390914224088192, -0.01455137599259615, 0.0012378935934975743, -0.10693203657865524, -0.044176917523145676, 0.08407818526029587, 0.024603016674518585, -0.08026725053787231, 0.05517278239130974, -0.010015876963734627, 0.0322963111102581, 0.0642680674791336, 0.05571436882019043, 0.08659934997558594, 0.003747360548004508, -0.02191968634724617, 0.019016172736883163, 0.014216771349310875, -0.010536840185523033, -0.014883436262607574, 0.10279001295566559, 0.04265886917710304, 0.0008976380340754986, 0.06447653472423553, 0.015596085228025913, 0.049197398126125336, -0.029860252514481544, 0.04240933805704117, -0.031991828233003616, 0.022910278290510178, -0.019326061010360718, -0.02209279127418995, -0.027545079588890076, 6.184017170918874e-33, -0.04419442638754845, -0.011292966082692146, -0.0564938522875309, 0.004811359569430351, 0.034674402326345444, 0.11428040266036987, 0.061805643141269684, -0.08081812411546707, -0.011365648359060287, 0.02675100788474083, -0.0817384123802185, -0.006243785843253136, -0.063044972717762, 0.06295724958181381, -0.0240431297570467, -0.03553641960024834, 0.008641202934086323, 0.01988878659904003, 0.025434046983718872, 0.053594790399074554, 0.007219541817903519, 0.02124800719320774, -0.06016552820801735, -0.016389552503824234, -0.05409659445285797, -0.088383749127388, -0.06095857918262482, -0.0063526504673063755, 0.05025387555360794, -0.02822974883019924, -0.024418706074357033, 0.008675718680024147, 0.023256560787558556, -0.06162383034825325, -0.0281410813331604, 0.015021816827356815, 0.05873636156320572, -0.008783523924648762, -0.004183625802397728, -0.012029789388179779, 0.019400736317038536, 0.08662904798984528, -0.00482385465875268, -0.06559313833713531, -0.090602807700634, 0.04396684840321541, -0.005816006101667881, 0.020672429352998734, -0.045016102492809296, 0.02434142865240574, 0.030992742627859116, -0.03540841117501259, -0.0011672223918139935, -0.0949966087937355, -0.007461016997694969, -0.05651289224624634, 0.05711180716753006, 0.08028063178062439, 0.10722588747739792, -0.014526872895658016, 0.014372886158525944, 0.0018630641279742122, -0.0639193207025528, 0.07694598287343979, -0.02760390378534794, -0.008601179346442223, 0.043836601078510284, 0.07802148908376694, -0.04229914769530296, -0.021322961896657944, -0.15341055393218994, 0.10037042945623398, -0.05815263092517853, -0.03796353191137314, -0.01466001383960247, 0.0031385489273816347, -0.017721889540553093, -0.04469725862145424, -0.050952885299921036, 0.06544841080904007, -0.09844053536653519, 0.10192384570837021, 0.04511658474802971, -0.028510838747024536, -0.051299095153808594, 0.08039803802967072, 0.022331388667225838, -0.06732292473316193, -0.01694023236632347, -0.009086002595722675, -0.028514312580227852, -0.055474963039159775, 0.08246158808469772, 0.013590897433459759, -0.04333893209695816, -4.511370259619347e-33, 0.006118105724453926, 0.05684104189276695, 0.00513914879411459, -0.003180023282766342, -0.039028409868478775, 0.015930451452732086, 0.003969065845012665, -0.027399703860282898, -0.0769149586558342, -0.06829912960529327, 0.03034714050590992, -0.015918510034680367, -0.05948399007320404, -0.060086820274591446, 0.04853734374046326, -0.08694009482860565, -0.0020184628665447235, 0.009670089930295944, 0.06441821902990341, 0.011543240398168564, 0.05572769045829773, 0.08649659901857376, -0.10283052921295166, 0.055331040173769, -0.17561545968055725, 0.06212944909930229, 0.0365133099257946, 0.04706127941608429, 0.05890418216586113, -0.04121152684092522, -0.0004462449869606644, -0.05284435302019119, 0.017482999712228775, 0.0014994764933362603, 0.003448912175372243, 0.008979271166026592, 0.08698201924562454, -0.025283418595790863, -0.0445149727165699, -0.01994735188782215, 0.08019498735666275, 0.020373739302158356, -0.0669516921043396, 0.021439265459775925, -0.06115574389696121, 0.05444809049367905, 0.03381597250699997, -0.007355866488069296, -0.023048434406518936, 0.029602261260151863, -0.03859175369143486, -0.026217039674520493, -0.10567191243171692, 0.010405789129436016, -0.023341314867138863, 0.03050919994711876, 0.03985161706805229, 0.053153134882450104, 0.10498934984207153, -0.017870768904685974, -0.058118220418691635, -0.09555715322494507, -0.02576482854783535, -0.0971158817410469, 0.004006111528724432, 0.008103926666080952, -0.06997985392808914, 0.04023737832903862, -0.002450848463922739, 0.06696982681751251, -0.062450382858514786, 0.028839178383350372, 0.047135114669799805, 0.00913933478295803, 0.004123676102608442, -0.04382360726594925, 0.02095259353518486, -0.0011955127120018005, 0.07637174427509308, 0.003239603480324149, -0.0667094737291336, -0.0006200692150741816, -0.0556032769382, 0.09034427255392075, 0.16798533499240875, 0.04254534840583801, 0.06941232830286026, 0.07193370908498764, 0.07091905921697617, -0.01643623411655426, -0.002616912592202425, 0.020697595551609993, 0.05751674249768257, 0.04409099742770195, 0.0653444305062294, -5.250345580520843e-08, 0.010036156512796879, 0.05168646574020386, -0.015065432526171207, 0.04327666014432907, -0.07149168103933334, -0.04900678992271423, 0.04576423764228821, 0.05296669527888298, -0.004790076985955238, -0.0657135546207428, -0.006364303641021252, -0.021903783082962036, -0.0492657907307148, -0.037635162472724915, 0.046658266335725784, 0.09396760910749435, -0.08541279286146164, -0.020293843001127243, 0.04787001013755798, -0.013893093913793564, -0.03351258113980293, -0.05298900604248047, -0.016747383400797844, 0.019330037757754326, -0.07313361763954163, -0.04069938510656357, 0.012433536350727081, 0.052977342158555984, 0.011847738176584244, -0.05562548339366913, 0.04562200978398323, 0.029817787930369377, 0.05901109427213669, 0.027775604277849197, 0.01415981538593769, 0.007909013889729977, -0.08140993863344193, 0.02548338659107685, 0.0274980366230011, 0.03292198106646538, -0.04477451369166374, -0.009512356482446194, 0.04954679310321808, -0.06331924349069595, 0.013599823229014874, -0.01658603549003601, 0.06346850097179413, -0.006793420761823654, 0.035159774124622345, 0.01713765226304531, 0.013664837926626205, 0.0617254413664341, -0.0018989132950082421, 0.11833354830741882, 0.062001653015613556, -0.046546731144189835, -0.011511367745697498, -0.043251883238554, 0.002653877716511488, 0.04365299642086029, 0.007271562237292528, -0.04960824176669121, -0.06512659788131714, -0.04109298065304756 ] }, { "text": "def load_image(path_or_url: str, max_size: int = 512) -> torch.Tensor:\n\"\"\"\nLoad an image from a file path or URL.\nReturns a normalized tensor ready for the model.\n\"\"\"\n# Load image\nif path_or_url.startswith('http'):\nheaders = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36'}\nresponse = requests.get(path_or_url, headers=headers, allow_redirects=True)\nresponse.raise_for_status()\nimg = Image.open(BytesIO(response.content)).convert('RGB')\nelse:\nimg = Image.open(path_or_url).convert('RGB')\n\n# Resize while maintaining aspect ratio\nratio = max_size / max(img.size)\nnew_size = tuple(int(dim * ratio) for dim in img.size)\nimg = img.resize(new_size, Image.LANCZOS)\n\n# Convert to tensor [0, 1]\nimg_tensor = transforms.ToTensor()(img).unsqueeze(0).to(device)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_51", "embedding": [ 0.011270802468061447, -0.03163488209247589, -0.013504535891115665, 0.05048125982284546, 0.0422668419778347, -0.060449905693531036, -0.06653431057929993, 0.07056989520788193, -0.06460529565811157, -0.08184929937124252, -0.014119289815425873, 0.027341103181242943, -0.08062219619750977, 0.09237505495548248, 0.03391192853450775, 0.0542801134288311, -0.015125196427106857, 0.012606797739863396, -0.06779991835355759, -0.04739020764827728, 0.06272906810045242, -0.06712999939918518, 0.07815824449062347, -0.059731725603342056, -0.027578499168157578, -0.03387458994984627, 0.026927828788757324, -0.01845654658973217, 0.042299479246139526, -0.038045115768909454, 0.06512349843978882, -0.026209427043795586, -0.06166265904903412, 0.013998397625982761, 0.06849577277898788, 0.03536247834563255, -0.06516283005475998, -0.11977948993444443, -0.03027741052210331, 0.00886120181530714, 0.0608840249478817, 0.009311877191066742, -0.0045557389967143536, 0.041479822248220444, -0.020719921216368675, 0.04737912490963936, 0.06886277347803116, 0.04562551900744438, 0.039083510637283325, -0.09303974360227585, -0.032729584723711014, -0.007077304646372795, -0.08110957592725754, 0.05640309303998947, 0.011358854360878468, -0.025841033086180687, 0.013254730962216854, -0.07740263640880585, -0.007829710841178894, -0.06386233866214752, -0.003078540787100792, 0.010513120330870152, 0.026625962927937508, -0.03385467454791069, -0.018556678667664528, 0.04335588216781616, -0.024930724874138832, -0.08816585689783096, 0.014300390146672726, -0.06476324051618576, -0.03725928068161011, -0.0348861962556839, -0.028728775680065155, 0.06819580495357513, -0.027132462710142136, -0.08373802155256271, 0.11688298732042313, 0.07557689398527145, 0.015507505275309086, -0.06457208842039108, -5.79643456148915e-05, -0.049010563641786575, 0.10666991770267487, 0.057687968015670776, 0.11928410083055496, -0.039985671639442444, 0.0042375121265649796, 0.02534298226237297, 0.01597968488931656, -0.013227405026555061, -0.01727079041302204, 0.021870488300919533, -0.07070129364728928, 0.06905736774206161, 0.021920667961239815, 0.0009906727354973555, 0.04325169697403908, -0.056681036949157715, -0.0786304846405983, 0.06130264326930046, 0.02782095968723297, -0.07317283749580383, 0.0223141647875309, 0.05273536965250969, 0.020461203530430794, 0.013942292891442776, 0.048920273780822754, 0.14538340270519257, 0.013323734514415264, -0.00196353392675519, 0.040508221834897995, 0.022795692086219788, -0.005120620131492615, -0.011617515236139297, 0.0640401616692543, -0.07199767976999283, -0.07544416189193726, 0.08702722936868668, -0.006123581435531378, 0.013027566485106945, 0.05583140626549721, 0.0924779549241066, -0.04144379869103432, 0.0007394538843072951, -0.011558979749679565, -0.05279446765780449, -0.04222225770354271, 6.712764815494308e-33, -0.052741799503564835, 0.005267444532364607, 0.027493774890899658, 0.007188921328634024, -0.022500434890389442, 0.019352765753865242, 0.035546086728572845, -0.02548348158597946, -0.07950177788734436, -0.03579430282115936, -0.048028409481048584, 0.032218124717473984, -0.04228002578020096, 0.051443614065647125, -0.05511106923222542, -0.023008150979876518, -0.005854138173162937, 0.035315170884132385, 0.05193202570080757, 0.061207693070173264, 0.009132785722613335, -0.013642095029354095, -0.020091326907277107, 0.023148585110902786, -0.09930840134620667, -0.044237170368433, -0.02141902968287468, 0.0351705364882946, -0.035365909337997437, -0.027718214318156242, -0.009467054158449173, -0.06166666001081467, -0.013939513824880123, -0.010192729532718658, -0.007943210192024708, -0.09765402227640152, 0.03680970147252083, 0.021717650815844536, -0.09553556144237518, -0.02700427733361721, -0.0057152509689331055, 0.07612576335668564, 0.004085281863808632, -0.054156139492988586, -0.07161423563957214, 0.021673616021871567, -0.062186263501644135, 0.01759505085647106, -0.07048232853412628, -0.03117990307509899, -0.01228687260299921, -0.04410569369792938, 0.058356188237667084, 0.0024239032063633204, -0.02149217389523983, -0.06034717336297035, 0.0371716283261776, 0.01509253028780222, 0.07491143047809601, -0.09596137702465057, 0.09475107491016388, 0.005092306062579155, 0.02539098635315895, 0.04107353836297989, 0.02397441305220127, -0.013024797663092613, 0.05518151819705963, 0.024368412792682648, -0.11494418233633041, 0.037487681955099106, -0.048836849629879, 0.10723859071731567, 0.02783140167593956, -0.0794811099767685, -0.05425839126110077, -0.1299601048231125, 0.029166627675294876, -0.031156884506344795, -0.07705575227737427, 0.061628829687833786, -0.06996050477027893, 0.000384811544790864, 0.0763242319226265, -0.10160567611455917, -0.054584044963121414, 0.032277125865221024, 0.0036676714662462473, -0.042595211416482925, -0.011849647387862206, -0.018062712624669075, -0.052007775753736496, -0.021642420440912247, 0.027882441878318787, -0.0063029928132891655, -0.03588568791747093, -4.7318125519389736e-33, 0.044656578451395035, 0.025276437401771545, 0.01194541621953249, 0.02718716487288475, -0.030676929280161858, 0.06325256079435349, 0.08615134656429291, 0.06321205943822861, -0.002216564491391182, -0.03750214725732803, 0.10636650025844574, 0.003311974462121725, -0.07229285687208176, -0.10651463270187378, 0.009715956635773182, -0.032365258783102036, -0.03450563922524452, -0.023591618984937668, -0.010416070930659771, 0.03191159665584564, -0.10304611921310425, 0.046268172562122345, -0.04602206498384476, 0.04753880947828293, -0.09598065912723541, 0.06618206948041916, 0.05042729154229164, 0.004637663718312979, -0.07204867154359818, -0.03527277708053589, 0.037428148090839386, -0.03860807418823242, -0.06640031188726425, 0.009614160284399986, 0.031831663101911545, 0.033682931214571, 0.07231181859970093, 0.018253065645694733, -0.0009045625338330865, 0.08484978973865509, 0.12230191379785538, 0.0320761576294899, -0.07315019518136978, 0.06502088904380798, -0.024919964373111725, -0.004233135841786861, -0.03855195268988609, -0.005061451345682144, 0.011561926454305649, 0.02851141430437565, 0.05438043177127838, -0.07542259991168976, -0.04668821394443512, 0.040753357112407684, -0.012823645956814289, 0.01912885531783104, -0.00033241856726817787, -0.001576561713591218, 0.022591527551412582, 0.043234504759311676, -0.005940391682088375, -0.09772810339927673, -0.056589726358652115, -0.07241906970739365, -0.029780302196741104, 0.008469679392874241, -0.12275050580501556, 0.0516689270734787, 0.022082865238189697, 0.08372877538204193, -0.029523923993110657, 0.07526330649852753, 0.0849425196647644, 0.08314431458711624, 0.035907331854104996, 0.005427920259535313, 0.05542878061532974, 0.040889840573072433, 0.049537770450115204, -0.006053381599485874, -0.006640538107603788, 0.022691315039992332, -0.018797388300299644, 0.02718103490769863, 0.08367707580327988, 0.046111658215522766, 0.008028636686503887, 0.04610922187566757, 0.01544992532581091, -0.039006322622299194, -0.010241988115012646, -0.01913118176162243, 0.09329674392938614, 0.04485033079981804, 0.041179295629262924, -5.540139724757864e-08, -0.06184489652514458, -0.005563437007367611, 0.031445637345314026, 0.0074429865926504135, -0.0424046665430069, 0.0501120463013649, 0.08140216022729874, -0.027560729533433914, 0.07523342967033386, -0.005227369721978903, 0.03510695695877075, -0.024922406300902367, -0.006192997097969055, 0.04014984518289566, -0.025958597660064697, 0.0717572495341301, 0.0008585562463849783, 0.030370069667696953, 0.052067480981349945, -0.06657221168279648, -0.021043378859758377, -0.07459582388401031, 0.014899842441082, 0.015049053356051445, 0.016641194000840187, -0.03418365865945816, -0.023314625024795532, 0.035373855382204056, -0.05861775949597359, -0.042405515909194946, -0.014510796405375004, -0.026200860738754272, 0.042428482323884964, 0.02918122708797455, 0.0137783857062459, 0.05121288448572159, -0.06540479511022568, -0.002235483843833208, -0.026878397911787033, -0.008971874602138996, -0.029002979397773743, 0.03243075683712959, 0.023573897778987885, -0.07100260257720947, 0.08319693058729172, -0.029136234894394875, 0.0073770200833678246, 0.01680200919508934, -0.019727012142539024, 0.09303811937570572, 0.07511845976114273, -0.030055444687604904, -0.03400856629014015, 0.09651749581098557, 0.020545760169625282, -0.10907502472400665, 0.0440681092441082, -0.0038972634356468916, -0.04279882833361626, 0.06113610044121742, 0.0953083261847496, -0.004157610237598419, -0.06683830916881561, -0.029855700209736824 ] }, { "text": "# Convert to tensor [0, 1]\nimg_tensor = transforms.ToTensor()(img).unsqueeze(0).to(device)\n\n# Normalize for InceptionV3\nimg_tensor = (img_tensor - IMAGENET_MEAN) / IMAGENET_STD\n\nreturn img_tensor\n\ndef tensor_to_image(tensor: torch.Tensor) -> np.ndarray:\n\"\"\"\nConvert a normalized tensor back to a displayable image.\n\"\"\"\n# Denormalize\nimg = tensor * IMAGENET_STD + IMAGENET_MEAN\n\n# Clip to valid range and convert\nimg = img.squeeze(0).permute(1, 2, 0).cpu().detach().numpy()\nimg = np.clip(img, 0, 1)\n\nreturn img\n\ndef show_image(tensor: torch.Tensor, title: str = \"\"):\n\"\"\"Display a tensor as an image.\"\"\"\nimg = tensor_to_image(tensor)\nplt.figure(figsize=(10, 10))\nplt.imshow(img)\nplt.title(title)\nplt.axis('off')\nplt.show()\n\n5. The Core Deep Dream Algorithm¶", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_52", "embedding": [ 0.037597499787807465, -0.038521770387887955, 0.007488740608096123, -0.02285321056842804, 0.028068849816918373, -0.03976678103208542, 0.006815287750214338, 0.020251242443919182, -0.07007410377264023, -0.09362848103046417, -0.015738582238554955, -0.03710330277681351, -0.03675498813390732, 0.10666931420564651, -0.049801960587501526, 0.035895392298698425, -0.01447953749448061, 0.05715838819742203, -0.0477638766169548, -0.04554769769310951, 0.08741263300180435, 0.05598607659339905, 0.04323325678706169, -0.022798677906394005, 0.01822115294635296, -0.01011623814702034, 0.022254109382629395, -0.014383121393620968, 0.04105265438556671, 0.024994779378175735, -0.00038831637357361615, -0.040232304483652115, 0.04154843091964722, 0.020093420520424843, 0.03699042275547981, 0.023391248658299446, -0.07576074451208115, -0.06398175656795502, -0.03057357668876648, 0.02748364396393299, 0.05682266876101494, 0.014014936983585358, -0.019406957551836967, -0.09868717193603516, -0.018576784059405327, 0.056993160396814346, 0.06421127915382385, -0.011470393277704716, 0.07188718765974045, -0.06274522840976715, 0.021236347034573555, 0.01595485396683216, -0.10758110880851746, 0.019487330690026283, -0.006008863914757967, -0.0020064814016222954, 0.036118291318416595, -0.08897470682859421, -0.06649503111839294, -0.07700468599796295, 0.0112677700817585, 0.046188682317733765, 0.0371762216091156, -0.04354304075241089, 0.03857521340250969, -0.008783120661973953, 0.01744156889617443, -0.07535656541585922, 0.03309381380677223, -0.025345763191580772, -0.0031434358097612858, -0.00823729857802391, -0.02890021726489067, -0.0019467993406578898, -0.030051734298467636, -0.031255122274160385, 0.08776374161243439, 0.042963288724422455, 0.013114280998706818, -0.035950642079114914, -0.00990328099578619, -0.0018197241006419063, 0.10829877853393555, 0.019689418375492096, 0.02415386773645878, -0.02216053381562233, -0.05524703860282898, 0.07177477329969406, 0.05006323754787445, -0.0408344492316246, -0.0483158603310585, 0.016151022166013718, -0.11899065226316452, 0.013321401551365852, 0.09844470769166946, -0.025991300120949745, 0.02513016387820244, -0.040279265493154526, -0.025088902562856674, 0.07161525636911392, 0.019173838198184967, -0.053070634603500366, 0.0009861831786110997, 0.007248731330037117, 0.034354303032159805, 0.12319234758615494, 0.06479313224554062, 0.0190646480768919, -0.031029153615236282, -0.023769959807395935, -0.00454644626006484, 0.02679401822388172, 0.00623422721400857, -0.011860506609082222, 0.08676521480083466, -0.018879838287830353, -0.05151499807834625, 0.07929504662752151, 0.014044323936104774, 0.033122990280389786, -0.044161513447761536, 0.06395920366048813, -0.013453683815896511, 0.06752581149339676, -0.017385641112923622, 0.043498314917087555, -0.05474807322025299, 5.5506795491370414e-33, -0.08519771695137024, -0.012469997629523277, 0.050681497901678085, -0.006092883180826902, -0.027120573446154594, 0.11293010413646698, 0.033682722598314285, -0.058409661054611206, -0.015296483412384987, 2.308362854819279e-05, -0.019653242081403732, 0.01275607943534851, -0.02132355235517025, 0.08771925419569016, -0.047675229609012604, -0.08297283947467804, 0.07638870179653168, -0.016410278156399727, 0.05333275347948074, -0.026248905807733536, 0.03504538536071777, 0.03473027050495148, -0.038873616605997086, 0.030370550230145454, -0.10641293972730637, -0.0764961987733841, -0.06495188176631927, 0.0014442483661696315, 0.013541708700358868, -0.0709761530160904, -0.08271130919456482, 0.0015229532727971673, -0.005898233037441969, -0.07825764268636703, -0.04359711334109306, -0.04051746428012848, 0.0633477121591568, 0.01146768406033516, -0.047646041959524155, -0.010995437391102314, 0.0215160995721817, 0.08046289533376694, 0.00025099687627516687, -0.0708695650100708, -0.06485015153884888, 0.07042516767978668, -0.03540266305208206, 0.09814135730266571, -0.04077129811048508, -0.02614079974591732, -0.03247954696416855, -0.05436336621642113, -0.006612177938222885, -0.05774550884962082, -0.030129745602607727, -0.08908416330814362, 0.09191258251667023, 0.04270408675074577, 0.06993497908115387, -0.09955903887748718, 0.018864313140511513, -0.004666543565690517, 0.03146982192993164, 0.07092751562595367, -0.03739044442772865, 0.008978546597063541, 0.00978528056293726, 0.05072048306465149, -0.04287571460008621, 0.039887621998786926, -0.10735403746366501, 0.15056772530078888, -0.0839528888463974, -0.03051947057247162, -0.012116936035454273, -0.03275315836071968, 0.02745203860104084, -0.0659676045179367, -0.0551365464925766, 0.041370369493961334, -0.05289480835199356, 0.08459735661745071, 0.001870352542027831, -0.13406161963939667, -0.05818876624107361, 0.027495834976434708, -0.03119690530002117, -0.07668381184339523, -0.0024914511013776064, -0.019768916070461273, -0.0776284784078598, 3.497155194054358e-05, 0.02797190099954605, 0.041479215025901794, -0.07600598782300949, -5.181190450604903e-33, 0.024115094915032387, 0.04159027710556984, -0.016130812466144562, 0.017747391015291214, -0.009614484384655952, 0.03352363407611847, 0.04253450036048889, 0.05867176502943039, -0.052191536873579025, -0.035077884793281555, 0.033104293048381805, -0.029040437191724777, -0.013521676883101463, -0.09838084131479263, 0.027800293639302254, -0.023588722571730614, -0.015957310795783997, 0.054252203553915024, 0.017223535105586052, 0.011211123317480087, -0.035345450043678284, 0.09285478293895721, -0.048296231776475906, 0.007609791122376919, -0.14233127236366272, 0.06772526353597641, 0.02646629512310028, 0.04529288783669472, 0.02871742658317089, -0.06547978520393372, 0.020645825192332268, -0.03302104398608208, -0.0025879901368170977, 0.0694504976272583, 0.027123020961880684, 0.05559910833835602, 0.04804866388440132, -0.024504385888576508, -0.036496665328741074, 0.02374475635588169, 0.05239947885274887, 0.09738684445619583, -0.03647294640541077, 0.10778181254863739, -0.042560089379549026, 0.02353307045996189, 0.004711204674094915, -0.0740925520658493, 0.013859881088137627, -0.0036020614206790924, -0.05589636415243149, -0.06096338853240013, -0.06358126550912857, 0.006898504216223955, -0.07015851885080338, 0.03042377345263958, -0.020101625472307205, -0.008177637122571468, 0.06022436171770096, 0.01054489053785801, 0.0047699506394565105, -0.08893761783838272, -0.0492720901966095, -0.07140062004327774, 0.0016585529083386064, -0.002045209286734462, -0.09443728625774384, 0.058009762316942215, 0.006240724120289087, 0.06333351880311966, 0.0195749644190073, 0.03742552921175957, 0.075778067111969, 0.004447269253432751, 0.002352022333070636, -0.03374173492193222, 0.05398052930831909, 0.04412827268242836, 0.09213276207447052, -0.04981633648276329, 0.017968198284506798, -0.047131285071372986, 0.0007650991319678724, 0.00809558667242527, 0.10819883644580841, 0.04365948587656021, 0.05777919664978981, 0.024676332250237465, 0.016593443229794502, -0.0037902402691543102, 0.004169125109910965, -0.036330390721559525, 0.033272743225097656, 0.07385709881782532, 0.0885799303650856, -5.0864542799899937e-08, 0.005831091199070215, 0.013345165178179741, 0.04886200278997421, 0.014946281909942627, -0.031116679310798645, -0.013648897409439087, 0.04146575555205345, -0.0363214910030365, 0.0009648273116908967, -0.06921335309743881, -0.023973988369107246, -0.12244365364313126, -0.04054667800664902, -0.023830492049455643, 0.021864792332053185, 0.09776714444160461, -0.0668262243270874, 0.014887869358062744, 0.06768710166215897, -0.0026146427262574434, -0.08086209744215012, -0.06603320688009262, -0.03194567188620567, 0.030294738709926605, -0.08583661168813705, -0.030393116176128387, -0.00465910229831934, 0.018554391339421272, 0.05656760558485985, -0.0427895151078701, 0.014107982628047466, -0.021301567554473877, 0.1203150600194931, 0.02162955142557621, 0.030475815758109093, 0.028220541775226593, -0.060234129428863525, -0.0023285155184566975, 0.013158519752323627, 0.05390927568078041, -0.07986266911029816, 9.706484706839547e-05, 0.053330667316913605, -0.058998145163059235, 0.04041850566864014, -0.03390190377831459, 0.06936965137720108, -0.05030118301510811, -0.02637791447341442, 0.056250493973493576, 0.08268240094184875, 0.025678446516394615, -0.004225861746817827, 0.09117905795574188, 0.046702757477760315, -0.08085688948631287, 0.02519362047314644, 0.05457573011517525, -0.016632823273539543, 0.07668880373239517, -0.00038879059138707817, -0.02441798709332943, -0.02986457571387291, -0.0398934967815876 ] }, { "text": "5. The Core Deep Dream Algorithm¶\n\nHere's where the magic happens. The algorithm is surprisingly simple:\n\nfor each iteration:\n1. Forward pass: get layer activations\n2. Compute loss: mean of activations (we want to maximize this)\n3. Backward pass: compute gradients with respect to input image\n4. Update image: add gradients to amplify detected patterns\n\nIn [6]:\n\ndef deep_dream_step(\nmodel: DeepDreamModel,\nimage: torch.Tensor,\nlayer_name: str,\nlearning_rate: float = 0.01\n) -> torch.Tensor:\n\"\"\"\nPerform a single Deep Dream optimization step.\n\nArgs:\nmodel: The DeepDream model wrapper\nimage: Input image tensor (requires_grad must be True)\nlayer_name: Which layer to maximize activations for\nlearning_rate: Step size for gradient ascent", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_53", "embedding": [ -0.04705677181482315, -0.0649123266339302, 0.0762479230761528, 0.01513367798179388, -0.001891564461402595, -0.009468630887567997, -0.07965197414159775, -0.049531497061252594, -0.07248008996248245, -0.10007869452238083, -0.06650200486183167, -0.026659734547138214, -0.001555390190333128, -0.02167460508644581, -0.04732795059680939, 0.07158213108778, -0.020375780761241913, 0.08271699398756027, -0.08230647444725037, -0.06889309734106064, 0.09103156626224518, -0.051456257700920105, 0.0509488619863987, -0.0077811069786548615, 0.013154702261090279, 0.02475578710436821, 0.007021796423941851, -0.030228013172745705, 0.039678413420915604, -0.020696278661489487, 0.08350271731615067, -0.016901634633541107, 0.013812661170959473, 0.08056773245334625, -0.009363300167024136, 0.06290770322084427, -0.06436245888471603, -0.05784229189157486, -0.014293813146650791, 0.040159378200769424, 0.02326241321861744, -0.06217697635293007, -0.012426863424479961, -0.027694033458828926, 0.031278904527425766, 0.04043300449848175, 0.03769157826900482, -0.030904725193977356, -0.03205695375800133, -0.031806379556655884, -0.05311417579650879, -0.056167036294937134, -0.05227841064333916, 0.06092656031250954, 0.027796870097517967, 0.013478280045092106, 0.04190210625529289, -0.03596367686986923, 0.004335097037255764, -0.08915441483259201, 0.03763207048177719, -0.03438957780599594, -0.02505301497876644, -0.043305810540914536, 0.015388064086437225, -0.048855215311050415, -0.01909027434885502, -0.03038346953690052, 0.1065748929977417, -0.006914239842444658, 0.003530168905854225, 0.07659496366977692, -0.012270449660718441, -0.03863659128546715, 0.03950878977775574, -0.004898982122540474, 0.09136806428432465, -0.004199748858809471, -0.02254084311425686, -0.08499693125486374, 0.031201908364892006, -0.02667570300400257, 0.04610389471054077, -0.04042200744152069, 0.059818729758262634, -0.030551491305232048, 0.008218997158110142, -0.0013691342901438475, 0.021099209785461426, -0.01982310600578785, 0.05716477334499359, -0.09480307996273041, -0.14092659950256348, -0.014077293686568737, 0.09544497728347778, 0.04302722215652466, -0.008197812363505363, -0.14977876842021942, -0.06280205398797989, -0.0157605167478323, -0.01767774298787117, -0.0632316842675209, 0.02102549374103546, -0.02022823877632618, 0.03755807504057884, 0.015658479183912277, 0.06788676232099533, 0.07212936878204346, -0.027119578793644905, -0.06204261630773544, 0.021790582686662674, 0.001961460569873452, 0.04836917296051979, 0.027622507885098457, 0.03813815861940384, 0.005031022243201733, -0.006948234513401985, 0.05585944280028343, -0.025755073875188828, 0.09435825794935226, -0.06914330273866653, 0.0723148062825203, 0.027170835062861443, -0.03813557326793671, -0.07606901973485947, -0.023622801527380943, -0.08991646021604538, 5.8309864626661855e-33, 0.02221345528960228, 0.05792604759335518, 0.008842138573527336, -0.005790284369140863, 0.0675334632396698, -0.0025934691075235605, 0.020536864176392555, -0.039657484740018845, -0.057150959968566895, 0.03010382317006588, -0.034947093576192856, 0.013398684561252594, -0.06004844978451729, 0.17644447088241577, 0.009059576317667961, -0.05193299055099487, -0.033850234001874924, -0.017896508798003197, 0.052347540855407715, 0.025407183915376663, 0.048186447471380234, 0.03100741095840931, -0.0331277996301651, -0.05653372034430504, -0.08934775739908218, 0.06406980752944946, 0.046046797186136246, 0.030205104500055313, -0.04584207385778427, 0.014719539321959019, -0.04600384458899498, -0.00048191932728514075, -0.07817072421312332, -0.000548316165804863, 0.0451175756752491, 0.05896418169140816, 0.08180510252714157, -0.0009020238067023456, -0.020871477201581, -0.0868445411324501, 0.008055338636040688, 0.04609329253435135, -0.03191153705120087, -0.02594073861837387, -0.07757493853569031, 0.027655798941850662, -0.027687057852745056, 0.06137955188751221, 0.05962926894426346, 0.002572782803326845, 0.009024969302117825, -0.04802573472261429, -0.047837451100349426, -0.09569170325994492, 0.013072960078716278, -0.013507352210581303, 0.04016336053609848, 0.004261479713022709, 0.13112831115722656, -0.0037780464626848698, 0.04516657441854477, -0.03714093193411827, 0.01529715210199356, 0.044303443282842636, -0.03699510172009468, 0.010122847743332386, -0.013219865970313549, 0.024599000811576843, 0.0006305186543613672, -0.009754827246069908, -0.06305737048387527, 0.05082456395030022, 0.002340175909921527, -0.04622264206409454, 0.00018372740305494517, 0.005109030287712812, 0.02157343365252018, -0.0978003442287445, -0.03671920299530029, 0.04697008058428764, -0.05497933551669121, 0.14417265355587006, -0.014767002314329147, -0.05547536164522171, 0.011873006820678711, 0.11054599285125732, -0.007361181080341339, -0.07545845210552216, -0.07688979804515839, 0.020240573212504387, -0.11568295210599899, -0.04412336274981499, 0.06699961423873901, 0.009397188201546669, -0.05589350685477257, -5.808085261318275e-33, 0.05456257238984108, 0.06074153259396553, -0.003923138603568077, 0.10003724694252014, 0.0699307769536972, -0.07334644347429276, 0.030569424852728844, 0.008079157210886478, -0.013521261513233185, 0.011724326759576797, 0.03383679687976837, 0.010919886641204357, -0.024400897324085236, -0.029489336535334587, 0.04775387793779373, -0.09880582988262177, 0.005501617677509785, -0.03962109982967377, 0.044821739196777344, 0.039019715040922165, -0.050634730607271194, 0.09777278453111649, -0.1351873129606247, 0.015096780844032764, -0.12748919427394867, 0.014852315187454224, 0.005755127407610416, 0.09132441878318787, 0.02053612284362316, 0.011568140238523483, 0.014814489521086216, -0.003934513311833143, -0.056531503796577454, 0.04113076999783516, -0.04495944455265999, 0.1027090921998024, 0.02807171270251274, -0.03011409007012844, -0.024898730218410492, 0.01651407778263092, 0.05089316889643669, -0.006445636041462421, -0.045237623155117035, -0.010342526249587536, 0.01658865436911583, -0.003436281345784664, -0.008570575155317783, 0.005264833103865385, 0.0058955298736691475, 0.03403165563941002, 0.04750608652830124, -0.040791574865579605, -0.13267649710178375, 0.045782431960105896, -0.04028209671378136, -0.004211589228361845, -0.03491027653217316, 0.009771251119673252, 0.05365470051765442, 0.0672370195388794, -0.0760686993598938, 0.005312321241945028, -0.012072887271642685, -0.020448626950383186, -0.04617246240377426, 0.05310828611254692, -0.08466770499944687, 0.011613933369517326, 0.007546198088675737, 0.02763497456908226, 0.026299793273210526, 0.03437167778611183, 0.0759177878499031, 0.10752248018980026, 0.018894881010055542, -0.05355291813611984, -0.05695114657282829, -0.0039688232354819775, 0.07849451899528503, -0.027061117812991142, -0.026465021073818207, -0.07244385778903961, -0.051287174224853516, 0.09720094501972198, 0.03419904038310051, 0.015222233720123768, 0.05391325801610947, 0.04756862297654152, 0.01683729514479637, -0.04164757952094078, -0.020465567708015442, -0.022564297541975975, 0.033602792769670486, 0.017798714339733124, 0.011749808676540852, -5.0835790688097404e-08, -0.047385793179273605, -0.00578082213178277, 0.07523413002490997, -0.0004098928184248507, 0.0028877854347229004, -0.032178957015275955, 0.0794561579823494, 0.06336461752653122, 0.024941112846136093, -0.04613106697797775, 0.07076192647218704, -0.023243607953190804, -0.03648620471358299, 0.04027451574802399, 0.0009148034150712192, 0.08944188803434372, 0.043897658586502075, 0.06283806264400482, 0.012158052995800972, -0.07572143524885178, -0.0016209353925660253, 0.013134509325027466, 0.04998093470931053, -0.03605502098798752, 0.06493857502937317, -0.043294236063957214, 0.0173760075122118, 0.029520690441131592, -0.05447512865066528, -0.0002982704318128526, 0.019674532115459442, -0.03933560475707054, 0.04763541370630264, 0.020021619275212288, -0.01198321022093296, 0.09835406392812729, -0.061591822654008865, 0.02090943045914173, -0.0009754904313012958, 0.005149016622453928, -0.006997187156230211, -0.008534979075193405, 0.011450124904513359, -0.07869675755500793, -0.0357118621468544, 0.0022290649358183146, -0.0343489795923233, -0.1074693500995636, -0.04913944751024246, 0.107859306037426, 0.02530556730926037, 0.0068213739432394505, 0.0030357171781361103, 0.08524666726589203, 0.061958856880664825, -0.059094615280628204, 0.008653108030557632, -0.04886624962091446, -0.011716254986822605, 0.026836536824703217, 0.03616926074028015, 0.01390674989670515, -0.0687531977891922, -0.032806046307086945 ] }, { "text": "Returns:\nUpdated image tensor\n\"\"\"\n# Forward pass\nlayer_outputs = model(image)\n\n# Get the activations from our target layer\nactivations = layer_outputs[layer_name]\n\n# Loss = mean of activations\n# We want to MAXIMIZE this, so we'll do gradient ASCENT\nloss = activations.mean()\n\n# Backward pass - compute gradients w.r.t. image\nloss.backward()\n\n# Normalize gradients (helps stabilize the process)\ngrad = image.grad.data\ngrad = grad / (grad.std() + 1e-8) # Normalize by standard deviation\n\n# Gradient ASCENT (add gradients, not subtract)\nimage.data = image.data + learning_rate * grad\n\n# Clear gradients for next iteration\nimage.grad.data.zero_()\n\nreturn image", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_54", "embedding": [ 0.007131761405616999, -0.06182977929711342, 0.06166243925690651, -0.019030187278985977, -0.015387904830276966, -0.057198233902454376, -0.01406220905482769, 0.019441433250904083, -0.08689645677804947, -0.045676544308662415, -0.04429486021399498, 0.016274787485599518, 0.0461321696639061, -0.0029938409570604563, -0.03174540773034096, 0.04911727085709572, -0.04002949595451355, 0.10746469348669052, -0.05825706943869591, -0.11791354417800903, -0.03846154361963272, 0.011414224281907082, 0.012969592586159706, 0.027805980294942856, 0.025881055742502213, -0.000387199834221974, 0.00668708048760891, -0.035399872809648514, 0.04470818117260933, -0.04006245359778404, 0.05410926043987274, -0.0846538245677948, 0.062398724257946014, 0.025207508355379105, -0.06916617602109909, 0.06698263436555862, -0.06843698769807816, -0.048673126846551895, 0.010103653185069561, 0.02854493446648121, -0.009342940524220467, 0.01638292893767357, -0.03213093802332878, -0.05441673845052719, 0.03185033053159714, 0.04855221509933472, 0.013746530748903751, -0.06643525511026382, 0.0637536570429802, -0.012147518806159496, 0.03826310485601425, -0.03954727202653885, -0.10536684095859528, 0.008371042087674141, -0.04490506649017334, 0.0625293180346489, 0.07225548475980759, -0.040892064571380615, -0.055099956691265106, -0.04317453131079674, 0.01982596330344677, -0.03570686653256416, -0.0009832485811784863, -0.019280705600976944, 0.05516522377729416, -0.028014514595270157, -0.005319193471223116, -0.08945359289646149, 0.06794005632400513, 0.017063409090042114, 3.096205182373524e-05, 0.05083928629755974, 0.020830461755394936, -0.06812573224306107, -0.03588974475860596, -0.04794342815876007, 0.10457637161016464, 0.06309020519256592, 0.05307958647608757, -0.046157654374837875, 0.028670888394117355, -0.010997822508215904, 0.05100306496024132, -0.07466371357440948, 0.032507725059986115, -0.04971710965037346, -0.00764870923012495, 0.017095433548092842, 0.05792156234383583, -0.00979575514793396, 0.02870754525065422, -0.0001129102092818357, -0.14806464314460754, 0.05242447555065155, 0.029143981635570526, 0.030742282047867775, -0.037947237491607666, -0.10990241169929504, -0.039413485676050186, 0.05276278406381607, -0.023561540991067886, -0.05080462619662285, 0.01660175807774067, 0.06675402820110321, 0.05025186017155647, 0.01864146813750267, 0.08286137133836746, 0.05091619864106178, -0.03563178330659866, -0.04115667939186096, 0.022096706554293633, 0.012633280828595161, 0.003957080189138651, 0.026417803019285202, 0.07564496994018555, 0.02427186630666256, 0.02461557276546955, 0.031096477061510086, -0.016775311902165413, 0.013671762309968472, -0.04942619800567627, 0.041634269058704376, -0.02294599637389183, 0.003107334254309535, -0.09152780473232269, -0.039276473224163055, -0.019821876659989357, 7.059627484483041e-33, -0.03691127896308899, -0.0008823774987831712, 0.05776544660329819, -0.03930976241827011, 0.006970894988626242, 0.06981886923313141, 0.009316450916230679, -0.04142642021179199, -0.04562791809439659, -0.0009062340832315385, -0.10750309377908707, 0.0008219497976824641, -0.09140078723430634, 0.15211640298366547, 0.012361240573227406, -0.06659669429063797, -0.008057883940637112, 0.0002633547119330615, 0.08577324450016022, -0.01588878035545349, 0.08587145060300827, -0.05725925788283348, -0.049735553562641144, -0.01170398946851492, -0.06003253161907196, -0.03658858686685562, 0.03346424177289009, 0.0034153414890170097, -0.09240149706602097, -0.02852424792945385, -0.054316505789756775, -0.048181213438510895, -0.035714294761419296, 0.009097821079194546, -0.0011393072782084346, 0.004489499609917402, 0.05753712356090546, 0.08332531154155731, 0.006411632522940636, -0.008927086368203163, 0.0049952794797718525, 0.06910542398691177, 0.011371954344213009, -0.028304506093263626, -0.042761582881212234, -0.0022451451513916254, -0.043862298130989075, 0.08393056690692902, 0.05425207316875458, -0.021069474518299103, -0.024136584252119064, -0.059512197971343994, -0.02247818000614643, -0.03672272339463234, -0.05664966255426407, -0.014921034686267376, 0.05300966277718544, 0.06406426429748535, 0.0652114748954773, -0.07012280821800232, 0.08059976249933243, -0.01244874857366085, 0.03158920258283615, 0.08813001215457916, -0.012957487255334854, -0.0011263840133324265, 1.6214455172303133e-05, 0.03059212490916252, -0.039981354027986526, 0.04512143135070801, -0.0307161882519722, 0.11824400722980499, -0.010898199863731861, -0.086599200963974, 0.021447479724884033, -0.008650420233607292, 0.034406427294015884, -0.0364607535302639, -0.007414685562252998, 0.00970511231571436, -0.0743032842874527, 0.10132382065057755, -0.0288141667842865, -0.1291903555393219, -0.040549930185079575, 0.07445989549160004, 0.003680428257212043, -0.0613221749663353, -0.02338511496782303, 0.011831742711365223, -0.11398142576217651, 0.02311691641807556, 0.05119068920612335, 0.07748094201087952, -0.06453997641801834, -6.351998987071225e-33, 0.03901045024394989, 0.10130708664655685, 0.01800031214952469, -0.021741023287177086, 0.02154872938990593, 0.042512197047472, 0.021765440702438354, 0.08793292194604874, -0.02127218060195446, 0.00899422261863947, 0.027165338397026062, 0.036250464618206024, -0.027769818902015686, -0.058749500662088394, 0.013945980928838253, -0.061394453048706055, -0.0076695638708770275, 0.043460045009851456, -0.004025033209472895, -0.04739077761769295, -0.07165791094303131, 0.131231427192688, -0.0638621598482132, 0.05103638023138046, -0.04882512241601944, 0.022976987063884735, -0.0037785086315125227, 0.10739748924970627, 0.010615035891532898, -0.03671731799840927, -0.037890028208494186, 0.031298425048589706, -0.014457843266427517, 0.09980102628469467, -0.015998756512999535, 0.044967830181121826, 0.03393832594156265, -0.04677053540945053, -0.013833782635629177, 0.02844308689236641, 0.05760157108306885, 0.03404448553919792, -0.02295939438045025, 0.01658358983695507, 0.08286263793706894, -0.04025941342115402, -0.03833766654133797, -0.06939568370580673, -0.019690822809934616, -0.02336590178310871, -0.0036983094178140163, -0.06932434439659119, -0.09715905040502548, 0.04255048558115959, -0.04935314133763313, 0.01300797425210476, -0.05108046159148216, -0.03576185926795006, 0.09254979342222214, -0.006475954316556454, -0.04828556999564171, -0.02922472544014454, -0.09039957821369171, 0.007825071923434734, -0.05005550757050514, 0.03686850517988205, -0.07810509204864502, 0.02079317718744278, 0.024576649069786072, 0.10217899084091187, 0.02881847694516182, 0.07070180773735046, 0.03655145317316055, 0.01273183524608612, 0.03857114538550377, -0.04028591886162758, -0.00851431954652071, 0.022169096395373344, 0.05957295373082161, -0.04788320139050484, 0.038322813808918, -0.02321561612188816, 0.012067877687513828, 0.06613977253437042, 0.05000907555222511, 0.020124757662415504, -0.010539596900343895, 0.03378351032733917, 0.05554364621639252, -0.0031859625596553087, -0.02584291808307171, -0.10625399649143219, 0.05514931306242943, -0.04378826171159744, 0.03781096637248993, -4.491234051329229e-08, 0.0003356398083269596, 0.014039527624845505, 0.059292618185281754, 0.010639136657118797, 0.015827247872948647, 0.015554527752101421, 0.0637347474694252, 0.037766970694065094, 0.03452532738447189, -0.11443455517292023, -0.023802729323506355, -0.05615649372339249, -0.033136215060949326, 0.010949349030852318, -0.04547876864671707, 0.14473162591457367, -0.035300735384225845, 0.059377893805503845, 0.05426236614584923, -0.0564529225230217, -0.03876127302646637, -0.0467894971370697, 0.017275100573897362, 0.025978131219744682, -0.02186655066907406, -0.025139490142464638, 0.017378251999616623, 0.025024743750691414, 0.029885586351156235, -0.04848901554942131, 0.02568945474922657, -0.07392037659883499, 0.07083176076412201, 0.04623589292168617, 0.015671659260988235, 0.09677823632955551, 0.008132733404636383, -0.0194777213037014, -0.04260065034031868, 0.041803039610385895, -0.14315244555473328, 0.0031993137672543526, 0.04976344853639603, -0.07223992049694061, -0.013082056306302547, -0.002281602006405592, 0.03998212516307831, -0.037464167922735214, 0.0011835130862891674, 0.04824256896972656, 0.09386367350816727, -0.0197300985455513, -0.015849526971578598, 0.07584237307310104, 0.023678826168179512, -0.1323452740907669, -0.03249850124120712, -0.005662248469889164, -0.025568347424268723, -0.01335353683680296, 0.03739101067185402, -0.009860144928097725, -0.053812846541404724, -0.0648234635591507 ] }, { "text": "# Clear gradients for next iteration\nimage.grad.data.zero_()\n\nreturn image\n\ndef deep_dream(\nmodel: DeepDreamModel,\nimage: torch.Tensor,\nlayer_name: str,\niterations: int = 20,\nlearning_rate: float = 0.01,\nshow_progress: bool = True\n) -> torch.Tensor:\n\"\"\"\nRun the Deep Dream algorithm.\n\nArgs:\nmodel: The DeepDream model wrapper\nimage: Input image tensor\nlayer_name: Which layer to dream on\niterations: Number of optimization steps\nlearning_rate: Step size\nshow_progress: Whether to print progress\n\nReturns:\nDreamed image tensor\n\"\"\"\n# Clone image and enable gradients\ndream_image = image.clone().requires_grad_(True)\n\nfor i in range(iterations):\ndream_image = deep_dream_step(model, dream_image, layer_name, learning_rate)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_55", "embedding": [ -0.010955331847071648, -0.061227526515722275, 0.02359551563858986, 0.05297383293509483, 0.005503912456333637, -0.04210846498608589, -0.05917789787054062, -0.02888205461204052, -0.048159413039684296, -0.11816587299108505, 0.004374404437839985, 0.00015208472905214876, -0.028623443096876144, -0.019653407856822014, -0.05320339277386665, 0.045054689049720764, -0.07394074648618698, 0.011204390786588192, -0.03150661289691925, -0.09798085689544678, 0.04049098119139671, -0.01839873380959034, 0.046141959726810455, 0.03208509460091591, 0.00749099301174283, 0.03864295780658722, 0.011823351494967937, -0.034418802708387375, 0.07227430492639542, 0.0011675897985696793, 0.04858434945344925, 0.002010806929320097, -0.029502402991056442, 0.038724612444639206, 0.005005823913961649, 0.06874386221170425, -0.08624400198459625, -0.03087753802537918, 0.004257969558238983, 0.02038220316171646, 0.05522865802049637, -0.03082484006881714, -0.04491233080625534, -0.030716564506292343, 0.0033153181429952383, 0.03746238723397255, 0.035979658365249634, -0.04452047124505043, 0.035348325967788696, -0.02308955416083336, -0.016002107411623, -0.040448546409606934, -0.07658572494983673, -0.019403841346502304, 0.025025418028235435, 0.02924356795847416, 0.08587070554494858, -0.018060127273201942, -0.04145742952823639, -0.09336374700069427, -0.02492377534508705, 0.0177867840975523, -0.012626639567315578, -0.05114777758717537, 0.011133527383208275, -0.030514009296894073, -0.02288084663450718, -0.009183625690639019, 0.06923174858093262, 0.003359054448083043, 0.0222708061337471, 0.07866091281175613, 0.0011525717563927174, 0.002817527623847127, 0.019400928169488907, -0.0790046975016594, 0.11179758608341217, 0.03311634808778763, 0.01883235014975071, -0.06879191845655441, 0.005859871860593557, -0.06519945710897446, 0.060565974563360214, -0.04703471437096596, 5.3200921684037894e-05, -0.06195572391152382, 0.041990019381046295, 0.0021501199807971716, 0.05728920176625252, -0.021000226959586143, 0.038561463356018066, -0.043002232909202576, -0.16120880842208862, 0.04564100131392479, 0.05230662226676941, 0.04743017628788948, 0.009015537798404694, -0.08712369203567505, -0.09103230386972427, 0.01035318523645401, -0.01492432039231062, -0.06753116101026535, 0.019903475418686867, 0.033604227006435394, 0.003241634229198098, 0.04957965761423111, 0.08025180548429489, 0.05769745633006096, -0.05397506803274155, -0.009758595377206802, 0.03261951357126236, 0.009575111791491508, 0.04625195264816284, 0.07180345803499222, 0.059601280838251114, -0.02880621887743473, -0.03800850361585617, 0.057748354971408844, -0.038218989968299866, 0.10890531539916992, -0.0022147097624838352, 0.1015867069363594, 0.03970378264784813, -0.026957670226693153, -0.11176377534866333, -0.05594547092914581, -0.04243696108460426, 3.9833598704070686e-33, 0.013021867722272873, -0.016584448516368866, 0.02120463363826275, -0.0029313634149730206, 0.051300570368766785, 0.02523166872560978, 0.026196900755167007, -0.011863159947097301, -0.09438769519329071, -0.009996282868087292, -0.07033038139343262, -0.002956627868115902, -0.06541778892278671, 0.16240623593330383, -0.02028004825115204, -0.03407016396522522, 0.00949738547205925, -0.008355808444321156, 0.054883215576410294, 0.03760218620300293, 0.08739722520112991, -0.024176517501473427, -0.040111344307661057, -0.05636255815625191, -0.08721541613340378, 0.0449572317302227, 0.014875990338623524, 0.029747173190116882, -0.06593602895736694, 0.0028659908566623926, -0.06541547179222107, -0.014729421585798264, -0.029979538172483444, -0.01891167275607586, 0.007924306206405163, 0.0019815575797110796, 0.11092698574066162, 0.004408668726682663, -0.04932355508208275, -0.09325090795755386, 0.00976769719272852, 0.049130041152238846, -0.012698346748948097, -0.045083191245794296, -0.06768642365932465, 0.003455394646152854, -0.024779360741376877, 0.09074588119983673, 0.005280280951410532, 0.020309612154960632, 0.0028832119423896074, -0.03803428262472153, -0.0873342752456665, -0.07790709286928177, -0.0232507586479187, -0.03558356687426567, 0.04786763712763786, 0.04970026761293411, 0.0918027013540268, -0.0807676836848259, 0.06275864690542221, 0.019841516390442848, 0.012582546100020409, 0.06850080192089081, -0.015575115568935871, 0.048921577632427216, -0.0018204553052783012, 0.04021510109305382, -0.0005841350648552179, -0.004229649901390076, -0.07101676613092422, 0.030238527804613113, -0.034966882318258286, -0.06481682509183884, 0.011238716542720795, -0.039094001054763794, 0.018259907141327858, -0.12895871698856354, -0.06022949516773224, 0.05255332961678505, -0.044565264135599136, 0.07132294774055481, -0.07458952069282532, -0.12807786464691162, 0.0023391786962747574, 0.061611030250787735, 0.02673301473259926, -0.01896187663078308, -0.03981161117553711, 0.00577959232032299, -0.14673781394958496, -0.05280917137861252, 0.061641283333301544, 0.011794978752732277, -0.07487800717353821, -5.4220940588105145e-33, 0.05644523724913597, 0.048428725451231, 0.0401575043797493, 0.04713651165366173, 0.0658656656742096, -0.03722861781716347, 0.07625987380743027, 0.02506549283862114, -0.004278529901057482, 0.01709568314254284, 0.037876445800065994, -0.019621390849351883, -0.05881132557988167, -0.025410301983356476, 0.06299028545618057, -0.07268396019935608, -0.02305436134338379, 0.02248016558587551, 0.006033396814018488, 0.004615165293216705, -0.0687515139579773, 0.08986863493919373, -0.1000152975320816, 0.032618287950754166, -0.139954075217247, 0.00851003173738718, 0.00688132643699646, 0.09777739644050598, 0.021383557468652725, -0.0008275685249827802, 0.06584543734788895, -0.01999911293387413, -0.06777995824813843, 0.05275159701704979, -0.007683754898607731, 0.1101580262184143, 0.05439993366599083, -0.04460667818784714, -0.032702066004276276, 0.013563282787799835, 0.09585285931825638, -0.0035332641564309597, -0.060516320168972015, 0.0395023487508297, 0.0024633649736642838, -0.01348034292459488, -0.005316044203937054, -0.024151954799890518, 0.03740527853369713, 0.006001356523483992, 0.049718402326107025, -0.050550881773233414, -0.09725715965032578, 0.0483902283012867, -0.03323264792561531, -0.024998601526021957, -0.05179920047521591, 0.014476913027465343, 0.047042716294527054, 0.02437741868197918, -0.047469865530729294, -0.026743747293949127, -0.048020366579294205, -0.04231899604201317, -0.027228670194745064, 0.03572941944003105, -0.09856065362691879, 0.05260268598794937, 0.05283111706376076, 0.07019580900669098, 0.009948519989848137, 0.10571404546499252, 0.06298264861106873, 0.082664355635643, 0.0022750364150851965, 0.013829782605171204, -0.05910312011837959, 0.0031110316049307585, 0.0831037238240242, -0.02503877319395542, -0.009782249107956886, -0.06643332540988922, -0.031424567103385925, 0.07155609875917435, 0.022732671350240707, -0.04458782821893692, 0.03791438043117523, 0.06494281440973282, 0.01413826271891594, -0.04420899599790573, 0.022306112572550774, -0.04921736195683479, 0.013448361307382584, 0.039947785437107086, 0.04264010861515999, -4.4859994829948846e-08, -0.031023429706692696, -0.030016187578439713, 0.07893845438957214, 0.018582643941044807, 0.011164749972522259, -0.013804384507238865, 0.07700066268444061, -0.012494586408138275, 0.008790167979896069, -0.05852597951889038, 0.03676338121294975, -0.03862461447715759, -0.015961315482854843, 0.03186874836683273, -0.00836776290088892, 0.10419391840696335, 0.01335094403475523, 0.034479863941669464, 0.045455507934093475, -0.09644730389118195, -0.014504442922770977, -0.04259362071752548, 0.0021686204709112644, -0.0379377081990242, -0.019587798044085503, -0.07028637081384659, 0.0076134963892400265, 0.0346587710082531, -0.05510885640978813, -0.0258342158049345, 0.06064630672335625, -0.07026927918195724, 0.06858230382204056, 0.03554875776171684, 0.033521391451358795, 0.04549840837717056, -0.00021923883468843997, 0.01551359985023737, 0.04775717109441757, 0.02835695631802082, -0.0694381445646286, 0.02321079932153225, 0.05735315382480621, -0.05803048238158226, -0.00768261356279254, -0.03407858684659004, -0.02439628355205059, -0.07792225480079651, -0.0189286507666111, 0.08912644535303116, 0.03165673092007637, 0.015853801742196083, -0.036738522350788116, 0.07356797158718109, 0.04918317496776581, -0.09116167575120926, -0.00022762021399103105, -0.028885021805763245, -0.022808894515037537, 0.022759808227419853, 0.04846038296818733, -0.0191180482506752, -0.0549447275698185, -0.04821021854877472 ] }, { "text": "for i in range(iterations):\ndream_image = deep_dream_step(model, dream_image, layer_name, learning_rate)\n\nif show_progress and (i + 1) % 5 == 0:\nprint(f\"Iteration {i + 1}/{iterations}\")\n\nreturn dream_image.detach()\n\nprint(\"Deep Dream functions defined!\")\n\nDeep Dream functions defined!\n\nDetails of Deep Dream¶\n\n1. Gradient Ascent vs Gradient Descent\n\nNormal training (Gradient Descent):\n\nGoal: minimize loss (make predictions better)\nUpdate: weights = weights - learning_rate * gradient\nWe go downhill on the loss landscape\n\nDeep Dream (Gradient Ascent):\n\nGoal: maximize activations (make patterns stronger)\nUpdate: image = image + learning_rate * gradient\nWe go uphill on the activation landscape\n\nLoss Landscape:\n\n╱╲\n╱ ╲\n╱ ╲ Descent: go DOWN to find minimum\n╱ ╲ (subtract gradient)\n╱ ↓ ╲\nminimum", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_56", "embedding": [ -0.037832651287317276, 0.005529502872377634, 0.04901609569787979, 0.03504789248108864, 0.021282829344272614, -0.03731919080018997, -0.09186435490846634, -0.0013446470256894827, 0.0001703872112557292, -0.09979347884654999, 0.014446540735661983, -0.006915476638823748, 0.054073724895715714, -0.04041507467627525, -0.04063108190894127, 0.02974245510995388, -0.07947822660207748, 0.08360270410776138, -0.055886611342430115, -0.0528964027762413, 0.0495942123234272, -0.018439052626490593, 0.0013835536083206534, 0.0532551035284996, 0.04405898600816727, 0.012985975481569767, -0.05061972141265869, 0.012190327048301697, 0.04561169818043709, 0.010428099893033504, 0.047965310513973236, -0.011343570426106453, 0.03520143777132034, 0.03676639869809151, -0.022334031760692596, 0.046027205884456635, -0.08840902894735336, -0.033301468938589096, 0.0024904010351747274, 0.03054090403020382, 0.004431615583598614, -0.0705355778336525, -0.02387045882642269, -0.05467269569635391, 0.03583689406514168, 0.05809454992413521, -0.04606284946203232, -0.09051451832056046, -0.026091190055012703, -0.007548776920884848, -0.053085364401340485, -0.017942486330866814, -0.06035895273089409, 0.0033545750193297863, 0.0580228753387928, 0.044385217130184174, 0.052811335772275925, -0.030766606330871582, -0.008728118613362312, -0.06639862805604935, 0.02922322228550911, -0.04820643737912178, -0.04145072028040886, -0.02264278195798397, 0.013369021005928516, -0.06150982901453972, -0.04817263036966324, -0.045757174491882324, 0.07342585176229477, 0.004704746417701244, -0.04016929119825363, 0.07099901139736176, 0.0037588775157928467, -0.05074436217546463, 0.05664129927754402, -0.03336590901017189, 0.10044606029987335, 0.0004494384047575295, -0.059844836592674255, -0.08600915968418121, 0.04238935559988022, 0.001569621730595827, 0.07312621176242828, -0.06595396250486374, 0.013086888007819653, -0.05190058797597885, 0.018383366987109184, 0.01622467115521431, 0.06093307211995125, -0.0005865561543032527, 0.015148826874792576, -0.04046574980020523, -0.15008048713207245, 0.004144859034568071, 0.04695986211299896, 0.03436462953686714, -0.013750113546848297, -0.14219632744789124, -0.06300295144319534, -0.0293007530272007, -0.05216313898563385, -0.0846056342124939, 0.04036916047334671, -0.06442495435476303, 0.018094368278980255, 0.025271620601415634, 0.07921043038368225, -0.000513180741108954, 0.03628561273217201, -0.029730461537837982, -0.002563074929639697, -0.022762738168239594, 0.03248946741223335, 0.04135650023818016, 0.05959402024745941, -0.02194288931787014, -0.015653003007173538, 0.014809160493314266, -0.031167158856987953, 0.0825897678732872, -0.017538638785481453, 0.030986228957772255, 0.025298498570919037, -0.038624148815870285, -0.09440626949071884, -0.05696363002061844, -0.05052638798952103, 4.4517150233410697e-33, 0.007866672240197659, -0.029497865587472916, 0.013941515237092972, 0.017194833606481552, 0.06825251132249832, -0.025748800486326218, 0.008574893698096275, -0.06271127611398697, -0.058328352868556976, 0.007916574366390705, -0.06550058722496033, 0.05313403904438019, -0.08380606770515442, 0.18329861760139465, 0.04222933575510979, -0.06869558244943619, 0.0017137646209448576, -0.0396282896399498, 0.05456480756402016, -0.007115465123206377, 0.07672503590583801, -0.00530854519456625, -0.03446429967880249, -0.060867439955472946, -0.03208037465810776, 0.04124411195516586, 0.024480847641825676, -0.0017907852306962013, -0.1116361990571022, 0.003133196383714676, -0.049637939780950546, -0.006293750833719969, -0.12383793294429779, -0.06573663651943207, 0.07565956562757492, 0.07408841699361801, 0.0603104904294014, 0.025722915306687355, -0.019931472837924957, -0.0317792147397995, -0.042283397167921066, 0.04835409298539162, -0.006767048500478268, -0.009914306923747063, -0.015333067625761032, 0.01985199749469757, 0.032965611666440964, 0.07561265677213669, 0.01939244009554386, 0.005216024350374937, -0.0082250302657485, -0.046986039727926254, -0.07707701623439789, -0.11168839037418365, 0.04249478131532669, 0.02785094827413559, 0.041751425713300705, 0.025117551907896996, 0.03907177969813347, 0.02316206879913807, 0.05357176810503006, -0.03527553007006645, -0.002073904499411583, 0.041545215994119644, -0.051495082676410675, 0.044926781207323074, -0.012754930183291435, 0.012235662899911404, 0.007634948939085007, 0.021268844604492188, -0.018941011279821396, 0.04164203628897667, 0.04600420966744423, -0.052225273102521896, 0.04232049733400345, 0.013117270544171333, 0.01824682205915451, -0.12771303951740265, -0.06488081812858582, 0.008743612095713615, -0.04257394000887871, 0.10419709980487823, -0.08748404681682587, -0.06297837942838669, 0.01843421161174774, 0.04788072034716606, 0.024638216942548752, -0.08318210393190384, -0.02772979810833931, 0.009055788628757, -0.19332490861415863, -0.04849760979413986, 0.03361118584871292, 0.004990278277546167, -0.0562717579305172, -6.144570519241155e-33, 0.03405311703681946, 0.07865802198648453, 0.021258126944303513, 0.03423866629600525, 0.0435873307287693, -0.034716300666332245, 0.06667842715978622, 0.013897726312279701, 0.004828573204576969, 0.03895188122987747, -0.026361048221588135, 0.024303026497364044, -0.08188574016094208, -0.016340676695108414, 0.05062483623623848, -0.09281451255083084, -0.02751282975077629, -0.02437746711075306, -0.014547116123139858, 0.02112363651394844, -0.045988135039806366, 0.13833551108837128, -0.1204160526394844, 0.010250627063214779, -0.06086098402738571, 0.0009624030208215117, 0.0203599501401186, 0.13606224954128265, 0.03733769804239273, -0.0292903371155262, -0.006677729077637196, -0.029095953330397606, -0.03159473463892937, 0.0439210869371891, 0.019136156886816025, 0.09080848097801208, 0.005130349192768335, -0.09505206346511841, -0.05000448599457741, 0.017049450427293777, 0.07371003925800323, -0.010391177609562874, 0.030832448974251747, -0.024258218705654144, 0.03249755874276161, 0.007452369201928377, -0.004715597257018089, -0.029215240851044655, 0.004153452347964048, -0.004093872848898172, 0.03582368791103363, -0.04302026331424713, -0.15641984343528748, 0.0703151598572731, -0.04542948678135872, 0.010585067793726921, -0.010494810529053211, -0.006099422927945852, 0.05119858309626579, 0.002598016057163477, -0.0489230714738369, 0.016462335363030434, -0.033678315579891205, 0.037570685148239136, -0.04971671476960182, 0.037137631326913834, -0.08999748528003693, 0.002693257061764598, 0.013561618514358997, 0.08411672711372375, -0.002383031416684389, 0.033503059297800064, 0.0882282480597496, 0.04899801313877106, -0.018098412081599236, -0.06071431562304497, -0.08208013325929642, -0.01970691978931427, 0.06432332843542099, -0.038616739213466644, -0.005363296717405319, -0.04334023967385292, -0.019286643713712692, 0.0817798376083374, -0.01017542090266943, 0.021033557131886482, 0.016890190541744232, 0.03953593224287033, 0.02443498559296131, -0.042952343821525574, 0.03065733052790165, -0.019244195893406868, 0.01475208718329668, 0.019278457388281822, 0.014307912439107895, -4.5880526045039005e-08, -0.058597974479198456, -0.01922847330570221, 0.08853412419557571, -0.0015625577652826905, 0.06541899591684341, 0.01597375050187111, 0.07042137533426285, -0.0013387275394052267, -0.011631060391664505, -0.05000295862555504, 0.07560370117425919, -0.013835565187036991, -0.02374710701406002, -0.0018085272749885917, 0.008299659937620163, 0.11331325769424438, 0.05165541544556618, 0.027768298983573914, 0.041521091014146805, -0.0484885647892952, -0.022101912647485733, 0.04531995952129364, 0.0007604163838550448, -0.044280800968408585, -0.013408025726675987, -0.06783393025398254, -0.04961381480097771, 0.04540310800075531, -0.019941681995987892, -0.04728572443127632, 0.09000879526138306, 0.0072567034512758255, 0.10004081577062607, 0.05369918420910835, 0.013215424492955208, 0.08685483038425446, -0.023502063006162643, 0.05053342506289482, 0.03540346026420593, 0.04715964198112488, -0.02539197728037834, 0.008708682842552662, 0.06287019699811935, -0.04669163003563881, -0.02326601929962635, 0.010410463437438011, 0.013113983906805515, -0.09561075270175934, 0.022809434682130814, 0.04149362072348595, -0.00788702629506588, 0.004474671557545662, -0.015530906617641449, 0.10669724643230438, 0.044468533247709274, -0.07028728723526001, -0.012451543472707272, -0.06501992046833038, -0.02610800601541996, 0.056097611784935, 0.008503910154104233, 0.003427468938753009, -0.006103715393692255, -0.04115516319870949 ] }, { "text": "Loss Landscape:\n\n╱╲\n╱ ╲\n╱ ╲ Descent: go DOWN to find minimum\n╱ ╲ (subtract gradient)\n╱ ↓ ╲\nminimum\n\nActivation Landscape:\n\nmaximum\n↑ Ascent: go UP to find maximum\n╱ ↑ ╲ (add gradient)\n╱ ╲\n╱ ╲\n\n2. Gradient Normalization\n\nIn normal training:\n\nWe don't usually normalize gradients this way. We just use them directly (or with optimizers like Adam that do their own scaling).\n\nIn Deep Dream:\n\n# Normalize gradients (helps stabilize the process)\ngrad = image.grad.data\ngrad = grad / (grad.std() + 1e-8) # Normalize by standard deviation\n\nWe normalize because:\n\nGradients can vary wildly in magnitude across different images/layers\nWithout normalization, some iterations might make huge changes, others tiny\nDividing by std() makes each step roughly the same size\n\n3. Image.grad?", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_57", "embedding": [ 0.0018606814555823803, -0.03011118248105049, 0.085961252450943, -0.007186786271631718, 0.022435486316680908, -0.022201446816325188, -0.07235986739397049, 0.03232785686850548, 0.014690387062728405, -0.022137051448225975, -0.03204025328159332, 0.01825683005154133, 0.0156985092908144, -0.017695652320981026, -0.037687789648771286, -0.007405431941151619, -0.07379929721355438, 0.18456889688968658, -0.12513603270053864, -0.045798107981681824, 0.03198516368865967, 0.027363009750843048, -0.027673745527863503, 0.018671797588467598, 0.052290819585323334, 0.026255743578076363, 0.03338893502950668, -0.025001849979162216, 0.06709827482700348, -0.011268104426562786, 0.06904558837413788, -0.007977740839123726, 0.055397577583789825, 0.0562811978161335, -0.07845292240381241, 0.04838349670171738, -0.06591058522462845, -0.0017050126334652305, 0.006655614823102951, -0.005225814413279295, 0.006050388794392347, -0.0016616476932540536, -0.005860873032361269, -0.01957734487950802, -0.00239468552172184, 0.012866171076893806, -0.03895144537091255, -0.10715078562498093, 0.035349201411008835, -0.023631859570741653, 0.025751158595085144, -0.03202119842171669, -0.10193251073360443, 0.022931287065148354, 0.01765209250152111, 0.10848034173250198, 0.0391404926776886, -0.036248598247766495, -0.04351656883955002, -0.004039067309349775, 0.025017250329256058, -0.07519391924142838, -0.005996187683194876, -0.03802606835961342, 0.0333646759390831, -0.06059552729129791, 0.05533049628138542, -0.10373147577047348, 0.08005072176456451, -0.008502298034727573, -0.019604139029979706, 0.0861489549279213, 0.016371751204133034, -0.04164143279194832, 0.02001834660768509, 0.004321351181715727, 0.04732930287718773, 0.04857802018523216, -0.0188741572201252, -0.07531050592660904, 0.03716997802257538, 0.06852475553750992, 0.059070851653814316, -0.011234020814299583, 0.06617163121700287, 0.023225853219628334, -0.04507600516080856, -0.03361450135707855, 0.03821953013539314, 0.026377268135547638, -0.008915627375245094, 0.011881670914590359, -0.14633698761463165, 0.02784709259867668, 0.020869290456175804, 0.0096284756436944, -0.041854243725538254, -0.1380467414855957, -0.05063103139400482, 0.007204433903098106, 0.01662987656891346, -0.011142677627503872, 0.048823658376932144, 0.009452945552766323, 0.04867444932460785, 0.02847348339855671, 0.09345081448554993, -0.00746613135561347, 0.012475562281906605, 0.00602414645254612, 0.026648512110114098, -0.004310199990868568, 0.008190563879907131, 0.03189685940742493, 0.04362943768501282, 0.01390074286609888, 0.000905910914298147, -3.709854354383424e-05, -0.05847451090812683, 0.020338980481028557, -0.11218662559986115, 0.03985058143734932, -0.06591173261404037, -0.034850407391786575, -0.06621205061674118, 0.04012405872344971, -0.0052445027977228165, 7.099596496462907e-33, 0.0010230026673525572, 0.021962951868772507, -0.002424706006422639, 0.038684189319610596, -0.041269510984420776, 0.014964134432375431, -0.054866958409547806, -0.05962992459535599, -0.029362723231315613, 0.0014397760387510061, -0.01022765226662159, 0.04342818260192871, -0.08528254181146622, 0.16428017616271973, 0.013983986340463161, -0.03662298619747162, -0.01962590403854847, -0.010857084766030312, 0.07872564345598221, -0.026936672627925873, 0.060703206807374954, -0.02497919648885727, -0.008211612701416016, 0.01400806475430727, -0.033654361963272095, -0.03786483779549599, 0.020407186821103096, 0.004514581058174372, -0.09052897244691849, -0.03248748183250427, -0.06623818725347519, -0.05663853883743286, -0.06898309290409088, -0.0363188274204731, 0.03984874114394188, 0.05773327872157097, 0.07762161642313004, 0.03111795149743557, -0.009592995047569275, -0.024645540863275528, -0.04598038271069527, 0.10963933169841766, 0.04207569733262062, -0.029047003015875816, -0.0181693397462368, 0.03270851448178291, 0.036725811660289764, -0.009989866055548191, 0.03492116928100586, -0.04653191938996315, -0.018527762964367867, -0.022318124771118164, 0.012330899015069008, -0.05501745641231537, 0.06443803757429123, 0.014805897139012814, 0.08989028632640839, -0.011268150992691517, 0.05632077157497406, -0.01653018221259117, 0.052804045379161835, -0.034338027238845825, 0.011993944644927979, 0.09249185025691986, 0.008027981035411358, 0.02078513242304325, -0.040083516389131546, 0.010349723510444164, -0.08748899400234222, 0.03577268496155739, -0.00826809648424387, 0.05894807353615761, 0.017310116440057755, -0.041885845363140106, 0.006306423805654049, -0.002264073584228754, 0.023815544322133064, -0.07328717410564423, -0.002651661168783903, -0.03667297586798668, -0.10701737552881241, 0.1469331681728363, -0.11542019248008728, -0.06317110359668732, -0.0664023607969284, 0.02747443877160549, 0.030716780573129654, -0.09175707399845123, -0.007974833250045776, -0.00579459173604846, -0.10461440682411194, -0.010380185209214687, 0.019391417503356934, 0.049271583557128906, -0.053158245980739594, -7.414596656388632e-33, -0.06848038733005524, 0.08090222626924515, -0.08275441825389862, 0.057415034621953964, 0.001873399829491973, 0.02431655302643776, 0.0262917373329401, 0.03675103932619095, -0.0607377327978611, -0.05927882343530655, 0.007332419045269489, 0.037921447306871414, -0.048818331211805344, -0.053571056574583054, 0.02676454558968544, -0.046423185616731644, 0.026432549580931664, 0.011078748852014542, -0.04012973979115486, -0.08230715990066528, 0.06594236195087433, 0.1518166959285736, -0.09209685027599335, 0.03719612956047058, 0.02670222520828247, -0.024120140820741653, -0.06726215034723282, 0.15582342445850372, -0.03230196237564087, -0.018590904772281647, -0.010508394800126553, -0.01186539139598608, -0.022896239534020424, 0.053398992866277695, -0.03554249554872513, 0.04539201408624649, -0.05070219561457634, -0.013243796303868294, -0.01608426496386528, -0.01372882816940546, 0.004979962483048439, 0.023433014750480652, 0.04012275114655495, -0.023878982290625572, 0.047045301645994186, 0.00989911612123251, -0.04366731271147728, -0.09916527569293976, -0.0018150841351598501, 0.00927733164280653, 0.01770188845694065, -0.01864592172205448, -0.09300403296947479, 0.028416479006409645, -0.012720846571028233, 0.04757815971970558, -0.017153339460492134, -0.007025058381259441, 0.06674312055110931, 0.01121571660041809, -0.03917160630226135, -0.014062093570828438, -0.05397653207182884, 0.00834100041538477, -0.13532327115535736, 0.06406540423631668, -0.015619173645973206, 0.0162703525274992, 0.0013311447110027075, 0.08915926516056061, -0.00814017467200756, 0.047034475952386856, 0.04118766635656357, 0.025396520271897316, -0.011521846987307072, -0.11258058249950409, 0.013378800824284554, -0.006693343166261911, 0.004591113887727261, -0.06658310443162918, 0.04046884551644325, -0.038625530898571014, 0.030284468084573746, 0.039014168083667755, 0.06651701033115387, 0.03605942055583, -0.011176117695868015, -0.010198782198131084, 0.04297256842255592, 0.026607461273670197, -0.023694045841693878, -0.06727799028158188, -0.06480371952056885, -0.07546620070934296, -0.006514898966997862, -5.1188099092769335e-08, -0.0961376279592514, 0.05031697452068329, 0.059479452669620514, 0.0018586881924420595, 0.026163026690483093, -0.04829398915171623, 0.034535616636276245, 0.05287995561957359, 0.03300884738564491, -0.003580754855647683, -0.012229252606630325, -0.0861801877617836, -0.07235182821750641, 0.026690974831581116, 0.02400689385831356, 0.16577984392642975, -0.006730322260409594, 0.06656341999769211, 0.01636364683508873, -0.03929080814123154, -0.08071209490299225, 0.019510360434651375, -0.030982229858636856, 0.01173480972647667, 0.03164859861135483, -0.04954162985086441, 0.012009425088763237, 0.01122109405696392, 0.010460896417498589, -0.022741032764315605, 0.044327326118946075, -0.0038472050800919533, 0.09031638503074646, 0.040492139756679535, -0.01156727597117424, 0.10668390989303589, -0.004626844543963671, 0.025795068591833115, -0.003876776434481144, 0.01338452659547329, -0.08200562000274658, -0.018057333305478096, 0.06026122719049454, -0.05544280260801315, -0.04430179297924042, 0.008252025581896305, 0.05563006177544594, -0.0013659787364304066, -0.009191679768264294, 0.04601702839136124, 0.08113868534564972, 0.008884859271347523, 0.009595345705747604, 0.10913179069757462, 0.03739093244075775, -0.05232006311416626, -0.014181735925376415, -0.03465639054775238, -0.010691452771425247, -0.013573233038187027, 0.011516458354890347, -0.030375948175787926, -0.07740232348442078, -0.0359569750726223 ] }, { "text": "3. Image.grad?\n\n# Before backward():\nimage.data = [[0.5, 0.3], [0.8, 0.2]] # pixel values\nimage.grad = None # no gradients yet\n\n# After loss.backward():\nimage.data = [[0.5, 0.3], [0.8, 0.2]] # unchanged\nimage.grad = [[0.02, -0.01], [0.05, 0.03]] # now populated!\n\n# After gradient ascent update:\nimage.data = [[0.52, 0.29], [0.85, 0.23]] # modified!\nimage.grad = [[0.02, -0.01], [0.05, 0.03]] # still there\n\n# After zero_():\nimage.data = [[0.52, 0.29], [0.85, 0.23]] # unchanged\nimage.grad = [[0.0, 0.0], [0.0, 0.0]] # cleared for next iteration\n\n6. Let's Dream!¶\n\nNow let's try it out. We'll use a sample image and see what different layers produce.\n\nIn [7]:\n\n# Sky with clouds (patterns emerge beautifully)\nsample_url = \"https://images.unsplash.com/photo-1534088568595-a066f410bcda?w=600\"", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_58", "embedding": [ -0.05953272059559822, -0.052043408155441284, 0.06954450160264969, 0.03005996160209179, 0.035979948937892914, -0.07490779459476471, 0.032434139400720596, -0.04990599676966667, 0.01875424198806286, -0.03708430379629135, -0.015229864977300167, 0.0446774959564209, 0.037382323294878006, -0.05203612521290779, -0.04594455286860466, 0.05483192205429077, -0.1499563455581665, 0.01756402850151062, -0.009501087479293346, -0.05975700169801712, -0.07409743964672089, 0.005966292694211006, -0.029851630330085754, -2.184228469559457e-05, 0.021525098010897636, 0.11470114439725876, 0.03900320827960968, -0.007860241457819939, -0.0070901233702898026, -0.032763682305812836, 0.013214590959250927, 0.0127329146489501, 0.006185860373079777, 0.015531636774539948, -0.08885260671377182, 0.13981817662715912, -0.035521894693374634, 0.12620677053928375, -0.009716548956930637, 0.07577193528413773, -0.0037134154699742794, 0.008939447812736034, 0.05526934564113617, -0.0698881670832634, 0.05134041979908943, 0.018178440630435944, 0.007656087167561054, -0.10182569921016693, 0.009275049902498722, -0.026045428588986397, 0.05189123749732971, -0.05022801458835602, -0.1153392642736435, -0.05607595294713974, -0.0017575182719156146, 0.08234687149524689, 0.11003587394952774, -0.004421452060341835, -0.030414670705795288, -0.0022496774327009916, 0.010425718501210213, 0.000337251607561484, 0.0044837952591478825, -0.023611562326550484, 0.07946549355983734, -0.055103328078985214, -0.0066735814325511456, -0.09262670576572418, 0.07619686424732208, 0.049182452261447906, -0.02483373135328293, 0.05996238812804222, 0.028553379699587822, -0.06157814338803291, -0.06408174335956573, -0.03642526641488075, 0.11094725877046585, 0.031814802438020706, 0.06257802993059158, -0.07162655144929886, 0.01755814626812935, -0.03824245557188988, -0.020802855491638184, -0.020345104858279228, -0.017614636570215225, -0.03731715306639671, 0.015259524807333946, -0.007269175723195076, 0.053759753704071045, -0.0005877031362615526, 0.00809321366250515, 0.023450065404176712, -0.10788658261299133, 0.11987308412790298, 0.029682589694857597, 0.07035799324512482, 0.02819945104420185, -0.07099582254886627, -0.009792775847017765, 0.06859972327947617, -0.010647136718034744, -0.05687907338142395, -0.04433610662817955, 0.1009727343916893, 0.0904666855931282, 0.020808657631278038, 0.08251209557056427, 0.025570137426257133, -0.016333768144249916, -0.0007897895411588252, -0.011080745607614517, -0.013566894456744194, 0.04211805760860443, 0.06850103288888931, 0.002742274897173047, -0.04257393255829811, 0.025885621085762978, 0.031722117215394974, -0.052829284220933914, 0.07670895755290985, 0.012786809355020523, 0.054711781442165375, 0.00930517166852951, -0.05749650299549103, -0.08895683288574219, -0.0500330924987793, 0.010158129967749119, 3.1415726504339485e-35, 0.010496574454009533, -0.05394027382135391, 0.017115306109189987, -0.0121417585760355, 0.033601924777030945, 0.04472809284925461, 0.012647896073758602, -0.031172189861536026, -0.0699012354016304, -0.00428016809746623, -0.04594489559531212, 0.029453299939632416, -0.1346975415945053, 0.12362753599882126, 0.03513326495885849, -0.034146759659051895, 0.028026718646287918, 0.008275704458355904, 0.03242417797446251, -0.04112778976559639, 0.0616421103477478, -0.07305964827537537, -0.08043128252029419, -0.05695505440235138, -0.0651027113199234, 0.007150308694690466, 0.04267055168747902, 0.010909791104495525, -0.045932587236166, -0.032037973403930664, -0.07022133469581604, 0.013625755906105042, -0.03062671236693859, -0.02279551327228546, -0.026809049770236015, 0.012453906238079071, 0.05013390630483627, 0.056645724922418594, 0.01563134789466858, 0.012385956011712551, 0.011682246811687946, 0.06253836303949356, -0.006044264417141676, -0.06363445520401001, -0.015671828761696815, 0.004512207582592964, 0.02330498956143856, 0.07060878723859787, 0.01177680492401123, -0.014723315834999084, 0.004306476097553968, -0.025717707350850105, -0.08157642185688019, -0.04389481246471405, -0.07308485358953476, -0.01815889962017536, 0.012068127281963825, 0.048588670790195465, 0.05827965587377548, -0.03430517762899399, 0.06291301548480988, 0.06376221776008606, 0.001847113249823451, 0.03138751909136772, -0.02151337079703808, 0.03746909275650978, 0.0261225625872612, 0.04420410096645355, -0.0495307482779026, 0.052921146154403687, -0.04058772698044777, 0.025446811690926552, -0.016025764867663383, -0.06878737360239029, 0.006045203655958176, 0.01810583285987377, -0.0075872112065553665, -0.09377937763929367, -0.026188623160123825, -0.036233458667993546, -0.022151069715619087, 0.03641222044825554, -0.07931187748908997, -0.07313719391822815, 0.011435960419476032, 0.045284248888492584, 0.031201817095279694, -0.07538414746522903, -0.06774896383285522, -0.02777591533958912, -0.16248460114002228, -0.004005520138889551, 0.01577407866716385, 0.029123742133378983, -0.05829712375998497, -6.0081614711614325e-34, 0.05045676976442337, 0.07467592507600784, 0.013096580281853676, 0.04712342843413353, 0.05334785208106041, 0.025651982054114342, 0.07204373925924301, 0.038489874452352524, 0.0035342981573194265, 0.020036937668919563, -0.029556840658187866, 0.037499990314245224, -0.03602923825383186, -0.025003449991345406, -0.005985455121845007, -0.0360744372010231, -0.025896433740854263, -0.02191636711359024, -0.08465036004781723, -0.02545120380818844, -0.008971831761300564, 0.12861505150794983, -0.09636181592941284, 0.03796326369047165, -0.07056963443756104, 0.03237909823656082, 0.03346170112490654, 0.13029000163078308, -0.055331237614154816, -0.015554063022136688, 0.00046590660349465907, -0.008121292106807232, 0.015897473320364952, 0.024726388975977898, 0.028127869591116905, 0.053354572504758835, 0.04833591356873512, -0.04961903765797615, -0.05734783411026001, 0.01983659528195858, 0.04630427807569504, 0.016631562262773514, 0.0031586994882673025, -0.00039095591637305915, 0.05551711097359657, -0.013570406474173069, 0.015383419580757618, 0.02063572406768799, -0.00826379843056202, 0.022185716778039932, -0.017488008365035057, -0.039101146161556244, -0.08105675131082535, 0.05494476854801178, 0.004107311833649874, 0.004364378750324249, -0.041967593133449554, -0.012879636138677597, 0.09731797873973846, -0.013069002889096737, -0.06609290093183517, -0.047461967915296555, 0.0071376836858689785, -0.03630621358752251, -0.017233766615390778, 0.08362056314945221, -0.061748165637254715, -0.0031101880595088005, 0.0008226240170188248, 0.09316843748092651, 0.046506959944963455, 0.07048371434211731, 0.029284777119755745, -0.06070706993341446, 0.042251087725162506, -0.0656646341085434, 0.028085652738809586, 0.0005862476537004113, 0.06374944746494293, -0.03478492051362991, 0.008026140742003918, -0.017599809914827347, 0.023509347811341286, 0.09765731543302536, 0.023612385615706444, 0.01931220106780529, -0.0238554198294878, 0.05454319715499878, 0.07546721398830414, -0.025746995583176613, -0.05091746523976326, -0.04153362289071083, 0.0378061942756176, -0.016302792355418205, -0.02410314977169037, -5.3091341101207945e-08, -0.0358586423099041, -0.028188655152916908, 0.048760782927274704, 0.06943555176258087, -0.006651599425822496, -0.03265214338898659, 0.003868309548124671, 0.00806385837495327, 0.056164566427469254, -0.16748632490634918, 0.06967431306838989, -0.04035750404000282, -0.008118364959955215, 0.0528690330684185, -0.026431582868099213, 0.05470864102244377, -0.0047269780188798904, 0.0018519886070862412, 0.03225814551115036, -0.022823676466941833, -0.07688279449939728, 0.0046456726267933846, -0.05108129605650902, 0.006806228309869766, 0.03454851359128952, -0.04496463015675545, 0.059568148106336594, -0.02968394011259079, 0.040019284933805466, 0.007491745054721832, 0.01621839962899685, -0.03660038113594055, 0.11727724224328995, 0.11664241552352905, 0.034901779145002365, 0.052940305322408676, 0.050289738923311234, 0.00391789898276329, -0.0355941504240036, 0.008404012769460678, -0.09639760106801987, -0.006130889989435673, 0.055295854806900024, -0.040958747267723083, 0.004729378502815962, -0.029933514073491096, -0.02165353111922741, -0.04140497371554375, 0.01931782253086567, 0.0023348373360931873, 0.04522427171468735, 0.004807998426258564, -0.026318414136767387, 0.08826196938753128, 0.09726019203662872, -0.09320251643657684, -0.06274362653493881, -0.030521733686327934, -0.04146603122353554, 0.013637199997901917, 0.0160630252212286, -0.08528733253479004, -0.04774554818868637, -0.05210498720407486 ] }, { "text": "In [7]:\n\n# Sky with clouds (patterns emerge beautifully)\nsample_url = \"https://images.unsplash.com/photo-1534088568595-a066f410bcda?w=600\"\n\noriginal_image = load_image(sample_url, max_size=400)\nshow_image(original_image, \"Original Image\")\n\nIn [8]:\n\n# Dream on an early layer (edges and simple patterns)\nearly_dream = deep_dream(\nmodel,\noriginal_image,\nlayer_name='Mixed_5b', # Early-mid layer\niterations=30,\nlearning_rate=0.01\n)\nshow_image(early_dream, \"Deep Dream - Mixed_5b (Early Layer: Textures & Patterns)\")\n\nIteration 5/30\nIteration 10/30\nIteration 15/30\nIteration 20/30\nIteration 25/30\nIteration 30/30\n\nIn [9]:", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_59", "embedding": [ -0.05611248314380646, 0.012866975739598274, 0.12111543118953705, 0.031631216406822205, 0.0388542003929615, -0.07345441728830338, -0.07046689093112946, -0.031155914068222046, -0.012569787912070751, -0.06439083069562912, -0.008047911338508129, -0.042105574160814285, -0.010114781558513641, -0.0410778634250164, -0.03299377113580704, 0.06263755261898041, -0.07086939364671707, 0.0024412828497588634, -0.05977090820670128, -0.04729921743273735, 0.03855385258793831, 0.015649965032935143, -0.001006494858302176, -0.03273269906640053, 0.054433222860097885, 0.0650053545832634, -0.021134573966264725, 0.05392127111554146, 0.114387147128582, -0.03788347542285919, 0.08376282453536987, 0.08485594391822815, 0.006197297479957342, 0.06250092387199402, 0.03250933438539505, 0.0731259360909462, -0.07146638631820679, -0.049258142709732056, 0.016578083857893944, 0.03478771075606346, 0.07939242571592331, -0.036315932869911194, -0.013344157487154007, -0.012571698985993862, -0.00846207607537508, 0.035000283271074295, -0.016775736585259438, -0.03763657063245773, 0.013644949533045292, -0.026898078620433807, -0.09179198741912842, -0.0636071115732193, -0.08116363734006882, 0.0007018359610810876, 0.02465529553592205, 0.013000980950891972, 0.005044905468821526, -0.012820601463317871, 0.03179650753736496, -0.06745186448097229, 0.024800637736916542, -0.011116593144834042, -0.05649520456790924, 0.007966031320393085, 0.044468775391578674, 0.013789959251880646, -0.050645433366298676, 0.016286810860037804, 0.13890859484672546, -0.026443155482411385, -0.011576751247048378, 0.06666973978281021, -0.008217182010412216, -0.005132728721946478, 0.024216800928115845, 0.01572398841381073, 0.009062071330845356, -0.04739827290177345, -0.037008486688137054, -0.10438234359025955, 0.004935733042657375, -0.027142683044075966, 0.020211096853017807, -0.01365926768630743, 0.029797518625855446, -0.014203890226781368, -0.008451865054666996, 0.015363882295787334, -0.011197391897439957, -0.03742688149213791, 0.018663471564650536, -0.02939094789326191, -0.15911883115768433, -0.002986377105116844, 0.01933903433382511, 0.07693586498498917, 0.07086131721735, -0.14249125123023987, -0.023211484774947166, 0.02498168870806694, 0.003446455579251051, -0.08688734471797943, 0.058061372488737106, 0.03383482247591019, 0.009514888748526573, 0.003639754606410861, 0.04675200954079628, 0.054347846657037735, -0.022615671157836914, -0.0252662505954504, -0.04730981960892677, -0.039150040596723557, 0.0033341303933411837, -0.0023976629599928856, 0.037573330104351044, -0.0666021779179573, -0.03637352213263512, 0.010409161448478699, -0.028420699760317802, 0.08254550397396088, 0.017868271097540855, 0.026637833565473557, 0.011675267480313778, -0.07613004744052887, -0.12240225821733475, -0.03780505061149597, -0.08747561275959015, 5.6523616471930924e-33, 0.08351508527994156, -0.030587518587708473, 0.014025149866938591, 0.0001803184422897175, 0.10124929994344711, -0.02210424840450287, 0.018663251772522926, -0.025647055357694626, -0.07838813960552216, 0.06085842847824097, -0.09439487010240555, 0.003855495946481824, -0.08167123049497604, 0.12908759713172913, 0.03243207931518555, -0.051090579479932785, -0.06740790605545044, -0.0034580521751195192, 0.03213653340935707, 0.07987386733293533, -0.028502900153398514, 0.02492082305252552, -0.030864901840686798, -0.0918101817369461, -0.10194174945354462, 0.06186547130346298, 0.0572255477309227, 0.023040801286697388, 0.02007625810801983, 0.016985923051834106, 0.0004915532190352678, 0.043727386742830276, -0.03156007453799248, -0.022713780403137207, 0.03466196358203888, 0.07881268858909607, 0.08821704983711243, 0.04702676832675934, -0.03177967295050621, -0.04831892251968384, 0.053891826421022415, 0.06070448085665703, 0.0033059902489185333, -0.01799873821437359, -0.040703997015953064, -0.022355733439326286, 0.028064090758562088, 0.017609504982829094, 0.003129588672891259, 0.025324594229459763, 0.019290992990136147, -0.050717245787382126, -0.058392465114593506, -0.07337556034326553, -0.010040707886219025, -0.014875734224915504, 0.04391760751605034, 0.008220839314162731, 0.049036938697099686, 0.0510968342423439, 0.0724158063530922, -0.02744605392217636, -2.65331327682361e-05, 0.035882651805877686, -0.008741333149373531, 0.03342573344707489, 0.031561002135276794, 0.04676968231797218, -0.03582237288355827, 0.02711404301226139, -0.014804909005761147, 0.05202270671725273, -0.009127487428486347, -0.10618771612644196, 0.06944004446268082, -0.03839535638689995, -0.015482885763049126, -0.017254045233130455, -0.10248927772045135, 0.061747390776872635, -0.006201955024152994, 0.09179959446191788, -0.04102056846022606, -0.09315034747123718, -0.07514980435371399, 0.06469330191612244, 0.061808910220861435, -0.028500942513346672, -0.09801503270864487, -0.025835180655121803, -0.0747004896402359, -0.07861263304948807, 0.11216793954372406, -0.06270596385002136, -0.06276661157608032, -5.354987290373978e-33, 0.033225733786821365, 0.02628611959517002, 0.03461771085858345, 0.07881293445825577, 0.059553440660238266, -0.03415235877037048, 0.0679045021533966, 0.07732366770505905, -0.018511662259697914, 0.05437306687235832, 0.06303117424249649, 0.04705362766981125, -0.0035968145821243525, -0.06390668451786041, -0.00748771708458662, -0.11563532054424286, -0.00785927101969719, -0.02565310150384903, 0.0003228606656193733, 0.02570262737572193, -0.005819594021886587, 0.05667535960674286, -0.08228591829538345, 0.01862788386642933, -0.06377016752958298, 0.03572384640574455, 0.03997588902711868, 0.06232834979891777, 0.022300563752651215, -0.012292576022446156, -0.027226869016885757, -0.051300857216119766, -0.03171670064330101, 0.03179832920432091, -0.028486711904406548, 0.09388834238052368, 0.026908066123723984, -0.05019613727927208, -0.07980768382549286, -0.04335452988743782, 0.029167816042900085, -0.02883715182542801, -0.0848480761051178, -0.016173293814063072, 0.009809503331780434, -0.01484343409538269, 0.02121931128203869, 0.0195663720369339, 0.02966100350022316, 0.03179066255688667, 0.05050068721175194, -0.0004655553202610463, -0.09373859316110611, 0.034672558307647705, 0.018848374485969543, 0.009061877615749836, -0.017772886902093887, 0.02920933999121189, 0.003588590770959854, 0.015946142375469208, -0.0443287193775177, -0.040963370352983475, -0.09594900161027908, -0.06708045303821564, 0.021000904962420464, 0.02867138758301735, -0.13681776821613312, -0.01694401167333126, -0.03286982327699661, 0.061373207718133926, -0.04508182033896446, 0.023979023098945618, 0.010211296379566193, 0.030354153364896774, 0.07846827805042267, -0.057354848831892014, -0.05819511041045189, 0.03318803384900093, 0.07626371085643768, 0.018086226657032967, -0.125031977891922, -0.044459760189056396, -0.027035094797611237, 0.13920873403549194, 0.039850689470767975, 0.016120009124279022, -0.005676062311977148, 0.029230831190943718, 0.02061217650771141, 0.010445457883179188, -0.018144235014915466, 0.014727533794939518, -0.006830612197518349, 0.11190326511859894, 0.024033889174461365, -5.4756220890794793e-08, -0.025436200201511383, -0.05776076018810272, 0.12100114673376083, -0.011120239272713661, 0.05251027271151543, 0.02552827075123787, 0.07267972826957703, 0.0176775511354208, -0.02150622569024563, -0.04216162487864494, 0.03828630596399307, -0.024057462811470032, -0.06683249771595001, 0.026864653453230858, -0.00547663914039731, 0.030824946239590645, 0.017148081213235855, 0.02908678725361824, -0.008183415047824383, -0.05751807242631912, -0.028046701103448868, 0.03133489936590195, 0.03077715076506138, -0.0822400376200676, -0.0002642731706146151, -0.022952347993850708, -0.03345184028148651, 0.02163020707666874, -0.07335719466209412, -0.01927489973604679, 0.045074380934238434, -0.044256605207920074, 0.0718417689204216, -0.05596928671002388, -0.02483559586107731, 0.0653938353061676, -0.04678991064429283, 0.04820393770933151, -0.0020636385306715965, -0.0010706494795158505, 0.0067577357403934, 0.018709957599639893, 0.04514886066317558, -0.02394212782382965, 0.03856700286269188, 0.014758113771677017, 0.022208502516150475, -0.06059136241674423, 0.003573428373783827, 0.08373786509037018, 0.020322270691394806, -0.011511786840856075, -0.05852308124303818, 0.06775413453578949, 0.04960774630308151, -0.09141214936971664, 0.024272073060274124, -0.049359265714883804, -0.010639525018632412, 0.06866596639156342, 0.04158712923526764, 0.02014312334358692, -0.045470692217350006, 0.027001269161701202 ] }, { "text": "Iteration 5/30\nIteration 10/30\nIteration 15/30\nIteration 20/30\nIteration 25/30\nIteration 30/30\n\nIn [9]:\n\n# Dream on a deeper layer (object parts and complex features)\ndeep_dream_result = deep_dream(\nmodel,\noriginal_image,\nlayer_name='Mixed_6c', # Deeper layer\niterations=30,\nlearning_rate=0.01\n)\nshow_image(deep_dream_result, \"Deep Dream - Mixed_6c (Deep Layer: Object Parts)\")\n\nIteration 5/30\nIteration 10/30\nIteration 15/30\nIteration 20/30\nIteration 25/30\nIteration 30/30\n\nIn [10]:\n\n# Dream on the deepest layer (full objects - eyes, faces, animals)\ndeepest_dream = deep_dream(\nmodel,\noriginal_image,\nlayer_name='Mixed_7c', # Deepest layer\niterations=30,\nlearning_rate=0.01\n)\nshow_image(deepest_dream, \"Deep Dream - Mixed_7c (Deepest Layer: Complex Objects)\")", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_60", "embedding": [ -0.011436390690505505, -0.009701824747025967, 0.11788862198591232, 0.04921601712703705, 0.04599898308515549, -0.09033907204866409, -0.0709206834435463, -0.014092275872826576, 0.0028325975872576237, -0.09833797812461853, -0.007596303708851337, -0.11994380503892899, -0.017753299325704575, 0.0038826405070722103, -0.031203169375658035, 0.018345672637224197, -0.059733618050813675, 0.08261256664991379, -0.09412576258182526, -0.03719213977456093, 0.049906108528375626, 0.008455178700387478, 0.015468371100723743, -0.023395828902721405, 0.029619932174682617, 0.05275248736143112, -0.018857665359973907, 0.041889891028404236, 0.07756011933088303, -0.07112959027290344, 0.031716492027044296, 0.04499843344092369, 0.017352934926748276, 0.06749268621206284, -0.013228699564933777, 0.06043553352355957, -0.08675660938024521, -0.046321429312229156, 0.03428899124264717, 0.015796776860952377, 0.025180669501423836, 0.026991544291377068, 0.013316628523170948, -0.01953880488872528, 0.016964241862297058, 0.05210641399025917, -0.07955662906169891, -0.08611215651035309, 0.02498495578765869, -0.0426357239484787, -0.1211148127913475, -0.02274933271110058, -0.08819661289453506, 0.013761240988969803, 0.04832826182246208, 0.024934327229857445, -0.014267662540078163, -0.06106717884540558, -0.0006810255581513047, -0.039219655096530914, 0.053087275475263596, -0.01274512056261301, 0.026841778308153152, 0.006252497434616089, 0.028707528486847878, -0.0632978305220604, -0.05573565885424614, 0.00885073933750391, 0.06923318654298782, 0.006155861541628838, 0.010293683037161827, 0.06255821138620377, -0.010114395059645176, -0.02734978124499321, 0.006925895344465971, 0.0036590960808098316, 0.023879166692495346, -0.045002032071352005, -0.01800990290939808, -0.05948245897889137, -0.011129657737910748, -0.03666478395462036, 0.0032264040783047676, -0.07016842812299728, 0.0686972364783287, -0.04429198428988457, 0.044270213693380356, 0.010821189731359482, -0.05289028212428093, 0.014225389808416367, 0.00014497751544695348, -0.03239855915307999, -0.11244233697652817, -0.011327355168759823, 0.09920498728752136, 0.027270223945379257, 0.07101894170045853, -0.0640387237071991, -0.039689935743808746, 0.04707224294543266, -0.040970563888549805, -0.07866663485765457, 0.04495009779930115, -0.04292948544025421, 0.01386226899921894, 0.027882492169737816, 0.07775666564702988, 0.044675927609205246, 0.013837271369993687, -0.038709692656993866, -0.016959048807621002, -0.027380546554923058, 0.012566362507641315, 0.025654731318354607, 0.04616633430123329, -0.03356315568089485, -0.032060544937849045, -0.008330135606229305, -0.01981736347079277, 0.09126381576061249, -0.010206018574535847, 0.0460251048207283, 0.009688264690339565, -0.03295474499464035, -0.08049667626619339, -0.02119334787130356, -0.024999042972922325, 5.196931789330352e-33, -0.019446775317192078, -0.05815834179520607, -0.003998053725808859, 0.00579300569370389, 0.06615033745765686, 0.006745132151991129, 0.013037345372140408, -0.009744497016072273, -0.07248324155807495, 0.07103966176509857, -0.10405782610177994, 0.011163214221596718, -0.08035929501056671, 0.13923509418964386, 0.027124540880322456, -0.053091101348400116, -0.04798281565308571, 0.001863836427219212, 0.0068452246487140656, 0.02356703393161297, 0.037501055747270584, 0.021785564720630646, -0.04398632422089577, -0.09867243468761444, -0.0871257558465004, 0.025463083758950233, 0.01695707067847252, -0.017408978193998337, -0.04884323850274086, 0.0040617468766868114, -0.06207531690597534, 0.04650995880365372, -0.05266490578651428, -0.0055700927041471004, 0.056845176964998245, 0.07311906665563583, 0.113823801279068, 0.04571967199444771, -0.027449602261185646, -0.04522186145186424, 0.025076372548937798, 0.004169146995991468, -0.04283187910914421, -0.030853144824504852, -0.023947175592184067, 0.019818760454654694, -0.011210455559194088, 0.07020222395658493, -0.05310097336769104, 0.04706685245037079, -0.013419591821730137, -0.05723882094025612, -0.058183979243040085, -0.05900394544005394, -0.01734120212495327, 0.04252338409423828, 0.04049302265048027, 0.030733982101082802, 0.04547816142439842, 0.04954859986901283, 0.05283384397625923, -0.02659829892218113, -0.017510250210762024, 0.044164273887872696, -0.028403349220752716, 0.0796208456158638, 0.016961054876446724, 0.03154471889138222, 0.03093237429857254, 0.015370674431324005, -0.07859187573194504, 0.022945472970604897, -0.0045765978284180164, -0.10257060825824738, -0.01242594514042139, -0.03641219437122345, -0.030765799805521965, -0.09796871989965439, -0.06414598226547241, 0.01773504540324211, 0.00828020740300417, 0.12443209439516068, -0.06065889447927475, -0.08862630277872086, -0.004700042773038149, 0.05900900810956955, 0.00036805495619773865, -0.05401717871427536, -0.07355572283267975, 0.0314016118645668, -0.10460992902517319, -0.09093157947063446, 0.11513342708349228, -0.06958886981010437, -0.02858484908938408, -5.6054392187861284e-33, 0.015675904229283333, 0.043407633900642395, 0.03921005502343178, 0.08509662747383118, 0.0508214607834816, -0.06868265569210052, 0.0446002297103405, 0.02348853088915348, -0.03860411420464516, 0.04324449226260185, 0.048440076410770416, 0.023236971348524094, -0.003430798416957259, -0.03979983553290367, 0.0319698229432106, -0.07200778275728226, -0.020056048408150673, -0.02225634455680847, 0.017413245514035225, 0.03137855604290962, -0.05794409289956093, 0.08164607733488083, -0.08629875630140305, 0.015721386298537254, -0.09394000470638275, 0.07937143743038177, -0.009894800372421741, 0.024859603494405746, 0.08158090710639954, -0.05400882661342621, -0.022597048431634903, -0.06921427696943283, -0.05538349226117134, 0.050828006118535995, 0.010957031510770321, 0.06415727734565735, 0.04527393355965614, -0.11001420021057129, -0.04239504039287567, -0.019027743488550186, 0.06164928525686264, -0.04049593210220337, -0.12257248163223267, 0.03880929946899414, 0.020361918956041336, -0.030131103470921516, 0.04408726096153259, -0.002222048584371805, 0.029632320627570152, 0.01149679720401764, 0.026391273364424706, -0.04095986858010292, -0.12357431650161743, 0.013944891281425953, -0.03039766475558281, 0.0032575486693531275, -0.008140225894749165, -0.02437860146164894, 0.07986819744110107, 0.04461101070046425, -0.049115490168333054, -0.032798100262880325, -0.06312951445579529, -0.0029953569173812866, 0.02287730947136879, 0.009228438138961792, -0.12928442656993866, 0.018623625859618187, -0.02219955250620842, 0.044823143631219864, 0.015835139900445938, 0.062009427696466446, 0.002532818354666233, 0.01971736177802086, 0.07735812664031982, -0.045821771025657654, -0.06443122774362564, 0.04493693262338638, 0.10152190923690796, 0.008823932148516178, -0.07933614403009415, -0.0877605751156807, -0.021035781130194664, 0.11531062424182892, 0.038565147668123245, -0.0014834838220849633, -0.015049882233142853, 0.04184075444936752, -0.0027387612499296665, -0.03508937358856201, -0.02659674733877182, 0.01664760522544384, 0.004851538687944412, 0.06597922742366791, 0.025897301733493805, -4.6434148970320166e-08, -0.00125912728253752, -0.080005943775177, 0.06467770785093307, -0.024766916409134865, 0.08973994851112366, 0.005567136686295271, 0.016588032245635986, 0.016459589824080467, -0.045081861317157745, 0.007085017394274473, 0.0924324095249176, -0.021482426673173904, -0.04685117304325104, 0.039619091898202896, 0.043898701667785645, 0.036816395819187164, -0.017942914739251137, 0.018454555422067642, 0.023368297144770622, -0.035396430641412735, -0.02146618627011776, 0.01661401242017746, 0.04867849871516228, -0.02638421021401882, -0.01845724880695343, -0.06834205985069275, -0.06467781215906143, 0.0917837917804718, -0.033132489770650864, 0.006655758712440729, 0.06958022713661194, -0.024112027138471603, 0.046916380524635315, 0.0233791321516037, 0.0201044250279665, 0.052369125187397, -0.02856731414794922, 0.05032799020409584, -0.019982529804110527, 0.0604889877140522, -0.040817778557538986, 0.04362953454256058, 0.055288877338171005, -0.011864697560667992, 0.04726672172546387, 0.004804586060345173, 0.028062619268894196, -0.09563134610652924, 0.041628751903772354, 0.10377441346645355, -0.052960824221372604, 0.0396629199385643, -0.049716442823410034, 0.08321773260831833, 0.041217394173145294, -0.07000981271266937, 0.016332218423485756, -0.014571338891983032, -0.0603264681994915, 0.07263372093439102, 0.04572880640625954, 0.023230480030179024, -0.06387170404195786, -0.015846462920308113 ] }, { "text": "Iteration 5/30\nIteration 10/30\nIteration 15/30\nIteration 20/30\nIteration 25/30\nIteration 30/30\n\n7. Multi-Scale Deep Dream (Octaves)¶\n\nThe basic algorithm works, but the results can look noisy. A common improvement is multi-scale processing (also called \"octaves\"):\n\n• Start with a small version of the image\n•\n\n• Dream on it\n•\n\n• Upscale the result\n•\n\n• Add details from the original image\n•\n\n• Dream again\n•\n\n• Repeat\n•\n\nThis creates more coherent, visually appealing results.\n\n1. Octave\n\nProcess at multiple scales (small → large), like looking at an image from far away, then closer, then closer.\n\nnum_octaves = 4\noctave_scale = 1.4\noriginal image = 512x512", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_61", "embedding": [ 0.019573133438825607, 0.015560015104711056, 0.05264880508184433, -0.06472191214561462, -0.050086475908756256, -0.1323445439338684, -0.06924151629209518, -0.05821727588772774, -0.006214299239218235, -0.0686110332608223, -0.07150435447692871, -0.04199299216270447, 0.05627729371190071, 0.013724696822464466, -0.08602313697338104, 0.04088738560676575, -0.04342423751950264, 0.1340714544057846, -0.04364388808608055, -0.09480700641870499, 0.013033831492066383, -0.03006829507648945, -0.04713452607393265, -0.036767203360795975, 0.08892902731895447, 0.04455960541963577, -0.04766450077295303, -0.021128609776496887, 0.04317276552319527, -0.036909252405166626, 0.09278611093759537, 0.03673529624938965, 0.05588929355144501, 0.021145809441804886, -0.019201595336198807, 0.025362921878695488, -0.14546866714954376, 0.0021030239295214415, -0.029086126014590263, 0.007195591926574707, 0.06347445398569107, 0.03188972920179367, 0.0006262517417781055, -0.04692392796278, 0.03445624187588692, 0.006307312287390232, -0.061241697520017624, -0.08135693520307541, 0.003006128827109933, -0.03282530605792999, -0.12097824364900589, -0.060953538864851, -0.05750299617648125, 0.026233738288283348, 0.02982386015355587, 0.021966751664876938, 0.06580757349729538, -0.04578601196408272, 0.008257710374891758, -0.016772912815213203, 0.029364565387368202, 0.02711707167327404, -0.02815180830657482, -0.009817112237215042, 0.029229935258626938, -0.029096700251102448, -0.00036716446629725397, -0.10953284800052643, 0.04256824404001236, -0.00039575816481374204, 0.004777780268341303, 0.023413769900798798, 0.06990578770637512, -0.014464844018220901, -0.02047349140048027, -0.02846166491508484, -0.018337173387408257, -0.06940589100122452, 0.010614672675728798, 0.01836918294429779, 0.01677333377301693, -0.017460325732827187, -0.00950329564511776, -0.08439827710390091, 0.028919361531734467, -0.024378210306167603, 0.018770946189761162, 0.0279034823179245, 0.010583403520286083, 0.00762619124725461, -0.025438103824853897, -0.019562138244509697, -0.18122456967830658, -0.015034498646855354, 0.009093126282095909, -0.01963927038013935, 0.05221519246697426, -0.0720875933766365, 0.012005520984530449, -0.0026968778111040592, 0.0784553810954094, -0.05404883623123169, 0.04683627188205719, -0.027227278798818588, 0.03570680692791939, 0.05784738436341286, 0.14002059400081635, 0.04616392031311989, 0.0006717133219353855, -0.04868264123797417, -0.005622487049549818, -0.010212256573140621, -0.015445074997842312, 0.03489655256271362, 0.059368036687374115, -0.019540956243872643, 0.030264904722571373, 0.03843958303332329, -0.02209792658686638, 0.0388767309486866, -0.06133214756846428, -0.040968023240566254, 0.01668827421963215, -0.033612318336963654, -0.07096482068300247, 0.00745796924456954, -0.0951378121972084, 3.763007944215661e-33, -0.04832896217703819, 0.0485512912273407, -0.005255908705294132, -0.011813003569841385, 0.09344816207885742, -0.003448301227763295, -0.02231966331601143, -0.04399092495441437, -0.04157261177897453, 0.010136602446436882, 0.05335075780749321, 0.025085439905524254, -0.0038864687085151672, 0.18800462782382965, 0.044296734035015106, -0.07014279067516327, 0.06922942399978638, 0.029803873971104622, -0.001417511492036283, 0.0024099601432681084, -0.02921692281961441, 0.024640651419758797, 0.014550145715475082, -0.04353950545191765, -0.08887971937656403, 0.015611168928444386, 0.031089581549167633, 0.012584521435201168, 0.0069419448263943195, 0.010431059636175632, -0.010646919719874859, 0.06098344922065735, -0.054608676582574844, -0.06411059200763702, 0.06920530647039413, 0.056419916450977325, 0.06912607699632645, 0.04787524789571762, 0.01716434955596924, -0.01912780851125717, 0.03095961920917034, 0.04915010556578636, 0.037910837680101395, -0.011760661378502846, -0.021378085017204285, 0.09152734279632568, -0.018166692927479744, 0.09676205366849899, 0.008383713662624359, 0.0084020234644413, 0.03429853543639183, -0.05179864540696144, -0.04860561341047287, -0.03602532297372818, 0.05369062349200249, 0.029475437477231026, 0.08339662104845047, -0.0455334335565567, 0.04686968773603439, 0.06353521347045898, 0.022993989288806915, -0.0708569809794426, -0.035502709448337555, 0.06701178848743439, 0.004674079362303019, -0.02109110727906227, 0.051328279078006744, 0.006017829291522503, -0.03886072337627411, 0.06236293911933899, -0.05213075131177902, 0.0633082464337349, 0.06585036218166351, -0.08789344877004623, -0.022485539317131042, -0.028862223029136658, 0.07146196812391281, -0.05784014239907265, -0.030153704807162285, -0.030484864488244057, -0.044554319232702255, 0.10365257412195206, -0.008048961870372295, -0.14059309661388397, -0.002415273804217577, 0.040750786662101746, -0.04403259977698326, -0.0006622530636377633, -0.06598714739084244, -0.02012389339506626, -0.10197432339191437, -0.059247784316539764, 0.08783450722694397, -0.006682050414383411, -0.10650073736906052, -3.4489423022988396e-33, 0.04095011577010155, 0.0450269915163517, 0.016912678256630898, 0.11116363108158112, 0.041437435895204544, -0.021729806438088417, 0.06313890218734741, -0.01277976669371128, -0.007047335151582956, 0.0016600083326920867, 0.0201238002628088, 0.01665477640926838, 0.01804303750395775, -0.029493281617760658, 0.027224261313676834, -0.09238066524267197, 0.021198783069849014, -0.02839032933115959, -0.02837936021387577, -0.0027813375927507877, 0.01858850196003914, 0.06060979887843132, 0.009223461151123047, 0.004344231449067593, -0.04079962521791458, 0.0326622910797596, -0.01941581442952156, 0.009208367206156254, -0.008170489221811295, -0.06116773560643196, -0.019916558638215065, -0.07062533497810364, 0.04036080837249756, -0.006626306101679802, 0.04167763516306877, 0.09489854425191879, 0.023240478709340096, -0.10842951387166977, -0.04315754026174545, -0.05214567482471466, -0.00600725831463933, -0.025939106941223145, -0.03768822178244591, -0.04283252730965614, -0.019813954830169678, 0.010151522234082222, -0.0034278910607099533, 0.02421330101788044, 0.017990995198488235, 0.07921065390110016, 0.03344334661960602, 0.011044954881072044, -0.08123017847537994, 0.03738107904791832, 0.0017139582196250558, -0.04576865956187248, -0.09518910944461823, 0.023857569321990013, 0.05605467036366463, -0.012383458204567432, -0.0658886581659317, -0.053035758435726166, 0.0057728588581085205, -0.03347131982445717, -0.02586754970252514, 0.045572321861982346, -0.0535421222448349, 0.004289489239454269, -0.052019376307725906, 0.10777511447668076, -0.022577811032533646, 0.019873755052685738, 0.020052840933203697, 0.06546008586883545, -0.04753457009792328, -0.09095807373523712, -0.06271369755268097, -0.04109792038798332, 0.052703410387039185, -0.05775628983974457, 0.0014200214063748717, -0.03858915716409683, -0.015966758131980896, 0.07703398913145065, 0.04119208827614784, -0.007666172459721565, 0.034299854189157486, -0.005719037260860205, 0.051320672035217285, 0.0369856096804142, 0.004380752332508564, 0.03904944658279419, 0.02328241616487503, -0.038579780608415604, 0.009831720031797886, -4.7681048442882457e-08, 0.01898365281522274, -0.04822554439306259, 0.024808503687381744, 0.0006849011988379061, 0.04806191101670265, -0.05741339549422264, 0.05259058624505997, 0.04614393413066864, 0.004248263780027628, -0.07821229100227356, 0.08134962618350983, -0.06768590956926346, -0.006940178107470274, 0.06019549071788788, 0.008574109524488449, 0.03851194307208061, 0.06808748096227646, -0.011331344954669476, 0.04651695862412453, -0.04961686581373215, -0.07253030687570572, 0.0941336452960968, 0.018735596910119057, -0.03152034431695938, -0.04040767252445221, 0.0047689806669950485, -0.07177247107028961, 0.10039416700601578, -0.05709659308195114, -0.04500927776098251, 0.10188983380794525, -0.020823031663894653, 0.05084230750799179, 0.034185197204351425, 0.03432212397456169, -0.0035655484534800053, -0.04932701960206032, 0.07084394246339798, -0.014931890182197094, -0.03953061252832413, -0.0177654717117548, 0.06089342385530472, 0.05890559032559395, 0.008389241993427277, 0.00704095559194684, 0.007332799956202507, -0.01844298467040062, -0.09443503618240356, 0.01635313406586647, 0.12258497625589371, 0.04051691293716431, 0.07495401799678802, -0.018501250073313713, 0.026151232421398163, 0.04356105253100395, -0.09480573236942291, -0.023567751049995422, 0.003901382442563772, 0.0056368159130215645, 0.0753440409898758, 0.04050182178616524, -0.05125850811600685, -0.02617475390434265, -0.014912108890712261 ] }, { "text": "num_octaves = 4\noctave_scale = 1.4\noriginal image = 512x512\n\nOctave sizes (small to large):\noctave 0: 512 / 1.4³ = 186x186 (far away - big patterns)\noctave 1: 512 / 1.4² = 261x261\noctave 2: 512 / 1.4¹ = 365x365\noctave 3: 512 / 1.4⁰ = 512x512 (close up - fine details)\n\nWhy?\n\n• Small scale → network sees the whole image → creates large, coherent patterns\n•\n\n• Large scale → network sees details → adds fine texture\n•\n\n2. What is interpolate? Why do we need it?\n\ninterpolate = resize an image\n\n•\nOriginal: 512x512\n\n•\n\n•\nWe want: 186x186\n\nscaled_image = torch.nn.functional.interpolate(\noriginal, # input tensor\nsize=(186, 186), # target size\nmode='bilinear', # smooth resizing (not blocky)\nalign_corners=False\n)\n\n•\n\nVisual example:", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_62", "embedding": [ -0.059587590396404266, -0.005730743985623121, 0.031006919220089912, 0.0035544373095035553, -0.006567416246980429, -0.03583887219429016, -0.01914299465715885, 0.039060626178979874, -0.06499160826206207, -0.09105271846055984, -0.07816209644079208, 0.013474659994244576, -0.042607828974723816, -0.028966132551431656, -0.034015607088804245, 0.052510183304548264, -0.05489073693752289, 0.043571051210165024, -0.09848527610301971, -0.0649355947971344, 0.09629788994789124, -0.07427371293306351, -0.05264848470687866, -0.09569293260574341, 0.03037858195602894, 0.03708278760313988, -0.010228079743683338, 0.04913926124572754, 0.11828282475471497, -0.003499440150335431, 0.06643590331077576, 0.05096435546875, -0.0610102117061615, 0.014870165847241879, -0.038925155997276306, -0.003211756469681859, -0.027361787855625153, 0.016218936070799828, 0.0022392424289137125, 0.03376852348446846, 0.07241225987672806, 0.07087437808513641, 0.02365921065211296, -0.033120281994342804, 0.07321588695049286, 0.015691682696342468, 0.03245118260383606, -0.024462377652525902, -0.09306085109710693, -0.04614223912358284, -0.07033728808164597, -0.011469481512904167, -0.06715109944343567, 0.07407410442829132, 0.03862842172384262, -0.02838093787431717, 0.044268898665905, -0.028086133301258087, 0.002640975173562765, -0.0480433814227581, 0.01103189866989851, 0.02848178707063198, 0.021109141409397125, 0.02024645358324051, -0.03043079562485218, -0.023578815162181854, 0.04991529509425163, -0.11207558214664459, 0.053547453135252, -0.040452487766742706, -0.02795303612947464, -0.020502405241131783, 0.03618943691253662, 0.04558265209197998, -0.016128648072481155, -0.08690111339092255, 0.03492409735918045, 0.042509499937295914, 0.04893772676587105, -0.01274059060961008, 0.01191630493849516, 0.0022477624006569386, 0.029850449413061142, -0.07456966489553452, 0.038957711309194565, -0.05491349473595619, 0.034462638199329376, 0.012893101200461388, 0.009707559831440449, -0.0013427543453872204, 0.026339661329984665, 0.046967048197984695, -0.1719752997159958, 0.027675140649080276, -0.0036445707082748413, -0.021534878760576248, -0.0028341819997876883, -0.03650696203112602, -0.0004366908106021583, 0.06335581094026566, 0.08671915531158447, 0.004158080089837313, -0.01031120028346777, 0.05241766944527626, -0.02922535128891468, 0.051366399973630905, 0.0660499557852745, 0.1254047155380249, -0.03169899806380272, 0.04902053251862526, -0.05027070641517639, -0.00872599333524704, 0.006795667577534914, 0.008797230198979378, 0.044182177633047104, -0.013403045013546944, -0.015300335362553596, 0.06452375650405884, 0.08250647783279419, 0.004733696114271879, -0.05381821095943451, 0.07922990620136261, -0.019902750849723816, 0.011740620248019695, -0.05080028995871544, 0.06021023169159889, -0.10682974755764008, 7.040641046665353e-33, -0.04090718924999237, 0.022925283759832382, -0.055522747337818146, -0.04235885292291641, 0.018062101677060127, 0.03785021975636482, 0.035400502383708954, -0.008324149064719677, -0.07960296422243118, 0.007156133186072111, -0.03083866275846958, 0.07707412540912628, 0.008772339671850204, 0.09281537681818008, -0.057067640125751495, 0.02049357444047928, 0.07857697457075119, 0.08848709613084793, 0.01310252770781517, 0.03338337317109108, 0.021281449124217033, 0.04513208195567131, 0.03660649061203003, 0.012920278124511242, -0.12612374126911163, 0.030151471495628357, 0.036543723195791245, 0.0170599315315485, 0.008242246694862843, -0.016255520284175873, -0.045805297791957855, -0.018218863755464554, 0.016114406287670135, -0.10531042516231537, 0.04207880049943924, 0.014041928574442863, 0.056775063276290894, -0.020451968535780907, -0.0362386628985405, -0.018166085705161095, 0.06008013337850571, 0.07744651287794113, 0.06238741800189018, -0.049227260053157806, -0.040330804884433746, 0.0011653517140075564, -0.015769528225064278, 0.06740330904722214, -0.02349836379289627, -0.022155389189720154, -0.01983744651079178, -0.037534333765506744, 0.036252185702323914, -0.01099843718111515, 0.06410136073827744, -0.006015538237988949, 0.1008715033531189, -0.02208695001900196, 0.04292403906583786, -0.041159454733133316, -0.022086041048169136, -0.06869592517614365, -0.02059635892510414, 0.08968207240104675, 0.024940645322203636, -0.04424046352505684, 0.020111871883273125, -0.007571070920675993, -0.04603055119514465, 0.020576346665620804, -0.02677144855260849, 0.10995453596115112, 0.01179126650094986, -0.0456102080643177, -0.0176699236035347, -0.11160352826118469, -0.024419333785772324, -0.010432514362037182, -0.06077364459633827, 0.05091686174273491, -0.05812745541334152, 0.06907083839178085, 0.039301302284002304, -0.12546870112419128, -0.1103053018450737, -0.048208773136138916, -0.028064023703336716, 0.04005706310272217, 0.03125286474823952, -0.08486606925725937, -0.04672630876302719, -0.05308579280972481, 0.027964219450950623, -0.018268518149852753, -0.062253061681985855, -6.1544042641697525e-33, 0.054053567349910736, 0.042615827172994614, -0.0061686839908361435, 0.06723283231258392, -0.04329054057598114, 0.03032686375081539, 0.06704162061214447, 0.0029797989409416914, 0.01865740492939949, -0.02733702026307583, 0.021288523450493813, -0.04269041121006012, 0.07163584977388382, -0.11508600413799286, -0.02127443067729473, -0.08833011984825134, -0.02021123468875885, -0.05785626173019409, 0.06667249649763107, -0.06177721172571182, -0.007629279978573322, 0.07270820438861847, -0.054044485092163086, 0.10017243772745132, -0.07372669875621796, 0.03178384527564049, -0.00775094935670495, -0.02065659873187542, -0.05654923990368843, -0.01126777846366167, 0.04384670406579971, -0.11665888875722885, -0.013859947212040424, -0.05069246515631676, -0.006038200110197067, 0.08693639934062958, 0.016372116282582283, -0.050608210265636444, -0.08641576766967773, -0.028278280049562454, 0.04947451129555702, 0.013105570338666439, -0.04600943997502327, 0.03063589334487915, -0.05565106123685837, 0.05911640822887421, -0.01241809967905283, 0.025106560438871384, -0.0031352147925645113, 0.058677710592746735, -0.010547753423452377, -0.023494254797697067, -0.050038985908031464, 0.007820776663720608, -0.028131019324064255, 0.026303142309188843, -0.13372863829135895, 0.040723465383052826, 0.023842010647058487, -0.020426683127880096, 0.030490266159176826, -0.09314819425344467, -0.06298582255840302, -0.05793796479701996, -0.0159792210906744, 0.06669262051582336, -0.08359504491090775, -0.06511301547288895, 0.09299146384000778, 0.052741825580596924, -0.06216778978705406, 0.0053428905084729195, 0.011813715100288391, 0.0321224182844162, -0.03385809436440468, -0.013720674440264702, 0.09461823105812073, -0.012454371899366379, 0.02905719168484211, -0.008630712516605854, 0.028618350625038147, -0.007882561534643173, -0.017267899587750435, 0.07594528794288635, 0.005539991427212954, 0.029947834089398384, 0.028445763513445854, 0.110981784760952, 0.0013566964771598577, -0.0449942909181118, 0.0669049546122551, 0.0005651791580021381, -0.02289223112165928, -0.029235541820526123, 0.026073116809129715, -5.551346049514905e-08, 0.0006575044244527817, 0.020152317360043526, -0.01851271651685238, 0.053088828921318054, -0.09081773459911346, -0.07437270879745483, 0.10988347232341766, 0.011472920887172222, 0.006287899799644947, -0.01967017538845539, 0.03291037306189537, -0.0470411516726017, -0.009798242710530758, 0.011028775945305824, 0.08348812162876129, 0.06521159410476685, 0.013883858919143677, -0.016856633126735687, 0.006558949127793312, 0.02664177492260933, -0.06246842071413994, -0.03257223963737488, -0.08204483240842819, -0.006347044371068478, -0.03713397681713104, -0.018611278384923935, -0.05483672767877579, 0.07025566697120667, -0.06992403417825699, 0.018406037241220474, 0.012681414373219013, -0.03969283774495125, 0.07699120789766312, 0.0647585317492485, 0.05694187432527542, 0.019422652199864388, -0.03021472692489624, 0.040051620453596115, 0.05345132574439049, -0.10578212887048721, 0.014339432120323181, 0.03760828077793121, 0.03849777951836586, -0.03552640601992607, 0.041653163731098175, -0.04169788211584091, -0.017777172848582268, -0.01780901663005352, -0.04598129913210869, 0.0861433893442154, 0.06786371022462845, 0.052896648645401, -0.058793433010578156, 0.02978234738111496, 0.04873548075556755, -0.05536544695496559, -0.030996346846222878, 0.01208640169352293, 0.03315086290240288, 0.058262959122657776, 0.014995231293141842, -0.06342393904924393, -0.03548966348171234, -0.026074988767504692 ] }, { "text": "•\n\nVisual example:\n\n```\nOriginal (512x512): Interpolated (186x186):\n┌─────────────────┐ ┌───────┐\n│ │ │ │\n│ 🐱 │ ──→ │ 🐱 │\n│ │ │ │\n│ │ └───────┘\n└─────────────────┘ (same image, smaller)\n\nWhy needed? The model can only dream at one size at a time. We resize to process at different scales.\n\n5. Why extract detail?\n\nWe want to accumulate only the new patterns, not the original image:\npython\n\ndetail = dreamed - scaled_image\n\n# ↑ ↑\n# output input (without previous detail)\n#\n# = only the NEW patterns added by this octave\n\nVisual example:\n\nscaled_image: dreamed: detail:\n┌───────┐ ┌───────┐ ┌───────┐\n│ │ │ ~∿∿~ │ │ ~∿∿~ │\n│ 🐱 │ + │ 🐱 │ = │ │ (just the swirls)\n│ │ dream │ ~∿∿~ │ - │ ~∿∿~ │\n└───────┘ └───────┘ └───────┘", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_63", "embedding": [ -0.05048317834734917, 0.0023400860372930765, 0.10403914004564285, 0.02342532016336918, 0.046818867325782776, -0.06798132508993149, -0.07367034256458282, -0.052862294018268585, 0.022086894139647484, -0.047595784068107605, -0.0291422288864851, -0.004236198961734772, 0.014749710448086262, -0.046517640352249146, -0.0011425353586673737, 0.008967298083007336, -0.0625545009970665, 0.07923419028520584, -0.09408710151910782, -0.08424516767263412, 0.06741955876350403, -0.08543986082077026, -0.08059758692979813, -0.025997478514909744, 0.061995793133974075, 0.06501850485801697, -0.05424715578556061, 0.08372198790311813, 0.13983996212482452, -0.03030502237379551, 0.06410456448793411, 0.12746386229991913, 0.021652905270457268, 0.026176955550909042, -0.014625768177211285, 0.028171217069029808, -0.08749624341726303, 0.011415182612836361, 0.010064050555229187, -0.015316694043576717, 0.07884198427200317, 0.05729406699538231, -0.027442552149295807, -0.013616329059004784, 0.031178051605820656, 0.004492380190640688, -0.009536627680063248, -0.06560634076595306, -0.0345013402402401, -0.07384515553712845, -0.0718679279088974, -0.033834654837846756, -0.08139045536518097, 0.005456447601318359, 0.027712704613804817, 0.017368705943226814, 0.07166345417499542, -0.03551216050982475, 0.03533034771680832, -0.08539612591266632, -0.04941818118095398, 0.06596343219280243, -0.011464848183095455, -0.013249509036540985, 0.02131635881960392, -0.06461457908153534, -0.009752587415277958, -0.04646584391593933, 0.08811651915311813, 0.01939352974295616, -0.022761281579732895, 0.035446688532829285, 0.06691978871822357, -0.043996214866638184, 0.04135406017303467, -0.06156013533473015, -0.04512408748269081, -0.06051699072122574, -0.04324570670723915, 0.025628188624978065, -0.003711853176355362, -0.033391356468200684, 0.02821163646876812, -0.06937556713819504, 0.011422389186918736, -0.01833931729197502, 0.030151836574077606, -0.013389382511377335, 0.020247336477041245, -0.02310272864997387, 0.010987043380737305, -0.01770818792283535, -0.17449039220809937, 0.0028637307696044445, 0.026645274832844734, 0.020766466856002808, -0.022136088460683823, -0.0982692614197731, 0.025154946371912956, -0.008916915394365788, 0.0426352433860302, -0.046947892755270004, 0.07658448815345764, 0.054829344153404236, 0.07578872889280319, -0.002684229053556919, 0.0495138019323349, 0.04898585006594658, 0.01747899129986763, -0.022830361500382423, -0.007082804571837187, -0.014358493499457836, 0.014459431171417236, 0.039238762110471725, 0.04320665821433067, -0.05084604024887085, 0.012080267071723938, 0.05068620294332504, -0.013275917619466782, 0.05756307393312454, 0.031967613846063614, 0.022422514855861664, 0.018293671309947968, -0.032988402992486954, -0.08150359988212585, -0.0031805962789803743, -0.09537632018327713, 1.831314955102527e-33, -0.04025501012802124, -0.007845035754144192, 0.00426294794306159, -0.02810591645538807, 0.11882602423429489, 0.05964375659823418, -0.0032135765068233013, -0.04305329546332359, -0.021661393344402313, 0.024912487715482712, -0.04199497401714325, 0.07779594510793686, -0.0560571663081646, 0.15702687203884125, 0.012698155827820301, -0.021166594699025154, 0.029059043154120445, 0.08628537505865097, -0.005110482219606638, 0.033316779881715775, -0.03564421087503433, 0.04357409104704857, 0.017528332769870758, -0.059751950204372406, -0.10321908444166183, 0.01696435734629631, 0.03208000585436821, 0.03287789598107338, -0.046462174504995346, 0.007524899207055569, -0.010529239661991596, 0.03638539835810661, -0.032377731055021286, -0.05032770335674286, 0.028428208082914352, 0.097862608730793, 0.09987723082304001, -0.02149037830531597, -0.008488715626299381, -0.06713227182626724, 0.07038114219903946, 0.065933458507061, 0.014711510390043259, -0.044023312628269196, -0.05035591870546341, 0.032175902277231216, 0.02018214762210846, 0.07138700783252716, -0.04609586298465729, -0.044332947582006454, 0.04037130996584892, -0.015668606385588646, 0.010877516120672226, -0.09704048186540604, 0.01998336799442768, -0.017593875527381897, 0.07299990952014923, -0.07953716069459915, 0.05874960869550705, 0.048551518470048904, -0.05957001447677612, -0.03404320031404495, -0.021439746022224426, 0.14151552319526672, 0.06283359974622726, 0.006196118891239166, 0.013087965548038483, 0.01389201357960701, -0.08273417502641678, 0.058715689927339554, -0.05024147406220436, 0.07394561916589737, -0.025428995490074158, -0.07791522890329361, 0.035086531192064285, -0.06234227120876312, 0.02523929998278618, -0.024096298962831497, -0.05704431235790253, -0.015721794217824936, -0.02853935770690441, 0.03852126747369766, -0.011947741732001305, -0.13154345750808716, -0.028556734323501587, 0.07902306318283081, 0.019772397354245186, 0.016209501773118973, -0.07695501297712326, -0.055899932980537415, -0.05464310571551323, -0.10296198725700378, 0.06514336168766022, -0.041091322898864746, -0.04979189485311508, -3.798161837460971e-33, 0.040721993893384933, 0.03226305916905403, 0.02523655816912651, 0.016806380823254585, 0.02936530113220215, -0.010902637615799904, 0.05900933966040611, -0.014461507089436054, -0.004582990426570177, -0.02047792449593544, -0.024523796513676643, -0.010412953794002533, 0.013815767131745815, -0.08879902213811874, -0.02129824087023735, -0.06190190464258194, -0.03075578063726425, -0.03849876672029495, 0.027017800137400627, -0.03846674785017967, 0.004864871967583895, 0.050769709050655365, -0.0566488541662693, 0.021292055025696754, -0.0820038840174675, 0.018428582698106766, -0.030315211042761803, 0.05850192531943321, -0.04092863202095032, -0.027448713779449463, -0.07591657340526581, -0.11358682811260223, -0.015389050357043743, -0.03660619631409645, 0.010874131694436073, 0.04210159555077553, -0.029636200517416, -0.02699608914554119, -0.03201606497168541, 0.029701421037316322, -0.011694036424160004, -0.011000534519553185, -0.05803290382027626, -0.00537954131141305, 0.0240537840873003, -0.015007139183580875, 0.022345291450619698, 0.023025577887892723, 0.052130114287137985, 0.014260925352573395, 0.044733643531799316, 0.045219168066978455, -0.085724838078022, -0.0019780793227255344, -0.030971992760896683, 0.031734831631183624, -0.11166106909513474, 0.04726502671837807, 0.01504624541848898, -0.02296687848865986, -0.026628738269209862, -0.039070095866918564, -0.10083898156881332, -0.060713715851306915, -0.01698247902095318, 0.06287692487239838, -0.04225371032953262, -0.08183087408542633, -0.00497193168848753, 0.015837963670492172, 0.018343521282076836, 0.025429531931877136, -0.02388005703687668, 0.036041274666786194, -0.05935309827327728, -0.045438870787620544, -0.04989762231707573, -0.03973746299743652, 0.04222097247838974, 0.015190540812909603, -0.060226909816265106, -0.041728269308805466, 0.040593765676021576, 0.08372486382722855, 0.018136994913220406, 0.03918915241956711, 0.009894031099975109, 0.05342806875705719, 0.07954096794128418, -0.005746185313910246, -0.037648480385541916, 0.030697034671902657, -0.01692160591483116, 0.014629561454057693, 0.04174836352467537, -5.5444253632686014e-08, -0.03351084142923355, -0.03411616012454033, 0.018528442829847336, 0.03832625225186348, 0.01267458125948906, -0.018233437091112137, 0.06322413682937622, 0.03563498333096504, -0.0013344918843358755, -0.05477422848343849, 0.06562616676092148, -0.010975872166454792, -0.023045862093567848, 0.06541914492845535, 0.03522254526615143, 0.051930446177721024, 0.08108798414468765, -0.04368201270699501, -0.0009091994725167751, -0.047418076545000076, -0.047500837594270706, 0.031224101781845093, -0.0036448633763939142, -0.017579220235347748, -0.03627685457468033, -0.008175651542842388, -0.06655934453010559, 0.046387165784835815, -0.043368250131607056, 0.017085038125514984, 0.10663755238056183, -0.061859991401433945, 0.07891788333654404, 0.08585964888334274, 0.02674219012260437, -0.0342695452272892, -0.04933631420135498, 0.038707368075847626, 0.004228683188557625, -0.07331600040197372, 0.014929069206118584, -0.009060702286660671, 0.06710211932659149, -0.016312139108777046, 0.025465967133641243, 0.02077522687613964, -0.017473721876740456, -0.08109712600708008, 0.007287322077900171, 0.1537424623966217, 0.06438999623060226, -0.008828540332615376, -0.06773000210523605, 0.08382976055145264, 0.07470668852329254, -0.09228247404098511, -0.019512774422764778, 0.03261997178196907, -0.0009070432861335576, 0.05611950159072876, 0.04248236492276192, -0.037225060164928436, 0.004757699556648731, -0.03169949725270271 ] }, { "text": "Why? So we can upscale just the patterns and add more detail in the next octave, without duplicating the base image.\n\nIn [11]:\n\ndef deep_dream_octaves(\nmodel: DeepDreamModel,\nimage: torch.Tensor,\nlayer_name: str,\nnum_octaves: int = 4,\noctave_scale: float = 1.4,\niterations_per_octave: int = 100,\nlearning_rate: float = 0.01,\nshow_progress: bool = True\n) -> torch.Tensor:\n\"\"\"\nMulti-scale Deep Dream for better quality results.\n\nArgs:\nmodel: The DeepDream model wrapper\nimage: Input image tensor\nlayer_name: Which layer to dream on\nnum_octaves: Number of scales to process\noctave_scale: Scale factor between octaves\niterations_per_octave: Optimization steps per scale\nlearning_rate: Step size\nshow_progress: Whether to print progress\n\nReturns:\nDreamed image tensor\n\"\"\"\noriginal = image.clone()", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_64", "embedding": [ -0.03311704844236374, -0.052563175559043884, 0.04394643381237984, -0.01002525258809328, -0.04365755617618561, -0.026015998795628548, -0.11568436026573181, -0.02933570183813572, -0.01760736294090748, -0.08540499955415726, -0.030899282544851303, 0.005934315733611584, -0.0647277757525444, 0.015520397573709488, -0.022833624854683876, 0.004060268402099609, -0.0018052554223686457, 0.08397302776575089, -0.1023213118314743, -0.05711114779114723, 0.07489056885242462, -0.04048175364732742, 0.010018146596848965, -0.011320834048092365, 0.04405079409480095, 0.03366842493414879, -0.031930021941661835, 0.043498530983924866, 0.11292046308517456, -0.0180861447006464, 0.04282154142856598, 0.09063762426376343, 0.02569076232612133, 0.037196315824985504, -0.03855178877711296, 0.05927232652902603, -0.08195886015892029, -0.03670347481966019, -0.02228870615363121, 0.007856369949877262, 0.07244212180376053, 0.04188885539770126, -0.028501782566308975, 0.004819265566766262, -0.01673322729766369, 0.017035353928804398, 0.02943844348192215, -0.0418197400867939, -0.0037128643598407507, -0.05302520468831062, -0.012605461291968822, -0.038524992763996124, -0.05465230718255043, 0.014815820381045341, 0.019657162949442863, 0.01573270559310913, 0.06488919258117676, -0.018749389797449112, -0.04890991002321243, -0.08933716267347336, -0.06301688402891159, 0.09892327338457108, -0.01635747030377388, -0.02858351357281208, 0.02709699422121048, -0.04259244352579117, 0.03624964877963066, -0.031157251447439194, 0.07426229864358902, 0.02130664326250553, 0.010666864924132824, 0.025614991784095764, 0.04781075194478035, 0.00790039449930191, 0.00721189146861434, -0.05903148278594017, 0.03138528764247894, -0.023998945951461792, -0.012470399960875511, -0.04569114372134209, 0.02132456749677658, -0.057536762207746506, 0.031234798952937126, -0.03872073069214821, 0.022862780839204788, -0.0864836722612381, 0.04402194917201996, -0.0047800359316170216, -0.0010767749045044184, -0.09845386445522308, 0.044006600975990295, -0.021302470937371254, -0.15686869621276855, -0.0194754209369421, 0.05594524368643761, 0.0343753844499588, 0.018542930483818054, -0.0734877809882164, -0.033672235906124115, -0.007626657839864492, 0.05902803689241409, -0.05414177104830742, 0.025887971743941307, 0.029330218210816383, 0.05659719184041023, 0.06936036050319672, 0.04858367145061493, 0.09025257080793381, -0.00917863566428423, -0.0377044640481472, 0.02881428599357605, 0.01895243488252163, 0.018014244735240936, 0.03424615040421486, 0.05919816344976425, -0.028878144919872284, -0.021240469068288803, 0.057439174503088, -0.0011534939985722303, 0.031261857599020004, -0.03312818333506584, 0.04905014857649803, 0.03755781054496765, -0.007048841565847397, -0.06090381368994713, -0.02704513818025589, -0.11774559319019318, 2.3874332509528892e-33, 0.013112748973071575, 0.060237735509872437, 0.010019670240581036, -0.048986464738845825, 0.09392456710338593, 0.06578151136636734, 0.027372222393751144, -0.02928580529987812, -0.021912891417741776, -0.00018327411089558154, -0.048105183988809586, 0.06405428051948547, -0.030022619292140007, 0.17658023536205292, -0.03059842251241207, -0.00839296355843544, 0.03880835697054863, 0.07039932161569595, -0.004386106040328741, 0.06390867382287979, 0.045343298465013504, 0.01979333907365799, 0.02516326867043972, -0.043396756052970886, -0.08494029939174652, 0.0335829071700573, 0.03936553746461868, 0.05824717879295349, -0.07011929154396057, -0.0060110390186309814, -0.0502765029668808, -0.026698507368564606, -0.0069891344755887985, -0.04423251375555992, 0.01699405536055565, 0.02692320942878723, 0.05374976620078087, -0.02215108647942543, 0.0017603017622604966, -0.11493532359600067, 0.05320149287581444, 0.04227341338992119, -0.006984425708651543, -0.06749264150857925, -0.06077616661787033, 0.022991906851530075, -0.0383356474339962, 0.04960738494992256, 0.011019328609108925, -0.023770207539200783, 0.03282693773508072, -0.06306454539299011, -0.027557644993066788, -0.09613505750894547, 0.029907112941145897, -0.052958082407712936, 0.09219853579998016, -0.001360808266326785, 0.08862824738025665, -0.02182122692465782, -0.040086306631565094, -0.031591907143592834, -0.031161537393927574, 0.1329503357410431, -0.008815173991024494, 0.0008226344361901283, 0.05197952687740326, 0.04680190235376358, -0.0617278516292572, -0.008191042579710484, -0.06170010566711426, 0.09110590815544128, -0.044510118663311005, -0.02359292283654213, -0.0016638562083244324, -0.05933055281639099, 0.05519214645028114, -0.07225159555673599, -0.011454431340098381, 0.04056625813245773, -0.04951821267604828, 0.10196410119533539, -0.019260914996266365, -0.15829771757125854, -0.06070560961961746, 0.05857761204242706, 0.014006586745381355, 0.01682428829371929, -0.026662806048989296, -0.004284282680600882, -0.07432150095701218, -0.04718165472149849, 0.05906374007463455, -0.009970319457352161, -0.0432727076113224, -3.2987846539248006e-33, 0.07231229543685913, 0.014929144643247128, -0.01695748046040535, 0.08278698474168777, -0.020975464954972267, -0.027333255857229233, 0.08813907951116562, 0.011070847511291504, -0.007697121240198612, -0.03903360664844513, 0.039077505469322205, -0.004599192179739475, -0.0422956608235836, -0.1331348866224289, 0.042924392968416214, -0.0833268091082573, -0.02298995666205883, -0.027537601068615913, 0.06217891350388527, -0.06590699404478073, -0.030698828399181366, 0.04807956889271736, -0.0903468206524849, 0.03469984605908394, -0.08984072506427765, -0.013107676059007645, -0.07352528721094131, 0.060817901045084, -0.028403853997588158, 0.004627492278814316, 0.06111396849155426, -0.09751950949430466, -0.05131921544671059, 0.025599665939807892, 0.010379813611507416, 0.12075313180685043, 0.04544591158628464, -0.02964344248175621, -0.06444933265447617, 0.02610999159514904, 0.01627950742840767, -0.01007878128439188, -0.04883376881480217, 0.029535140842199326, -0.012701280415058136, -0.0015290087321773171, -0.030650915578007698, -0.024637777358293533, 0.04115810617804527, 0.018997034057974815, 0.07421275228261948, -0.022446298971772194, -0.05915582552552223, 0.040770888328552246, -0.03134849667549133, -0.00026518350932747126, -0.08620662987232208, 0.028496334329247475, 0.02899407036602497, 0.027164235711097717, -0.021924126893281937, -0.05423349887132645, -0.0677671805024147, -0.09154199063777924, -0.06576243042945862, 0.06641808152198792, -0.05888545140624046, -0.00021376012591645122, 0.07483027130365372, 0.03892471268773079, 0.005807377398014069, 0.02570495195686817, 0.016060438007116318, 0.10043468326330185, -0.07063670456409454, -0.004408890847116709, -0.01503442507237196, -0.0065130628645420074, 0.05939755588769913, -0.0054962486028671265, -0.026730846613645554, -0.06312034279108047, -0.04681310057640076, 0.0996762067079544, 0.03690268099308014, 0.031968921422958374, 0.040862176567316055, 0.11507362127304077, 0.028295544907450676, -0.008030536584556103, 0.01582658663392067, -0.006745041813701391, -0.0111459419131279, -0.006358029320836067, 0.05463280528783798, -4.852681101397138e-08, -0.051762934774160385, 0.039251767098903656, 0.03573444113135338, -0.012597429566085339, -0.031431894749403, -0.09064459800720215, 0.07401620596647263, 0.07188911736011505, 0.014221801422536373, 0.00549402367323637, 0.03811648488044739, -0.032380037009716034, -0.035364702343940735, 0.025832584127783775, 0.04307972267270088, 0.09966380149126053, 0.054014019668102264, -0.006161803379654884, 0.017187725752592087, -0.05494914948940277, -0.011634815484285355, 0.025318585336208344, -0.040719132870435715, -0.040520522743463516, -0.037284862250089645, -0.025485144928097725, -0.03237752988934517, 0.10067371279001236, -0.06426653265953064, 0.01581544615328312, 0.07107231765985489, -0.06037010997533798, 0.07305092364549637, 0.061926696449518204, 0.05970118194818497, 0.017340973019599915, -0.005384885706007481, 0.012991941533982754, 0.020133910700678825, -0.028070397675037384, -0.01946178637444973, 0.00774562219157815, 0.028448035940527916, -0.015377046540379524, 0.04896542429924011, -0.030893320217728615, -0.04638642817735672, -0.06645957380533218, -0.04430331289768219, 0.09072336554527283, 0.061582569032907486, 0.039736922830343246, -0.03660128265619278, 0.07515305280685425, 0.029937000945210457, -0.06197354197502136, -0.011017007753252983, -0.0014454114716500044, 0.010607508011162281, 0.0661696046590805, 0.04039360210299492, -0.09202343225479126, -0.02761608175933361, -0.019451726227998734 ] }, { "text": "Returns:\nDreamed image tensor\n\"\"\"\noriginal = image.clone()\n\n# Calculate sizes for each octave (from smallest to largest)\n_, _, h, w = image.shape\noctave_sizes = []\nfor i in range(num_octaves - 1, -1, -1):\nscale = octave_scale ** i\noctave_sizes.append((int(h / scale), int(w / scale)))\n\n# Start with zeros (detail will be added)\ndetail = torch.zeros_like(image)\n\nfor octave_idx, (oh, ow) in enumerate(octave_sizes):\nif show_progress:\nprint(f\"\\nOctave {octave_idx + 1}/{num_octaves} - Size: {ow}x{oh}\")\n\n# Resize image and detail to current octave size\nscaled_image = torch.nn.functional.interpolate(\noriginal, size=(oh, ow), mode='bilinear', align_corners=False\n)\nscaled_detail = torch.nn.functional.interpolate(\ndetail, size=(oh, ow), mode='bilinear', align_corners=False\n)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_65", "embedding": [ -0.008923611603677273, 0.028514737263321877, 0.03598109632730484, 0.018321679905056953, -0.03669201210141182, -0.023097464814782143, -0.007112872786819935, 0.03038979507982731, -0.1050310954451561, -0.1106843650341034, -0.03746620938181877, -0.03170337155461311, -0.048752591013908386, 0.028193537145853043, -0.047754786908626556, 0.03487348183989525, -0.05269339308142662, 0.02524385042488575, -0.0666358694434166, -0.07248888909816742, 0.09249383956193924, -0.03693012520670891, 0.04824042320251465, -0.03656553104519844, 0.05851294472813606, 0.048773087561130524, 0.013504677452147007, 0.039623674005270004, 0.0628637745976448, -0.01864510215818882, 0.045448921620845795, 0.027626611292362213, -0.011458953842520714, 0.009350410662591457, 0.021409183740615845, -0.01517307199537754, -0.1261214315891266, -0.011825265362858772, 0.017040610313415527, 0.07340244948863983, 0.05122700706124306, 0.06161827594041824, -0.0567772351205349, -0.05712689086794853, 0.049395643174648285, 0.015184137038886547, 0.041400063782930374, -0.04371687397360802, -0.0044958628714084625, -0.020887522026896477, -0.022887002676725388, -0.0099595095962286, -0.04681391641497612, 0.02029016613960266, 0.03547891229391098, -0.01986730843782425, 0.0709104835987091, -0.07388396561145782, -0.01709112711250782, -0.10859321057796478, 0.002521011745557189, 0.024200446903705597, 0.04455088451504707, -0.018521716818213463, -0.008276977576315403, 0.0319913849234581, 0.0039292192086577415, -0.07983934134244919, 0.019323118031024933, 0.008802381344139576, -0.014896327629685402, 0.009995522908866405, 0.04242466762661934, -0.004122474230825901, -0.0219082273542881, -0.07901300489902496, 0.08990877121686935, 0.04850032180547714, 0.012815292924642563, -0.002152977976948023, -0.02633048966526985, -0.05417966842651367, 0.033488448709249496, -0.041855596005916595, 0.03556843474507332, -0.028565729036927223, 0.04574291408061981, 0.027720022946596146, 0.005323460325598717, -0.01885237544775009, -0.021867776289582253, 0.05108356103301048, -0.16493915021419525, 0.016640985384583473, 0.010331651195883751, -0.005300524178892374, 0.036233801394701004, -0.028806589543819427, -0.02649189718067646, 0.032113440334796906, 0.04073449969291687, -0.06309477984905243, 0.02508571371436119, 0.015049594454467297, -0.0022506301756948233, 0.07402939349412918, 0.05206353962421417, 0.11701823770999908, -0.06350914388895035, 0.008510584011673927, 0.027196021750569344, -0.010694798082113266, 0.026698682457208633, 0.023621581494808197, 0.09333227574825287, -0.030701370909810066, -0.010335972532629967, 0.07784222066402435, 0.04863177239894867, 0.014403827488422394, 0.06280584633350372, 0.06450419127941132, 0.010889180935919285, 0.05394415184855461, -0.08063998818397522, 0.04507763311266899, -0.08302231132984161, 5.446895520244926e-33, -0.03829391673207283, -0.003105715150013566, -0.013313991948962212, -0.0021468629129230976, 0.034589216113090515, 0.05467524379491806, 0.044473644345998764, -0.003657354973256588, -0.08336221426725388, -0.05402042716741562, -0.051243048161268234, 0.09781792759895325, -0.004401835612952709, 0.05439523607492447, -0.07457809895277023, -0.012667815200984478, 0.09599016606807709, 0.05557461827993393, -0.004518161062151194, 0.02347327582538128, 0.04773614928126335, 0.013032942079007626, -0.01906781829893589, 0.0021708961576223373, -0.09973626583814621, -0.016604553908109665, -0.016887810081243515, -0.012718054465949535, -0.07215084880590439, -0.043851904571056366, -0.05922260880470276, -0.03573908284306526, -0.0003136445302516222, -0.08017434924840927, 0.007247749716043472, -0.01715308614075184, 0.054890599101781845, 0.02426276169717312, -0.058076564222574234, -0.08628397434949875, 0.033864349126815796, 0.07755875587463379, 0.01912679709494114, -0.08403939753770828, -0.06203173100948334, 0.030508577823638916, -0.04161357134580612, 0.1298915147781372, 0.03332032635807991, 0.009831896051764488, -0.005491542164236307, -0.020473534241318703, -0.003608337137848139, -0.047107938677072525, 0.03602168709039688, -0.03908761963248253, 0.06990725547075272, 0.027603060007095337, 0.09670374542474747, -0.05961725860834122, -0.007653542794287205, 0.025290291756391525, -0.021041754633188248, 0.07103942334651947, -0.027079366147518158, 0.010017584078013897, 0.013333719223737717, -0.0013988143764436245, -0.04640763998031616, 0.00815693661570549, -0.07279994338750839, 0.08756589144468307, 0.005886993370950222, -0.04816756770014763, -0.027336888015270233, -0.1220596581697464, -0.01934574544429779, -0.11282063275575638, -0.08347640931606293, 0.025583529844880104, -0.03418269753456116, 0.03870376572012901, -0.01505263801664114, -0.1742166429758072, -0.019311092793941498, -0.02863427810370922, 0.017609428614377975, 0.00012094186968170106, -0.03965502232313156, -0.082929827272892, -0.095688097178936, -0.06701742112636566, 0.0585760660469532, -0.008142578415572643, -0.06396203488111496, -4.7821707299282004e-33, 0.06029276177287102, 0.029386864975094795, 0.04143810272216797, 0.041321445256471634, -0.02322004735469818, 0.06497011333703995, 0.06777402013540268, 0.028084510937333107, -0.009066334925591946, -0.010973794385790825, 0.03843917325139046, -0.04484812915325165, -0.01370319165289402, -0.11035152524709702, 0.011783470399677753, -0.061249420046806335, -0.046184200793504715, 0.011745146475732327, 0.028004731982946396, 0.006957449018955231, -0.009656556881964207, 0.059888407588005066, -0.0718517079949379, 0.06657379120588303, -0.14341039955615997, 0.05422896891832352, 0.031837157905101776, 0.029459116980433464, -0.04546627029776573, -0.03454321250319481, 0.06320592761039734, -0.09125357121229172, -0.04074195772409439, 0.02872582897543907, 0.02375607378780842, 0.04788310453295708, 0.08072575181722641, -0.06411736458539963, -0.06290038675069809, 0.016834212467074394, 0.06501619517803192, -0.013313370756804943, -0.046769771724939346, 0.05575991049408913, -0.06985028088092804, 0.024518543854355812, -0.006569253280758858, 0.026732908561825752, 0.0014933716738596559, 0.02905489318072796, 0.02063189446926117, -0.057858943939208984, -0.05869843438267708, 0.03899431228637695, -0.04482266679406166, 0.028050463646650314, -0.07380466908216476, 0.00029413445736281574, 0.024738701060414314, -0.009057504124939442, -0.023645132780075073, -0.10350735485553741, -0.001973430160433054, -0.08371595293283463, -0.01567966863512993, 0.026073794811964035, -0.10870188474655151, -0.017552826553583145, 0.04923252761363983, 0.06638175994157791, -0.02668805979192257, 0.06886179745197296, 0.04341452568769455, 0.02474655956029892, -0.02449333295226097, -0.0018966422649100423, 0.02620478719472885, 0.004315704572945833, 0.08504008501768112, 0.004005389288067818, 0.012327345088124275, -0.01309958565980196, 0.01377376914024353, 0.07423444837331772, 0.031638823449611664, 0.04345186799764633, 0.04140718653798103, 0.0998746007680893, 0.006270259618759155, -0.04958454519510269, 0.04867527633905411, 0.00048421870451420546, 0.04226528853178024, 0.02516804076731205, 0.10467235743999481, -4.95696710345328e-08, -0.00401579774916172, -0.014728679321706295, 0.004964369814842939, 0.043835487216711044, -0.017988188192248344, -0.04840116947889328, 0.10382025688886642, -0.03994687646627426, -0.0074708545580506325, -0.04392285272479057, 0.06525716185569763, -0.016898632049560547, -0.0026182453148066998, 0.03569227084517479, 0.013356010429561138, 0.051997486501932144, 0.03787172585725784, 0.013516104780137539, 0.03427707031369209, -0.010949202813208103, -0.06526429951190948, -0.0454411655664444, -0.030296849086880684, -0.016522563993930817, -0.07357358932495117, -0.056189555674791336, -0.008939729072153568, 0.04449858143925667, -0.015986230224370956, 0.02099439688026905, 0.02856626734137535, -0.07245788723230362, 0.11251736432313919, 0.08631712943315506, 0.025159213691949844, -0.06303337961435318, 0.008555503562092781, 0.06016650050878525, 0.012375559657812119, -0.0052694519981741905, -0.049795735627412796, 0.07053717225790024, 0.032103557139635086, -0.040942538529634476, 0.08432475477457047, -0.04184339940547943, -0.008383815176784992, -0.04987775906920433, -0.009313918650150299, 0.13134975731372833, 0.08495036512613297, 0.03474566712975502, -0.06992291659116745, 0.054976727813482285, 0.010110707022249699, -0.06317688524723053, -0.04066336899995804, 0.07708858698606491, -0.0035643496084958315, 0.04787158966064453, 0.051635969430208206, -0.06462346017360687, -0.04471064358949661, -0.04498199746012688 ] }, { "text": "# Add detail from previous octave\ndream_input = scaled_image + scaled_detail\n\n# Dream at this scale\ndreamed = deep_dream(\nmodel,\ndream_input,\nlayer_name,\niterations=iterations_per_octave,\nlearning_rate=learning_rate,\nshow_progress=False\n)\n\n# Extract the detail (difference between dreamed and input)\ndetail = dreamed - scaled_image\n\n# Upscale detail for next octave\nif octave_idx < len(octave_sizes) - 1:\nnext_h, next_w = octave_sizes[octave_idx + 1]\ndetail = torch.nn.functional.interpolate(\ndetail, size=(next_h, next_w), mode='bilinear', align_corners=False\n)\n\n# Final result: original + accumulated detail\nfinal = original + torch.nn.functional.interpolate(\ndetail, size=(h, w), mode='bilinear', align_corners=False\n)\n\nreturn final\n\nprint(\"Multi-scale Deep Dream defined!\")", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_66", "embedding": [ -0.023299945518374443, 0.0018586000660434365, 0.0706317350268364, 0.03213553875684738, -0.04938763007521629, -0.02697628177702427, -0.08342081308364868, 0.039605945348739624, -0.04538680613040924, -0.10908763855695724, -0.06408634036779404, -0.010854380205273628, -0.051327940076589584, -0.009795158170163631, -0.04126888886094093, 0.02499309368431568, -0.03294582664966583, 0.03962671384215355, -0.09479755163192749, -0.06871658563613892, 0.10990604013204575, -0.06290190666913986, 0.05831649899482727, -0.028514385223388672, 0.0608508363366127, 0.036485761404037476, 0.015035047195851803, 0.0963299497961998, 0.0819951519370079, -0.010478544980287552, 0.056828614324331284, 0.025377662852406502, -0.02576085552573204, 0.025983300060033798, -0.005655212327837944, -0.03329452872276306, -0.12494467943906784, 0.019683541730046272, 0.027687469497323036, 0.03453626483678818, 0.051865335553884506, 0.04255354404449463, -0.044687092304229736, -0.048315029591321945, 0.0560058131814003, -0.007210516836494207, 0.006256744731217623, -0.08099506050348282, -0.018264533951878548, -0.014346606098115444, -0.06506835669279099, -0.009700817056000233, -0.001281836535781622, -0.0005586168845184147, 0.05344298109412193, -0.01006404124200344, 0.05708979070186615, -0.0796128362417221, 0.001119218417443335, -0.12094007432460785, 0.006311480887234211, 0.040051303803920746, 0.028974825516343117, -0.03167251497507095, -0.002103130565956235, 0.005847990047186613, -0.007600079756230116, -0.06463286280632019, 0.03871481120586395, 0.004671982955187559, 0.021884499117732048, 0.032857511192560196, 0.02998318336904049, -0.08905008435249329, 0.04654122143983841, -0.08626079559326172, 0.05134099721908569, 0.03650043159723282, -0.004729973617941141, -0.021782120689749718, 0.04876064509153366, -0.02770279347896576, 0.0029002507217228413, -0.057981155812740326, 0.04199518263339996, -0.042027637362480164, 0.0402376614511013, 0.01025720126926899, -0.020387623459100723, -0.03792855888605118, -0.011735967360436916, -0.014889788813889027, -0.1780385673046112, 0.019290948286652565, 0.009479084052145481, 0.0014700337778776884, 0.04270177334547043, -0.05821198597550392, -0.04555705189704895, 0.021004946902394295, 0.028212497010827065, -0.04125738888978958, 0.009584399871528149, -0.009783045388758183, -0.01781454309821129, 0.08548149466514587, 0.08373584598302841, 0.13830426335334778, -0.039661992341279984, -0.035551078617572784, 0.00507917907088995, -0.05521257221698761, 3.683584509417415e-05, 0.05581393837928772, 0.06869268417358398, -0.02534947544336319, 0.012867067940533161, 0.04809890687465668, 0.034454505890607834, 0.04104140028357506, -0.005078969988971949, 0.05787909775972366, -0.02416396327316761, 0.034745991230010986, -0.09202826023101807, 0.01017709355801344, -0.06554489582777023, 5.315847736595411e-33, -0.020958367735147476, -0.0032631754875183105, -0.029659289866685867, -0.017647841945290565, 0.0638401210308075, 0.05674107372760773, 0.017843088135123253, -0.03747992962598801, -0.09759166091680527, -0.03834587335586548, -0.046901244670152664, 0.04175451397895813, -0.019640179350972176, 0.04520655423402786, -0.07073990255594254, -0.006386288441717625, 0.02423255518078804, 0.04822245612740517, 0.03200189396739006, 0.05288412794470787, 0.08111946284770966, 0.016888434067368507, -0.018822183832526207, -0.05655092000961304, -0.09730511158704758, 0.038654133677482605, 0.029150085523724556, 0.034919705241918564, -0.08675938844680786, -0.024703877046704292, -0.02610710822045803, -0.011896663345396519, 0.001746772788465023, -0.07595685869455338, 0.029605930671095848, 0.05606268346309662, 0.09547413885593414, 0.023390423506498337, -0.032357390969991684, -0.09858933836221695, 0.032907288521528244, 0.07282811403274536, 0.0013168971054255962, -0.040529586374759674, -0.03857627511024475, 0.05101104453206062, -0.01713922806084156, 0.10349061340093613, -0.002012845128774643, 0.014596386812627316, -0.010390983894467354, -0.02626066654920578, -0.03238067775964737, -0.08275426924228668, 0.019121529534459114, -0.004250938072800636, 0.1005333960056305, 0.007159889210015535, 0.12094876915216446, -0.016390690580010414, 0.0041597685776650906, -0.004526827950030565, -0.05704798921942711, 0.05500318109989166, 0.008643717505037785, 0.022850945591926575, 0.017991861328482628, 0.02182096615433693, 0.003420148277655244, -0.020432153716683388, -0.044314563274383545, 0.04048095643520355, 0.01978030428290367, -0.031451597809791565, -0.012498007155954838, -0.08167475461959839, -0.013987582176923752, -0.1120091900229454, -0.036169011145830154, 0.04080267995595932, -0.03347254544496536, 0.03356090188026428, -0.033192455768585205, -0.14849859476089478, -0.020479565486311913, 0.0036990626249462366, 0.00017051605391316116, -0.004394794814288616, -0.04051625728607178, -0.03608579561114311, -0.10985137522220612, -0.0812927857041359, 0.06590158492326736, -0.01364055648446083, -0.05273992195725441, -4.4259279833618904e-33, 0.06986790150403976, 0.043127089738845825, 0.023485902696847916, 0.08039693534374237, 0.010014068335294724, 0.00939021073281765, 0.02777017094194889, -0.018929973244667053, 0.008707575500011444, -0.0031740807462483644, 0.04563671350479126, -0.04279366880655289, 0.038554597645998, -0.08396167308092117, 0.039249222725629807, -0.053272660821676254, -0.03145822510123253, -0.03870334103703499, 0.05071939527988434, 0.028691491112113, 0.0028724446892738342, 0.053924091160297394, -0.10295752435922623, 0.04051728546619415, -0.13875479996204376, 0.03491686284542084, 0.023887978866696358, 0.06218261644244194, -0.03894011676311493, -0.031101001426577568, 0.04348358139395714, -0.09158258140087128, -0.0194642785936594, 0.009292379021644592, -0.010411964729428291, 0.09570184350013733, 0.06762095540761948, -0.11493440717458725, -0.05043324828147888, -0.009826851077377796, 0.0728253647685051, -0.020574957132339478, -0.08133599162101746, 0.012131056748330593, -0.027261588722467422, 0.049229443073272705, -0.020623572170734406, 0.01604613848030567, 0.021616201847791672, 0.05891123786568642, 0.026055585592985153, -0.024242643266916275, -0.09727850556373596, 0.01606140471994877, -0.04617680609226227, 0.019781893119215965, -0.06983007490634918, 0.022799905389547348, 0.024837108328938484, -0.013622465543448925, 0.011738291010260582, -0.049796830862760544, -0.021701863035559654, -0.05391881242394447, 0.014070098288357258, 0.041429635137319565, -0.09763582050800323, -0.033675696700811386, 0.06295204907655716, 0.04559013247489929, -0.04795704409480095, 0.06066056713461876, 0.04036968946456909, 0.04929887130856514, 0.011260363273322582, -0.038766734302043915, -0.00794246420264244, -0.015331433154642582, 0.0795370489358902, 0.002100970596075058, -0.01939820684492588, -0.0286914873868227, 0.008760256692767143, 0.09183856844902039, 0.008727826178073883, 0.03627091273665428, 0.048598762601614, 0.12485426664352417, -0.017873117700219154, -0.08469107747077942, 0.032210107892751694, 0.02874801866710186, -0.0076768724247813225, -0.024909352883696556, 0.041432566940784454, -4.961736266295702e-08, -0.014334181323647499, -0.005264121573418379, 0.010505875572562218, 0.08143377304077148, 0.01813822239637375, -0.060291923582553864, 0.0883781835436821, -0.004323861096054316, -0.009646337479352951, -0.047737061977386475, 0.06648189574480057, -0.012708884663879871, 0.0077767991460859776, 0.03245343640446663, 0.054097987711429596, 0.06554814428091049, 0.07327061146497726, 0.009708896279335022, 0.03319275379180908, -0.03984237462282181, -0.053256746381521225, 0.02675049938261509, 0.010555705986917019, -0.04620910435914993, -0.02336645871400833, -0.014269479550421238, -0.05643097311258316, 0.039080001413822174, -0.020411409437656403, 0.012063603848218918, 0.05579141154885292, -0.07759129256010056, 0.12124621123075485, 0.028920525684952736, 0.035778798162937164, -0.03883310407400131, 0.022990336641669273, 0.10492245852947235, 0.036780912429094315, -0.00904675479978323, -0.020047318190336227, 0.07140125334262848, 0.02372933179140091, -0.02971419133245945, 0.03902110829949379, -0.011418478563427925, -0.035271842032670975, -0.08261950314044952, 0.013245698064565659, 0.1396593302488327, 0.05802090838551521, 0.025553854182362556, -0.04581381380558014, 0.044165391474962234, 0.0377785749733448, -0.08263479173183441, -0.04795008897781372, 0.053409505635499954, -0.021031290292739868, 0.032754115760326385, 0.05607978254556656, -0.06668220460414886, -0.08564723283052444, 0.0052988724783062935 ] }, { "text": "return final\n\nprint(\"Multi-scale Deep Dream defined!\")\n\nMulti-scale Deep Dream defined!\n\nFull Flow Visualization¶\n\nOctave 1 (186x186):\nscaled_image ──────────────────┐\n├──→ dream_input ──→ [DREAM] ──→ dreamed\ndetail (zeros) ────────────────┘ │\n│\ndetail = dreamed - scaled_image ←──────┘\n│\n[UPSCALE to 261x261]\n│\n▼\nOctave 2 (261x261):\nscaled_image ──────────────────┐\n├──→ dream_input ──→ [DREAM] ──→ dreamed\ndetail (from octave 1) ────────┘ │\n│\ndetail = dreamed - scaled_image ←──────┘\n│\n[UPSCALE to 365x365]\n│\n▼\n... continue ...\n│\n▼\nFinal: original + detail (upscaled to 512x512)\n\nIn [12]:\n\n# Try the multi-scale version\noctave_dream = deep_dream_octaves(\nmodel,\noriginal_image,\nlayer_name='Mixed_6c',\nnum_octaves=4,\noctave_scale=1.4,\niterations_per_octave=30,\nlearning_rate=0.01\n)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_67", "embedding": [ 0.026578882709145546, -0.005409385543316603, 0.07167655974626541, 0.005443578585982323, -0.006592439487576485, -0.06604855507612228, -0.12492004781961441, -0.03772331401705742, -0.015495490282773972, -0.1071162298321724, -0.012960599735379219, -0.0858197808265686, -0.027297664433717728, -0.03715056553483009, -0.06059480085968971, 0.0024303134996443987, -0.07697563618421555, 0.10384562611579895, -0.11362098902463913, -0.030744824558496475, 0.037326086312532425, -0.03668908402323723, -0.009712780825793743, 0.00280366069637239, 0.07844296842813492, 0.04238362982869148, -0.04404976963996887, 0.07389750331640244, 0.05955375358462334, -0.03475865721702576, 0.08496163040399551, 0.1173979789018631, -0.015497289597988129, 0.05001595616340637, 0.01252677571028471, 0.05713503062725067, -0.07354415953159332, -0.05106359347701073, -0.016783954575657845, 0.013282384723424911, 0.06095201522111893, 0.04248223081231117, -0.007433636114001274, -0.04122307524085045, 0.009143080562353134, 0.02425619401037693, -0.05247652158141136, -0.04700102284550667, 0.0012295091291889548, -0.05530605465173721, -0.06232869625091553, -0.019397901371121407, -0.0539582259953022, 0.02606015093624592, 0.01924128644168377, -0.015797533094882965, 0.0166873037815094, -0.05525293946266174, -0.0003364196454640478, -0.05306166410446167, -0.07740017771720886, 0.03715195134282112, 0.011394047178328037, -0.017697086557745934, 0.022471444681286812, -0.04909222945570946, -0.05457569658756256, -0.0373297855257988, 0.027108829468488693, 0.009303485974669456, -0.029006129130721092, 0.008020661771297455, 0.0563746802508831, -0.05486157909035683, 0.050639841705560684, -0.06155617907643318, 0.0004558662767522037, -0.04749192297458649, -0.011280929669737816, -0.01588534750044346, 0.009709125384688377, -0.03139612823724747, -0.023150578141212463, -0.05744413286447525, 0.012184378691017628, -0.015527560375630856, -0.0013889758847653866, 0.0183829627931118, 0.027404623106122017, -0.02407371997833252, -0.007163474336266518, -0.009088460355997086, -0.17350253462791443, 0.02785872109234333, 0.08990586549043655, 0.010073400102555752, 0.001188752823509276, -0.09989014267921448, 0.002424033125862479, 0.0018192915013059974, 0.04221952334046364, -0.0562007799744606, 0.0857897624373436, 0.018820274621248245, 0.060540709644556046, 0.06748303771018982, 0.07412546873092651, 0.0887918472290039, -0.011294571682810783, -0.09192688763141632, 0.016750318929553032, -0.02809038758277893, 0.04464228078722954, 0.03520463779568672, 0.07805036753416061, -0.011391440406441689, -0.020823800936341286, 0.032983776181936264, -0.02879790961742401, 0.05442572385072708, -0.04241380840539932, 0.03625458851456642, 0.014134137891232967, -0.04875189810991287, -0.09644628316164017, -0.014238285832107067, -0.06891638785600662, 4.391487468250736e-33, -0.04873175919055939, 0.002437814837321639, -0.0013632187619805336, 0.012874814681708813, 0.13502588868141174, 0.04674875736236572, 0.004398052114993334, -0.024352306500077248, -0.09661027789115906, 0.01933230645954609, -0.045355476438999176, 0.044854793697595596, -0.045255813747644424, 0.1723373979330063, -0.029163559898734093, -0.023884287104010582, 0.030745383352041245, 0.015293128788471222, 0.017500469461083412, 0.052866071462631226, 0.0854015052318573, 0.05229257419705391, -0.02100169099867344, -0.0599205456674099, -0.09151950478553772, -0.002663650782778859, 0.04005541652441025, 0.03365005925297737, -0.0598231703042984, 0.011199785396456718, -0.07216399908065796, -0.01527503039687872, 0.018329473212361336, -0.03314743936061859, 0.007022797130048275, 0.04990149661898613, 0.025981765240430832, 0.04483526572585106, -0.057339202612638474, -0.08913952112197876, 0.021028371527791023, 0.056150712072849274, -0.012873157858848572, -0.022174064069986343, -0.03372238948941231, 0.03338493034243584, -0.006430761888623238, 0.1182764545083046, 0.026943637058138847, -0.028597690165042877, 0.03771326318383217, -0.06046117842197418, -0.03533106669783592, -0.11357231438159943, 0.013365224003791809, -0.03438340499997139, 0.07409246265888214, 0.03175559639930725, 0.0453677698969841, -0.006252682767808437, -0.007710459176450968, -0.04412950202822685, -0.09754607826471329, 0.08591596782207489, 0.04208698496222496, 0.04654456675052643, 0.015319239348173141, 0.020008428022265434, -0.01171035971492529, 0.005548209883272648, -0.10195204615592957, 0.039309676736593246, 0.048740074038505554, -0.022949272766709328, -0.01128062978386879, -0.05240939185023308, 0.01930697076022625, -0.0739247277379036, -0.012285296805202961, 0.014490523375570774, -0.03723782300949097, 0.1099114939570427, -0.04015161469578743, -0.11003904044628143, -0.025659551844000816, 0.04744170978665352, -0.012729667127132416, -0.02325354516506195, -0.05397748202085495, 0.023453431203961372, -0.0936962217092514, -0.08213541656732559, 0.08054116368293762, -0.05006131902337074, -0.027142474427819252, -5.1279372504347914e-33, 0.07217789441347122, 0.06593544781208038, -0.0133869219571352, 0.06717380881309509, 0.03407888486981392, -0.057068269699811935, 0.09989707171916962, 0.0069570052437484264, 0.015244956128299236, -0.028130093589425087, 0.058723192662000656, 0.006771428976207972, 0.009909496642649174, -0.06176440417766571, 0.08379910886287689, -0.09267295897006989, -0.009930151514708996, -0.021590065211057663, 0.02604944258928299, 0.002415011404082179, 0.01659804955124855, 0.050301194190979004, -0.06801926344633102, 0.04177432507276535, -0.05882097780704498, 0.018530968576669693, -0.013319811783730984, 0.039151351898908615, -0.004077235236763954, -0.029559684917330742, -0.009471227414906025, -0.0833386778831482, -0.01837879791855812, 0.054771631956100464, 0.061327867209911346, 0.0672016516327858, 0.022305399179458618, -0.10679979622364044, -0.07624869793653488, -0.018167579546570778, 0.032581597566604614, -0.02214687131345272, -0.06943808495998383, 0.027203049510717392, 0.022103579714894295, 0.04020193591713905, 0.03255432844161987, 0.0010797273134812713, 0.05740683153271675, 0.014971882104873657, -0.0040351469069719315, 0.00010270307393511757, -0.05247141048312187, 0.02551206760108471, -0.004705470521003008, -0.01861206255853176, -0.03251121938228607, 0.011615927331149578, 0.04590451717376709, -0.024797121062874794, -0.018407810479402542, -0.0666099488735199, -0.05679072067141533, -0.0697796419262886, -0.038015324622392654, 0.0235445536673069, -0.06768178194761276, 0.001683347043581307, -0.010943695902824402, 0.06795451045036316, -0.006433052010834217, 0.03191366419196129, 0.006317582447081804, 0.01269602868705988, -0.024156903848052025, -0.0461064949631691, -0.08931327611207962, -0.003291820641607046, 0.08988692611455917, 0.030634194612503052, -0.02791527286171913, 0.0018030463252216578, 0.010236386209726334, 0.13120032846927643, 0.091147281229496, -0.022598428651690483, 0.028463883325457573, 0.08061550557613373, 0.033429138362407684, -0.0186017993837595, 0.028628995642066002, 0.031805481761693954, -0.0015664795646443963, 0.018238790333271027, 0.045221712440252304, -5.021669480242963e-08, 0.004850174766033888, -0.03684107959270477, 0.016383791342377663, -0.004737474024295807, 0.02298513986170292, -0.033519383519887924, 0.031385067850351334, 0.02901844121515751, -0.01717708446085453, -0.005900240037590265, 0.06575271487236023, -0.0108566302806139, -0.012818708084523678, 0.00828403327614069, 0.004088947083801031, 0.02198820374906063, 0.004127958323806524, -0.030056564137339592, 0.018520241603255272, -0.07995184510946274, -0.04383232817053795, 0.037345655262470245, 0.0001589669263921678, -0.04265573248267174, -0.029253896325826645, -0.04586802423000336, -0.07618481665849686, 0.07512003928422928, -0.05526161566376686, -0.009103749878704548, 0.1127505674958229, -0.0539800263941288, 0.05614073947072029, 0.01778654381632805, 0.001846371334977448, 0.005157302599400282, -0.0029505575075745583, 0.1132030189037323, 0.06717145442962646, -0.017955660820007324, 0.006781313568353653, 0.03630753979086876, 0.04067255184054375, -0.012865039519965649, 0.04048972576856613, 0.00948389433324337, -0.014793526381254196, -0.07148236781358719, 0.02442423440515995, 0.17005524039268494, 0.03307553380727768, 0.05686754360795021, -0.026542803272604942, 0.10158602148294449, 0.034405726939439774, -0.1286436915397644, -0.054585255682468414, 0.02098223567008972, -0.03407072648406029, 0.05053321644663811, 0.05808504298329353, -0.022236481308937073, -0.03498757630586624, -0.007779731415212154 ] }, { "text": "show_image(octave_dream, \"Multi-Scale Deep Dream (Mixed_6c)\")\n\nOctave 1/4 - Size: 112x145\n\nOctave 2/4 - Size: 158x204\n\nOctave 3/4 - Size: 221x285\n\nOctave 4/4 - Size: 310x400\n\n8. Compare Different Layers¶\n\nLet's visualize what different layers \"see\" by dreaming on multiple layers.\n\nIn [13]:\n\ndef compare_layers(model, image, layers, **kwargs):\n\"\"\"Dream on multiple layers and display results side by side.\"\"\"\nn_layers = len(layers)\nfig, axes = plt.subplots(1, n_layers + 1, figsize=(5 * (n_layers + 1), 5))\n\n# Show original\naxes[0].imshow(tensor_to_image(image))\naxes[0].set_title(\"Original\")\naxes[0].axis('off')", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_68", "embedding": [ 0.01603993959724903, -0.02604902721941471, 0.10097475349903107, -0.02563859149813652, 0.042264267802238464, -0.018448712304234505, -0.08774247765541077, -0.006629341281950474, 0.036825232207775116, -0.1064157709479332, -0.03805021941661835, -0.0789131373167038, -0.00023966975277289748, 0.02829628251492977, -0.10105332732200623, -0.016531143337488174, -0.004915435798466206, 0.0438135527074337, -0.07798168063163757, -0.031914014369249344, 0.0455315075814724, -0.017493989318609238, 0.015374097041785717, -0.006680620368570089, 0.06240968406200409, 0.023243507370352745, -0.04200172424316406, 0.07066241651773453, 0.027103958651423454, -0.008715242147445679, 0.037302929908037186, 0.041669636964797974, -0.0038413952570408583, 0.062342092394828796, -0.02323256991803646, 0.05503109470009804, -0.0707445964217186, -0.040354110300540924, -0.02083982527256012, -0.017543170601129532, 0.03942247852683067, 0.030849330127239227, 0.0010469352127984166, -0.04446424916386604, 0.0045834979973733425, 0.06213515251874924, -0.05179005116224289, -0.04147874563932419, 0.03132865950465202, -0.02552076056599617, -0.052033837884664536, -0.023792535066604614, -0.08084610104560852, 0.00573250837624073, 0.009997684508562088, 0.022747362032532692, 0.03788287192583084, -0.03934365138411522, -0.011051411740481853, -0.019036345183849335, -0.058094728738069534, 0.03819826617836952, 0.029230494052171707, -0.029834268614649773, 0.0647789016366005, 0.012780646793544292, -0.021976159885525703, -0.014460034668445587, -0.005553794093430042, 0.004927979316562414, 0.006564630661159754, 0.028079118579626083, 0.016388557851314545, -0.0027628792449831963, -0.004967158660292625, -0.013451485894620419, 0.02732149139046669, -0.08107039332389832, -0.031065018847584724, -0.06505150347948074, -0.004897285718470812, -0.031284399330616, -0.015867779031395912, -0.044402774423360825, -0.0077315219677984715, -0.09089478105306625, 0.0381719209253788, -0.027342282235622406, -0.00922128651291132, -0.07192616909742355, 0.007058831863105297, -0.001682085101492703, -0.13217982649803162, 0.05662965029478073, 0.0777987465262413, 0.011234073899686337, -0.000895973586011678, -0.01644252799451351, -0.011108234524726868, 0.008579052053391933, 0.05562836304306984, -0.10385370254516602, 0.04643020033836365, -0.010358450934290886, 0.06819611042737961, 0.09584379196166992, 0.09477458894252777, 0.004638475365936756, -0.02658942900598049, -0.1184956282377243, -0.03947005048394203, -0.02184748277068138, -0.010571726597845554, 0.0796956792473793, 0.1414966583251953, -0.015683839097619057, -0.01932918094098568, 0.10246319323778152, -0.024625854566693306, -0.001592773711308837, -0.019350331276655197, 0.03365039452910423, 0.05903538316488266, -0.022078733891248703, -0.029499324038624763, 0.021482884883880615, -0.07217448949813843, 6.839026133084069e-33, -0.009052063338458538, -0.011479056440293789, 0.019607622176408768, 0.008242773823440075, 0.060423169285058975, 0.00693249236792326, -0.011073270812630653, -0.07244355231523514, -0.04082290828227997, 0.047811053693294525, -0.03915167972445488, 0.13935495913028717, -0.006547101773321629, 0.11293014883995056, 0.024544231593608856, -0.048773255199193954, 0.012088545598089695, -0.02195058763027191, -0.01319615077227354, 0.03533126786351204, 0.0018488036002963781, 0.021147342398762703, -0.015501040033996105, -0.016155770048499107, -0.0819808691740036, -0.05172447860240936, -4.9446639422967564e-06, 0.003220674116164446, -0.0284167118370533, -0.03183893486857414, -0.06643468141555786, 0.004014278762042522, -0.027660837396979332, -0.07097326219081879, -0.021354928612709045, 0.01920018531382084, 0.060019977390766144, 0.04234934598207474, -0.03691112622618675, -0.04109117388725281, -0.022656885907053947, 0.020732009783387184, -0.030016237869858742, -0.06847674399614334, -0.024811778217554092, 0.04874516651034355, -0.07350228726863861, 0.12706413865089417, 0.003129762364551425, -0.005645574536174536, 0.04532400891184807, -0.06519398838281631, -0.020209843292832375, -0.056773699820041656, 0.03589401766657829, -0.03956298902630806, 0.052574656903743744, 0.025569023564457893, 0.08589709550142288, -0.0056024580262601376, 0.022808296605944633, -0.04511471092700958, -0.031212572008371353, 0.02601444348692894, -0.016273729503154755, 0.06941816210746765, 0.05826141685247421, -0.012233643792569637, -0.050363291054964066, 0.050391532480716705, -0.10248950123786926, 0.08629321306943893, 0.028446786105632782, -0.043130915611982346, 0.015555907972157001, -0.08134883642196655, -0.0804925411939621, -0.022422976791858673, -0.03420623391866684, 0.040785469114780426, -0.011513552628457546, 0.0889875516295433, -0.023692091926932335, -0.15888839960098267, -0.08645717054605484, 0.024006081745028496, 0.026483189314603806, -0.014061019755899906, -0.047857820987701416, 0.023017223924398422, -0.059512604027986526, -0.04134198650717735, 0.10421213507652283, -0.015451508574187756, -0.05057895556092262, -6.69249194604644e-33, 0.06082140654325485, 0.05466469004750252, 0.04755523428320885, 0.0635649636387825, -0.003702152520418167, -0.03421686962246895, 0.1168404221534729, 0.04697226360440254, -0.03729995712637901, 0.0520014725625515, 0.07723100483417511, -0.05273723602294922, 0.00291623966768384, -0.0961398258805275, 0.08293627947568893, -0.07361381500959396, -0.02604391798377037, 0.012255760841071606, 0.04633014649152756, -0.03556910157203674, -0.037369780242443085, 0.07731115818023682, -0.0482817143201828, 0.01914663054049015, -0.10257607698440552, 0.06977830827236176, -0.010623828507959843, -0.008293483406305313, -0.007931401021778584, -0.11166892945766449, -0.007280151359736919, -0.039620548486709595, -0.05396248400211334, 0.03127320483326912, 0.07209297269582748, 0.09790531545877457, 0.030250608921051025, -0.1133098229765892, -0.08243560045957565, 0.027919236570596695, -0.019312165677547455, 0.0246073380112648, -0.0460529588162899, 0.015792300924658775, -0.03247595578432083, 0.0493849478662014, -0.0323793888092041, 0.03388185054063797, 0.04770953953266144, -0.023132218047976494, -0.00499320263043046, 0.04264465719461441, -0.03899296000599861, -0.05305157229304314, -0.015248636715114117, -0.045602284371852875, -0.07717201858758926, 0.020308779552578926, 0.03551353141665459, 0.026461876928806305, 0.008113788440823555, -0.09429648518562317, -0.09556557983160019, -0.013521374203264713, -0.05064104124903679, 0.027305109426379204, -0.0720747709274292, -0.0016151175368577242, 0.061345044523477554, 0.09273301810026169, -0.0004859073960687965, -0.02022836171090603, 0.03833447024226189, -0.03861602023243904, 0.0026015203911811113, -0.0014800371136516333, -0.07007677108049393, 0.040547631680965424, 0.0834241434931755, 0.018602605909109116, -0.016789738088846207, -0.05785459280014038, 0.014250418171286583, 0.08331487327814102, 0.007972938008606434, 0.06024136394262314, 0.009362013079226017, 0.08260554820299149, 0.03947722539305687, -0.0009372326312586665, 0.021377811208367348, -0.06215175613760948, 0.06018899381160736, 0.01427418552339077, 0.07235521078109741, -5.226237576039239e-08, 0.06968206912279129, -0.030934730544686317, 0.09556803852319717, -0.01875719614326954, -0.07269786298274994, -0.018600089475512505, 0.03793209046125412, 0.02113780379295349, -0.043180856853723526, 0.04817412793636322, 0.0127811124548316, -3.6095778341405094e-05, -0.06017296761274338, 0.046764351427555084, -0.03550303354859352, 0.01968848519027233, -0.06790152937173843, -0.00440224539488554, 0.06674923002719879, -0.011899515986442566, 0.002295103622600436, 0.01765899732708931, -0.02643474005162716, 0.02404138632118702, -0.06797964125871658, 0.034273888915777206, -0.06883583962917328, 0.06063662841916084, -0.049345649778842926, 0.049917250871658325, 0.11960957944393158, -0.08300119638442993, 0.07528248429298401, -0.02738049253821373, 0.06892610341310501, 0.029538163915276527, -0.026642151176929474, 0.08851572126150131, 0.03428288549184799, 0.06622037291526794, -0.058750808238983154, -0.04179389029741287, 0.05656617134809494, -0.010556211695075035, 0.10764917731285095, -0.002475655870512128, 0.036762189120054245, -0.09500575065612793, 0.014666208997368813, 0.08721672743558884, 0.02369699440896511, 0.001823565922677517, -0.04685497656464577, 0.04111930727958679, 0.031183257699012756, -0.087506003677845, -0.03283274918794632, 0.009264538995921612, 0.026616171002388, 0.04776051267981529, 0.0193927101790905, -0.018152186647057533, -0.02358938194811344, -0.040134724229574203 ] }, { "text": "# Show original\naxes[0].imshow(tensor_to_image(image))\naxes[0].set_title(\"Original\")\naxes[0].axis('off')\n\n# Dream on each layer\nfor idx, layer in enumerate(layers):\nprint(f\"\\nProcessing layer: {layer}\")\ndreamed = deep_dream_octaves(model, image, layer, show_progress=False, **kwargs)\naxes[idx + 1].imshow(tensor_to_image(dreamed))\naxes[idx + 1].set_title(f\"{layer}\")\naxes[idx + 1].axis('off')\n\nplt.tight_layout()\nplt.show()\n\n# Compare early vs deep layers\ncompare_layers(\nmodel,\noriginal_image,\n['Mixed_5b', 'Mixed_6b', 'Mixed_7b'],\nnum_octaves=3,\niterations_per_octave=30\n)\n\nProcessing layer: Mixed_5b\n\nProcessing layer: Mixed_6b\n\nProcessing layer: Mixed_7b\n\n9. Why Do We See Dogs and Eyes?¶", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_69", "embedding": [ -0.026226019486784935, -0.01249076146632433, 0.053648706525564194, -0.019268982112407684, 0.055591486394405365, -0.022784635424613953, -0.06780029833316803, 0.030530186370015144, 0.05320407822728157, -0.07390027493238449, 0.0015503050526604056, -0.03376532718539238, -0.010901421308517456, -0.010099807754158974, -0.08468684554100037, -0.03741583228111267, -0.037834636867046356, -0.014803166501224041, -0.0750514343380928, -0.05074311047792435, 0.01803428679704666, 0.011295735836029053, 0.03808341920375824, -0.006920071318745613, 0.016741642728447914, 0.04358828440308571, -0.013079791329801083, 0.07988347113132477, 0.07136675715446472, -0.033914048224687576, 0.018248479813337326, 0.07871498167514801, 0.012758336961269379, 0.06251645088195801, -0.04617278277873993, 0.07984642684459686, -0.06544637680053711, -0.06714853644371033, -0.038850776851177216, -0.0011226501083001494, 0.032548047602176666, 0.03581690415740013, -0.02613292634487152, -0.03855610266327858, 0.011425076983869076, 0.08790355920791626, -0.014587544836103916, -0.051296018064022064, 0.00568452849984169, -0.0035913095343858004, -0.06041080132126808, -0.007785484194755554, -0.06963016837835312, -0.0011819583596661687, 0.047523222863674164, 0.0591125525534153, 0.056128665804862976, -0.004686650354415178, -0.05339870974421501, -0.030543627217411995, -0.09115047752857208, 0.036553315818309784, -0.0015437272377312183, -0.043035704642534256, 0.05426874756813049, -0.028817374259233475, -0.014714236371219158, 0.006409920286387205, -0.00447721965610981, 0.022225061431527138, 0.03728383034467697, 0.026803569868206978, 0.00998462364077568, 0.015245320275425911, -0.038674406707286835, -0.04647492244839668, 0.07488153129816055, -0.06438767164945602, -0.020782023668289185, -0.08572696149349213, -0.018088404089212418, -0.03229817375540733, -0.008570120669901371, -0.04045788198709488, 0.027380969375371933, -0.051992859691381454, 0.022152459248900414, -0.008888798765838146, -0.023853110149502754, -0.06255926191806793, 0.047245677560567856, -0.02515963278710842, -0.10883570462465286, 0.07794586569070816, 0.12530510127544403, 0.04443052038550377, 0.00807125587016344, 0.02081330120563507, -0.04342302680015564, 0.03948407992720604, 0.029191911220550537, -0.08806692063808441, 0.0012276238994672894, 0.031451787799596786, 0.035866379737854004, 0.06445091962814331, 0.10415469855070114, 0.0235157273709774, -0.06376123428344727, -0.10350188612937927, -0.01805964671075344, 0.004211318213492632, 0.028152937069535255, 0.04299669712781906, 0.09631839394569397, -0.0335894450545311, -0.017703985795378685, 0.07711627334356308, -0.0055956169962882996, -0.027499455958604813, 0.001499708741903305, 0.04623746871948242, 0.015516899526119232, 0.024212371557950974, -0.11892999708652496, -0.012584876269102097, -0.06873539090156555, 2.802013761769594e-33, -0.009314478375017643, -0.0649862289428711, -0.015101070515811443, -0.045214202255010605, 0.004981439560651779, 0.01767834462225437, 0.007953447289764881, -0.025863924995064735, -0.017433099448680878, 0.07542939484119415, -0.07848188281059265, 0.07679124921560287, -0.032390180975198746, 0.09579973667860031, 0.0029539745301008224, -0.08181015402078629, 0.017240632325410843, 0.04173511639237404, -0.039829522371292114, 0.04384342208504677, 0.046793803572654724, 0.011681673116981983, -0.019732115790247917, -0.040921591222286224, -0.08884481340646744, 0.018830183893442154, 0.0012433560332283378, 0.0013209208846092224, -0.050094302743673325, -0.021781571209430695, -0.08470487594604492, -0.03686663135886192, -0.02386690117418766, -0.06892623007297516, -0.06740192323923111, 0.00527764018625021, 0.05532519146800041, 0.022402001544833183, -0.06305691599845886, -0.11268269270658493, -0.000935286923777312, 0.04379831254482269, -0.0218946635723114, -0.06561321765184402, -0.033458415418863297, 0.035546787083148956, -0.08334566652774811, 0.12537957727909088, 0.01440166961401701, 0.015897134318947792, 0.06952643394470215, -0.02434568479657173, -0.022719724103808403, -0.06043585389852524, -0.01630742847919464, -0.030589865520596504, 0.09641169011592865, 0.031240593641996384, 0.024352798238396645, 0.004148448351770639, 0.007251757197082043, -0.019311994314193726, -0.03453879430890083, 0.06432287395000458, -0.012784931808710098, 0.0766085609793663, 0.07499060034751892, 0.010517731308937073, -0.0303195770829916, 0.050813011825084686, -0.1276286542415619, 0.07866205275058746, -0.043862611055374146, -0.0516216941177845, 0.039445698261260986, -0.08904847502708435, -0.05725768953561783, -0.07964509725570679, -0.031553126871585846, -0.004409490153193474, 0.0039818002842366695, 0.13275352120399475, -0.0728442594408989, -0.12230565398931503, -0.08031685650348663, -0.0014089590404182673, 0.03466397523880005, -0.0011250798124819994, -0.02173590660095215, 0.021512748673558235, -0.059992965310811996, -0.034919340163469315, 0.09246718138456345, 0.028378015384078026, -0.04633845388889313, -4.230877103703994e-33, 0.08012238889932632, 0.04436947777867317, 0.020105626434087753, 0.053701359778642654, -0.03764655068516731, -0.032630737870931625, 0.12496955692768097, 0.023856831714510918, -0.022155724465847015, 0.03519974276423454, 0.05671043321490288, -0.06969672441482544, -0.04236679524183273, -0.10403002053499222, 0.10304925590753555, -0.07071191072463989, -0.06233835965394974, 0.012090092524886131, 0.008961241692304611, -0.039135437458753586, -0.007756062783300877, 0.09231896698474884, -0.0641220211982727, 0.01792195998132229, -0.09255769103765488, 0.06022835895419121, -0.009065446443855762, 0.04537850618362427, -0.005658952984958887, -0.07439521700143814, -0.0005816681659780443, -0.049709778279066086, -0.09479085355997086, 0.06695651262998581, 0.06221996620297432, 0.0991445779800415, 0.022107770666480064, -0.10818809270858765, -0.09920266270637512, 0.047056812793016434, 0.01720438152551651, 0.07231312990188599, -0.009785240516066551, 0.07694550603628159, -0.05351722612977028, 0.08326058834791183, -0.04516756162047386, 0.035951487720012665, 0.06977210193872452, -0.016850553452968597, 0.0268073882907629, -0.009573834016919136, 0.00679229199886322, -0.002114225411787629, -0.02496461197733879, -0.013541708700358868, -0.08518905192613602, -0.029054297134280205, 0.007812189403921366, 0.031723085790872574, 0.006171683315187693, -0.08636126667261124, -0.09935164451599121, -0.03716205433011055, -0.04764482378959656, 0.04086492583155632, -0.09759490191936493, 0.0031137941405177116, 0.0579678900539875, 0.06595158576965332, 0.021733978763222694, 0.00783490389585495, 0.0058630104176700115, -0.007724414579570293, -0.025518331676721573, 0.008587297052145004, -0.0458034947514534, 0.023614617064595222, 0.04611022397875786, 0.00795651227235794, -0.027403900399804115, -0.04150288179516792, 0.015150539577007294, 0.09063021838665009, -0.000622196530457586, 0.07075366377830505, 0.007749634794890881, 0.07514292001724243, 0.053936947137117386, -0.0035016329493373632, 0.03299683332443237, -0.036767181009054184, 0.07030728459358215, 0.05205906555056572, 0.04049684852361679, -5.116029555551904e-08, -0.039952754974365234, -0.048945337533950806, 0.07362722605466843, -0.023104697465896606, -0.040405046194791794, -0.020495444536209106, 0.004000767134130001, 0.016895415261387825, 0.01610468327999115, 0.0029985588043928146, 0.010515669360756874, -0.021626880392432213, -0.08180565387010574, 0.021561218425631523, -0.028087574988603592, 0.028240935876965523, -0.03385617211461067, 0.0010557647328823805, 0.08895605057477951, -0.025917375460267067, -0.01662737876176834, 0.0016261663986369967, -0.00830002035945654, -0.026070166379213333, -0.06629351526498795, -0.02849542908370495, -0.04929576814174652, 0.09255888313055038, -0.019413214176893234, 0.08197513222694397, 0.11310466378927231, -0.041116710752248764, 0.09845935553312302, 0.04568929970264435, 0.03526236116886139, 0.06705772131681442, 0.010701116174459457, 0.07532058656215668, 0.014178471639752388, 0.04833894595503807, -0.07030844688415527, -0.003447495633736253, 0.000549032527487725, -0.020234422758221626, 0.07926859706640244, -0.035501062870025635, -0.008372283540666103, -0.0477028414607048, 0.02706647664308548, 0.03188115358352661, -0.005427737254649401, -0.010724847204983234, -0.019423946738243103, 0.0433904193341732, 0.02013530395925045, -0.06939299404621124, -0.004178876057267189, -0.0298110693693161, 0.03202188387513161, 0.05166488513350487, 0.012248470447957516, -0.019747091457247734, -0.009778068400919437, -0.032502785325050354 ] }, { "text": "Processing layer: Mixed_5b\n\nProcessing layer: Mixed_6b\n\nProcessing layer: Mixed_7b\n\n9. Why Do We See Dogs and Eyes?¶\n\nYou might notice that Deep Dream often produces animal-like features, eyes, and fur patterns. This isn't random—it's because:\n\n• InceptionV3 was trained on ImageNet, which has over 100 dog breeds (out of 1000 total classes)\n•\n\n• The network has learned to be very good at detecting animal features\n•\n\n• When we amplify activations, we amplify whatever patterns the network knows best\n•\n\nThis is actually a profound insight into neural networks: they have biases based on their training data, and those biases become visible through techniques like Deep Dream.\n\nConnection to Modern AI Interpretability¶", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_70", "embedding": [ -0.025255218148231506, -0.06620901823043823, 0.12111783772706985, 0.060471151024103165, 0.0813451036810875, 0.008723474107682705, -0.020936448127031326, -0.10431651026010513, 0.04224717244505882, -0.03528184816241264, -0.06803397089242935, -0.0779910460114479, -0.052358075976371765, -0.04798520728945732, -0.08372364938259125, -0.0073402258567512035, 0.005490283016115427, -0.013746177777647972, -0.10802572220563889, -0.0021648535039275885, 0.024632232263684273, 0.00606224499642849, 0.019243648275732994, -0.06933686882257462, -0.00908668152987957, 0.011057625524699688, -0.008100789040327072, -0.05361655727028847, 0.0445982851088047, -0.07012320309877396, 0.06098361685872078, 0.05859687551856041, -0.017117096111178398, 0.04565482586622238, -0.0373203344643116, 0.023968705907464027, -0.05085815489292145, -0.02460205927491188, -0.014351947233080864, -0.032635536044836044, 0.0068308040499687195, -0.03801892325282097, -0.02068234793841839, 0.0003521157777868211, 0.01674874685704708, 0.0194338820874691, -0.03357062488794327, -0.0965735986828804, -0.018499234691262245, -0.024348748847842216, -0.12035548686981201, -0.04782474413514137, 0.008215624839067459, 0.052951619029045105, -0.0036358146462589502, -0.028161022812128067, -0.06304635107517242, 0.04744237661361694, -0.022114785388112068, 0.011775961145758629, 0.002329722512513399, -0.017942924052476883, 0.042425937950611115, -0.0036718558985739946, 0.025437254458665848, 0.002415404189378023, -0.07780555635690689, 0.01721341721713543, 0.09360881894826889, -0.13550032675266266, 0.04109766706824303, 0.09126192331314087, 0.0008213453693315387, -0.04255945608019829, 0.0408538281917572, 0.02058645710349083, 0.014071258716285229, -0.060793161392211914, 0.08497019112110138, -0.09836147725582123, 0.015909472480416298, -0.02921864204108715, 0.03544500842690468, 0.0023105440195649862, 0.08200158178806305, 0.02727782540023327, -0.09679988026618958, -0.04862957447767258, -0.15588980913162231, 0.042669061571359634, -0.0276053287088871, -0.09134839475154877, -0.07174009084701538, -0.04289695993065834, 0.09040037542581558, 0.029681194573640823, -0.008391891606152058, -0.1059744730591774, 0.00914706476032734, 0.007803782820701599, -0.03716107830405235, -0.05219770967960358, 0.018589328974485397, 0.011729156598448753, 0.034733619540929794, -0.01838110201060772, 0.07180802524089813, 0.008369470946490765, 0.008641907945275307, -0.057649049907922745, -0.0369020439684391, 0.047710176557302475, -0.005900188349187374, 0.01249248068779707, 0.0376179963350296, -0.025326702743768692, -0.07485122233629227, 0.005102687049657106, 0.020123271271586418, 0.06327410787343979, -0.0599137619137764, 0.06753227859735489, 0.009462895803153515, -0.017472075298428535, -0.005887196399271488, 0.012467893771827221, -0.002968902001157403, 3.007451970726928e-33, 0.02100362628698349, -0.06858471035957336, -0.03503614291548729, 0.015898702666163445, 0.08764215558767319, -0.01937781646847725, 0.021621083840727806, -0.03282501548528671, -0.04715893417596817, 0.03334680572152138, -0.06336446106433868, 0.04793776571750641, -0.03102530539035797, 0.1511489599943161, 0.05977702513337135, 0.0003537967859301716, -0.03456585481762886, 0.008767622523009777, 0.055870477110147476, 0.005903132725507021, -0.037066515535116196, 0.054620057344436646, -0.012097775004804134, -0.03809456527233124, -0.026194730773568153, 0.026260020211338997, -0.0015871820505708456, -0.01816920004785061, -0.005235873628407717, 0.03417704626917839, -0.08640512824058533, 0.06705264002084732, 0.012828024104237556, -0.005780636798590422, -0.003853234928101301, 0.054123688489198685, 0.051248736679553986, -0.027380451560020447, -0.055723510682582855, -0.007126598618924618, 0.10013692826032639, 0.0083314199000597, -0.020534679293632507, -0.026481326669454575, -0.0471174493432045, 0.08044109493494034, -0.011070501059293747, 0.04062100127339363, -0.047214727848768234, 0.014067085459828377, 0.026935547590255737, 0.024832533672451973, 0.059439778327941895, -0.10246174782514572, 0.0362292155623436, 0.05325385928153992, 0.023936977609992027, 0.045448027551174164, 0.016460085287690163, 0.0655648410320282, 0.03386266902089119, 0.03413042798638344, -0.002139665884897113, 0.049280256032943726, -0.0007970819133333862, -0.00878379587084055, -0.00645469781011343, 0.021899009123444557, 0.00678623840212822, -0.001017375267110765, -0.029637034982442856, 0.04241027310490608, -0.005001128651201725, -0.03235898166894913, 0.004672992508858442, 0.009725617244839668, -0.04557967931032181, -0.012874463573098183, -0.03585289046168327, 0.045249082148075104, 0.04605916142463684, 0.13920405507087708, -0.05792553350329399, 0.0012706437846645713, -0.07116921246051788, 0.10139729827642441, -0.012122897431254387, -0.05545125529170036, -0.02521217241883278, 0.07363571226596832, 0.023159576579928398, -0.060433901846408844, 0.08553958684206009, -0.05047149956226349, -0.05928957834839821, -4.781148049842985e-33, -0.08509937673807144, 0.03431493416428566, -0.056381694972515106, 0.03773503005504608, -0.042133692651987076, -0.01691621169447899, 0.016364775598049164, -0.0416923463344574, 0.014053466729819775, 0.11157455295324326, 0.05600994825363159, 0.005964783951640129, 0.010385584086179733, -0.017410583794116974, 0.028753966093063354, -0.08097323030233383, -0.03584602102637291, 0.023233285173773766, 0.0775613859295845, -0.04407834634184837, 0.014298656024038792, 0.08423503488302231, -0.09846987575292587, -0.015112144872546196, -0.034381452947854996, 0.04746000096201897, -0.063494011759758, 0.05515525862574577, 0.026784583926200867, -0.052458714693784714, -0.05088910087943077, -0.01370897889137268, -0.08046931773424149, 0.027392329648137093, 0.0434407964348793, 0.03934334218502045, 0.013856027275323868, -0.07521157711744308, -0.015863612294197083, -0.046073414385318756, -0.005192537792026997, -0.051366038620471954, -0.08999059349298477, 0.013110988773405552, 0.012664876878261566, -0.0012473033275455236, 0.003276111790910363, 0.011150847189128399, 0.019997239112854004, 0.03432978317141533, 0.01638435572385788, 0.02250470221042633, -0.10842682421207428, -0.020128492265939713, -0.0949302613735199, 0.0034042554907500744, -0.002868905896320939, 0.06133027747273445, 0.07974901050329208, 0.09901754558086395, 0.016198690980672836, -0.002749066101387143, -0.053355783224105835, 0.02795967273414135, -0.03531283885240555, 0.02913844771683216, -0.059110354632139206, -0.004722400568425655, 0.0785473883152008, -0.09799560159444809, 0.06675009429454803, -0.039228152483701706, -0.022954070940613747, 0.09712178260087967, 0.002174563240259886, -0.010355529375374317, -0.015308724716305733, -0.0013986903941258788, 0.0252423956990242, 0.05645159259438515, -0.03428128361701965, -0.10888000577688217, -0.002222664887085557, 0.09129153937101364, 0.10514529794454575, 0.031826313585042953, -0.04267245903611183, 0.029737453907728195, 0.06682145595550537, -0.004186562262475491, -0.057385556399822235, 0.02334856241941452, -0.06982754915952682, 0.03612825646996498, -0.060420580208301544, -4.7533820435319285e-08, -0.010126173496246338, -0.04242647811770439, 0.04456038028001785, 0.02781643159687519, 0.039257656782865524, -0.012101677246391773, -0.025019103661179543, 0.04277760162949562, -0.06916205585002899, 0.022239476442337036, 0.018108725547790527, -0.019540857523679733, -0.11443588882684708, 0.00044131188769824803, 0.09827791899442673, 0.043082717806100845, -0.03229892626404762, 0.042003147304058075, 0.04335971176624298, 0.007736812811344862, 0.05722058191895485, 0.013732951134443283, -0.0250035859644413, -0.0609663724899292, 0.01950441673398018, -0.08628492802381516, -0.046851955354213715, 0.0771254450082779, -0.10734810680150986, 0.02406204119324684, 0.011576369404792786, 0.04104127362370491, 0.02197444811463356, -0.06906849890947342, 0.029135579243302345, 0.0550931915640831, -0.0017357959877699614, -0.02321600541472435, 0.02361166477203369, 0.00780990906059742, 0.02080107480287552, 0.04642960801720619, 0.050955869257450104, -0.038277775049209595, -0.02398819290101528, -0.015278443694114685, 0.03720761835575104, -0.1103290468454361, 0.058239683508872986, 0.09304101765155792, -0.07102076709270477, 0.02329687960445881, 0.04447508603334427, 0.05426940694451332, 0.030433697625994682, -0.05729491636157036, 0.01121705211699009, -0.11016973108053207, -0.0037354205269366503, 0.06778919696807861, 0.06995384395122528, 0.09801134467124939, -0.04463689774274826, -0.033884428441524506 ] }, { "text": "Connection to Modern AI Interpretability¶\n\nDeep Dream was one of the first \"feature visualization\" techniques. Today, researchers use similar ideas to:\n\n• Understand what models have learned (interpretability)\n•\n\n• Find model biases (fairness)\n•\n\n• Create adversarial examples (security)\n•\n\n• Generate art (creative AI)\n•\n\nThe core principle—using gradients to modify inputs—remains fundamental.\n\n10. Try Your Own Images!¶\n\nHere's a convenient function to dream on any image:\n\nIn [14]:\n\ndef dream_on_image(\nimage_path_or_url: str,\nlayer: str = 'Mixed_6c',\nmax_size: int = 512,\nnum_octaves: int = 4,\niterations: int = 10,\nlearning_rate: float = 0.01\n):\n\"\"\"\nConvenient function to apply Deep Dream to any image.", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_71", "embedding": [ -0.03748859837651253, -0.01923411525785923, 0.009449758566915989, 0.03377246856689453, 0.046929046511650085, -0.04753081873059273, -0.08905889838933945, -0.014679106883704662, 0.0015898379497230053, -0.06749578565359116, -0.09749609977006912, 0.00480111688375473, 0.04274411126971245, 0.01982523500919342, -0.05906152352690697, 0.029862772673368454, -0.013882876373827457, 0.09101956337690353, -0.07686549425125122, -0.07161339372396469, 0.027885667979717255, -0.0326414629817009, -4.0268958400702104e-05, -0.029143832623958588, 0.03621688857674599, -0.012652978301048279, -0.009515859186649323, -0.02084551937878132, -0.001974535873159766, -0.03123372793197632, 0.038508251309394836, 0.007794053293764591, 0.023919785395264626, 0.013124275952577591, -0.026784859597682953, 0.07325107604265213, -0.044394027441740036, -0.013354181312024593, 0.01357599813491106, -0.03323082625865936, 0.0386272557079792, -0.029574379324913025, 0.026629766449332237, -0.054140061140060425, 0.035072971135377884, 0.0047467793338000774, 3.400901914574206e-05, -0.07749028503894806, -0.015358041040599346, -0.014138531871140003, -0.1382339894771576, -0.007368949241936207, -0.03740547224879265, 0.006232063751667738, 0.020187029615044594, 0.005846190731972456, 0.02792838215827942, 0.017087681218981743, 0.028733788058161736, -0.06377539783716202, -0.006078963167965412, 0.0020000203512609005, 0.05930597335100174, 0.01068231463432312, 0.01433095894753933, -0.05805423483252525, -0.032473012804985046, 0.0250895693898201, 0.06833094358444214, -0.07826092839241028, 0.022808434441685677, 0.051275502890348434, -0.03829440474510193, -0.02765830047428608, 0.05878298357129097, 0.021595342084765434, 0.04547175019979477, -0.007320266682654619, 0.030720829963684082, -0.04829520732164383, 0.006659659557044506, -0.03549927473068237, 0.0338396392762661, 0.005254512652754784, 0.03306815028190613, 0.00023360019258689135, -0.009471102617681026, 0.010273815132677555, 0.04942886531352997, 0.05471030995249748, 0.0274184737354517, -0.084053635597229, -0.10350558906793594, 0.0003909800434485078, 0.09518049657344818, 0.03737425431609154, 0.00978730246424675, -0.18483436107635498, -0.09657689929008484, -0.007243296597152948, -0.015659475699067116, -0.013702132739126682, 0.06308314204216003, -0.044915299862623215, 0.050447143614292145, 0.022704225033521652, 0.1417613923549652, -0.008321749046444893, 0.008851727470755577, -0.08015318959951401, -0.028086571022868156, -0.01529981754720211, -0.004485014826059341, -0.019690824672579765, 0.03594095632433891, -0.03984870761632919, -0.05588177591562271, 0.031972113996744156, 0.025380253791809082, 0.0690680742263794, 0.010468561202287674, 0.032746877521276474, -0.009214917197823524, 0.04418988898396492, 0.009302565827965736, -0.03202538564801216, -0.0808781161904335, 1.7500016027523337e-33, -0.02483353763818741, 0.019100980833172798, 0.046751148998737335, 0.012269522063434124, 0.1361752152442932, -0.08084167540073395, -0.02227422408759594, -0.028031866997480392, -0.055148351937532425, 0.001916407374665141, -0.04021361842751503, 0.06665943562984467, -0.057529181241989136, 0.18559972941875458, 0.06632309406995773, 0.006951567716896534, -0.04211004450917244, -0.03540998697280884, 0.03305179998278618, 0.04796756058931351, 0.0006983712082728744, -0.017488086596131325, 0.0005826643900945783, -0.06395160406827927, -0.05705256387591362, 0.07437144964933395, 0.011299015954136848, 0.013431682251393795, 0.03157894313335419, 0.0030045907478779554, -0.07825573533773422, 0.0432426817715168, -0.04649719223380089, -0.026977332308888435, 0.020000608637928963, 0.049716852605342865, -0.02042173594236374, -0.005781006999313831, -0.03725840523838997, 0.014399044215679169, 0.052294522523880005, 0.0322040431201458, 0.004201496951282024, -0.016810817644000053, -0.04539429768919945, 0.09454721957445145, -0.01154189184308052, 0.06516211479902267, -0.042107004672288895, 0.022023694589734077, -0.028650837019085884, -0.02831951528787613, -0.052514493465423584, -0.092136450111866, -0.006793942768126726, -0.006804690696299076, 0.027104150503873825, -0.0056719048880040646, 0.03484209626913071, -0.03252207487821579, 0.051214318722486496, 0.007947493344545364, 0.03808059170842171, 0.013008496724069118, -0.06646585464477539, 0.04827605187892914, 0.0022176846396178007, 0.05341775715351105, -0.006263044662773609, -0.008716454729437828, -0.0923372209072113, 0.07686120271682739, -0.020464662462472916, -0.05100278928875923, -0.05300077423453331, 0.007715154439210892, -0.00289850402623415, -0.10598160326480865, 0.02324514091014862, 0.027681652456521988, -0.025479024276137352, 0.008918486535549164, -0.030559241771697998, -0.051206573843955994, -0.004985641222447157, 0.05815161392092705, -0.02756590209901333, -0.0694904699921608, -0.08596695959568024, 0.027511974796652794, -0.09196251630783081, -0.04946306347846985, 0.07496552169322968, -0.016948213800787926, -0.09772170335054398, -3.7070724128737674e-33, -0.048377398401498795, 0.049545977264642715, -0.0220059622079134, 0.09270186722278595, 0.025265594944357872, -0.06696243584156036, 0.028289122506976128, -0.009575758129358292, 0.03985660523176193, 0.021474597975611687, 0.04097403585910797, 0.005414153914898634, 0.007527108304202557, -0.012718291953206062, 0.029204152524471283, -0.11645610630512238, -0.039162274450063705, -0.0066164820455014706, -0.03500993177294731, 0.011331206187605858, 0.013484852388501167, 0.10947859287261963, -0.09629949182271957, -0.006246685516089201, -0.10716600716114044, 0.06390410661697388, 0.005867100786417723, 0.007602988742291927, -0.05373486503958702, 0.018049992620944977, -0.049537915736436844, 0.029704047366976738, -0.05477442964911461, 0.02655344270169735, 0.010826928541064262, 0.08514676988124847, 0.04895498603582382, -0.07151073962450027, -0.03461650386452675, -0.02501978725194931, 0.07826237380504608, -0.013566442765295506, -0.0261299517005682, -0.016082653775811195, -0.0004206597222946584, 0.024499032646417618, 0.025074739009141922, 0.03917061910033226, 0.05085087940096855, 0.04634050279855728, 0.034358490258455276, 0.03651284798979759, -0.10086918622255325, -0.012107105925679207, -0.06823085993528366, -0.05936918780207634, -0.04158564284443855, 0.03809406980872154, 0.08114486187696457, 0.04498875513672829, -0.07852219045162201, 0.000500464579090476, -0.08145781606435776, -0.002918618731200695, -0.07733553647994995, 0.05419281870126724, -0.12114403396844864, 0.03671202063560486, 0.007058121729642153, -0.008963245898485184, 0.06959835439920425, -0.05492984130978584, 0.04162830114364624, 0.1218191534280777, -0.023010360077023506, -0.04021038860082626, -0.051819656044244766, -0.019010543823242188, 0.010881191119551659, 0.008270763792097569, 0.0074874041602015495, -0.06876220554113388, 0.004566752817481756, 0.07870972156524658, 0.07801159471273422, 0.017842359840869904, -0.01853826269507408, -0.011208713985979557, 0.014543944038450718, -0.0025644388515502214, -0.03909151628613472, 0.05967850983142853, -0.0643668845295906, 0.11486351490020752, -0.0426173098385334, -5.165123084793777e-08, -0.024624880403280258, -0.021548409014940262, 0.08924916386604309, 0.0042095971293747425, -0.005269841756671667, -0.03351064398884773, 0.034206897020339966, 0.00967869907617569, -0.07406618446111679, 0.006544146686792374, 0.0575149841606617, -0.005936812609434128, -0.048062730580568314, -0.0017530802870169282, 0.028774989768862724, 0.08179029822349548, 0.03386927396059036, 0.04842500388622284, 0.02453790418803692, -0.039028916507959366, 0.038919903337955475, -0.0031653447076678276, -0.0387037955224514, -0.064542256295681, 0.04613885283470154, -0.04992293938994408, -0.07789083570241928, 0.048059482127428055, -0.06516534090042114, 0.026821058243513107, 0.08943036198616028, -0.013785107061266899, 0.10965196043252945, 0.011831987649202347, 0.03981760889291763, 0.046393729746341705, -0.0485544428229332, -0.029040759429335594, -0.016987457871437073, -0.0020676827989518642, 0.0021684858947992325, 0.06426941603422165, 0.06200023368000984, -0.06351916491985321, -0.01153524685651064, 0.0398399643599987, 0.04795803129673004, -0.09317362308502197, -0.022209547460079193, 0.16084808111190796, 0.01653241738677025, 0.019428428262472153, -0.001359850401058793, 0.05221596732735634, 0.1183401495218277, -0.0926850363612175, -0.0037031336687505245, -0.00987893994897604, -0.0672377198934555, 0.11528541147708893, 0.050594013184309006, 0.0916399210691452, -0.014885254204273224, -0.034257858991622925 ] }, { "text": "Args:\nimage_path_or_url: Path to local image or URL\nlayer: Which layer to dream on (see model.get_available_layers())\nmax_size: Maximum image dimension\nnum_octaves: Number of scales (more = slower but better)\niterations: Steps per octave\nlearning_rate: How strong the effect is\n\"\"\"\n# Load image\nimage = load_image(image_path_or_url, max_size=max_size)\n\n# Show original\nprint(\"Original:\")\nshow_image(image, \"Original\")\n\n# Dream\ndreamed = deep_dream_octaves(\nmodel, image, layer,\nnum_octaves=num_octaves,\niterations_per_octave=iterations,\nlearning_rate=learning_rate\n)\n\n# Show result\nprint(f\"\\nDreamed ({layer}):\")\nshow_image(dreamed, f\"Deep Dream - {layer}\")\n\nreturn dreamed", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_72", "embedding": [ 0.0057921139523386955, 0.01969284377992153, 0.060025688260793686, 0.041341833770275116, -0.0025630805175751448, -0.06560146808624268, -0.08995826542377472, 0.012361078523099422, -0.0007675614324398339, -0.08841876685619354, -0.026218626648187637, -0.009562375955283642, 0.022254863753914833, -0.022191530093550682, -0.06636025756597519, 0.027587639167904854, -0.008016165345907211, 0.07126179337501526, -0.054519712924957275, -0.06100153923034668, 0.09616062790155411, -0.030878357589244843, 0.03516396880149841, -0.02279634401202202, 0.06790275126695633, 0.005907916929572821, -0.06237668916583061, 0.06582383811473846, 0.06080878525972366, -0.038768667727708817, 0.04621167480945587, 0.013920002616941929, -0.022071845829486847, 0.06250917166471481, -0.013245408423244953, 0.06947258114814758, -0.05486394837498665, -0.09656365215778351, -0.01646251603960991, -0.00034554643207229674, 0.05912073701620102, 0.004607142880558968, -0.024865273386240005, -0.07426584511995316, 0.0008988453191705048, 0.013705773279070854, -0.013859769329428673, -0.04916044697165489, -0.019354641437530518, -0.020334452390670776, -0.08910731226205826, -0.018364381045103073, -0.04993367940187454, 0.004959256388247013, 0.01915818266570568, 0.007986671291291714, 0.03480461239814758, -0.03178907558321953, -0.06510993838310242, -0.023112116381525993, -0.06487482041120529, 0.031101174652576447, -0.03267056494951248, -0.00619150185957551, 0.022946039214730263, -0.01706944964826107, -0.04664962738752365, -0.025011233985424042, 0.059666071087121964, 0.011419505812227726, -0.0060347141698002815, 0.029404116794466972, -0.0037746429443359375, -0.019680486992001534, 0.03846039995551109, -0.08669574558734894, 0.024835366755723953, -0.024183044210076332, -0.021506426855921745, -0.1087658479809761, 0.009489857591688633, -0.05298115685582161, 0.01881464011967182, -0.06386761367321014, 0.07439478486776352, -0.054283175617456436, 0.0427832305431366, 0.009974497370421886, 0.023981546983122826, -0.019717784598469734, 0.018335381522774696, -0.024973170831799507, -0.16861198842525482, 0.040499161928892136, 0.10361311584711075, 0.04166498780250549, 0.018164223060011864, -0.12937797605991364, -0.03914058953523636, 0.003842294681817293, -0.005313395522534847, -0.023456182330846786, 0.07785221934318542, -0.024935191497206688, 0.014251367188990116, 0.05202598124742508, 0.07391797751188278, 0.07280411571264267, -0.022556573152542114, -0.06465961784124374, -0.0037719609681516886, -0.015558225102722645, 0.007750981487333775, 0.025622472167015076, 0.05542191490530968, -0.02218003198504448, -0.047081902623176575, 0.034548114985227585, -0.014655494131147861, 0.042625270783901215, 0.021327462047338486, 0.01691683754324913, 0.02730255387723446, -0.05278049036860466, -0.09222036600112915, -0.04264424368739128, -0.10716789960861206, 3.599156153996527e-33, -0.0016042140778154135, 0.0017260900931432843, 0.029133375734090805, -0.031215818598866463, 0.06635519862174988, 0.010256755165755749, 0.03187957778573036, -0.009499551728367805, -0.07222234457731247, -0.008202433586120605, -0.06800038367509842, 0.031991977244615555, -0.025255585089325905, 0.16956718266010284, 0.03884975612163544, -0.0025495849549770355, -0.011215122416615486, 0.02119739167392254, 0.02547089383006096, 0.0689181461930275, 0.05357193946838379, 0.012009148485958576, -0.038420047610998154, -0.06555785238742828, -0.058067869395017624, 0.007125722710043192, 0.013422143645584583, 0.05050598457455635, -0.07898933440446854, -0.00833113119006157, 0.017421752214431763, -0.0044723921455442905, -0.04368022829294205, -0.07175810635089874, 0.03396002575755119, 0.02894594706594944, 0.05828765779733658, 0.06795523315668106, -0.06417175382375717, -0.05452989414334297, 0.01293344609439373, 0.029149159789085388, 0.047776706516742706, 0.01012029405683279, -0.07243454456329346, 0.04341337829828262, -0.04594748094677925, 0.09055761247873306, -0.03972058370709419, 0.04823128134012222, 0.07986322045326233, -0.08283646404743195, -0.05231330543756485, -0.05013057217001915, 0.012812628410756588, 0.0034850160591304302, 0.056855399161577225, 0.027468062937259674, 0.049268268048763275, 0.02239971235394478, 0.050143759697675705, -0.04258054494857788, 0.016041642054915428, 0.04506838321685791, -0.01901697739958763, 0.06072176992893219, 0.044871728867292404, -0.0021590935066342354, -0.0010061073116958141, 0.022375281900167465, -0.0790199264883995, 0.07270840555429459, 0.011598666198551655, -0.08490407466888428, 0.016666868701577187, -0.06126154214143753, -0.04046764224767685, -0.11417437344789505, -0.030394859611988068, 0.07010721415281296, -0.02566963993012905, 0.044303227216005325, -0.046078432351350784, -0.11179640889167786, -0.027317553758621216, 0.04119349271059036, 0.002025762340053916, -0.08986806124448776, -0.08584477007389069, -0.0025333950761705637, -0.10214739292860031, -0.04594875127077103, 0.058739203959703445, -0.04976288601756096, -0.05858079344034195, -4.761164645879006e-33, 0.0792887881398201, 0.05319361388683319, 0.02919233776628971, 0.1067526713013649, 0.048838309943675995, -0.06598690152168274, 0.0695459395647049, 0.05105623975396156, 0.01347324252128601, 0.007288538850843906, 0.06126226484775543, -0.010557657107710838, -0.007338421884924173, -0.040399421006441116, 0.07619515806436539, -0.07566101104021072, -0.04026796296238899, -0.03909685090184212, 0.0003755355137400329, 0.026202483102679253, -0.08628719300031662, 0.09329329431056976, -0.044465210288763046, 0.05996425822377205, -0.07993505150079727, 0.027564479038119316, 0.0047844648361206055, 0.022572016343474388, -0.004364784341305494, -0.05349692329764366, 0.006457164883613586, -0.05892503261566162, -0.07244261354207993, 0.0644846260547638, 0.04307742789387703, 0.1514330357313156, 0.06645664572715759, -0.07601042091846466, -0.06587181240320206, 0.00414300849661231, 0.08740326762199402, 0.00936692301183939, -0.06887371093034744, 0.020834820345044136, -0.0012710998998954892, 0.020085524767637253, 0.012635646387934685, -0.015046453103423119, 0.02310541644692421, 0.03649987280368805, 0.04570761322975159, -0.004454386420547962, -0.07710710167884827, 0.04577752202749252, -0.006906383670866489, -0.02650296688079834, -0.10673351585865021, 0.008473599329590797, 0.04045829176902771, 0.008832366205751896, -0.025522777810692787, -0.04881228506565094, -0.09162092953920364, -0.0055405269376933575, -0.06998716294765472, -0.00013836962170898914, -0.12212585657835007, 0.001136447535827756, 0.023955849930644035, 0.07538209855556488, -0.00467863492667675, 0.027960199862718582, 0.04998164251446724, 0.08065640181303024, -0.056298114359378815, -0.015223685652017593, -0.077660471200943, -0.012571105733513832, 0.024095376953482628, 0.006014982704073191, -0.025262201204895973, -0.02717689238488674, -0.03934107720851898, 0.07280363887548447, 0.02032579481601715, 0.03082357719540596, 0.028604883700609207, 0.04092739522457123, 0.012397066690027714, -0.03336985036730766, 0.048100829124450684, 0.029267659410834312, -0.021412361413240433, 0.033751796931028366, 0.01134698186069727, -4.597742275791461e-08, 0.005903563462197781, -0.03605727106332779, 0.11067492514848709, -0.022899562492966652, 0.04723134636878967, 0.028979972004890442, 0.08577018976211548, 0.011201852932572365, -0.04584227129817009, -0.020395899191498756, 0.09000670909881592, -0.003494809614494443, -0.0344766341149807, 0.029658440500497818, -0.013709038496017456, 0.044314149767160416, 0.04790196195244789, 0.01215297356247902, 0.0226241834461689, -0.061083968728780746, -0.055310893803834915, 0.03845112398266792, 0.004300679545849562, -0.0283238235861063, -0.04039479419589043, -0.045241501182317734, -0.03155773505568504, 0.04929165169596672, -0.0692964717745781, 0.0042584724724292755, 0.11921914666891098, -0.05433876812458038, 0.053586315363645554, 0.026513660326600075, 0.03610409423708916, 0.044352609664201736, -0.09077043831348419, 0.026523498818278313, 0.056500393897295, 0.05090609937906265, -0.03135215491056442, 0.011357251554727554, 0.06792226433753967, -0.017632534727454185, 0.04238118976354599, -0.005118665751069784, -0.0017464355332776904, -0.0952913761138916, -0.003952545579522848, 0.12080832570791245, 0.017267907038331032, -0.020796965807676315, -0.09011366963386536, 0.05302055925130844, 0.025316962972283363, -0.09668542444705963, -0.00519011402502656, -0.012667798437178135, -0.024165961891412735, 0.0817151591181755, 0.048902831971645355, 0.014220702461898327, -0.02373114973306656, 0.04191680997610092 ] }, { "text": "# Show result\nprint(f\"\\nDreamed ({layer}):\")\nshow_image(dreamed, f\"Deep Dream - {layer}\")\n\nreturn dreamed\n\n# Example usage:\n# result = dream_on_image(\"your_image.jpg\", layer='Mixed_6c')\n#\n# Or with a URL:\n# result = dream_on_image(\"https://example.com/image.jpg\")\n\nIn [15]:\n\nmodel.get_available_layers()\n\nOut[15]:\n\n['Conv2d_1a',\n'Conv2d_2b',\n'Mixed_5b',\n'Mixed_5c',\n'Mixed_5d',\n'Mixed_6a',\n'Mixed_6b',\n'Mixed_6c',\n'Mixed_6d',\n'Mixed_6e',\n'Mixed_7a',\n'Mixed_7b',\n'Mixed_7c']\n\nIn [16]:\n\n# Try it with another sample image\nnature_url = \"https://images.pexels.com/photos/414612/pexels-photo-414612.jpeg\"\n\n# Mountain landscape\nnature_url = \"https://images.unsplash.com/photo-1506905925346-21bda4d32df4?w=600\"\n\n# Forest\nnature_url = \"https://images.unsplash.com/photo-1448375240586-882707db888b?w=600\"", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_73", "embedding": [ -0.004763816948980093, 0.05679383501410484, 0.09983467310667038, 0.04950905218720436, 0.08857070654630661, -0.03838210925459862, -0.02829919010400772, -0.015836913138628006, 0.019352158531546593, -0.09291267395019531, 0.03555218130350113, -0.07182570546865463, 0.05039575695991516, 0.014600996859371662, -0.000747645040974021, 0.051043801009655, -0.0671233981847763, 0.07559084892272949, -0.06297336518764496, -0.05411010980606079, 0.07570591568946838, 0.060812801122665405, 0.03643278032541275, -0.047091446816921234, -0.0019158213399350643, -0.025292403995990753, -0.023379966616630554, 0.07807955145835876, 0.05738389864563942, -0.023211518302559853, 0.06258376687765121, 0.07801640778779984, -0.03816617652773857, 0.0615265928208828, 0.05727597698569298, 0.050757575780153275, -0.07230519503355026, -0.06170140206813812, 0.029823999851942062, 0.009319925680756569, 0.0736537054181099, -0.048462819308042526, 0.0028374874964356422, -0.07657023519277573, -0.003026938531547785, 0.016676170751452446, -0.03494027256965637, -0.032953910529613495, 0.05318770185112953, -0.04106968641281128, -0.06380333751440048, -0.03130419924855232, -0.12209004908800125, 0.006790300365537405, 0.0556657649576664, -0.05333271622657776, -0.02018425054848194, -0.058794133365154266, -0.00990749429911375, -0.04647989943623543, 0.021501829847693443, -0.019740035757422447, 0.0006865983596071601, -0.018300754949450493, 0.04228444769978523, -0.02327415905892849, -0.13167108595371246, 0.06548777967691422, 0.05160507559776306, -0.026283560320734978, 0.005988816265016794, 0.042439401149749756, 0.009256764315068722, -0.013944962061941624, 0.02577909640967846, -0.022206081077456474, 0.044300686568021774, -0.04429328441619873, -0.0026337578892707825, -0.05904233455657959, -0.05489983782172203, -0.08544205874204636, 0.025691887363791466, -0.010196222923696041, 0.10449770092964172, -0.017719833180308342, -0.03544652462005615, 0.006949774455279112, -0.0027768355794250965, -0.048181138932704926, -0.027294248342514038, -0.02372383512556553, -0.10171999782323837, 0.050637129694223404, 0.07163463532924652, 0.04865187034010887, 0.05061541870236397, -0.1266935020685196, -0.03349335491657257, 0.04624876379966736, -0.003990061581134796, -0.047614503651857376, 0.01152657251805067, -0.058693777769804, 0.026481106877326965, 0.05344467982649803, 0.06534718722105026, 0.024950874969363213, -0.0012278457870706916, -0.06589911878108978, -0.08033561706542969, -0.018454646691679955, 0.03382626548409462, 0.0021881703287363052, 0.025466829538345337, -0.06133072450757027, -0.02740626223385334, 0.0021132559049874544, 0.04792825132608414, 0.0013517301995307207, 0.018765974789857864, 0.03478506952524185, 0.01605880819261074, -0.057651665061712265, -0.0754927471280098, -0.03458400070667267, 0.0040717716328799725, 8.813271650354985e-34, -0.014549010433256626, -0.07806023210287094, 0.01820511743426323, 0.020269079133868217, 0.0898372158408165, 0.06532324105501175, 0.02371221035718918, -0.0661693811416626, -0.07978124916553497, -0.013310430571436882, -0.09698851406574249, 0.027699923142790794, -0.05973228067159653, 0.05615448206663132, 0.011528233997523785, 0.005597643554210663, -0.024271953850984573, 0.0012341146357357502, 0.05328720435500145, 0.08101218193769455, -0.04493449255824089, 0.04540293663740158, -0.020985234528779984, -0.03275735303759575, -0.05723026022315025, -0.05318619683384895, 0.00797091331332922, -0.020681872963905334, -0.02947232685983181, -0.021484609693288803, -0.006304673384875059, 0.00880024116486311, -0.0035009903367608786, -0.044485729187726974, 0.03773481026291847, 0.05147126317024231, 0.06309457123279572, 0.07252373546361923, -0.1288459450006485, -0.02081499807536602, 0.010755451396107674, 0.04595063254237175, 0.006517849396914244, 0.00933018233627081, -0.04046263545751572, 0.020115729421377182, -0.06742583960294724, 0.0787958949804306, -0.04826093837618828, 0.025926420465111732, 0.03945332393050194, 0.0009467649506404996, -0.012291045859456062, -0.07247273623943329, -0.03514772281050682, -0.014861101284623146, 0.02557915635406971, 0.01765945926308632, 0.01799684390425682, -0.0572599433362484, 0.010607198812067509, 0.035647641867399216, -0.0036534571554511786, 0.028104661032557487, 0.00965462252497673, 0.054647885262966156, 0.1035025417804718, 0.01010452676564455, -0.0611099973320961, 0.03556433692574501, -0.07211675494909286, 0.07306992262601852, 0.001116058323532343, -0.07236587256193161, -0.002454380039125681, -0.07018392533063889, -0.07814174890518188, -0.09154500812292099, -0.022269409149885178, 0.054688937962055206, 0.05701382830739021, 0.02943071350455284, -0.0707559734582901, -0.06393679231405258, -0.05888517573475838, 0.08500757813453674, -0.018193285912275314, -0.06064758822321892, -0.033319901674985886, -0.009578696452081203, -0.09352421015501022, -0.03633459284901619, 0.014816711656749249, -0.03740018606185913, 0.019935542717576027, -1.6616352842972067e-33, 0.07319862395524979, 0.037189025431871414, 0.08359518647193909, 0.05485851317644119, 0.06632158905267715, -0.04847448319196701, 0.12814955413341522, -0.019234754145145416, 0.017886672168970108, 0.05179480090737343, 0.1111343502998352, -0.013397782109677792, -0.019091026857495308, -0.08205384761095047, 0.022403709590435028, -0.05791162699460983, -0.06445907801389694, 0.020814018324017525, 0.00908021628856659, 0.0631876289844513, -0.07107575237751007, 0.0831863060593605, -0.06602682918310165, 0.08913162350654602, -0.09519010037183762, 0.08509381860494614, 0.05509667098522186, 0.018093043938279152, -0.03356749936938286, -0.06903775036334991, -0.009176124818623066, -0.012503830716013908, -0.054708804935216904, 0.08281498402357101, 0.01703685149550438, 0.07191072404384613, 0.021552493795752525, -0.05177617073059082, -0.022185519337654114, 0.025105196982622147, 0.04615059867501259, 0.003089597448706627, -0.09256944805383682, 0.060715243220329285, -0.0006675862823612988, -0.010953901335597038, 0.047550708055496216, 0.006874158047139645, 0.024123940616846085, 0.04953505098819733, 0.03965161740779877, -0.03346208110451698, -0.12200981378555298, 0.03187944367527962, 0.012619300745427608, -0.05254503712058067, -0.09440363943576813, -0.0037567191757261753, -0.014920254237949848, 0.030865352600812912, 0.004101748112589121, -0.07458272576332092, -0.09712285548448563, 0.015598103404045105, -0.020373979583382607, -0.01954800635576248, -0.17895160615444183, 0.009742829017341137, 0.0018711123848333955, 0.05615200474858284, 0.008412365801632404, 0.006484384648501873, 0.07476204633712769, 0.022927919402718544, 0.06260407716035843, -0.028294892981648445, -0.04321853816509247, 0.07001229375600815, 0.07205129414796829, 0.04309894144535065, -0.09826008975505829, -0.04574024677276611, -0.0039445883594453335, 0.09883149713277817, 0.04554915055632591, 0.022259656339883804, -0.03800718113780022, 0.033662207424640656, 0.01564960554242134, -0.09824682772159576, -0.00124373531434685, 0.02075350284576416, 0.03897273540496826, 0.07560530304908752, 0.03897036984562874, -5.2524029570122366e-08, 0.008206512778997421, -0.07500267028808594, 0.09253837913274765, -0.03202516585588455, -0.012600134126842022, 0.025177255272865295, 0.01824328489601612, -0.02864103578031063, 0.011470286175608635, 0.014108765870332718, 0.04520783573389053, -0.004741358570754528, -0.04822925850749016, 0.006786665879189968, -0.015818776562809944, 0.00601167744025588, -0.01170351542532444, 0.03759050369262695, 0.02330397628247738, -0.034294839948415756, -0.006858864799141884, 0.009263887070119381, -0.014103608205914497, 0.004176238086074591, 0.010949471965432167, -0.041567493230104446, -0.06848789006471634, -0.01821926049888134, -0.01904984563589096, 0.023291539400815964, 0.10427261888980865, -0.0832839235663414, 0.04110640287399292, -0.007324966136366129, 0.0014036475913599133, 0.04764372482895851, -0.036397092044353485, -0.00021285601542331278, 0.008807215839624405, 0.04832401126623154, 0.03027285449206829, 0.01415383629500866, 0.04417790099978447, -0.03320327401161194, 0.0570487305521965, -0.0035433368757367134, 0.07737209647893906, -0.05709294602274895, 0.03635344281792641, 0.10163506865501404, -0.008170322515070438, -0.061450354754924774, -0.03873877227306366, 0.05088222026824951, -0.021237196400761604, -0.10653700679540634, 0.06451831758022308, 0.01187088992446661, -0.02250799909234047, 0.05879463255405426, 0.039159324020147324, 0.004444867838174105, -0.03716837614774704, 0.016211211681365967 ] }, { "text": "# Forest\nnature_url = \"https://images.unsplash.com/photo-1448375240586-882707db888b?w=600\"\n\n# Architecture (buildings create interesting geometric patterns)\n# nature_url = \"https://images.unsplash.com/photo-1486325212027-8081e485255e?w=600\"\n\n# Ocean waves\n# nature_url = \"https://images.unsplash.com/photo-1505118380757-91f5f5632de0?w=600\"\n\n# Abstract texture (good for showing pure pattern amplification)\n# nature_url = \"https://images.unsplash.com/photo-1558591710-4b4a1ae0f04d?w=600\"\n\nresult = dream_on_image(nature_url, layer='Mixed_6e', num_octaves=4, iterations=30)\n\nOriginal:\n\nOctave 1/4 - Size: 186x124\n\nOctave 2/4 - Size: 261x173\n\nOctave 3/4 - Size: 365x243\n\nOctave 4/4 - Size: 512x341\n\nDreamed (Mixed_6e):\n\nIn [17]:", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_74", "embedding": [ -0.04729053005576134, 0.06862809509038925, 0.11343462020158768, 0.018713776022195816, 0.04476388916373253, -0.08031884580850601, -0.04154491052031517, -0.059305112808942795, 0.020298784598708153, -0.025351211428642273, 0.0021548669319599867, -0.1249951422214508, -0.019126085564494133, 0.02798992581665516, 0.015341022983193398, 0.1444040983915329, -0.12162105739116669, 0.04344530403614044, -0.04159551486372948, 0.03976508602499962, 0.0684148520231247, 0.07881513983011246, -0.051858287304639816, -0.028605448082089424, 0.019041018560528755, 0.023013705387711525, -0.05626571923494339, 0.06978120654821396, 0.09426961839199066, -0.03854803740978241, 0.059415657073259354, 0.08421184122562408, 0.05834827199578285, 0.0344027616083622, 0.04153952747583389, 0.08368337154388428, -0.05455547198653221, -0.05284866690635681, -0.006846759468317032, 0.06229066103696823, 0.004589551128447056, -0.02797415666282177, 0.041494354605674744, -0.030711321160197258, -0.020177209749817848, 0.03544851392507553, -0.05023370310664177, -0.06189665570855141, 0.010053077712655067, -0.07805995643138885, -0.09400880336761475, -0.099039725959301, -0.11011993885040283, -0.02972668595612049, -0.0038728509098291397, -0.01573343016207218, 0.0005972878425382078, -0.04433386027812958, 0.08368270099163055, -0.12674464285373688, 0.14265288412570953, 0.023327205330133438, -0.014177721925079823, -0.011812187731266022, 0.06668875366449356, 0.04559432715177536, -0.10116477310657501, 0.002326453570276499, 0.10223932564258575, -0.0855216383934021, -0.02115737460553646, -0.005571784917265177, 0.00627947086468339, 0.024321088567376137, 0.009276716969907284, 0.05042652785778046, -0.019247032701969147, -0.010682810097932816, -0.038284655660390854, -0.09372791647911072, -0.019491145387291908, -0.08272185176610947, -0.03719234839081764, -0.027051139622926712, 0.07856646925210953, 0.06569704413414001, -0.011753419414162636, 0.0018660554196685553, -0.01263141818344593, -0.008418237790465355, 0.03793827444314957, -0.03098771721124649, -0.08731143921613693, 0.016057318076491356, 0.01506862323731184, 0.06809574365615845, 0.010119916871190071, -0.14201271533966064, -0.0189193207770586, 0.013073218055069447, 0.04800890386104584, -0.07795784622430801, -0.034101132303476334, 0.007081293035298586, -0.0050485096871852875, 0.006787385791540146, 0.019883757457137108, 0.07208964228630066, 0.014945413917303085, -0.0046678874641656876, -0.05331634357571602, -0.002269440097734332, -0.07294905930757523, 0.020178785547614098, -0.04716357961297035, -0.04020439088344574, -0.007648438215255737, 0.010024861432611942, -0.0065959133207798, 0.01742895133793354, 0.08305931836366653, 0.01362399198114872, 0.013619557954370975, 0.010646037757396698, -0.07464652508497238, -0.05010848864912987, -0.02295621857047081, 9.35789159107339e-33, 0.08724739402532578, 0.029310045763850212, -0.028406063094735146, -0.03193661570549011, 0.16213607788085938, -0.03930354863405228, -0.0456719845533371, -0.04376465454697609, -0.06090942770242691, 0.020673096179962158, -0.14840397238731384, 0.08525608479976654, -0.027783306315541267, 0.04628736153244972, 0.0032184512820094824, -0.02055404707789421, -0.013706059195101261, -0.04188529774546623, 0.004718227777630091, 0.06844452023506165, -0.06914018094539642, 0.07027441263198853, -0.01851017214357853, -0.061447612941265106, -0.05967644602060318, 0.037289492785930634, 0.037159260362386703, -0.015135545283555984, -0.031811587512493134, 0.01008503045886755, 0.07245465368032455, -0.007604572456330061, -0.0789453387260437, -0.0034237958025187254, 0.06464394181966782, -0.002197513123974204, 0.052575744688510895, 0.02425883151590824, -0.05702591687440872, 0.003667718032374978, -0.0021473553497344255, 0.05634806305170059, 0.012687468901276588, 0.004075647797435522, 0.04799501597881317, 0.0044099511578679085, 0.056305814534425735, 0.0913262814283371, 0.008823736570775509, 0.022212298586964607, -0.039232037961483, 0.0019712764769792557, -0.04443271830677986, -0.023604795336723328, -0.030181461945176125, -0.009830460883677006, 0.05651644244790077, -0.001668780343607068, -0.007508688140660524, 0.0501793809235096, -0.00029610274941660464, -0.0017945521976798773, 0.028355516493320465, -0.009410473518073559, -0.01339740864932537, -0.026277443394064903, 0.011367849074304104, 0.005950808525085449, -0.03912334889173508, 0.03197140619158745, -0.04710741713643074, 0.06605877727270126, 0.0719672441482544, -0.019589131698012352, -0.011125150136649609, -0.033701542764902115, -0.037387665361166, -0.0010391148971393704, -0.09898294508457184, 0.0856487825512886, -0.02444988675415516, 0.07782857865095139, 0.03367564082145691, -0.10012080520391464, -0.07818972319364548, 0.07272984832525253, 0.02101082354784012, -0.026650944724678993, -0.07662301510572433, 0.016496961936354637, -0.05035378783941269, 0.016382426023483276, 0.024730319157242775, -0.05782078951597214, -0.015978971496224403, -1.0536983689293163e-32, -0.00781440269201994, 0.006356898695230484, 0.03910202533006668, 0.0066580381244421005, 0.0481359139084816, -0.009015772491693497, -0.00033987543429248035, 0.019912762567400932, 0.019286809489130974, 0.05526011064648628, 0.08565573394298553, 0.08239489793777466, 0.03951378911733627, -0.06334862112998962, -0.026372604072093964, -0.08921348303556442, -0.02281845360994339, -0.02638021670281887, -0.037567853927612305, 0.05020396038889885, -0.018873514607548714, 0.12244505435228348, -0.1161649227142334, 0.029585933312773705, -0.05353446304798126, 0.07557785511016846, 0.03135109692811966, 0.0028674970380961895, -0.024248803034424782, -0.004815483465790749, -0.060756079852581024, -0.01431624311953783, -0.03295725956559181, 0.0009354198118671775, -0.007891077548265457, 0.061780981719493866, 0.028850965201854706, -0.07919583469629288, -0.050481993705034256, -0.009636243805289268, 0.03290171176195145, -0.007412543520331383, -0.05411716550588608, -0.03172822296619415, -0.0009823369327932596, -0.01838785782456398, 0.042145464569330215, 0.021484479308128357, 0.01135983970016241, 0.02652846835553646, 0.0944715142250061, 0.014827169477939606, -0.04731933772563934, 0.017433129251003265, 0.04521867632865906, -0.004745769780129194, -0.05560579150915146, 0.03712146729230881, -0.024491500109434128, 0.06386077404022217, 0.004404633305966854, 0.03362780064344406, -0.08901113271713257, -0.031344205141067505, -0.011693376116454601, 0.015125068835914135, -0.0814322978258133, -0.028137370944023132, -0.017683865502476692, -0.01467294804751873, -0.03084065206348896, -0.0005129133351147175, -0.011933981440961361, -0.0011269228998571634, 0.07409599423408508, -0.061873722821474075, -0.006032890640199184, 0.020914940163493156, 0.028238046914339066, 0.051809486001729965, -0.04410148784518242, -0.003302627243101597, 0.009669127874076366, 0.11318226903676987, 0.09351623058319092, -0.0001598471135366708, -0.021938828751444817, -0.011534326709806919, 0.007325427141040564, -0.02556292526423931, 0.022119896486401558, 0.07156078517436981, -0.029405221343040466, 0.10315435379743576, 0.0700528472661972, -6.492645354683191e-08, 0.026039035990834236, -0.05580718070268631, 0.02154301106929779, -0.06303117424249649, -0.01625652052462101, -0.03977048397064209, 0.061275165528059006, -0.03720133751630783, -0.10533169656991959, -0.050356488674879074, 0.0006343279965221882, 0.0029915503691881895, -0.10019128024578094, 0.07303940504789352, -0.005058623850345612, -0.07965078204870224, -0.05981573089957237, -0.017645472660660744, -0.030521931126713753, -0.05220390856266022, -0.004392123781144619, -0.0326654277741909, -0.03192899003624916, -0.05109390988945961, 0.004380903206765652, -0.0031829422805458307, -0.043488603085279465, -0.012370828539133072, -0.02397613786160946, 0.03240206465125084, 0.07904451340436935, -0.039380595088005066, 0.033943600952625275, 0.008863124996423721, -0.07381598651409149, 0.019899960607290268, -0.03294304013252258, 0.026884282007813454, -0.0329262800514698, -0.010850761085748672, 0.06700798124074936, 0.0005361974472180009, 0.04933377355337143, 0.02919618971645832, 0.0629410371184349, 0.025319159030914307, 0.05637044459581375, -0.05991043522953987, 0.043126001954078674, 0.08655911684036255, 0.05148253217339516, -0.057697515934705734, -0.049909040331840515, 0.007643398828804493, 0.01897723786532879, -0.08882403373718262, -0.0264347642660141, -0.0546652190387249, -0.007897489704191685, 0.02004813402891159, 0.09136465191841125, -0.03750970959663391, -0.041350580751895905, -0.012307129800319672 ] }, { "text": "Octave 1/4 - Size: 186x124\n\nOctave 2/4 - Size: 261x173\n\nOctave 3/4 - Size: 365x243\n\nOctave 4/4 - Size: 512x341\n\nDreamed (Mixed_6e):\n\nIn [17]:\n\nresult = dream_on_image(nature_url, layer='Mixed_7c', num_octaves=4, iterations=30)\n\nOriginal:\n\nOctave 1/4 - Size: 186x124\n\nOctave 2/4 - Size: 261x173\n\nOctave 3/4 - Size: 365x243\n\nOctave 4/4 - Size: 512x341\n\nDreamed (Mixed_7c):\n\n11. Save Your Creations¶\n\nIn [18]:\n\ndef save_dream(tensor: torch.Tensor, filename: str):\n\"\"\"Save a dreamed image to file.\"\"\"\nimg = tensor_to_image(tensor)\nimg_pil = Image.fromarray((img * 255).astype(np.uint8))\nimg_pil.save(filename)\nprint(f\"Saved to {filename}\")\n\n# Example:\n# save_dream(result, \"my_dream.png\")\n\nSummary¶\n\nWe've built Deep Dream from scratch! Here's what we learned:", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_75", "embedding": [ 0.005570804234594107, 0.016115223988890648, 0.02413412369787693, 0.026351872831583023, 0.03662072867155075, -0.03567693009972572, -0.03903868794441223, -0.01063445769250393, -0.04500090330839157, -0.0447361059486866, -0.008764967322349548, -0.058617476373910904, -0.02324434369802475, -0.008887856267392635, -0.0722072646021843, 0.030375227332115173, -0.15127985179424286, 0.055863671004772186, -0.07329922914505005, -0.010329235345125198, 0.03149634972214699, -0.02887953445315361, 0.058234505355358124, -0.0049994164146482944, 0.04223360866308212, 0.03093637153506279, -0.012649938464164734, 0.03460367023944855, 0.07264014333486557, -0.04516536742448807, 0.09104371815919876, 0.11036709696054459, 0.033163346350193024, 0.015471857972443104, 0.03623524308204651, 0.08519408106803894, -0.1029333621263504, -0.06625111401081085, 0.002294317353516817, -0.017639366909861565, 0.08417295664548874, 0.032543472945690155, 0.0005732151912525296, -0.05341566726565361, -0.04132577031850815, 0.05407245457172394, 0.02635597251355648, -0.0619114525616169, 0.019311757758259773, -0.041848041117191315, -0.07455866038799286, 0.01219969242811203, -0.1515268236398697, 0.022090138867497444, 0.018917590379714966, -0.027435632422566414, 0.0187141802161932, -0.061661262065172195, -0.010826765559613705, -0.034443601965904236, -0.008014592342078686, 0.025369688868522644, 0.028164513409137726, -0.05948382616043091, 0.009900879114866257, 0.022236375138163567, -0.048738494515419006, -0.02787291258573532, 0.05232422426342964, -0.06997160613536835, -0.05178596451878548, 0.02892497554421425, -0.021728213876485825, 0.048943519592285156, -0.007871584966778755, -0.04175823554396629, 0.03298370540142059, 0.0019051076378673315, -0.03643391653895378, -0.026357155293226242, 0.005125164054334164, -0.07661016285419464, 0.032142121344804764, -0.041955504566431046, 0.0404273085296154, -0.028859885409474373, 0.04945677891373634, 0.05448203533887863, 0.029926516115665436, -0.05589357390999794, -0.016698604449629784, 0.018503082916140556, -0.08449355512857437, 0.05664455145597458, 0.08907835185527802, 0.026004036888480186, 0.09168872982263565, -0.0618426688015461, 0.01680717244744301, 0.022051535546779633, 0.07884531468153, -0.06892823427915573, -0.011504406109452248, 0.03650136664509773, 0.05996546521782875, 0.05414798855781555, 0.08493572473526001, 0.03705861419439316, -0.04293590039014816, -0.03679797053337097, -0.03427542373538017, 0.011615949682891369, 0.0007779694860801101, -0.0035203055012971163, 0.06806990504264832, -0.00869890209287405, -0.08449087291955948, 0.08645082265138626, 0.0404161773622036, 0.05853777378797531, 0.04117349162697792, 0.07889348268508911, 0.05411960557103157, 0.042751945555210114, -0.1031513512134552, -0.0345442108809948, -0.0985492542386055, 6.717756258381487e-33, -0.023758433759212494, 0.020916514098644257, 0.022577360272407532, 0.043832942843437195, 0.05627827346324921, 0.012353450991213322, 0.031184229999780655, -0.053583476692438126, -0.049573056399822235, -0.036501191556453705, -0.09955726563930511, 0.02725529484450817, 0.009927268140017986, 0.11552250385284424, 0.018900850787758827, -0.0447758249938488, 0.0046624974347651005, 0.0022223980631679296, 0.012310441583395004, 0.02935520000755787, -0.01210799627006054, 0.0747171938419342, -0.04690144956111908, 0.009555798955261707, -0.09411567449569702, -0.007960760965943336, 0.012181642465293407, -0.024664662778377533, -0.00509810633957386, -0.0204757209867239, -0.04550300911068916, -0.05600609630346298, 0.015391976572573185, -0.03861181065440178, 0.03318893164396286, 0.02491636574268341, 0.007434167433530092, 0.029318932443857193, -0.1150190681219101, -0.04116860777139664, 0.02193307690322399, 0.07474914938211441, 0.05663884058594704, -0.05455022305250168, -0.05662519484758377, 0.012862184084951878, -0.07759366184473038, 0.10235070437192917, 0.016379032284021378, 0.03873973339796066, -0.011731063947081566, -0.02449951320886612, 0.007144010625779629, -0.03845856338739395, -0.007520436774939299, -0.056394804269075394, 0.05764554813504219, -0.04644943028688431, 0.06215061992406845, -0.04048081487417221, 0.028230013325810432, 0.007954210974276066, 0.0032104342244565487, 0.02658306621015072, -0.007363288663327694, 0.02647886984050274, 0.040512241423130035, -0.012856370769441128, -0.07879908382892609, 0.011491662822663784, -0.09347741305828094, 0.05746600031852722, 0.011733358725905418, -0.0836121067404747, 0.0028327531181275845, -0.08631598949432373, -0.02396238036453724, -0.08001624047756195, -0.09975627064704895, 0.009611629880964756, -0.04099732264876366, 0.05782930180430412, -0.03901882469654083, -0.14866431057453156, -0.07940968871116638, -0.015360359102487564, 0.017494304105639458, -0.019944962114095688, -0.055551450699567795, -0.006867458578199148, -0.0904289036989212, -0.04212937504053116, 0.05648187920451164, -0.043650902807712555, -0.053525280207395554, -6.232606964594082e-33, 0.04736015573143959, 0.04248058423399925, 0.017842929810285568, 0.07543591409921646, 0.007480042986571789, -0.002772129373624921, 0.13029898703098297, 0.0445946604013443, 0.0067186965607106686, 0.013890904374420643, 0.0340871699154377, 0.011819749139249325, -0.0026281564496457577, -0.10735660046339035, 0.03081522509455681, -0.08537260442972183, -0.034044962376356125, -0.007894212380051613, 0.01136289443820715, -0.013064716011285782, -0.07291252166032791, 0.08416730165481567, 0.006896384060382843, 0.05766477435827255, -0.060609959065914154, 0.08231691271066666, 0.04468311741948128, 0.011083394289016724, -0.03342421352863312, -0.06454834342002869, -0.022947821766138077, -0.08948522806167603, -0.0889749526977539, 0.054457392543554306, 0.04612443223595619, 0.03319796919822693, 0.05520997941493988, -0.03964202478528023, -0.0676344484090805, 0.010608932003378868, 0.047671884298324585, 0.02335810847580433, -0.05231454223394394, 0.05232273042201996, -0.003061250550672412, 0.006324655842036009, 0.01942974142730236, 0.08102644234895706, 0.07364920526742935, 0.04952888563275337, 0.026980608701705933, -0.018927183002233505, -0.05655863881111145, -0.03767813742160797, 0.03412141650915146, -0.002305444795638323, -0.030872823670506477, 0.010685128159821033, 0.030283905565738678, 0.01346874050796032, -0.013396796770393848, -0.10709547251462936, -0.029694663360714912, -0.09217245876789093, -0.031894464045763016, -0.003317169612273574, -0.1317823976278305, -0.011686814948916435, -0.010955550707876682, 0.10284767299890518, -0.01664748601615429, 0.058255214244127274, 0.030165310949087143, 0.04286735877394676, 0.034436509013175964, -0.014521347358822823, -0.045934002846479416, 0.03570927307009697, 0.07071875780820847, -0.023169316351413727, -0.01672441139817238, 0.007434815634042025, 0.030455587431788445, 0.07728268206119537, 0.049195464700460434, -0.012257852591574192, 0.00788111425936222, 0.03905433416366577, 0.03627098724246025, -0.04964735731482506, 0.021263020113110542, 0.05665356665849686, 0.05523300915956497, 0.05871964991092682, 0.06964270770549774, -5.188578100501218e-08, 0.003935694228857756, -0.006080257706344128, -0.007350201718509197, 0.053490620106458664, -0.02809295430779457, -0.01817254163324833, 0.045261818915605545, -0.048076238483190536, 0.05164838582277298, -0.021801767870783806, 0.06770768016576767, -0.025861868634819984, -0.03030388616025448, 0.0416610948741436, -0.03683074191212654, -0.006680408027023077, -0.034404125064611435, -0.007124046795070171, 0.010916925966739655, -0.06716755032539368, 0.01140405610203743, -0.01481468603014946, -0.04658765718340874, -0.03213902562856674, -0.022016704082489014, -0.042158856987953186, 0.028690168634057045, 0.07998521625995636, -0.06523042917251587, 0.007591114845126867, 0.11083956807851791, -0.07724837213754654, 0.09135130047798157, 0.019358167424798012, -0.01277873758226633, -0.009219223633408546, -0.03213058039546013, 0.015859028324484825, 0.024264175444841385, 0.01938697136938572, -0.04213550314307213, 0.04516523703932762, 0.04524771124124527, -0.05032419413328171, 0.07718242704868317, -0.0557960644364357, 0.010766150429844856, -0.0507979542016983, 0.006679895333945751, 0.17671096324920654, 0.014462747611105442, 0.01735812798142433, -0.03023659624159336, 0.08861962705850601, 0.0699140653014183, -0.13622555136680603, -0.012037924490869045, 0.02544179931282997, 0.01803266443312168, 0.029402373358607292, 0.02965657040476799, -0.01378049049526453, -0.037460822612047195, -0.03812072053551674 ] }, { "text": "# Example:\n# save_dream(result, \"my_dream.png\")\n\nSummary¶\n\nWe've built Deep Dream from scratch! Here's what we learned:\n\n• Neural networks detect hierarchical features - edges → textures → parts → objects\n•\n\n• Gradient ascent on inputs - instead of training the network, we modify the image\n•\n\n• Multi-scale processing - improves visual quality\n•\n\n• Networks have biases - they \"see\" what they were trained to recognize\n•\n\nKey Takeaways for Understanding AI:¶\n\n• Feature visualization reveals what networks learn\n•\n\n• Training data biases become visible in network behavior\n•\n\n• The same gradient-based principles underpin adversarial examples, style transfer, and more\n•\n\nNext Steps:¶\n\n• Try different pre-trained models (VGG, ResNet)\n•", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_76", "embedding": [ -0.041463401168584824, -0.024536658078432083, 0.10217950493097305, 0.060509420931339264, 0.10180898755788803, -0.011206809431314468, -0.09366986155509949, -0.04358725622296333, -0.005518470890820026, -0.055195365101099014, -0.09209830313920975, 0.00404231296852231, 0.019161293283104897, -0.049492549151182175, -0.05448678135871887, -0.006726393010467291, 0.029701141640543938, 0.07477176189422607, -0.11207693070173264, -0.06372499465942383, 0.06714128702878952, -0.03863547742366791, 0.01597552001476288, -0.0649089440703392, 0.07047975063323975, 0.04775404930114746, 0.003777968930080533, -0.009034228511154652, 0.022028302773833275, -0.057018961757421494, 0.020284172147512436, -0.02461395412683487, 0.024808095768094063, 0.05447490140795708, -0.03684861212968826, 0.1212942898273468, -0.06200360506772995, -0.02899315021932125, 0.014520249329507351, -0.07433992624282837, 0.01898503303527832, -0.06630522012710571, 0.007168020121753216, -0.010478004813194275, 0.07410819828510284, 0.017670514062047005, -0.019626691937446594, -0.06414380669593811, -0.018328040838241577, -0.01072736643254757, -0.06305056810379028, -0.06908965855836868, -0.038071438670158386, 0.02626827172935009, 0.03474576771259308, 0.035416148602962494, 0.010062349028885365, 0.014874863438308239, 0.012415554374456406, -0.007242710329592228, 0.03290514275431633, -0.004304520320147276, -0.01804795116186142, -0.014778479002416134, -0.00014867733989376575, -0.03188050910830498, -0.0385582335293293, 0.04350379854440689, 0.09513882547616959, -0.06776176393032074, 0.0560423769056797, 0.08292809128761292, -0.04815992712974548, 0.007219680584967136, 0.06672332435846329, 0.05032705143094063, 0.05440468341112137, -0.0016552184242755175, -0.0050012958236038685, -0.08536195009946823, 0.05866632238030434, -0.025164088234305382, 0.014626519754529, 0.00942615419626236, 0.0419464148581028, 0.03645866736769676, -0.018021268770098686, -0.029833948239684105, -0.016691122204065323, -0.04000450670719147, 0.0013459344627335668, -0.04583406448364258, -0.07116756588220596, 0.014969180338084698, 0.03715009242296219, 0.021078353747725487, -0.02497527003288269, -0.14079560339450836, -0.08113853633403778, 0.03553500771522522, 0.022693132981657982, -0.02459673397243023, 0.07542885839939117, -0.043227750808000565, 0.025036757811903954, 0.010437608696520329, 0.12554487586021423, 0.010629212483763695, 0.029092909768223763, -0.019963502883911133, 0.0026054205372929573, 0.04081820696592331, -0.03930939733982086, -0.016104228794574738, 0.04705820977687836, -0.04560161009430885, -0.09628951549530029, 0.012747949920594692, -0.035547200590372086, 0.042573049664497375, -0.032907161861658096, 0.03403036296367645, -0.0026795114390552044, -0.019464118406176567, -0.02891186997294426, -0.04445614665746689, -0.13822941482067108, 4.760363473010524e-33, 0.019942443817853928, -0.001558358664624393, 0.010194414295256138, 0.05372127890586853, 0.15971723198890686, -0.05549907684326172, 0.006916654296219349, -0.01983165554702282, -0.03630823269486427, 0.05504672974348068, -0.02604314498603344, 0.03743695467710495, -0.07352231442928314, 0.20643757283687592, -0.004402699880301952, -0.010479964315891266, -0.0370713546872139, -0.06859342753887177, 0.08379939198493958, 0.0669199749827385, -0.03973795473575592, -0.019761864095926285, 0.004698071163147688, -0.03333623707294464, -0.056142330169677734, 0.02802993915975094, -0.006976898293942213, 0.0010561079252511263, 0.013230457901954651, 0.012585919350385666, -0.09871181845664978, 0.009734606370329857, -0.012587392702698708, 0.002848706441000104, -0.04097218066453934, 0.045653071254491806, 0.02836635708808899, -0.036253754049539566, -0.036488212645053864, -0.016342421993613243, 0.02172335796058178, 0.05962008982896805, -0.03925536200404167, -0.021989043802022934, -0.01885312981903553, 0.01756024919450283, 0.004499684553593397, 0.013336163014173508, -0.03833644837141037, 0.008023545145988464, -0.0004867472453042865, -0.01626434549689293, -0.03654948249459267, -0.0585944838821888, -0.03020823746919632, 3.9590882806805894e-05, 0.05211358517408371, 0.03245428949594498, 0.0578342080116272, -0.02082877792418003, 0.046208616346120834, 0.014120650477707386, 0.007191592827439308, 0.06234585493803024, -0.024017665535211563, 0.029344018548727036, 0.028513910248875618, 0.0177864171564579, 0.002681080950424075, -0.01213482953608036, -0.07399001717567444, 0.05403764173388481, -0.03194306418299675, -0.061824195086956024, -0.020593009889125824, -0.008048982359468937, -0.05517026409506798, -0.05361955612897873, -0.007321909535676241, 0.060011643916368484, -0.006700151599943638, 0.06928237527608871, -0.03812778741121292, -0.06209433823823929, 0.008120567537844181, 0.0617058165371418, 0.012058703228831291, -0.10370892286300659, 0.04023124277591705, 0.04981821030378342, -0.052340053021907806, -0.04007429629564285, 0.02961118519306183, -0.01564144715666771, -0.049594249576330185, -4.753112142233889e-33, -0.018689334392547607, 0.1276528388261795, -0.08774758130311966, 0.07550692558288574, 0.006319859530776739, -0.04029867798089981, 0.026992352679371834, -0.008359591476619244, -0.030934274196624756, -0.0004218898538965732, 0.038974083960056305, -0.02947569452226162, -0.000479450129205361, -0.06233101710677147, 0.04003244638442993, -0.1191248670220375, -0.046948567032814026, -0.03282218053936958, -0.0007040953496471047, -0.0007039254996925592, 0.0246558990329504, 0.1334698349237442, -0.08445403724908829, 0.03723679855465889, -0.09399818629026413, -0.005391091573983431, -0.023717133328318596, 0.06763363629579544, -0.012236942537128925, 0.009502286091446877, 0.0020294329151511192, -0.02895960584282875, -0.013008860871195793, 0.04295380786061287, 0.04451733082532883, 0.08721865713596344, 0.06344489753246307, -0.08814465254545212, -0.011176945641636848, 0.009298664517700672, 0.07239487022161484, -0.056609418243169785, -0.04644389823079109, -0.033437713980674744, -0.02821202203631401, 0.0077454326674342155, -0.013059865683317184, 0.003599386429414153, 0.03632260486483574, 0.055461812764406204, 0.08343072235584259, -0.008083789609372616, -0.11485636234283447, -0.06697563827037811, -0.011271856725215912, -0.05011625215411186, 0.04756573587656021, 0.05841965600848198, 0.10537317395210266, 0.07672657072544098, -0.05402718484401703, -0.07856491208076477, -0.07850124686956406, -0.02859262377023697, -0.037022486329078674, 0.03511478379368782, -0.09358926117420197, 0.07634427398443222, 0.03252986818552017, -0.009045748971402645, -0.015527445822954178, 0.0015525565249845386, 0.007779448758810759, 0.1012282520532608, -0.022471437230706215, -0.08396374434232712, -0.04276104271411896, 0.005839561112225056, 0.010813930071890354, -0.024938208982348442, -0.005529538728296757, -0.048153143376111984, -0.03618444874882698, 0.09431875497102737, 0.1104896143078804, 0.11114475131034851, -0.0025320001877844334, 0.009430677630007267, 0.008979619480669498, -0.027297822758555412, -0.03239741548895836, 0.04626142978668213, -0.02994835004210472, 0.09934072196483612, -0.0031099787447601557, -5.318885243354998e-08, -0.06670619547367096, 0.00943204015493393, 0.0833282470703125, 0.050236400216817856, 0.010709220543503761, -0.05653253570199013, 0.02118021808564663, 0.04429252818226814, -0.037734221667051315, 0.014610854908823967, -0.018786132335662842, 0.025861244648694992, -0.06291969120502472, -4.4296476175986754e-07, 0.02539156749844551, 0.03624391928315163, 0.037297848612070084, 0.055191632360219955, 0.035339903086423874, -0.09126055985689163, 0.07058661431074142, 0.02709919586777687, -0.011621017940342426, -0.07032196968793869, 0.06667819619178772, -0.0807344987988472, -0.03112979047000408, 0.07242462784051895, -0.07140101492404938, 0.02818947844207287, 0.014369159936904907, -0.012824976816773415, 0.028164587914943695, -0.027935585007071495, 0.020096685737371445, 0.07426533102989197, -0.004302972462028265, 0.0016529461136087775, 0.055943772196769714, -0.028443412855267525, 0.002655057003721595, 0.052629999816417694, 0.03978504240512848, -0.045721497386693954, -0.090178482234478, 0.009967362508177757, 0.014190832152962685, -0.06133108213543892, 0.024101894348859787, 0.08985894918441772, 0.007982105948030949, 0.017935248091816902, 0.0203449334949255, 0.050236959010362625, 0.07867906987667084, -0.08123933523893356, -0.0011019438970834017, 0.013595486991107464, 0.02928345836699009, 0.09751344472169876, 0.04509362950921059, 0.06557365506887436, -0.024606779217720032, -0.051308806985616684 ] }, { "text": "Next Steps:¶\n\n• Try different pre-trained models (VGG, ResNet)\n•\n\n• Experiment with maximizing specific neurons instead of whole layers\n•\n\n• Combine with style transfer for even more creative results\n•\n\n• Explore modern interpretability tools like Lucid or TransformerLens\n•\n\nThanks for reading! If you found this helpful, consider following for more deep learning tutorials.\n\nIn [19]:\n\n!jupyter nbconvert --to html https://colab.research.google.com/drive/1EvQjVea0M3qkUVMkil3ZtujnGcRGjBB_?usp=drive_link\n\n[NbConvertApp] WARNING | pattern '/content/deep_dream_tutorial.ipynb' matched no files\nThis application is used to convert notebook files (*.ipynb)\nto various other formats.\n\nWARNING: THE COMMANDLINE INTERFACE MAY CHANGE IN FUTURE RELEASES.", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_77", "embedding": [ -0.07945159077644348, -0.03047832101583481, 0.054546765983104706, -0.013500512577593327, -0.029509395360946655, 0.007645478472113609, -0.10420297831296921, 0.015212390571832657, -0.0349591039121151, -0.05067384988069534, -0.06974523514509201, 0.0037264907732605934, -0.032041653990745544, -0.012322439812123775, -0.05448227375745773, -0.004193785600364208, 0.00775117939338088, 0.10217183083295822, -0.08529268950223923, -0.031106263399124146, 0.02275332808494568, -0.012623501941561699, 0.059142135083675385, -0.09582322835922241, 0.0462021604180336, -0.004744634032249451, -0.017108026891946793, -0.019433360546827316, 0.003380499081686139, -0.04974082484841347, 0.031940072774887085, 0.013379045762121677, -0.06327527016401291, 0.06466501206159592, 0.09919692575931549, 0.0462576299905777, -0.04039016738533974, -0.025080589577555656, -0.009687712416052818, -0.04683751240372658, 0.11060543358325958, 0.01083301194012165, -0.0058092824183404446, -0.0034618873614817858, 0.05819430202245712, -0.03080383501946926, 0.013168474659323692, -0.06706026941537857, 0.05970818176865578, -0.04816810414195061, -0.08189747482538223, 0.014651703648269176, -0.013305509462952614, 0.044929854571819305, 0.012255988083779812, 0.04148310795426369, -0.005671534687280655, 0.039276547729969025, 0.02889985591173172, -0.04382544755935669, -0.04751062020659447, 0.011032420210540295, 0.0040522124618291855, -0.029604529961943626, -0.010096129961311817, 0.0028423143085092306, -0.060526084154844284, 0.09568870812654495, 0.054102715104818344, -0.03886304795742035, 0.018572669476270676, 0.04922321438789368, -0.06771236658096313, 0.08015241473913193, 0.04924802482128143, 0.011284342966973782, 0.04898211732506752, 0.013261585496366024, 0.06714321672916412, -0.09581517428159714, -0.010584118776023388, -0.021416814997792244, 0.05721038579940796, 0.01999436877667904, 0.06112644448876381, -0.015143375843763351, -0.0594002902507782, 0.02398134209215641, -0.0470760352909565, -0.05224410444498062, 0.02907467447221279, -0.05880886688828468, -0.026300961151719093, -0.0034125070087611675, -0.0438116192817688, 0.022851957008242607, -0.026824260130524635, -0.04465034231543541, -0.05224985256791115, 0.07590960711240768, 0.007028394378721714, -0.028607450425624847, 0.07587657123804092, -0.041231367737054825, 0.014815036207437515, -0.008585546165704727, 0.1192828044295311, 0.03476634994149208, -0.005685009993612766, -0.07153972238302231, 0.017186583951115608, -0.0008602886227890849, -0.019536659121513367, -0.029988138005137444, 0.08466675877571106, 0.004106583539396524, -0.014711343683302402, 0.0649416372179985, -0.008047351613640785, 0.04009230062365532, -0.1065295934677124, -0.018861087039113045, -0.052955176681280136, 0.011698657646775246, -0.03197554126381874, 0.01901285909116268, -0.07518163323402405, 1.192441893688474e-32, -0.0441197045147419, -0.03579329699277878, 0.039665352553129196, -0.01377233024686575, 0.1044987291097641, -0.017819907516241074, 0.03746160492300987, -0.002057401929050684, -0.078829824924469, 0.03537333384156227, -0.08960850536823273, -0.020119568333029747, -0.06704460084438324, 0.11001967638731003, -0.09372343122959137, -0.07405253499746323, -0.048040490597486496, -0.005275375209748745, 0.03893474116921425, -0.028451718389987946, 0.05272180214524269, 0.00980883277952671, -0.025158628821372986, -0.031959522515535355, -0.07283702492713928, -0.04737267643213272, 0.04686068370938301, 0.00329101225361228, 0.05356346070766449, 0.01694481261074543, -0.11778566986322403, 0.001072878367267549, -0.0032472030725330114, -0.0399753674864769, -0.10292400419712067, 0.00686489837244153, 0.016087627038359642, -0.008015756495296955, 0.0005945427692495286, -0.054373085498809814, -0.03167486563324928, 0.018804680556058884, -0.03580286726355553, -0.028733516111969948, -0.029842637479305267, 0.08634063601493835, 0.051176879554986954, 0.03431497514247894, -0.028614964336156845, 0.0219909455627203, -0.004130312707275152, -0.036738064140081406, -0.018425162881612778, -0.039047133177518845, 0.0007224437431432307, 0.011295465752482414, 0.11142241954803467, 0.0731218159198761, 0.10898055136203766, 0.02494783140718937, 0.0929618552327156, 0.02662477269768715, -0.030609900131821632, 0.047726765275001526, 0.059722330421209335, 0.024269262328743935, -0.02967158332467079, -0.03450813889503479, -0.015131810680031776, -0.0035796230658888817, -0.055757828056812286, 0.06260377168655396, 0.019862938672304153, -0.06089366599917412, 0.07621940970420837, -0.047709234058856964, -0.040830083191394806, -0.008426855318248272, -0.04737164080142975, -0.04496477544307709, -0.04793131351470947, 0.11135649681091309, -0.014007394202053547, -0.025463934987783432, -0.00494468305259943, -0.001389835961163044, 0.03505846485495567, -0.07126311957836151, 0.01587066240608692, 0.04279610142111778, 0.09698080271482468, -0.012866432778537273, -0.025457045063376427, -0.010993470437824726, -0.09343458712100983, -9.082533508761208e-33, 0.04116145148873329, 0.10745187848806381, -0.06361983716487885, -0.005177741404622793, -0.04358683526515961, 0.005633566994220018, 0.03599490597844124, 0.05017158016562462, 0.008339593186974525, -0.04696016013622284, 0.0649317130446434, -0.061252180486917496, 0.07386329770088196, -0.09943751990795135, -0.010290703736245632, -0.029658570885658264, -0.03531932458281517, 0.018014511093497276, 0.02623572014272213, -0.010722138918936253, -0.05246461182832718, 0.12235984951257706, -0.04933898150920868, 0.07576744258403778, -0.0518677644431591, -0.030720479786396027, -0.010243923403322697, 0.13237826526165009, 0.029440604150295258, 0.030066531151533127, -0.025001803413033485, 0.0420793816447258, -0.06406921148300171, -0.016441741958260536, 0.01576291024684906, 0.0668511688709259, 0.05332425236701965, -0.059333767741918564, 0.0035343708004802465, -0.03680136799812317, 0.0630384013056755, 0.0023465482518076897, -0.0798349678516388, 0.021697424352169037, 0.03119022771716118, 0.005862019024789333, -0.05742250010371208, 0.011214149184525013, -0.05178730934858322, 0.020991303026676178, 0.026410309597849846, -0.053385112434625626, -0.042284488677978516, -0.001579499221406877, 0.019823560491204262, 0.03456874191761017, 0.031226830556988716, -0.022836672142148018, 0.025556687265634537, 0.03548178821802139, -0.08265525847673416, -0.10694833844900131, -0.0539664551615715, -0.12881572544574738, 0.0064187063835561275, -0.04486362636089325, -0.04816364496946335, 0.0861997902393341, 0.06543166935443878, 0.013798042200505733, 0.06442633271217346, 0.053447432816028595, 0.10192866623401642, 0.06426382809877396, 0.011412523686885834, -0.02461579069495201, 0.013724003918468952, 0.04942826181650162, -0.016760077327489853, 0.0006395716336555779, -0.025538604706525803, 0.04662561044096947, 0.007707006298005581, 0.09988534450531006, 0.06910452991724014, 0.1104544848203659, 0.02789692021906376, 0.11071918904781342, 0.04608610272407532, 0.04745761305093765, -0.05525095760822296, 0.013045987114310265, 0.04517516866326332, 0.17866723239421844, -0.019213004037737846, -6.30765200071437e-08, -0.056912701576948166, 0.034233301877975464, 0.010211176238954067, 0.05652272328734398, -0.033839479088783264, -0.0304446741938591, 0.0293766800314188, 0.009286602027714252, -0.020895441994071007, 0.029552647843956947, -0.0007958708447404206, 0.010012364946305752, -0.05897560715675354, 0.031519319862127304, -0.07062405347824097, 0.10706782341003418, 0.04142574593424797, 0.06497392803430557, 0.013980557210743427, -0.015032026916742325, 0.04000606760382652, 0.0164811909198761, 0.010966647416353226, 0.022330934181809425, 0.078660748898983, -0.0551968514919281, -0.0886746495962143, 0.012789946049451828, -0.07810657471418381, -0.08263920992612839, -0.04675842076539993, -0.011614141054451466, 0.01665237359702587, -0.022771736606955528, -0.030222542583942413, 0.09323990345001221, -0.00992360059171915, 0.049887243658304214, 0.050309013575315475, 0.006711880210787058, -0.05500689893960953, -0.029829705134034157, -0.05999124422669411, -0.041168130934238434, -0.025344278663396835, -0.07849497348070145, -0.004568885546177626, -0.04061317443847656, -0.004905201960355043, 0.015228921547532082, 0.035904962569475174, 0.010246477089822292, -0.020361753180623055, 0.008916700258851051, 0.033749330788850784, -0.024865252897143364, -0.09181274473667145, 0.07434102147817612, -0.009722022339701653, 0.057191845029592514, 0.05633431300520897, 0.06333053857088089, -0.03393697366118431, -0.007423053029924631 ] }, { "text": "WARNING: THE COMMANDLINE INTERFACE MAY CHANGE IN FUTURE RELEASES.\n\nOptions\n=======\nThe options below are convenience aliases to configurable class-options,\nas listed in the \"Equivalent to\" description-line of the aliases.\nTo see all configurable class-options for some , use:\n --help-all", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_78", "embedding": [ -0.01076927687972784, -0.00025431133690290153, -0.03443043306469917, 0.05435459315776825, 0.027463622391223907, -0.01322425901889801, 0.03848221153020859, 0.010274866595864296, -0.1610059142112732, 0.018308192491531372, 0.0292756799608469, -0.01407899521291256, -0.02217143215239048, -0.0063112471252679825, 0.029551345854997635, -0.04431643709540367, -0.02582145668566227, -0.0852040946483612, -0.09048473834991455, 0.07747433334589005, 0.05555922910571098, 0.050507865846157074, -0.09825340658426285, 0.004892216995358467, -0.08274277299642563, 0.01279300544410944, -0.01763833314180374, -0.04023689776659012, -0.020823180675506592, -0.03773992136120796, -0.07085008919239044, 0.11038476228713989, -0.02907736971974373, 0.00892732571810484, 0.04741593822836876, 0.04987732321023941, 0.09583728015422821, 0.039066996425390244, 0.016545433551073074, -0.01496072206646204, -0.029749782755970955, 0.03786611929535866, 0.011140543036162853, -0.036183107644319534, -0.10357284545898438, -0.035017047077417374, 0.000708389503415674, -0.1402307003736496, -0.07137539237737656, -0.06989207863807678, -0.00644370261579752, 0.034573521465063095, 0.008853868581354618, -0.06115090847015381, 0.0240484531968832, 0.04283319041132927, -0.09433222562074661, 0.06633872538805008, 0.028117718175053596, 0.022127917036414146, -0.1454334259033203, 0.03072153590619564, 0.031150147318840027, 0.025532910600304604, -0.11237385869026184, 0.005471980664879084, -0.012723305262625217, 0.050352130085229874, 0.08921131491661072, 0.05411059781908989, -0.04153944179415703, -0.04257262125611305, 0.01862160488963127, 0.005739235319197178, 0.04524353891611099, 0.06789513677358627, 0.1130235567688942, 0.042728446424007416, -0.0009099999442696571, -0.04596393182873726, -0.08854417502880096, -0.007264700252562761, 0.010873660445213318, 0.024596568197011948, 0.02013525739312172, 0.04772266373038292, -0.052074093371629715, -0.036122653633356094, 0.13738933205604553, 0.05484958365559578, -0.11239229887723923, -0.07479524612426758, -0.06200117617845535, -0.047484710812568665, -0.028290169313549995, 0.01031603291630745, -0.004685620311647654, -0.0256575308740139, -0.05810187757015228, -0.023962946608662605, -0.06575343757867813, -0.06782069057226181, 0.10946501046419144, 0.0510893277823925, -0.036782193928956985, -0.09715215861797333, 0.05233171582221985, -0.0355052575469017, 0.03740278258919716, -0.04399634525179863, -0.027493081986904144, 0.008445586077868938, 0.019111471250653267, -0.08867236226797104, 0.004297729581594467, 0.04184010624885559, -0.005513534881174564, -0.04153558239340782, 0.02787485532462597, -0.007381393574178219, -0.026430906727910042, -0.0081133171916008, 0.01024172455072403, -0.020554378628730774, -0.004977743607014418, -0.00804379303008318, -0.045044925063848495, 4.995158918695675e-33, 0.03759846091270447, -0.06566386669874191, 0.017451105639338493, 0.027551326900720596, 0.05412636324763298, -0.0031974161975085735, 0.007831594906747341, -0.004704817198216915, -0.015290748327970505, -0.0014567469479516149, 0.08941081166267395, 0.0006540755275636911, -0.0709267184138298, 0.12577810883522034, -0.0030051704961806536, 0.0011832857271656394, -0.006383152678608894, 0.06493812799453735, -0.02001616358757019, -0.06680597364902496, 0.0033172147814184427, 0.10676244646310806, -0.015173953957855701, -0.07248241454362869, 0.06867662817239761, 0.047485221177339554, 0.028405379503965378, 0.00518122548237443, 0.04488866776227951, -0.005245282780379057, 0.021641792729496956, -0.0033395832870155573, 0.02714880183339119, 0.03045712038874626, 0.0049315099604427814, 0.03150973469018936, -0.09946630150079727, 0.05647263303399086, -0.03785557672381401, -0.02303297631442547, -0.008169504813849926, 0.00998696032911539, -0.004520006477832794, -0.012080539017915726, 0.06119050458073616, 0.02099270187318325, -0.01822151616215706, 0.0123872896656394, 0.05367088317871094, -0.018920758739113808, -0.0027274824678897858, 0.04976201057434082, 0.04044247418642044, 0.022109219804406166, 0.06006854400038719, -0.07385256141424179, -0.020028777420520782, 0.08265390992164612, -0.008297192864120007, 0.004800231195986271, -3.1730771297588944e-05, 0.009989648126065731, 0.0021083944011479616, -0.033128947019577026, 0.041739750653505325, -0.001127237337641418, -0.078841432929039, -0.020002931356430054, 0.09659361094236374, 0.007878757081925869, -0.006624837871640921, 0.011685051955282688, -0.04007720574736595, 0.04208393767476082, 0.03433447331190109, -0.021147042512893677, -0.017805106937885284, -0.008315995335578918, 0.08630494773387909, 0.04820531979203224, -0.04681011289358139, 0.047972243279218674, -0.07145392894744873, -0.037045918405056, 0.015488464385271072, -0.09236893057823181, 0.03632579743862152, -0.0006963982596062124, 0.0534161813557148, -0.004208439029753208, 0.02686193771660328, 0.031160611659288406, 0.022756051272153854, 0.00295692658983171, -0.1186390221118927, -8.019988002005618e-33, 0.0450686551630497, 0.018769241869449615, -0.01629304699599743, 0.05885201320052147, -0.09171250462532043, 0.06247811019420624, 0.002392970258370042, 0.005948176607489586, 0.02328118495643139, -0.047866884618997574, 0.022981058806180954, 0.04567418247461319, -0.03661181777715683, -0.07131612300872803, -0.06032409891486168, -0.02091738022863865, -0.11431458592414856, -0.07225990295410156, 0.0545048713684082, 0.034395039081573486, 0.024449536576867104, -0.03076532855629921, 0.019833989441394806, 0.0338607020676136, 0.013623788952827454, -0.05284389108419418, 0.014939576387405396, 0.08752551674842834, 0.04605122283101082, -0.029249345883727074, 0.018837621435523033, 0.12107953429222107, -0.12421740591526031, 0.019553806632757187, -0.042331598699092865, -0.046646375209093094, -0.01107573788613081, 0.07996666431427002, -0.008628209121525288, 0.0997375100851059, -0.0029101695399731398, -0.006062867119908333, -0.02596234530210495, 0.0585157573223114, -0.007921209558844566, 0.02822255901992321, 0.0782855898141861, -0.04130956158041954, 0.06140327453613281, -0.0019225869327783585, 0.009892771020531654, -0.05989714711904526, 0.007255237549543381, 0.0013805525377392769, 0.049579836428165436, -0.028311515226960182, -0.0014699631137773395, 0.03068215772509575, 0.0012176188174635172, 0.04629132151603699, 0.012178000062704086, -0.012453136034309864, -0.05027427524328232, 0.02429019659757614, -0.050262827426195145, 0.055992305278778076, -0.06028740853071213, 0.007126517128199339, -0.03937795013189316, -0.013147947378456593, 0.051202595233917236, -0.13029462099075317, -0.032386887818574905, -0.08022497594356537, -0.027423251420259476, -0.015348853543400764, 0.07269813120365143, -0.0240133348852396, 0.06183435395359993, 0.06090722605586052, 0.0639958381652832, 0.013539619743824005, -0.05337636172771454, 0.009668939746916294, -0.08342434465885162, -0.012587210163474083, -0.030571933835744858, 0.127921000123024, 0.05729159340262413, 0.05140914022922516, -0.033302657306194305, -0.028705928474664688, 0.02052084542810917, 0.11880654841661453, -0.0480002723634243, -5.04419332969519e-08, -0.030148763209581375, -0.08965329825878143, -0.03669819235801697, -0.012503694742918015, -0.03596871718764305, 0.01910215988755226, -0.0620463564991951, -0.008386005647480488, 0.01871771365404129, 0.04491217061877251, 0.03446835279464722, 0.01273257378488779, 0.01788688823580742, 0.01821521297097206, -0.009920782409608364, -0.037603624165058136, -0.07212065905332565, 0.02981427125632763, 0.017323758453130722, 0.05977635458111763, -0.05226008594036102, -0.0863448977470398, -0.0708610936999321, 0.08463536947965622, -0.00513435946777463, -0.025534730404615402, -0.06503765285015106, 0.08490914106369019, -0.09324414283037186, 0.07558748871088028, 0.03854719549417496, 0.0737149715423584, 0.02386467158794403, 0.027492519468069077, 0.04792112484574318, -0.010308739729225636, -0.09995477646589279, 0.03323529288172722, 0.01784624718129635, -0.017626583576202393, -0.04572904855012894, -0.06733628362417221, -0.054351456463336945, -0.0072180465795099735, -0.028379475697875023, -0.016654783859848976, 0.01861647330224514, 0.022936036810278893, -0.023174386471509933, -0.07212915271520615, -0.0790318176150322, 0.09066568315029144, 0.03091336414217949, -0.02251693420112133, -0.02493024244904518, 0.04047543928027153, 0.028136951848864555, 0.005097735673189163, 0.03058425523340702, 0.012923130765557289, -0.02147216722369194, -0.08162406831979752, 0.0029261931777000427, 0.03893114998936653 ] }, { "text": "--debug\nset log level to logging.DEBUG (maximize logging output)\nEquivalent to: [--Application.log_level=10]\n--show-config\nShow the application's configuration (human-readable format)\nEquivalent to: [--Application.show_config=True]\n--show-config-json\nShow the application's configuration (json format)\nEquivalent to: [--Application.show_config_json=True]\n--generate-config\ngenerate default config file\nEquivalent to: [--JupyterApp.generate_config=True]\n-y\nAnswer yes to any questions instead of prompting.\nEquivalent to: [--JupyterApp.answer_yes=True]\n--execute\nExecute the notebook prior to export.\nEquivalent to: [--ExecutePreprocessor.enabled=True]\n--allow-errors", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_79", "embedding": [ 0.01980987936258316, 0.059799015522003174, -0.018785027787089348, 0.013539152219891548, 0.023863228037953377, -0.05638524889945984, 0.006064694374799728, 0.1358652412891388, -0.09474138170480728, 0.015240640379488468, -0.005615239031612873, -0.08956173807382584, 0.04796455800533295, -0.01284886710345745, 0.023157021030783653, 0.01138357724994421, -0.0021457888651639223, -0.017111806198954582, -0.017124319449067116, 0.008839132264256477, 0.05629255622625351, 0.04819123074412346, 0.04281194880604744, 0.012340797111392021, 0.019365962594747543, -0.044354382902383804, -0.004915817640721798, 0.03636849671602249, -0.055907461792230606, 0.04375738278031349, -0.012637883424758911, 0.03351692110300064, -0.021783001720905304, 0.09903697669506073, 0.16431516408920288, 0.03770914673805237, 0.083442822098732, -0.0441843681037426, 0.012950681149959564, -0.06865862011909485, 0.02682206965982914, 0.05693912133574486, -0.08782955259084702, -0.05559668689966202, -0.053777046501636505, -0.07389398664236069, -0.02264426089823246, -0.026388851925730705, -0.007312696892768145, 0.029132673516869545, -0.010399604216217995, 0.07633353769779205, 0.052243154495954514, -0.0974312350153923, -0.037426531314849854, 0.015676314011216164, 0.028720447793602943, 0.03475324809551239, 0.03391163796186447, -0.014938543550670147, -0.07390094548463821, 0.03584262728691101, -0.05733833089470863, 0.03168143332004547, -0.017491746693849564, -0.011012157425284386, -0.009968273341655731, 0.07020917534828186, 0.08168001472949982, 0.07039349526166916, -0.13310390710830688, -0.012286858633160591, -0.061853013932704926, -0.12308294326066971, -0.015246168710291386, -0.007061997428536415, -0.06879542768001556, 0.04201364144682884, -0.07083221524953842, -0.09489892423152924, -0.022376928478479385, -0.016100339591503143, -0.00523361237719655, 0.1453610062599182, -0.019457805901765823, -0.035356562584638596, 0.031638551503419876, 0.055291250348091125, 0.08221058547496796, 0.038277436047792435, -0.05581594258546829, -0.1460428386926651, -0.06517817825078964, 0.03412773832678795, -0.04867533594369888, 0.08515607565641403, -0.0046557956375181675, 0.016282446682453156, -0.03654158115386963, 0.021044567227363586, 0.04332027584314346, -0.00895282905548811, 0.10219074785709381, -0.03822455182671547, 0.08267591148614883, -0.0641254335641861, 0.04386000335216522, -0.04826240614056587, 0.01514872070401907, -0.011411440558731556, 0.03169337660074234, 0.04849629104137421, 0.09340056031942368, -0.020400917157530785, 0.1115509420633316, 0.09270665049552917, 0.020849235355854034, 0.06869268417358398, -0.024265481159090996, -0.009600523859262466, 0.13271567225456238, -0.034760765731334686, 0.03904188051819801, 0.03296149894595146, 0.1090102344751358, 0.08247590810060501, -0.013844168744981289, 3.520181668062486e-33, 0.09204194694757462, -0.047607336193323135, 0.091896653175354, 0.04961919039487839, 0.05122094228863716, 0.07128331810235977, -0.010228079743683338, -0.0026728161610662937, -0.013066991232335567, 0.06792344897985458, -0.08221043646335602, 0.030877264216542244, -0.04175226390361786, 0.032859332859516144, -0.038525890558958054, 0.027074366807937622, -0.07708878815174103, 0.025580184534192085, 0.02938629686832428, 0.0272592231631279, 0.018496938049793243, -0.04751988872885704, -0.05335310846567154, -0.026338228955864906, 0.07400228083133698, -0.01860533468425274, 0.019324779510498047, 0.015709221363067627, -0.0873829796910286, 0.016316812485456467, -0.037644676864147186, -0.0416206493973732, 0.022151151672005653, -0.06612806767225266, -0.05926046893000603, -0.047846946865320206, -0.03587251529097557, 0.011645272374153137, -0.03710901364684105, 0.010230968706309795, -0.01852399855852127, -0.02932058833539486, -0.07621770352125168, 0.01618092693388462, -0.029895702376961708, -0.01307337824255228, -0.060532476752996445, 0.03907029330730438, 0.03769277408719063, -0.03940783068537712, -0.04602361097931862, -0.00938570499420166, 0.07296206802129745, -0.10760827362537384, 0.02843625843524933, -0.0685528963804245, 0.08066064119338989, -0.05391280725598335, 0.03448064625263214, -0.036620013415813446, 0.031071001663804054, -0.017055824398994446, -0.08857764303684235, 0.056867875158786774, -0.026180321350693703, 0.011999784037470818, -0.02255193330347538, -0.0086525809019804, 0.03170616552233696, -0.012267058715224266, -0.10944206267595291, -0.030834462493658066, -0.01347365789115429, -0.0427570603787899, 0.0418807715177536, 0.019718408584594727, -0.006814540829509497, 0.06451085954904556, -0.001980036962777376, -0.021933358162641525, 0.045790743082761765, -0.01908365823328495, -0.08798098564147949, -0.015598315745592117, 0.026472149416804314, -0.04605693370103836, 0.0004697254626080394, 0.012108665890991688, -0.04638370871543884, -0.01802065223455429, 0.01734660565853119, -0.010476100258529186, 0.017485888674855232, -0.04413720220327377, -0.07863551378250122, -5.3174276744713134e-33, 0.026291485875844955, 0.011904752813279629, -0.01165724266320467, -0.015151412226259708, -0.026094282045960426, -0.003976208623498678, 0.05872005969285965, 0.021020319312810898, 0.009178807027637959, -0.031258877366781235, -0.02380361780524254, -0.042626772075891495, 0.03674069419503212, -0.006101279519498348, -0.023720698431134224, 0.07410334795713425, -0.10201741009950638, 0.01740974187850952, 0.10061538219451904, -0.023110203444957733, -0.019831404089927673, 0.02086799591779709, 0.05198656767606735, 0.07582995295524597, -0.015058589167892933, -0.08903197944164276, -0.002290613716468215, 0.012683911249041557, -0.039118584245443344, -0.059442274272441864, 0.040723301470279694, 0.0654846578836441, -0.018464207649230957, 0.002238193526864052, -0.03769807144999504, -0.07787211984395981, 0.02378566563129425, 0.032112784683704376, 0.021057354286313057, 0.09988772869110107, 0.072947658598423, 0.019350020214915276, -0.03366360813379288, 0.035712212324142456, 0.015988318249583244, 0.020606566220521927, -0.013687320053577423, -0.0697007104754448, -0.030161825940012932, -0.005253254435956478, -0.04943465441465378, -0.036225758492946625, 0.03394700586795807, -0.005257852375507355, 0.006508493795990944, 0.010656753554940224, -0.0048075648956000805, 0.03153316304087639, -0.10524418205022812, 0.04147796332836151, -0.044985201209783554, -0.06808210164308548, 0.03129047900438309, -0.058100782334804535, -0.06007733568549156, -0.041568707674741745, -0.022017285227775574, 0.07421568036079407, -0.007811213377863169, -0.05084337294101715, 0.018198292702436447, -0.11698529869318008, -0.0063751437701284885, 0.03127748891711235, 0.0381312295794487, 0.014195443131029606, -0.06298698484897614, -0.12299354374408722, -0.01600135862827301, 0.0547490231692791, -0.020353948697447777, 0.0007205067668110132, -0.04966474324464798, 0.018366118893027306, -0.03563491627573967, -0.030283266678452492, -0.06612036377191544, 0.1233074814081192, 0.058348070830106735, 0.041891541332006454, -0.03646717220544815, -0.02482898160815239, 0.005585895851254463, 0.048011064529418945, -0.024153949692845345, -4.9002863988789613e-08, -0.09354427456855774, -0.07894574105739594, 0.024359099566936493, -0.015033135190606117, 0.015311850234866142, 0.06334081292152405, 0.04922507330775261, 0.008747893385589123, 0.012198728509247303, -0.02219056710600853, -0.01753152348101139, -0.008155536837875843, -0.11153233051300049, 0.053903549909591675, -0.04895694926381111, 0.01932613179087639, 0.042603954672813416, 0.07404936850070953, -0.018153062090277672, -0.0193385798484087, 0.03944623842835426, 0.03668937087059021, -0.001529789064079523, 0.06837914884090424, 0.05279681086540222, -0.04650386422872543, -0.013183663599193096, 0.01776193454861641, -0.03982790187001228, -0.04449331387877464, -0.03844049200415611, -0.02230234444141388, 0.017268363386392593, 0.013238885439932346, -0.121563620865345, 0.032938674092292786, -0.018373001366853714, 0.002201171824708581, 0.07096898555755615, -0.020413847640156746, -0.07078910619020462, 0.013875691220164299, -0.024131372570991516, -0.05201857164502144, -0.04268058389425278, -0.029826363548636436, 0.02747778780758381, 0.022287629544734955, -0.0006943269399926066, -0.016972975805401802, -0.044536709785461426, 0.04217443987727165, 0.05632010102272034, 0.044704582542181015, 0.028699954971671104, 0.03143814206123352, -0.07403667271137238, 0.026979953050613403, 0.0939183458685875, 0.005578346084803343, 0.06534122675657272, 0.04107650741934776, 0.012014326639473438, -0.02010202780365944 ] }, { "text": "--execute\nExecute the notebook prior to export.\nEquivalent to: [--ExecutePreprocessor.enabled=True]\n--allow-errors\nContinue notebook execution even if one of the cells throws an error and include the error message in the cell output (the default behaviour is to abort conversion). This flag is only relevant if '--execute' was specified, too.\nEquivalent to: [--ExecutePreprocessor.allow_errors=True]\n--stdin\nread a single notebook file from stdin. Write the resulting notebook with default basename 'notebook.*'\nEquivalent to: [--NbConvertApp.from_stdin=True]\n--stdout\nWrite notebook output to stdout instead of files.\nEquivalent to: [--NbConvertApp.writer_class=StdoutWriter]\n--inplace\nRun nbconvert in place, overwriting the existing notebook (only\nrelevant when converting to notebook format)", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_80", "embedding": [ -0.005172012373805046, 0.04635659605264664, -0.022014420479536057, 0.0782531201839447, -0.030487800016999245, 0.003890050807967782, -0.0322393923997879, 0.09427343308925629, -0.032905347645282745, -0.0177681352943182, -0.04164713993668556, -0.03282180055975914, -0.012971863150596619, -0.022642794996500015, -0.1010589674115181, -0.09272241592407227, 0.016250349581241608, 0.04667441546916962, -0.014187381602823734, -0.008368202485144138, 0.009607584215700626, 0.06110764667391777, 0.035749055445194244, 0.013540532439947128, 0.024518124759197235, 0.00532888388261199, -0.0440995879471302, 0.011630039662122726, -0.04025639221072197, 0.026579245924949646, 0.006021348759531975, 0.021339870989322662, -0.005678280256688595, 0.11125318706035614, 0.19481515884399414, 0.015886390581727028, 0.023781750351190567, 0.00022725465532857925, 0.0237733181566, -0.02315784990787506, 0.09501014649868011, 0.007123454008251429, -0.09621571004390717, -0.001796032185666263, -0.054680727422237396, -0.09852088987827301, -0.029388941824436188, -0.03261822834610939, 0.015356049872934818, 0.020566241815686226, -0.02303764969110489, 0.044369373470544815, -0.019588511437177658, -0.026050403714179993, 0.026341380551457405, 0.08144215494394302, -0.061787333339452744, -0.02513018622994423, 0.02380596287548542, 0.0012519550509750843, -0.06862874329090118, -0.005426033865660429, -0.07628116756677628, 0.015062441118061543, -0.02894122712314129, 0.0452345609664917, -0.06990417093038559, 0.06139576807618141, 0.034135982394218445, 0.06652048230171204, -0.0389571450650692, 0.024591129273176193, -0.10385099798440933, 0.024655377492308617, -0.015554159879684448, -0.03037058562040329, -0.011710756458342075, -0.00843916367739439, -0.051258884370326996, -0.07607326656579971, -0.008897390216588974, -0.0377480573952198, 0.02264743112027645, 0.060084786266088486, 0.0044189863838255405, 0.035051409155130386, -0.009868429973721504, 0.07724536955356598, 0.06107485666871071, -0.024184968322515488, -0.06602942198514938, -0.11427553743124008, 0.04629550874233246, 0.013117596507072449, -0.016352882608771324, 0.02746395394206047, 0.028027458116412163, 0.03416040539741516, 0.013625542633235455, -0.018397783860564232, 0.011304512619972229, 0.00506573123857379, 0.05624096095561981, -0.03793055936694145, 0.11465546488761902, -0.02941514365375042, 0.048522647470235825, -0.08645609021186829, 0.005158759653568268, -0.029728401452302933, -0.003634813241660595, 0.01983022876083851, 0.01461439486593008, -0.020406534895300865, 0.0979190394282341, 0.03399800881743431, 0.01959829591214657, 0.08523978292942047, 0.004479392897337675, 0.06435419619083405, 0.0037464038468897343, -0.0199806597083807, 0.04850544407963753, 0.07845386117696762, 0.040484391152858734, -0.007386453915387392, 0.018627647310495377, 3.093723337843699e-33, -0.044294342398643494, -0.054808054119348526, 0.009570692665874958, 0.02431720867753029, 0.022320695221424103, 0.05024249851703644, 0.0424053855240345, -0.015028663910925388, -0.005937633570283651, 0.0444420650601387, -0.10134901106357574, 0.030344843864440918, -0.06962092965841293, 0.030170317739248276, 0.0059007336385548115, 0.1017870083451271, -0.039307914674282074, -0.023745788261294365, 0.05886685848236084, 0.08076246082782745, 0.11609973013401031, -0.03290897607803345, -0.07038038969039917, -0.02117939293384552, 0.004765804391354322, -0.06814175099134445, -0.009964555501937866, 0.0005000319215469062, 0.014543486759066582, 0.006162841804325581, -0.09240889549255371, -0.021530048921704292, 0.028685670346021652, -0.07318849861621857, -0.050739675760269165, -0.049650680273771286, -0.018045060336589813, 0.006139215547591448, 0.024027984589338303, -0.02480720356106758, -0.08438310772180557, -0.009541518054902554, -0.08398169279098511, 0.057288751006126404, 0.042119402438402176, 0.0023948815651237965, -0.050475314259529114, 0.018660180270671844, 0.0623963288962841, -0.039000481367111206, 0.017646126449108124, 0.025375181809067726, 0.07345365732908249, -0.06192201375961304, -0.02064826525747776, -0.08902591466903687, 0.07786574214696884, 0.01757883094251156, 0.09127182513475418, -0.016813362017273903, 0.026568466797471046, 0.043574947863817215, -0.14418812096118927, 0.07409209758043289, 0.011097734794020653, 0.03919625282287598, -0.011972937732934952, 0.0015684233512729406, -0.0821526050567627, -0.0789598599076271, -0.11124417930841446, -0.05090136080980301, -0.05147344991564751, -0.051795054227113724, 0.07047165930271149, 0.027424301952123642, 0.016972022131085396, 0.0035425142850726843, 0.030078355222940445, -0.06396961212158203, 0.036146458238363266, -0.019115470349788666, -0.08764324337244034, -0.05984051898121834, -0.006293545477092266, -0.022433437407016754, -0.005198848433792591, -0.041790302842855453, -0.03957829251885414, 0.002882096916437149, 0.08053085207939148, -0.06839446723461151, -0.04842332750558853, 0.005451608449220657, -0.07622252404689789, -5.184668811857383e-33, 0.11433497071266174, 0.010958327911794186, -0.047835443168878555, 0.010593816637992859, -0.09028349071741104, 0.025773989036679268, 0.07898076623678207, -0.013104774057865143, -0.020325643941760063, -0.10005178302526474, -0.08710651844739914, -0.010443060658872128, 0.03151349350810051, 0.03624169901013374, -0.0022740073036402464, -0.028312793001532555, -0.06212214007973671, 0.030366739258170128, -0.01712440326809883, -0.04875998571515083, -0.03228069469332695, -0.011272718198597431, 0.05008227378129959, 0.12520812451839447, -0.0011050032917410135, -0.00022605768754146993, 0.014829259365797043, 0.09526508301496506, -0.05778644606471062, -0.005611961241811514, 0.0512528233230114, 0.0378664955496788, 0.03898356109857559, -0.001958992565050721, 0.006955511402338743, 0.011062027886509895, 0.006895098369568586, 0.047378476709127426, 0.016456404700875282, 0.05453724414110184, 0.13142476975917816, 0.027894506230950356, -0.06530074030160904, 0.036834970116615295, 0.036405038088560104, 0.08238842338323593, -0.005744244437664747, -0.0240439735352993, -0.06646526604890823, -0.047601185739040375, -0.014494040049612522, -0.02667832002043724, -0.051121924072504044, 0.028584061190485954, 0.01223633624613285, 0.021139390766620636, 0.0844251736998558, -0.0472882017493248, -0.08493009954690933, -0.009150215424597263, -0.061879854649305344, -0.09550472348928452, 0.07416830956935883, -0.08332092314958572, -0.05741073191165924, -0.05838555842638016, 0.026390748098492622, 0.07445359975099564, 0.05242766812443733, 0.0446518138051033, 0.04624585062265396, -0.07055959105491638, -0.008365448564291, 0.017057497054338455, -0.07178927212953568, 0.09368950128555298, -0.05750647932291031, -0.07466349005699158, -0.016905127093195915, 0.06755413860082626, -0.04033903777599335, 0.0015509508084505796, 0.03692576289176941, 0.08360178023576736, 0.024965116754174232, -0.0021513227839022875, 0.029329409822821617, 0.06530485302209854, 0.05804374814033508, 0.08913741260766983, 0.05364818125963211, -0.045303456485271454, 0.029424158856272697, 0.02806088700890541, -0.010702157393097878, -4.75419454915027e-08, -0.03703099116683006, -0.03706587105989456, 0.03280249610543251, 0.014455440454185009, -0.023045586422085762, -0.038281120359897614, 0.024262921884655952, -0.1074947789311409, 0.03819199651479721, -0.02261299081146717, -0.022251788526773453, -0.004078755620867014, -0.05528666824102402, 0.03801361471414566, -0.02651870623230934, 0.10044702887535095, 0.1008698120713234, -0.025121541693806648, 0.020183725282549858, -0.020046990364789963, -0.002230570651590824, 0.002673123963177204, 0.03622731938958168, 0.02317466214299202, 0.014517874456942081, -0.05547313392162323, -0.015035075135529041, 0.040482934564352036, -0.0101991081610322, -0.07546664774417877, -0.005069575272500515, -0.04133162647485733, 0.05521516874432564, 0.06404977291822433, -0.06271791458129883, -0.005611001513898373, 0.07917670160531998, -0.005642913747578859, 0.06914206594228745, -0.050169382244348526, -0.07724879682064056, 0.019115034490823746, -0.07234285771846771, -0.014073239639401436, -0.0490952804684639, -0.022035950794816017, -0.04555335268378258, -0.03295150399208069, -9.100673923967406e-05, -0.0037190914154052734, -0.025414805859327316, 0.05179615691304207, -0.05690499395132065, 0.06936261057853699, -0.029289234429597855, -0.031494077295064926, -0.12563219666481018, 0.019900649785995483, -0.001100964262150228, -0.042094096541404724, 0.03235519304871559, 0.02390756644308567, 0.03325001150369644, -0.016614140942692757 ] }, { "text": "--inplace\nRun nbconvert in place, overwriting the existing notebook (only\nrelevant when converting to notebook format)\nEquivalent to: [--NbConvertApp.use_output_suffix=False --NbConvertApp.export_format=notebook --FilesWriter.build_directory=]\n--clear-output\nClear output of current file and save in place,\noverwriting the existing notebook.\nEquivalent to: [--NbConvertApp.use_output_suffix=False --NbConvertApp.export_format=notebook --FilesWriter.build_directory= --ClearOutputPreprocessor.enabled=True]\n--coalesce-streams\nCoalesce consecutive stdout and stderr outputs into one stream (within each cell).\nEquivalent to: [--NbConvertApp.use_output_suffix=False --NbConvertApp.export_format=notebook --FilesWriter.build_directory= --CoalesceStreamsPreprocessor.enabled=True]\n--no-prompt", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_81", "embedding": [ -0.035153333097696304, 0.05381299927830696, -0.02916145510971546, 0.04443667083978653, -0.0423930399119854, 0.004502690397202969, -0.05813596397638321, 0.09762632101774216, -0.037058375775814056, 0.0056913550943136215, -0.03515806421637535, -0.02807595208287239, -0.026762699708342552, -0.04444948956370354, -0.07474401593208313, -0.048189882189035416, -0.04211417958140373, 0.07342273741960526, -0.024407213553786278, -0.05364464595913887, 0.051958754658699036, 0.034019824117422104, 0.08326108008623123, -0.017515577375888824, 0.09881077706813812, 0.022034021094441414, 0.005033844616264105, -0.024872630834579468, -0.004221807233989239, 0.006844762247055769, 0.02591860480606556, 0.06327623873949051, 0.007174581289291382, 0.042028769850730896, 0.19468815624713898, 0.007050301413983107, 0.03460530936717987, 0.023884616792201996, 0.02269534207880497, -0.03567081317305565, 0.10477963835000992, 0.023570025339722633, -0.09766361117362976, -0.06489814817905426, -0.11369994282722473, -0.062195830047130585, -0.0023094022180885077, -0.040648240596055984, 0.000375917850760743, 0.027302246540784836, 0.028819676488637924, 0.03424403816461563, -0.05355159193277359, 0.012172491289675236, 0.020749036222696304, 0.05163494125008583, -0.023086609318852425, 0.001974336802959442, -0.010580865666270256, -0.03887808695435524, -0.08012143522500992, 0.01090934220701456, -0.05764279142022133, -0.0026443160604685545, -0.01312902383506298, 0.06708425283432007, -0.09159944206476212, 0.09330213814973831, 0.05496795475482941, 0.03263279050588608, -0.038378339260816574, 0.04486049339175224, -0.09953399747610092, -0.0064572663977742195, -0.002634946722537279, -0.02856198139488697, 0.007116783410310745, 0.04259977117180824, -0.04467311128973961, -0.08897452801465988, 0.03911661356687546, -0.0459737628698349, 0.026954621076583862, -0.007954108528792858, 0.0006876569241285324, 0.004160964861512184, 0.017017561942338943, 0.03756945580244064, 0.03625273331999779, -0.03379286080598831, -0.06278141587972641, -0.09122014045715332, 0.075015589594841, -0.022478265687823296, -0.06256818771362305, 0.024287061765789986, 0.029807059094309807, 0.12963688373565674, 0.02606339380145073, 0.01608101651072502, 0.020490208640694618, 0.009504936635494232, 0.05012592673301697, -0.05617913976311684, 0.07832862436771393, -0.04112852364778519, 0.07403947412967682, 0.03199649229645729, 0.004398311022669077, -0.04833003506064415, 0.015441390685737133, -0.0098560256883502, 0.026860637590289116, -0.024088621139526367, 0.10880589485168457, 0.05225186422467232, 0.004586172755807638, 0.10998460650444031, -0.004205391276627779, 0.10846299678087234, 0.0498078316450119, -0.04639207944273949, -0.019937502220273018, 0.045315105468034744, 0.004779781214892864, -0.009749275632202625, 0.01546182855963707, 4.0987912116059094e-33, -0.029302524402737617, -0.03873387351632118, 0.034355539828538895, 0.007873761467635632, 0.0644703060388565, 0.08388882875442505, 0.0200534425675869, 0.02771073579788208, 0.022010918706655502, 0.03938513249158859, -0.098138228058815, 0.05478164926171303, -0.0655725747346878, 0.009224141016602516, -0.07881541550159454, -0.0016154313925653696, -0.06112656742334366, 0.006450493820011616, 0.03171183913946152, 0.038347743451595306, 0.1272653043270111, 0.04110674187541008, -0.07635937631130219, -0.03491795063018799, 0.007942001335322857, -0.07789953798055649, 0.0249476358294487, -0.00914041418582201, -0.06110680475831032, -0.00860187504440546, -0.06769124418497086, 0.013255053199827671, -0.017764747142791748, -0.06253857910633087, -0.1176242083311081, -0.028347842395305634, -0.01112713385373354, -0.006859822664409876, 0.01762411743402481, 0.019045375287532806, -0.07679877430200577, -0.022995296865701675, -0.13175907731056213, -5.787552800029516e-05, 0.032562900334596634, -0.013016155920922756, -0.0436808243393898, 0.009537734091281891, 0.022782381623983383, -0.0003635830944404006, 0.037289153784513474, 0.031210770830512047, 0.060002442449331284, -0.008116036653518677, -0.0027375195641070604, -0.05794500559568405, 0.09302493184804916, -0.044052641838788986, 0.11685281991958618, -0.02796236425638199, 0.044717900454998016, 0.10195624828338623, -0.13225199282169342, 0.04292724281549454, -0.006433131638914347, 0.022784147411584854, 0.08052133768796921, 0.0009587316308170557, -0.03944076970219612, -0.0770624503493309, -0.13012507557868958, -0.011247602291405201, -0.06819505244493484, -0.05843271687626839, 0.05585837736725807, 0.005563154350966215, -0.0018956593703478575, 0.013416956178843975, -0.043862275779247284, -0.03907343000173569, 0.02053191512823105, -0.002615293487906456, -0.09775833785533905, -0.09296086430549622, 0.03146858140826225, -0.02946162037551403, -0.015472412109375, -0.05069052055478096, -0.05747053027153015, -0.024550901725888252, 0.027988480404019356, -0.06582751125097275, -0.046317894011735916, -0.001989314565435052, -0.028429079800844193, -5.362295559158231e-33, 0.13201643526554108, 0.012812111526727676, -0.04875217005610466, -0.035519227385520935, -0.0779736191034317, 0.04247556999325752, 0.09901232272386551, -0.019084308296442032, -0.05177009850740433, -0.10214074701070786, -0.09137502312660217, -0.04248693957924843, 0.021597687155008316, -0.01252781506627798, -0.005617849063128233, 0.005857949145138264, 0.005766816437244415, 0.08938419818878174, -0.02342226356267929, -0.040876973420381546, -0.043095506727695465, 0.026030153036117554, 0.014927532523870468, 0.09670279920101166, 0.005903399549424648, -0.03047403134405613, 0.0006442402373068035, 0.10160305351018906, 0.02359911799430847, -0.0014392834855243564, 0.008900916203856468, 0.034853920340538025, 0.03522202745079994, -0.073375403881073, -0.0093834912404418, 0.035977158695459366, 0.02335522323846817, 0.0394996777176857, 0.028878146782517433, 0.012969808652997017, 0.09759324043989182, -0.0034920829348266125, -0.062779501080513, 0.07597041130065918, 0.05037817358970642, 0.07408978790044785, -0.036107055842876434, -0.02719103731215, -0.11298920214176178, -0.02618737891316414, 0.03286168351769447, -0.038712479174137115, -0.08333436399698257, 0.015202553011476994, 0.03605915606021881, -0.019158802926540375, 0.059146150946617126, -0.04860001429915428, -0.10794250667095184, -0.027405669912695885, -0.008727463893592358, -0.0541844442486763, 0.041645605117082596, -0.09101062268018723, -0.025629092007875443, -0.058707352727651596, 0.02929016388952732, 0.07721979171037674, 0.047699280083179474, 0.004672764800488949, -0.018460655584931374, -0.08446013927459717, -0.03338601067662239, 0.04868580400943756, -0.026675095781683922, 0.12117111682891846, -0.004991390276700258, -0.042878150939941406, -0.0326211079955101, 0.04116956889629364, -0.10787348449230194, -0.01886449009180069, -0.02055020071566105, 0.01520357932895422, 0.015501017682254314, 0.007347960025072098, 0.009170186705887318, 0.07838914543390274, 0.07985102385282516, 0.056805744767189026, -0.005578483920544386, 0.0068895695731043816, 0.04053331911563873, 0.03736645355820656, -0.02592882513999939, -4.866374681000707e-08, -0.001319868490099907, -0.04180949553847313, 0.02789449691772461, 0.0988134816288948, -0.015026320703327656, -0.004428790416568518, 0.0364890955388546, -0.025837916880846024, 0.008546492084860802, -0.0733191967010498, -0.021409332752227783, -0.016227087005972862, -0.03890922665596008, 0.0032265668269246817, -0.02101798914372921, 0.048666004091501236, 0.0657455176115036, -0.015954134985804558, 0.013579588383436203, -0.016508305445313454, 0.0034376420080661774, 0.01952291838824749, -0.003521607257425785, 0.03490462899208069, 0.006432821974158287, -0.028639236465096474, 0.02337193675339222, 0.008572886697947979, -0.01971426047384739, -0.06350650638341904, 0.00695000821724534, -0.014655561186373234, 0.011586961336433887, 0.061581872403621674, -0.031014159321784973, -0.037533462047576904, 0.06882621347904205, 0.04607405140995979, 0.045040540397167206, -0.002710870932787657, -0.08972997963428497, 0.03371528908610344, -0.07400774955749512, -0.01873319409787655, -0.03819867968559265, -0.054623786360025406, -0.0026530874893069267, -0.025330403819680214, 0.0055420733988285065, 0.0011640640441328287, -0.018290963023900986, 0.051513418555259705, -0.05187281593680382, 0.01886458322405815, -0.027440598234534264, -0.0034001662861555815, -0.07207441329956055, 0.06798389554023743, 0.0136625487357378, 0.001955554122105241, 0.022134752944111824, -0.00842868722975254, 0.029111575335264206, -0.008202466182410717 ] }, { "text": "--no-prompt\nExclude input and output prompts from converted document.\nEquivalent to: [--TemplateExporter.exclude_input_prompt=True --TemplateExporter.exclude_output_prompt=True]\n--no-input\nExclude input cells and output prompts from converted document.\nThis mode is ideal for generating code-free reports.\nEquivalent to: [--TemplateExporter.exclude_output_prompt=True --TemplateExporter.exclude_input=True --TemplateExporter.exclude_input_prompt=True]\n--allow-chromium-download\nWhether to allow downloading chromium if no suitable version is found on the system.\nEquivalent to: [--WebPDFExporter.allow_chromium_download=True]\n--disable-chromium-sandbox\nDisable chromium security sandbox when converting to PDF..\nEquivalent to: [--WebPDFExporter.disable_sandbox=True]\n--show-input", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_82", "embedding": [ 0.006954053416848183, 0.09582792967557907, -0.1007702648639679, 0.03302181884646416, 0.1403718739748001, 0.060377392917871475, -0.045279789716005325, 0.0001996146747842431, -0.07488025724887848, -0.1032504066824913, 0.04632394388318062, -0.06476974487304688, 0.0660238265991211, -0.061818089336156845, -0.037782374769449234, -0.030249636620283127, 0.06546273082494736, -0.0583597868680954, 0.14457188546657562, 0.022915832698345184, -0.00776334572583437, -0.044212546199560165, 0.06316345185041428, 0.01833372563123703, -0.05067412555217743, 0.046829961240291595, -0.09493902325630188, -0.014916840009391308, 0.013471279293298721, -0.03502906113862991, 0.018275052309036255, 0.05665849894285202, 0.023187212646007538, 0.037577927112579346, 0.10835009068250656, -0.08666102588176727, 0.041132695972919464, 0.00992708932608366, -0.053699687123298645, -0.007086436729878187, 0.02078131213784218, -0.01129077933728695, -0.05199512466788292, -0.029548048973083496, -0.08072313666343689, -0.11924664676189423, -0.03983806073665619, -0.0879817083477974, -0.03292099013924599, -0.01744345761835575, -0.03978079557418823, 0.05937061458826065, -0.03555212542414665, 0.01891450770199299, -0.0016950269928202033, 0.02689099684357643, 0.019662918522953987, 0.009148758836090565, -0.007702905684709549, -0.014008412137627602, -0.14277520775794983, -0.022788306698203087, -0.006949832662940025, 0.026152143254876137, 0.00929241068661213, 0.14491531252861023, -0.0679546520113945, 0.020419245585799217, 0.03777802363038063, 0.04012434929609299, -0.07589536160230637, 0.025738239288330078, -0.060108769685029984, -0.01782425493001938, 0.06566029042005539, -0.035395268350839615, -0.017215803265571594, 0.0624656155705452, -0.04214748740196228, -0.027364147827029228, -0.031238676980137825, -0.020474720746278763, 0.009942828677594662, 0.028573453426361084, -0.05221932753920555, 0.03900725021958351, 0.028186412528157234, 0.03516509756445885, 0.07969341427087784, -0.015364575199782848, -0.07952670007944107, -0.01513020507991314, 0.006654395256191492, 0.05887284502387047, -0.017466122284531593, 0.03373071178793907, 0.031133053824305534, -0.049292661249637604, 0.05309256538748741, 0.011501562781631947, 0.06925137341022491, -0.04331750422716141, 0.05694206431508064, -0.10552511364221573, -0.02676570974290371, -0.01914328522980213, 0.06252690404653549, 0.020831143483519554, -0.03915148228406906, 0.006154576316475868, 0.043826378881931305, 0.012597708962857723, 0.03107890486717224, -0.0665052980184555, -0.012701822444796562, 0.05995757132768631, 0.041520848870277405, 0.026808492839336395, 0.03643028065562248, 0.07149196416139603, 0.07676040381193161, 0.059952959418296814, 0.04917517304420471, 0.04581397399306297, 0.09801624715328217, -0.0127511415630579, 0.004843232687562704, 4.78170200155581e-33, -0.0245533287525177, -0.033961206674575806, -0.057390328496694565, -0.06390495598316193, 0.05557756870985031, 0.08451186865568161, 0.021492883563041687, 0.013736281543970108, 0.026965608820319176, -0.006413132417947054, -0.003880634205415845, 0.01950882188975811, -0.04533962905406952, -0.0050486186519265175, -0.009449207223951817, 0.02929055504500866, -0.024364179000258446, 0.03654153272509575, 0.06881949305534363, -0.004033353179693222, 0.04289973899722099, -0.04015794023871422, -0.04141055420041084, 0.06599997729063034, -0.043027691543102264, 0.023251894861459732, -0.08555743843317032, 0.040456898510456085, -0.031887877732515335, -0.013061189092695713, -0.005839771591126919, -0.010174382477998734, 0.05639589950442314, 0.0537307932972908, -0.002628216054290533, -0.012005060911178589, -0.051809389144182205, -0.05170290544629097, -0.05785852670669556, 0.003242401173338294, -0.04021409898996353, -0.043806590139865875, -0.022307058796286583, 0.02543138898909092, 0.060147397220134735, -0.10582158714532852, -0.028112847357988358, -0.07603175193071365, 0.009681876748800278, -0.0384063795208931, -0.04988821595907211, 0.05171118304133415, 0.051273372024297714, -0.1273157298564911, -0.054697103798389435, -0.12138807773590088, -0.0107963178306818, -0.0065148379653692245, 0.0013657412491738796, -0.09228241443634033, 0.016566764563322067, 0.008748793974518776, -0.045861151069402695, -0.0681319534778595, -0.04891304299235344, -0.05777033418416977, -0.015252791345119476, -0.03361699730157852, -0.027212485671043396, -0.047332763671875, -0.09387373924255371, -0.048116423189640045, 0.04619557410478592, -0.004996990319341421, 0.06129314750432968, -0.05790550634264946, -0.03300253301858902, -0.015823468565940857, 0.11616002023220062, -0.015408494509756565, -0.017146501690149307, -0.0006881217705085874, 0.034641992300748825, -0.057769689708948135, 0.0626453161239624, -0.001226132269948721, -0.04789697378873825, 0.013522209599614143, 0.03236428648233414, -0.010380171239376068, 0.08958467841148376, -0.06736376136541367, -0.096968874335289, -0.01870850659906864, 0.03430930897593498, -5.736783447417241e-33, -0.029031651094555855, 0.07187292724847794, -0.02778172306716442, -0.03130345046520233, -0.08537131547927856, 0.06059590354561806, 0.04263870790600777, -0.031352851539850235, 0.05164061859250069, -0.08884843438863754, 0.06459371745586395, -0.020572222769260406, 0.002377326600253582, -0.05915946885943413, -0.014982598833739758, 0.012468826957046986, -0.043741825968027115, 0.0035893702879548073, -0.05066719651222229, 0.03116648644208908, -0.005930582992732525, 0.022630009800195694, 0.0020157115068286657, 0.1257644146680832, -0.04931633546948433, -0.007579843048006296, -0.02069934457540512, 0.04633636027574539, 0.07986011356115341, 0.0254674069583416, 0.03957008942961693, 0.0829564779996872, -0.03604908660054207, 0.0012510553933680058, -0.0011246270732954144, -0.05819713696837425, -0.021947668865323067, 0.12184284627437592, 0.01448189839720726, 0.11408937722444534, -0.011904748156666756, -0.041322480887174606, -0.04548635706305504, -0.003066434757784009, -0.012185131199657917, 0.10066584497690201, 0.08600302040576935, -0.0241529680788517, 0.05085834488272667, 0.023435836657881737, -0.048399824649095535, 0.07202674448490143, -0.04522061347961426, -0.08267901092767715, -0.021022669970989227, -0.037856295704841614, -0.029883749783039093, -0.06539002060890198, -0.010314860381186008, 0.0008479590178467333, 0.05784611776471138, -0.046498991549015045, -0.014722630381584167, -0.02728833444416523, 0.008540320210158825, -0.005198560189455748, -0.04885946586728096, 0.12765389680862427, 0.04437004402279854, 0.0669921413064003, 0.04635601490736008, 0.011890909634530544, 0.023521943017840385, -0.05197342857718468, 0.03858895227313042, 0.08148747682571411, 0.017973007634282112, -0.0417601577937603, -0.0478508323431015, -0.038847699761390686, -0.010676093399524689, 0.04653964191675186, -0.009102032519876957, -0.04833288490772247, -0.006506515201181173, -0.05522817373275757, -0.07130347192287445, -0.004737635608762503, 0.030034923925995827, 0.003065925557166338, 0.04217914491891861, 0.06741058081388474, -0.004030521027743816, 0.0018372148042544723, 0.07063715159893036, -4.803825959243113e-08, 0.0429941862821579, -0.046880047768354416, -0.06365597993135452, 0.00802680104970932, 0.09535019099712372, 0.04774159938097, 0.0012717748759314418, -0.036153897643089294, 0.02084878645837307, -0.04344793036580086, 0.0054886192083358765, -0.05499918758869171, -0.029236136004328728, -0.02148318849503994, 0.0587114542722702, 0.09097884595394135, 0.04313905909657478, 0.057865504175424576, -0.025692911818623543, -0.024515939876437187, 0.030500752851366997, -0.06134731322526932, -0.04036285728216171, 0.052371442317962646, 0.005431337747722864, -0.017627518624067307, 0.032045453786849976, 0.032986391335725784, 0.03828062862157822, 0.005130167119204998, -0.04347144812345505, -0.015550601296126842, -0.10315878689289093, 0.012799486517906189, -0.006850300822407007, 0.10148578137159348, 0.06361746042966843, 0.016976147890090942, -0.0486287884414196, 0.02855301834642887, 0.024366550147533417, 0.03930975869297981, -0.09895329922437668, -0.016317468136548996, -0.05123155191540718, 0.010940296575427055, 0.004794219974428415, -0.07183387875556946, 0.05465429276227951, 0.027701761573553085, 0.013019276782870293, -0.04782400280237198, 0.020946629345417023, 0.035858143121004105, -0.021148568019270897, 0.03113676980137825, 0.030948491767048836, 0.005087928380817175, 0.0014102277345955372, 0.022276200354099274, 0.020838702097535133, -0.005183927249163389, 0.14344626665115356, 0.029912492260336876 ] }, { "text": "Disable chromium security sandbox when converting to PDF..\nEquivalent to: [--WebPDFExporter.disable_sandbox=True]\n--show-input\nShows code input. This flag is only useful for dejavu users.\nEquivalent to: [--TemplateExporter.exclude_input=False]\n--embed-images\nEmbed the images as base64 dataurls in the output. This flag is only useful for the HTML/WebPDF/Slides exports.\nEquivalent to: [--HTMLExporter.embed_images=True]\n--sanitize-html\nWhether the HTML in Markdown cells and cell outputs should be sanitized..\nEquivalent to: [--HTMLExporter.sanitize_html=True]\n--log-level=\nSet the log level by value or name.\nChoices: any of [0, 10, 20, 30, 40, 50, 'DEBUG', 'INFO', 'WARN', 'ERROR', 'CRITICAL']\nDefault: 30\nEquivalent to: [--Application.log_level]\n--config=", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_83", "embedding": [ 0.006039157044142485, 0.03775941953063011, -0.06444931030273438, 0.029562702402472496, 0.13607558608055115, -0.0059853908605873585, -0.05959571152925491, 0.023579245433211327, -0.028323210775852203, -0.06814291328191757, 0.006862230133265257, -0.009677562862634659, 0.041567690670490265, 0.032574739307165146, -0.023350415751338005, 0.007699958048760891, 0.04290332645177841, -0.010303875431418419, 0.09633483737707138, 0.04022100940346718, 0.010208445601165295, -0.06618447601795197, 0.07471071183681488, -0.034542590379714966, 0.00184451078530401, 0.05997263640165329, -0.08259851485490799, 0.002478865208104253, -0.029882872477173805, -0.04825568571686745, 0.04929116368293762, -0.06775354593992233, 0.0018426106544211507, 0.029339788481593132, 0.08784006536006927, 0.03096807561814785, -0.018086574971675873, -0.10823136568069458, 0.01503213495016098, 0.05785742402076721, 0.030299050733447075, -0.01196255348622799, -0.07742933928966522, -0.05833034962415695, -0.0730319544672966, -0.14004436135292053, -0.0034678762312978506, -0.05941491201519966, 0.016669252887368202, 0.010843009687960148, -0.04264488443732262, 0.08991622179746628, 0.01134623121470213, -0.007858790457248688, 0.012804697267711163, -0.054354697465896606, 0.011841975152492523, -0.017348414286971092, 0.01173805445432663, 0.00808744691312313, -0.0795912891626358, -0.0006848854827694595, 0.04659157246351242, -0.01642090454697609, -0.011781735345721245, 0.10802274942398071, -0.004185203462839127, 0.057275813072919846, 0.0022202301770448685, 0.11047184467315674, -0.10585013031959534, 0.028062373399734497, 0.00691258953884244, 0.016917243599891663, 0.028866643086075783, 0.003700820729136467, -0.010817175731062889, -0.010111596435308456, -0.06568557024002075, -0.10505997389554977, 0.061911799013614655, -0.04419075697660446, 0.0337451808154583, 0.047946009784936905, 0.02169426716864109, 0.02521270513534546, 0.025714239105582237, -0.010408639907836914, 0.00149392185267061, 0.033193450421094894, -0.04061311110854149, -0.006851877551525831, -0.012238789349794388, 0.0755203440785408, 0.06701050698757172, 0.004509565886110067, -0.004896152298897505, 0.02041292004287243, -0.019565662369132042, -0.028233176097273827, 0.03904709592461586, -0.058054134249687195, 0.04369291290640831, -0.10361875593662262, -0.03618650138378143, -0.04894845560193062, 0.06966765969991684, 0.0430821031332016, -0.0103805186226964, -0.013492523692548275, -0.0013427477097138762, 0.01923675462603569, -0.05821605771780014, -0.03595114126801491, -0.04549355432391167, 0.035903576761484146, 0.016778605058789253, -0.012565195560455322, -0.015006187371909618, 0.0527939647436142, 0.06887628138065338, 0.07504398375749588, -0.02712469920516014, 0.034925784915685654, 0.05745067074894905, -0.05064694210886955, 0.02771657146513462, 6.0305009147793446e-33, -0.014136252924799919, -0.040812522172927856, -0.05307508632540703, -0.06321470439434052, 0.08321899175643921, 0.02909543178975582, -0.055540211498737335, -0.016820821911096573, -0.043263040482997894, -0.001341424765996635, -0.0009436156833544374, 0.029552362859249115, -0.0122813256457448, 0.012746235355734825, -0.01975775882601738, 0.07223540544509888, -0.10017945617437363, -0.009587359614670277, 0.08058135211467743, -0.00400807848200202, -0.017977707087993622, -0.021671824157238007, -0.04643530771136284, 0.03219347447156906, -0.12254216521978378, 0.05563770607113838, -0.05514436215162277, 0.026354771107435226, -0.04800443723797798, -0.006132174748927355, -0.05012160912156105, -0.0506342388689518, 0.060045354068279266, -0.015695666894316673, 0.045099012553691864, -0.03662857785820961, -0.03663274645805359, -0.023672204464673996, -0.11535326391458511, -0.015758344903588295, 0.019062092527747154, -0.05156812071800232, -0.015123976394534111, 0.06994122266769409, -0.01620057225227356, -0.06832848489284515, 0.00932272057980299, -0.009260892868041992, 0.0006179161719046533, -0.06920270621776581, -0.055014897137880325, 0.04767825827002525, 0.031448256224393845, -0.15258221328258514, -0.01975621096789837, -0.09733915328979492, 0.01359713263809681, -0.03175627067685127, 0.022809695452451706, -0.055256251245737076, 0.02823694795370102, 0.0029115218203514814, -0.027128932997584343, -0.08314394950866699, -0.024919899180531502, -0.02714468352496624, -0.003996030893176794, 0.012956577353179455, -0.03683001548051834, -0.09018899500370026, -0.06236782670021057, -0.009344507940113544, 0.0670340359210968, 0.032858315855264664, 0.006148095242679119, -0.0010709534399211407, 0.011790385469794273, 0.05979573726654053, 0.10368683934211731, -0.015855731442570686, -0.019408445805311203, -0.09204938262701035, 0.06540010869503021, -0.08449736982584, 0.005979104433208704, 0.0343896821141243, -0.11953458935022354, 0.023242857307195663, 0.009416339918971062, 0.02826848439872265, 0.08808141946792603, -0.05466088280081749, -0.029732437804341316, -0.06528852880001068, -0.002761028939858079, -6.993746168907237e-33, -0.0475604310631752, 0.07334935665130615, -0.10334289073944092, 0.06551254540681839, -0.03147377446293831, 0.05986311286687851, 0.05918009951710701, 0.05039988085627556, 0.05498557537794113, -0.07302325963973999, 0.015390962362289429, -0.0004508867859840393, -0.06595538556575775, -0.10355661064386368, -0.01776721514761448, -0.0014042721595615149, -0.06272061169147491, 0.01681136153638363, -0.047260407358407974, -0.06760431081056595, 0.04379163682460785, 0.05843446031212807, 0.03885785490274429, 0.20825687050819397, 0.00972058530896902, 0.07504343241453171, 0.05346586927771568, -0.04902558773756027, 0.05222340673208237, 0.001712176133878529, 0.020010821521282196, 0.05845685303211212, -0.003990830387920141, 0.017397500574588776, 0.010695802047848701, -0.0998835489153862, -0.013768170960247517, 0.0758260190486908, 0.029011504724621773, 0.07014768570661545, -0.011998039670288563, 0.022599084302783012, -0.011411935091018677, 0.018903259187936783, 0.04833616688847542, 0.06545121967792511, -0.004665646702051163, -0.02738148532807827, 0.11013659089803696, 0.10398674011230469, -0.0623307079076767, -0.006323464680463076, -0.009415662847459316, -0.09023918956518173, 0.03293292596936226, -0.04306856915354729, -0.051500581204891205, -0.054096776992082596, 0.010793091729283333, 0.039546795189380646, 0.013030639849603176, -0.029655711725354195, 0.015504216775298119, 0.024986589327454567, -0.013490954414010048, -0.005632332060486078, -0.09881297498941422, 0.12357243150472641, -0.01535540260374546, 0.027361467480659485, 0.0103635024279356, -0.04033680260181427, 0.0213069599121809, -0.04438171535730362, 0.002611447824165225, 0.0025166699197143316, 0.028501305729150772, 0.045537207275629044, 0.02532760053873062, 0.02025652304291725, -0.001892422791570425, 0.016139965504407883, -0.07204380631446838, -0.02324005216360092, 0.045183215290308, -0.030351299792528152, -0.1048654243350029, 0.01682594232261181, -0.014084266498684883, -0.011960186064243317, 0.016247576102614403, 0.04814387857913971, 0.009293509647250175, 0.03399080038070679, 0.07201890647411346, -5.862645480192441e-08, 0.00792714860290289, -0.0026198946870863438, -0.03848643973469734, -0.0333697646856308, 0.0294095017015934, 0.016930874437093735, -0.0056389691308140755, 0.06161033734679222, 0.02821352705359459, -0.04118121415376663, 0.04443521425127983, -0.050003208220005035, -0.009717613458633423, -0.028651162981987, -0.00601401599124074, 0.09396066516637802, 0.05214359238743782, 0.052081428468227386, 0.005687403958290815, -0.06181708723306656, 0.03171323612332344, -0.07570543885231018, -0.02702309563755989, 0.07887369394302368, 0.002822106471285224, 0.007918884977698326, 0.002467805752530694, 0.04849274829030037, -0.006785989739000797, -0.017110291868448257, -0.061038896441459656, -0.012263051234185696, -0.11227311193943024, 0.007279796991497278, -0.05644369125366211, 0.05212436616420746, 0.06381738185882568, -0.05741163715720177, -0.0606507770717144, 0.050864748656749725, 0.03441416472196579, 0.03599318116903305, -0.035857945680618286, -0.03734726458787918, -0.013210894539952278, 0.03204474225640297, 0.02433738298714161, 0.016730129718780518, 0.00869770348072052, 0.031554214656353, 0.055424220860004425, -0.0705517902970314, -0.025997430086135864, 0.07203076779842377, 0.014295035973191261, -0.08656403422355652, 0.06368128955364227, 0.028095943853259087, 0.07622018456459045, 0.03606792166829109, 0.035790398716926575, -0.01860642619431019, 0.130494624376297, 0.0652003362774849 ] }, { "text": "Default: 30\nEquivalent to: [--Application.log_level]\n--config=\nFull path of a config file.\nDefault: ''\nEquivalent to: [--JupyterApp.config_file]\n--to=\nThe export format to be used, either one of the built-in formats\n['asciidoc', 'custom', 'html', 'latex', 'markdown', 'notebook', 'pdf', 'python', 'qtpdf', 'qtpng', 'rst', 'script', 'slides', 'webpdf']\nor a dotted object name that represents the import path for an\n``Exporter`` class\nDefault: ''\nEquivalent to: [--NbConvertApp.export_format]\n--template=\nName of the template to use\nDefault: ''\nEquivalent to: [--TemplateExporter.template_name]\n--template-file=\nName of the template file to use\nDefault: None\nEquivalent to: [--TemplateExporter.template_file]\n--theme=", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_84", "embedding": [ -0.02742783911526203, 0.019264884293079376, -0.08865936845541, 0.009026287123560905, 0.01152564026415348, 0.0059196073561906815, -0.006951211020350456, 0.07886797934770584, -0.024764051660895348, -0.013109767809510231, 0.01879301853477955, -0.05628928914666176, -0.020200489088892937, 0.06825726479291916, 0.0705442950129509, 0.00587106216698885, -0.03428028151392937, -0.014341901056468487, 0.02625374123454094, 0.06167062371969223, 0.07472171634435654, 0.027237875387072563, 0.08658714592456818, -0.015786422416567802, 0.04262620955705643, -0.009685770608484745, -0.04724505916237831, 0.011620884761214256, -0.0105415228754282, -0.0014009991427883506, 0.023358751088380814, 0.04198959842324257, 0.007400951813906431, 0.06156319007277489, 0.1465865969657898, 0.10116267204284668, 0.08780639618635178, -0.04557112604379654, -0.018656263127923012, 0.03366711363196373, 0.07405455410480499, -0.0007748536299914122, -0.10914254188537598, -0.09909812361001968, -0.09823361039161682, -0.04145180433988571, -0.013925645500421524, -0.029459580779075623, -0.03056853450834751, -0.01007378101348877, -0.03499734401702881, 0.031124023720622063, -0.031140880659222603, -0.05306379124522209, 0.023059336468577385, 0.018391486257314682, 0.018884530290961266, 0.0331374853849411, 0.010069799609482288, -0.016838544979691505, -0.11591167747974396, 0.06359843909740448, -0.0206157173961401, 0.04627981036901474, -0.035217948257923126, -0.005743634887039661, -0.113402359187603, 0.09536729007959366, 0.061000239104032516, 0.03993909806013107, -0.20748868584632874, -0.049948010593652725, -0.058432966470718384, -0.03924575075507164, 0.0008678000885993242, -0.06856045871973038, 0.009153845719993114, 0.0416959784924984, -0.12853401899337769, -0.07559686154127121, 0.03516872972249985, 0.009253935888409615, -0.003629255574196577, 0.086293064057827, 0.070294089615345, 0.02193964459002018, 0.03301841765642166, 0.030513295903801918, 0.07504685968160629, 0.07968023419380188, -0.04684066027402878, -0.1000995934009552, 0.01661238819360733, 0.03383617475628853, -0.02248322404921055, 0.06607989966869354, 0.07370232045650482, 0.0924895629286766, -0.02302423305809498, 0.010018757544457912, 0.02354927361011505, -0.09039030969142914, 0.08426094800233841, -0.03787808120250702, 0.019697509706020355, -0.05044831708073616, 0.020130986347794533, -0.0777801126241684, 0.0462937168776989, -0.0285630039870739, 0.006327319424599409, -0.038912706077098846, -0.06454450637102127, -0.12317338585853577, 0.020572097972035408, 0.02952813357114792, -0.06971187144517899, 0.03887733817100525, -0.02852570079267025, 0.09062301367521286, 0.038549188524484634, -0.043792180716991425, -0.006127096712589264, 0.019365476444363594, 0.029035484418272972, 0.03379614278674126, -0.028141867369413376, 1.0100601431688551e-33, 0.034017495810985565, 0.023298198357224464, -0.042791854590177536, -0.0068518477492034435, 0.048694536089897156, 0.017198165878653526, 0.023418545722961426, -0.014525306411087513, -0.02009461633861065, 0.019995449110865593, -0.0029241519514471292, 0.0528586246073246, -0.07866842299699783, 0.12232550233602524, -0.04467226564884186, 0.050077375024557114, -0.05408121645450592, 0.02980462647974491, 0.10922403633594513, -0.05971074849367142, 0.03866147994995117, 0.02285638265311718, -0.05651957169175148, 0.0013892661081627011, -0.020262768492102623, 0.012414208613336086, 0.005871922709047794, -0.011796717531979084, -0.06925120949745178, 0.0018590000690892339, -0.0061901891604065895, -0.021909886971116066, 0.0559229850769043, -0.021259838715195656, -0.03796839341521263, -0.015969766303896904, -0.07947440445423126, -0.013176021166145802, -0.12844648957252502, 0.03663875535130501, -0.03572401404380798, 0.0059055145829916, -0.024176785722374916, 0.03377208113670349, -0.003796903882175684, -0.03437769040465355, 0.03342864289879799, -0.03712228685617447, 0.04699690639972687, -0.07776525616645813, -0.06879691034555435, -0.013355179689824581, 0.050165772438049316, -0.03425775095820427, 0.042171645909547806, -0.06050567328929901, 0.043022241443395615, -0.02408335544168949, -0.0030248763505369425, -0.11393918842077255, 0.0486580915749073, 0.024919237941503525, -0.01520485058426857, -0.03011608123779297, 0.049680761992931366, -0.00487985834479332, 0.04195701703429222, -0.00022515351884067059, 0.03229415416717529, -0.011647163890302181, -0.09917270392179489, -0.0037060219328850508, 0.03002297692000866, 0.048163823783397675, 0.07264763861894608, 0.01208478957414627, 0.03488992527127266, 0.02456756867468357, 0.041295796632766724, -0.010386569425463676, -0.07635677605867386, -0.02077046036720276, -0.04210716485977173, -0.024165602400898933, -0.006061684340238571, -0.05655752122402191, 0.06741549074649811, 0.027752716094255447, 0.004456326365470886, -0.08656477183103561, 0.012867535464465618, -0.08080529421567917, -0.03243342787027359, -0.03578970208764076, -0.08210280537605286, -4.3424293135451216e-33, 0.07690016180276871, 0.03238005191087723, -0.04173679277300835, 0.03168504312634468, -0.08577274531126022, 0.01745903119444847, 0.11396752297878265, 0.07474297285079956, 0.03650987520813942, -0.02844349667429924, 0.0013424776261672378, -0.025463435798883438, 0.10661429166793823, -0.03358335420489311, 0.018098192289471626, 0.04396498203277588, -0.08675367385149002, 0.05506875738501549, -0.0036669212859123945, -0.06347095221281052, -0.05043256655335426, -0.012587422505021095, 0.0007832383853383362, 0.10015248507261276, 0.060131143778562546, -0.0461280532181263, 0.04332026094198227, -0.06531553715467453, -0.0734645426273346, -0.015477515757083893, 0.00420741131529212, 0.08007553964853287, -0.05579639598727226, -0.019980033859610558, -0.06844751536846161, -0.010470875538885593, -0.03271420672535896, 0.049524713307619095, 0.033035311847925186, 0.060930222272872925, 0.04759245738387108, 0.009450482204556465, 0.012675291858613491, 0.07166317105293274, -0.047785479575395584, 0.028764059767127037, -0.02944679744541645, -0.004185013007372618, 0.05685441195964813, -0.02487972564995289, -0.027562202885746956, -0.05472512170672417, -0.028292350471019745, -0.06083380803465843, 0.03786233067512512, 0.014478128403425217, -0.005179485771805048, -0.01764988899230957, -0.0781884416937828, -0.002528960583731532, -0.025655267760157585, -0.014981186017394066, 0.004330827854573727, -0.030421150848269463, -0.06356065720319748, -0.06725659966468811, -0.08812262862920761, 0.040935955941677094, -0.027620522305369377, -0.056270089000463486, 0.0023711479734629393, -0.0927654504776001, 0.012609465047717094, 0.008397171273827553, -0.05116739869117737, -0.026699259877204895, 0.006851607002317905, 0.04215412214398384, 0.026621844619512558, 0.08129707723855972, -0.009357700124382973, 0.043235763907432556, -0.06805163621902466, 0.008162252604961395, 0.0030050405766814947, -0.05975457280874252, -0.03831995278596878, 0.06708300113677979, 0.04749399423599243, 0.0007635801448486745, 0.01037193089723587, 0.09646802395582199, 0.06027577072381973, 0.0974554568529129, -0.0071940552443265915, -5.72008467258911e-08, -0.06929218769073486, -0.10862170904874802, -0.02625272609293461, -0.027257317677140236, 0.006512627005577087, 0.04810480400919914, 0.028144951909780502, -0.0010077233891934156, -0.022726334631443024, 0.007825893349945545, 0.005357175134122372, -0.012041122652590275, -0.11143989861011505, 0.015090261586010456, -0.045608099550008774, 0.032316602766513824, 0.03367413207888603, 0.14926956593990326, -0.006742303259670734, -0.01785222999751568, 0.02932887151837349, 0.0004230586055200547, -0.02253446727991104, 0.01621711067855358, 0.03197524696588516, 0.027605419978499413, 0.009180495515465736, 0.047073401510715485, -0.028213145211338997, -0.04033946618437767, 0.021072322502732277, 0.0020452593453228474, -0.017576653510332108, 0.019490404054522514, -0.11811996251344681, 0.049576155841350555, -0.02733147144317627, -0.03494500741362572, 0.0001228981273015961, 0.04573637619614601, 0.03827095031738281, -0.06561838090419769, -0.06815101206302643, -0.04041675105690956, -0.043746523559093475, -0.0038981803227216005, -0.04537343233823776, 0.009997539222240448, -0.009485006332397461, -0.016041606664657593, 0.025861846283078194, -0.028537774458527565, 0.019718945026397705, 0.016367051750421524, 0.05867139995098114, 0.03224705159664154, -0.02782822772860527, -0.0020383079536259174, 0.08314485847949982, -0.05057819187641144, 0.021641099825501442, 0.020157914608716965, 0.07616454362869263, 0.02454197034239769 ] }, { "text": "--template-file=\nName of the template file to use\nDefault: None\nEquivalent to: [--TemplateExporter.template_file]\n--theme=\nTemplate specific theme(e.g. the name of a JupyterLab CSS theme distributed\nas prebuilt extension for the lab template)\nDefault: 'light'\nEquivalent to: [--HTMLExporter.theme]\n--sanitize_html=\nWhether the HTML in Markdown cells and cell outputs should be sanitized.This\nshould be set to True by nbviewer or similar tools.\nDefault: False\nEquivalent to: [--HTMLExporter.sanitize_html]\n--writer=\nWriter class used to write the\nresults of the conversion\nDefault: 'FilesWriter'\nEquivalent to: [--NbConvertApp.writer_class]\n--post=\nPostProcessor class used to write the\nresults of the conversion\nDefault: ''", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_85", "embedding": [ -0.028004055842757225, 0.1362391859292984, -0.011863494291901588, -0.00040997902397066355, 0.029761524870991707, 0.07508447021245956, -0.022738611325621605, 0.020979898050427437, -0.008689274080097675, -0.009653106331825256, -0.03158652037382126, -0.03874437138438225, 0.00027637919993139803, -0.032888587564229965, -0.012508227489888668, -0.0405765101313591, 0.042480576783418655, -0.00023278007574845105, -0.00039858068339526653, 0.039951153099536896, 0.028658393770456314, -0.04047422483563423, 0.09521716833114624, -0.05022909492254257, 0.04798796772956848, 0.013707604259252548, -0.04747794568538666, 0.028248384594917297, 0.00046161763020791113, -0.02305513247847557, 0.02543635666370392, -0.003268089145421982, 0.050784964114427567, 0.04711281135678291, 0.1250181347131729, 0.05709695443511009, 0.07787474244832993, -0.05946052446961403, 0.002027996350079775, 0.04529256001114845, 0.07528470456600189, -0.0034552791621536016, -0.13442648947238922, -0.037125177681446075, -0.044306907802820206, -0.043727271258831024, 0.025215232744812965, -0.11102893203496933, -0.05330876633524895, -0.009736931882798672, -0.12130133807659149, 0.0339030884206295, 0.05540112778544426, -0.10128860920667648, -0.08571308106184006, -0.011212394572794437, 0.041673336178064346, 0.021347705274820328, 0.08309303224086761, -0.022294119000434875, -0.08329559862613678, 0.016483500599861145, 0.014719057828187943, -0.009713629260659218, 0.05609145015478134, 0.005610059015452862, -0.05505005270242691, 0.0614461749792099, 0.01313419546931982, 0.0207691453397274, -0.04768965393304825, -0.012653614394366741, 0.034521061927080154, 0.037428174167871475, -0.012377714738249779, 0.0480191670358181, -0.0018790398025885224, -0.05922611430287361, -0.005412037018686533, -0.054688483476638794, 0.023460987955331802, -0.00355187407694757, -0.015263686887919903, 0.09695125371217728, 0.07006852328777313, 0.03408319503068924, -0.02308453992009163, 0.06498927623033524, 0.03518622741103172, -0.030424848198890686, 0.03417201712727547, -0.05264347791671753, 0.0027346331626176834, 0.04243743047118187, -0.09613466262817383, 0.0409708246588707, 0.03244822099804878, 0.030494196340441704, 0.011435163207352161, 0.028069939464330673, 0.005297960713505745, -0.09488684684038162, 0.058363594114780426, -0.029240796342492104, 0.07862264662981033, -0.04919164627790451, 0.034753404557704926, -0.022545531392097473, 0.07301732152700424, -0.013887882232666016, 0.06426434963941574, -0.030377309769392014, -0.12081761658191681, -0.054471392184495926, 0.02750200405716896, 0.0030619895551353693, 0.04232434555888176, -0.00536427041515708, 0.05464464798569679, 0.05394793301820755, 0.04770571365952492, -0.04080294445157051, -0.06919840723276138, 0.0037684047129005194, -0.0007499682251363993, -0.009587692096829414, -0.058145325630903244, 5.992270899754727e-33, -0.004082185216248035, -0.034899696707725525, 0.01177903637290001, -0.010228168219327927, 0.07303330302238464, -0.05991080030798912, -0.04694958031177521, -0.0061071147210896015, -0.009321085177361965, -0.004212869331240654, 0.04680152237415314, -0.016794176772236824, -0.028910769149661064, 0.1128513514995575, -0.11696892976760864, 0.015418228693306446, -0.035314079374074936, -0.056589897722005844, 0.020357370376586914, -0.05980684608221054, 0.06557860225439072, -0.008107222616672516, -0.010841083712875843, 0.05107337608933449, -0.10075307637453079, 0.03548579663038254, -0.0167269054800272, 0.03247804194688797, -0.02943991869688034, 0.008359626866877079, 0.017771655693650246, -0.06361734122037888, 0.05267036333680153, -0.008095497265458107, -0.08331642299890518, 0.03553784638643265, -0.021906135603785515, 0.01992725022137165, 5.590165528701618e-05, 0.032380957156419754, -0.0671023428440094, 0.07212286442518234, 0.038310665637254715, 0.04427671805024147, 0.0019065029919147491, 0.01767389290034771, -0.01926860213279724, -0.023767372593283653, 0.048068657517433167, -0.0788075402379036, -0.05873790383338928, -0.022212978452444077, 0.05742213875055313, -0.04077642410993576, -0.000843065558001399, 0.03689026087522507, 0.005707101430743933, -0.001327507896348834, 0.0689421147108078, -0.02874196320772171, 0.044710978865623474, 0.026819495484232903, -0.009779753163456917, -0.012736426666378975, 0.04895741119980812, -0.0011074690846726298, 0.03836394473910332, -0.030636046081781387, -0.037743959575891495, -0.09160757809877396, -0.07531549036502838, 0.032229259610176086, 0.03183894231915474, 0.0661662369966507, 0.035846155136823654, -0.043756406754255295, -0.03162568435072899, -0.042440030723810196, 0.0002954734954982996, -0.08878601342439651, -0.03887864202260971, 0.014278056100010872, -0.04483168572187424, -0.09121821075677872, -0.032865431159734726, -0.06771604716777802, 0.02541879564523697, -0.013269840739667416, 0.0002726850507315248, -0.04441337287425995, 0.1369626820087433, -0.09401822090148926, -0.07369299232959747, -0.056394752115011215, -0.11727052927017212, -7.64403625593785e-33, 0.03869554400444031, 0.06957279145717621, -0.07769416272640228, 0.02872936986386776, -0.07526442408561707, 0.04138358682394028, 0.09319043904542923, 0.07543806731700897, 0.016084197908639908, 0.006351782474666834, 0.027860822156071663, -0.0042237453162670135, 0.0006272484315559268, -0.006949794013053179, -0.03457225486636162, 0.07236187905073166, -0.00981084629893303, 0.06281450390815735, -0.07162036001682281, -0.06661438941955566, -0.09844501316547394, 0.009727656841278076, 0.01329756248742342, 0.09738565236330032, 0.021074168384075165, -0.018525246530771255, 0.01259411871433258, -0.02716088481247425, 0.02167881838977337, 0.011942223645746708, -0.03130829334259033, 0.11199614405632019, -0.05925244837999344, 0.016663534566760063, 0.04964858666062355, -0.03464911878108978, -0.04909845069050789, -0.005209472496062517, 0.039685096591711044, 0.08700500428676605, 0.07505535334348679, -0.005447478964924812, -0.03616027906537056, 0.07261542230844498, -0.005869442131370306, 0.06854720413684845, -0.054031435400247574, 0.05497235432267189, 0.04526648670434952, 0.007170957513153553, -0.028916148468852043, -0.07483288645744324, -0.013361682184040546, -0.03230174630880356, 0.016742676496505737, -0.01752438396215439, 0.031999167054891586, -0.03678712248802185, -0.12949122488498688, 0.05382866412401199, -0.04017941653728485, -0.026259606704115868, -0.015492607839405537, -0.08260812610387802, -0.0005171963130123913, -0.030066221952438354, -0.0689908117055893, 0.05758988857269287, 0.039217572659254074, -0.0665266215801239, 0.056146323680877686, 0.012722902931272984, 0.023893069475889206, -0.06493980437517166, -0.052438925951719284, 0.00252499058842659, -0.024539964273571968, 0.05963246524333954, -0.04472767934203148, 0.02124869078397751, 0.022884422913193703, 0.04398786649107933, -0.012752953916788101, 0.011623894795775414, 0.04825321212410927, -0.024648381397128105, -0.04972667992115021, 0.10087750852108002, -0.04401843622326851, -0.00550751481205225, 0.0029129590839147568, 0.001877433154731989, 0.08108574897050858, 0.1516556292772293, 0.014158684760332108, -5.6891014565962905e-08, -0.029936378821730614, -0.04712909460067749, -0.03059367649257183, -0.047478582710027695, -0.08391176164150238, 0.04141836240887642, -0.0033104075118899345, -0.05188124626874924, 0.02375868335366249, 0.009113725274801254, 0.006216924637556076, -0.006027932744473219, -0.0764254629611969, 0.02107069082558155, -0.08310438692569733, 0.07866133004426956, 0.01491224579513073, 0.0536252036690712, -0.02558446116745472, -0.04040968418121338, -0.05125385895371437, 0.015368224121630192, -0.009845605120062828, 0.038696806877851486, 0.038723818957805634, 0.08132913708686829, -0.10205324739217758, -0.01308299321681261, -0.03270682319998741, 0.00045877520460635424, 0.0037635425105690956, 0.008178884163498878, -0.006127835717052221, 0.008755037561058998, -0.05909721553325653, 0.014493548311293125, -0.018576519563794136, -0.03721298277378082, 0.08644074946641922, 0.12825730443000793, 0.0042962306179106236, -0.05139807239174843, -0.15288226306438446, -0.032385870814323425, 0.00494642648845911, -0.03633810952305794, -0.018974335864186287, 0.032969698309898376, -0.04783377796411514, -0.01833501085639, 0.04497237503528595, -0.033437978476285934, -0.02986164391040802, 0.017488466575741768, -0.013643342070281506, -0.07814913243055344, -0.020773176103830338, 0.11890577524900436, 0.07528818398714066, 0.018503746017813683, 0.05635126680135727, -0.015914248302578926, 0.07453164458274841, -0.003866696497425437 ] }, { "text": "Equivalent to: [--NbConvertApp.writer_class]\n--post=\nPostProcessor class used to write the\nresults of the conversion\nDefault: ''\nEquivalent to: [--NbConvertApp.postprocessor_class]\n--output=\nOverwrite base name use for output files.\nSupports pattern replacements '{notebook_name}'.\nDefault: '{notebook_name}'\nEquivalent to: [--NbConvertApp.output_base]\n--output-dir=\nDirectory to write output(s) to. Defaults\nto output to the directory of each notebook. To recover\nprevious default behaviour (outputting to the current\nworking directory) use . as the flag value.\nDefault: ''\nEquivalent to: [--FilesWriter.build_directory]\n--reveal-prefix=\nThe URL prefix for reveal.js (version 3.x).\nThis defaults to the reveal CDN, but can be any url pointing to a copy", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_86", "embedding": [ -0.14478516578674316, 0.014187629334628582, -0.0015933435643091798, 0.04607488960027695, 0.016979428008198738, -0.014834381639957428, -0.04390355572104454, 0.054376717656850815, 0.04943688213825226, -0.030369846150279045, -0.0032688986975699663, 0.039672236889600754, -0.045124247670173645, 0.0031184637919068336, -0.010140194557607174, -0.015115631744265556, -0.010429623536765575, 0.02620057761669159, 0.014118247665464878, -0.034050919115543365, 0.1173311173915863, 0.020090216770768166, 0.09192053973674774, -0.019998745992779732, 0.06880218535661697, -0.044380221515893936, -0.03567824140191078, -0.0029387143440544605, -0.01851598545908928, -0.01772485487163067, 0.086191326379776, 0.020618464797735214, -0.03338267281651497, -0.029035186395049095, 0.13094562292099, 0.09355951100587845, 0.020997023209929466, -0.06378370523452759, 0.039793744683265686, -0.00933685153722763, 0.10090263187885284, 0.04973926395177841, -0.05997909605503082, -0.03495870903134346, -0.11830846965312958, -0.08744293451309204, -0.012910212390124798, -0.0029035259503871202, -0.07559040933847427, 0.024269532412290573, 0.0041723595932126045, -0.056080419570207596, -0.027210354804992676, -0.059761613607406616, -0.019063768908381462, 0.047894056886434555, -0.07950606942176819, 0.08976851403713226, -0.020073823630809784, 0.00198363047093153, -0.008711597882211208, -0.03172918036580086, -0.02472721040248871, -0.01234982069581747, 0.029874127358198166, 0.046898242086172104, -0.07680802792310715, 0.014168479479849339, 0.029605960473418236, 0.026116393506526947, 0.018142806366086006, 0.020363086834549904, -0.0411096028983593, -0.00949257891625166, -0.017233900725841522, -0.042935892939567566, -0.021737026050686836, 0.06786441802978516, -0.05554507300257683, -0.10637370496988297, 0.07600532472133636, -0.08440326899290085, 0.018720930442214012, 0.0681152269244194, 0.061786554753780365, 0.09409993141889572, -0.005690860096365213, 0.04613427445292473, 0.054212626069784164, 0.019157839938998222, -0.07047334313392639, -0.16992902755737305, 0.05533182621002197, 0.04139978066086769, -0.08809792995452881, -0.010464444756507874, 0.0369800440967083, 0.1360488086938858, 0.006556971464306116, 0.03954596444964409, -0.01250395830720663, 0.031467191874980927, 0.09747642278671265, -0.06065189093351364, 0.04876190051436424, 0.0230474341660738, -0.024827636778354645, 0.021417589858174324, 0.005217086058109999, -0.00672528613358736, 0.01871500350534916, 0.01410453300923109, -0.01692221499979496, -0.031191715970635414, 0.03408120945096016, -0.003746866947039962, -0.012941598892211914, 0.08176741749048233, 0.007120645605027676, 0.15061740577220917, 0.11933568865060806, -0.007463530171662569, -0.05522715672850609, 0.014283934608101845, -0.008912003599107265, -0.028666287660598755, -0.016020752489566803, 1.8128923872312492e-33, 0.047574132680892944, 0.03302321583032608, 0.033511824905872345, -0.02822359837591648, 0.02244921214878559, -0.04097231850028038, 0.06153789535164833, 0.014695016667246819, -0.0658324807882309, 0.008853582665324211, -0.05767986178398132, 0.0499630905687809, -0.04939521849155426, -0.006546869408339262, -0.10848595201969147, 0.07605098932981491, -0.012857998721301556, 0.05816824734210968, 0.036188505589962006, 0.007047859951853752, 0.06784506887197495, 0.1038953959941864, -0.10855918377637863, -0.008584811352193356, -0.002324511529877782, -0.022314980626106262, 0.0032289561349898577, 0.01365694124251604, -0.0723789632320404, 0.021774979308247566, -0.037148140370845795, 0.034684401005506516, 0.026874374598264694, 0.0020291830878704786, -0.0586540661752224, 0.03857357054948807, -0.03136923909187317, -0.05058424174785614, -0.0312957838177681, 0.019362183287739754, 0.010468663647770882, -0.0025669862516224384, -0.14237001538276672, 0.013734137639403343, -0.07432260364294052, 0.041187088936567307, 0.002005696529522538, -0.030660683289170265, 0.04549753665924072, -0.0518680103123188, -0.040072839707136154, 0.0378059484064579, 0.05250396579504013, 0.022480767220258713, 0.0735553577542305, -0.060008078813552856, 0.03845525532960892, -0.040605876594781876, 0.09372133761644363, -0.024074148386716843, 0.12060968577861786, 0.07825994491577148, -0.08016516268253326, 0.003187668975442648, -0.08540336787700653, -0.016950491815805435, 0.022949444130063057, 0.0009270102018490434, -0.012802138924598694, 0.027055440470576286, -0.1195991039276123, 0.017385514453053474, -0.05127185210585594, 0.004034819547086954, 0.0867156907916069, -0.00812385231256485, -0.08733969181776047, -0.019406398758292198, 0.03044813871383667, -0.05315261706709862, -0.00813649594783783, -0.053431373089551926, -0.08957281708717346, -0.03983062878251076, 0.013682249933481216, 0.024569513276219368, -0.003742118366062641, -0.03340260311961174, -0.0639839768409729, -0.019485827535390854, 0.13046185672283173, -0.08069184422492981, -0.03240000456571579, -0.019604051485657692, -0.09610764682292938, -4.039404502318398e-33, 0.016782615333795547, -0.004080410115420818, -0.08028408885002136, 0.010213993489742279, -0.13638927042484283, 0.014284505508840084, 0.04117785021662712, 0.01148403249680996, -0.027979230508208275, -0.040449533611536026, -0.08946730941534042, 0.03402765467762947, 0.020022926852107048, -0.008287684991955757, -0.029705148190259933, 0.03418823704123497, 0.009117175824940205, -0.002838012296706438, -0.01264795009046793, -0.09000465273857117, -0.0320015475153923, 0.02977125160396099, 0.004088069312274456, 0.07736667990684509, 0.02285686321556568, -0.06023489311337471, 0.07614076882600784, 0.04017414152622223, 0.04687294363975525, -0.018803128972649574, -0.007889499887824059, 0.028712483122944832, -0.047024890780448914, 0.0023579199332743883, -0.026893747970461845, 0.029382186010479927, -0.045465778559446335, 0.0468626469373703, 0.06586781144142151, -0.0026782045606523752, 0.011683248914778233, -0.04731292277574539, -0.021391907706856728, 0.1131647601723671, 0.0321032889187336, -0.0017185783945024014, -0.02901361510157585, 0.013500332832336426, -0.003834492526948452, -0.0013904618099331856, 0.049170587211847305, -0.04478837177157402, -0.020459435880184174, -0.07242431491613388, 0.021293848752975464, 0.006960634142160416, -0.004190996289253235, -0.08801530301570892, -0.0874529629945755, 0.06587982922792435, 0.007996676489710808, -0.057221606373786926, -0.041670288890600204, -0.02616002783179283, -0.04690856486558914, -0.07619982957839966, -0.03321473300457001, 0.09889231622219086, 0.07403954118490219, -0.025750352069735527, -0.0075689745135605335, -0.05209736526012421, 0.06729403883218765, 0.008135739713907242, 0.0014236633433029056, 0.02770092897117138, 0.006772791035473347, 0.004325108136981726, -0.010448534972965717, 0.055559802800416946, -0.07126813381910324, 0.007306605111807585, 0.007661784533411264, 0.01751830242574215, 0.0811687633395195, -0.012631276622414589, 0.0216994546353817, 0.1010025218129158, 0.00906796008348465, 0.023106353357434273, 0.0030809794552624226, 0.08471334725618362, 0.008314812555909157, 0.027236701920628548, -0.020378416404128075, -4.746472725969397e-08, -0.09700489044189453, -0.037716060876846313, -0.01442602276802063, 0.038858119398355484, 0.002417396754026413, 0.0095882099121809, 0.06238798797130585, 0.01290011964738369, 0.01563160866498947, -0.02978549525141716, -0.026906171813607216, -0.017486026510596275, -0.003977254498749971, 0.0032464112155139446, -0.0524754673242569, 0.02308703400194645, 0.06368910521268845, 0.09157562255859375, -0.02712378092110157, -0.02389197237789631, -0.054602302610874176, -0.017066631466150284, -0.00320516899228096, -0.015963679179549217, 0.016587993130087852, -0.041393715888261795, 0.0035995428916066885, 0.03134395182132721, -0.03525311127305031, -0.02573452703654766, -0.08894886076450348, -0.013219845481216908, 0.006940925028175116, 0.021333759650588036, -0.08042009174823761, 0.0002663611085154116, 0.036475710570812225, -0.011388654820621014, 0.07869946211576462, 0.07107685506343842, -0.002128743100911379, -0.05587911978363991, -0.005065614357590675, 0.03373738005757332, -0.03530598059296608, -0.03466016799211502, 0.05986000597476959, -0.022998899221420288, -0.010835657827556133, -0.08378836512565613, 0.005448172800242901, -0.00917099043726921, -0.09570042788982391, 0.07709028571844101, 0.046098772436380386, 0.005878095980733633, -0.0491347499191761, 0.060657259076833725, 0.007456495426595211, 0.0185164213180542, 0.03930310159921646, -0.0039424533024430275, 0.04972285032272339, 0.03640332072973251 ] }, { "text": "--reveal-prefix=\nThe URL prefix for reveal.js (version 3.x).\nThis defaults to the reveal CDN, but can be any url pointing to a copy\nof reveal.js.\nFor speaker notes to work, this must be a relative path to a local\ncopy of reveal.js: e.g., \"reveal.js\".\nIf a relative path is given, it must be a subdirectory of the\ncurrent directory (from which the server is run).\nSee the usage documentation\n(https://nbconvert.readthedocs.io/en/latest/usage.html#reveal-js-html-slideshow)\nfor more details.\nDefault: ''\nEquivalent to: [--SlidesExporter.reveal_url_prefix]\n--nbformat=\nThe nbformat version to write.\nUse this to downgrade notebooks.\nChoices: any of [1, 2, 3, 4]\nDefault: 4\nEquivalent to: [--NotebookExporter.nbformat_version]", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_87", "embedding": [ -0.1023012325167656, -0.04458458721637726, 0.05307456851005554, -0.02245432510972023, 0.008335758931934834, 0.04011942446231842, -0.051694709807634354, 0.02210857719182968, 0.0760105699300766, -0.07065007835626602, -0.007991540245711803, 0.0535251684486866, -0.08857813477516174, 0.07047992199659348, 0.03163744509220123, -0.056461792439222336, 0.05356593057513237, 0.017357319593429565, 0.05267644673585892, 0.0053232996724545956, 0.11234550178050995, -0.016474401578307152, 0.06812738627195358, -0.057575467973947525, 0.07096664607524872, -0.018404781818389893, -0.0007310379296541214, -0.006300140172243118, -0.012555778957903385, 0.029708297923207283, 0.07453954219818115, -0.02277633547782898, 0.012268123216927052, -0.05325992405414581, 0.038904108107089996, 0.056806471198797226, -0.016474012285470963, -0.04078569635748863, 0.010606931522488594, 0.05503622442483902, 0.04418882355093956, 0.08106234669685364, -0.023581653833389282, -0.027708645910024643, -0.05203517898917198, -0.11710350215435028, -0.08249983191490173, -0.002866089344024658, -0.017874304205179214, 0.042337995022535324, 0.013657698407769203, -0.07434604316949844, 0.03574713319540024, -0.030455952510237694, -0.0007231426425278187, 0.016759131103754044, -0.031113142147660255, 0.05971262603998184, 0.02321181446313858, 0.02110101282596588, 0.033717457205057144, -0.0750667080283165, 0.013805920258164406, -0.015303552150726318, 0.01926872320473194, 0.042834121733903885, -0.05937664583325386, -0.0038337153382599354, -0.012755189090967178, 0.024859033524990082, -0.022988975048065186, -0.005046248435974121, 0.0853404849767685, -0.006946636829525232, -0.059411678463220596, -0.07482501119375229, 0.054094698280096054, -0.0019091538852080703, -0.05515804514288902, -0.11052937805652618, 0.10382254421710968, -0.09818963706493378, -0.007151822559535503, -0.005737189203500748, 0.014829784631729126, 0.057685546576976776, -0.007318565621972084, -0.030080046504735947, 0.010911493562161922, 0.021038006991147995, -0.07548481971025467, -0.13912460207939148, 0.04352349042892456, -0.006317307241261005, -0.03419756144285202, -0.04015648737549782, -0.026384970173239708, 0.0461735762655735, -0.011506203562021255, 0.04217776656150818, -0.02446957677602768, 0.028385566547513008, 0.14458003640174866, -0.022882619872689247, -0.029441669583320618, -0.014698916114866734, -0.02205725573003292, 0.06900066882371902, 0.032633472234010696, 0.02794773317873478, -0.012084880843758583, 0.024988844990730286, 0.012259284034371376, -0.016894584521651268, 0.020074237138032913, -0.04052452743053436, 0.025561930611729622, 0.04005110636353493, 0.02801637351512909, 0.07322115451097488, 0.12505501508712769, 0.04181748628616333, -0.01845145784318447, 0.018136879429221153, -0.017956454306840897, 0.017500068992376328, -0.027729975059628487, 2.8789863257228873e-34, 0.0489380806684494, -0.022485429421067238, -0.04909224063158035, -0.030207326635718346, 0.04925468936562538, -0.08084803074598312, 0.04429672658443451, -0.0068377223797142506, -0.12660840153694153, -0.00012334116036072373, -0.0019105597166344523, 0.06625014543533325, -0.02548222243785858, 0.0029104575514793396, -0.09307396411895752, 0.0915042906999588, -0.0017503357958048582, 0.06622185558080673, 0.11616062372922897, -0.07630287110805511, 0.041748519986867905, 0.0328841432929039, 0.005876437295228243, -0.029449379071593285, 0.018941786140203476, -0.022497572004795074, -0.003407665528357029, -0.007552276831120253, 0.008794213645160198, -0.01933450996875763, -0.02342100813984871, -0.023468246683478355, 0.020176513120532036, -0.04752369225025177, 0.002741467207670212, 0.010992961004376411, -0.05473211035132408, -0.04520039260387421, 0.010324797593057156, -0.09526214748620987, 0.0055886744521558285, -0.06055813282728195, -0.11902488768100739, -0.032132189720869064, -0.01251404918730259, 0.036993544548749924, 0.009897034615278244, 0.038468386977910995, 0.05323106050491333, -0.01163586787879467, -0.03975708410143852, 0.0012809534091502428, -0.05337196961045265, -0.005150764249265194, 0.096129409968853, -0.07773326337337494, 0.04430690035223961, 0.007430975325405598, 0.0887182429432869, -0.0860607698559761, 0.09628608822822571, 0.043602585792541504, -0.01347771380096674, -0.07941359281539917, -0.04717322438955307, 0.016852563247084618, -0.06984034180641174, -0.006871961057186127, -0.0602002888917923, 0.016960376873612404, -0.09204434603452682, -0.005893856752663851, -0.02436589077115059, 0.05337133631110191, 0.01440468244254589, 0.001599819166585803, -0.0754811093211174, 0.014325818046927452, 0.11263610422611237, -0.062270086258649826, -0.07439860701560974, -0.08019690960645676, -0.06230759248137474, 0.036869119852781296, -0.029711352661252022, 0.03210065886378288, 0.035625260323286057, -0.049285467714071274, -0.0221196711063385, -0.021879181265830994, 0.0177081897854805, -0.025962796062231064, -0.07374962419271469, 0.039967842400074005, -0.02810003235936165, -3.407441474243059e-33, -0.012240244075655937, 0.0629667192697525, -0.10262466967105865, 0.043992459774017334, -0.10399607568979263, 0.007906935177743435, -0.010160407051444054, 0.06928493827581406, -0.017005205154418945, -0.05039899796247482, -0.011119105853140354, 0.05864296108484268, 0.0011805513640865684, -0.07428734004497528, 0.025731494650244713, 0.06549488008022308, 0.012007283978164196, 0.05027417466044426, -0.018829843029379845, -0.03831871226429939, -0.042643122375011444, 0.06379839777946472, -0.056324552744627, 0.02517288364470005, 0.01680653728544712, -0.03439848870038986, 0.11688555777072906, 0.03152891620993614, 0.014400244690477848, -0.020660363137722015, -0.005119692999869585, 0.026095230132341385, -0.08978252112865448, 0.006975463125854731, -0.0046203648671507835, 0.09805130213499069, 0.0014074821956455708, -0.013770555146038532, -0.01335680391639471, -0.04673049971461296, 0.04268535599112511, 0.02553093619644642, -0.032243918627500534, 0.04986469820141792, -0.010724963620305061, 0.0474005751311779, -0.012261554598808289, 0.061037514358758926, 0.02150825597345829, -0.0602998323738575, 0.031316764652729034, -0.10034381598234177, 0.03314979001879692, -0.06866486370563507, -0.044692493975162506, 0.04672884941101074, 0.004329283256083727, -0.050481513142585754, -0.032717932015657425, 0.057204969227313995, 0.023989694193005562, -0.045205648988485336, -0.024279575794935226, -0.07620267570018768, -0.028932426124811172, -0.04754641652107239, -0.07267322391271591, 0.1543995440006256, 0.005971383769065142, 0.02018970064818859, -0.018042197450995445, -0.023176729679107666, 0.13350467383861542, -0.05503768473863602, 0.0006115463329479098, 0.026695428416132927, -0.01766587607562542, 0.011824049986898899, -0.014569127932190895, 0.007154747378081083, -0.016659114509820938, 0.03549685329198837, 0.021008364856243134, -0.028083477169275284, 0.09536547213792801, 0.05091166868805885, 0.0187654048204422, 0.08560889959335327, -0.0324099175632, 0.055117666721343994, -0.0306139774620533, 0.05018626153469086, 0.08721470087766647, 0.0537712499499321, 0.06419330090284348, -5.1415302237955984e-08, -0.05727139115333557, 0.033026281744241714, 0.010468739084899426, -0.12710139155387878, -0.05546483397483826, -0.03639140725135803, 0.04281182587146759, -0.03745291754603386, 0.023399246856570244, -0.033069562166929245, 0.016383325681090355, -0.029387706890702248, 0.021578112617135048, 0.08283274620771408, -0.05901920795440674, 0.03806093707680702, -0.01602715067565441, 0.11537448316812515, -0.0033178692683577538, -0.04453228786587715, -0.05550402030348778, -0.06452280282974243, 0.06161026284098625, -0.00894443690776825, 0.03975691273808479, -0.05519716069102287, -0.002068227855488658, 0.026927553117275238, -0.03926490619778633, 0.008790513500571251, -0.09689710289239883, 0.007375756278634071, -0.01711161620914936, 0.02418532781302929, -0.014163239859044552, 0.0345219224691391, -0.0060664997436106205, -0.05045858398079872, 0.043174199759960175, 0.10598768293857574, 0.00314894737675786, -0.10375963151454926, -0.05607594549655914, 0.048306118696928024, -0.03733363375067711, -0.04557522013783455, 0.05051013454794884, -0.039165228605270386, -0.007588346488773823, -0.005753098521381617, -0.01095795538276434, -0.05236365273594856, -0.05512325093150139, 0.016437843441963196, 0.09316667914390564, 0.032707054167985916, -0.048850130289793015, 0.08901990205049515, -0.04825223237276077, 0.03530513867735863, 0.024748023599386215, -0.019000006839632988, 0.03952096030116081, 0.028734903782606125 ] }, { "text": "Examples\n--------\n\nThe simplest way to use nbconvert is\n\n> jupyter nbconvert mynotebook.ipynb --to html\n\nOptions include ['asciidoc', 'custom', 'html', 'latex', 'markdown', 'notebook', 'pdf', 'python', 'qtpdf', 'qtpng', 'rst', 'script', 'slides', 'webpdf'].\n\n> jupyter nbconvert --to latex mynotebook.ipynb\n\nBoth HTML and LaTeX support multiple output templates. LaTeX includes\n'base', 'article' and 'report'. HTML includes 'basic', 'lab' and\n'classic'. You can specify the flavor of the format used.\n\n> jupyter nbconvert --to html --template lab mynotebook.ipynb\n\nYou can also pipe the output to stdout, rather than a file\n\n> jupyter nbconvert mynotebook.ipynb --stdout\n\nPDF is generated via latex\n\n> jupyter nbconvert mynotebook.ipynb --to pdf", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_88", "embedding": [ -0.04377353936433792, 0.06099329888820648, -0.05296383053064346, 0.009602546691894531, -0.03068443387746811, 0.06518677622079849, -0.11837492138147354, 0.06717890501022339, 0.0031730474438518286, -0.02936125546693802, -0.04825383424758911, 0.021351920440793037, 0.04668552801012993, 0.008499237708747387, 0.045933425426483154, -0.026472182944417, 0.019547168165445328, 0.017568618059158325, 0.0706816166639328, -0.02545659989118576, 0.03507613390684128, 0.013446620665490627, 0.08181696385145187, -0.09442546218633652, 0.04570206254720688, 0.043582264333963394, -0.06090841069817543, 0.04633598029613495, 0.0031839876901358366, 0.023907816037535667, 0.05998002365231514, -0.04722154513001442, 0.02395377680659294, 0.0356377474963665, 0.1142139658331871, 0.053801022469997406, 0.026263969019055367, 0.035553883761167526, -0.008752724155783653, 0.06086299940943718, 0.10977328568696976, 0.013363092206418514, -0.1031736209988594, -0.033625997602939606, -0.049626607447862625, -0.13262268900871277, -0.07729697972536087, -0.03687954694032669, -0.03166409209370613, -0.0033195307478308678, -0.07765363156795502, -0.0168879646807909, 0.0029736156575381756, -0.016500994563102722, 0.04234122857451439, -0.011975699104368687, 0.00959074404090643, -0.03324912115931511, -0.01884726993739605, -0.11827503889799118, -0.05350453034043312, 0.032000184059143066, -0.010306963697075844, -0.004155745264142752, 0.027945328503847122, 0.027360841631889343, -0.09793417900800705, 0.14501826465129852, 0.03042544424533844, 0.03861080855131149, -0.13632549345493317, -0.051234278827905655, -0.03155824914574623, 0.04873548075556755, 0.0067695132456719875, -0.05397694930434227, -0.0007055019377730787, -0.04449981451034546, -0.0793992280960083, -0.05966300144791603, -0.0155966030433774, -0.022525755688548088, 0.004687200300395489, 0.04088858887553215, 0.04392467811703682, -0.020317522808909416, 0.053307320922613144, 0.04177403450012207, -0.0012298979563638568, -0.03216209635138512, 0.043249230831861496, -0.061000026762485504, -0.0002840574597939849, -0.07930643111467361, -0.026765748858451843, 0.04023503139615059, 0.08219026774168015, -0.0146882813423872, 0.028065146878361702, 0.02373521961271763, 0.05608847364783287, -0.04837581887841225, 0.035203367471694946, -0.06008379906415939, 0.0397578589618206, -0.03206796571612358, 0.025776227936148643, -0.012960076332092285, 0.07520893216133118, -0.0212930329144001, -0.03863690420985222, -0.020922645926475525, -0.07063889503479004, -0.09891694784164429, 0.015108650550246239, -0.0296483151614666, -0.017059285193681717, 0.03610803931951523, 0.08176609128713608, 0.08720105141401291, -0.0179743655025959, 0.022351346909999847, -0.061473745852708817, 0.09144359827041626, 0.034197885543107986, 0.046574175357818604, -0.01480048056691885, 2.6396263803721952e-33, -0.011069949716329575, -0.03028048388659954, 0.009324242360889912, -0.05689981207251549, 0.0816882774233818, 0.01312772836536169, 0.019258208572864532, -0.013305295258760452, -0.022046294063329697, -0.007948657497763634, 0.02220231480896473, -0.001113551901653409, 0.021786076948046684, 0.09371016919612885, -0.17614206671714783, 0.03221762552857399, -0.08305139094591141, 0.007000884506851435, 0.09245289862155914, 0.05806615576148033, 0.04370353743433952, 0.02740226872265339, 0.026682782918214798, 0.06722528487443924, -0.04227064177393913, -0.0016002675984054804, -0.01575324684381485, 0.09086795151233673, -0.10695763677358627, -0.009127490222454071, 0.008195217698812485, 0.009548753499984741, -0.031217601150274277, -0.09166029840707779, -0.11318235844373703, -0.0032148947939276695, -0.008420689031481743, -0.08438035100698471, -0.03166201710700989, -0.043160028755664825, -0.09639085829257965, -0.05103331804275513, -0.0341113843023777, -0.017371784895658493, -0.011071392334997654, 0.007497954182326794, -0.04357193782925606, 0.040251098573207855, 0.048234723508358, -0.0739375576376915, -0.06342499703168869, -0.022965410724282265, 0.015095258131623268, -0.02744300290942192, 0.041420549154281616, 0.0037696256767958403, 0.05134916678071022, -0.0016578460345044732, 0.07878642529249191, -0.010793142020702362, 0.02865671180188656, 0.06087646260857582, -0.04276655241847038, -0.01063862070441246, 0.016347361728549004, 0.010236628353595734, 0.03543578460812569, 0.04182199388742447, -0.047327861189842224, -0.007833490148186684, -0.07958407700061798, 0.03968365862965584, -0.019754953682422638, -0.012227766215801239, 0.07462465763092041, 0.013417631387710571, -0.030138304457068443, -0.003912776242941618, 0.01350443996489048, -0.06127237156033516, 0.0007907949038781226, -0.020941495895385742, -0.0011895789066329598, -0.0491764061152935, 0.007323973346501589, -0.039096344262361526, 0.035593751817941666, -0.027872741222381592, 0.02138425223529339, 0.0025342265143990517, 0.03207074850797653, -0.04002179577946663, -0.11143453419208527, 0.004098707810044289, -0.05970966815948486, -4.7086953535040994e-33, 0.022020045667886734, 0.07812608033418655, -0.08089017122983932, 0.01664130389690399, -0.02457105927169323, 0.04563123732805252, 0.07984217256307602, 0.04329043626785278, -0.022553686052560806, -0.0188706424087286, -0.03730841353535652, -0.09881278872489929, -0.002177289454266429, -0.03569166362285614, -0.03568047657608986, 0.030810894444584846, -0.015492088161408901, 0.057126935571432114, 0.015353268012404442, -0.004813943523913622, -0.08029041439294815, -0.0028878662269562483, 0.04919945448637009, 0.09601607918739319, 0.02622413821518421, -0.018130024895071983, 0.030874215066432953, 0.02578490786254406, -0.06779427081346512, 0.0016797116259112954, 0.028576048091053963, 0.04114455357193947, 0.024439984932541847, 0.022909017279744148, 0.005884447135031223, 0.07317011803388596, 0.0030981211457401514, -0.012482449412345886, 0.03295100852847099, 0.01889977417886257, 0.0772022232413292, 0.03707326203584671, -0.019055169075727463, 0.06213636323809624, -0.013283569365739822, 0.03145892173051834, -0.12439645081758499, 0.06193986535072327, -0.019525079056620598, -0.06448359787464142, -0.06605330854654312, -0.03115363046526909, -0.048754118382930756, 0.0023354084696620703, -0.08596964925527573, 0.008411185815930367, 0.05046287551522255, -0.01889726333320141, -0.0706799179315567, 0.0487564392387867, -0.07781728357076645, -0.05439120531082153, 0.04703231528401375, -0.049395397305488586, -0.0021823393180966377, -0.1359216570854187, -0.026336388662457466, 0.014017782174050808, 0.03700172156095505, 0.047343503683805466, -0.04571901261806488, -0.004348143935203552, 0.043857865035533905, 0.011657031252980232, 0.021140359342098236, 0.09952428191900253, 0.044551070779561996, 0.03425631672143936, -0.056859176605939865, -0.017402222380042076, 0.02919875644147396, 0.040569376200437546, 0.015917666256427765, -0.028488347306847572, 0.03158344700932503, 0.007012226618826389, 0.01700758934020996, 0.08079773187637329, 0.01792382076382637, 0.017188332974910736, 0.032657209783792496, 0.08815556019544601, 0.020208140835165977, 0.1493590921163559, 0.10651811212301254, -5.2845656739464175e-08, -0.024336524307727814, -0.025676028802990913, 0.016487983986735344, 0.04249823838472366, -0.08889494091272354, 0.004757283255457878, 0.04456048086285591, -0.10456755757331848, -0.008907384239137173, -0.004253996070474386, 0.021695958450436592, -0.061838436871767044, -0.033092740923166275, -0.004167897626757622, -0.024544162675738335, 0.06633919477462769, 0.019440626725554466, -0.0024900641292333603, 0.05116162821650505, -0.002549851546064019, 0.0015071542002260685, -0.022229807451367378, -0.009290794841945171, -0.006903909146785736, 0.06129429489374161, 0.014298041351139545, -0.08351761847734451, 0.04020269215106964, -0.06358462572097778, -0.0694417804479599, 0.035736553370952606, -0.03711980581283569, -0.026775935664772987, 0.022385068237781525, -0.014888618141412735, 0.006920330226421356, -0.03411608189344406, -0.06546870619058609, 0.027955109253525734, 0.05711652338504791, 0.022853398695588112, -0.02296997606754303, -0.17116141319274902, -0.03752030059695244, 0.05942767113447189, 0.0017389688873663545, -0.07286204397678375, -0.058613523840904236, 0.008574023842811584, -0.028287282213568687, 0.06006411463022232, -0.08978991955518723, 0.035653822124004364, -0.025304386392235756, -0.0020041409879922867, 0.032374151051044464, -0.023236658424139023, 0.06688739359378815, 0.05265405401587486, -0.013704766519367695, 0.042926203459501266, 0.041175659745931625, 0.08017238974571228, -0.012964235618710518 ] }, { "text": "> jupyter nbconvert mynotebook.ipynb --stdout\n\nPDF is generated via latex\n\n> jupyter nbconvert mynotebook.ipynb --to pdf\n\nYou can get (and serve) a Reveal.js-powered slideshow\n\n> jupyter nbconvert myslides.ipynb --to slides --post serve\n\nMultiple notebooks can be given at the command line in a couple of\ndifferent ways:\n\n> jupyter nbconvert notebook*.ipynb\n> jupyter nbconvert notebook1.ipynb notebook2.ipynb\n\nor you can specify the notebooks list in a config file, containing::\n\nc.NbConvertApp.notebooks = [\"my_notebook.ipynb\"]\n\n> jupyter nbconvert --config mycfg.py\n\nTo see all available configurables, use `--help-all`.\n\nIn [20]:\n\nfrom google.colab import drive\ndrive.mount('/content/drive')\n\nMounted at /content/drive", "source": "notebook: deep_dream_tutorial.html", "type": "html_notebook", "chunk_id": "notebook: deep_dream_tutorial.html_89", "embedding": [ -0.06118479371070862, -0.0419919528067112, -0.006461247336119413, -0.007585751824080944, -0.029750052839517593, 0.056179385632276535, -0.08133544772863388, 0.09207802265882492, 0.012933769263327122, -0.06809408962726593, -0.03597565367817879, 0.03598923608660698, 0.04005814343690872, -0.008966296911239624, 0.012966668233275414, -0.08441846072673798, 0.02577780745923519, -0.009157346561551094, 0.028714289888739586, -0.024860695004463196, 0.036213427782058716, -0.009748103097081184, 0.10665116459131241, -0.09401524066925049, -0.01668357662856579, -0.020741313695907593, -0.05407722294330597, -0.046894632279872894, -0.07945146411657333, 0.022881096228957176, 0.06106088310480118, -0.038597844541072845, -0.07984121143817902, 0.04847091808915138, 0.15084373950958252, 0.003079914953559637, -0.021624736487865448, -0.003230891190469265, 0.030410271137952805, -0.010909447446465492, 0.13553816080093384, 0.0025070959236472845, -0.07562512904405594, -0.0648210346698761, -0.0074475533328950405, -0.09616910666227341, -0.01829579472541809, -0.06069079414010048, 0.05615684390068054, 0.030584972351789474, -0.07089295983314514, -0.02952398918569088, -0.012218684889376163, -0.020281150937080383, 0.004485968500375748, -0.011030168272554874, 0.014303319156169891, 0.043328821659088135, 0.014885873533785343, -0.005839507561177015, -0.03467905893921852, -0.010327805764973164, -0.023653749376535416, -0.00010790128726512194, 0.025871064513921738, 0.03553690388798714, -0.021854916587471962, 0.10789917409420013, 0.03153301402926445, -0.0007414220017381012, -0.03943479061126709, 0.04201307147741318, 0.016326872631907463, 0.03184891492128372, -0.06127505749464035, -0.10397203266620636, -0.018385615199804306, -0.02272980287671089, -0.06905431300401688, -0.10766977816820145, -0.0026706920471042395, -0.07277768105268478, 0.06425176560878754, 0.07009311020374298, 0.013622003607451916, -0.07405561208724976, 0.008391723968088627, 0.03653136268258095, 0.015006618574261665, -0.007987873628735542, -0.006134937517344952, -0.10104482620954514, -0.03636080026626587, -0.031186673790216446, -0.028087886050343513, -0.00859244354069233, 0.021222300827503204, 0.008183177560567856, 0.009588471613824368, 0.02144978940486908, -0.004940367303788662, 0.010513778775930405, 0.1399000585079193, -0.01736014150083065, 0.004499619826674461, -0.03820182755589485, -0.03678256645798683, -0.05961339920759201, 0.017300399020314217, -0.009389116428792477, 0.005280900280922651, 0.009850605390965939, 0.026324063539505005, -0.023719342425465584, 0.04079323634505272, -0.008052936755120754, -0.00868027750402689, 0.10520801693201065, 0.08021517097949982, 0.030244994908571243, 0.029422754421830177, -0.0031039288733154535, 0.04918458312749863, -0.009162070229649544, 0.0005812494200654328, 0.018365226686000824, -0.033123698085546494, 5.923550030637717e-33, 0.004539834335446358, -0.1197235956788063, 0.03968336805701256, -0.037793222814798355, 0.05981907248497009, -0.017606712877750397, 0.03376029431819916, 0.02472480572760105, -0.07297450304031372, -0.03015740029513836, -0.0041964114643633366, 0.05696148797869682, 0.003407461801543832, 0.05162259563803673, -0.1802787333726883, 0.023279616609215736, -0.05975351110100746, 0.0511130765080452, 0.06990452855825424, 0.027413805946707726, 0.02665381319820881, 0.03523912653326988, -0.013462658040225506, 0.01671208254992962, -0.022253625094890594, -0.060099393129348755, 0.02511714957654476, 0.03564651310443878, -0.04969785362482071, 0.025785859674215317, -0.056524477899074554, 0.0397065095603466, -0.011686396785080433, -0.09407283365726471, -0.0393882691860199, -0.04780936613678932, -0.10043615847826004, -0.07372935116291046, 0.018889516592025757, -0.08787616342306137, -0.032972272485494614, -0.052725475281476974, -0.06637420505285263, -0.04571130871772766, -0.1009681224822998, 0.07817022502422333, -0.025459961965680122, 0.09536585956811905, 0.048249948769807816, -0.03136788308620453, -0.005560482386499643, -0.007076404057443142, -0.03457514941692352, -0.048152875155210495, 0.06664669513702393, -0.020153813064098358, 0.055455531924963, -0.0022846104111522436, 0.12277409434318542, -0.040069565176963806, 0.06255383044481277, 0.06946052610874176, -0.07567878067493439, 0.032716188579797745, 0.005880193319171667, 0.09905006736516953, -0.08390869945287704, 0.042690347880125046, -0.012524797581136227, 0.003319569630548358, -0.09444709122180939, 0.025763297453522682, -0.021273942664265633, -0.06836600601673126, 0.10312691330909729, 0.003912078216671944, -0.05186357721686363, 0.07187382876873016, -0.037675902247428894, -0.055925603955984116, -0.013377737253904343, -0.06845957785844803, -0.03322210907936096, 0.029733357951045036, -0.06276353448629379, 0.035849153995513916, 0.020085573196411133, 0.009197792038321495, -0.03526381030678749, 0.002485257340595126, 0.0035726989153772593, -0.007680409122258425, -0.042767394334077835, 0.017317302525043488, -0.06959260255098343, -7.499011844457058e-33, 0.025873156264424324, 0.03803769871592522, -0.05659079551696777, 0.004471853841096163, 0.05119946226477623, 0.006763717159628868, 0.03453134000301361, -0.01526697538793087, -0.011178734712302685, -0.008256593719124794, -0.08483579754829407, -0.016917964443564415, -0.021398860961198807, -0.06144103407859802, -0.0486065112054348, 0.05558396130800247, 0.025850465521216393, 0.05822319909930229, -0.018113406375050545, -0.016592612490057945, -0.08782250434160233, 0.04594094678759575, 0.081641286611557, 0.0771031379699707, 0.02006378211081028, -0.033378563821315765, 0.04518263787031174, 0.016306154429912567, -0.034692030400037766, 0.021557025611400604, -0.009038228541612625, 0.08107078820466995, -0.04701494798064232, 0.015946101397275925, 0.015612202696502209, 0.02346879243850708, 0.012892322614789009, -0.04927439987659454, -0.00038207595935091376, 0.005022851750254631, 0.06962065398693085, 0.04603511095046997, -0.06704085320234299, 0.05346664413809776, 0.06695078313350677, 0.03153452277183533, -0.08249518275260925, 0.0788302943110466, -0.07934549450874329, -0.01319155003875494, -0.083432637155056, -0.044083792716264725, -0.00476603489369154, -0.05276184901595116, -0.005559460259974003, 0.02577637881040573, 0.044893670827150345, -0.019549861550331116, -0.014389744028449059, -0.01452555600553751, -0.027428055182099342, -0.0941421240568161, 0.001024353434331715, -0.048207614570856094, -0.02168426103889942, -0.10686895251274109, -0.04171999916434288, 0.07380576431751251, 0.008489826694130898, 0.03125730901956558, -0.022882452234625816, -0.03240320086479187, 0.1494579166173935, -0.011441445909440517, 0.025408156216144562, 0.11255817115306854, 0.0194490235298872, -0.04584848880767822, -0.036263834685087204, 0.029017552733421326, 0.0060265278443694115, 0.05698032304644585, 0.0459793396294117, -0.05593157932162285, 0.010560388676822186, 0.07458826899528503, 0.009164191782474518, 0.08585546165704727, 0.05422024056315422, 0.03190220519900322, -0.004544464405626059, 0.04675789549946785, 0.06606444716453552, 0.10230790823698044, 0.043594103306531906, -5.204829278682155e-08, -0.021616131067276, 0.020611625164747238, 0.04442901909351349, 0.01155595201998949, -0.08601216226816177, -0.005252912640571594, 0.05853031948208809, 0.06505124270915985, 0.055442508310079575, -0.0038486903067678213, 0.07249151170253754, -0.07291620224714279, 0.047960393130779266, 0.04567559063434601, -0.08196097612380981, 0.0676795020699501, 0.057629700750112534, -0.006973614916205406, 0.0031182211823761463, 0.023135846480727196, 0.023019205778837204, -0.0827503427863121, 0.09943899512290955, 0.05056283622980118, -0.019559001550078392, -0.00295813730917871, -0.031009720638394356, -0.052339229732751846, -0.09095607697963715, -0.07610249519348145, -0.057937245815992355, -0.046006910502910614, 0.007748296018689871, 0.021231479942798615, 0.005450145807117224, 0.015312595292925835, -0.04342551529407501, 0.0025693627540022135, 0.08419369906187057, 0.10635069757699966, -0.04572903364896774, -0.062296997755765915, -0.045702915638685226, 0.020237997174263, 0.038420502096414566, -0.019330469891428947, -0.028398670256137848, -0.022577205672860146, -0.03328842669725418, 0.019926831126213074, -0.03080279752612114, -0.02717597968876362, -0.0070020053535699844, 0.039854079484939575, 0.05074239894747734, 0.00959587749093771, -0.04542486369609833, 0.08037300407886505, 0.021282406523823738, 0.03943825513124466, 0.031629424542188644, 0.021388530731201172, 0.03024189919233322, 0.013111972250044346 ] }, { "text": "Word_Vectors\n\nWord Vectors¶\n\nI've taken this great lecture \"Sequence Models\" from Coursera given by DeepLearning.AI. this notebook is dervied from the week2 homework.\n\nWe will use pre-trained set of embeddings, learn cosine similiarty, how to solve word analogy between two words. And the most exciting part is to modify the words to reduce their gender bias.\n\nTable of Contents¶\n\n• Packages\n•\n\n• 1 - Load the Word Vectors\n•\n\n• 2 - Cosine Similarity\n•\n\n• 3 - Word Analogy Task\n•\n\n• 4 - Debiasing Word Vectors\n\n• 4.1 - Neutralize Bias for Non-Gender Specific Words\n•\n\n• 4.2 - Equalization Algorithm for Gender-Specific Words\n•\n\n•\n\n• 5 - References\n•\n\nPackages¶\n\nLoad packages\n\nIn [1]:\n\nimport numpy as np\n\n1 - Load the Word Vectors¶", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_0", "embedding": [ -0.019659360870718956, -0.07108955085277557, 0.028839323669672012, -0.031737156212329865, -0.002284812042489648, -0.03199746459722519, 0.014246262609958649, -0.06166591867804527, -0.07388389110565186, 0.013963819481432438, -0.0004906610702164471, -0.01401599496603012, 0.044580426067113876, 0.014237262308597565, -0.02845356985926628, 0.05288438871502876, 0.04743213951587677, 0.06450338661670685, -0.019705036655068398, -0.06669938564300537, 0.06185689568519592, 0.03044530376791954, 0.03215586394071579, -0.04940740019083023, 0.01653607003390789, -0.011974949389696121, -0.0005777255282737315, 0.00787452980875969, -0.03647439181804657, 0.025150524452328682, 0.08408137410879135, 0.04073800891637802, 0.06340738385915756, 0.0022205899003893137, -0.07144421339035034, 0.04254283383488655, -0.04249783605337143, -0.059295833110809326, 0.05620647966861725, 0.05891270935535431, -0.03186722472310066, -0.040771350264549255, -0.043197356164455414, 0.03673034533858299, 0.07996559888124466, 0.036383435130119324, -0.026440264657139778, 0.003533671610057354, -0.02516728825867176, -0.027719425037503242, -0.03264365345239639, -0.059432629495859146, -0.07597750425338745, 0.0388985350728035, -0.1168036237359047, -0.03512147068977356, 0.022892693057656288, -0.012756998650729656, 0.014766170643270016, -0.0714142918586731, 0.0016283236909657717, -0.0907117947936058, -0.0038108222652226686, -0.0005876741488464177, -0.041273340582847595, -0.04876153916120529, 0.022841859608888626, 0.09914688766002655, -0.007839477621018887, 0.08525572717189789, 0.03042120486497879, 0.13593082129955292, -0.02985469624400139, 0.032555438578128815, -0.000932444294448942, 0.07950054854154587, 0.10503369569778442, -0.06514909118413925, 0.1106019914150238, -0.06656702607870102, -0.10202725976705551, -0.038364946842193604, 0.10541059821844101, 0.029231032356619835, -0.0042499336414039135, 0.002116709016263485, 0.036059070378541946, -0.041518326848745346, -0.04490819200873375, 0.010095342993736267, -0.07847228646278381, -0.09711650758981705, 0.17680984735488892, -0.05738898366689682, 0.05752791091799736, 0.01515734102576971, 0.012003486044704914, -0.009306780062615871, -0.04157419130206108, 0.054225094616413116, 0.048424504697322845, 0.04449605569243431, -0.010630450211465359, -0.00907930452376604, -0.04875025898218155, -0.007612643297761679, 0.03633931651711464, -0.026323474943637848, 0.043236345052719116, -0.11341463774442673, -0.061571501195430756, -0.010244181379675865, -0.0355696938931942, 0.015446299687027931, 0.04273528978228569, -0.016878867521882057, 0.04609234631061554, 0.0012238954659551382, 0.09106859564781189, -0.00786295160651207, -0.0038406404200941324, 0.054880935698747635, 0.0486585758626461, 0.06160707399249077, -0.028211962431669235, -0.014369265176355839, -0.012630327604711056, 1.2296528653135243e-33, -0.048760786652565, 0.05040981248021126, 0.0007941054063849151, 0.019048744812607765, 0.05746668577194214, 0.02065335400402546, 0.025555917993187904, -0.012243793345987797, -0.04845449700951576, -0.0351763553917408, -0.08683434873819351, 0.029377974569797516, -0.0933334231376648, 0.013310378417372704, -0.0069375657476484776, -0.08308947831392288, -0.004331814590841532, -0.0027307807467877865, -0.0072801364585757256, 0.004285141360014677, 0.006665273569524288, 0.04297851026058197, -0.05061236768960953, 0.03128433600068092, -0.037073567509651184, -0.09276366978883743, 0.05298396199941635, -0.08482427150011063, -0.00567586487159133, -0.005796707235276699, -0.06543541699647903, -0.029359707608819008, 0.07616644352674484, 0.05274621769785881, -0.0034658098593354225, -0.06648411601781845, 0.03828613460063934, 0.018623415380716324, 0.01079308521002531, -0.027014385908842087, 0.019222982227802277, -0.02366890199482441, 0.07629629224538803, -0.05631595104932785, 0.006934477016329765, 0.021214472129940987, 0.023891113698482513, 0.04072917252779007, 0.010204344987869263, 0.008619699627161026, -0.03153020143508911, 0.02819601073861122, -0.022959275171160698, 0.06677226722240448, -0.03726157918572426, 0.04443269595503807, 0.07886439561843872, -0.002627655863761902, 0.023751983419060707, -0.054911281913518906, 0.09426842629909515, 0.012277327477931976, 0.11563301086425781, -0.005460905376821756, -0.00034434563713148236, 0.0024342467077076435, -0.01972166635096073, -0.0028421240858733654, 0.035201314836740494, 0.09664174169301987, -0.028154505416750908, 0.04490915685892105, -0.0417315848171711, 0.06938231736421585, 0.008287325501441956, 0.08886134624481201, 0.046899378299713135, -0.07997358590364456, -0.07018464058637619, -0.0027004238218069077, 0.0027078452985733747, -0.00781971588730812, -0.036402542144060135, -0.14483395218849182, -0.12421084940433502, -0.12356585264205933, 0.03135772794485092, -0.15339557826519012, 0.04071086645126343, -0.020970817655324936, -0.012715994380414486, 0.03350524976849556, 0.021344207227230072, 0.022084038704633713, -0.006795212626457214, -2.5356821903747805e-33, -0.08531307429075241, -0.021723618730902672, 0.0032067301217466593, 0.030791563913226128, -0.061478402465581894, -0.017818186432123184, 0.08922948688268661, 0.0013781978050246835, 0.047332510352134705, -0.030939176678657532, -0.038786761462688446, -0.09548758715391159, 0.01237796526402235, -0.02651442028582096, 0.10670185834169388, -0.04270854964852333, 0.010869048535823822, 0.028496641665697098, 0.049154266715049744, 0.07171780616044998, -0.0007531618466600776, 0.08499743044376373, -0.048007380217313766, 0.012646295130252838, 0.028742454946041107, 0.039585232734680176, 0.032712601125240326, -0.03258691355586052, 0.037130434066057205, -0.0013572931056842208, -0.07106271386146545, -0.006800036411732435, -0.028073307126760483, 0.10013563930988312, -0.04589458182454109, -0.005401741713285446, -0.023844799026846886, 0.010543080978095531, -0.013920821249485016, -0.04142845794558525, 0.06235130876302719, 0.034442707896232605, -0.0897681936621666, 0.0012628709664568305, -0.00622009951621294, 0.018061429262161255, -0.06974181532859802, 0.003630572697147727, 0.03678573668003082, 0.06616847962141037, -0.06565649062395096, 0.02992813102900982, -0.12687627971172333, 0.02765800431370735, 0.012589089572429657, -0.08412431180477142, 0.027703341096639633, -0.07979743182659149, 0.0010160158853977919, 0.016616184264421463, -0.0731433779001236, -0.024029023945331573, -0.03792976215481758, 0.016622889786958694, -0.05366242304444313, -0.09475693851709366, -0.05599747598171234, 0.004331887234002352, 0.04773188754916191, -0.006222585216164589, 0.08790009468793869, 0.04331980645656586, 0.022333702072501183, -0.02047821693122387, -0.019804449751973152, -0.029088493436574936, -0.018560923635959625, -0.05543868988752365, -0.08116014301776886, -0.0793834701180458, -0.011833492666482925, -0.01706550642848015, 0.0720592513680458, 0.010755274444818497, -0.04051165282726288, 0.06450656056404114, 0.03963683173060417, 0.09462372213602066, 0.0012326764408499002, 0.06952707469463348, -0.04531898349523544, -0.055748581886291504, -0.008709991350769997, 0.02267839014530182, 0.009970361366868019, -4.0518223443086754e-08, -0.057032693177461624, 0.008470467291772366, 0.008322782814502716, 0.045290615409612656, -0.007239399943500757, -0.05485100299119949, -0.062056995928287506, -0.05891400948166847, -0.04312414675951004, -0.03694352135062218, -0.04066654294729233, 0.029364224523305893, -0.020485064014792442, 0.017924616113305092, -0.01351136900484562, 0.0662199929356575, 0.0370035320520401, 0.05473373457789421, 0.06203813478350639, -0.05829296633601189, 0.0721864104270935, 0.03943205624818802, -0.04487454891204834, 0.0444149412214756, -0.028679773211479187, 0.018687715753912926, -0.07174184918403625, 0.052253324538469315, 0.0766964852809906, -0.059130772948265076, 0.00794681254774332, 0.0430736169219017, -0.04365766793489456, -0.09424226731061935, 0.04529193788766861, 0.06378541141748428, -0.03074605017900467, 0.01357421837747097, -0.008557362481951714, 0.06894687563180923, -0.004865771625190973, 0.02151523157954216, 0.003217174904420972, -0.017050201073288918, 0.11694706976413727, 0.04451795294880867, 0.030259281396865845, -0.08671757578849792, 0.021559499204158783, 0.02848186157643795, 0.046072591096162796, 0.049011923372745514, 0.016823170706629753, -0.02265760488808155, 0.02320088818669319, -0.04055405035614967, -0.04097724333405495, 0.0661911815404892, 0.01418777834624052, 0.07310362160205841, 0.007022381294518709, 0.026700908318161964, 0.019010575488209724, -0.053566526621580124 ] }, { "text": "•\n\n• 5 - References\n•\n\nPackages¶\n\nLoad packages\n\nIn [1]:\n\nimport numpy as np\n\n1 - Load the Word Vectors¶\n\nFor this assignment, you'll use 50-dimensional GloVe vectors to represent words.\nRun the following cell to load the word_to_vec_map.\n\nIn [2]:\n\ndef read_glove_vecs(glove_file):\nwith open(glove_file, 'r') as f:\nwords = set()\nword_to_vec_map = {}\n\nfor line in f:\nline = line.strip().split()\ncurr_word = line[0]\nwords.add(curr_word)\nword_to_vec_map[curr_word] = np.array(line[1:], dtype=np.float64)\n\nreturn words, word_to_vec_map\n\nIn [3]:\n\nwords, word_to_vec_map = read_glove_vecs('data/glove.6B.50d.txt')\n\nIn [4]:\n\nprint(len(words))\n\n400000\n\nIn [5]:\n\nfor idx, (key, value) in enumerate(word_to_vec_map.items()):\nprint(\"word: \", key)\nprint(\"shape\", value.shape)\nif idx ==1:\nbreak", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_1", "embedding": [ 0.029825810343027115, -0.011550845578312874, -0.035712745040655136, -0.07541719824075699, 0.02563728764653206, 0.0012324157869443297, 0.04901167377829552, 0.001770999631844461, -0.06886820495128632, 0.06744411587715149, 0.03141188621520996, 0.059807442128658295, 0.11332651972770691, 0.017492279410362244, -0.0386740118265152, 0.03938867151737213, -0.0904618352651596, 0.028671693056821823, -0.04710910841822624, 0.03374485298991203, 0.0202084481716156, 0.11325947195291519, 0.03700610250234604, -0.035540882498025894, 0.021033069118857384, 0.08122717589139938, 0.057755496352910995, 0.021330812945961952, -0.10099579393863678, 0.04535774886608124, 0.008518612943589687, 0.052769120782613754, 0.056147538125514984, 0.09643524885177612, 0.006216586101800203, 0.005984624847769737, -0.06168787553906441, 0.01301034726202488, -0.07702924311161041, 0.032012857496738434, 0.026393279433250427, -0.025779129937291145, -0.03253060579299927, 0.04719099402427673, 0.1221453845500946, 0.01239882130175829, -0.04482319578528404, 0.018229195848107338, 0.09582135081291199, 0.029359690845012665, -0.03629153221845627, 0.0005468526505865157, -0.015450967475771904, -0.0081730792298913, -0.06013808399438858, -0.03666422888636589, 0.034231338649988174, -0.12993918359279633, -0.005025773774832487, -0.013448764570057392, 0.01634090580046177, 0.007519918028265238, 0.02428470365703106, -0.04100564867258072, 0.007527716923505068, -0.049896955490112305, 0.01844923011958599, 0.08699938654899597, -0.03446606546640396, 0.010920699685811996, -0.03597208112478256, 0.07003960758447647, 0.07161104679107666, -0.01482196245342493, 0.0058116791769862175, -0.06830692291259766, 0.053077973425388336, -0.048174064606428146, 0.10542134940624237, -0.0609125941991806, -0.05593467131257057, 0.015452398918569088, 0.09250721335411072, 0.03755735605955124, -0.030668778344988823, -0.00724475784227252, 0.028615782037377357, 0.017251407727599144, -0.016720231622457504, -0.021508775651454926, -0.0347931943833828, -0.1065734252333641, -0.01527363620698452, -0.05315443500876427, 0.029952967539429665, 0.013444102369248867, 0.015964532271027565, 0.03159075602889061, -0.07326455414295197, 4.08616142522078e-05, 0.037044551223516464, -0.051198992878198624, 0.013239349238574505, -0.04974941909313202, 0.033059243112802505, 0.057027433067560196, 0.020955756306648254, -0.07040408998727798, -0.01361114252358675, -0.04395349323749542, -0.02047969400882721, -0.04845155403017998, -0.06741097569465637, -0.006908592768013477, 0.022045817226171494, -0.03714444115757942, -0.06762966513633728, 0.03967169299721718, 0.06237466633319855, 0.031900785863399506, -0.023242274299263954, 0.0008337626350112259, 0.0020397452171891928, 0.03866039589047432, -0.06617821753025055, -0.030281148850917816, 0.04569939151406288, 7.161931676190066e-34, -0.11259683966636658, 0.034802693873643875, -0.006693758070468903, 0.08100131154060364, 0.05857648327946663, -0.01358737237751484, 0.011303773149847984, -0.06917712092399597, -0.020034153014421463, 0.07414931058883667, -0.11692412942647934, 0.06552097201347351, -0.010069804266095161, 0.07966610789299011, 0.011094730347394943, 0.008590730838477612, -0.03167096525430679, 0.004146503284573555, -0.031208498403429985, 0.0007964040269143879, -0.036415815353393555, 0.05000212788581848, 0.02714327722787857, -0.00538670364767313, -0.06514128297567368, -0.07423854619264603, -0.0047721522860229015, -0.06309055536985397, 0.05652977153658867, -0.028413278982043266, -0.0030481985304504633, 0.011700636707246304, 0.0702115073800087, -0.04739733412861824, -0.023804321885108948, -0.025436032563447952, 0.05370628088712692, 0.002685004845261574, -0.07682904601097107, -0.07551079988479614, 0.008328422904014587, 0.020681098103523254, 0.028125980868935585, -0.08196340501308441, -0.001433763769455254, 0.038673389703035355, 0.009820525534451008, 0.11247831583023071, -0.03894217684864998, -0.0037908912636339664, 0.007055515423417091, -0.03221545368432999, 0.008352500386536121, 0.039961837232112885, -0.04738624766469002, -0.031222861260175705, 0.022810501977801323, 0.03243129700422287, 0.018121229484677315, -0.006101100705564022, -0.00043717821245081723, -0.03685872629284859, 0.09199576079845428, 0.08435112982988358, 0.11556361615657806, 0.0149992061778903, 0.014066409319639206, 0.03555848449468613, 0.01593438908457756, 0.06126002222299576, -0.06963080912828445, -0.02314016968011856, -0.0718621164560318, -0.02981848455965519, -0.03245808184146881, 0.00707597192376852, 0.01321929320693016, -0.013315835036337376, -0.09142658859491348, -0.07852041721343994, -0.004426784347742796, 0.01536543294787407, 0.014772647991776466, -0.0719519853591919, -0.07176095247268677, -0.07649071514606476, -0.01832948625087738, -0.13524608314037323, -0.004750361200422049, -0.06721068173646927, -0.09706666320562363, -0.008621521294116974, -0.004824679344892502, -0.039325542747974396, -0.031940847635269165, -2.4751352314288092e-33, 0.0038894047029316425, 0.00394653994590044, -0.021269138902425766, 0.06273912638425827, 0.014502525329589844, -0.005567081738263369, 0.0705614760518074, 0.04988560080528259, 0.025145724415779114, -0.02399318851530552, -0.050026971846818924, -0.05427009239792824, 0.03888638690114021, 0.0061419266276061535, 0.1273120492696762, 0.01070462167263031, -0.024696288630366325, 0.13535454869270325, -0.03123476542532444, 0.025472206994891167, -0.022316131740808487, -0.039185915142297745, 0.10801596939563751, 0.03664397820830345, -0.034820251166820526, 0.025556446984410286, 0.0023989425972104073, -0.01420302502810955, -0.12699465453624725, -0.07763991504907608, -0.04753123223781586, 0.013633275404572487, 0.042023513466119766, 0.10858955979347229, -0.02241991087794304, -0.032523803412914276, 0.020464712753891945, -0.004969106521457434, -0.050519607961177826, -0.002110563451424241, 0.07584930956363678, 0.058988213539123535, -0.05310964211821556, -0.056524816900491714, -0.047607697546482086, 0.04217010736465454, -0.11321807652711868, 0.02550048939883709, -0.010462676174938679, 0.06543504446744919, 0.025255762040615082, 0.034303054213523865, -0.021401362493634224, -0.020664939656853676, -0.022422999143600464, -0.023398522287607193, -0.07047931849956512, -0.11988479644060135, 0.022921044379472733, -0.0071184695698320866, -0.056748367846012115, -0.06030423939228058, 0.0038430928252637386, 0.012788639403879642, 0.05576835945248604, -0.03770023211836815, -0.03637618198990822, 0.014157014898955822, -0.03428683802485466, 0.03545919060707092, -0.026552509516477585, 0.07082904130220413, 0.00028528031543828547, 0.004537495318800211, -0.027315758168697357, 0.06218448281288147, -0.005762864835560322, -0.08185631781816483, -0.05321850627660751, 0.0055764601565897465, 0.024706818163394928, -0.0718088150024414, 0.054200753569602966, 0.13662061095237732, -0.016915535554289818, 0.08772753924131393, 0.06933464109897614, 0.04387780651450157, 0.04603387787938118, 0.07152792811393738, 0.05012913793325424, 0.02438703179359436, 0.03372114524245262, 0.08641410619020462, 0.0383334755897522, -4.494041760949585e-08, 0.0025338514242321253, 0.04447181522846222, 0.0028549148701131344, -0.015071770176291466, -0.044374000281095505, 0.04003065079450607, -0.01773253083229065, -0.007339194416999817, -0.01972513645887375, 0.02651113085448742, 0.048788201063871384, -0.05185404792428017, -0.09117189794778824, 0.012991135939955711, -0.015939950942993164, 0.040329210460186005, 0.03089018166065216, -0.02321556583046913, 0.017459500581026077, -0.0591646283864975, 0.047144919633865356, 0.023671887814998627, 0.03423560783267021, 0.15119348466396332, -0.008028993383049965, -0.028954090550541878, -0.12497347593307495, 0.014460109174251556, 0.06134631112217903, -0.009330535307526588, 0.030833441764116287, -0.054821163415908813, 0.003818754106760025, -0.025343015789985657, 0.013727241195738316, -0.026145491749048233, -0.034664086997509, 0.004413840360939503, -0.009587704204022884, 0.10298750549554825, -0.0733339712023735, 0.06368769705295563, -0.07043472677469254, -0.08332238346338272, 0.052591823041439056, -0.043702028691768646, -0.029906975105404854, -0.04513861611485481, 0.02201416715979576, 0.015997683629393578, -0.029488010331988335, 0.08505868166685104, 0.04837364703416824, -0.0571826733648777, -0.002008601790294051, 0.010369463823735714, -0.08147571235895157, 0.03258824348449707, 0.03288326412439346, -0.010276180692017078, -0.09469885379076004, 0.03547607734799385, -0.029059117659926414, 0.003715953789651394 ] }, { "text": "400000\n\nIn [5]:\n\nfor idx, (key, value) in enumerate(word_to_vec_map.items()):\nprint(\"word: \", key)\nprint(\"shape\", value.shape)\nif idx ==1:\nbreak\n\nword: the\nshape (50,)\nword: ,\nshape (50,)\n\nAs you can see above, there are 400000 words in the corpus and the shape of each word vector is 50.\n\n2 - Cosine Similarity¶\n\nWe will use cosine similiarity to measure the similarity between two words. Given two vectors $u$ and $v$, cosine similarity is defined as follows:\n\n$$\\text{CosineSimilarity(u, v)} = \\frac {u \\cdot v} {||u||_2 ||v||_2} = cos(\\theta) \\tag{1}$$\nThe norm of $u$ is defined as $ ||u||_2 = \\sqrt{\\sum_{i=1}^{n} u_i^2}$\n\nNote that L2 (Euclidean) distance also works.\n\nLet's see an example before applying it within a function:\n\nIn [6]:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_2", "embedding": [ 0.025571810081601143, -0.04132380709052086, -0.05855661630630493, -0.10892333835363388, 0.04111633822321892, 0.020470913499593735, -0.010854643769562244, 0.042195968329906464, -0.024123037233948708, -0.005304557271301746, 0.10474485903978348, 0.012138484045863152, 0.05419958755373955, -0.007351787760853767, -0.058651771396398544, 0.004507869947701693, 0.027363073080778122, -0.008465563878417015, -0.11569944769144058, -0.04575704410672188, 0.0931539312005043, 0.02697831019759178, 0.0391349270939827, 0.002348658163100481, 0.03361387178301811, 0.11646998673677444, 0.059219200164079666, -0.030524710193276405, -0.021551165729761124, 0.01984592154622078, 0.058076273649930954, 0.010142412967979908, 0.040554676204919815, 0.007297292817384005, -0.05947190150618553, -0.04090981185436249, 0.037967223674058914, -0.027618324384093285, 0.04863976314663887, -0.019969316199421883, -0.055000223219394684, 0.02962612174451351, -0.02533542923629284, 0.12196481227874756, 0.05490680783987045, 0.04817138984799385, -0.09666762501001358, 0.04662056267261505, 0.03765567019581795, -0.013800627551972866, -0.08984358608722687, 0.0332774817943573, -0.060255248099565506, -0.00901684071868658, -0.09138292074203491, -0.009590405970811844, -0.006263448391109705, 0.00657485518604517, 0.0714593306183815, -0.037802938371896744, 0.06352069228887558, -0.04232199862599373, 0.06401833146810532, 0.005047495011240244, -0.04634539410471916, -0.02311006560921669, 0.03494951128959656, -0.044727154076099396, -0.0722598135471344, 0.020471680909395218, 0.0078057521022856236, 0.08612079918384552, -0.07066567987203598, 0.011518455110490322, -0.05074112117290497, 0.024464838206768036, -0.02365909516811371, -0.05798421800136566, 0.012995734810829163, -0.07287953794002533, -0.038392480462789536, 0.028585875406861305, 0.11354236304759979, -0.03517932444810867, -0.003217608667910099, 0.00532979890704155, 0.03869760408997536, -0.029738008975982666, 0.02889936789870262, -0.010228562168776989, -0.03129439800977707, -0.09960762411355972, -0.030272427946329117, -0.028831705451011658, 0.034686457365751266, 0.004737270064651966, -0.00794382393360138, 0.09039949625730515, -0.002737909322604537, -0.006796947680413723, 0.050392333418130875, -0.03799387067556381, -0.045769259333610535, -0.054511893540620804, -0.007159348577260971, -0.015699336305260658, 0.10254324972629547, 0.005805567838251591, 0.1461348682641983, -0.06627173721790314, -0.007450512610375881, 0.04356299713253975, -0.048066794872283936, 0.06592896580696106, 0.032615937292575836, -0.015963170677423477, 0.07197154313325882, 0.008719106204807758, 0.09280894696712494, 0.0016427406808361411, -0.021991638466715813, -0.014319156296551228, -0.014558489434421062, 0.014704839326441288, -0.06032394617795944, -0.03038044646382332, -0.006713955197483301, 5.366840681534082e-33, -0.0537179671227932, 0.08964432030916214, -0.05123475193977356, 0.033361732959747314, -0.05395158752799034, -0.05529974400997162, -0.09131791442632675, -0.01796071045100689, 0.0017488530138507485, -0.01034910324960947, -0.10691624879837036, 0.10912086814641953, 0.014351101592183113, 0.04439276084303856, 0.026402626186609268, -0.008173513226211071, 0.03675130009651184, -0.0037073821295052767, -0.009727983735501766, -0.07370724529027939, -0.006359725259244442, -0.01698528230190277, 0.05049693584442139, 0.028372861444950104, -0.031295426189899445, -0.0592658668756485, -0.012788903899490833, -0.07018738985061646, -0.03636666759848595, -0.013992015272378922, -0.017300494015216827, -0.029126619920134544, 0.06098553165793419, 0.0184437595307827, 0.01074286550283432, -0.046623896807432175, 0.02273736521601677, -0.01597081497311592, -0.03350682556629181, -0.07381147891283035, -0.020643506199121475, 0.0332946851849556, 0.018237510696053505, -0.019198792055249214, 0.0032890508882701397, 0.014085243456065655, 0.020017046481370926, 0.011713080108165741, 0.015414867550134659, -0.06790877133607864, 0.05301045998930931, 0.01369236595928669, -0.07843359559774399, 0.09574151784181595, 0.02430691197514534, -0.03536595031619072, 0.010804287157952785, 0.009314415976405144, 0.061897750943899155, 0.0842939168214798, 0.033263787627220154, 0.03873049467802048, 0.17062264680862427, 0.016654122620821, 0.06204425171017647, -0.03507351130247116, -0.0969000905752182, 0.019269531592726707, 0.060417771339416504, 0.10056314617395401, 0.02012665569782257, -0.03352433070540428, -0.06535526365041733, -0.00015854564844630659, 0.009158575907349586, 0.009197056293487549, 0.07811785489320755, -0.1018841341137886, -0.029210388660430908, 0.02411646768450737, -0.10315274447202682, -0.016445936635136604, 0.032590530812740326, -0.15026365220546722, -0.10849854350090027, -0.0572679229080677, 0.01764548569917679, -0.11686396598815918, -0.02703286148607731, -0.003100543050095439, 0.0005458364030346274, 0.05614026263356209, 0.0012610346311703324, -0.017810432240366936, -0.013122502714395523, -6.554314789159187e-33, -0.11502344161272049, 0.011182349175214767, 0.007331088185310364, 0.009361685253679752, -0.045872773975133896, 0.0018128054216504097, 0.047977957874536514, 0.0645899698138237, -0.030600452795624733, -0.03490198403596878, 0.029375579208135605, -0.10004471242427826, 0.04213758185505867, 0.006648050621151924, 0.08519993722438812, 0.004652298055589199, 0.05330260097980499, 0.05937811732292175, 0.016043225303292274, 0.08332578837871552, 0.05519694834947586, -0.037690579891204834, -0.011786836199462414, 0.03405473381280899, -0.02104245498776436, 0.09081454575061798, -0.02237279899418354, -0.08370918780565262, -0.045482225716114044, -0.08652975410223007, -0.0017383504891768098, 0.01705048605799675, -0.002669431734830141, 0.056930139660835266, -0.07647233456373215, -0.030234690755605698, 0.02946462668478489, -0.056546516716480255, -0.015032274648547173, -0.021559109911322594, 0.0017371730646118522, 0.0479397214949131, -0.04883718118071556, -0.018638672307133675, -0.09310972690582275, -0.06267080456018448, -0.015372981317341328, -0.051080819219350815, -0.003238687990233302, 0.013581759296357632, 0.08959098905324936, 0.02680055983364582, -0.035178910940885544, 0.051067791879177094, -0.01255401223897934, -0.05129987746477127, -0.1424923539161682, 0.0036806375719606876, -0.030503669753670692, -0.02335435338318348, -0.01464019250124693, 0.022800087928771973, -0.002926367102190852, 0.09586334973573685, 0.12119445949792862, -0.02571936510503292, 0.04560185223817825, 0.047235582023859024, -0.026777660474181175, 0.06527012586593628, -0.006647433619946241, 0.024735374376177788, -0.04196725785732269, -0.015265415422618389, -0.04607505723834038, -0.023296335712075233, 0.03256501629948616, -0.09055798500776291, -0.09736094623804092, 0.0034227725118398666, 0.0020427010022103786, -0.006706255488097668, 0.023947453126311302, -0.0001820877514546737, -0.05255763977766037, 0.01461518369615078, -0.008220620453357697, 0.038443345576524734, 0.02281976491212845, 0.12298168987035751, 0.010168426670134068, -0.055397048592567444, -0.032719001173973083, -0.019203655421733856, 0.061094239354133606, -5.237058786633497e-08, -0.07596401870250702, -0.014730233699083328, -0.05532483011484146, -0.01408542599529028, -0.03789953887462616, -0.014077816158533096, -0.06847155839204788, 0.03908892720937729, -0.06962693482637405, -0.025158146396279335, -0.00810949970036745, -0.019445452839136124, -0.08998607844114304, 0.05744199454784393, -0.032151900231838226, -0.012344933114945889, -0.022559400647878647, 0.002126627368852496, 0.10494497418403625, 0.0028216068167239428, 0.008388722315430641, -0.01436803862452507, -0.014484135434031487, 0.05776291713118553, -0.05461699888110161, 0.024222481995821, -0.004931141156703234, 0.053226493299007416, 0.04430070146918297, -0.03501204773783684, -0.0027423345018178225, -0.008656899444758892, 0.01122375763952732, -0.051487166434526443, 0.010417482815682888, -0.037579335272312164, -0.05828195810317993, 0.011545832268893719, -0.05580366775393486, 0.08490560948848724, 0.022168630734086037, 0.07177388668060303, 0.004347723443061113, -0.0021188913378864527, 0.12485317885875702, 0.01052054949104786, 0.10433993488550186, 0.013890363276004791, 0.017392074689269066, -0.0685843974351883, 0.016869764775037766, 0.019862346351146698, 0.0016557256458327174, 0.007335762958973646, -0.006161047611385584, -0.05166631564497948, -0.04652727022767067, 0.05582951754331589, 0.056714918464422226, -0.05265115574002266, -0.0026897445786744356, 0.021238090470433235, -0.026774130761623383, -0.04540174454450607 ] }, { "text": "Note that L2 (Euclidean) distance also works.\n\nLet's see an example before applying it within a function:\n\nIn [6]:\n\n# dot product\nu_v = np.dot(word_to_vec_map[\"city\"], word_to_vec_map[\"town\"])\nprint(u_v)\n\n# norm of 2 words:\nnorm_u = np.sqrt(np.sum(np.square(word_to_vec_map[\"city\"])))\nnorm_v = np.sqrt(np.sum(np.square(word_to_vec_map[\"town\"])))\n\n# simple version of norm:\nnorm_u = np.sqrt(np.dot(word_to_vec_map[\"city\"], word_to_vec_map[\"city\"]))\nnorm_v = np.sqrt(np.dot(word_to_vec_map[\"town\"], word_to_vec_map[\"town\"]))\nprint(norm_u)\nprint(norm_v)\n\n# cosine similarity:\nu_v/(norm_u * norm_v)\n\n27.940339194829\n5.683819631019707\n5.658190970652017\n\nOut[6]:\n\n0.868787942931717\n\nIn [7]:\n\ndef cosine_similarity(u, v):\n\"\"\"\nCosine similarity reflects the degree of similarity between u and v", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_3", "embedding": [ 0.06309903413057327, -0.07860181480646133, -0.04101744666695595, -0.08484455943107605, 0.039091188460588455, -0.013393901288509369, -0.03449118137359619, 0.006350784096866846, -0.10846363753080368, -0.005584548227488995, 0.09553585201501846, 0.002158921444788575, 0.03718206286430359, 0.043525632470846176, -0.056167952716350555, 0.07785383611917496, 0.038823261857032776, 0.0246442798525095, -0.017396586015820503, -0.058673106133937836, 0.06676547229290009, 0.08222342282533646, 0.004946818575263023, 0.02571406029164791, 0.09648134559392929, 0.04825284704566002, 0.050942279398441315, 0.029625453054904938, -0.051079537719488144, 0.05159424990415573, 0.06990248709917068, 0.006275334861129522, 0.0692826509475708, -0.002483281772583723, -0.016548413783311844, -0.009584947489202023, 0.0002570372016634792, -0.022647254168987274, 0.010831848718225956, 0.02162197045981884, -0.028699958696961403, -0.02506835386157036, -0.021039221435785294, 0.034037791192531586, 0.043276216834783554, 0.04847801849246025, -0.027374107390642166, 0.04260842874646187, 0.033565789461135864, -0.04387582838535309, -0.03342752903699875, -0.023318404331803322, -0.09109824895858765, -0.020119061693549156, -0.1273127943277359, 0.019491247832775116, 0.01661386340856552, 0.021632196381688118, 0.026097839698195457, -0.08012154698371887, 0.0536700002849102, -0.033989232033491135, 0.02031642198562622, -0.006089954171329737, -0.031173547729849815, -0.021045103669166565, 0.005835568532347679, 0.003586242673918605, -0.06334024667739868, 0.03234698250889778, 0.02443113550543785, 0.0414360910654068, -0.04314799606800079, -0.018737580627202988, -0.03457405045628548, -0.010984547436237335, 0.01964201219379902, -0.04357137531042099, 0.036320023238658905, -0.05178089067339897, -0.032330188900232315, -0.00369638972915709, 0.055092163383960724, 0.005680673755705357, -0.03329991176724434, -0.010588658973574638, 0.05053600296378136, -0.008717642165720463, 0.09765051305294037, -0.08251182734966278, -0.0032717676367610693, -0.12105338275432587, -0.03299213945865631, -0.044288430362939835, -0.05459125339984894, -0.03923219442367554, -0.014796959236264229, 0.025182683020830154, -0.03385035693645477, 0.017443928867578506, 0.04473542794585228, -0.06172315031290054, -0.050022609531879425, -0.11630252003669739, 0.05703112483024597, 0.06683172285556793, 0.07846245169639587, 0.003012501634657383, 0.09075924009084702, 0.0001537645293865353, 0.011377756483852863, -0.009875411167740822, -0.031785786151885986, 0.07557272166013718, 0.013501989655196667, 0.025120221078395844, 0.06760890036821365, 0.013437499292194843, 0.09465768188238144, 0.02094484120607376, -0.01885305531322956, 0.013197029940783978, 0.03573160246014595, -0.014758286066353321, -0.05193997919559479, -0.018800564110279083, 0.023159222677350044, 1.2176225071523236e-33, -0.09112253040075302, 0.07570427656173706, 0.02735051140189171, 0.06538420915603638, -0.0054685575887560844, -0.017437098547816277, -0.06297702342271805, -0.06584503501653671, 0.022382304072380066, -0.0206968504935503, -0.07366055995225906, 0.05602388083934784, -0.010261333547532558, -0.015717798843979836, 0.03878123313188553, 0.013446418568491936, 0.05304762348532677, -0.015509864315390587, 0.018487077206373215, -0.004865052178502083, 0.006868739612400532, -0.015612849965691566, -0.02638591080904007, 0.018066177144646645, -0.07556244730949402, -0.10546129196882248, -0.03334354981780052, -0.06169457733631134, -0.0005528776091523468, -0.010989551432430744, -0.05944390594959259, 0.04752441123127937, 0.06012650951743126, 0.04372280463576317, 0.026764435693621635, -0.009308547712862492, 0.009360103867948055, -0.046270355582237244, -0.012029186822474003, -0.10415875166654587, -0.03834261745214462, 0.023558946326375008, -0.003892893437296152, -0.04453317075967789, 0.026616470888257027, 0.045693859457969666, -0.0018583331257104874, 0.05292301997542381, -0.0026945776771754026, -0.029472624883055687, 0.05026279389858246, -0.04476340860128403, -0.04526827111840248, 0.13173465430736542, 0.015601780265569687, -0.06143513321876526, 0.01376265287399292, -0.0028322951402515173, 0.10270779579877853, 0.0462016761302948, 0.04357186704874039, 0.016539817675948143, 0.12425578385591507, 0.007737128995358944, 0.04153691232204437, -0.038135357201099396, -0.007133629638701677, 0.06055331975221634, 0.05998194217681885, 0.07208331674337387, 0.0072508011944592, -0.01838565059006214, -0.0450025349855423, 0.018814463168382645, 0.032372407615184784, -0.016522184014320374, 0.01635291986167431, -0.13079266250133514, -0.03703207150101662, -0.03255978971719742, -0.07075359672307968, -0.010153587907552719, -0.03007325902581215, -0.13336387276649475, -0.08918949216604233, -0.09839779138565063, -0.003026525489985943, -0.10938861221075058, -0.02996227703988552, -0.03627748787403107, -0.058932166546583176, 0.042741525918245316, -0.017670320346951485, -0.0020073154009878635, -0.018252920359373093, -2.3336409764203305e-33, -0.12369190156459808, -0.027324624359607697, 0.029206331819295883, 0.015935728326439857, -0.055325284600257874, -0.04188636690378189, 0.04360272362828255, -0.016659000888466835, 0.026578389108181, -0.0018299968214705586, -0.052515704184770584, -0.12197759002447128, 0.08489271253347397, 0.006152733229100704, 0.14416837692260742, 0.031823936849832535, 0.09532348811626434, 0.0490831658244133, 0.017505567520856857, 0.07609107345342636, 0.029694300144910812, -0.06269221007823944, -0.01731047034263611, -0.012777119874954224, -0.03172299265861511, 0.04817500710487366, -0.03301607817411423, -0.0653647854924202, -0.07117383927106857, -0.085952527821064, -0.034950386732816696, 0.051575176417827606, 0.0038130865432322025, 0.009725707583129406, -0.055269770324230194, 0.009379974566400051, 0.0247312281280756, -0.0493851974606514, -0.015552889555692673, -0.08042486757040024, 0.015604640357196331, 0.028435464948415756, -0.01823270320892334, -0.022393841296434402, -0.05005091428756714, 0.021183134987950325, 0.02875705249607563, -0.09007333219051361, 0.007789254188537598, 0.00021850180928595364, 0.053089652210474014, 0.033603485673666, -0.039837390184402466, 0.07245523482561111, -0.037418823689222336, 0.010361096821725368, -0.12881053984165192, 0.016763336956501007, -0.03055216744542122, -0.061110638082027435, -0.010967666283249855, -0.0508645735681057, -0.059495363384485245, 0.09290964901447296, 0.0704091414809227, -0.001391900354065001, 0.03051704540848732, 0.049450650811195374, 0.044649120420217514, 0.029829321429133415, -0.0019831915851682425, 0.11473310738801956, 0.01747416891157627, 0.0061876061372458935, -0.06368567049503326, 0.014289417304098606, 0.05354393273591995, -0.08980776369571686, -0.10544600337743759, 0.000507441523950547, 0.028592219576239586, -0.009680519811809063, 0.07019789516925812, 0.04078654944896698, -0.02953512966632843, -0.01399178709834814, 0.030410021543502808, 0.05641879513859749, 0.043510664254426956, 0.07182697206735611, 0.0018461676081642509, 0.000571362441405654, -0.034766651690006256, -0.023608647286891937, 0.054348837584257126, -3.857628527725865e-08, -0.06333596259355545, 0.003074590815231204, -0.008564095012843609, -0.01407015323638916, -0.018931403756141663, -0.028115112334489822, 0.009282208979129791, 0.042012445628643036, -0.052749693393707275, 0.024561116471886635, -0.03528231754899025, 0.03632773086428642, -0.06515321135520935, 0.033338677138090134, -0.04164329916238785, 0.0765233263373375, 0.029870765283703804, -0.015721634030342102, 0.06371953338384628, 0.05563962832093239, -0.016856728121638298, 0.007374204695224762, 2.2977395929046907e-05, 0.10077822208404541, -0.08778191357851028, -0.005725732538849115, -0.03541494160890579, 0.02237885445356369, 0.12013735622167587, -0.023350488394498825, 0.043012190610170364, -0.01508674118667841, 0.019381318241357803, -0.006086386274546385, -0.02590150013566017, -0.08314172178506851, -0.043588027358055115, 0.02493915520608425, -0.02852475829422474, 0.12412092834711075, -0.04175207018852234, 0.07725943624973297, -0.010343613103032112, -0.006508626975119114, 0.1214587464928627, 0.018598997965455055, 0.08938191831111908, -0.0453573502600193, 0.0012762675760313869, -0.05765080824494362, 0.028302019461989403, 0.043175358325242996, 0.0015506139025092125, -0.015429175458848476, 0.053902529180049896, -0.09042630344629288, -0.08142733573913574, 0.055404722690582275, 0.008745856583118439, -0.05383134260773659, -0.07587198913097382, 0.05550031363964081, 0.03453867509961128, -0.03125135600566864 ] }, { "text": "Out[6]:\n\n0.868787942931717\n\nIn [7]:\n\ndef cosine_similarity(u, v):\n\"\"\"\nCosine similarity reflects the degree of similarity between u and v\n\nArguments:\nu -- a word vector of shape (n,)\nv -- a word vector of shape (n,)\n\nReturns:\ncosine_similarity -- the cosine similarity between u and v defined by the formula above.\n\"\"\"\n\n# Special case. Consider the case u = [0, 0], v=[0, 0]\nif np.all(u == v):\nreturn 1\n\ndot = np.dot(u,v)\nnorm_u = np.sqrt(np.sum(np.square(u)))\nnorm_v = np.sqrt(np.sum(np.square(v)))\n# avoid division by zero error\nif np.isclose(norm_u * norm_v, 0, atol=1e-32):\nreturn 0\n# Compute the cosine similarity defined by formula (1) (≈1 line)\ncosine_similarity = dot / (norm_u * norm_v)\n\nreturn cosine_similarity\n\nBelow you may find examples of words and their cosine similarity:\n\nIn [8]:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_4", "embedding": [ 0.006373137701302767, -0.021735215559601784, -0.09922657907009125, -0.03921927511692047, 0.005925345700234175, -0.036518096923828125, -0.016329137608408928, 0.01031162217259407, -0.061617299914360046, -0.0322648324072361, 0.039017580449581146, -0.010895405896008015, 0.03619860112667084, 0.0529465526342392, -0.06983988732099533, -0.03334549441933632, -0.0010368882212787867, -0.03591197356581688, -0.017265785485506058, -0.02364865504205227, 0.05313434079289436, 0.057718709111213684, 0.005449185613542795, 0.028525378555059433, 0.059692736715078354, 0.03990790247917175, 0.0734175518155098, 0.017806854099035263, -0.02374854125082493, 0.04467657208442688, 0.06387778371572495, 0.005653797183185816, 0.042209599167108536, -0.015853779390454292, -0.05133946239948273, -0.023154674097895622, 0.021936478093266487, -0.04545717313885689, 0.020614150911569595, 0.044995952397584915, -0.03816051036119461, 0.02342941425740719, -0.014586472883820534, 0.10793323814868927, 0.05125358700752258, 0.05727126821875572, -0.09316709637641907, 0.021503565832972527, 0.054050035774707794, -0.007777022663503885, -0.00981192383915186, -0.007363907061517239, -0.057331640273332596, -0.04389836639165878, -0.031649261713027954, -0.0006138514145277441, 0.043316490948200226, -0.02123282477259636, 0.06659508496522903, -0.09729423373937607, 0.07441040873527527, -0.050412487238645554, 0.074344702064991, -0.011010539717972279, -0.018416108563542366, -0.006497036200016737, 0.04500293359160423, -0.03580302372574806, -0.06871460378170013, -0.0126411784440279, -0.01292107068002224, 0.07118868082761765, -0.042956095188856125, 0.02850710041821003, -0.07318693399429321, 0.03421948477625847, -0.009812125004827976, -0.012464790605008602, 0.025204306468367577, -0.011285096406936646, -0.00494788633659482, -0.02855605259537697, 0.04926309734582901, -0.04273946210741997, 0.006363925989717245, 0.02588811330497265, 0.034849487245082855, -0.01919579692184925, 0.10445590317249298, -0.027118191123008728, -0.061225686222314835, -0.06684467941522598, -0.02542600966989994, -0.06575089693069458, -0.019189491868019104, -0.0038552337791770697, -0.03250490874052048, 0.05918988212943077, -0.06794259697198868, -0.016555767506361008, 0.04615713283419609, -0.050975389778614044, -0.06661397218704224, -0.036504603922367096, 0.04685390740633011, 0.12144921720027924, 0.1288835108280182, 0.05064435675740242, 0.13584791123867035, -0.018338242545723915, -0.04624282196164131, 0.02747599594295025, -0.030725302174687386, 0.05332459881901741, 0.06978212296962738, 0.035112734884023666, 0.04128338024020195, 0.01051381416618824, 0.05204182490706444, 0.034036699682474136, 0.011458170600235462, 0.021172216162085533, -0.01116423774510622, 0.03655598312616348, -0.045822154730558395, -0.05425376072525978, 0.0158233642578125, 4.299432301585935e-33, -0.09144452214241028, 0.1372353434562683, 0.03876227140426636, -0.015393486246466637, -0.03366014361381531, -0.03173266351222992, -0.0766054317355156, -0.03758664429187775, -0.01965261623263359, -0.04563148692250252, -0.0969066321849823, 0.08680814504623413, -0.01317120436578989, -0.022999735549092293, -0.004892588593065739, 0.026329820975661278, 0.052363865077495575, -0.06768665462732315, -0.013707645237445831, -0.09232352674007416, 0.021634435281157494, -0.03630359470844269, -0.004484936129301786, 0.04662194103002548, -0.047490254044532776, -0.1057688295841217, -0.03631572425365448, -0.056819092482328415, -0.013954021967947483, -0.02724839560687542, -0.025335973128676414, -0.017368679866194725, 0.020315969362854958, 0.017766747623682022, 0.024620072916150093, -0.05319869518280029, 0.031198007985949516, -0.005556694231927395, -0.021049562841653824, -0.055864304304122925, -0.007262563332915306, 0.06531794369220734, 0.04348471760749817, -0.057176630944013596, 0.02158413454890251, 0.01950153335928917, -0.019838247448205948, 0.05423618480563164, 0.019334949553012848, -0.008703241124749184, -0.011180166155099869, 0.01832115463912487, -0.02951931208372116, 0.09023833274841309, -0.03550606966018677, -0.051784347742795944, 0.02386445552110672, 0.037660498172044754, 0.07377130538225174, -0.02090219408273697, 0.10199565440416336, -0.00971589982509613, 0.07473059743642807, -0.032434962689876556, -0.0008418518700636923, 0.003006103914231062, -0.04520582780241966, 0.02341402694582939, 0.03459860011935234, 0.07211682945489883, 0.015833545476198196, -0.0013446431839838624, -0.0951494574546814, -0.004537386819720268, 0.02568220905959606, -0.06095467507839203, 0.03194402530789375, -0.08178837597370148, -0.06121223792433739, -0.022163722664117813, -0.09675416350364685, 0.012773402966558933, -0.02697797305881977, -0.17566002905368805, -0.1360962837934494, -0.04484959691762924, 0.04925817251205444, -0.0942549780011177, -0.06528434157371521, -0.05964711681008339, 0.007358952425420284, 0.030981238931417465, 0.034117452800273895, 0.041912712156772614, -0.021131064742803574, -5.6774650637388716e-33, -0.12081412971019745, 0.002278129803016782, 0.044549208134412766, -0.019866464659571648, -0.06517745554447174, 0.0142251281067729, 0.06640911102294922, -0.02411307767033577, -0.03644536808133125, -0.06616488844156265, 0.0009561259648762643, -0.09249790012836456, 0.011194910854101181, 0.028332224115729332, 0.1114167645573616, 0.08083910495042801, 0.016881082206964493, 0.07562431693077087, 0.0261687021702528, 0.07176264375448227, 0.050552848726511, -0.024162407964468002, -0.03252574801445007, -0.043103624135255814, -0.02364085428416729, 0.06188071519136429, -0.003385329619050026, -0.09688038378953934, -0.0056604440324008465, -0.0691111609339714, -0.030142616480588913, 0.08599261194467545, -0.0013745030155405402, 0.05998247116804123, -0.06456601619720459, 0.02432427927851677, 0.04314412921667099, -0.054453544318675995, 0.023387402296066284, -0.12087110430002213, -0.009655827656388283, -0.009401530027389526, -0.04286382719874382, -0.05373453348875046, -0.05398678034543991, 0.0022405649069696665, 0.008933703415095806, -0.01627589948475361, 0.03488510102033615, 0.0523979477584362, 0.04049276188015938, 0.041265711188316345, -0.042119190096855164, 0.07552605867385864, -0.023895803838968277, 0.024607466533780098, -0.11328187584877014, 0.0396774597465992, -0.029945259913802147, -0.05047615244984627, 0.00247788755223155, 0.012868053279817104, -0.02104601077735424, 0.05345100909471512, 0.06599506735801697, 0.013319483958184719, -0.002151080872863531, 0.06750480085611343, 0.054082900285720825, 0.044130317866802216, -0.026625394821166992, 0.09765150398015976, -0.027485134080052376, -0.0611167773604393, -0.02793261967599392, -0.010591338388621807, 0.03539483994245529, -0.09949613362550735, -0.15550023317337036, 0.0015713541069999337, 0.024280156940221786, 0.01493103988468647, 0.055566128343343735, 0.03962742164731026, -0.058931879699230194, 0.008353522047400475, 0.049954596906900406, 0.026984769850969315, 0.01080444548279047, 0.10267876088619232, -0.018631603568792343, -0.021647464483976364, 0.014103581197559834, -0.06489156931638718, 0.04778033122420311, -4.4625149797639097e-08, -0.023151477798819542, -0.030417904257774353, -0.027034493163228035, -0.03421320766210556, 0.018160847947001457, 0.0005944424774497747, -0.024117082357406616, -0.06563980877399445, -0.049901921302080154, -0.028250372037291527, -0.05852198600769043, -0.008810088038444519, -0.042090628296136856, 0.06353656947612762, -0.04872133955359459, 0.02513372339308262, -0.019132554531097412, -0.025833886116743088, 0.08101275563240051, 0.0249116700142622, -0.021754641085863113, -0.029713217169046402, -0.039251092821359634, 0.08837150037288666, -0.06255283206701279, 0.054940029978752136, -0.033449333161115646, 0.028676308691501617, 0.09074561297893524, 0.003567946143448353, 0.006813463289290667, -0.015597506426274776, 0.025250693783164024, -0.033094048500061035, -0.01442035287618637, -0.02874300628900528, 0.0064287069253623486, 0.07700702548027039, -0.03466631844639778, 0.10463852435350418, -0.021447157487273216, 0.05155833065509796, 0.01683769002556801, -0.002854822902008891, 0.13060413300991058, 0.03594008460640907, 0.10831974446773529, -0.0481121726334095, 0.02216687798500061, -0.036866504698991776, 0.027110185474157333, 0.011424873024225235, -0.06723137199878693, 0.02891838364303112, 0.009782930836081505, -0.09594037383794785, -0.09407584369182587, 0.04014197736978531, 0.04458213597536087, -0.05530475825071335, 0.006354742683470249, 0.011756421998143196, 0.03896421194076538, -0.03175145387649536 ] }, { "text": "return cosine_similarity\n\nBelow you may find examples of words and their cosine similarity:\n\nIn [8]:\n\nfather = word_to_vec_map[\"father\"]\nmother = word_to_vec_map[\"mother\"]\nball = word_to_vec_map[\"ball\"]\ncrocodile = word_to_vec_map[\"crocodile\"]\nfrance = word_to_vec_map[\"france\"]\nitaly = word_to_vec_map[\"italy\"]\nparis = word_to_vec_map[\"paris\"]\nrome = word_to_vec_map[\"rome\"]\n\nprint(\"cosine_similarity(father, mother) = \", cosine_similarity(father, mother))\nprint(\"cosine_similarity(ball, crocodile) = \",cosine_similarity(ball, crocodile))\nprint(\"cosine_similarity(france - paris, rome - italy) = \",cosine_similarity(france - paris, rome - italy))", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_5", "embedding": [ 0.04341861978173256, 0.028215929865837097, -0.02361619658768177, -0.05691533535718918, -0.04141683876514435, -0.02406531572341919, -0.011908208020031452, 0.034860074520111084, -0.08268384635448456, -0.004656472243368626, 0.12217182666063309, -0.10008138418197632, 0.033016402274370193, 0.031441546976566315, -0.03786315768957138, -0.048944711685180664, 0.01606394350528717, 0.03595545142889023, -0.0487215518951416, -0.10587378591299057, 0.0517292357981205, 0.009106077253818512, 0.04504922032356262, 0.0428110808134079, -0.014394572004675865, 0.08596892654895782, -0.028059249743819237, 0.048066042363643646, -0.07760158181190491, 0.017059532925486565, 0.019903594627976418, 0.02436911314725876, -0.0019112449372187257, 0.04481298103928566, 0.016455402597784996, 0.021067310124635696, -0.018220117315649986, -0.06741774827241898, 0.09631448239088058, 0.04821156710386276, -0.07018714398145676, -0.04259440675377846, -0.015660813078284264, 0.10165634751319885, 0.03648444637656212, 0.06999121606349945, -0.07813863456249237, 0.06731215864419937, 0.042642220854759216, -0.03421793505549431, -0.0669330507516861, 0.021961746737360954, -0.08498997241258621, -0.03671332448720932, -0.027984093874692917, 0.045584358274936676, 0.07712997496128082, -0.021728405728936195, 0.056196004152297974, -0.09534663707017899, -0.01374167948961258, -0.0645333006978035, 0.026257134974002838, 0.037261608988046646, -0.025575770065188408, -0.013849512673914433, 0.004805883392691612, 0.015408501960337162, 0.006462656892836094, 0.02971012145280838, 0.012055917643010616, 0.08226509392261505, -0.05974641442298889, 0.010956459678709507, -0.055371299386024475, 0.08264052122831345, -0.06312353163957596, -0.06629291921854019, -0.002265163464471698, -0.05895133316516876, -0.03652181476354599, 0.018902774900197983, 0.07914458960294724, 0.03022424317896366, 0.025649400427937508, -0.03009316883981228, 0.05719858035445213, -0.06284024566411972, 0.04737876355648041, -0.014264109544456005, -0.03479714319109917, -0.10670428723096848, 0.05193587765097618, -0.04233184829354286, 0.010738316923379898, 0.00023200397845357656, -0.03897779807448387, 0.013747488148510456, -0.0814705416560173, -0.040196310728788376, 0.013564282096922398, 0.0006053752149455249, 0.051869284361600876, -0.03165215998888016, -0.007764071691781282, 0.01255162712186575, 0.044812969863414764, -0.034495964646339417, 0.10196661204099655, -0.02830575592815876, -0.08208289742469788, -0.04285683482885361, -0.009616749361157417, 0.04035275802016258, -0.009125838987529278, 0.033228062093257904, 0.026508687064051628, -0.012802733108401299, 0.04555270075798035, 0.024579908698797226, 0.013163857161998749, -0.014423396438360214, -0.022215645760297775, -0.008565991185605526, -0.09830166399478912, -0.046593498438596725, 0.014466759748756886, -1.1919377259981162e-34, -0.0979359894990921, 0.06776813417673111, 0.04468559846282005, 0.04695345088839531, -0.03092104010283947, -0.06410541385412216, -0.05139359459280968, 0.01167066115885973, -0.04719573259353638, -0.039161767810583115, -0.12212312966585159, 0.07902167737483978, -0.009862654842436314, 0.03164634853601456, -0.035235702991485596, 0.024582941085100174, 0.01661650463938713, -0.027010278776288033, -0.03016914241015911, -0.008924351073801517, 0.03332112357020378, 0.0838041678071022, 0.04607086256146431, 0.001821590936742723, 0.0022401129826903343, -0.05000925809144974, -0.031735870987176895, -0.02892567403614521, 8.18185944808647e-05, -0.03538350388407707, -0.004767888691276312, 0.013392658904194832, 0.05994125083088875, -0.006023241672664881, 0.06801066547632217, -0.02101363241672516, 0.02101227082312107, -0.07850239425897598, -0.04458565637469292, 0.0031251697801053524, -0.08572854846715927, -0.04973239451646805, 0.01326944213360548, 0.015156061388552189, 0.07040204852819443, -0.05254283919930458, -0.06409738957881927, 8.879604865796864e-05, 0.03737754002213478, 0.023325927555561066, 0.07428768277168274, -0.021247927099466324, -0.051790542900562286, 0.08543479442596436, -0.0377870537340641, 0.02383015863597393, 0.010797137394547462, 0.037652499973773956, 0.020895209163427353, 0.040627021342515945, 0.10253308713436127, -0.0017960129771381617, 0.11003818362951279, 0.033831607550382614, 0.07322022318840027, 0.013967488892376423, -0.026807527989149094, 0.07346782833337784, 0.014576188288629055, 0.06341111660003662, -0.010908679105341434, -0.025319084525108337, -0.03929487243294716, 0.0060424827970564365, -0.0002882081607822329, 0.0800667256116867, 0.005929374136030674, -0.11447104811668396, -0.11131875962018967, -0.060873545706272125, -0.07654446363449097, -0.02644290030002594, 0.014209989458322525, -0.10081876069307327, -0.10324768722057343, -0.07383143156766891, 0.06353151798248291, -0.08270096778869629, 0.022005874663591385, -0.033018890768289566, -0.04392973333597183, 0.04444534331560135, 0.0005835668998770416, -0.04833243414759636, -0.015968743711709976, -1.9041658501527535e-33, -0.10064291954040527, -0.03913213685154915, 0.0406704805791378, -0.049403879791498184, -0.04081862047314644, -0.03319556266069412, 0.07629987597465515, -0.032677583396434784, 0.01921045035123825, -0.031948022544384, -0.07901684194803238, -0.06964661180973053, 0.06733736395835876, -0.07956250756978989, 0.09218606352806091, 0.06368886679410934, 0.02485968917608261, 0.10489897429943085, 0.02814810909330845, 0.09524515271186829, 0.031166329979896545, -0.05252201110124588, -0.07245157659053802, -0.04272329807281494, -0.034357700496912, 0.05147285759449005, -0.015380896627902985, -0.09873384982347488, 0.012455473653972149, -0.04895412176847458, -0.019886953756213188, 0.021731095388531685, 0.04439077526330948, 0.05766644701361656, -0.04834536835551262, 0.020033065229654312, 0.02741648256778717, 0.0010520172072574496, -0.016584942117333412, -0.07588076591491699, -0.002382110571488738, 0.05162765085697174, 0.018992066383361816, 0.012860223650932312, 0.025228459388017654, 0.014031767845153809, -0.06615151464939117, -0.013368950225412846, 0.01945243589580059, 0.07692420482635498, 0.08002156764268875, 0.021748986095190048, -0.07991012185811996, 0.016879195347428322, 0.04774569347500801, 0.012828909792006016, -0.04320118576288223, -0.03583602234721184, -0.09926935285329819, -0.03199802339076996, 0.020580830052495003, -0.0046837059780955315, -0.040757838636636734, 0.09022021293640137, 0.03723717853426933, -0.02780914306640625, -0.0747038796544075, 0.026489311829209328, -0.01489727757871151, 0.004942949861288071, -0.02080097422003746, 0.05659188702702522, -0.047040894627571106, -0.03402586281299591, -0.04354173317551613, 0.07994161546230316, -0.01946643367409706, -0.01563483104109764, -0.06518419831991196, 0.01753135398030281, -0.023080551996827126, -0.05540807917714119, 0.04334801807999611, 0.08754684031009674, -0.04902862384915352, -0.00844108872115612, 0.024175960570573807, -0.013716368936002254, 0.08651509135961533, 0.048922859132289886, 0.028764253482222557, -0.03370266035199165, 0.02945944108068943, 0.0008060775580815971, 0.07969851046800613, -3.650530189247547e-08, 0.05212836340069771, -0.03358026593923569, 0.01830458454787731, 0.034480612725019455, -0.028379099443554878, -0.059416964650154114, 0.006327154580503702, -0.08416054397821426, -0.06896898150444031, 0.0020755156874656677, -0.03130186349153519, 0.04988684877753258, -0.02400381490588188, -0.015203194692730904, 0.0037456711288541555, 0.022731879726052284, -0.016772661358118057, -0.0036138631403446198, 0.08681465685367584, 0.03937368094921112, -0.04625200852751732, -0.002032502321526408, -0.014136118814349174, 0.09963881969451904, -0.05126902088522911, -0.03041406348347664, -0.01149645447731018, 0.029698427766561508, -0.0004965449334122241, -0.04929801821708679, 0.09362848103046417, -0.03990279883146286, 0.04578671604394913, -0.079012431204319, -0.008695071563124657, -0.05621284246444702, -0.034748878329992294, 0.02062721736729145, -0.02354835905134678, 0.07838563621044159, 0.05773007869720459, 0.013066605664789677, -0.022374525666236877, 0.006560873240232468, 0.17945358157157898, 0.026279842481017113, 0.11179700493812561, -0.03523433953523636, 0.0696316584944725, -0.01593208499252796, -0.04139149188995361, 0.05437474325299263, -0.01578540913760662, -0.06448250263929367, 0.014860911294817924, -0.03355927765369415, -0.012210001237690449, 0.08074109256267548, 0.05312104895710945, 0.0061154416762292385, -0.006879141554236412, 0.031870100647211075, 0.11207972466945648, -0.040172409266233444 ] }, { "text": "cosine_similarity(father, mother) = 0.8909038442893615\ncosine_similarity(ball, crocodile) = 0.2743924626137942\ncosine_similarity(france - paris, rome - italy) = -0.6751479308174201\n\nThe cosine similarity from man - actor, woman - actress is around ~90% while the opposite is around ~50%. It makes sense.\n\nIn [9]:\n\nprint(cosine_similarity(word_to_vec_map[\"man\"] - word_to_vec_map[\"actor\"],\nword_to_vec_map[\"woman\"]-word_to_vec_map[\"actress\"]))\nprint(cosine_similarity(word_to_vec_map[\"man\"] - word_to_vec_map[\"actress\"],\nword_to_vec_map[\"woman\"]-word_to_vec_map[\"actor\"]))\n\n0.9146492195406316\n0.5060072094699283\n\nLet's check another job:\n\nIn [10]:\n\nprint(cosine_similarity(word_to_vec_map[\"man\"] - word_to_vec_map[\"engineer\"],\nword_to_vec_map[\"woman\"]-word_to_vec_map[\"nurse\"]))", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_6", "embedding": [ 0.033007681369781494, -0.00031733367359265685, -0.04000945761799812, -0.06779522448778152, -0.040368493646383286, -0.004859340377151966, -0.019683104008436203, 0.04450404271483421, -0.04274720326066017, -0.00873134657740593, 0.14524944126605988, -0.11524149030447006, -0.005215152632445097, 0.05309666693210602, -0.03255344182252884, -0.061958491802215576, 0.023051708936691284, 0.013591802679002285, -0.04302956163883209, -0.02140413410961628, 0.014927534386515617, -0.01886741630733013, 0.023811087012290955, -0.00893314927816391, 0.025286659598350525, 0.02581760473549366, 0.0033557401038706303, 0.04450003802776337, -0.09325243532657623, 0.025970185175538063, 0.036241255700588226, 0.07532241195440292, 0.009799385443329811, 0.008767436258494854, -0.05072372406721115, 0.018322106450796127, -0.022784220054745674, -0.049195725470781326, 0.0951153039932251, 0.02526259608566761, -0.02709513157606125, -0.017298175022006035, -0.02140802890062332, 0.06101998686790466, 0.024864181876182556, 0.07340079545974731, -0.08322922140359879, 0.050134219229221344, 0.002482025185599923, 0.00903019867837429, -0.07579228281974792, 0.05193226784467697, -0.10647888481616974, -0.017754485830664635, -0.046251170337200165, 0.024106984958052635, 0.03850633278489113, -0.024562979117035866, 0.03883436694741249, -0.05392204225063324, -0.009033075533807278, -0.044533345848321915, 0.026658806949853897, 0.016869978979229927, 0.014459008350968361, -0.06505095213651657, -0.013126088306307793, -0.03390992432832718, -0.01920250989496708, 0.05777941644191742, 0.02773922123014927, 0.07917313277721405, -0.0555526502430439, -0.01648428663611412, -0.03904326632618904, 0.04356619715690613, -0.031137777492403984, -0.07035598158836365, 0.030839338898658752, -0.07371066510677338, 0.0073013510555028915, -0.026991281658411026, 0.06474008411169052, 0.05319840461015701, -0.0010426699882373214, 0.009615568444132805, 0.05042940005660057, -0.10193482041358948, 0.027088461443781853, 0.02605299837887287, -0.07677777111530304, -0.08700975775718689, 0.04111696034669876, 0.006292608566582203, 0.013731521554291248, 0.023138830438256264, -0.06483696401119232, 0.0930890291929245, -0.07918931543827057, -0.009115975350141525, 0.02061825431883335, -0.01128778699785471, 0.0033761439844965935, -0.013931963592767715, -0.011980983428657055, 0.013463499955832958, 0.07393378764390945, 0.006290204357355833, 0.06017667427659035, -0.05380634590983391, -0.048421166837215424, -0.031103210523724556, -0.010629766620695591, 0.03301296383142471, 0.00266313087195158, 0.008871994912624359, 0.07237986475229263, 0.032655470073223114, 0.0664980560541153, 0.02964029647409916, 0.012491443194448948, 0.02307942323386669, -0.005166756454855204, -0.0074416338466107845, -0.0729975551366806, -0.050183333456516266, -0.013810137286782265, 5.011120478940911e-34, -0.07912557572126389, 0.08088676631450653, 0.08231355994939804, 0.04374116286635399, -0.03951878845691681, 0.003985610790550709, -0.09844706952571869, -0.011103174649178982, -0.0009112994302995503, -0.047280605882406235, -0.14514373242855072, 0.060052499175071716, -0.05141453817486763, 0.017549974843859673, -0.035032372921705246, 0.04888448491692543, 0.024219375103712082, -0.004119325894862413, -0.1025916114449501, -0.0071863834746181965, 0.03441586345434189, 0.11295999586582184, -0.03463800251483917, -0.014115551486611366, -0.022405346855521202, -0.04890257492661476, -0.016491450369358063, 0.014966501854360104, 0.0025748740881681442, -0.02267475239932537, -0.0035950513556599617, 0.049000125378370285, 0.05741308256983757, -0.034973885864019394, 0.10513324290513992, -0.02682044543325901, -0.0032398353796452284, -0.06981158256530762, -0.03535512834787369, 0.029128022491931915, -0.10156022012233734, -0.020156145095825195, -0.016029058024287224, -0.06308284401893616, 0.004216562025249004, -0.04613494873046875, 0.006875419523566961, 0.005039723590016365, 0.021577805280685425, 0.03734094649553299, 0.02359592914581299, 0.005600018426775932, -0.03358010575175285, 0.08675194531679153, -0.007714504841715097, 0.011865456588566303, 0.03872477263212204, -0.0026873897295445204, 0.014689545147120953, 0.035729095339775085, 0.09961578994989395, 0.03318808972835541, 0.1263209730386734, 0.0193118155002594, 0.040879491716623306, 0.040511809289455414, -0.02355959452688694, 0.023182189092040062, 0.05408456176519394, 0.06696300953626633, -0.020794887095689774, 0.013946393504738808, -0.014343233779072762, 0.02372569590806961, 0.005718219559639692, 0.08141567558050156, 0.029660664498806, -0.07887709885835648, -0.04924783483147621, -0.040694475173950195, -0.08657069504261017, 0.02941310964524746, 0.013194112107157707, -0.18283219635486603, -0.13702067732810974, -0.08779540657997131, 0.03357071429491043, -0.11614228039979935, 0.07719221711158752, 0.042443208396434784, 0.02613317407667637, 0.024458272382616997, -0.014084513299167156, -0.019991496577858925, -0.038111742585897446, -2.625133453381518e-33, -0.1212775707244873, -0.05229603871703148, 0.01762746088206768, -0.027106232941150665, -0.05969588831067085, -0.022863304242491722, 0.13613200187683105, -0.024808891117572784, 0.027559220790863037, 0.0060627395287156105, -0.04676532372832298, -0.09475521743297577, 0.01886027678847313, -0.08198626339435577, 0.12999700009822845, 0.011045016348361969, 0.04359050840139389, 0.07965227216482162, 0.01764114946126938, 0.06869584321975708, 0.06752295047044754, -0.015497349202632904, -0.037905506789684296, 0.0036847381852567196, -0.026883842423558235, 0.053641028702259064, 0.016693754121661186, -0.07700083404779434, -0.0009575472213327885, -0.009331068024039268, -0.02997254952788353, -0.025172868743538857, 0.03566204383969307, 0.023788822814822197, -0.057344187051057816, -0.009173386730253696, -0.03251133859157562, 0.016175467520952225, 0.022625943645834923, -0.10329275578260422, -0.022259263321757317, 0.025441978126764297, -0.03465859591960907, -0.02257990650832653, -0.013998977839946747, -0.006605410482734442, -0.006961611565202475, -0.05413581803441048, 0.02267242781817913, 0.03869405761361122, 0.022850308567285538, 0.009381229989230633, -0.10556705296039581, 0.013397468253970146, 0.046853985637426376, 0.00029927067225798965, -0.030863074585795403, -0.06572509557008743, -0.06846749037504196, 0.04522477462887764, 0.008549150079488754, -0.008344728499650955, -0.03969711810350418, 0.0630866289138794, 0.014044723473489285, 0.002498248592019081, -0.040642719715833664, 0.0231802836060524, 0.027495823800563812, -0.013539087027311325, 0.021285945549607277, 0.03610704094171524, -0.03118458203971386, -0.02654276415705681, -0.06096427142620087, -0.0016646516742184758, -0.0009313224582001567, -0.005028722807765007, -0.030029350891709328, -0.014774158596992493, -0.07358243316411972, -0.08774753659963608, 0.044432133436203, 0.07426153123378754, -0.06155448779463768, 0.02704901434481144, -0.004298238083720207, 0.01895228587090969, 0.04253429174423218, 0.08223769068717957, 0.004185795783996582, -0.012363450601696968, 0.0031484991777688265, -0.025860745459794998, 0.08341417461633682, -4.791730745523637e-08, -0.009430797770619392, -0.04063139483332634, 0.0032065468840301037, 0.009972522966563702, -0.0707356408238411, -0.04827248677611351, 0.003394145518541336, -0.08157999813556671, -0.05403512716293335, 0.03333370015025139, -0.043577034026384354, 0.03751148283481598, -0.016738906502723694, -0.023348480463027954, 0.027606943622231483, -0.01266521867364645, -0.014279133640229702, 0.02540568821132183, 0.06648129224777222, 0.04236764833331108, 0.015603980049490929, -0.01262614969164133, -0.040927495807409286, 0.09634270519018173, -0.09360363334417343, 0.04920586198568344, 0.00884395930916071, 0.0761626735329628, -0.02214844524860382, -0.05747505649924278, 0.06453480571508408, -0.014405986294150352, 0.03519682586193085, -0.06334523111581802, -0.03549635410308838, -0.04311966896057129, -0.010846846736967564, 0.02090163715183735, -0.051713913679122925, 0.10907090455293655, 0.03028329834342003, -0.011144093237817287, 0.025866743177175522, 0.034006938338279724, 0.19281916320323944, 0.03533736243844032, 0.1414707452058792, 0.0062737544067204, 0.029061133041977882, -0.005867060273885727, 0.015878908336162567, 0.09097464382648468, -0.02446689084172249, -0.017354052513837814, 0.03335007280111313, -0.09192434698343277, -0.01405565720051527, 0.08896265923976898, -0.007203119341284037, 0.05681443214416504, 0.03726727515459061, -0.03163258358836174, 0.06397618353366852, -0.05707535892724991 ] }, { "text": "In [10]:\n\nprint(cosine_similarity(word_to_vec_map[\"man\"] - word_to_vec_map[\"engineer\"],\nword_to_vec_map[\"woman\"]-word_to_vec_map[\"nurse\"]))\n\nprint(cosine_similarity(word_to_vec_map[\"man\"] - word_to_vec_map[\"nurse\"],\nword_to_vec_map[\"woman\"]-word_to_vec_map[\"engineer\"]))\n\n0.5709592438104082\n0.23166955887222856\n\nUnfortunately man to engineer and woman to nurse have a higher similarity than man to nurse woman to engineer.\n\nSimple Example for Gender Biased Words¶\n\nI will create woman and man word embeddings. Here the first element repsresents the gender. -1 for man, 1 for woman.\n\nIn [11]:\n\nman = np.array([-1,0.1,0.6])\nwoman = np.array([1,0.5,0.3])", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_7", "embedding": [ 0.013188203796744347, 0.010317139327526093, -0.06341642141342163, -0.06316995620727539, 0.0007145407143980265, -0.0474945530295372, -0.02911156415939331, -0.04259875789284706, -0.07831652462482452, -0.0008709772955626249, 0.027336906641721725, -0.020985441282391548, 0.022559184581041336, 0.025064129382371902, -0.04720516502857208, 0.03979820758104324, -0.032954033464193344, 0.06726803630590439, -0.020558953285217285, -0.0551818311214447, -0.003484824439510703, 0.0511416457593441, -0.017234481871128082, -0.007892949506640434, 0.045047711580991745, 0.02777009643614292, 0.019001048058271408, 0.06315157562494278, -0.06296049058437347, 0.03587665408849716, 0.05284425988793373, 0.05556103587150574, 0.06761029362678528, 0.01206933706998825, -0.08497502654790878, 0.04603220522403717, -0.049713410437107086, -0.007265124469995499, 0.06192079558968544, 0.04600559547543526, -0.010006099008023739, 0.006449407897889614, -0.04129500687122345, 0.03914764150977135, 0.04185609519481659, 0.047684963792562485, -0.06635163724422455, 0.020885545760393143, 0.01043726596981287, -0.0014717300655320287, -0.05540461465716362, -0.01646314188838005, -0.1151631772518158, 0.013638030737638474, -0.08387797325849533, -0.038117341697216034, -0.004053945653140545, -0.07631687819957733, 0.002504188334569335, -0.0643165186047554, 0.015345555730164051, -0.06609614193439484, 0.0633910670876503, -0.029048465192317963, 0.07545159012079239, -0.04570143669843674, 0.017892565578222275, 0.028834668919444084, -0.013547223061323166, 0.08670911937952042, 0.07051657140254974, 0.07692942023277283, -0.049540646374225616, -0.01410749088972807, -0.06442044675350189, 0.0346362367272377, 0.040132224559783936, -0.06964527815580368, 0.10492410510778427, -0.017086807638406754, -0.04437456279993057, -0.036396730691194534, 0.06816112250089645, 0.061124496161937714, -0.02091001160442829, 0.037550412118434906, 0.010315281338989735, -0.04151042550802231, 0.01373104564845562, -0.00357740162871778, -0.06344075500965118, -0.06440407782793045, 0.04355934262275696, 3.147614188492298e-05, 0.013201306574046612, 0.023101091384887695, 0.027864059433341026, 0.01754743792116642, -0.027194896712899208, 0.038597386330366135, 0.04336683079600334, -0.02859867922961712, -0.007603203412145376, -0.06988447904586792, 0.01277571078389883, 0.02124965190887451, 0.050439782440662384, 0.00746309757232666, 0.0025077881291508675, -0.0668264850974083, -0.03278517723083496, -0.004280355758965015, -0.04524149373173714, 0.06708069890737534, 0.00797669030725956, -0.04115714132785797, 0.04756281152367592, 0.05351840332150459, 0.08697575330734253, 0.06887181848287582, -0.01951608620584011, 0.03302377089858055, 0.03907986357808113, -0.02400369755923748, -0.09438034147024155, -0.0578705333173275, -0.018115509301424026, 5.633190711863623e-34, -0.09343638271093369, 0.0658416897058487, 0.0362018384039402, 0.010000379756093025, 0.059142980724573135, 0.023896105587482452, -0.05866878852248192, -0.030331678688526154, -0.058247871696949005, -0.03895259276032448, -0.11866053193807602, 0.11170153319835663, -0.0039036248344928026, 0.021432610228657722, -0.049329157918691635, -0.05312182009220123, 0.003381216898560524, -0.010050162672996521, -0.08888345211744308, -0.024118145927786827, 0.017258036881685257, 0.042486123740673065, -0.04903009906411171, 0.012836574576795101, -0.07150152325630188, -0.10065477341413498, -0.04634404927492142, -0.02700148895382881, -0.040837835520505905, -0.0042441715486347675, -0.05403532832860947, 0.03617648035287857, 0.0664038434624672, -0.060573745518922806, 0.0716024860739708, -0.0627458393573761, 0.08674483746290207, -0.024283597245812416, -0.06571387499570847, -0.07512149214744568, -0.051866065710783005, 0.023124711588025093, 0.08260246366262436, -0.06350114196538925, 0.043536700308322906, 0.018783017992973328, 0.047632116824388504, 0.07182145863771439, 0.02045208215713501, 0.04404493793845177, -0.023013761267066002, -0.0021277866326272488, -0.006065595429390669, 0.08916641026735306, -0.03282623738050461, -0.05386539548635483, 0.062522754073143, 0.022456949576735497, 0.06094982475042343, 0.040426693856716156, 0.022862808778882027, 0.05079997703433037, 0.1286717653274536, 0.024017663672566414, 0.05018129572272301, -0.02729903906583786, -0.010618314146995544, 0.007012000773102045, 0.03902393952012062, 0.1051768958568573, -0.03245234116911888, 0.06138821691274643, -0.06396330893039703, 0.023598629981279373, -0.05433176830410957, 0.06098116561770439, 0.0036391555331647396, -0.06171846389770508, -0.048651162534952164, -0.04783911257982254, -0.07304884493350983, 0.0036148119252175093, -0.004013009835034609, -0.17037445306777954, -0.11666005104780197, -0.0787251815199852, -0.029337694868445396, -0.10067472606897354, 0.04011031612753868, 0.003875401569530368, 0.007582472637295723, 0.074735626578331, 0.02594411000609398, -0.0291322972625494, -0.005770567338913679, -1.855263264777631e-33, -0.15228277444839478, -0.01739303395152092, 0.003617623122408986, 0.002661200473085046, -0.047235842794179916, -0.04551520571112633, 0.13543571531772614, -0.04271510988473892, 0.060190267860889435, 0.029156941920518875, -0.0017659945879131556, -0.10720901191234589, 0.058267951011657715, -0.03787713497877121, 0.14382554590702057, -0.013408305123448372, -0.015636427327990532, 0.07601262629032135, 0.01148186530917883, 0.040301401168107986, 0.05423141270875931, 0.07303187996149063, -0.04049558937549591, 0.05511609837412834, -0.010759596712887287, 0.08928137272596359, 0.0457335002720356, -0.07500466704368591, 0.02826184593141079, -0.03935561329126358, -0.04456200823187828, -0.04482078179717064, -0.03358375281095505, 0.03984324634075165, -0.0009538891026750207, -0.024081537500023842, -0.015738485381007195, 0.022807219997048378, -0.005573851987719536, -0.09778407961130142, 0.023299306631088257, 0.06148502603173256, -0.07098084688186646, -0.02205502986907959, 0.02570379711687565, 0.04534536227583885, -0.0025266008451581, -0.031003663316369057, 0.07978589832782745, 0.02147156186401844, -0.0002759834169410169, 0.0033456769306212664, -0.08071538060903549, 0.06403325498104095, 0.03975140303373337, -0.07466739416122437, -0.07710302621126175, -0.05492522567510605, -0.02787739969789982, 0.02365007996559143, -0.018030844628810883, -0.062407009303569794, 0.004765552934259176, 0.08753583580255508, -0.0048659490421414375, -0.04362017288804054, -0.04112261161208153, 0.03518366441130638, 0.02231161668896675, 0.030021121725440025, 0.012254469096660614, 0.09714244306087494, 0.009908373467624187, -0.019124535843729973, -0.059036318212747574, -0.031460970640182495, 0.018090158700942993, -0.04197445511817932, -0.09158996492624283, -0.04603464901447296, 0.007271174341440201, -0.0394427664577961, 0.08044908195734024, 0.07935657352209091, -0.04921058192849159, 0.038549892604351044, 0.06297192722558975, 0.03020840510725975, 0.023869240656495094, 0.033927951008081436, 0.0031150770373642445, -0.007456176448613405, -0.058468256145715714, -0.005232061725109816, 0.015481937676668167, -4.4579632429986304e-08, -0.039746638387441635, -0.025172842666506767, -0.01606910116970539, -0.016583846881985664, -0.0028726388700306416, -0.05387791618704796, 0.01494892779737711, -0.04679881036281586, -0.03777404874563217, 0.024556675925850868, 0.004595505073666573, 0.0291166789829731, -0.013828812167048454, 0.019280655309557915, 0.031233958899974823, 0.022182799875736237, -0.001549548702314496, 0.028745433315634727, 0.056062251329422, -0.04819536954164505, -0.010037871077656746, 0.0011106713209301233, -0.037818413227796555, 0.06939107924699783, -0.052638258785009384, 0.02838568389415741, -0.05350205674767494, 0.027182862162590027, 0.07443704456090927, 0.005722520872950554, 0.05052149295806885, -0.018491707742214203, 0.031688936054706573, -0.0393100380897522, -8.093816722976044e-05, -0.019333520904183388, -0.03286638855934143, 0.016116738319396973, -0.04254936799407005, 0.0843397006392479, -0.03971217945218086, 0.05220372974872589, -0.012204703874886036, 0.015454594045877457, 0.18893621861934662, -0.035361867398023605, 0.07957565784454346, -0.003699253313243389, 0.04519282281398773, -0.02687753364443779, 0.0658002495765686, 0.023704104125499725, 0.010809699073433876, -0.03516506403684616, 0.03142554685473442, -0.08323695510625839, -0.08211688697338104, 0.031079815700650215, -0.022789616137742996, 0.006357490085065365, 0.04821352660655975, -0.010938086546957493, 0.07667670398950577, -0.05386080592870712 ] }, { "text": "In [11]:\n\nman = np.array([-1,0.1,0.6])\nwoman = np.array([1,0.5,0.3])\n\nAnd I would like to create 2 words (and I aim to them be gender biased.) So that, the first element of lipstick is positive and the first element of war is negative.\n\nIn [12]:\n\nlipstick = np.array([0.1, -0.1, 0])\nwar = np.array([-0.1, 0.1, 0])\n\nHow can we understand that they are gender biased?\n\nFirst, we will take a difference between man and woman. The only difference between man and woman should gender. We will see how other features will be equalized later.\n\nIn [13]:\n\ndiff = woman - man\nprint(\"diff\", diff)\n\ndiff [ 2. 0.4 -0.3]\n\nThen, we will check the similarty between this difference and given word. If the similarty is positive it means that the word is related to woman, otherwise it will be related to man.", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_8", "embedding": [ -0.0016860937466844916, -0.0010441228514537215, -0.05878696218132973, 0.005235190037637949, 0.015097210183739662, -0.05193158984184265, 0.06779114156961441, -0.1121840626001358, -0.0759187713265419, -0.0017686747014522552, 0.0015714002074673772, -0.06936432421207428, 0.0044427732937037945, 0.03394843637943268, 0.051593780517578125, 0.06415629386901855, 0.01508649718016386, 0.021340657025575638, -0.027517791837453842, -0.006884740199893713, 0.027650678530335426, -0.0009917530696839094, -0.007902928628027439, 6.591691635549068e-05, -0.024894127622246742, 0.01700744777917862, 0.04168137535452843, 0.06498171389102936, -0.005027254112064838, 0.044739849865436554, 0.04380619525909424, 0.04029405489563942, 0.0908907800912857, 0.01921156980097294, -0.10099346190690994, -0.009784780442714691, -0.07763306051492691, 0.03469627723097801, 0.011384183540940285, 0.04033586382865906, 0.004260921850800514, -0.00696133729070425, -0.061599213629961014, -0.028678996488451958, 0.09505502134561539, 0.021754741668701172, -0.03885852172970772, 0.0909195989370346, 0.031172344461083412, -0.02036396600306034, 0.013519966043531895, -0.04699164256453514, -0.069839708507061, -0.006219916045665741, -0.04908709600567818, 0.0009712841711007059, 0.05224469304084778, 0.04330636188387871, -0.025070935487747192, -0.09282968938350677, 0.03747337684035301, -0.07685273885726929, -0.02607482671737671, 0.008904357440769672, 0.04896830394864082, -0.07847349345684052, 0.03068510629236698, 0.044414836913347244, -0.037676576524972916, 0.06346696615219116, 0.03676481917500496, 0.08450391888618469, 0.007291692309081554, 0.005538916680961847, -0.044020749628543854, 0.021869827061891556, 0.1139368861913681, -0.06606267392635345, 0.0785832479596138, -0.0019246813608333468, -0.055427324026823044, -0.06891711801290512, 0.08541055768728256, 0.10331477224826813, -0.028866158798336983, -0.037616174668073654, 0.012399297207593918, -0.01646919921040535, -0.0501679964363575, 0.025645611807703972, -0.05389808490872383, -0.05082344636321068, 0.09085366129875183, -0.022540835663676262, 0.010238339193165302, 0.05716009438037872, 0.0014810118591412902, -0.04558949172496796, 0.0161924809217453, 0.08985104411840439, 0.04610254988074303, -0.09379436820745468, -0.07028267532587051, -0.05107545107603073, 0.019532745704054832, -0.012142064049839973, 0.027105232700705528, -0.09394855797290802, -0.0231094341725111, -0.021150799468159676, 0.0077469185926020145, -0.02768164873123169, -0.030615227296948433, 0.03732150048017502, 0.009342534467577934, -0.04543823376297951, 0.049875471740961075, 0.09596952795982361, 0.012523394078016281, 0.011746224947273731, -0.030513836070895195, 0.01696597784757614, 0.010851084254682064, -0.002437607618048787, -0.03903903812170029, -0.01161748357117176, 0.007351904176175594, 4.568526192869684e-34, -0.05356646701693535, -0.0018007101025432348, -0.024953460320830345, 0.019912945106625557, 0.0443534180521965, 0.05333230644464493, -0.014443379826843739, -0.03817608207464218, -0.08613506704568863, -0.014127560891211033, -0.029170142486691475, 0.08608979731798172, -0.03476762771606445, -0.028191598132252693, -0.028542589396238327, -0.01453496515750885, 0.019973143935203552, 0.008650032803416252, -0.007484854198992252, 0.005216010846197605, -0.030305787920951843, 0.044332388788461685, -0.02949223294854164, -0.05243152007460594, -0.06909100711345673, -0.12281384319067001, -0.04409655183553696, -0.037457045167684555, -0.05840504541993141, -0.014751673676073551, -0.08472013473510742, -0.013570105656981468, 0.031761445105075836, -0.0012571876868605614, 0.04647555202245712, -0.05893426015973091, 0.029033483937382698, -0.010456202551722527, -0.012125389650464058, -0.0869489535689354, -0.040521979331970215, 0.025323370471596718, 0.11585117131471634, -0.10019105672836304, -0.03473522514104843, 0.07789280265569687, -0.006770595908164978, 0.05192452669143677, 0.04936455562710762, 0.05566224828362465, -0.05302869528532028, -0.009547099471092224, 0.02489633485674858, 0.0881631150841713, -0.0280348788946867, 0.0348825678229332, 0.05388513207435608, 0.046853817999362946, 0.048768870532512665, -0.045195262879133224, 0.0044326758943498135, 0.07954707741737366, 0.06560938060283661, -0.021519599482417107, -0.0290779210627079, 0.03662078455090523, -0.030865546315908432, 0.0052229068242013454, 0.05756649374961853, 0.057339880615472794, 0.007127952761948109, 0.08445989340543747, -0.05644987151026726, 0.02778802253305912, -0.029636124148964882, 0.08695181459188461, 0.024335302412509918, -0.027489015832543373, -0.009126469492912292, -0.04265064746141434, -0.042840998619794846, -0.009990451857447624, -0.04356713593006134, -0.1276046484708786, -0.18533408641815186, -0.029823115095496178, 0.011099208146333694, -0.09640387445688248, 0.05303902179002762, 0.00970205944031477, -0.07172535359859467, 0.012370060198009014, -0.006945854052901268, 0.010060914792120457, 0.01793907769024372, -4.108533488380334e-33, -0.16420356929302216, 0.024640966206789017, 0.025416195392608643, -0.01258478406816721, -0.036001116037368774, -0.014358763583004475, 0.05556522309780121, -0.0406251884996891, 0.07361852377653122, 0.06201406940817833, -0.00667848763987422, -0.045705027878284454, 0.02816585823893547, -0.02559521235525608, 0.07950746268033981, -0.03237100690603256, -0.045492734760046005, 0.041882529854774475, 0.035528577864170074, -0.027806762605905533, -0.017969738692045212, 0.1010960042476654, -0.07475575059652328, -0.002797619439661503, -0.0654468834400177, 0.026632431894540787, 0.06230602413415909, -0.08225831389427185, 0.04311219975352287, 0.024223456159234047, -0.0796927958726883, -0.020804373547434807, -0.06434918940067291, 0.055162739008665085, 0.011512170545756817, -0.07139942049980164, -0.047968290746212006, -0.023102298378944397, 0.01928509585559368, -0.04943090304732323, 0.01902497373521328, 0.02909674495458603, -0.03356626629829407, -0.002355399075895548, -0.005776268895715475, -0.02518402971327305, -0.010903931222856045, 0.05839690566062927, 0.08123607188463211, -0.03963739797472954, -0.025969799607992172, 0.03407999500632286, -0.02787395566701889, 0.1301637887954712, -0.04305087774991989, -0.07227916270494461, -0.0648314580321312, -0.005393477156758308, 0.012050066143274307, 0.06863972544670105, -0.05655356124043465, -0.0457034558057785, -0.04800749570131302, 0.06037522479891777, -0.0655801072716713, -0.05847829952836037, -0.08613759279251099, -0.01935526542365551, 0.08593650907278061, 0.04193352162837982, 0.048428744077682495, 0.0679730549454689, 0.02760729007422924, -0.036232754588127136, -0.06962184607982635, -0.03526916727423668, -0.029118290171027184, -0.08291631191968918, -0.059591036289930344, -0.015337791293859482, 0.05695943906903267, 0.02146070823073387, 0.061270274221897125, 0.04689692333340645, -0.04348110035061836, -0.009030720219016075, 0.016879335045814514, 0.04412053897976875, 0.023607030510902405, 0.043704401701688766, 0.018646331503987312, 0.008140421472489834, -0.06541189551353455, 0.017912374809384346, -0.037994470447301865, -5.321293627957857e-08, -0.049379050731658936, -0.04999484866857529, -0.006588281132280827, 0.07517774403095245, -0.08357441425323486, -0.03223524987697601, 0.005591536872088909, -0.13522151112556458, -0.02011747844517231, 0.037655413150787354, 0.011885472573339939, 0.05954240635037422, -0.03963983431458473, 0.01422595139592886, -0.003011647379025817, 0.10063676536083221, 0.05160730704665184, -0.021832523867487907, 0.023289406672120094, -0.027370436117053032, 0.06526371091604233, -0.07509365677833557, -0.030886560678482056, 0.022300858050584793, -0.05818310007452965, 0.03300650417804718, -0.017361240461468697, -0.002895304234698415, 0.014936360530555248, 0.030261507257819176, 0.021847020834684372, 0.006553875282406807, -0.04150513559579849, -0.051053568720817566, 0.10254202038049698, 0.04011471942067146, -0.06227847933769226, -0.021133551374077797, 0.06612731516361237, 0.05693436786532402, -0.023873282596468925, 0.03620639070868492, -0.02185819111764431, 0.011095014400780201, 0.07734203338623047, -0.01616368256509304, 0.05163303017616272, -0.010337396524846554, -0.0024119720328599215, 0.0006863034213893116, 0.06841593980789185, -0.004096004646271467, -0.017520517110824585, -0.03765098750591278, -0.06096164882183075, -0.040174514055252075, -0.09955516457557678, 0.10957328975200653, 0.0007874377770349383, 0.06209593638777733, 0.06572027504444122, 0.02083224430680275, 0.08869262039661407, -0.08896181732416153 ] }, { "text": "In [14]:\n\ndef get_similarity(diff, word):\nprint(\"np.dot:\", np.dot(diff, word))\nprint(\"L2 diff\", np.sqrt(np.sum(np.square(diff))))\nprint(\"L2 word: \", np.sqrt(np.sum(np.square(word))))\ncos_sim = np.dot(diff, word) / (np.sqrt(np.sum(np.square(diff))) * np.sqrt(np.sum(np.square(word))))\nprint(\"cos sim\", cos_sim)\n\nThe cosine similarity between the difference and \"war\" is negative:\n\nIn [15]:\n\nget_similarity(diff, war)\n\nnp.dot: -0.16\nL2 diff 2.0615528128088303\nL2 word: 0.14142135623730953\ncos sim -0.5487954724560281\n\nThe cosine similarity between the difference and \"lipstick\" is positive:\n\nIn [16]:\n\nget_similarity(diff, lipstick)\n\nnp.dot: 0.16\nL2 diff 2.0615528128088303\nL2 word: 0.14142135623730953\ncos sim 0.5487954724560281\n\nWe will explore how to reduce gender bias from these words later.", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_9", "embedding": [ -0.03303417190909386, -0.02944214642047882, -0.05928347632288933, -0.0029594136867672205, -0.003403150476515293, -0.08739772439002991, -0.010020613670349121, 0.05634867399930954, -0.006640664767473936, -0.012176773510873318, 0.11160385608673096, -0.05491152033209801, 0.004311821889132261, 0.023096028715372086, -0.024381887167692184, 0.0052961790934205055, 0.012673400342464447, -0.023802658542990685, -0.04205552861094475, 0.004956940189003944, 0.04210321977734566, 0.012225777842104435, -0.016530226916074753, 0.036538127809762955, 0.07931533455848694, 0.06127869337797165, 0.0021611459087580442, 0.03828951716423035, -0.01737058348953724, 0.02565942518413067, 0.06717675924301147, 0.07814108580350876, -0.004470631014555693, 0.010238361544907093, -0.033364344388246536, -0.037287067621946335, 0.010535663925111294, -0.006997371558099985, 0.07560395449399948, 0.020237529650330544, -0.052073877304792404, 0.02631988562643528, 0.033538296818733215, 0.04990413784980774, -0.01004085224121809, 0.023754751309752464, -0.10986722260713577, 0.09260071069002151, 0.02718018926680088, -0.05184841901063919, -0.02673419937491417, -0.018696554005146027, -0.1417691558599472, -0.07363735139369965, -0.014773119240999222, 0.003168342635035515, 0.05653226003050804, 0.01539412047713995, 0.008189467713236809, -0.0773373693227768, -0.01813092827796936, -0.00010707150795497, 0.021607978269457817, 0.0015414681984111667, 0.0038924941327422857, -0.006375268567353487, 0.04622143879532814, -0.02390071004629135, -0.04730464518070221, 0.016665754839777946, 0.00903766043484211, 0.08145324885845184, -0.04506950080394745, 0.012646663002669811, -0.05036638304591179, 0.020182127133011818, 0.0034529706463217735, 0.015298536978662014, 0.008297156542539597, -0.05964912474155426, -0.0042917062528431416, -0.0005603168392553926, 0.025259917601943016, 0.05466371029615402, -0.007001565303653479, -0.03231942653656006, 0.043991509824991226, -0.04786336421966553, 0.058617159724235535, -0.0724964514374733, -0.043604835867881775, -0.026908664032816887, -0.02598167024552822, 0.0021409818436950445, -0.05244055390357971, 0.04297235608100891, 0.002094717463478446, 0.06490233540534973, -0.010283416137099266, 0.03954751044511795, 0.059251852333545685, -0.07725376635789871, -0.0705878958106041, -0.07631359994411469, 0.013954688794910908, 0.035673029720783234, 0.08625306189060211, -0.043143607676029205, 0.06975322216749191, -0.03898756578564644, -0.06042801961302757, 0.004268151707947254, -0.012514672242105007, 0.0605807825922966, 0.06760577112436295, 0.025987720116972923, 0.062059544026851654, 0.02441834844648838, 0.05853638797998428, 0.050707101821899414, 0.07357043772935867, 0.0006947637884877622, -0.010974039323627949, 0.011597566306591034, -0.038716308772563934, -0.02797263115644455, -0.009874282404780388, 9.213181256989459e-34, -0.06520827114582062, 0.04680979996919632, 0.03290807828307152, 0.017057104036211967, 0.008647843264043331, -0.015019324608147144, -0.08885922282934189, -0.06753497570753098, -0.02300216071307659, 0.01086797658354044, -0.14420780539512634, 0.12388484925031662, -0.030899979174137115, -0.016888031736016273, -0.022942660376429558, 0.02066527120769024, 0.004038446117192507, -0.020460812374949455, -0.041288238018751144, -0.015502002090215683, 0.026191504672169685, 0.021016081795096397, -0.02961760200560093, 0.03329315036535263, -0.027342941612005234, -0.04288993775844574, -0.036056648939847946, -0.018724793568253517, -0.01613250933587551, -0.01504523865878582, -0.0017368810949847102, -0.008613253943622112, 0.02243071049451828, 0.016908809542655945, -0.007840117439627647, -0.04602871090173721, 0.039687901735305786, -0.08418020606040955, -0.04653406888246536, -0.06267775595188141, -0.07270989567041397, 0.06121053174138069, 0.011897804215550423, -0.041050024330616, 0.004639404825866222, 0.06259393692016602, -0.004108745604753494, -0.044563379138708115, -0.0014462105464190245, -0.005569887347519398, 0.008521775715053082, -0.01594218984246254, -0.00108921539504081, 0.0644746720790863, -0.03641880676150322, -0.013214868493378162, 0.041941192001104355, 0.05014593154191971, 0.044141437858343124, 0.01565614901483059, 0.06686560809612274, 0.01688515767455101, 0.08007946610450745, -0.009665980003774166, 0.05474751442670822, 0.04115407168865204, -0.09285159409046173, 0.0023812134750187397, 0.065055713057518, 0.09023842215538025, 0.023181365802884102, 0.0240266565233469, -0.01680476777255535, -0.024609334766864777, 0.05336946249008179, -0.02272588014602661, 0.03634730353951454, -0.05671720206737518, -0.031793009489774704, -0.015140224248170853, -0.10878846794366837, 0.013354478403925896, -0.04848088324069977, -0.1848926544189453, -0.16784776747226715, -0.09003185480833054, 0.05178361013531685, -0.0741400420665741, -0.00539040332660079, -0.05111685395240784, -0.06475851684808731, 0.013748559169471264, 0.030769776552915573, -0.02785186469554901, -0.024585802108049393, -4.080568110432287e-33, -0.17135730385780334, 0.040269166231155396, 0.014451841823756695, 0.011802948080003262, -0.03400832787156105, 0.059320785105228424, 0.09953509271144867, -0.0011753353755921125, 0.07914595305919647, 0.013390770182013512, -0.012002754025161266, -0.07264438271522522, 0.018629910424351692, -0.04686687886714935, 0.14278267323970795, 0.03450985625386238, 0.058938056230545044, 0.06585954129695892, 0.01788501627743244, 0.05322984606027603, 0.018460895866155624, 0.01182284951210022, -0.05246976017951965, -0.04451797902584076, -0.016571808606386185, 0.0551421232521534, -2.7656669772113673e-05, -0.10855840146541595, -0.03980228304862976, -0.043393898755311966, -0.017175445333123207, 0.07875259220600128, -0.027595844119787216, 0.037138912826776505, -0.07785182446241379, -0.0098094642162323, 0.01226840727031231, -0.08394410461187363, -0.013548857532441616, -0.127153217792511, 0.004612545948475599, 0.0013710339553654194, 0.02818264067173004, -0.012237141840159893, -0.00832067709416151, -0.03965218365192413, -0.021247223019599915, -0.046399541199207306, 0.09731095284223557, -0.011626158840954304, 0.07068932801485062, 0.054975345730781555, -0.053914833813905716, 0.08090448379516602, -0.04683570936322212, -0.0029046989511698484, -0.1283971667289734, 0.020376894623041153, -0.10278203338384628, 0.022977503016591072, 0.006625029258430004, -0.04125285893678665, -0.10071595758199692, 0.054252758622169495, 0.010661534033715725, -0.027415182441473007, -0.056234899908304214, -0.004309665411710739, 0.09883002191781998, -0.006887039635330439, -0.02281961776316166, 0.10719781368970871, 0.003045620396733284, -0.05229559168219566, -0.03905515745282173, -0.010691151022911072, -0.023405609652400017, -0.04251419007778168, -0.09092755615711212, 0.04280466586351395, -0.01369134709239006, -0.0029382691718637943, 0.05600195750594139, 0.018326224759221077, -0.09256268292665482, -0.011426504701375961, -0.008308688178658485, 0.10167771577835083, 0.015953265130519867, 0.03437762334942818, -0.020917054265737534, -0.032246485352516174, -0.006706107873469591, -0.032628245651721954, 0.059639669954776764, -4.726163638224534e-08, 0.013744538649916649, -0.046895626932382584, 0.00707215303555131, 0.025867847725749016, -0.04055893421173096, 0.03839403763413429, -0.059037577360868454, -0.0539279468357563, -0.038522135466337204, 0.055668026208877563, 0.025941012427210808, 0.04071906581521034, -0.08255129307508469, 0.04976785555481911, -0.0624212920665741, 0.08170193433761597, -0.01799602620303631, -0.0522034615278244, 0.04833146557211876, 0.028473161160945892, 0.012496662326157093, -0.004543432034552097, -0.04469650611281395, 0.04073898494243622, -0.08131258189678192, 0.042190682142972946, -0.041255779564380646, 0.0189327672123909, 0.007885427214205265, 0.03459050506353378, 0.03608991578221321, -0.014500700868666172, -0.00824440736323595, -0.08177028596401215, -0.001072643673978746, -0.010987306945025921, 0.0024861714337021112, 0.07407841086387634, 0.01869465969502926, 0.10672785341739655, -0.036309439688920975, 0.026494067162275314, -0.02580161951482296, 0.02471356838941574, 0.1543688029050827, 0.0077236974611878395, 0.057294078171253204, -0.05433264002203941, 0.03466830775141716, -0.0661960169672966, 0.07575596868991852, 0.014489023014903069, -0.05904700234532356, -0.013877286575734615, 0.0009011251386255026, -0.0580100417137146, -0.09600794315338135, 0.08633320033550262, -0.019954940304160118, -0.014719963073730469, 0.03294313699007034, -0.010482482612133026, 0.09367378801107407, 0.002245196606963873 ] }, { "text": "We will explore how to reduce gender bias from these words later.\n\n3 - Word Analogy Task¶\n\n•\nIn the word analogy task, complete this sentence:\n\n\"a is to b as c is to ____\".\n\n•\n\n•\nAn example is:\n\n'man is to woman as king is to queen' .\n\n•\n\nIn [17]:\n\ndef complete_analogy(word_a, word_b, word_c, word_to_vec_map):\n\"\"\"\nPerforms the word analogy task as explained above: a is to b as c is to ____.\n\nArguments:\nword_a -- a word, string\nword_b -- a word, string\nword_c -- a word, string\nword_to_vec_map -- dictionary that maps words to their corresponding vectors.\n\nReturns:\nbest_word -- the word such that v_b - v_a is close to v_best_word - v_c, as measured by cosine similarity\n\"\"\"\n\n# convert words to lowercase\nword_a, word_b, word_c = word_a.lower(), word_b.lower(), word_c.lower()", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_10", "embedding": [ 0.05341954156756401, -0.026302995160222054, -0.031549666076898575, -0.021638307720422745, -0.026005037128925323, -0.009501446969807148, 0.012571563012897968, -0.043643396347761154, -0.09423530101776123, 0.03317256271839142, -0.020335815846920013, -0.056673239916563034, 0.0814623087644577, 0.05443115904927254, 0.042879097163677216, 0.055743951350450516, 0.07405998557806015, 0.07986418157815933, -0.07249994575977325, -0.046063829213380814, 0.08717899769544601, -0.01585967279970646, 0.020291145890951157, 0.011250336654484272, 0.010157838463783264, -0.06018509715795517, -0.039979103952646255, 0.017419107258319855, -0.05005398765206337, -0.0011158987181261182, 0.04941834881901741, 0.0677933543920517, 0.0362975113093853, -0.0408455990254879, -0.002959329867735505, 0.0680694505572319, -0.09982746839523315, -0.03230016306042671, 0.07647427171468735, 0.03439563512802124, -0.057826023548841476, -0.05160018429160118, -0.04474422708153725, 0.0673869326710701, 0.0328708253800869, 0.12181147933006287, -0.008735132403671741, 0.04420775920152664, -0.06865943223237991, -0.07225672900676727, -0.03227614983916283, -0.029840299859642982, -0.10732629150152206, 0.006504875607788563, -0.08509590476751328, -0.02120198868215084, 0.017325839027762413, -0.05069078132510185, 0.025618266314268112, -0.06808731704950333, -0.04766212776303291, -0.054721832275390625, -0.023079901933670044, 0.03818391636013985, -0.04806842654943466, -0.06039824336767197, 0.016831934452056885, 0.043584395200014114, -0.009449214674532413, 0.12334142625331879, 0.05363054573535919, 0.10725913196802139, -0.04266267269849777, 0.05220698565244675, 0.043929703533649445, 0.066969133913517, 0.10174669325351715, -0.05820097774267197, 0.06209997832775116, -0.05194372311234474, -0.07480913400650024, -0.056439779698848724, 0.01878289505839348, 0.08679106831550598, 0.0021893391385674477, -0.05533652380108833, 0.005681984126567841, -0.07508797943592072, -0.013999862596392632, 0.031113706529140472, -0.0740865096449852, -0.10784658789634705, 0.14551381766796112, -0.015978248789906502, 0.06403975933790207, -0.005616620648652315, 0.026033377274870872, -0.038154155015945435, -0.017427580431103706, 0.06317275762557983, 0.006166392005980015, 0.04714345932006836, 0.0077279373072087765, -0.09727225452661514, -0.03242087736725807, -0.00879012979567051, 0.03168702870607376, -0.039193324744701385, 0.03735771030187607, -0.09514667838811874, -0.03672417253255844, -0.06146296113729477, -0.001129835844039917, 0.044763583689928055, 0.03201445937156677, -0.005438847467303276, 0.044496215879917145, 0.011710389517247677, 0.06217033416032791, 0.003983807750046253, 0.022367293015122414, 0.06471877545118332, 0.05778561159968376, 0.0015028418274596334, -0.025680534541606903, 0.011634627357125282, -0.0278819240629673, -9.664026503213e-34, -0.068559430539608, 0.053265176713466644, 0.018645144999027252, 0.05980425328016281, 0.052496474236249924, 0.006611008197069168, 0.0069157518446445465, -0.029203446581959724, -0.004451808985322714, -0.001422911649569869, -0.10379402339458466, 0.045862022787332535, -0.054592832922935486, 0.007320855278521776, -0.03346778824925423, -0.019462279975414276, 0.0015006707981228828, 0.03282175585627556, -0.066968634724617, -0.011208468116819859, 0.011477879248559475, 0.08290572464466095, -0.0760849341750145, -0.002821502508595586, -0.057694461196660995, -0.12820561230182648, 0.011225268244743347, -0.03930561617016792, 0.017136167734861374, -0.0149083212018013, -0.06407319009304047, -0.03807458654046059, 0.05040658637881279, 0.01062895730137825, 0.029369771480560303, -0.04886111617088318, 0.0612296462059021, -0.002522544702515006, 0.008786138147115707, 0.007657464127987623, -0.020946862176060677, -0.05051502212882042, 0.01964924857020378, -0.02967015840113163, 0.009130165912210941, 0.03442796692252159, -0.007648599799722433, 0.0446525476872921, -0.009444952011108398, 0.03638748824596405, 0.03431845083832741, -0.0320606492459774, 0.02020404115319252, 0.06866294145584106, -0.0193661917001009, 0.038874611258506775, 0.054958026856184006, -0.006569163873791695, 0.034180570393800735, 0.022582869976758957, 0.056773990392684937, 0.012901099398732185, 0.08309680223464966, 0.02188715897500515, -0.015189221128821373, 0.026820991188287735, 0.007139138411730528, -0.025729920715093613, 0.030699143186211586, 0.07793230563402176, -0.04952254518866539, 0.05176505073904991, -0.08417584747076035, 0.02485002763569355, 0.02651182934641838, 0.059380970895290375, -0.03392879664897919, -0.08208868652582169, -0.0387871190905571, -0.055320966988801956, -0.025716332718729973, 0.03458742797374725, -0.03237520530819893, -0.11343526840209961, -0.10376203060150146, -0.12251888960599899, 0.025874163955450058, -0.18792173266410828, 0.05888550728559494, -0.04571691155433655, -0.06073465570807457, -0.0353894867002964, 0.011907346546649933, -0.023414531722664833, 0.03903732821345329, -1.846645972831142e-33, -0.1063838079571724, -0.055548056960105896, 0.04952062666416168, 0.09339217841625214, -0.04319893568754196, -0.06131075322628021, 0.16641493141651154, -0.07322641462087631, 0.010859962552785873, -0.028885062783956528, -0.08463030308485031, -0.07787977159023285, 0.018119975924491882, -0.028879089280962944, 0.10433948040008545, -0.023035505786538124, 0.030634267255663872, -0.014758552424609661, 0.012461252510547638, 0.06716293096542358, 0.026822611689567566, 0.057419098913669586, -0.0689069852232933, 0.00197195284999907, -0.01374500896781683, 0.07112227380275726, -0.003295241855084896, -0.010229540057480335, 0.06554485112428665, 0.035885706543922424, -0.055263761430978775, -0.02332291379570961, -0.00464957021176815, 0.022344889119267464, -0.042741041630506516, 4.6103318709356245e-06, -0.011132323183119297, 0.029420562088489532, -0.024554170668125153, 0.009588535875082016, -0.019766278564929962, 0.025991316884756088, -0.04248040169477463, -0.025581715628504753, 0.019497983157634735, 0.02669292688369751, -0.016550038009881973, -0.017034873366355896, 0.05780820921063423, 0.02151395007967949, -0.03077424131333828, -0.003928914200514555, -0.08831870555877686, 0.049508236348629, -0.004814556334167719, -0.07991360127925873, -0.04614315554499626, -0.11552811414003372, -0.01860785484313965, 0.05797561630606651, -0.03302859142422676, -0.06281311810016632, -0.001910559949465096, 0.04750611633062363, -0.03758839890360832, -0.019897419959306717, -0.03923443332314491, -0.04023059085011482, 0.04828934371471405, -0.023438453674316406, 0.05384824797511101, 0.04147788882255554, -0.030414564535021782, 0.01728615164756775, -0.003935873042792082, 0.019062567502260208, -0.016809016466140747, -0.011461751535534859, -0.08532380312681198, -0.08045309782028198, -0.01834763213992119, -0.06410989910364151, 0.07416518032550812, 0.02854364737868309, -0.061975810676813126, 0.00022209894086699933, 0.01366184651851654, 0.0806717574596405, 0.03490670397877693, 0.06288008391857147, -0.020110182464122772, -0.018800271674990654, -0.013352825306355953, 0.06892523169517517, 0.03752484545111656, -5.0412307217584384e-08, -0.04862822964787483, 0.057626329362392426, 0.013149897567927837, 0.04147716239094734, -0.026380788534879684, -0.05741224065423012, -0.016907693818211555, -0.06172626465559006, -0.008287623524665833, -0.010043778456747532, -0.03944224864244461, 0.06442826986312866, -0.04241796210408211, 0.031867865473032, 0.015286282636225224, 0.07810371369123459, 0.019105877727270126, 0.021858083084225655, 0.0466308519244194, -0.02295920066535473, 0.029394933953881264, -0.03064669482409954, -0.07580491155385971, 0.020006202161312103, -0.05224728211760521, 0.03242435306310654, -0.0636599063873291, 0.06827996671199799, 0.07730469852685928, -0.07431679964065552, 0.053955137729644775, 0.012801475822925568, -0.03537185117602348, -0.07093896716833115, 0.02801985666155815, 0.032067518681287766, -0.036556415259838104, 0.016955414786934853, 0.02216900885105133, 0.1054210290312767, 0.033345531672239304, -0.007830629125237465, -0.01806756481528282, 0.019043991342186928, 0.10074278712272644, 0.01656534895300865, 0.016576455906033516, -0.03005274385213852, -0.03652573004364967, 0.05799219012260437, 0.04003121331334114, 0.04333094507455826, 0.00887441635131836, -0.01821034774184227, -0.0025271051563322544, -0.06349995732307434, -0.05757218971848488, 0.06889788061380386, -0.04829713702201843, 0.05555808171629906, 0.02450958825647831, 0.054428283125162125, 0.015052679926156998, -0.02199474908411503 ] }, { "text": "# convert words to lowercase\nword_a, word_b, word_c = word_a.lower(), word_b.lower(), word_c.lower()\n\n# Get the word embeddings e_a, e_b and e_c\ne_a, e_b, e_c = word_to_vec_map[word_a], word_to_vec_map[word_b], word_to_vec_map[word_c]\n\nwords = word_to_vec_map.keys()\n#initialize max_cosine_sim as large neg number\nmax_cosine_sim = -100\nbest_word = None\n\n# loop over the whole word vector set\nfor w in words:\n# skip word_c from query\nif w == word_c:\ncontinue\n\ncosine_sim = cosine_similarity(e_b - e_a, word_to_vec_map[w.lower()] - e_c)\nif cosine_sim > max_cosine_sim:\nmax_cosine_sim = cosine_sim\nbest_word = w\n\nreturn best_word\n\nIn [18]:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_11", "embedding": [ 0.03375625982880592, -0.021527927368879318, -0.03854728117585182, -0.06360678374767303, -0.035623323172330856, -0.03182227909564972, -0.007903404533863068, 0.07774903625249863, -0.12049086391925812, -0.008990496397018433, 0.05587298423051834, -0.01824486069381237, 0.10273546725511551, -0.001336530433036387, -0.04955364018678665, 0.04927867650985718, 0.04755573347210884, 0.08184818923473358, -0.11361972987651825, -0.060422640293836594, -0.03765138238668442, 0.03076210431754589, 0.02213044837117195, -0.04208340495824814, 0.047361332923173904, 0.041462287306785583, 0.0010108953574672341, 0.0446728952229023, -0.04069340601563454, 0.0041651432402431965, 0.06253274530172348, -0.012990356422960758, 0.052125561982393265, 0.0360303595662117, 0.011982542462646961, -0.03659878298640251, -0.060448870062828064, -0.05271941423416138, 0.008748386055231094, 0.01799074560403824, -0.06409529596567154, -0.00016102012887131423, -0.0547710545361042, 0.10038593411445618, 0.03955155238509178, 0.07726757228374481, -0.09348145872354507, 0.03861731290817261, 0.01529495045542717, -0.020623354241251945, -0.06338407099246979, -0.012236527167260647, -0.11924419552087784, 0.0072150882333517075, -0.07906784117221832, -0.013782831840217113, 0.035323187708854675, -0.09062973409891129, 0.05183782801032066, -0.09674584120512009, 0.013990651816129684, -0.0683165043592453, 0.10596311092376709, -0.034603703767061234, -0.014914908446371555, 0.007605798076838255, 0.03362853825092316, 0.040220558643341064, -0.0034423700999468565, 0.08601349592208862, -0.0015440774150192738, 0.08419439941644669, -0.03265132009983063, 0.022825317457318306, -0.09972649812698364, 0.0717102512717247, 0.030360519886016846, -0.029509972780942917, 0.07630414515733719, -0.017508767545223236, -0.03541865199804306, -0.027684411033988, 0.04384417086839676, 0.01612558402121067, 0.028010625392198563, -0.06391726434230804, 0.06302789598703384, -0.06349172443151474, 0.0707428827881813, -0.025039231404662132, -0.03774883225560188, -0.09219726175069809, 0.007535403594374657, -0.04627218469977379, 0.004035037476569414, -0.009610230103135109, -0.0015179641777649522, 0.03598301485180855, -0.0403280034661293, 0.021429916843771935, 0.0466926172375679, -0.0036164019256830215, 0.007408821024000645, -0.08948711305856705, -0.04727333039045334, -0.010736146941781044, 0.07385951280593872, 0.04804368317127228, 0.08589792996644974, -0.11181700974702835, -0.08021651208400726, -0.026870744302868843, -0.003917381167411804, -0.0026977916713804007, 0.020194532349705696, 0.027872147038578987, 0.06916772574186325, 0.06212873011827469, 0.0618448369204998, 0.024457644671201706, -0.013008984737098217, 0.06480706483125687, 0.04803665354847908, -0.015969986096024513, -0.10925514250993729, -0.05096202343702316, -0.007631555199623108, 4.330257069542357e-33, -0.06308314204216003, 0.03858287259936333, 0.006470648106187582, 0.008679979480803013, 0.025626661255955696, 0.023521168157458305, -0.035035163164138794, 0.03457615524530411, -0.0936259776353836, 0.024203728884458542, -0.10503296554088593, 0.05234064534306526, -0.0019449396058917046, 0.049728430807590485, -0.05003291741013527, -0.029779061675071716, 0.01638435199856758, -0.09355708956718445, -0.0734485536813736, -0.06115316227078438, 0.04677229002118111, -0.013202840462327003, 0.004877571482211351, -0.009346811100840569, -0.07164151966571808, -0.09739648550748825, -0.005234374199062586, -0.05204184725880623, -0.022095834836363792, -0.036736518144607544, -0.05241652950644493, -0.026248924434185028, 0.018871817737817764, 0.025435306131839752, 0.05471595749258995, -0.04702669382095337, 0.05755478888750076, 0.009903574362397194, -0.014333877712488174, -0.061761632561683655, -0.023423314094543457, 0.023231998085975647, 0.015193150378763676, -0.0530884824693203, 0.06069637089967728, 0.010308382101356983, -0.025327414274215698, 0.038862910121679306, -0.017474517226219177, -0.011619956232607365, 0.06380503624677658, -0.06769504398107529, -0.038905054330825806, 0.10630092024803162, -0.04116795212030411, -0.03464150056242943, 0.02806772291660309, 0.07658655941486359, 0.06555267423391342, 0.0334220826625824, 0.02819383144378662, 0.020219886675477028, 0.06060110777616501, 0.02026807889342308, 0.062017958611249924, -0.01709592714905739, -0.0681043490767479, 0.02944781817495823, -0.017002047970891, 0.06180413067340851, 0.0533330962061882, -0.0011079523246735334, -0.03276226297020912, -0.029807178303599358, -0.004548363387584686, 0.0003310416068416089, 0.009443940594792366, -0.06049786135554314, -0.07552271336317062, -0.03138129785656929, -0.07794718444347382, 0.0024623556528240442, 0.019955698400735855, -0.14572466909885406, -0.09441473335027695, -0.09684032201766968, 0.01027791015803814, -0.08464108407497406, 0.008935521356761456, -0.04185127839446068, -0.048751816153526306, 0.05863814800977707, 0.006039201747626066, -0.027168015018105507, 0.004809879232198, -4.226948013836371e-33, -0.06240054965019226, -0.013934985734522343, 0.05197042226791382, 0.00381134869530797, -0.03312237933278084, -0.010969731025397778, 0.10963081568479538, -0.03407691791653633, 0.02430904097855091, -0.016995694488286972, -0.00042017106898128986, -0.07986781746149063, 0.07903345674276352, -0.04426857456564903, 0.11316677927970886, 0.004024739842861891, 0.01830720715224743, 0.1109238937497139, 0.03956647217273712, 0.12463594228029251, 0.0028071613050997257, -0.011314989998936653, -0.05448555946350098, 0.03868279233574867, 0.003087175777181983, 0.08305367827415466, 0.014909034594893456, -0.013744103722274303, -0.02437700144946575, -0.0942368358373642, -0.05935318022966385, 0.061692699790000916, 0.00081668421626091, 0.07104718685150146, -0.06171181797981262, -0.018451472744345665, 0.018318140879273415, -0.0587213896214962, -0.05669625476002693, -0.0965672954916954, -0.009250937961041927, 0.07831896096467972, -0.040350720286369324, -0.03417835757136345, -0.013535148464143276, 0.060604166239500046, -0.07052972912788391, -0.03642542287707329, 0.03864234313368797, 0.04683658853173256, 0.033857252448797226, 0.003357555950060487, -0.019777745008468628, 0.09963295608758926, 0.022152872756123543, -0.01389948558062315, -0.09659609198570251, -0.06571044772863388, -0.05318620428442955, -0.023405006155371666, 0.015895681455731392, -0.0312577448785305, 0.02510378509759903, 0.01658819429576397, 0.08966116607189178, 0.02952175959944725, -0.03553019091486931, 0.07855967432260513, 0.021958280354738235, -0.009800317697227001, -0.012978632934391499, 0.1005866751074791, -0.0008774858433753252, -0.025407811626791954, -0.0046261087991297245, 0.010271706618368626, 0.01583779603242874, -0.03598402813076973, -0.050281912088394165, -0.07068639248609543, -0.016237659379839897, -0.05123727768659592, 0.026473194360733032, 0.02963276021182537, -0.04249947518110275, 0.042550768703222275, -0.04486041143536568, 0.002990707056596875, 0.06520437449216843, 0.050073400139808655, 0.006880220025777817, -0.016297027468681335, 0.056246981024742126, 0.02143591083586216, 0.08179879933595657, -4.213189441770737e-08, 1.1463275768619496e-05, -0.007095638662576675, -0.019783107563853264, 0.03463795408606529, 0.055514417588710785, -0.021819448098540306, 0.004498888272792101, -0.007807973772287369, -0.039016492664813995, -0.04725416377186775, 0.00906870886683464, 0.016273682937026024, -0.06490562856197357, 0.0015283580869436264, -0.035938456654548645, 0.03754745051264763, 0.0010344069451093674, 0.01560808066278696, 0.12369119375944138, -0.013031557202339172, -0.04001850634813309, 0.010635511949658394, 0.03387804701924324, 0.11552997678518295, -0.010110183618962765, -0.008728663437068462, 0.006887365598231554, 0.02850094996392727, 0.11669319123029709, -0.04910396784543991, 0.029466629028320312, -0.06787161529064178, 0.005459239706397057, -0.05852910503745079, 0.007433969993144274, -0.00243171164765954, -0.012310117483139038, 0.02682534046471119, -0.08242733776569366, 0.06558287143707275, -0.00779098691418767, 0.06877119094133377, -0.01183317694813013, -0.03201742097735405, 0.1319965273141861, 0.0023984224535524845, 0.07444039732217789, -0.03835950419306755, 0.08957018703222275, -0.0036517316475510597, 0.036838844418525696, 0.045381221920251846, -0.00018536773859523237, 0.003797394223511219, -0.05698143690824509, -0.04191320389509201, -0.014138900674879551, 0.09532734751701355, -0.004088833462446928, -0.027755605056881905, -0.00796637125313282, 0.007989136502146721, 0.013876513577997684, 0.007999888621270657 ] }, { "text": "return best_word\n\nIn [18]:\n\nexample_list = [('italy', 'italian', 'spain'),\n('india', 'delhi', 'japan'),\n('man', 'woman', 'boy'),\n('small', 'smaller', 'large'),\n('small', 'smaller', 'big')]\nfor triad in example_list:\nprint ('{} -> {} :: {} -> {}'.format( *triad, complete_analogy(*triad, word_to_vec_map)))\n\nitaly -> italian :: spain -> spanish\nindia -> delhi :: japan -> tokyo\nman -> woman :: boy -> girl\nsmall -> smaller :: large -> smaller\nsmall -> smaller :: big -> competitors\n\nAs you can see, it can't catch \"bigger\" for the latest example.\n\n4 - Debiasing Word Vectors¶\n\nLet's begin by computing a vector $g = e_{woman}-e_{man}$.\n\nThe resulting vector $g$ roughly encodes the concept of \"gender\".", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_12", "embedding": [ 0.06597378849983215, 0.03799379616975784, 0.037126872688531876, -0.06579183787107468, 0.052400268614292145, -0.009904693812131882, 0.009137707762420177, -0.04300926998257637, -0.09611117094755173, 0.050878118723630905, 0.0813412144780159, 0.0035244335886090994, 0.05487172305583954, 0.027616068720817566, 0.016174890100955963, 0.07027529925107956, 0.0153372623026371, 0.07271542400121689, -0.008627229370176792, -0.10502011328935623, 0.03875971958041191, 0.001757122459821403, -0.054751407355070114, -0.010966365225613117, 0.010759892873466015, 0.027263255789875984, -0.012532380409538746, 0.03350047394633293, -0.03921562433242798, -0.0073906187899410725, 0.027361799031496048, 0.09202385693788528, 0.0773313045501709, 0.06669255346059799, -0.024243654683232307, 0.010845866054296494, -0.07460396736860275, -0.009959210641682148, 0.03354900702834129, 0.07003100216388702, -0.04110516607761383, 0.012964011169970036, -0.01770051196217537, 0.021054081618785858, 0.026471374556422234, 0.016131587326526642, -0.03578076884150505, 0.051263902336359024, -0.033684056252241135, -0.04222488030791283, -0.0688520148396492, 0.002342380816116929, -0.07564971596002579, 0.0471528023481369, -0.032457537949085236, -0.042293306440114975, -0.05459290370345116, -0.09159794449806213, -0.04681488126516342, -0.12584573030471802, -0.018469013273715973, -0.06899049133062363, -0.006889115087687969, 0.003121536923572421, -0.0232382919639349, -0.04414939507842064, 0.048523012548685074, 0.11464636027812958, -0.04972536116838455, 0.14086966216564178, 0.1078517735004425, 0.044964492321014404, -0.07443588227033615, 0.03742804750800133, -0.014070607721805573, 0.07644643634557724, 0.050908662378787994, -0.08286421746015549, 0.016547057777643204, -0.019323226064443588, -0.09069828689098358, -0.03448930010199547, 0.031463872641325, -0.005575207062065601, 0.027324512600898743, 0.042380884289741516, 0.007475175429135561, -0.1278308779001236, 0.007307291030883789, 0.005945806857198477, -0.0690905898809433, -0.047273486852645874, 0.07304155826568604, 0.013801086694002151, 0.029685111716389656, 0.0009376113303005695, 0.06188886985182762, -0.03318435326218605, -0.0010132836177945137, 0.06987705826759338, 0.09511213004589081, 0.0010827393271028996, 0.017572397366166115, -0.04994870349764824, -0.06705549359321594, -0.031952887773513794, 0.03848801180720329, -0.03355710580945015, 0.02222745306789875, -0.07075489312410355, -0.0692475363612175, 0.019254226237535477, -0.03713983669877052, 0.009144448675215244, -0.03623971343040466, -0.01692045107483864, 0.0005049906321801245, 0.05603262782096863, 0.07264034450054169, 0.03825749456882477, -0.0014600676950067282, 0.0663524866104126, 0.03248362988233566, 0.011065232567489147, -0.04918697848916054, 0.01954195648431778, -0.05767703801393509, -1.4191353914973767e-33, -0.05799414590001106, -0.03463735431432724, 0.024735836312174797, -0.0011322133941575885, -0.009512815624475479, -0.0026150234043598175, -0.03263218328356743, -0.04207169637084007, -0.0953073725104332, 0.012882044538855553, -0.09119351953268051, 0.07244961708784103, -0.01437043584883213, 0.05073579400777817, 0.06075148656964302, 0.0005689365207217634, 0.07625367492437363, 0.009020223282277584, -0.10892540216445923, -0.03399396315217018, 0.04537231847643852, 0.048960644751787186, -0.006624311674386263, -0.0420982651412487, -0.10904860496520996, -0.06159421056509018, 0.02210194058716297, -0.06004892289638519, -0.029436180368065834, 0.0023101335391402245, -0.06103213131427765, -0.051385920494794846, 0.10405037552118301, 0.03595379739999771, 0.01015823520720005, -0.010241671465337276, 0.03494228795170784, -0.04778663069009781, -0.03140490502119064, -0.031209133565425873, -0.02158934995532036, -0.02054351568222046, 0.021050795912742615, 0.020088037475943565, 0.08174055069684982, 0.03511034697294235, 0.008569827303290367, 0.010499749332666397, -0.06457870453596115, 0.040661267936229706, 0.01743188314139843, -0.03442700579762459, -0.004495264962315559, 0.0898343101143837, -0.01300077699124813, 0.05070247873663902, 0.04193867743015289, -0.0012757879449054599, -0.018883904442191124, 0.020045746117830276, -0.008884789422154427, 0.02389884926378727, 0.07112336903810501, -0.005196206737309694, 0.02559029310941696, 0.006039721425622702, -0.012156777083873749, 0.04816507548093796, 0.057491518557071686, 0.08268281072378159, 0.022241748869419098, 0.04179193824529648, -0.035430118441581726, 0.05659760162234306, 0.026676710695028305, 0.03497981280088425, -0.018118353560566902, -0.08310116082429886, -0.01805901899933815, -0.025742020457983017, -0.061994247138500214, 0.0044053238816559315, -0.011505325324833393, -0.03258545696735382, -0.07260706275701523, -0.0792713463306427, 0.029572730883955956, -0.14911846816539764, 0.10300299525260925, 0.06559037417173386, -0.09838084876537323, 0.024430599063634872, 0.022636886686086655, -0.023830905556678772, -0.02852555923163891, -1.4241575992757688e-33, -0.10407143831253052, -0.02386830933392048, 0.07040723413228989, -0.0395430289208889, -0.04263998940587044, -0.07010477036237717, 0.08518783003091812, 0.02766481414437294, 0.01225651428103447, -0.007790445350110531, -0.055776070803403854, -0.07226473093032837, 0.10287120193243027, -0.08991581201553345, 0.1356293261051178, -0.02324090711772442, 0.018904877826571465, 0.043480563908815384, 0.04309583082795143, 0.0668114647269249, 0.047336727380752563, 0.014488263987004757, -0.037444472312927246, 0.04275049641728401, 0.027531621977686882, 0.01208331249654293, 0.07763925939798355, -0.046794287860393524, 0.011453578248620033, -0.09696869552135468, -0.003171401796862483, -0.030868753790855408, -0.0015663446392863989, 0.12080948799848557, 0.006655146833509207, 0.01860499009490013, -0.11051562428474426, -0.03697357326745987, -0.003924871329218149, 0.004984002560377121, -0.07522733509540558, 0.05875255912542343, -0.031633101403713226, -0.014737805351614952, -0.016272999346256256, -0.01041429117321968, -0.016085725277662277, -0.0007482231012545526, 0.05114845931529999, -0.0025232210755348206, 0.033184319734573364, 0.028696399182081223, -0.09523624926805496, 0.0670083537697792, 0.06014986336231232, -0.08643364161252975, -0.046483058482408524, -0.032413557171821594, -0.04592088237404823, 0.04248342663049698, -0.03167359158396721, -0.02598319575190544, -0.037010617554187775, 0.06952446699142456, 0.051466431468725204, -0.0802946537733078, -0.0552009753882885, -0.03902261704206467, 0.027985209599137306, -0.05035971850156784, 0.014213182963430882, 0.07328229397535324, -0.0738568976521492, -0.01766866259276867, -0.061755482107400894, -0.0004312077071517706, -0.07247411459684372, 0.002616260200738907, -0.05050419270992279, -0.03663010522723198, -0.04155909642577171, -0.00890984944999218, 0.08741652220487595, 0.10354918986558914, -0.06689586490392685, -0.003552311332896352, 0.047853048890829086, 0.04956302046775818, 0.042551565915346146, 0.07717602699995041, -0.009757122956216335, -0.030100323259830475, 0.016318703070282936, 0.0760270431637764, 0.04513993114233017, -5.214549503307353e-08, -0.10887899249792099, -0.040979210287332535, -0.05822626128792763, 0.02838062308728695, -0.03935118392109871, -0.06772911548614502, -0.005741626024246216, -0.05302854999899864, -0.03994712233543396, 0.02213970199227333, 0.018125874921679497, 0.009856084361672401, -0.07927864044904709, -0.03452577069401741, 0.06355859339237213, -0.020460763946175575, 0.020562581717967987, 0.019884034991264343, 0.012918995693325996, -0.04280875250697136, -0.005482711363583803, 0.03643769398331642, -0.05202266573905945, 0.0447436198592186, -0.061865661293268204, 0.021344762295484543, -0.030831219628453255, 0.022592229768633842, 0.06816327571868896, -0.008701288141310215, 0.06451325118541718, -0.014159842394292355, -0.021450186148285866, -0.05699053406715393, -0.01646685041487217, 0.010494105517864227, -0.09275741875171661, 0.047988567501306534, 0.06038730591535568, 0.01823068968951702, 0.003956443630158901, -0.03071526065468788, -0.052892960608005524, 0.013291154988110065, 0.0909867063164711, -0.06905432790517807, -0.009540162980556488, -0.05698186904191971, 0.04252965375781059, 0.004961440805345774, -0.03333267197012901, 0.0040996987372636795, -1.4237574532671715e-06, -0.06567844748497009, 0.02584732696413994, -0.07687344402074814, 0.005244872998446226, 0.059644438326358795, -0.008770435117185116, -0.024849815294146538, 0.07197108864784241, -0.017942272126674652, 0.034241873770952225, 0.012924296781420708 ] }, { "text": "Let's begin by computing a vector $g = e_{woman}-e_{man}$.\n\nThe resulting vector $g$ roughly encodes the concept of \"gender\".\n\nThis is not the best way of reducing the gender bias. It doesn't eliminate all traces of bias, the bias direction $g$ was defined using only the pair of words woman and man.\n\nif $g$ were defined by computing $g_1 = e_{woman} - e_{man}$; $g_2 = e_{mother} - e_{father}$; $g_3 = e_{girl} - e_{boy}$; and so on and averaging over them, you would obtain a better estimate of the \"gender\" dimension in the 50 dimensional word embedding space.\n\nIn [19]:\n\ng = word_to_vec_map['woman'] - word_to_vec_map['man']\nprint(g)", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_13", "embedding": [ 0.012259284034371376, -0.010221058502793312, 0.03607876971364021, -0.03057677671313286, 0.006737048272043467, 0.038179997354745865, 0.0021027224138379097, -0.06689716875553131, -0.034279026091098785, 0.01395308319479227, 0.0011713881976902485, -0.046101875603199005, 0.04766722768545151, -0.045349761843681335, 0.0035554927308112383, 0.04485458508133888, 0.0431886650621891, 0.08959873765707016, -0.039886340498924255, -0.02610425092279911, -0.0034047309309244156, -0.017177648842334747, 0.05386215075850487, -0.04409771040081978, 0.012547744438052177, -0.038130249828100204, -0.03657865151762962, 0.01880766823887825, -0.058046210557222366, 0.04680025205016136, 0.07573247700929642, 0.07252664864063263, 0.13235293328762054, -0.016298338770866394, -0.13891378045082092, -0.01872340962290764, -0.08636138588190079, 0.008022555150091648, 0.018063301220536232, 0.04292656481266022, -0.0193120576441288, 0.004021723289042711, -0.08305814862251282, 0.049383070319890976, 0.056219425052404404, 0.060836583375930786, 0.005042781122028828, -0.0038376033771783113, -0.0684671550989151, -0.005951061379164457, 0.029292607679963112, -0.06333276629447937, -0.025204485282301903, 0.07601644098758698, -0.12858454883098602, -0.04986003041267395, -0.02519763819873333, -0.014399793930351734, 0.02236783690750599, 0.0014074835926294327, -0.057062920182943344, -0.07939299196004868, -0.0003134780272375792, 0.0009170473203994334, -0.011304590851068497, -0.07234159111976624, 0.034149155020713806, 0.03826555237174034, -0.04599132761359215, 0.10549180954694748, 0.0880097970366478, 0.0827566459774971, -0.07488235831260681, 0.012317199259996414, 0.019414307549595833, 0.06304195523262024, 0.07947493344545364, -0.050044573843479156, 0.11681345850229263, -0.06012227386236191, -0.03806161880493164, -0.060716453939676285, 0.1130819171667099, 0.042330533266067505, 0.007731880992650986, -0.01289678830653429, 0.023114610463380814, -0.055385738611221313, -0.06868307292461395, 0.043311458081007004, -0.07443977147340775, -0.07946402579545975, 0.03894953429698944, 0.019857702776789665, 0.05040522664785385, -0.021465472877025604, -0.039112191647291183, -0.007004524581134319, 0.005049804225564003, 0.05167858302593231, 0.03567398712038994, 0.04258169233798981, 0.017556071281433105, -0.03432627022266388, -0.035299722105264664, -0.06768695265054703, 0.08844563364982605, 0.01388628501445055, -0.06541894376277924, -0.11197101324796677, -0.04405977576971054, -0.04301360622048378, -0.03496577963232994, 0.07119546085596085, -0.030114874243736267, -0.08334604650735855, 0.07573401927947998, 0.04261481761932373, 0.08423328399658203, -0.03730180859565735, -0.02354554459452629, 0.012491347268223763, 0.06001950055360794, 0.02724425494670868, -0.020619047805666924, 0.014183619990944862, -0.014312321320176125, 2.0569986665298748e-33, -0.05055401474237442, 0.010990099050104618, -0.01114417240023613, 0.050523921847343445, 0.027326518669724464, 0.0921127125620842, 0.053234826773405075, 0.013090468943119049, 0.0072409966960549355, -0.023620925843715668, -0.054041195660829544, 0.04198881983757019, 0.00596853531897068, -0.018640639260411263, -0.02543472684919834, 0.020083552226424217, 0.015452295541763306, 0.05094662681221962, -0.06530711054801941, 0.0280869510024786, 0.08673940598964691, 0.08948347717523575, -0.032005175948143005, -0.07918912172317505, -0.0575859397649765, -0.05179509520530701, 0.01061368826776743, -0.007920860312879086, -0.03897448629140854, -0.005847950931638479, -0.02897132933139801, -0.07793332636356354, 0.049904920160770416, -0.039831940084695816, 0.009977076202630997, -0.046319156885147095, 0.06674552708864212, 0.06307747960090637, -0.051159441471099854, 0.053638797253370285, -0.0017439782386645675, -0.006507753394544125, 0.09259069710969925, -0.09846881777048111, -0.06962507218122482, 0.06609193235635757, 0.07293066382408142, 0.048403434455394745, -0.03492724150419235, 0.034828752279281616, -0.03220190107822418, 0.024831168353557587, -0.005364838521927595, 0.06062689423561096, 0.023981081321835518, 0.04995647817850113, 0.026582669466733932, 0.025700263679027557, 0.01856122352182865, -0.04126310348510742, -0.009094499051570892, 0.03314339742064476, 0.1050102636218071, -0.010224859230220318, -0.007371382787823677, 0.004118730779737234, -0.008035315200686455, -0.010691112838685513, 0.026086565107107162, 0.07103170454502106, 0.022015739232301712, 0.06832748651504517, -0.05420473590493202, 0.007570911664515734, -0.03707752749323845, 0.07928116619586945, 0.01960449479520321, -0.03852769732475281, -0.03002939000725746, 0.008613940328359604, -0.002787863602861762, 0.03228938207030296, -0.028207717463374138, -0.11675303429365158, -0.12100397795438766, -0.1410159468650818, -0.00012234499445185065, -0.10072750598192215, 0.0554845854640007, 0.06472834944725037, -0.012711314484477043, 0.004610454197973013, -0.013047165237367153, 0.0173646230250597, 0.00765999173745513, -3.233012071576447e-33, -0.08202891796827316, -0.017343638464808464, 0.05078543722629547, 0.054562512785196304, -0.0067217107862234116, -0.04254122078418732, 0.11844722926616669, 0.0173395536839962, 0.04106498137116432, 0.04279593005776405, -0.06902235001325607, -0.07063653320074081, 0.07069123536348343, 0.006254499312490225, 0.11874588578939438, -0.03300435468554497, -0.038700904697179794, -0.013579471968114376, 0.07154908031225204, 0.022187262773513794, 0.0772494375705719, 0.04123981297016144, -0.024867786094546318, 0.07092029601335526, 0.05614123493432999, 0.0479317381978035, 0.08174727857112885, -0.04309086129069328, 0.008369533345103264, 0.027489136904478073, -0.036947499960660934, -0.11393165588378906, -0.07042894512414932, 0.07185456901788712, -0.0032063662074506283, -0.0886325016617775, -0.07078355550765991, 0.09534177929162979, 0.01393901277333498, 0.02033902518451214, -0.011762258596718311, 0.04794986918568611, -0.09717199206352234, -0.07315580546855927, 0.011213201098144054, 0.052037887275218964, -0.014423795975744724, 0.025143813341856003, 0.06750417500734329, -0.009626953862607479, -0.07806739956140518, 0.00890483520925045, -0.10024943947792053, 0.04735138267278671, -0.0008410643204115331, -0.06819076091051102, 0.0138573432341218, -0.061531491577625275, -0.029294051229953766, 0.06346301734447479, -0.02904249168932438, -0.05188864469528198, -0.05897469446063042, -0.01740569993853569, -0.08720617741346359, -0.046217188239097595, 0.006031911354511976, -0.07512854039669037, 0.03553672134876251, 0.030636509880423546, 0.039034776389598846, -0.04797238111495972, -0.04682286083698273, 0.02781968005001545, -0.025324981659650803, 0.039619095623493195, 0.030506566166877747, -0.03442275524139404, -0.054219841957092285, -0.04652274772524834, 0.003985899966210127, -0.05456620454788208, 0.07627987116575241, -0.021752549335360527, -0.037470098584890366, 0.015276778489351273, -0.004844435025006533, 0.023313967511057854, 0.030581984668970108, 0.024200228974223137, 0.003912028390914202, -0.011054852977395058, -0.0320860929787159, 0.04803948849439621, -0.0370015911757946, -4.7148098758498236e-08, -0.04885438457131386, -0.03272419795393944, 0.018482059240341187, 0.04750550165772438, -0.0464496985077858, -0.14126969873905182, 0.013905004598200321, -0.05546668544411659, -0.0130463857203722, 0.020397184416651726, -0.014362112618982792, 0.032247353345155716, 0.008273830637335777, -0.00952650886029005, 0.07485359162092209, -0.035848330706357956, 0.02070898376405239, 0.001558050629682839, 0.04239773377776146, 0.0013675070367753506, 0.03492506965994835, -0.003219036152586341, -0.04509827122092247, -0.03643474355340004, -0.04726160690188408, 0.018022265285253525, 0.025791550055146217, 0.0301505159586668, -0.004457553848624229, -0.07936763763427734, 0.05532405525445938, 0.07104546576738358, -0.03997902199625969, -0.008799979463219643, 0.037618428468704224, -0.012732580304145813, -0.06931686401367188, 0.012521505355834961, 0.019989605993032455, 0.05727913975715637, 0.01360114011913538, -0.004636555910110474, 0.06193942204117775, -0.042473383247852325, 0.08224253356456757, 0.03699611499905586, 0.05962599068880081, 0.05413258075714111, -0.024474553763866425, 0.03963099420070648, 0.045178674161434174, 0.015393278561532497, -0.02817012555897236, -0.015958355739712715, 0.039939310401678085, -0.06753523647785187, 0.0007757721468806267, -0.013339695520699024, 0.009639349766075611, 0.030706437304615974, -0.01451302319765091, -0.030304402112960815, -0.04166649281978607, -0.13029251992702484 ] }, { "text": "In [19]:\n\ng = word_to_vec_map['woman'] - word_to_vec_map['man']\nprint(g)\n\n[-0.087144 0.2182 -0.40986 -0.03922 -0.1032 0.94165\n-0.06042 0.32988 0.46144 -0.35962 0.31102 -0.86824\n0.96006 0.01073 0.24337 0.08193 -1.02722 -0.21122\n0.695044 -0.00222 0.29106 0.5053 -0.099454 0.40445\n0.30181 0.1355 -0.0606 -0.07131 -0.19245 -0.06115\n-0.3204 0.07165 -0.13337 -0.25068714 -0.14293 -0.224957\n-0.149 0.048882 0.12191 -0.27362 -0.165476 -0.20426\n0.54376 -0.271425 -0.10245 -0.32108 0.2516 -0.33455\n-0.04371 0.01258 ]\n\nIn [20]:\n\nprint ('List of names and their similarities with constructed vector:')\n\n# girls and boys name\nname_list = ['john', 'marie', 'sophie', 'ronaldo', 'priya', 'rahul', 'danielle', 'reza',\n'katy', 'yasmin']\n\nfor w in name_list:\nprint (w, cosine_similarity(word_to_vec_map[w], g))", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_14", "embedding": [ 0.011444873176515102, 0.005075340159237385, -0.014260286465287209, 0.007361527532339096, -0.040281958878040314, -0.0670289695262909, 0.016586853191256523, -0.04411269724369049, -0.07319768518209457, 0.021419024094939232, 0.05540979653596878, -0.018132932484149933, -0.013095050118863583, -0.03956528380513191, -0.059649959206581116, -0.0035522228572517633, -0.08818648010492325, 0.053303807973861694, 0.016746070235967636, -0.07600077241659164, 0.016071250662207603, 0.11443984508514404, -0.0006920338491909206, -0.0762769803404808, 0.049219414591789246, 0.020137673243880272, -0.05895440652966499, 0.07852797955274582, -0.024615906178951263, -0.02490219846367836, 0.01332324929535389, 0.09828782081604004, 0.08263929933309555, 0.01676063798367977, -0.007419489324092865, -0.01638498343527317, -0.012600479647517204, -0.02183067798614502, 0.06029398739337921, 0.0614931546151638, 0.03343328833580017, -0.07858792692422867, 0.02238791435956955, -0.006322958506643772, 0.061150360852479935, 0.02379940263926983, -0.04330970719456673, 0.0580403171479702, -0.017491420730948448, -0.012103425338864326, 0.001653773244470358, -0.003554465714842081, -0.09002306312322617, 0.04739946499466896, -0.04330036789178848, -0.032535962760448456, -0.008579116314649582, -0.0969969630241394, 0.03838934004306793, -0.10136941075325012, -0.06579267233610153, 0.015002550557255745, -0.031985580921173096, -0.025574717670679092, 0.03999127820134163, -0.050139471888542175, 0.002617754740640521, 0.0380491279065609, 0.02879001572728157, 0.11565791070461273, 0.05024268850684166, 0.012462716549634933, -0.07807904481887817, -0.04367782920598984, -0.05409467592835426, -0.005981230176985264, 0.007665934506803751, -0.062193114310503006, 0.05998516455292702, -0.0367344431579113, -0.009211762808263302, -0.042185988277196884, 0.07801194489002228, 0.10418324172496796, -0.05157962813973427, -0.04965792968869209, -0.027611143887043, 0.0031107482500374317, 0.016334038227796555, 0.02722916565835476, -0.08707962930202484, -0.05159570276737213, -0.047901052981615067, 0.04204244539141655, -0.04078705608844757, 0.0794917568564415, 0.011094795539975166, -0.00393002200871706, -0.004615811165422201, 0.07373025268316269, 0.033501919358968735, -0.026047347113490105, 0.03504486754536629, -0.05876675248146057, -0.051702652126550674, 0.019607651978731155, 0.0258393045514822, 0.029233518987894058, -0.03342602029442787, -0.08222057670354843, -0.020392324775457382, -0.01571739837527275, 0.00048363348469138145, -0.007303621154278517, -0.0077962507493793964, -0.07787037640810013, -0.025638068094849586, 0.06459204852581024, 0.08412287384271622, 0.10497410595417023, -0.024956703186035156, -0.001384981325827539, -0.008304363116621971, 0.02610742300748825, -0.13493916392326355, 0.00699170446023345, 0.021439481526613235, 3.636640464792342e-33, -0.04353831708431244, 0.0024749343283474445, 0.06864823400974274, -0.03677177429199219, 0.03658397123217583, 0.11826163530349731, -0.03896911069750786, -0.0713772177696228, -0.043030865490436554, 0.04575962573289871, -0.09072582423686981, 0.019901465624570847, -0.04427901655435562, 0.03577649965882301, -0.027611806988716125, -0.01612052693963051, 0.056842587888240814, 0.006654719356447458, -0.15798261761665344, -0.0222913920879364, 0.020222174003720284, 0.06877560913562775, -0.013757620006799698, -0.07679352164268494, 0.017877720296382904, 0.01845291256904602, -0.054786719381809235, -0.035632237792015076, -0.008834355510771275, 0.010869000107049942, -0.007918617688119411, 0.0576123483479023, -0.010868069715797901, -0.0455884225666523, 0.0659518614411354, -0.029063889756798744, 0.049551066011190414, 0.013099689036607742, -0.06503983587026596, -0.0055257962085306644, -0.06012660637497902, -0.020782412961125374, 0.017967725172638893, -0.044568534940481186, 0.029796427115797997, 0.03754032403230667, 0.0473908931016922, 0.0760091170668602, -0.029658768326044083, 0.07725394517183304, -0.013019245117902756, -0.034876782447099686, -0.04145515337586403, 0.0821681022644043, 0.0146168889477849, -0.03981005772948265, 0.08139225840568542, 0.031831830739974976, 0.027555767446756363, 0.06841019541025162, 0.014047328382730484, 0.09010358154773712, 0.06310838460922241, 0.01601393148303032, 0.03109254688024521, -0.02163173072040081, 0.0011290527181699872, 0.025356413796544075, -0.02522047609090805, 0.11074917018413544, -0.02423754706978798, 0.07246259599924088, 0.03854718059301376, 0.04226559400558472, -0.003769990988075733, 0.03181278333067894, 0.04367032274603844, -0.08375124633312225, -0.04716027155518532, -0.04422803223133087, -0.050433866679668427, 0.042173121124506, -0.027977416291832924, -0.13253363966941833, -0.0717630460858345, -0.06298524141311646, -0.06224745139479637, -0.11001510918140411, -0.008616096340119839, -0.015015064738690853, -0.12093911319971085, 0.012707820162177086, -0.005202260799705982, -0.03097144514322281, -0.09845616668462753, -5.044706740266804e-33, -0.04104885458946228, 0.05941016599535942, 0.07600054889917374, 0.05688008666038513, 0.017838604748249054, -0.03883412480354309, 0.15558958053588867, 0.01992805302143097, 0.08273269236087799, 0.08753174543380737, -0.009882726706564426, -0.02516022138297558, 0.08683376014232635, -0.008573540486395359, 0.17199763655662537, -0.0836009681224823, -0.024378949776291847, 0.03635595738887787, -0.013834246434271336, -0.020630741491913795, -0.01533508114516735, 0.03570984676480293, 0.010679342783987522, 0.07173123210668564, 0.008374212309718132, 0.03480464592576027, 0.08686753362417221, -0.01518592331558466, -0.0541301853954792, 0.048878978937864304, -0.04246300458908081, -0.07719022780656815, -0.033339161425828934, 0.06279030442237854, 0.015675973147153854, 0.023059116676449776, -0.032306160777807236, 0.09353180974721909, 0.013541958294808865, -0.004377058707177639, -0.008360210806131363, 0.06771091371774673, -0.03171543404459953, -0.02533475123345852, -0.014475622214376926, 0.0683184266090393, 0.03608446195721626, 0.033757008612155914, -0.018217144533991814, -0.02173132449388504, 0.034233786165714264, 0.059857070446014404, -0.11385270953178406, 0.0513768307864666, 0.024133970960974693, -0.029942620545625687, -0.03801996260881424, -0.07597028464078903, -0.07108010351657867, -0.004709847737103701, -0.06932291388511658, -0.06196269392967224, 0.04855140298604965, 0.048032037913799286, 0.0354655459523201, -0.055464137345552444, -0.06494679301977158, -0.08002915978431702, -0.011443797498941422, 0.018455423414707184, 0.06360133737325668, -0.0016047406243160367, -0.0013294925447553396, 0.01726960577070713, 0.008401770144701004, -0.032185401767492294, -0.022411860525608063, -0.009119445458054543, -0.01777557283639908, -0.05986974388360977, -0.03012612648308277, -0.048542652279138565, 0.0833062008023262, 0.12789252400398254, -0.040868282318115234, -0.022141318768262863, -0.014183987863361835, 0.0594584196805954, 0.03184692561626434, 0.050185177475214005, -0.028264664113521576, 0.06148090213537216, -0.040680818259716034, 0.08677386492490768, 0.00508856913074851, -6.469640112527486e-08, -0.055103182792663574, -0.03953908011317253, -0.01329384557902813, -0.027446823194622993, 0.021809067577123642, -0.019297225400805473, 0.011524917557835579, -0.06852947920560837, -0.029427673667669296, -0.01626734808087349, 0.05198660492897034, -0.009426369331777096, -0.03956766054034233, -0.06249072775244713, 0.07335489988327026, 0.019688140600919724, 0.0726684033870697, -0.004556955303996801, -0.04198333993554115, -0.05360307916998863, 0.0339568667113781, 0.042703818529844284, -0.08140487968921661, 0.011169817298650742, -0.08490199595689774, 0.018060751259326935, -0.021794017404317856, 0.05042269080877304, 0.0313626229763031, -0.042810991406440735, 0.10336776077747345, -0.028350630775094032, 0.013183127157390118, -0.009499491192400455, -0.06044080853462219, -0.011796426959335804, -0.040661174803972244, 0.013045589439570904, 0.008122310973703861, 0.05288706719875336, -0.042094636708498, 0.02406751736998558, 0.035387616604566574, 0.02835933305323124, 0.019230345264077187, -0.02201119065284729, 0.06164984777569771, 0.03892991691827774, 0.02047570049762726, 0.016674518585205078, 0.005607573315501213, 0.03533734753727913, -0.021444477140903473, -0.030769677832722664, 0.013533531688153744, -0.07295279949903488, 0.009662814438343048, 0.029744146391749382, -0.0975717306137085, -0.008502385579049587, -0.0057023437693715096, -0.02326361835002899, 0.025322608649730682, -0.0357322134077549 ] }, { "text": "for w in name_list:\nprint (w, cosine_similarity(word_to_vec_map[w], g))\n\nList of names and their similarities with constructed vector:\njohn -0.23163356145973724\nmarie 0.315597935396073\nsophie 0.31868789859418784\nronaldo -0.31244796850329437\npriya 0.17632041839009402\nrahul -0.16915471039231716\ndanielle 0.24393299216283895\nreza -0.07930429672199553\nkaty 0.2831068659572615\nyasmin 0.23313857767928758\n\nAs you can see, female first names tend to have a positive cosine similarity with our constructed vector $g$, while male first names tend to have a negative cosine similarity. This is not surprising, and the result seems acceptable.\n\nNow try with some other words:\n\nIn [21]:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_15", "embedding": [ -0.06207403540611267, 0.008070850744843483, -0.025476450100541115, -0.025016548112034798, -0.029521001502871513, -0.026162203401327133, 0.015423255041241646, -0.0024098651483654976, -0.029959673061966896, 0.022395934909582138, 0.11892267316579819, -0.047071412205696106, 0.033181723207235336, -0.00868487823754549, -0.0886230394244194, 0.003648974932730198, -0.02762865275144577, 0.010764599777758121, 0.0022599108051508665, -0.027649544179439545, -0.04218864440917969, 0.009077046997845173, 0.014385409653186798, -0.028376949951052666, 0.03342902287840843, 0.034337952733039856, 0.023979783058166504, 0.07075679302215576, -0.04496948421001434, -0.01890198141336441, 0.016353029757738113, 0.043559350073337555, 0.06481585651636124, 0.05425587296485901, -0.06470003724098206, -0.00818233285099268, -0.013735434971749783, 0.04427969083189964, 0.047230079770088196, -0.017323410138487816, -0.020344102755188942, -0.04484518989920616, -0.01071174256503582, 0.07358122617006302, -0.06304272264242172, 0.0057237958535552025, -0.07868495583534241, 0.08445968478918076, 0.0036136331036686897, -0.0243244506418705, -0.12335702776908875, -0.014211277477443218, -0.08229532837867737, -0.01396218128502369, -0.049718718975782394, -0.026591863483190536, -0.021486567333340645, -0.04845818877220154, -0.03563370928168297, -0.036997776478528976, -0.06190817430615425, -0.01737322099506855, 0.006224112585186958, -0.07118940353393555, 0.021261688321828842, -0.012464301660656929, 0.05309493467211723, 0.004681707359850407, -0.023123037070035934, 0.0832679495215416, 0.08727367222309113, 0.08037438988685608, -0.07848641276359558, 0.037701528519392014, -0.15348944067955017, 0.06959135830402374, -0.028327077627182007, 0.05092736706137657, -0.013180723413825035, -0.030930962413549423, 0.0018593919230625033, -0.024009838700294495, -0.006250095088034868, 0.01427125558257103, -0.02809426560997963, 0.041024189442396164, -0.052434246987104416, -0.12991638481616974, -0.020063070580363274, 0.011981885880231857, -0.09958252310752869, -0.04637894779443741, 0.07622276991605759, 0.048207640647888184, 0.02853577770292759, 0.007593458518385887, 0.06761683523654938, 0.0696699470281601, -0.07411054521799088, 0.02454058639705181, -0.01169451791793108, 0.02564508467912674, 0.04981330782175064, 0.028942802920937538, -0.026738781481981277, -0.0284263975918293, 0.019461318850517273, -0.013888257555663586, 0.024645086377859116, -0.0955759659409523, -0.034857723861932755, -0.0041873943991959095, -0.06529897451400757, -0.006267578806728125, 0.00035148061579093337, -0.0646943598985672, 0.04768335446715355, 0.03828123211860657, -0.005912404973059893, 0.02687176689505577, 0.012548452243208885, 0.05614291876554489, -0.032788317650556564, 0.028822148218750954, -0.06584759801626205, -0.012735850177705288, -0.03138330578804016, 4.3432756694777136e-33, -0.028266582638025284, 0.062363747507333755, 0.04283273592591286, 0.06141073629260063, -0.046341799199581146, 0.009239652194082737, -0.12758323550224304, -0.002236345550045371, -0.052369821816682816, -0.056060947477817535, -0.11559686064720154, 0.03600045666098595, 0.033479511737823486, -0.02192942053079605, -0.050138138234615326, 0.08730864524841309, 0.017509298399090767, -0.024776015430688858, -0.13638997077941895, 0.010906296782195568, 0.0804964005947113, 0.03921058028936386, 0.008194077759981155, -0.051037151366472244, -0.044523537158966064, -0.03205408528447151, -0.003958336543291807, -0.06783585995435715, -0.022749440744519234, -0.022443585097789764, -0.018306750804185867, -0.026930473744869232, 0.07078397274017334, 0.01593663915991783, 0.06720799952745438, -0.029854167252779007, 0.06120244786143303, -0.0911836177110672, -0.06725297123193741, 0.037259068340063095, -0.039471253752708435, 0.006786474026739597, -0.045122891664505005, 0.01706703193485737, 0.004033420234918594, -0.030744118615984917, 0.06870371848344803, -0.006097227800637484, -0.03028898872435093, 0.03430803120136261, -0.027887767180800438, 0.020577343180775642, -0.10462541878223419, 0.08155080676078796, -0.08916068822145462, -0.016221115365624428, 0.0932023674249649, 0.06259944289922714, -0.018027979880571365, 0.04184738174080849, 0.05649691820144653, 0.005004929378628731, 0.0382329598069191, -0.00845449510961771, -0.006443831138312817, -0.08224387466907501, -0.06156488507986069, 0.05395181104540825, 0.0145597904920578, 0.1323971301317215, 0.07233387231826782, 0.024603474885225296, 0.03429444879293442, 0.061640720814466476, 0.07371994107961655, 0.048670992255210876, 0.04868210107088089, -0.07866697013378143, -0.052497148513793945, 0.01529697421938181, -0.01701614260673523, 0.06726177036762238, -0.010103928856551647, -0.12041771411895752, -0.1758512258529663, -0.06856265664100647, 0.057204678654670715, -0.12469407171010971, -0.017673926427960396, 0.03504689037799835, -0.0025037138257175684, 0.11861361563205719, 0.04661945626139641, -0.04871733486652374, -0.04969419166445732, -7.603171664199451e-33, -0.0967533066868782, -0.040400274097919464, 0.07408466190099716, -0.05500905588269234, 0.009357495233416557, 0.0008624635520391166, 0.06229586526751518, 0.03200208395719528, -0.01605231873691082, -0.06281966716051102, 0.055755555629730225, -0.10503978282213211, 0.010640914551913738, -0.0812263935804367, 0.17355744540691376, -0.0187706146389246, 0.06423237919807434, 0.06502573937177658, -0.014572180807590485, 0.009970405139029026, 0.09509073197841644, 0.048868533223867416, -0.09082799404859543, 0.023652587085962296, 0.031889062374830246, 0.007413048297166824, 0.06037263572216034, -0.055430371314287186, -0.03643549606204033, 0.024940645322203636, -0.014595524407923222, 0.026112791150808334, -0.02321290597319603, 0.04657449200749397, -0.00019173460896126926, 0.008064799942076206, -0.05193420499563217, 0.0450364425778389, 0.03348279371857643, -0.02679196372628212, -0.03143632411956787, 0.04519577696919441, -0.01097637414932251, -0.018826227635145187, -0.034945979714393616, -0.03889286518096924, -0.012114890851080418, -0.019115479663014412, 0.09556502103805542, 0.019647696986794472, 0.035548143088817596, 0.024451356381177902, -0.14822053909301758, 0.036533962935209274, 0.06222303956747055, -0.0564948208630085, -0.047212038189172745, -0.04179016873240471, -0.009402009658515453, 0.06714457273483276, -0.0202222540974617, -0.024121107533574104, -0.04309796541929245, 0.0496271513402462, 0.012499473057687283, -0.09466271847486496, -0.011943495832383633, 0.015419300645589828, 0.047296784818172455, -0.046212952584028244, -0.02959931083023548, -0.03340592980384827, -0.04339921846985817, -0.03117532469332218, -0.016855642199516296, -0.0011230427771806717, -0.016367275267839432, -0.0005000311648473144, -0.06579563021659851, -0.044910598546266556, -0.039429955184459686, -0.030331183224916458, 0.015429353341460228, 0.06935452669858932, -0.004924542736262083, -0.0012248442508280277, 0.002861541463062167, 0.05397069826722145, 0.06016287952661514, 0.06835751980543137, 0.001270568696781993, -0.05156025290489197, 0.020275190472602844, 0.000740729330573231, 0.004413018934428692, -5.7690410670829806e-08, -0.028762733563780785, -0.09023389965295792, -0.05443548783659935, 0.04449251666665077, -0.010171028785407543, 0.006188997998833656, -0.01823027804493904, -0.07350700348615646, -0.030501144006848335, 0.08339635282754898, -0.006974108051508665, 0.039335984736680984, -0.05176609754562378, -0.008814043365418911, 0.04628106206655502, -0.005819517187774181, -0.03450188413262367, 0.05240180343389511, 0.06474970281124115, 0.016745083034038544, -0.02021535113453865, -0.010905592702329159, -0.0463828518986702, 0.022668033838272095, -0.05255468562245369, 0.01625855080783367, 0.02629617415368557, 0.02090679667890072, 0.030141355469822884, -0.029818067327141762, 0.01023069117218256, 0.021887851879000664, 0.019414760172367096, -0.03977057337760925, -0.0025604143738746643, -0.026009568944573402, -0.0020241120364516973, 0.07563679665327072, -0.019162628799676895, 0.0764278843998909, 0.04148973152041435, 0.026707427576184273, 0.011114843189716339, 0.04710004851222038, 0.08843637257814407, 0.005894412752240896, 0.06981353461742401, -0.01016590092331171, 0.020559387281537056, -0.01738506369292736, 0.02675219252705574, 0.05401528626680374, 0.022088825702667236, -0.02158989943563938, -0.01436146255582571, -0.08210502564907074, -0.009076054207980633, 0.0701722502708435, 0.02155584655702114, -0.06457506120204926, 0.04200012609362602, -0.07103762030601501, 0.05188116431236267, -0.006486742291599512 ] }, { "text": "Now try with some other words:\n\nIn [21]:\n\nprint('Other words and their similarities:')\nword_list = ['lipstick', 'guns', 'science', 'arts', 'literature', 'warrior','doctor', 'tree', 'receptionist',\n'technology', 'fashion', 'teacher', 'engineer', 'pilot', 'computer', 'singer']\nfor w in word_list:\nprint (w, cosine_similarity(word_to_vec_map[w], g))", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_16", "embedding": [ -0.00654219463467598, -0.008476067334413528, 0.006769879721105099, -0.034859780222177505, 0.004288322292268276, -0.006177082192152739, 0.021144689992070198, -0.01774435117840767, -0.12175502628087997, 0.009402219206094742, 0.12076316028833389, 0.029917974025011063, 0.0875658318400383, 0.021496297791600227, -0.03502250462770462, 0.07373148947954178, 0.006299635861068964, 0.03983430191874504, -0.010353432968258858, -0.12066926062107086, 0.03166525065898895, 0.09612689912319183, 0.011265529319643974, 0.059665657579898834, 0.0024241216015070677, 0.06074998900294304, -0.030885830521583557, 0.03139407932758331, -0.058741189539432526, 0.028330808505415916, 0.0287803802639246, 0.008105920627713203, 0.008874161168932915, 0.026513218879699707, 0.01649961806833744, 0.00823685061186552, -0.03899076581001282, -0.02362845651805401, 0.03962993249297142, -0.01673794910311699, -0.0496935099363327, -0.05224161222577095, -0.06855238974094391, 0.04313162714242935, 0.03591379523277283, -0.01619320549070835, -0.09386022388935089, 0.05039403215050697, 0.038535263389348984, 0.01631954498589039, -0.08450824022293091, -0.07510311901569366, -0.11490161716938019, 0.015499453991651535, -0.05938568711280823, -0.035550687462091446, 0.05801217630505562, -0.011382514610886574, -0.002938165096566081, -0.12128765136003494, -0.023775743320584297, -0.08417561650276184, 0.03982949256896973, 0.009019714780151844, -0.04285890981554985, -0.03160955384373665, 0.019953660666942596, 0.09271551668643951, 0.018152400851249695, 0.03229911997914314, 0.06078282371163368, 0.06764957308769226, -0.015862274914979935, -0.02926069125533104, -0.029851844534277916, 0.019309237599372864, 0.028032446280121803, -0.08570094406604767, 0.018985901027917862, -0.0062016998417675495, -0.04983812943100929, 0.0006593976868316531, 0.023656047880649567, 0.031243691220879555, -0.04525799676775932, -0.050040245056152344, -0.0032114186324179173, -0.06513524800539017, -0.03252897039055824, -0.06365467607975006, -0.07082269340753555, -0.11954821646213531, 0.017930777743458748, -0.06198257580399513, -0.01824566349387169, 0.01821083575487137, 0.05029750242829323, -0.03187564015388489, -0.025935163721442223, -0.0384201779961586, 0.011729569174349308, -0.017388366162776947, 0.06689506024122238, -0.04621747508645058, -0.03408455103635788, 0.00804724358022213, 0.03021111898124218, -0.08490397781133652, 0.025549110025167465, -0.07999621331691742, -0.023481301963329315, -0.0043633198365569115, -0.015042167156934738, 0.03981068730354309, 0.023405659943819046, -0.023569298908114433, -0.014007482677698135, 0.05489801988005638, 0.06439728289842606, 0.07629209011793137, -0.042382266372442245, 0.017428873106837273, 0.025635836645960808, -0.05234851688146591, -0.1406700760126114, -0.0699988454580307, 0.007122409995645285, -4.948089186152874e-33, -0.05674336105585098, -0.007297839038074017, -0.0033633369021117687, 0.02697649784386158, 0.08117308467626572, -0.03247154876589775, -0.01421312615275383, -0.015542000532150269, -0.06800463795661926, -0.019782457500696182, -0.053569991141557693, 0.09101786464452744, -0.018165884539484978, 0.10372549295425415, 0.000564559712074697, 0.03728078305721283, 0.04754599928855896, -0.02023463509976864, -0.055547066032886505, -0.030245574191212654, -0.0024358544033020735, 0.04053671285510063, 0.009222880005836487, 0.005692873150110245, -0.07457127422094345, -0.03446582332253456, -0.051637742668390274, -0.041146572679281235, -0.028695719316601753, -0.013183637522161007, 0.013360943645238876, 0.03529409319162369, 0.10850464552640915, -0.006844665855169296, -0.017419617623090744, 0.0075858887284994125, 0.0333680659532547, -0.06847153604030609, -0.02980695106089115, -0.07195219397544861, -0.01950983516871929, 0.011376715265214443, -0.003251902759075165, 0.026165608316659927, 0.11028249561786652, 0.022774966433644295, -0.030018862336874008, 0.026059413328766823, 0.02650090493261814, 0.08371555060148239, 0.06790336966514587, -0.06907954066991806, -0.10644926875829697, 0.10120145976543427, -0.04584755003452301, -0.04113532975316048, 0.04056082293391228, 0.044900450855493546, 0.04894444718956947, 0.029089292511343956, 0.030642762780189514, 0.027018114924430847, 0.0786723792552948, 0.013502557761967182, 0.08863935619592667, -0.009725677780807018, -0.00020909399609081447, 0.11076667904853821, -0.04127296805381775, 0.07157469540834427, -0.03427204117178917, -0.006349134258925915, -0.043713875114917755, 0.042559996247291565, -0.04005437344312668, 0.03292600437998772, 0.03933709114789963, -0.19003234803676605, -0.08743866533041, 0.0067853196524083614, -0.06081917881965637, -0.01155262440443039, -0.05476094037294388, -0.0610881932079792, -0.12111864984035492, -0.06143742427229881, 0.01950041763484478, -0.09889044612646103, 0.05240775644779205, 0.011860358528792858, -0.11287802457809448, 0.10608728975057602, 0.017246851697564125, -0.013666967861354351, -0.051857840269804, -8.525157984968443e-34, -0.041029468178749084, -0.03698643669486046, 0.03923815116286278, -0.047209467738866806, 0.0033188853412866592, -0.031229596585035324, 0.08064176142215729, -0.002805490279570222, 0.043872181326150894, -0.0021648965775966644, -0.04295478016138077, -0.055922314524650574, 0.016710538417100906, -0.06632646173238754, 0.07976748049259186, -0.032941266894340515, 0.020541274920105934, 0.1309019923210144, 0.014109347946941853, 0.07647214829921722, 0.03822062164545059, -0.04083939641714096, -0.02370351366698742, 0.05885537713766098, 0.024196133017539978, 0.005699978210031986, 0.001322140102274716, -0.09181929379701614, 0.017405664548277855, 0.030154865235090256, 0.0733964741230011, 0.01594637893140316, 0.0742352083325386, 0.09261259436607361, -0.002611353760585189, 0.019300920888781548, 0.02310231886804104, -0.030637813732028008, -0.0501982718706131, -0.08000823855400085, 0.008018122985959053, 0.08059544861316681, -0.01773787848651409, -0.02049577794969082, -0.03429945930838585, -0.057778794318437576, -0.08953852206468582, -0.06217575818300247, 0.022575538605451584, 0.05386397987604141, 0.10230264067649841, 0.012355819344520569, -0.06498707830905914, 0.03523072600364685, 0.01963229663670063, -0.010084730572998524, -0.06651682406663895, -0.04866207391023636, -0.058389950543642044, -0.0012482921592891216, -0.015559102408587933, -0.025858627632260323, -0.018776345998048782, 0.06711774319410324, 0.008173764683306217, -0.0114261070266366, -0.05069367587566376, 0.047868285328149796, -0.001275458955205977, -0.02895393781363964, -0.011852769181132317, 0.05312838405370712, -0.038302816450595856, -0.006648077163845301, -0.03900234401226044, -0.00588992889970541, -0.020404266193509102, -0.04825793206691742, -0.08185379952192307, -0.00018688218551687896, 0.010633515194058418, -0.037803374230861664, 0.02715461142361164, 0.057704243808984756, -0.04067838564515114, 0.01427449006587267, 0.001745857298374176, 0.05891803279519081, 0.060227155685424805, 0.056112028658390045, 0.04175206646323204, -0.03606659919023514, 0.07047109305858612, 0.06491187959909439, 0.05721215531229973, -4.073092085832286e-08, -0.044341932982206345, -0.027499614283442497, 0.017015498131513596, 0.015599044039845467, -0.06890887022018433, -0.046209778636693954, -0.0014829023275524378, -0.103000208735466, -0.06338325887918472, 0.06147310137748718, 0.031998198479413986, -0.00787342619150877, -0.056811533868312836, 0.01446568127721548, 0.05029396712779999, 0.030834082514047623, 0.017703257501125336, 0.038521524518728256, 0.081959068775177, -0.014663085341453552, -0.029050083830952644, 0.0004100840596947819, 0.010282660834491253, 0.053132109344005585, -0.08977664262056351, 0.005309135187417269, -0.05438047647476196, -0.03533261641860008, 0.016306111589074135, 0.0028059789910912514, 0.0382557287812233, -0.07017382979393005, -0.01646360568702221, -0.06342976540327072, 0.0048613338731229305, -0.05893195420503616, -0.01084237452596426, -0.052366748452186584, -0.02137790434062481, 0.09929797053337097, -0.004002208821475506, -0.0020023779943585396, -0.022761456668376923, -0.006386300083249807, 0.09790594130754471, -0.04979422315955162, 0.03761851787567139, -0.014785388484597206, 0.06251787394285202, -0.012532786466181278, -0.012240851297974586, 0.03437146916985512, 0.02165525034070015, -0.08794946223497391, 0.019024889916181564, 0.0007735990220680833, 0.025099925696849823, 0.05939500406384468, 0.006658703554421663, -0.10108168423175812, 0.040710706263780594, -0.011095956899225712, 0.0951741635799408, 0.025560572743415833 ] }, { "text": "Other words and their similarities:\nlipstick 0.2769191625638267\nguns -0.1888485567898898\nscience -0.06082906540929701\narts 0.008189312385880337\nliterature 0.06472504433459932\nwarrior -0.20920164641125288\ndoctor 0.11895289410935041\ntree -0.07089399175478091\nreceptionist 0.33077941750593737\ntechnology -0.13193732447554302\nfashion 0.03563894625772699\nteacher 0.17920923431825664\nengineer -0.0803928049452407\npilot 0.0010764498991916937\ncomputer -0.10330358873850498\nsinger 0.1850051813649629\n\n“computer” is negative and is closer in value to male first names, while “literature” is positive and is closer to female first names\n\nHere you may find the cosine similarities between man, woman and given word:\n\nIn [22]:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_17", "embedding": [ -0.021495750173926353, -0.03855748102068901, -0.01181152742356062, 0.0021045405883342028, -0.06153809651732445, -0.02602699026465416, 0.013438583351671696, -0.00636136531829834, 0.032530274242162704, 0.02024809643626213, 0.08997493982315063, -0.04277847707271576, 0.06653771549463272, -0.000799198925960809, -0.054689887911081314, -0.03567176312208176, 0.02558992989361286, -0.08389674872159958, -0.03926462307572365, 0.03606028109788895, -0.006442403420805931, 0.0013412846019491553, -0.021293438971042633, 0.009584413841366768, -0.015978621318936348, 0.07142460346221924, -0.0619044192135334, 0.01477344986051321, -0.049160752445459366, -0.04220619797706604, -0.041469503194093704, 0.10604267567396164, 0.039875444024801254, 0.025971580296754837, -0.07457984238862991, 0.011036260053515434, 0.048512496054172516, 0.0836370512843132, 0.028813976794481277, -0.0128195621073246, -0.06152360886335373, -0.03691256046295166, 0.052497874945402145, 0.03447527810931206, 0.014385812915861607, -0.047913916409015656, -0.09258782863616943, -0.03207824006676674, -0.024768298491835594, -0.03180335462093353, -0.12746331095695496, -0.051659632474184036, -0.05349459499120712, 0.05562165379524231, -0.026906205341219902, 0.01488537061959505, 0.07841526716947556, 0.0034755126107484102, -0.03266014903783798, -0.00746626453474164, -0.05262628197669983, -0.010385352186858654, -0.02262943796813488, -0.0045159501023590565, 0.04204166680574417, -0.026229312643408775, -0.014784170314669609, -0.05258457735180855, -0.022261498495936394, 0.08729702234268188, 0.00821010209619999, -0.0024490738287568092, -0.001049312762916088, 0.054586514830589294, -0.03763926401734352, 0.05870107561349869, 0.03675707057118416, -0.01676669344305992, -0.015619266778230667, -0.07463359832763672, -0.010461431927978992, -0.03252870962023735, -0.08186310529708862, 0.048777684569358826, -0.10543320327997208, 0.0056375120766460896, -0.03785886988043785, -0.10299335420131683, -0.013281269930303097, -0.04002773389220238, -0.09143730252981186, -0.027255166321992874, 0.025191808119416237, 0.021334387362003326, -0.027345096692442894, -0.02129627950489521, -0.02533452771604061, 0.06244407966732979, -0.0006817782996222377, 0.068589948117733, -0.010288508608937263, 0.059032537043094635, 0.005978396628051996, -0.004835332743823528, -0.06389366090297699, -0.06551440060138702, -0.02528345212340355, -0.07674949616193771, -0.002094804774969816, -0.09266243129968643, -0.023430459201335907, -0.013739634305238724, -0.07294391095638275, 0.021252989768981934, 0.029714150354266167, -0.011886336840689182, -0.02131936512887478, 0.07588491588830948, -0.005399486515671015, 0.06109048053622246, -0.012287908233702183, 0.029290173202753067, -0.024591898545622826, 0.014370488934218884, 0.0064905015751719475, -0.029201583936810493, -0.07438699901103973, 3.4307298540427714e-33, 0.034500379115343094, 0.03588138520717621, 0.03176894783973694, 0.049892548471689224, 0.06016135960817337, -0.010482107289135456, -0.10666855424642563, 0.04353838786482811, -0.031253982335329056, -0.0029865417163819075, -0.07079713046550751, 0.037447914481163025, -0.017725447192788124, 0.028361942619085312, -0.014110217802226543, 0.07271062582731247, -0.009821498766541481, 0.023900385946035385, -0.06501300632953644, -0.005133947357535362, 0.02850024402141571, 0.06211128830909729, -0.01369437575340271, -0.08336113393306732, 0.051940616220235825, -0.021003536880016327, -0.060982994735240936, 0.0188774224370718, 0.02682870626449585, -0.00867164321243763, -0.034283146262168884, 0.05512687563896179, 0.009343745186924934, 0.011120086535811424, -0.02650519274175167, -0.040270913392305374, 0.038000836968421936, -0.1763473004102707, 0.028128933161497116, 0.008900976739823818, -0.06249139457941055, 0.09112986922264099, 0.011036166921257973, -0.06812708079814911, 0.020486265420913696, 0.020119352266192436, 0.012289397418498993, -0.02450116164982319, 0.021600954234600067, 0.0038239394780248404, -0.05820073187351227, -0.00688294367864728, 0.06813585758209229, 0.04991874098777771, -0.02243158034980297, -0.018185853958129883, 0.017743555828928947, 0.08549722284078598, 0.013432329520583153, 0.07877688109874725, 0.061227813363075256, 0.09706759452819824, 0.042348865419626236, -0.017811724916100502, 0.10077337920665741, 0.03659023717045784, -0.01276322826743126, 0.027804214507341385, 0.03473321348428726, 0.0832015872001648, -0.0336773507297039, 0.022934040054678917, 0.030386144295334816, -0.008503700606524944, 0.06658994406461716, 0.02819208614528179, -0.05240630730986595, -0.0868716910481453, -0.0022563498932868242, -0.006431486923247576, -0.10016601532697678, -0.022418953478336334, -0.08129049092531204, -0.1650911420583725, -0.16788120567798615, -0.035917434841394424, 0.09260928630828857, -0.0696144700050354, 0.030968571081757545, 0.00020340229093562812, -0.11215993762016296, 0.0017705411883071065, 0.021280696615576744, 0.00011191437806701288, -0.05036984011530876, -9.461678926043367e-33, -0.08987835794687271, -0.0860346108675003, -0.026880765333771706, 0.06421270221471786, 0.03499966859817505, 0.026041045784950256, 0.04284922778606415, 0.018611978739500046, -0.0036332036834210157, 0.016226334497332573, 0.044544756412506104, -0.023723041638731956, -0.027850480750203133, -0.07955542951822281, 0.09994848072528839, -0.07638728618621826, 0.029311763122677803, 0.05843717232346535, -0.006969534792006016, 0.014800474047660828, 0.050400156527757645, 0.1018514484167099, -0.1743442565202713, -0.0073641096241772175, 0.04782072454690933, 0.0348077267408371, 0.002032698132097721, -0.014052854850888252, -0.06618193536996841, 0.07234076410531998, -0.014730974100530148, 0.025869064033031464, -0.01285473071038723, 0.03928985446691513, -0.015308519825339317, 0.022251369431614876, -0.01901068538427353, -0.028143413364887238, 0.019971422851085663, 0.015501497313380241, -0.037438537925481796, 0.0006960504688322544, -0.02172120101749897, -0.0036393851041793823, -0.03808320686221123, -0.05489947274327278, -0.0723399892449379, 0.034836843609809875, 0.03964931145310402, -0.04722537845373154, 0.05933467298746109, 0.002414141548797488, -0.04364854097366333, -0.011500369757413864, -0.014563830569386482, -0.021997004747390747, 0.0056962501257658005, -0.03371470049023628, -0.06335745751857758, 0.07500675320625305, 0.012020889669656754, -0.023549558594822884, -0.024038327857851982, 0.0665091723203659, -0.10151506960391998, -0.05132725462317467, 0.0049877590499818325, 0.015970570966601372, -0.009275704622268677, -0.07694460451602936, -0.019044332206249237, -0.014437059871852398, -0.00025516064488328993, -0.009368633851408958, -0.042099788784980774, 0.016283266246318817, -0.004662454128265381, -0.05283958464860916, -0.05858169496059418, -0.05026562511920929, -0.009274213574826717, -0.05985235050320625, 0.014390240423381329, 0.05849875509738922, 0.016062870621681213, 0.06163640692830086, -0.07354365289211273, 0.06947723031044006, 0.0224485881626606, -0.04584544524550438, 0.0142606720328331, -0.05429088696837425, 0.004046447109431028, -0.050409965217113495, -0.006911739241331816, -7.415756897444226e-08, 0.0016653123311698437, -0.08748893439769745, 0.0040367888286709785, 0.012852308340370655, -0.0011989529011771083, -0.036770086735486984, -0.049300260841846466, -0.0631566047668457, -0.008212320506572723, 0.12485026568174362, 0.012450138106942177, 0.026850556954741478, -0.0534401535987854, -0.007065985817462206, 0.048932041972875595, 0.03848693147301674, 0.04196901246905327, 0.005588255822658539, -0.021277915686368942, -0.010751154273748398, 0.0750904455780983, -0.010530984029173851, -0.020227715373039246, -0.028322597965598106, -0.054719503968954086, 0.003970941994339228, -0.06879094988107681, 0.033874526619911194, -0.07171820104122162, 0.06484740227460861, 0.006059651728719473, -0.016729561612010002, -0.05959989130496979, -0.04164763167500496, 0.02700916863977909, 0.03422580286860466, 0.02665085718035698, 0.03650522977113724, -0.0013873069547116756, 0.04672911763191223, 0.010390151292085648, -0.09940333664417267, -0.031709153205156326, 0.07501861453056335, 0.11351817101240158, -0.03696061670780182, 0.03195261210203171, 0.007369177415966988, 0.008506858721375465, 0.003681409638375044, 0.03810308873653412, 0.06847202777862549, 0.015247783623635769, -0.06302659958600998, -0.051119379699230194, -0.03907154127955437, -0.08795150369405746, 0.04488344490528107, -0.061185307800769806, 0.02861376851797104, 0.1809084713459015, -0.09459087252616882, 0.1284397691488266, -0.046719279140233994 ] }, { "text": "Here you may find the cosine similarities between man, woman and given word:\n\nIn [22]:\n\nprint('Other words and their similarities:')\nword_list_1 = ['lipstick', 'arts', 'literature','doctor', 'tree', 'receptionist',\n'fashion', 'teacher', 'singer']\nword_list_2 = [ 'guns', 'science', 'warrior',\n'technology', 'engineer', 'pilot', 'computer']\nfor w in word_list_1:\nprint (\"woman\", w, cosine_similarity(word_to_vec_map[w], word_to_vec_map[\"woman\"]))\nprint (\"man\", w, cosine_similarity(word_to_vec_map[w], word_to_vec_map[\"man\"]))\n\nfor w in word_list_2:\nprint (\"woman\", w, cosine_similarity(word_to_vec_map[w], word_to_vec_map[\"woman\"]))\nprint (\"man\", w, cosine_similarity(word_to_vec_map[w], word_to_vec_map[\"man\"]))", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_18", "embedding": [ -0.0033798220101743937, 0.02079884149134159, -0.020422574132680893, -0.028360817581415176, -0.016620134934782982, -0.016815094277262688, 0.008622003719210625, -0.013341663405299187, -0.13562197983264923, -0.0003088957746513188, 0.12030039727687836, -0.001402702764607966, 0.058575231581926346, 0.018604930490255356, -0.007694009691476822, 0.05668263137340546, -0.018042927607893944, 0.04418916255235672, -0.0092161251232028, -0.07960516214370728, 0.054310861974954605, 0.055537253618240356, -0.004752312786877155, 0.020821472629904747, -0.02857985720038414, 0.04897155985236168, -0.011791728436946869, 0.04135000333189964, -0.08856622874736786, 0.02407163195312023, 0.03055809624493122, 0.019918126985430717, 0.03287632390856743, 0.04287097230553627, 0.01486918330192566, -0.008952746167778969, -0.028164394199848175, -0.005776906386017799, 0.04461490735411644, 0.04791788011789322, -0.09092841297388077, -0.06652706861495972, -0.0669049397110939, 0.03621819242835045, 0.05055768042802811, 0.04533931612968445, -0.0708221048116684, 0.06292056292295456, -0.001517794793471694, -0.017461340874433517, -0.09168688207864761, -0.048648759722709656, -0.1067633181810379, 0.022404391318559647, -0.051115982234478, -0.02785530500113964, 0.06997144967317581, -0.007849172689020634, -0.003955762833356857, -0.10136780142784119, 0.0014674627454951406, -0.08821864426136017, 0.03525230661034584, 0.0260503888130188, -0.0012658106861636043, -0.02572815679013729, 0.03264874219894409, 0.0556626096367836, 0.018609369173645973, 0.02764952927827835, 0.044766467064619064, 0.1019226610660553, -0.06753098964691162, -0.03333015739917755, -0.024722617119550705, 0.01955762878060341, 0.036552928388118744, -0.09416133165359497, 0.03409537672996521, -0.02945271134376526, -0.05954328551888466, 0.0001307929342146963, 0.04890989139676094, 0.06007876619696617, -0.04554488882422447, -0.051049962639808655, 0.00848286971449852, -0.043392397463321686, -0.02368428371846676, -0.02860734611749649, -0.10454720258712769, -0.12487562000751495, 0.0406637117266655, -0.061117708683013916, 0.011388573795557022, 0.03192352503538132, 0.009936332702636719, 0.012404144741594791, -0.04747600108385086, -0.029267391189932823, 0.01919054612517357, -0.016589783132076263, 0.040536679327487946, -0.07429726421833038, -0.020227665081620216, 0.013148970901966095, 0.0528133399784565, -0.03206344693899155, 0.058013491332530975, -0.08659274131059647, -0.009298824705183506, -0.033405374735593796, -0.04594288766384125, 0.03079850785434246, 0.05100854113698006, -0.0012206508545204997, 0.028386253863573074, 0.0681794285774231, 0.08859702944755554, 0.05319928750395775, -0.024372100830078125, -0.004361211322247982, 0.043569840490818024, -0.057300567626953125, -0.08621064573526382, -0.05847630649805069, 0.014461249113082886, -2.8381545192566174e-33, -0.10425292700529099, 0.01997152902185917, -0.006225214339792728, 0.05486249923706055, 0.04913049563765526, -0.038062091916799545, -0.008742231875658035, -0.02837570384144783, -0.03348662331700325, -0.05157813802361488, -0.07528094202280045, 0.09286612272262573, -0.039369527250528336, 0.03884575888514519, -0.01609067991375923, -0.00517119187861681, 0.037434566766023636, -0.028883930295705795, -0.07232152670621872, -0.013730981387197971, 0.04858221858739853, 0.10292267799377441, -0.004773149732500315, 0.02247343771159649, -0.05904623493552208, -0.07859226316213608, -0.025010788813233376, -0.021202372387051582, -0.0053194561041891575, -0.026837559416890144, -0.010654201731085777, 0.03919561207294464, 0.10446123778820038, -0.04003787413239479, 0.02706979587674141, -0.007111729588359594, 0.0432484932243824, -0.06810985505580902, -0.0031592957675457, -0.03415903076529503, -0.04907267168164253, 0.004869874566793442, 0.035825517028570175, 0.0055353231728076935, 0.06905745714902878, -0.004813569597899914, -0.050103116780519485, 0.043997254222631454, 0.03708949685096741, 0.09732206165790558, 0.01785116083920002, -0.05217224732041359, -0.0729052871465683, 0.1236620843410492, -0.025161031633615494, 0.0023472397588193417, 0.035822659730911255, -0.003953075036406517, 0.05766972899436951, 0.06644200533628464, 0.04618634656071663, 0.011380529962480068, 0.09478014707565308, 0.032596636563539505, 0.08036144822835922, 0.0111019192263484, 0.002275938168168068, 0.05885719507932663, -0.024857014417648315, 0.0926118940114975, -0.05998098850250244, -0.018481867387890816, 0.0028027931693941355, 0.034012570977211, -0.03566352650523186, 0.06796740740537643, 0.026642674580216408, -0.14983917772769928, -0.072917141020298, -0.0328097939491272, -0.04832910746335983, 0.010158509947359562, -0.002694113180041313, -0.07249442487955093, -0.12380213290452957, -0.0879608616232872, 0.031105782836675644, -0.11379481852054596, 0.07082584500312805, 0.003209915477782488, -0.05874369665980339, 0.1271950751543045, 0.042925070971250534, -0.03151218220591545, -0.015360478311777115, -7.121463446453086e-34, -0.05838887766003609, -0.04042166471481323, 0.06095210462808609, -0.0397971048951149, 0.017393607646226883, -0.005549068562686443, 0.08238241076469421, -0.0549890510737896, 0.057688117027282715, -0.008341843262314796, -0.06430889666080475, -0.09999419748783112, 0.04456198215484619, -0.029638875275850296, 0.08942962437868118, -0.0008242438198067248, 0.03969136252999306, 0.09018340706825256, -0.004956789780408144, 0.08482365310192108, 0.05007600784301758, -0.009134604595601559, -0.03469863533973694, -0.011388473212718964, -0.03073761984705925, 0.03603554144501686, 0.007133546285331249, -0.09077737480401993, 0.019579214975237846, 0.03805786743760109, 0.027405954897403717, -0.000612594885751605, 0.043793223798274994, 0.06726600229740143, -0.02329353056848049, -0.003844140563160181, -0.010813964530825615, 0.008356633596122265, -0.042241498827934265, -0.06112121045589447, 0.02046329341828823, 0.09711523354053497, -0.03815547376871109, -0.04682952165603638, -0.01779846101999283, -0.018104547634720802, -0.08413464576005936, -0.041630253195762634, 0.022365989163517952, 0.04010478034615517, 0.07661475241184235, 0.013044039718806744, -0.11713915318250656, 0.013030724599957466, 0.0010004763025790453, -0.02330012246966362, -0.0454893484711647, -0.06453672796487808, -0.05520705133676529, 0.006728518754243851, -0.03769972175359726, -0.015845930203795433, -0.028420453891158104, 0.09948203712701797, 0.01088198833167553, -0.025472469627857208, -0.05030306428670883, 0.027199722826480865, -0.01612277515232563, -0.0032735546119511127, -0.0238184817135334, 0.0432814285159111, -0.02564537152647972, -0.04071393609046936, -0.02736753225326538, 0.017658039927482605, -0.051154013723134995, -0.07139431685209274, -0.09192728251218796, -0.033569928258657455, -0.022129615768790245, -0.06099716201424599, 0.03501433506608009, 0.05555827170610428, -0.08565729856491089, 0.03709321469068527, 0.019313178956508636, 0.03575257584452629, 0.04599074646830559, 0.044823940843343735, 0.01113347988575697, -0.047786515206098557, 0.04801541939377785, 0.03891897201538086, 0.08263988047838211, -3.8514041733606064e-08, -0.038640428334474564, -0.031734686344861984, 0.014321827329695225, -0.002630038419738412, -0.039874881505966187, -0.03950660675764084, -0.001736716367304325, -0.09246817976236343, -0.02793557569384575, 0.05909009650349617, -0.016749102622270584, 0.04772728309035301, -0.0053413803689181805, 0.009924801997840405, 0.05312998220324516, 0.04967590048909187, 0.007954401895403862, -0.002251608297228813, 0.06881808489561081, -0.04738091304898262, 0.030728822574019432, -0.039995208382606506, 0.0017321695340797305, 0.09204765409231186, -0.08397700637578964, 0.05777137354016304, -0.018152562901377678, 0.006209846585988998, -0.0007273389492183924, -0.014106303453445435, 0.04248221218585968, -0.021475866436958313, -0.025235764682292938, -0.09077160805463791, 0.03016270510852337, -0.07867367565631866, -0.016458993777632713, -0.0012053935788571835, -0.040925055742263794, 0.1292979121208191, -0.01049733068794012, 0.014968089759349823, -0.01041451282799244, 0.03197911009192467, 0.15933257341384888, -0.024298865348100662, 0.054009705781936646, -0.0022590511944144964, 0.04816228523850441, 0.01058963779360056, -0.0031402683816850185, 0.03391470015048981, 0.039143357425928116, -0.09366489201784134, -0.002985178492963314, -0.011165114119648933, 0.015467861667275429, 0.06698727607727051, -0.014470060355961323, -0.05831349268555641, 0.036675456911325455, 4.187160084256902e-05, 0.10640643537044525, -0.006560640409588814 ] }, { "text": "Other words and their similarities:\nwoman lipstick 0.3862429669706063\nman lipstick 0.273165272354283\nwoman arts 0.2940187431766971\nman arts 0.3084874532181791\nwoman literature 0.363119683771546\nman literature 0.35388764809819956\nwoman doctor 0.7252735302545701\nman doctor 0.7119579038910591\nwoman tree 0.37484879731523546\nman tree 0.43365820275424793\nwoman receptionist 0.4464364858934247\nman receptionist 0.3104243175079627\nwoman fashion 0.4624789392055569\nman fashion 0.4739439919224705\nwoman teacher 0.68499316078363\nman teacher 0.6392358303810439\nwoman singer 0.5692962568351047\nman singer 0.5133699757062065\nwoman guns 0.3138791334333115\nman guns 0.4273814491100573\nwoman science 0.31239626692008643\nman science 0.3622743278942722\nwoman warrior 0.4713955678516831", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_19", "embedding": [ 8.186735067283735e-05, -0.10210899263620377, -0.02113768272101879, 0.020505068823695183, -0.022053610533475876, 0.027962984517216682, -0.018535276874899864, -0.08460062742233276, -0.02004912495613098, -0.006842201575636864, 0.08884601294994354, -0.007665337063372135, -0.0021801083348691463, -0.024173423647880554, -0.03687097877264023, -0.007632658816874027, -0.012214720249176025, -0.023561565205454826, -0.026602186262607574, 0.017186874523758888, 0.006393692456185818, 0.00826257560402155, -0.019674090668559074, 0.0362231619656086, -0.03539055213332176, 0.02739509753882885, -0.03703155741095543, 0.0004551453748717904, -0.06601261347532272, -0.015929166227579117, -0.029458394274115562, 0.09224870055913925, 0.026404833421111107, -0.009660342708230019, -0.08717842400074005, 0.030260350555181503, 0.043626636266708374, 0.07494580000638962, 0.06982791423797607, 0.032944560050964355, -0.047889236360788345, -0.028903290629386902, -0.02256835624575615, 0.010703206062316895, 0.027317605912685394, -0.0742281973361969, -0.1109917089343071, -0.0027945362962782383, -0.03214024752378464, -0.027222348377108574, -0.07248583436012268, -0.05542613938450813, -0.10204201191663742, 0.028355099260807037, -0.05471678823232651, -0.010824691504240036, 0.04895976185798645, 0.0009375066147185862, -0.037512827664613724, -0.0059819333255290985, -0.012744838371872902, 0.0032391666900366545, 0.0173924770206213, 0.012829847633838654, 0.05275333300232887, -0.01864825189113617, -0.047471627593040466, -0.04271170124411583, 0.006007389165461063, 0.06715422868728638, -0.01029529981315136, 0.000978286494500935, 0.014253283850848675, 0.07209234684705734, -0.03675825148820877, 0.031868938356637955, 0.009706921875476837, -0.07996100187301636, -0.07729826122522354, -0.07039831578731537, -0.023448990657925606, -0.0657816156744957, 0.04750579223036766, 0.047157179564237595, -0.07752303779125214, -0.007879049517214298, -0.01796616241335869, -0.11637260019779205, -0.029335064813494682, -0.03186593949794769, -0.10357066243886948, -0.05313708260655403, -0.017062876373529434, 0.014740782789885998, -0.08323322236537933, 0.0056103188544511795, -0.09240587800741196, 0.03070915676653385, 0.015154948458075523, 0.05956150218844414, -0.04106786474585533, 0.028494663536548615, -0.007489560637623072, -0.047265540808439255, -0.05195806175470352, -0.061062417924404144, -0.008187415078282356, -0.07567830383777618, -0.05132726579904556, -0.06574106216430664, -0.007778901606798172, 0.004177403170615435, -0.10030316561460495, 0.006180564407259226, 0.0604819692671299, -0.0803353413939476, 0.01936884969472885, -0.009954373352229595, 0.0012200615601614118, 0.040836088359355927, -0.017207857221364975, 0.05583440512418747, -0.00816925335675478, -0.0034836733248084784, -0.03680676221847534, -0.01768951117992401, -0.03624612092971802, 6.075116068180835e-33, 0.030220376327633858, 0.03920300677418709, 0.05948304757475853, 0.019143013283610344, 0.10808401554822922, 0.014888625591993332, -0.050594866275787354, 0.05343189835548401, -0.009203111752867699, 0.03592686355113983, -0.03550364077091217, -0.0075557115487754345, -0.09062913805246353, 0.023022938519716263, -0.07531583309173584, 0.05356691777706146, 0.0005709558608941734, 0.00279275793582201, -0.09403645992279053, 0.016688261181116104, -0.0028672616463154554, 0.07063820958137512, -0.04841579869389534, -0.042473867535591125, -0.0011416601482778788, 0.02290830761194229, -0.041454724967479706, 0.03266460448503494, 0.04001166298985481, -0.01251886785030365, -0.004533467348664999, 0.030489236116409302, -0.0050918227061629295, -0.026322951540350914, -0.0659579336643219, -0.03631643205881119, 0.036777738481760025, -0.10175618529319763, 0.025541499257087708, 0.012463021092116833, -0.05371629819273949, -0.0037451998796314, 0.05786382034420967, -0.05694027245044708, -0.03696601092815399, 0.09388269484043121, -0.01943029649555683, -0.017831144854426384, 0.034202780574560165, 0.00925558153539896, -0.04666132852435112, -0.03593982756137848, 0.003546647960320115, 0.09674548357725143, 0.050203002989292145, -0.006189726293087006, 9.925872291205451e-05, 0.04491610825061798, 0.07812946289777756, 0.09227164834737778, 0.06223708763718605, 0.07668626308441162, 0.06867857277393341, -0.029116081073880196, 0.1328980028629303, 0.026770316064357758, -0.008164824917912483, -0.0104783670976758, 0.051583223044872284, 0.08917976915836334, -0.03915586695075035, 0.06712377816438675, 0.05142369493842125, 0.03187432512640953, 0.04421091452240944, 0.03569876402616501, -0.023066112771630287, -0.11244093626737595, 0.03673555701971054, 0.031210418790578842, -0.03877106308937073, -0.029082145541906357, 0.03716270998120308, -0.17538519203662872, -0.14790953695774078, -0.09029166400432587, 0.06110621616244316, -0.09500538557767868, 0.05442747473716736, 0.002589163836091757, -0.09537915885448456, 0.05123012885451317, 0.05478951707482338, -0.06806984543800354, -0.04969889670610428, -1.2300551415208948e-32, -0.03762902691960335, -0.04579039290547371, 0.029655249789357185, 0.07021840661764145, 0.030310099944472313, 0.052605126053094864, -0.03477900102734566, 0.03975274786353111, 0.044069476425647736, 0.06967160850763321, -0.036068301647901535, -0.07226154953241348, 0.02895616553723812, -0.06083052605390549, 0.0873953327536583, -0.09668263792991638, 0.0472341813147068, 0.046963248401880264, -0.03307896852493286, 0.05188341811299324, -0.020853441208600998, 0.06593213230371475, -0.10155108571052551, 0.006404725369066, -0.008836204186081886, 0.013025635853409767, -0.0035489399451762438, -0.05636143311858177, -0.03991794213652611, 0.06294463574886322, 0.010113521479070187, -0.045221783220767975, -0.042537789791822433, -0.05494670197367668, -0.03734010457992554, -0.014308178797364235, -0.0445675365626812, 0.02012675441801548, 0.01286153681576252, 0.01741849258542061, -0.039129555225372314, -0.06937268376350403, -0.023090345785021782, -0.07854346930980682, -0.06157584860920906, -0.030192876234650612, -0.07106497883796692, 0.03312963619828224, 0.012213560752570629, -0.01606866717338562, 0.014943016692996025, 0.0059926738031208515, -0.10648216307163239, 0.013606545515358448, -0.013289406895637512, -0.03069279156625271, 0.04775175824761391, -0.03629732504487038, -0.045200709253549576, 0.05599917098879814, 0.0060367221012711525, 0.0017267795046791434, -0.03726667910814285, 0.04750402644276619, -0.03223768621683121, -0.10873080044984818, -0.015343830920755863, -0.05403754115104675, -0.018740827217698097, 0.007957612164318562, -0.010628112591803074, -0.05654770880937576, -0.04539738968014717, 0.023558789864182472, -0.001168171875178814, 0.007922465912997723, 0.002433007350191474, -0.05006217584013939, -0.03197219595313072, -0.057014696300029755, 0.0631072148680687, -0.11735895276069641, 0.024923207238316536, 0.07818066328763962, 0.008032992482185364, 0.09681202471256256, -0.02575448341667652, 0.058990903198719025, 0.008472025394439697, 0.024414507672190666, -0.015324627049267292, -0.019665934145450592, -0.004534901585429907, -0.03618578240275383, 0.02215333841741085, -7.181593986160806e-08, -0.034930963069200516, -0.07054133713245392, 0.009307539090514183, -0.03536294773221016, 0.004973661620169878, -0.07830562442541122, -0.032716598361730576, -0.02366592548787594, -0.01152708474546671, 0.11322005093097687, 0.011827782727777958, 0.05425826087594032, -0.031877338886260986, 0.02383127063512802, -0.003915675450116396, 0.0023389949928969145, 0.08763857185840607, 0.018185969442129135, -0.009400468319654465, -0.0498739629983902, 0.04450439661741257, 0.04633663222193718, -0.04449576511979103, -0.06326901167631149, -0.024044111371040344, 0.05900117754936218, -0.055339064449071884, 0.06430970877408981, -0.0400574617087841, 0.1281375139951706, 0.06438416242599487, -0.033094704151153564, -0.07660962641239166, -0.05455990880727768, 0.00441222358494997, 0.029616042971611023, 0.0007127990247681737, -0.004451482556760311, -0.02803647704422474, 0.027405327185988426, 0.024890515953302383, -0.08630040287971497, 0.03335034102201462, 0.0758242979645729, 0.08468214422464371, -0.03520514816045761, 0.07666980475187302, 0.012137901969254017, 0.010515158995985985, 0.03422196954488754, -0.046378590166568756, 0.03675513342022896, -0.016205502673983574, -0.10025916993618011, -0.003320160787552595, -0.05427708849310875, -0.02154771238565445, 0.06804852932691574, -0.021609868854284286, -0.013034515082836151, 0.13773281872272491, -0.07222460955381393, 0.10515713691711426, -0.03732388839125633 ] }, { "text": "man guns 0.4273814491100573\nwoman science 0.31239626692008643\nman science 0.3622743278942722\nwoman warrior 0.4713955678516831\nman warrior 0.6049269311478533\nwoman technology 0.20144332004912435\nman technology 0.27961583473586277\nwoman engineer 0.37687460619888824\nman engineer 0.4405255720305907\nwoman pilot 0.5124479109262313\nman pilot 0.5442145707441612\nwoman computer 0.32951857656034195\nman computer 0.40155425059559346", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_20", "embedding": [ 0.0037789868656545877, 0.03496254235506058, -0.03307785093784332, -0.000766070035751909, -0.038882795721292496, -0.04021700471639633, 0.03138454630970955, -0.03521966561675072, -0.09015993773937225, 0.07963459193706512, -0.005068046972155571, -0.03977784141898155, 0.03717586770653725, 0.0015851458301767707, -0.06030173599720001, -0.008824038319289684, -0.063886858522892, -0.06751445680856705, 0.03310873359441757, 0.0195634625852108, -0.01061233039945364, 0.002902917331084609, 0.007925515063107014, -0.02812502719461918, 0.019046247005462646, 0.021624838933348656, -0.015221096575260162, 0.06508251279592514, -0.11038918793201447, -0.04328098148107529, -0.028729435056447983, 0.07898460328578949, 0.013542864471673965, 0.007957091554999352, -0.07708773016929626, -0.06122723966836929, 0.03145577758550644, 0.08025968074798584, -0.0059008230455219746, 0.030006011947989464, -0.056823041290044785, -0.03789614513516426, 0.10977887362241745, 0.021284004673361778, 0.05722487345337868, 0.0229022353887558, -0.09111853688955307, -0.0764118880033493, 0.024988535791635513, -0.004900313913822174, -0.08136440813541412, 0.031503744423389435, -0.05312010273337364, 0.0370023176074028, 0.04647373408079147, -0.155104398727417, 0.005046576727181673, -0.001524421968497336, 0.01214771717786789, -0.046170949935913086, 0.010159498080611229, 0.04238440468907356, -0.05360463261604309, -0.018804339691996574, 0.04611929506063461, -0.021577630192041397, 0.004387918394058943, -0.027119267731904984, -0.01990337483584881, 0.08604007214307785, 0.04439930617809296, 0.02666667103767395, -0.029425831511616707, 0.04896480590105057, -0.0204854104667902, -0.021793141961097717, 0.01678268238902092, 0.010784098878502846, 0.1122528538107872, 0.01741754449903965, -0.008030147291719913, -0.0747019574046135, -0.10384217649698257, 0.06618622690439224, -0.014815328642725945, 0.05076472833752632, -0.06095340475440025, -0.016723716631531715, 0.03384970501065254, 0.010694993659853935, -0.0995962992310524, -0.004711366258561611, 0.04891938716173172, 0.0718618854880333, -0.048788364976644516, 0.03661224991083145, 0.01978057622909546, 0.03742500767111778, -0.08280566334724426, 0.07859846949577332, 0.02336403913795948, -0.01361910905689001, -0.018329406157135963, 0.00571677228435874, -0.024396078661084175, 0.07861271500587463, 0.055297691375017166, 0.05416019633412361, -0.06116007640957832, -0.061236537992954254, 0.05098120495676994, 0.04485413432121277, -0.09039092808961868, -0.03655339032411575, 0.046813104301691055, -0.010243406519293785, -0.08681967854499817, 0.06760963797569275, -0.014969676733016968, 0.042874984443187714, 0.02553507685661316, -0.023403538390994072, -0.011334296315908432, 0.05596025660634041, 0.05130860209465027, 0.02376433275640011, -0.0340595468878746, 5.8389085599067585e-33, -4.0005077607929707e-05, -0.026734108105301857, 0.07060552388429642, 0.043111372739076614, 0.0064380718395113945, -0.062075141817331314, -0.008364868350327015, -0.048027608543634415, -0.04292375221848488, 0.042266845703125, -0.037947334349155426, -0.009970570914447308, -0.06860276311635971, 0.022948412224650383, 0.06332387775182724, -0.0356442853808403, 0.007337662857025862, 0.005738773848861456, -0.0669495165348053, 0.016918759793043137, 0.051148951053619385, 0.0008705397485755384, -0.04233867675065994, -0.06366036832332611, 0.07299304753541946, 0.06027304381132126, -0.04087015613913536, 0.04538469761610031, -0.0260158758610487, 0.034935131669044495, -0.03588847815990448, 0.09003850072622299, -0.06068925932049751, -0.071588896214962, 0.007135981228202581, -0.0860963836312294, 0.07558385282754898, -0.05721766874194145, -0.0283820778131485, 0.037703920155763626, 0.030412720516324043, 0.0038345560897141695, -0.020595191046595573, -0.08756682276725769, -0.04838395118713379, -0.03342843055725098, 0.038672856986522675, -0.006205622106790543, -0.036826614290475845, 0.06939647346735, -0.11646635085344315, 0.034643203020095825, 0.041234806180000305, 0.018173236399888992, 0.01589576154947281, -0.028920823708176613, 0.058061812072992325, 0.05445326492190361, 0.01117636263370514, 0.09387008100748062, -0.004857832565903664, 0.0744614526629448, 0.06947354227304459, 0.05849570408463478, 0.02707531675696373, -0.03273753821849823, -0.004255485720932484, 0.016483090817928314, 0.027809031307697296, 0.1494341939687729, -0.029723867774009705, 0.022677892819046974, 0.050315000116825104, -0.06195065379142761, 0.08094147592782974, 0.044143881648778915, -0.0003020667645614594, 0.0008550232741981745, -0.0107637420296669, -0.038808126002550125, -0.045930929481983185, 0.03528381139039993, -0.06356368213891983, -0.06194490194320679, -0.05258521810173988, -0.033852409571409225, 0.01329284068197012, -0.13179218769073486, -0.05293329060077667, -0.04366162791848183, -0.11910753697156906, -0.0948128029704094, 0.06941679120063782, -0.019661111757159233, -0.11226026713848114, -9.308552419749532e-33, -0.056547582149505615, 0.051292773336172104, 0.0471196286380291, 0.07706344127655029, 0.07330407202243805, -0.004216139204800129, 0.04321718215942383, -0.024132391437888145, -0.011500421911478043, 0.06334178149700165, 0.05322489142417908, -0.025492718443274498, -0.010566437616944313, 0.0029616523534059525, 0.1301063597202301, -0.049842022359371185, 0.022831952199339867, -0.04423457384109497, -0.04411005973815918, -0.05210213363170624, 0.03009307198226452, 0.04118780046701431, -0.04819006845355034, -0.0052599823102355, 0.04703010618686676, 0.06522585451602936, -0.04409706965088844, -0.018815552815794945, -0.002874822588637471, 0.016793830320239067, -0.0019146896665915847, -0.08861937373876572, -0.03198273479938507, -0.01784254051744938, 0.011603203602135181, -0.04025500267744064, 0.009054070338606834, 0.08561445027589798, 0.05763848125934601, 0.005841287784278393, 0.00876079872250557, -0.007737608160823584, -0.0730249434709549, -0.007931911386549473, -0.05314662307500839, -0.02009442448616028, 0.06434307247400284, 0.02243134379386902, 0.0394601970911026, -0.02083376981317997, 0.030941970646381378, -0.013456841930747032, -0.11334100365638733, -0.07876185327768326, -0.04242473095655441, -0.037581026554107666, 0.057817135006189346, -0.014703786931931973, 0.00823542196303606, 0.06860995292663574, -0.05338491499423981, -0.015959935262799263, -0.03962595388293266, 0.06284721195697784, -0.0872829481959343, -0.08118832856416702, -0.05283220857381821, -0.010321865789592266, -0.06838028877973557, -0.019026361405849457, 0.0272388719022274, -0.03969847038388252, -0.009870121255517006, 0.02719045989215374, 0.008565100841224194, -0.012369520030915737, -0.0020588531624525785, 0.004502973984926939, 0.015392819419503212, -0.0658324584364891, 0.0016478676116093993, -0.09336665272712708, 0.0013574807671830058, 0.04592495411634445, -0.020622797310352325, 0.09644773602485657, -0.01112808845937252, 0.045667268335819244, -0.005180646199733019, -0.06564296036958694, -0.043037302792072296, -0.03008558414876461, 0.001472722040489316, -0.027002662420272827, -0.055503908544778824, -5.3819505296814896e-08, -0.025919577106833458, 0.005994186270982027, 0.014583977870643139, 0.009761427529156208, 0.005687459837645292, 0.015566935762763023, -0.00701988535001874, -0.04500450938940048, 0.02433285117149353, -0.028602613136172295, 0.0352512001991272, -0.04941709712147713, 0.014912499114871025, -0.010562638752162457, 0.026442870497703552, -0.001107087591663003, 0.01254578959196806, 0.003699971828609705, -0.07522042840719223, -0.12792176008224487, 0.06329040229320526, -0.047380998730659485, -0.02350827492773533, -0.022461364045739174, -0.11143869161605835, 0.07605084031820297, -0.139304518699646, 0.005312237422913313, -0.03700755909085274, 0.13694123923778534, -0.0016313946107402444, 0.009555920958518982, -0.03694063797593117, -0.04217948764562607, 0.03675493597984314, 0.02813095413148403, 0.0673595443367958, 0.045724011957645416, 0.006951353047043085, -0.03128373995423317, -0.10091666877269745, -0.0060770343989133835, 0.0048382882960140705, 0.09511197358369827, 0.022805094718933105, -0.01216974575072527, -0.02312169224023819, -0.027783416211605072, -0.03194551542401314, -0.05687849596142769, 0.06074228510260582, 0.03865782916545868, 0.005966324359178543, -0.06930258870124817, 0.02152733877301216, 0.0692908838391304, -0.006115396972745657, -0.06698571145534515, -0.04633735120296478, -0.025658151134848595, 0.12719692289829254, -0.08936916291713715, -0.01559776533395052, -0.021735437214374542 ] }, { "text": "4.1 - Neutralize Bias for Non-Gender Specific Words¶\n\nBoliukbasi et al., 2016\n\nThe figure below should help you visualize what neutralizing does. If you're using a 50-dimensional word embedding, the 50 dimensional space can be split into two parts: The bias-direction $g$, and the remaining 49 dimensions, which is called $g_{\\perp}$ here. In linear algebra, we say that the 49-dimensional $g_{\\perp}$ is perpendicular (or \"orthogonal\") to $g$, meaning it is at 90 degrees to $g$. The neutralization step takes a vector such as $e_{receptionist}$ and zeros out the component in the direction of $g$, giving us $e_{receptionist}^{debiased}$.", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_21", "embedding": [ -0.006977511569857597, -0.0038952636532485485, 0.03409009799361229, -0.01721460185945034, -0.021335605531930923, 0.0461701825261116, 0.10920336097478867, -0.08136823773384094, 0.007614367175847292, 0.035732537508010864, 0.09940392524003983, 0.021554576233029366, 0.04657134786248207, -0.029003793373703957, -0.022125015035271645, 0.07191731780767441, 0.05387809872627258, 0.043518055230379105, -0.10142680257558823, -0.02589072287082672, -0.009645912796258926, -0.012203844264149666, -0.04606061801314354, -0.03409711644053459, 0.016778135672211647, -0.04676273092627525, 0.021509675309062004, 0.025818616151809692, -0.003017240669578314, -0.016423417255282402, 0.0521070770919323, 0.03672037646174431, 0.05757893621921539, 0.03585425764322281, -0.11102499812841415, 0.01996830478310585, -0.03531545773148537, 0.03780133277177811, 0.017831189557909966, 0.08177539706230164, 0.026466315612196922, 0.028693517670035362, -0.07236229628324509, 0.013679267838597298, 0.04476645961403847, -0.021675197407603264, -0.02644941955804825, 0.0033340600784868, -0.03937811404466629, -0.07727491110563278, 0.0258028581738472, -0.031035998836159706, -0.04169907048344612, 0.09464017301797867, -0.13329395651817322, -0.05800614878535271, 0.03277473524212837, 0.001713969511911273, -0.03405647724866867, 0.007920870557427406, -0.037384480237960815, -0.1117139607667923, -0.011291539296507835, -0.0017115713562816381, -0.02314535155892372, -0.07663163542747498, -0.0021668672561645508, -0.01463122945278883, -0.06276316195726395, 0.018477633595466614, 9.92038767435588e-05, 0.013254450634121895, -0.01914295367896557, -0.04450684040784836, 0.042522888630628586, -0.0030393132474273443, 0.06788823008537292, -0.006508864462375641, 0.1614571362733841, -0.0702672228217125, 0.00944457482546568, -0.057041656225919724, 0.054418809711933136, 0.03899146616458893, -0.00019875953148584813, -0.030581165105104446, -0.033256594091653824, -0.03539839759469032, -0.033779777586460114, 0.012240090407431126, -0.05778655409812927, -0.00118897610809654, 0.026701919734477997, 0.025465771555900574, -0.0010796134592965245, -0.028521953150629997, -0.08194474130868912, 0.023825280368328094, -0.0017560272244736552, 0.08427827805280685, 0.009307879023253918, 0.04310895875096321, -0.03175874054431915, -0.0037445479538291693, -0.06959862262010574, -0.03700572997331619, 0.05156826227903366, 0.026751792058348656, -0.05978992581367493, -0.1036018654704094, -0.07648210227489471, -0.020921705290675163, -0.0028873817063868046, 0.011941548436880112, -0.059744346886873245, -0.031017884612083435, 0.08269944787025452, 0.06391128152608871, 0.08283589780330658, -0.05950537323951721, 0.018216503784060478, -0.0025386246852576733, -0.007842880673706532, 0.06367681920528412, -0.03090674988925457, 0.01792481727898121, 0.01651526428759098, 8.054481781704545e-34, -0.0013993445318192244, 0.05535540357232094, -0.027321772649884224, 0.0335736982524395, 0.005572620779275894, 0.05387057363986969, -0.05805538222193718, 0.06648070365190506, 0.030519993975758553, 0.03825565427541733, -0.028610263019800186, 0.036892492324113846, 0.02138475887477398, 0.023969018831849098, -0.060005269944667816, -0.03855311498045921, 0.0319364033639431, 0.0750758945941925, -0.0903538167476654, -0.03601659834384918, 0.034512996673583984, 0.0862128958106041, -0.08551819622516632, -0.05662348493933678, -0.07824298739433289, 0.00621123006567359, 0.0031433594413101673, -0.032540321350097656, -0.059448447078466415, -0.002862510969862342, -0.05910224840044975, -0.028389962390065193, 0.017966253682971, 0.042028095573186874, 0.04380583018064499, -0.0021734419278800488, 0.006863554939627647, -0.0008015327039174736, -0.011968513019382954, 0.012593681924045086, -0.05663229525089264, 0.031151240691542625, 0.12284958362579346, -0.09471609443426132, -0.028063716366887093, 0.08071959763765335, 0.07537564635276794, 0.0037534181028604507, 0.028721321374177933, 0.03679312765598297, 0.000176794666913338, 0.02514946274459362, 0.0039839968085289, 0.07142215967178345, -0.005141158122569323, 0.04613954573869705, 0.05243441089987755, 0.04036160185933113, 0.07528019696474075, -0.04987196996808052, 0.007737850304692984, 0.07274185866117477, 0.04370111599564552, -0.07782474160194397, 0.018912894651293755, 0.02769283764064312, -0.09416446089744568, -0.06268966943025589, 0.05779177322983742, 0.0729387104511261, -0.01209749560803175, 0.10562052577733994, 0.031571779400110245, 0.04864576831459999, -0.09225433319807053, 0.06235726550221443, -0.008394116535782814, 0.008677951991558075, 0.044923193752765656, 0.003063409822061658, -0.033616457134485245, -0.029720181599259377, -0.06300471723079681, -0.059544023126363754, -0.10663033276796341, -0.08778749406337738, 0.02147771045565605, -0.08063208311796188, 0.032907623797655106, 0.08396536856889725, 0.006013143807649612, 0.016754664480686188, -0.05162825062870979, 0.07643715292215347, 0.014341534115374088, -2.169564005564617e-33, -0.06074894964694977, -0.006740996614098549, -0.1222381517291069, -0.00569691089913249, -0.028098611161112785, -0.02918904833495617, 0.10790608078241348, 0.056176576763391495, 0.005568822380155325, 0.07069694250822067, -0.013815195299685001, -0.03866729885339737, 0.048506464809179306, 0.05745503678917885, 0.034102149307727814, 0.014264721423387527, 0.051811590790748596, 0.025713114067912102, -0.03495357558131218, 0.009688438847661018, 0.05779720097780228, 0.10353926569223404, -0.04382752999663353, 0.10515516996383667, 0.09757746756076813, 0.053594183176755905, 0.08194912225008011, -0.030901100486516953, 0.042603202164173126, 0.0580144077539444, -0.07904934138059616, -0.05412657931447029, -0.06791404634714127, 0.07461319118738174, -0.028577473014593124, -0.05097634345293045, -0.08428289741277695, 0.06479211896657944, 0.010396894067525864, -0.03725643455982208, -0.0016694617224857211, 0.004613532684743404, -0.0383094847202301, -0.020384496077895164, 0.041175685822963715, 0.014225671999156475, -0.01576857455074787, -0.02500927820801735, -0.036075398325920105, -0.04436768591403961, -0.07737285643815994, 0.03784820809960365, -0.03199706971645355, 0.07812444120645523, -0.05106809735298157, -0.07110919803380966, 0.03955521807074547, -0.07757928967475891, 0.06625618785619736, 0.0378357470035553, -0.03248891234397888, -0.04875395447015762, 0.006054949946701527, -0.025417890399694443, -0.05360879376530647, -0.05176369473338127, 0.015699094161391258, -0.0772508978843689, 0.06830350309610367, -0.020053114742040634, 0.0733422264456749, 0.011744501069188118, -0.04062396287918091, -0.08947806060314178, -0.04160325229167938, 0.02155068702995777, 0.049960944801568985, -0.06860405206680298, -0.06039058044552803, -0.019958902150392532, -0.0117155397310853, -0.05152241513133049, 0.08105186372995377, -0.005767184309661388, -0.00763882789760828, 0.005997085012495518, -0.015587965026497841, 0.05114636570215225, -0.017859501764178276, -0.026045145466923714, 0.02844458632171154, -0.03905743360519409, 0.003035286907106638, 0.022870562970638275, 0.005452653393149376, -4.729253788582355e-08, -0.08574298769235611, -0.015604705549776554, -0.01600002311170101, 0.02392720617353916, -0.003310550469905138, -0.16903835535049438, 0.015419205650687218, -0.15340736508369446, -0.051381632685661316, 0.012769541703164577, 0.014819192700088024, -0.005153869278728962, -0.04544439911842346, -0.014872156083583832, 0.07464002072811127, 0.06694817543029785, -0.011845652014017105, 0.04333522543311119, 0.026728974655270576, 0.0415189154446125, 0.004116349387913942, -0.003919124137610197, -0.0891975685954094, 0.0016579973744228482, -0.022669920697808266, 0.012063993141055107, 0.03212757781147957, 0.05673118680715561, 0.09719240665435791, -0.055453453212976456, 0.014974557794630527, 0.07729381322860718, -0.05995455011725426, -0.00948244147002697, 0.001989461714401841, 0.08571957796812057, -0.01553854625672102, 0.019780734553933144, 0.029278064146637917, 0.013042746111750603, -0.027799975126981735, -0.03559654578566551, -0.030396120622754097, -0.009079852141439915, 0.07732163369655609, 0.039347145706415176, 0.049070656299591064, -0.019804518669843674, -0.05040400102734566, 0.022005097940564156, 0.11510716378688812, -0.004884724039584398, -0.017945531755685806, 0.022922171279788017, -0.015668826177716255, -0.04005301743745804, 0.03778580203652382, -0.03258682042360306, 0.004869111347943544, 0.047370925545692444, 0.012476282194256783, 0.02275622822344303, -0.05684835836291313, -0.08622955530881882 ] }, { "text": "Even though $g_{\\perp}$ is 49-dimensional, given the limitations of what you can draw on a 2D screen, it's illustrated using a 1-dimensional axis below.\n\nFigure 2: The word vector for \"receptionist\" represented before and after applying the neutralize operation.\n\nExercise 3 - neutralize¶\n\nImplement neutralize() to remove the bias of words such as \"receptionist\" or \"scientist.\"\n\nGiven an input embedding $e$, you can use the following formulas to compute $e^{debiased}$:\n\n$$e^{bias\\_component} = \\frac{e \\cdot g}{||g||_2^2} * g\\tag{2}$$$$e^{debiased} = e - e^{bias\\_component}\\tag{3}$$\nIf you are an expert in linear algebra, you may recognize $e^{bias\\_component}$ as the projection of $e$ onto the direction $g$. If you're not an expert in linear algebra, don't worry about this. ;)", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_22", "embedding": [ 0.008636225014925003, 0.046088188886642456, 0.008207055740058422, -0.07845564186573029, -0.010131770744919777, 0.016399115324020386, 0.07819871604442596, -0.03141914680600166, -0.007361619733273983, 0.03646068647503853, 0.07698199898004532, 0.01592671312391758, 0.0611075684428215, -0.015786495059728622, -0.06162825599312782, 0.04327522963285446, 0.07750241458415985, 0.08086921274662018, -0.09533742815256119, -0.033899132162332535, -0.025256987661123276, -0.02699536271393299, -0.06916612386703491, -0.057755399495363235, 0.039447687566280365, -0.042564161121845245, 0.07121951133012772, 0.01769312657415867, 0.013804499059915543, -0.06956237554550171, 0.0793863832950592, -0.02462274581193924, 0.03456328809261322, 0.04228489100933075, -0.1048051118850708, 0.022970007732510567, -0.051621995866298676, 0.006509533151984215, -0.048088036477565765, 0.07470972836017609, 0.0443122461438179, 0.057629719376564026, -0.08298445492982864, 0.003248606575652957, 0.08047075569629669, -0.058227572590112686, 0.007751537952572107, -0.028749793767929077, 0.003442595712840557, -0.09770701080560684, 0.016216933727264404, -0.048867762088775635, -0.05908213555812836, 0.0022803654428571463, -0.08468896895647049, -0.07072828710079193, 0.027314040809869766, -0.035763729363679886, -0.006813509855419397, 0.004257301799952984, 0.027475953102111816, -0.099676214158535, 0.020689258351922035, -0.030879871919751167, -0.016463572159409523, -0.029467470943927765, 0.07155391573905945, 0.0005590838263742626, -0.0719807967543602, 0.01374299731105566, -0.01971421018242836, -0.006604546215385199, -0.023837707936763763, -0.12825781106948853, 0.01885507069528103, 0.03429235517978668, 0.00013284027227200568, -0.003420688211917877, 0.14180657267570496, -0.06016821041703224, 0.07900780439376831, -0.055503085255622864, 0.04649457335472107, 0.060907091945409775, 0.01375511009246111, -0.006271852180361748, -0.05769544467329979, 0.021301032975316048, -0.0012296593049541116, -0.030229980126023293, -0.035972777754068375, 0.02467753179371357, -0.07028768211603165, 0.006834961473941803, -0.008888300508260727, -0.013380846008658409, -0.06875873357057571, -0.022703777998685837, 0.0025187493301928043, 0.09923349320888519, 0.01753648743033409, 0.027188275009393692, -0.00935149472206831, 0.044350363314151764, -0.05327724665403366, -0.022343741729855537, 0.03268051892518997, 0.05180025473237038, -0.013505293987691402, -0.11936650425195694, -0.06619200110435486, 0.037172675132751465, -0.07005435228347778, 0.03407201170921326, -0.009255414828658104, -0.048897214233875275, 0.10954441130161285, 0.07970187067985535, 0.09498747438192368, -0.016980642452836037, 0.042501091957092285, 0.01320680696517229, -0.009690070524811745, 0.05515611544251442, -0.0010787897044792771, 0.020708778873085976, -0.0007350885425694287, 2.1398486104017835e-33, -0.04136748984456062, 0.05095653235912323, -0.015886293724179268, 0.014851401560008526, -0.007154314778745174, 0.08916548639535904, -0.1129300519824028, 0.0885186567902565, 0.07903266698122025, 0.018735015764832497, -0.027042197063565254, 0.0247820932418108, 0.03850608319044113, 0.02214767225086689, -0.03348829224705696, -0.027036644518375397, 0.03329101577401161, 0.07475295662879944, -0.06269647181034088, -0.07463003695011139, 0.015772122889757156, 0.032181598246097565, -0.06692960113286972, -0.023020651191473007, -0.06733393669128418, -0.0038998262025415897, -0.01835542544722557, -0.03532117232680321, -0.0746273621916771, -0.016222771257162094, 0.002263699658215046, -0.04503403976559639, 0.008739413693547249, 0.01695910468697548, -0.0014597887638956308, -0.05627349391579628, -0.02143295668065548, 0.0044706170447170734, 0.03614915907382965, -0.036126237362623215, -0.042028412222862244, 0.06319974362850189, 0.15316472947597504, -0.07060908526182175, -0.04130176454782486, 0.0641406998038292, 0.1045476496219635, -0.03135183826088905, 0.05550520867109299, 0.010764479637145996, 0.02423080988228321, 0.0002998477139044553, -0.0020513543859124184, 0.013887910172343254, 0.0013915903400629759, 0.01651844009757042, 0.017181046307086945, 0.05294866859912872, 0.10309868305921555, -0.02406235784292221, -0.05236057937145233, 0.1203184723854065, 0.04500915855169296, -0.06880927830934525, 0.04577866941690445, 0.049514662474393845, -0.14967551827430725, -0.0356425866484642, 0.031088484451174736, 0.0659499540925026, -0.0026523154228925705, 0.0738830491900444, 0.08013229072093964, 0.004987608175724745, -0.08768019825220108, 0.012437327764928341, -0.0020717494189739227, 0.02214372158050537, 0.03566546365618706, 0.019594216719269753, -0.0602855458855629, -0.04773891344666481, -0.06838721036911011, -0.053974494338035583, -0.05564955994486809, -0.07130391150712967, -0.012610381469130516, -0.08484149724245071, -0.005117808002978563, 0.09001937508583069, -0.02995900996029377, 0.0018880590796470642, -0.08066708594560623, 0.037248820066452026, -0.011821580119431019, -3.011133104754925e-33, -0.049219682812690735, 0.07270494103431702, -0.04621176794171333, 0.007759197615087032, 0.006733239162713289, -0.028584511950612068, 0.07582322508096695, 0.02215573936700821, -0.016920117661356926, 0.03714726120233536, -0.022950027137994766, 0.049563128501176834, 0.06599781662225723, 0.05503969267010689, 0.052935890853405, 0.060494814068078995, -0.01912836544215679, 0.028312481939792633, -0.07620328664779663, 0.02729637362062931, 0.016215935349464417, 0.06203516572713852, -0.000842483073938638, 0.0849786028265953, 0.12575051188468933, 0.05491795763373375, 0.12062979489564896, -0.045015718787908554, 0.02726607583463192, 0.0346778929233551, -0.0677960216999054, -0.003327844198793173, -0.04644332453608513, 0.0827987939119339, -0.028417494148015976, -0.06357049196958542, -0.022183852270245552, 0.04202019050717354, -0.01936599612236023, -0.054022930562496185, 0.014936372637748718, 0.04084816947579384, -0.018296560272574425, 0.016404954716563225, 0.02598370611667633, 0.040219105780124664, 0.030287781730294228, -0.022357845678925514, -0.029384251683950424, 0.008733125403523445, -0.0701441839337349, 0.04915202781558037, -0.041505590081214905, 0.057945575565099716, -0.037839192897081375, -0.05942443385720253, 0.017817547544836998, -0.05402892827987671, 0.061742570251226425, 0.006913657765835524, -0.04903345927596092, -0.09830484539270401, 0.006357355043292046, -0.021013135090470314, -0.023341882973909378, -0.02804369106888771, 0.013780473731458187, -0.009637889452278614, 0.042689498513936996, -0.005198583472520113, 0.06441216915845871, 0.03379962220788002, -0.035582538694143295, -0.09158468246459961, -0.018342014402151108, 0.04715501517057419, 0.06477891653776169, -0.05659868195652962, -0.024875100702047348, -0.02437317743897438, -0.0479474738240242, -0.044299639761447906, 0.07518979907035828, -0.029431387782096863, 0.014152872376143932, -0.01156589575111866, -0.025334885343909264, 0.04473156854510307, 0.024828612804412842, -0.031716540455818176, -0.017379095777869225, 0.03313423693180084, 0.03348353132605553, 0.013508593663573265, 0.05676410347223282, -5.2849067344595824e-08, -0.09515184164047241, -0.031629715114831924, 0.06588300317525864, 0.031455568969249725, 0.033441655337810516, -0.12649375200271606, -0.015431349165737629, -0.12754324078559875, -0.08315957337617874, -0.03250296786427498, 0.029131239280104637, -0.03727312013506889, -0.044287294149398804, -0.024231864139437675, 0.0246847216039896, 0.05091625824570656, 0.004925956018269062, -0.0016524519305676222, 0.021664036437869072, 0.062069252133369446, -0.029088273644447327, 0.001091024954803288, -0.022177886217832565, 0.039125628769397736, -0.03584917634725571, -0.019431408494710922, -0.003770350245758891, -0.010355031117796898, 0.11915899813175201, -0.019056571647524834, 0.02396651916205883, 0.02741437591612339, -0.011030599474906921, -0.011459451168775558, -0.009269798174500465, -0.02451261319220066, 0.006301127374172211, 0.001569687738083303, 0.012268067337572575, 0.055057745426893234, -0.04958685487508774, 0.023226091638207436, 0.02360493317246437, -0.004976554308086634, 0.06450719386339188, 0.0656450167298317, 0.062004223465919495, -0.020929459482431412, -0.023711608722805977, 0.02360713668167591, 0.10015266388654709, -0.0522596538066864, -0.06825349479913712, 0.05235866457223892, -0.008133653551340103, -0.10131434351205826, 0.03462214022874832, -0.01645343191921711, 0.012187625281512737, 0.02437039092183113, -0.02326972410082817, 0.018183622509241104, -0.08191592991352081, -0.08922943472862244 ] }, { "text": "In [23]:\n\ndef neutralize(word, g, word_to_vec_map):\n\"\"\"\nRemoves the bias of \"word\" by projecting it on the space orthogonal to the bias axis.\nThis function ensures that gender neutral words are zero in the gender subspace.\n\nArguments:\nword -- string indicating the word to debias\ng -- numpy-array of shape (50,), corresponding to the bias axis (such as gender)\nword_to_vec_map -- dictionary mapping words to their corresponding vectors.\n\nReturns:\ne_debiased -- neutralized word vector representation of the input \"word\"\n\"\"\"\n\ne = word_to_vec_map[word]\ne_biascomponent = np.dot(e, g) / np.dot(g, g) * g\ne_debiased = e - e_biascomponent\n\nreturn e_debiased\n\nIn [24]:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_23", "embedding": [ -0.0017275522695854306, -0.016960566863417625, -0.020076358690857887, -0.01796676404774189, 0.02119939588010311, -0.020594406872987747, 0.063983254134655, -0.09078346937894821, -0.09802540391683578, 0.03920677304267883, 0.01135467179119587, -0.026313886046409607, 0.04950777813792229, -0.013300751335918903, 0.00329352798871696, 0.07441920787096024, 0.025424756109714508, 0.07710708677768707, -0.04146302863955498, -0.06470877677202225, -0.0038760583847761154, 0.07138283550739288, 0.0009447691263630986, -0.023658350110054016, 0.037772536277770996, -0.010849743150174618, 0.03168748319149017, 0.04329054430127144, -0.08293236047029495, -0.006096776574850082, 0.09473191201686859, 0.027239136397838593, 0.061552874743938446, 0.011946284212172031, -0.08512222766876221, 0.015210513025522232, -0.05341269075870514, -0.03185301274061203, 0.04398177191615105, 0.026392392814159393, 0.009088530205190182, 0.016441037878394127, -0.09317144006490707, -0.0387791208922863, 0.07064281404018402, 0.05753650888800621, -0.016656262800097466, 0.020368387922644615, -0.036718301475048065, -0.07133358716964722, 0.07850535213947296, -0.0649050623178482, -0.09848719090223312, 0.08205944299697876, -0.1556837111711502, -0.04155653342604637, 0.033829234540462494, -0.03136467933654785, -0.01686445064842701, -0.04858621582388878, -0.06305722892284393, -0.07631254941225052, 0.00792334508150816, 0.0008973789517767727, -0.03346474468708038, -0.05626882612705231, 0.03433728218078613, 0.04767448827624321, -0.020892901346087456, 0.05124403163790703, 0.05068641155958176, 0.04500918462872505, 0.030281463637948036, -0.0360364131629467, 0.010815671645104885, 0.030744753777980804, 0.12935897707939148, -0.015717672184109688, 0.15815259516239166, -0.018474191427230835, -0.015536144375801086, -0.03635034337639809, 0.07251685857772827, 0.07946304231882095, -0.00599677162244916, -0.032873451709747314, -0.06364934146404266, -0.03631823882460594, -0.0032222303561866283, 0.009732075966894627, -0.059919316321611404, -0.04001995548605919, 0.0821143314242363, -0.008241803385317326, 0.037820521742105484, -0.03567636385560036, -0.023377271369099617, -0.014670363627374172, 0.012374655343592167, 0.0824054554104805, 0.0382743738591671, -0.002919000107795, -0.06187012046575546, -0.051305633038282394, -0.004009155090898275, 0.03732557222247124, 0.04452608525753021, -0.017425687983632088, -0.02047845348715782, -0.09517762064933777, -0.06137244403362274, -0.0532626137137413, -0.024252651259303093, 0.03274126350879669, -0.03634608909487724, -0.02627725712954998, 0.08121871948242188, 0.07499270886182785, 0.08003979921340942, -0.02177584543824196, -0.02813507430255413, -0.00624666316434741, 0.04427846148610115, 0.019324664026498795, -0.03581738471984863, 0.03197149187326431, -0.02440357208251953, 1.8927909219276324e-33, -0.04048192501068115, 0.011020669713616371, -0.009235485456883907, 0.01069862861186266, 0.028769172728061676, 0.09770697355270386, -0.0015448977937921882, -0.01085815578699112, -0.06826864182949066, -0.0364709198474884, -0.06429414451122284, 0.05552976578474045, -0.04268181696534157, 0.0030494658276438713, -0.039931051433086395, -0.014696185477077961, 0.04988294467329979, 0.03870641440153122, -0.06030993163585663, -0.05215214937925339, 0.035528432577848434, 0.07742160558700562, -0.061655737459659576, -0.058806825429201126, -0.08718905597925186, -0.0558219775557518, -0.017304303124547005, -0.05030839890241623, -0.07446733862161636, -0.012809520587325096, -0.0866374671459198, -0.04872462525963783, 0.07054582238197327, 0.05203656479716301, 0.04544536769390106, -0.04295995086431503, 0.04272150993347168, 0.06116234511137009, -0.024520253762602806, -0.009433181025087833, -0.007516892626881599, -0.018109964206814766, 0.10670154541730881, -0.11445660889148712, -0.032741110771894455, 0.06915953010320663, 0.04345877841114998, 0.07832300662994385, 0.028271520510315895, 0.06816897541284561, 0.0018571056425571442, -0.006485690362751484, -0.010905241593718529, 0.07924477010965347, -0.02795465476810932, 0.04755907505750656, 0.0850314274430275, 0.03385886549949646, 0.07979468256235123, -0.07982183992862701, 0.034400295466184616, 0.050658587366342545, 0.08697635680437088, -0.062331534922122955, 0.0002872029726859182, 0.033518873155117035, -0.03691401332616806, -0.043998900800943375, 0.00340909487567842, 0.04267476871609688, -0.01831880770623684, 0.042976681143045425, -0.06844040006399155, 0.054005641490221024, -0.05869406834244728, 0.05060984939336777, 0.013737048953771591, -0.0032496617641299963, -0.022065985947847366, -0.027398768812417984, 0.00800759345293045, 0.025386665016412735, -0.10735413432121277, -0.07618462294340134, -0.13006280362606049, -0.09737516194581985, -0.007799249142408371, -0.11512742936611176, 0.02823403663933277, -0.005741475149989128, -0.04055727273225784, 0.0041745067574083805, -0.052986547350883484, 0.0328441746532917, -0.00932143535465002, -4.109542209470133e-33, -0.06697092950344086, 0.010705074295401573, -0.048494067043066025, 0.03249594569206238, -0.03742978721857071, -0.08244994282722473, 0.15095332264900208, -0.0062468396499753, 0.08977658301591873, 0.05990393087267876, 0.002548887627199292, -0.0426408052444458, 0.06372001767158508, 0.029850918799638748, 0.09816952794790268, -0.013889041729271412, -0.028827635571360588, 0.06586721539497375, 0.00853432435542345, 0.02031986601650715, 0.005294451490044594, 0.09630317986011505, -0.014860505238175392, 0.02781469002366066, 0.013844924047589302, 0.039661955088377, 0.05508210510015488, -0.03124239481985569, 0.05008946731686592, 0.03773544728755951, -0.0718209370970726, -0.011819390580058098, -0.04203221574425697, 0.06330865621566772, 0.008324773982167244, -0.030173789709806442, -0.0797010287642479, 0.04346980154514313, -0.009306459687650204, -0.04887145012617111, 0.0025570960715413094, 0.08386839181184769, -0.08096951991319656, -0.016875285655260086, 0.0202272180467844, 0.03846646100282669, 0.0055792005732655525, -0.01239724550396204, 0.02140302211046219, 0.02420584298670292, -0.05891820788383484, 0.04567548260092735, -0.035581160336732864, 0.0732339471578598, -0.023317238315939903, -0.05751502141356468, -0.015956342220306396, -0.06553824245929718, 0.015154289081692696, 0.028365805745124817, -0.06693006306886673, -0.044459618628025055, -0.053391579538583755, -0.0011635194532573223, -0.03482891246676445, -0.03891880810260773, -0.02013874612748623, -0.07530700415372849, 0.08192843198776245, 0.018364710733294487, 0.13194604218006134, 0.05973375588655472, -0.01210249587893486, -0.04854196682572365, -0.06024559214711189, -0.000456805806607008, 0.0056686787866055965, -0.0435098372399807, -0.08080503344535828, -0.021430790424346924, 0.019178619608283043, -0.031056616455316544, 0.09084971994161606, 0.04241391271352768, -0.04378852993249893, 0.0036461688578128815, -0.030718587338924408, 0.05052109435200691, 0.03206611052155495, 0.029238689690828323, 0.023782968521118164, -0.055000465363264084, -0.013629480265080929, 0.06032693013548851, -0.003056115936487913, -4.1810558570887224e-08, -0.045290421694517136, 0.012643895111978054, -0.03267119824886322, 0.04893704876303673, -0.03504509851336479, -0.12215036153793335, 0.009135415777564049, -0.11232580244541168, -0.02768947370350361, -0.010048720054328442, 0.013913908042013645, 0.002598861698061228, -0.06992242485284805, -0.04825031757354736, 0.02768407203257084, 0.0636315867304802, 0.038120586425065994, 0.07281962782144547, 0.04453825578093529, -0.016879139468073845, 0.008569002151489258, -0.041414130479097366, -0.09024368971586227, 0.030092254281044006, -0.03479795902967453, -0.00446752505376935, 0.006543247029185295, -0.002184287179261446, 0.07293380796909332, -0.06361977010965347, 0.03998124599456787, 0.018304990604519844, -0.01063972245901823, -0.0036543619353324175, 0.003109878161922097, 0.01804976351559162, -0.0535472147166729, 0.03816334158182144, 0.019164394587278366, 0.08657249808311462, -0.057991333305835724, 0.04738477244973183, -0.030267514288425446, -0.022204987704753876, 0.03092845156788826, 0.05355733633041382, 0.0348367914557457, -0.025566203519701958, -0.02386670932173729, 0.0440918430685997, 0.07776162028312683, 0.026771817356348038, -0.02846701070666313, -0.016157912090420723, -0.011636163108050823, -0.028211651369929314, -0.024026986211538315, 0.04282011836767197, -0.039067864418029785, 0.032129693776369095, -0.005794838070869446, 0.042527277022600174, -0.001077250693924725, -0.10685886442661285 ] }, { "text": "e = word_to_vec_map[word]\ne_biascomponent = np.dot(e, g) / np.dot(g, g) * g\ne_debiased = e - e_biascomponent\n\nreturn e_debiased\n\nIn [24]:\n\ne = \"receptionist\"\nprint(\"cosine similarity between \" + e + \" and g, before neutralizing: \", cosine_similarity(word_to_vec_map[\"receptionist\"], g))\n\ne_debiased = neutralize(\"receptionist\", g, word_to_vec_map)\nprint(\"cosine similarity between \" + e + \" and g, after neutralizing: \", cosine_similarity(e_debiased, g))\n\ncosine similarity between receptionist and g, before neutralizing: 0.33077941750593737\ncosine similarity between receptionist and g, after neutralizing: -2.6832242276243644e-17\n\n4.2 - Equalization Algorithm for Gender-Specific Words¶", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_24", "embedding": [ 0.014764662832021713, 0.015479730442166328, -0.027706753462553024, -0.02684367448091507, -0.02309250272810459, -0.05238739401102066, 0.040386419743299484, -0.011648064479231834, -0.08761995285749435, 0.010708467103540897, 0.09178227931261063, -0.07319571077823639, 0.019081035628914833, -0.024516601115465164, 0.010420787148177624, 0.01116619911044836, 0.0285581573843956, 0.0632832944393158, -0.054233476519584656, -0.08641549199819565, -0.00812546070665121, 0.058380115777254105, -0.015250791795551777, 0.0023143202997744083, 0.012804444879293442, 0.021997936069965363, 0.005344785284250975, 0.060098905116319656, -0.05276711657643318, 0.0028345459140837193, 0.059733953326940536, 0.022964732721447945, 0.06849176436662674, 0.03427779674530029, -0.06590469181537628, 0.027918854728341103, -0.028276436030864716, -0.05165168642997742, 0.0750223845243454, 0.018335040658712387, -0.04162104055285454, -0.009048864245414734, -0.05817952752113342, -0.002336957026273012, 0.03449466452002525, 0.01869504153728485, -0.05820442736148834, 0.05133846402168274, -0.004304248373955488, -0.04007323086261749, 0.06449215859174728, 0.004903575871139765, -0.1277710646390915, 0.046214278787374496, -0.10109949856996536, -0.004316700156778097, 0.020498160272836685, -0.037781111896038055, -0.0026596083771437407, -0.05802923068404198, -0.09241723269224167, -0.10153763741254807, 0.038858626037836075, 0.00046772166388109326, -0.005861592013388872, -0.022601518779993057, 0.03594176471233368, -0.02278931625187397, 0.006836188957095146, 0.046100057661533356, 0.023049626499414444, 0.027194160968065262, -0.02295931614935398, -0.0033371211029589176, -0.024098316207528114, 0.05752681568264961, 0.040100179612636566, -0.004359462298452854, 0.10575268417596817, -0.03262628614902496, -0.026496082544326782, -0.07936763018369675, 0.08241330832242966, 0.08898745477199554, 0.007286473177373409, -0.04623357951641083, -0.059256717562675476, -0.06064378842711449, 0.012901888228952885, -0.001850039348937571, -0.03906446322798729, -0.03610444813966751, 0.032169051468372345, -0.021139472723007202, 0.006165144499391317, -0.020045505836606026, -0.05672260373830795, 0.045035846531391144, -0.014103622175753117, 0.051776476204395294, 0.02623889409005642, 0.03510352224111557, -0.056330665946006775, -0.0836825743317604, -0.05939842015504837, 0.008878596127033234, 0.09536387771368027, -0.01084410585463047, 0.001505472813732922, -0.09575628489255905, -0.0698896273970604, -0.05599172040820122, -0.00480944337323308, -0.0023549385368824005, -0.021059388294816017, 0.027774568647146225, 0.07719998061656952, 0.06690116226673126, 0.07631441205739975, 0.02021767571568489, 0.027863917872309685, 0.004226462449878454, 0.019848138093948364, 0.01702743209898472, -0.06936044991016388, -0.039975203573703766, -0.0142152588814497, 3.639376795235866e-33, -0.07971633225679398, 0.06549874693155289, 0.05178653821349144, 0.018412286415696144, 0.009086268953979015, 0.10743691027164459, -0.09601373970508575, 0.010249356739223003, -0.03429620712995529, -0.0325942263007164, -0.11711926758289337, 0.10922801494598389, -0.013532416895031929, -0.010041353292763233, -0.07733708620071411, 0.021575428545475006, 0.027321483939886093, 0.018725495785474777, -0.0995739996433258, -0.029092134907841682, 0.05646535009145737, 0.03326903283596039, -0.07287359237670898, 0.043206002563238144, -0.011700935661792755, -0.03578050434589386, -0.036356229335069656, -0.013398665003478527, -0.011763791553676128, -0.01151809748262167, -0.04534786567091942, -0.01926010474562645, 0.01717054285109043, 0.04419983550906181, 0.06589072942733765, -0.04548382759094238, 0.035179510712623596, 0.007754263933748007, -0.017291517928242683, -0.03244682401418686, -0.07929014414548874, 0.029330622404813766, 0.09778714179992676, -0.10248393565416336, 0.022424597293138504, 0.031125398352742195, 0.0014338825130835176, 0.04332537204027176, 0.05581679195165634, 0.04663539677858353, 0.02540951408445835, -0.018168484792113304, -0.015366491861641407, 0.1067657545208931, -0.0720532089471817, 0.03391594439744949, 0.07580071687698364, 0.05265289545059204, 0.06498218327760696, -0.022851210087537766, 0.05221223458647728, 0.08848933130502701, 0.09561632573604584, -0.0731215551495552, 0.04809480160474777, 0.0034557136241346598, -0.06921589374542236, -0.02230231463909149, 0.02692098543047905, 0.0651480033993721, 0.012940073385834694, 0.039284832775592804, -0.0064412858337163925, 0.07634351402521133, -0.052304863929748535, 0.016826722770929337, -0.002216567751020193, -0.0008070245385169983, -0.0134665472432971, -0.05536993220448494, -0.047870565205812454, 0.018622083589434624, -0.03736334666609764, -0.1307232826948166, -0.11864630877971649, -0.08520800620317459, 0.005139939021319151, -0.07393413037061691, 0.023317864164710045, 0.045310478657484055, -0.008630700409412384, 0.06044651195406914, -0.04159001633524895, 0.0319334976375103, -0.020346369594335556, -5.7130619714176476e-33, -0.11293791979551315, -0.000702878343872726, -0.05336947739124298, 0.00849846564233303, -0.06301935762166977, -0.030985066667199135, 0.1443321257829666, -0.06667035073041916, 0.06075279042124748, 0.03535185009241104, 0.02688394859433174, -0.06509418785572052, 0.03856232017278671, 0.005113402381539345, 0.10038384795188904, 0.02298206277191639, 0.014277906157076359, 0.11731567233800888, 0.015635281801223755, 0.07906421273946762, 0.04480482637882233, 0.05307749658823013, -0.03601188585162163, 0.04431113228201866, 0.05383553355932236, 0.03947146609425545, 0.030061790719628334, -0.0630653128027916, 0.022932223975658417, -0.0021522140596061945, -0.09815434366464615, 0.004034493118524551, -0.04675721004605293, 0.07998596876859665, -0.017524447292089462, -0.045149438083171844, -0.01628846488893032, 0.0021335340570658445, -0.01640891470015049, -0.06268775463104248, -0.010835723951458931, 0.05750883370637894, -0.08052776008844376, -0.02207767218351364, 0.05952318012714386, 0.016804013401269913, -0.009894326329231262, -0.029687199741601944, 0.012837792746722698, -0.007963853888213634, 0.00792408175766468, 0.052751172333955765, -0.10269723832607269, 0.085114024579525, -0.024838116019964218, -0.05736810341477394, -0.010396228171885014, -0.07641036808490753, -0.05086393281817436, 0.0015671482542529702, -0.026861827820539474, -0.08015233278274536, 0.009085205383598804, 0.03453386574983597, 0.004824432544410229, -0.06263668835163116, -0.0035936706699430943, -0.028523171320557594, 0.07267870754003525, -0.011056163348257542, 0.0735645666718483, 0.04978933185338974, -0.015201445668935776, -0.08210800588130951, -0.05597785487771034, -0.027190333232283592, 0.0005046688602305949, -0.057467516511678696, -0.08855560421943665, -0.03422677889466286, -0.04361860826611519, -0.05659036710858345, 0.08129867166280746, 0.06075519323348999, -0.08002234995365143, 0.01795363985002041, 0.002390167908743024, 0.06774197518825531, 0.006398091558367014, 0.03778667002916336, -0.014405384659767151, -0.012305592186748981, -0.06766636669635773, 0.01012092363089323, 0.00247244187630713, -4.4134264243211874e-08, -0.015534776262938976, -0.03055376559495926, -0.04755879566073418, 0.036884505301713943, 0.007463864050805569, -0.0870509222149849, -0.02562079206109047, -0.11579231917858124, -0.07549046725034714, -0.014334119856357574, -0.02193622477352619, 0.015820417553186417, -0.05133339762687683, -0.011723998934030533, 0.0532466322183609, 0.06182359904050827, 0.0416303388774395, 0.04371137171983719, 0.051913436502218246, 0.026339631527662277, 0.01899292878806591, -0.003339537186548114, -0.10494708269834518, 0.0569547563791275, -0.05009019747376442, 0.03105730004608631, -0.0069595458917319775, 0.02366126887500286, 0.0775272399187088, -0.05631737783551216, 0.039171066135168076, -0.024006305262446404, -0.015583413653075695, -0.07052477449178696, -0.020162051543593407, -0.007750832475721836, 0.007231695111840963, 0.061208683997392654, -0.0002564819878898561, 0.1171061247587204, -0.02912323549389839, 0.01549686398357153, -0.05666530504822731, 0.010564768686890602, 0.11501920223236084, 0.008449031971395016, 0.1237981840968132, -0.02782602235674858, -0.008688540197908878, 0.027662331238389015, 0.08019647747278214, -0.0028186163399368525, 0.006397651508450508, -0.03852508217096329, -0.022908305749297142, -0.0812431275844574, 0.005630903411656618, 0.021965300664305687, -0.01759047992527485, 0.039396218955516815, 0.024784494191408157, -0.003085077041760087, 0.01644599251449108, -0.07373630255460739 ] }, { "text": "4.2 - Equalization Algorithm for Gender-Specific Words¶\n\nEqualization is applied to pairs of words that you might want to have differ only through the gender property. As a concrete example, suppose that \"actress\" is closer to \"babysit\" than \"actor.\" By applying neutralization to \"babysit,\" you can reduce the gender stereotype associated with babysitting. But this still does not guarantee that \"actor\" and \"actress\" are equidistant from \"babysit.\" The equalization algorithm takes care of this.", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_25", "embedding": [ 0.03538428246974945, 0.0188268031924963, 0.06439638882875443, -0.0541868656873703, -0.04275893047451973, -0.0608346201479435, 0.017572754994034767, -0.06989657133817673, -0.04844743385910988, 0.01809830032289028, -0.00595925934612751, -0.06222809478640556, 0.06616563349962234, 0.0014747035456821322, 0.022092660889029503, 0.04564802721142769, 0.040949746966362, 0.12641562521457672, -0.07905071973800659, -0.07141616195440292, 0.027624547481536865, -0.0284615196287632, -0.03228384256362915, 0.023394199088215828, -0.033505793660879135, -0.026574790477752686, -0.01184024102985859, 0.020601853728294373, -0.004214051179587841, 0.02846185304224491, 0.013848019763827324, 0.0010324477916583419, 0.06026255711913109, 0.016713805496692657, -0.14262859523296356, 0.014426656067371368, -0.018409155309200287, -0.0192235317081213, 0.04479940980672836, 0.01998005248606205, -0.038973793387413025, -0.036626771092414856, -0.0520540215075016, -0.06358364224433899, 0.005246996879577637, 0.0935748890042305, -0.03325387090444565, 0.007466721348464489, -0.0546695776283741, -0.05471598729491234, 0.015842685475945473, 0.014366263523697853, -0.06269274652004242, 0.11034917831420898, -0.057575590908527374, -0.012575982138514519, 0.003730577416718006, 0.03200434893369675, -0.043087322264909744, 0.008240086026489735, -0.09725388139486313, -0.09396868199110031, 0.0007905279053375125, 0.04042111709713936, 0.0338636115193367, -0.04922161623835564, 0.0713253766298294, -0.023702528327703476, -0.017473768442869186, 0.011637784540653229, 0.07395915687084198, 0.08983372896909714, 0.044605568051338196, 0.09099245816469193, 0.02303391881287098, 0.06417842954397202, 0.0705934539437294, 0.01922914944589138, 0.037573669105768204, 0.026604756712913513, -0.06739673018455505, -0.0555364191532135, 0.06693028658628464, 0.01543961651623249, 0.033705517649650574, -0.01983177848160267, -0.06283003836870193, -0.0724303349852562, -0.07708216458559036, 0.06488820165395737, -0.05532938614487648, -0.01681566797196865, 0.13905885815620422, -0.0441795289516449, 0.0504208579659462, -0.04699200019240379, -0.0313253179192543, 0.0046416232362389565, 0.03087056800723076, 0.019035274162888527, -0.013249213807284832, 0.03149234130978584, -0.029946129769086838, -0.04304568096995354, -0.00414963997900486, -0.04250118508934975, 0.05447820574045181, -0.06029554083943367, -0.0410718135535717, -0.10877112299203873, 0.005828886292874813, -0.05278441682457924, 0.01464683748781681, 0.031017005443572998, -0.0377652682363987, -0.02041766606271267, 0.09190153330564499, 0.03913784399628639, 0.028588982298970222, -0.06063206121325493, -0.025905128568410873, -0.03009488433599472, 0.07032059878110886, 0.005396393593400717, 0.036231931298971176, -0.011472079902887344, -0.03812355175614357, 1.8651761719039168e-33, -0.030268212780356407, 0.037666529417037964, 0.042483389377593994, 0.010223129764199257, -0.04860580712556839, -0.004167289938777685, -0.036535702645778656, 0.006052395328879356, -0.013055196031928062, -0.0208332110196352, 0.013225896283984184, 0.049716878682374954, -0.025759652256965637, -0.011613789945840836, -0.037766482681035995, -0.03957368806004524, 0.04707392305135727, 0.042338646948337555, -0.02956486865878105, -0.01860218495130539, 0.09004675596952438, 0.06262406706809998, -0.08396536856889725, -0.00880016852170229, -0.024789150804281235, 0.001858214964158833, 0.009421855211257935, -0.041455257683992386, 0.07511142641305923, -0.013427934609353542, -0.06865235418081284, 0.0046102125197649, 0.0207815058529377, 0.09618133306503296, 0.04441562294960022, -0.02350853569805622, 0.021579477936029434, 0.043006137013435364, -0.003215726464986801, -0.006609692238271236, -0.024191999807953835, -0.005197255872189999, 0.017097091302275658, -0.12901966273784637, 0.054974060505628586, 0.008533666841685772, -0.0372002050280571, 0.005810982547700405, 0.04721992090344429, 0.06595440208911896, 0.016983630135655403, 0.02204911597073078, 0.0003855520626530051, 0.04417882859706879, -0.012743447907269001, 0.03632518649101257, 0.0922117605805397, -0.022800739854574203, 0.018613941967487335, -0.00857710000127554, 0.020070048049092293, -0.01587471179664135, 0.034571923315525055, -0.07677499204874039, -0.009019071236252785, 0.030084969475865364, 0.04245984926819801, -0.056273479014635086, 0.010769392363727093, 0.03349073976278305, -0.027277501299977303, -0.04075782001018524, -0.03219098970293999, 0.13379544019699097, -0.05072235316038132, -0.017407283186912537, 0.01160274539142847, 0.057806458324193954, 0.056317828595638275, -0.07879679650068283, -0.09110265225172043, 0.04470028355717659, -0.03676242753863335, -0.061722531914711, -0.12965127825737, -0.10373605787754059, 0.03287452831864357, -0.05899088457226753, 0.037745486944913864, 0.019685059785842896, 0.0340658500790596, 0.029414288699626923, -0.06284240633249283, 0.06868252903223038, 0.07060578465461731, -3.942700990180064e-33, -0.07740373909473419, -0.08879810571670532, -0.07065416127443314, 0.08058705180883408, -0.02904910035431385, -0.06535100936889648, 0.11137785017490387, -0.04893995076417923, 0.10481086373329163, -0.0036310821305960417, 0.04761453717947006, -0.05622542276978493, 0.006600243970751762, -0.025259308516979218, 0.025127852335572243, -0.019367627799510956, 0.03160003572702408, 0.09674852341413498, 0.029539819806814194, 0.07759133726358414, 0.04644431918859482, 0.056210797280073166, -0.044307466596364975, -0.0019504801603034139, 0.07973130792379379, 0.0024759452790021896, 0.003126075491309166, 0.032151587307453156, 0.1116354689002037, 0.016901342198252678, -0.03580226004123688, -0.0868629515171051, -0.10571495443582535, -0.022344369441270828, -0.01211958471685648, -0.07362048327922821, -0.05210790038108826, 0.05101938918232918, 0.03158321976661682, 0.014551497995853424, -0.012648727744817734, -0.022456374019384384, -0.11676616221666336, 0.018881570547819138, 0.05883698910474777, -0.011085519567131996, -0.04235680401325226, -0.03265931457281113, 0.040452223271131516, -0.09057368338108063, -0.002382508246228099, 0.029675530269742012, -0.0653536468744278, 0.04564040154218674, 0.046848952770233154, -0.07940562814474106, 0.10682501643896103, -0.041428565979003906, -0.07138920575380325, 0.06437095999717712, -0.04721502959728241, -0.009946530684828758, -0.005571221001446247, 0.06128730997443199, -0.13181914389133453, -0.0556962676346302, -0.012200046330690384, -0.04333416372537613, 0.04701773449778557, 0.014927512034773827, 0.10254419595003128, -0.02571711130440235, -0.0028715559747070074, -0.006686277687549591, -0.08767619729042053, -0.036349326372146606, 0.07301107048988342, 0.0033742638770490885, -0.0387483574450016, 0.004565588664263487, 0.039059605449438095, -0.02310970053076744, 0.008074544370174408, 0.0021248445846140385, -0.06915301829576492, 0.026233144104480743, 0.006963786669075489, 0.01869307830929756, -0.03227346017956734, 0.006125824525952339, -0.0036118323914706707, 0.007457891013473272, -0.08043523877859116, -0.006343506742268801, -0.07928670942783356, -4.289984900651689e-08, -0.023638496175408363, -0.008406071923673153, -0.029782366007566452, 0.06990715116262436, -0.04189952835440636, -0.06919857114553452, -0.0310612004250288, -0.0519571416079998, -0.03179989010095596, -0.024725720286369324, -0.046235065907239914, 0.053067587316036224, 0.052055347710847855, -0.025873808190226555, 0.0774446502327919, 0.015844937413930893, 0.008340533822774887, 0.019023988395929337, 0.0426233746111393, 0.08436128497123718, -0.01570087857544422, -0.03615356236696243, -0.06839144229888916, -0.07885554432868958, 0.01704602688550949, -0.015799619257450104, -0.03380085900425911, -0.035397615283727646, -0.024566084146499634, -0.03377363085746765, 0.005168828181922436, 0.059401411563158035, -0.028749600052833557, -0.00825908500701189, 0.07093127071857452, 0.06032980978488922, -0.020599231123924255, 0.0521136075258255, -0.03425054997205734, 0.06672215461730957, 0.033677082508802414, -0.04953400045633316, -0.02259759232401848, -0.010269198566675186, 0.11037494987249374, 0.09310086071491241, 0.03775673732161522, -0.03181339427828789, -0.041451096534729004, 0.03233752399682999, 0.04424392431974411, 0.06571312248706818, 0.02311006188392639, -0.12065480649471283, 0.013744116760790348, -0.0033632824197411537, 0.013035525567829609, 0.05677345022559166, 0.07555404305458069, 0.015275691635906696, 0.07128211855888367, -0.02322280779480934, 0.049679167568683624, -0.0515071339905262 ] }, { "text": "The key idea behind equalization is to make sure that a particular pair of words are equidistant from the 49-dimensional $g_\\perp$. The equalization step also ensures that the two equalized steps are now the same distance from $e_{receptionist}^{debiased}$, or from any other work that has been neutralized. Visually, this is how equalization works:\n\nThe derivation of the linear algebra to do this is a bit more complex. (See Bolukbasi et al., 2016 in the References for details.) Here are the key equations:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_26", "embedding": [ -0.0389724038541317, 0.005673000123351812, 0.044029101729393005, -0.050389815121889114, -0.08351542800664902, -0.004221206996589899, 0.021532980725169182, -0.07364588230848312, 0.03556107357144356, 0.03697352856397629, 0.05626988038420677, 0.026607047766447067, 0.051903512328863144, -0.07819170504808426, -0.0813329666852951, 0.013487237505614758, 0.0037037956062704325, 0.042180027812719345, -0.099007248878479, -0.05856065824627876, -0.024190623313188553, -0.01422566082328558, -0.04880145937204361, 0.053885139524936676, 0.027091849595308304, 0.04093228280544281, -0.0014243066543713212, -0.0004885399248450994, 0.01415352150797844, 0.007638523355126381, 0.06700123846530914, -0.006462785415351391, 0.1001635417342186, 0.028808461502194405, -0.1449822038412094, -0.0028143853414803743, 0.011370053514838219, -0.002513300394639373, -0.004591632634401321, 0.055496830493211746, -0.011235675774514675, -0.001648414763621986, -0.08142348378896713, 0.050810277462005615, 0.010575435124337673, -0.04153204709291458, 0.030126767233014107, 0.009440572932362556, -0.016927435994148254, -0.127785786986351, -0.022353623062372208, 0.01267067901790142, -0.07697001844644547, 0.02507111243903637, -0.05603289604187012, -0.03739476948976517, -0.03015238605439663, 0.04594040662050247, -0.03806499019265175, -0.033414989709854126, -0.10072825849056244, -0.0881192684173584, -0.006515659857541323, 0.032152190804481506, 0.005725037772208452, -0.05951898917555809, 0.0762607678771019, 0.02366674691438675, -0.0731625035405159, 0.01459414791315794, 0.02212376892566681, 0.03271327167749405, -0.011747446842491627, 0.007722296752035618, -0.01413737703114748, 0.06054811179637909, 0.02693330869078636, -0.0015583900967612863, 0.0993434488773346, 0.08225998282432556, -0.0512578971683979, -0.073769710958004, 0.07775527238845825, -0.0005199693259783089, 0.06069585308432579, -0.035779114812612534, -0.023837735876441002, -0.04420262202620506, -0.014352765865623951, -0.0671299397945404, 0.028037935495376587, -0.030164256691932678, -0.0401756651699543, -0.008748825639486313, -0.028949681669473648, -0.04581319913268089, -0.06393512338399887, 0.030014188960194588, 0.04633380100131035, 0.04476866498589516, 0.035280611366033554, 0.06274989992380142, 0.0054389601573348045, 0.003350947517901659, -0.041376933455467224, -0.021482892334461212, 0.0433628112077713, 0.010959859937429428, -0.027515575289726257, -0.123626209795475, -0.02111273631453514, -0.05958227068185806, -0.02083396725356579, 0.09287793189287186, -0.05030184984207153, -0.034554727375507355, 0.07143121212720871, 0.04483848065137863, 0.09340526908636093, -0.0740928053855896, -0.012279796414077282, -0.03518791124224663, 0.023894667625427246, 0.053585950285196304, 0.0013203008566051722, -0.012185516767203808, -0.009153690189123154, 3.327180924020821e-33, -0.06476565450429916, 0.07104579359292984, 0.0026183482259511948, 0.013064293190836906, -0.03230883181095123, 0.019150981679558754, -0.11000305414199829, 0.036085136234760284, 0.037318695336580276, 0.04681286960840225, -0.04131363704800606, 0.09394510835409164, 0.03539365157485008, 0.025657564401626587, -0.07758001238107681, -0.025877539068460464, 0.023899367079138756, 0.05733606964349747, -0.035892851650714874, -0.06523694843053818, 0.07632683962583542, 0.015078891068696976, -0.05934497341513634, -0.022487273439764977, -0.034887880086898804, -0.004652760922908783, 0.013740096241235733, 0.007926521822810173, 0.045868732035160065, -0.033751409500837326, -0.01431622076779604, 0.021685481071472168, 0.010561656206846237, 0.07430177927017212, 0.02172844111919403, -0.04565391689538956, 0.015065905638039112, -0.027139192447066307, 0.024590879678726196, -0.07552696764469147, -0.05865943431854248, 0.038481131196022034, 0.09870072454214096, -0.16261345148086548, 0.03752904757857323, 0.07213637977838516, -0.0019553350284695625, 0.009243936277925968, 0.06571763008832932, -0.006737177260220051, 0.035534899681806564, 0.011038010939955711, -0.04855336621403694, 0.10619282722473145, -0.01301971822977066, 0.0071272412315011024, 0.06968328356742859, 0.006106589920818806, 0.048419512808322906, 0.058105334639549255, -0.02231210097670555, 0.013058967888355255, 0.029093390330672264, -0.04041371867060661, 0.08189361542463303, 0.03555414453148842, -0.04175974428653717, -0.02279661037027836, 0.09306414425373077, 0.0666893795132637, 0.0193590447306633, 0.00881874281913042, 0.01504572294652462, 0.0767260268330574, -0.03606061637401581, -0.02975297160446644, 0.010757604613900185, 0.029888004064559937, 0.05324649065732956, -0.02458193711936474, -0.1248711571097374, -0.020460261031985283, -0.0637202113866806, -0.047379523515701294, -0.1047612652182579, -0.06086655706167221, -0.008678274229168892, -0.09059976041316986, 0.0014393753372132778, 0.06831858307123184, 0.03299327194690704, 0.01658826693892479, -0.028883684426546097, 0.08074139803647995, 0.03260264918208122, -5.83128658106763e-33, -0.056461818516254425, -0.07126038521528244, -0.08629267662763596, 0.06708016991615295, -0.05577928572893143, -0.01844492368400097, 0.08178704977035522, -0.0520051009953022, 0.04178793355822563, -0.01363860722631216, -0.0028580990619957447, -0.005159801337867975, 0.04193444177508354, 0.05252716317772865, 0.03265295922756195, 0.03546552732586861, 0.11849069595336914, 0.05501308664679527, 0.024592312052845955, 0.027639364823698997, 0.04538442939519882, 0.06143905594944954, -0.011449320241808891, 0.010592442005872726, 0.11541023850440979, -0.015101300552487373, 0.03672751039266586, -0.024931633844971657, 0.0847306028008461, -0.013992314226925373, -0.04838378354907036, -0.0873565673828125, -0.10087324678897858, 0.023314515128731728, -0.025698747485876083, -0.031023681163787842, -0.026155579835176468, 0.10098417103290558, 0.03816772997379303, 0.02027365192770958, -0.00218008435331285, -0.051386620849370956, -0.05247380584478378, -0.03574429824948311, 0.06910444051027298, 0.024531109258532524, -0.04011306166648865, -0.045485250651836395, -0.0001258302218047902, -0.11553765833377838, 0.04727170616388321, 0.06204741448163986, -0.02071613259613514, 0.0830797329545021, -0.025389553979039192, -0.06955121457576752, 0.06283660978078842, -0.0516931489109993, -0.015591122210025787, -0.009175524115562439, -0.043692462146282196, -0.04338424652814865, 0.017344880849123, 0.04063457250595093, -0.05218549445271492, -0.03865669295191765, 0.022343913093209267, -0.016415178775787354, 0.025001123547554016, -0.04247206076979637, 0.025565601885318756, -0.044990576803684235, -0.05908367037773132, -0.017734799534082413, -0.007593364454805851, -0.004340304993093014, 0.09822146594524384, -0.10464974492788315, -0.03675948455929756, -0.009398605674505234, -0.006881805136799812, -0.011986520141363144, 0.03479602187871933, -0.012301125563681126, -0.08606606721878052, 0.050796832889318466, 0.07660969346761703, 0.004749152343720198, -0.02727460116147995, 0.01513980794698, 0.026320476084947586, 0.03699370101094246, -0.05634113401174545, 0.02848680317401886, -0.03530396521091461, -5.267473923709076e-08, -0.09465284645557404, 0.015500838868319988, -0.028960267081856728, 0.017326930537819862, 0.02052224613726139, -0.19484877586364746, -0.0028373009990900755, -0.06744785606861115, -0.08207153528928757, 0.0016007337253540754, -0.002657934557646513, -0.00041088482248596847, 0.010088510811328888, 0.00618996936827898, 0.04240729659795761, 0.06357956677675247, -0.07501841336488724, -0.02593492902815342, 0.05127483606338501, 0.08486457169055939, -0.045029085129499435, -0.02911517769098282, -0.048042181879282, -0.039997223764657974, -0.009644578211009502, 0.027948634698987007, -0.03168927878141403, 0.013926743529736996, 0.0835094228386879, -0.013899551704525948, 0.03681807592511177, 0.02761678583920002, 0.024105364456772804, -0.0387495681643486, 0.03694147616624832, 0.0338822677731514, 0.058077774941921234, -0.009672989137470722, -0.01412445679306984, 0.012054521590471268, -0.014708224684000015, -0.022709546610713005, 0.05027284473180771, 0.008254996500909328, 0.13127121329307556, 0.03941712900996208, 0.014958756975829601, -0.007541377563029528, -0.0589090958237648, 0.006630363874137402, 0.09765900671482086, 0.041194215416908264, 0.0035816452000290155, -0.05461475998163223, -0.002344737760722637, -0.07999734580516815, 0.04742258042097092, -0.023831937462091446, 0.06182732805609703, 0.06317214667797089, 0.011846804991364479, -0.01491271797567606, -0.041342005133628845, -0.04637208580970764 ] }, { "text": "$$ \\mu = \\frac{e_{w1} + e_{w2}}{2}\\tag{4}$$$$ \\mu_{B} = \\frac {\\mu \\cdot \\text{bias_axis}}{||\\text{bias_axis}||_2^2} *\\text{bias_axis}\n\\tag{5}$$$$\\mu_{\\perp} = \\mu - \\mu_{B} \\tag{6}$$$$ e_{w1B} = \\frac {e_{w1} \\cdot \\text{bias_axis}}{||\\text{bias_axis}||_2^2} *\\text{bias_axis}\n\\tag{7}$$\n$$ e_{w2B} = \\frac {e_{w2} \\cdot \\text{bias_axis}}{||\\text{bias_axis}||_2^2} *\\text{bias_axis}\n\\tag{8}$$\n\n$$e_{w1B}^{corrected} = \\sqrt{ |{1 - ||\\mu_{\\perp} ||^2_2} |} * \\frac{e_{\\text{w1B}} - \\mu_B} {||(e_{w1} - \\mu_{\\perp}) - \\mu_B||_2} \\tag{9}$$$$e_{w2B}^{corrected} = \\sqrt{ |{1 - ||\\mu_{\\perp} ||^2_2} |} * \\frac{e_{\\text{w2B}} - \\mu_B} {||(e_{w2} - \\mu_{\\perp}) - \\mu_B||_2} \\tag{10}$$$$e_1 = e_{w1B}^{corrected} + \\mu_{\\perp} \\tag{11}$$$$e_2 = e_{w2B}^{corrected} + \\mu_{\\perp} \\tag{12}$$\n\nIn [25]:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_27", "embedding": [ -0.02457161247730255, -0.009535419754683971, -0.043805304914712906, -0.07389318197965622, 0.0630459114909172, -0.03608405962586403, -0.0028379708528518677, -0.004605375230312347, -0.008741095662117004, 0.01376551017165184, 0.059038661420345306, -0.06818884611129761, 0.03572455793619156, -0.03073144517838955, -0.03625941276550293, 0.11638519912958145, -0.10121893882751465, 0.04770326986908913, -0.10550656169652939, 0.07684347033500671, -0.023068072274327278, 0.008238367736339569, 0.019078725948929787, -0.03663678094744682, 0.09989122301340103, 0.04132939130067825, 0.03278147801756859, 0.046875253319740295, -0.0007814001874066889, -0.06709548085927963, 0.09477014094591141, -0.01905512623488903, 0.019955072551965714, -0.026772689074277878, -0.04103989899158478, -0.07146334648132324, 0.03097379393875599, 0.012729276902973652, -0.056043632328510284, 0.05259047821164131, 0.028064334765076637, 0.10277118533849716, -0.028083402663469315, -0.0028966697864234447, 0.020701032131910324, 0.01776808314025402, -0.0017623075982555747, 0.006788805592805147, 0.022852852940559387, -0.044228941202163696, -0.002758597256615758, -0.10969854891300201, -0.050172705203294754, 0.0060492027550935745, 0.014749604277312756, -0.04183362424373627, 0.01882115565240383, 0.02030113711953163, 0.03573904186487198, -0.007210216950625181, 0.04997548460960388, -0.039019547402858734, 0.017633188515901566, -0.0165009256452322, -0.004874877166002989, 0.013187489472329617, -0.006837968248873949, -0.0055829850025475025, -0.10680690407752991, 0.011422358453273773, -0.10355938225984573, -0.03327793627977371, -0.02093992941081524, -0.13040658831596375, 0.053610265254974365, 0.0074244956485927105, 0.012973388656973839, 0.029477858915925026, 0.07544662058353424, -0.06395161151885986, -0.01750202476978302, -0.06422486901283264, 0.02578583173453808, -0.05094635486602783, 0.012318882159888744, -0.028389422222971916, -0.08788404613733292, 0.0019532490987330675, 0.09040513634681702, -0.04154755175113678, 0.009200242348015308, -0.03979052975773811, -0.11117685586214066, -0.042430516332387924, 0.044058918952941895, 0.01971939392387867, -0.01241372711956501, -0.001969908829778433, 0.020303884521126747, 0.03464282676577568, 0.009052490815520287, -0.04637627676129341, -0.03190980106592178, 0.024214863777160645, -0.00401480495929718, 0.025746921077370644, 0.09620688110589981, 0.12555363774299622, 0.022357124835252762, -0.06541337072849274, 0.01948711834847927, 0.06884945183992386, -0.06351014226675034, 0.035895779728889465, 0.04449598491191864, -0.03030547685921192, 0.13212133944034576, 0.04375229775905609, 0.019805066287517548, -0.00665511516854167, 0.004190449602901936, 0.01108834519982338, -0.0026382864452898502, -0.028443338349461555, -0.10194390267133713, 0.00858998205512762, -0.006108851172029972, 3.81466210472667e-33, -0.06562952697277069, 0.013010798022150993, -0.0287824347615242, -0.017078610137104988, -0.033491719514131546, 0.027833037078380585, -0.036443762481212616, 0.0037434971891343594, 0.0469701923429966, 0.0032821367494761944, -0.06098933145403862, 0.02210959605872631, -0.009400172159075737, -0.034308671951293945, -0.028426142409443855, -0.07762161642313004, 0.031314633786678314, 0.03706527501344681, 0.0505320206284523, 0.003072500228881836, 0.02168124169111252, 0.0274853203445673, -0.017554529011249542, -0.004738444462418556, -0.12971878051757812, 0.002083074999973178, 0.04548744112253189, 0.029978860169649124, -0.029484713450074196, -0.011002650484442711, 0.03109985589981079, -0.08817793428897858, -0.0490274652838707, -0.07423135638237, -0.08799727261066437, -0.04874458163976669, 0.01350112073123455, 0.08280594646930695, 0.0747787356376648, -0.01585894450545311, 0.04133791849017143, 0.04785280302166939, 0.08892913907766342, -0.0007182592526078224, -0.01328334491699934, -0.012584567070007324, 0.05440518260002136, 0.04727861285209656, 0.10023187845945358, 0.014031853526830673, -0.048418719321489334, 0.015075710602104664, 0.01525789499282837, 0.04967246204614639, 0.08109084516763687, 0.041625428944826126, 0.06217913702130318, 0.050039537250995636, 0.010992076247930527, -0.052995555102825165, -0.01873159222304821, 0.06118441000580788, 0.010995765216648579, -0.07993177324533463, 0.0683334693312645, -0.0016286087920889258, -0.044828999787569046, 0.03229415789246559, -0.00518861785531044, 0.04998734965920448, 0.0028382614254951477, -0.009034916758537292, 0.04452795162796974, 0.05513102561235428, -0.0024956753477454185, 0.012976642698049545, -0.009400022216141224, -0.0014452040195465088, 0.008662628941237926, 0.008466390892863274, -0.08315149694681168, 0.0979626402258873, -0.08655579388141632, -0.07572538405656815, -0.13477839529514313, 0.03311210498213768, -0.03050495684146881, -0.0606609545648098, -0.03865055739879608, 0.03118865378201008, -0.03215884044766426, 0.04745570942759514, -0.06545035541057587, 0.012929010204970837, -0.038722094148397446, -1.9119007866521565e-33, 0.000794550811406225, 0.11031712591648102, 0.10043691843748093, -0.04239511117339134, -0.026326043531298637, -0.02021939307451248, 0.1023915559053421, -0.04346039146184921, 0.018907569348812103, 0.04574375972151756, -0.008206870406866074, -0.10156905651092529, -0.0393548347055912, 0.023282703012228012, 0.08063064515590668, 0.05795246362686157, -0.0008706995286047459, 0.05027884244918823, 0.003309091320261359, -0.05648484081029892, 0.09467489272356033, 0.06084367632865906, -0.006965776439756155, 0.042998939752578735, -0.05981289967894554, 0.05133173242211342, 0.0508875772356987, -0.0061623514629900455, -0.020257262513041496, 0.004780544899404049, -0.10751578211784363, -0.0030607639346271753, -0.012405133806169033, 0.07031024247407913, -0.05357883498072624, -0.04409442096948624, -0.09462839365005493, 0.03464110940694809, -0.03898829594254494, -0.097121961414814, 0.0030596465803682804, 0.06090886890888214, -0.0476582869887352, -0.015507292002439499, 0.0030161424074321985, 0.03643300384283066, 0.039959583431482315, -0.008815220557153225, -0.01363391987979412, -0.019466886296868324, -0.0534416064620018, 0.06157171353697777, -0.025933420285582542, 0.024768292903900146, -0.04879168048501015, -0.012473990209400654, -0.014531529508531094, -0.07036346197128296, 0.04866449162364006, -0.011831158772110939, -0.06880492717027664, -0.037467170506715775, -0.022871319204568863, -0.0029962246771901846, 0.024181336164474487, 0.09527190774679184, 0.054308198392391205, -0.021256137639284134, 0.02605409175157547, 0.041282881051301956, 0.030820902436971664, 0.04811763018369675, 0.054470889270305634, -0.06476087868213654, 0.03955123573541641, 0.03980143368244171, 0.014027439057826996, -0.041814807802438736, -0.023927662521600723, -0.020149480551481247, -0.03180103376507759, 0.012405293062329292, 0.03644087538123131, 0.015750519931316376, -0.028085533529520035, -0.008906271308660507, 0.003721383400261402, 0.012100070714950562, 0.024123290553689003, 0.029052680358290672, 0.03274845704436302, 0.058725640177726746, 0.10926686227321625, -0.0031439787708222866, 0.0760100930929184, -3.928503744532463e-08, -0.066803939640522, -0.06432029604911804, 0.0064844111911952496, 0.012627325020730495, -0.04014300927519798, -0.01906328834593296, -0.10812656581401825, -0.07320918887853622, -0.04777867719531059, -0.07198820263147354, -0.008870932273566723, -0.02457897551357746, -0.04916441813111305, 0.041798949241638184, -0.07005513459444046, 0.04934274032711983, -0.030071785673499107, -0.03697254881262779, 0.07513383030891418, -0.02213423140347004, 0.05184214562177658, -0.006420846097171307, 0.08400514721870422, 0.036801788955926895, -0.02458631619811058, 0.06257905811071396, -0.07578200846910477, 0.03560861945152283, 0.07675011456012726, 0.03663243353366852, 0.02456299401819706, -0.02407524548470974, 0.03905324637889862, 0.011161361820995808, 0.05248410999774933, -0.05769195035099983, -0.03498844429850578, 0.0016888290410861373, -0.025603223592042923, 0.15325692296028137, -0.04147346690297127, 0.033278122544288635, 0.07513142377138138, -0.005757787264883518, 0.10593272000551224, 0.09168589115142822, -0.035030972212553024, 0.06300035864114761, 0.02000083588063717, -0.11203703284263611, 0.08803843706846237, -0.052990954369306564, 0.015266184695065022, 0.06572656333446503, -0.06500288099050522, -0.04984782636165619, 0.0071317036636173725, 0.00163944938685745, 0.02147398702800274, 0.021993743255734444, 0.006437411066144705, 0.03398018330335617, -0.11010120809078217, -0.058176249265670776 ] }, { "text": "In [25]:\n\ndef equalize(pair, bias_axis, word_to_vec_map):\n\"\"\"\nDebias gender specific words by following the equalize method described in the figure above.\n\nArguments:\npair -- pair of strings of gender specific words to debias, e.g. (\"actress\", \"actor\")\nbias_axis -- numpy-array of shape (50,), vector corresponding to the bias axis, e.g. gender\nword_to_vec_map -- dictionary mapping words to their corresponding vectors\n\nReturns\ne_1 -- word vector corresponding to the first word\ne_2 -- word vector corresponding to the second word\n\"\"\"\n\nw1, w2 = pair[0], pair[1]\ne_w1, e_w2 = word_to_vec_map[w1], word_to_vec_map[w2]\n\n# Step 2: Compute the mean of e_w1 and e_w2\nmu = (e_w1 + e_w2)/2\n\n# Step 3: Compute the projections of mu over the bias axis and the orthogonal axis", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_28", "embedding": [ 0.015858715400099754, -0.010656480677425861, -0.026271063834428787, -0.07698719948530197, -0.041762929409742355, -0.027008140459656715, 0.027976935729384422, -0.05582120642066002, -0.10404708981513977, 0.03294026851654053, 0.03240344300866127, -0.0399407334625721, 0.09098446369171143, 0.0011031978065147996, -0.024388233199715614, 0.047417305409908295, -0.036978449672460556, 0.0694870799779892, -0.08041433990001678, -0.04781680926680565, 0.01567738689482212, 0.024187689647078514, 0.024875124916434288, -0.0038870328571647406, 0.03625940904021263, 0.012471400201320648, 0.0114796357229352, 0.0678165853023529, -0.10449154675006866, 0.005486865993589163, 0.07873819768428802, -0.0029244462493807077, 0.08904081583023071, 0.021318674087524414, -0.11675525456666946, -0.02224600873887539, -0.06816452741622925, -0.040057793259620667, 0.04428057745099068, 0.03846985846757889, -0.013629484921693802, -0.001196191762574017, -0.04097085818648338, -0.019239431247115135, 0.02154763787984848, 0.06508701294660568, -0.004150706809014082, 0.008275392465293407, -0.035084065049886703, -0.05155904218554497, 0.015381768345832825, -0.009487812407314777, -0.09353023022413254, 0.05877852067351341, -0.05930512771010399, -0.033855944871902466, -0.0054087210446596146, -0.02319294959306717, -0.01111609023064375, -0.0336737260222435, -0.052398908883333206, -0.07360770553350449, 0.03110043704509735, 0.047202855348587036, -0.05285213515162468, -0.05763723701238632, 0.0449262373149395, 0.08375293761491776, -0.04745407775044441, 0.06529639661312103, 0.020304037258028984, 0.03935686871409416, 0.01961459405720234, -0.04140077531337738, 0.014363709837198257, 0.020327722653746605, 0.08921369910240173, -0.05620509758591652, 0.11025988310575485, -0.02169867604970932, -0.08831874281167984, -0.08470357954502106, 0.09029510617256165, 0.03699667379260063, 0.003449864685535431, -0.013486308977007866, -0.03640680015087128, -0.04680955782532692, 0.0046137007884681225, 0.009972726926207542, -0.06663293391466141, -0.05224030092358589, 0.03906955197453499, -0.028213167563080788, 0.07585247606039047, -0.006611078046262264, -0.0221236664801836, 0.0019007500959560275, 0.025235751643776894, 0.08419463038444519, 0.017859989777207375, -0.02446945570409298, -0.01500729937106371, -0.047251179814338684, -0.0026143589057028294, 0.01108297985047102, 0.08038388192653656, -0.02642473764717579, -0.028682971373200417, -0.11791379749774933, -0.044070299714803696, -0.11035825312137604, -0.035509541630744934, 0.11591275036334991, 0.00492758397012949, -0.007177033927291632, 0.09483034163713455, 0.10442709177732468, 0.05490560829639435, -0.06742680072784424, -6.207483966136351e-05, 0.008046366274356842, 0.07413799315690994, 0.005999927408993244, -0.048907287418842316, -0.006601263303309679, -0.02575512044131756, 2.092054479465288e-33, -0.0732095018029213, -0.002054475015029311, 0.003817155957221985, 0.023308588191866875, 0.014024168252944946, 0.08853849768638611, -0.0190750602632761, -0.019884295761585236, -0.04045534133911133, -0.025020742788910866, -0.07808234542608261, 0.08516660332679749, -0.02646910399198532, -0.002497898181900382, -0.05712622404098511, -0.027379121631383896, 0.07064979523420334, 0.056062959134578705, -0.05530747026205063, -0.03199365735054016, 0.0673808827996254, 0.07669235020875931, -0.020874638110399246, -0.029698466882109642, -0.06185569986701012, -0.07676331698894501, -0.014414854347705841, -0.0033820681273937225, 0.01778854802250862, -0.02407507412135601, -0.03425482288002968, -0.05270356684923172, 0.019062092527747154, -0.0046529569663107395, 0.016492798924446106, -0.07119910418987274, 0.0716741532087326, 0.06936619430780411, -0.01983315870165825, -0.012438898906111717, 0.005159102845937014, -0.015917493030428886, 0.07368510961532593, -0.11825460940599442, -0.03377174586057663, 0.03857086971402168, -0.007288038730621338, 0.09002950042486191, 0.0689101293683052, 0.08147333562374115, -0.019615182653069496, -0.018739622086286545, 0.005346985533833504, 0.06505075097084045, -0.016952920705080032, 0.05943221598863602, 0.05168255791068077, 0.011140209622681141, 0.04022718593478203, -0.04260050505399704, 0.012529129162430763, -0.008546244353055954, 0.06659255921840668, -0.020390940830111504, 0.04989812895655632, 0.014447764493525028, -0.007614655885845423, -0.01096448116004467, 0.02378135919570923, 0.07404182106256485, 0.005115024279803038, 0.0013510946882888675, -0.04121583700180054, 0.06677762418985367, -0.04968540370464325, 0.07011526823043823, 0.022397838532924652, -0.0013393160188570619, -0.010874961502850056, -0.026308411732316017, -0.06320653110742569, 0.017908113077282906, -0.1021362766623497, -0.135092630982399, -0.1438041627407074, -0.03745859116315842, -0.019344476982951164, -0.1326342225074768, 0.05938985198736191, 0.05499354749917984, -0.07510043680667877, 0.027172107249498367, -0.037420496344566345, 0.008849679492413998, -0.004030514974147081, -4.429023574266384e-33, -0.06687546521425247, -0.0030807044822722673, 0.04723162204027176, 0.07697238773107529, 0.02858378365635872, -0.01930730603635311, 0.1252840757369995, -0.035414330661296844, 0.07796599715948105, 0.032612357288599014, -0.036111146211624146, -0.08375687897205353, 0.05807734280824661, -0.021466294303536415, 0.09325924515724182, -0.004424876067787409, 0.032799314707517624, 0.0755155086517334, 0.042526084929704666, 0.03702811524271965, 0.051416706293821335, 0.0829467847943306, -0.0064722890965640545, 0.0040158238261938095, -0.022808728739619255, 0.043587349355220795, 0.07285679876804352, -0.02654811181128025, 0.02537117712199688, -0.002973616123199463, -0.04114802926778793, -0.09165743738412857, -0.08191529661417007, 0.060859475284814835, -0.019460422918200493, -0.008153011091053486, -0.037249382585287094, 0.004266598727554083, -0.058508310467004776, -0.05302722007036209, 0.011922710575163364, 0.03685727342963219, -0.11824586987495422, -0.031260907649993896, 0.006613311357796192, 0.038948655128479004, -0.013377883471548557, -0.015513096936047077, 0.022667163982987404, -0.05122073367238045, -0.06079966574907303, 0.06248290091753006, -0.053328562527894974, 0.038280051201581955, -0.01025975402444601, -0.08397752046585083, 0.0023378815967589617, -0.04750765487551689, -0.018727414309978485, -0.010673878714442253, -0.0524587519466877, -0.07407429069280624, -0.06133675575256348, 0.02368301898241043, -0.05184043571352959, -0.02547161653637886, 0.019448675215244293, -0.051345497369766235, 0.020698411390185356, 0.054985783994197845, 0.11160042881965637, 0.01139093842357397, 0.0001997130166273564, -0.029495950788259506, -0.016579607501626015, -0.0006993536953814328, -0.023580381646752357, -0.055332861840724945, -0.04255712777376175, -0.013185587711632252, 0.005231810733675957, -0.04473415017127991, 0.0744294673204422, 0.005101041402667761, -0.04696861281991005, 0.03930356726050377, 0.024473421275615692, 0.06440845131874084, 0.0398133285343647, 0.06810098886489868, 0.001025702804327011, 0.007395375054329634, -0.02739574760198593, 0.04284920543432236, 0.015712425112724304, -4.646051721124422e-08, -0.04203484207391739, -0.008842581883072853, -0.039007291197776794, 0.04558166116476059, -0.07303425669670105, -0.07322821766138077, -0.03990161418914795, -0.0781363993883133, -0.04259394109249115, -0.04336419329047203, 0.00594752561300993, 0.0061934832483530045, 0.021532347425818443, 0.0028066940139979124, 0.0168022271245718, 0.04832189530134201, -0.03070070594549179, 0.054498378187417984, 0.08090893179178238, -0.01714186929166317, 0.03302949294447899, -0.05802521854639053, -0.017275245860219002, 0.02856680005788803, -0.060484569519758224, 0.04529525339603424, -0.05918482691049576, -0.0018356912769377232, 0.014207812026143074, -0.06611721217632294, 0.06311680376529694, -0.013705039396882057, 0.03398452326655388, -0.03304758667945862, 0.06225048005580902, -0.04368487000465393, -0.021951183676719666, 0.009559518657624722, -0.03307030722498894, 0.13108427822589874, -0.02890351228415966, 0.029244279488921165, 0.08342156559228897, 0.0034769668709486723, 0.11638787388801575, 0.07769253104925156, 0.04910505190491676, 0.011215114034712315, -0.009486658498644829, -0.029480688273906708, 0.06816490739583969, 0.046411801129579544, -0.005634239409118891, -0.03747892752289772, -0.04936627298593521, -0.02439473383128643, 0.009900239296257496, 0.08881323039531708, 0.030409181490540504, 0.07322657853364944, -0.003980246372520924, -0.008774601854383945, -0.05973779782652855, -0.11387069523334503 ] }, { "text": "# Step 2: Compute the mean of e_w1 and e_w2\nmu = (e_w1 + e_w2)/2\n\n# Step 3: Compute the projections of mu over the bias axis and the orthogonal axis\n\nmu_B = np.dot(mu, bias_axis) / np.dot(bias_axis, bias_axis) * bias_axis\nmu_orth = mu - mu_B\n\n# Step 4: Use equations (7) and (8) to compute e_w1B and e_w2B\ne_w1B = np.dot(e_w1, bias_axis) / np.dot(bias_axis, bias_axis) * bias_axis\ne_w2B = np.dot(e_w2, bias_axis) / np.dot(bias_axis, bias_axis) * bias_axis\n\n# Step 5: Adjust the Bias part of e_w1B and e_w2B using the formulas (9) and (10) given above\ncorrected_e_w1B = np.sqrt(abs(1- np.dot(mu_orth, mu_orth))) * (e_w1B - mu_B) / abs((e_w1 - mu_orth) - mu_B)\ncorrected_e_w2B = np.sqrt(abs(1- np.dot(mu_orth, mu_orth))) * (e_w2B - mu_B) / abs((e_w2 - mu_orth) - mu_B)", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_29", "embedding": [ -0.0381932370364666, -0.0263686366379261, -0.025073666125535965, -0.05163588374853134, 0.036012351512908936, -0.05384502559900284, -0.02261625975370407, 0.009030638262629509, -0.05869458243250847, 0.01722012087702751, -0.028145646676421165, -0.052560992538928986, 0.025303123518824577, -0.048502106219530106, -0.044694725424051285, 0.06322132796049118, -0.04322083666920662, 0.04693460091948509, -0.02278037741780281, 0.007885294035077095, 0.011286354623734951, 0.018758725374937057, 0.024650350213050842, -0.04956269636750221, 0.12327376008033752, 0.016364306211471558, 0.040841370820999146, 0.045047443360090256, -0.04424601048231125, -0.04499848932027817, 0.0650332048535347, -0.03929237276315689, 0.02331419475376606, -0.024622565135359764, -0.05396200343966484, -0.06589262187480927, -0.006802106276154518, 0.016319211572408676, -0.05246203765273094, 0.04306422546505928, 0.028275009244680405, 0.11964324116706848, -0.010081799700856209, -0.04147158935666084, -0.006307286210358143, 0.015597396530210972, 0.010004251264035702, 0.014322193339467049, 0.015710899606347084, -0.04184792935848236, 0.0531911626458168, -0.10453901439905167, -0.08778249472379684, -0.012300834991037846, -0.0027235536836087704, 0.0005589883658103645, 0.05303248018026352, -0.019511893391609192, 0.01911572553217411, 0.0052669658325612545, 0.04440922290086746, -0.039067286998033524, 0.014475811272859573, 0.01458565704524517, -0.0422140434384346, 0.017449866980314255, 0.01552598737180233, -0.008750173263251781, -0.10166841745376587, 0.0021070847287774086, -0.0756269171833992, -0.030473750084638596, -0.005446965806186199, -0.09010601788759232, 0.037769339978694916, -0.0182866919785738, 0.04501350596547127, 0.07004642486572266, 0.053054329007864, -0.059071533381938934, -0.02288258634507656, -0.021989377215504646, 0.01801419071853161, -0.03181346133351326, 0.011465797200798988, -0.0037948591634631157, -0.04046930745244026, 0.029154304414987564, 0.06443271785974503, -0.023404603824019432, 0.05866728723049164, -0.06706515699625015, -0.14151374995708466, -0.01014637853950262, 0.04504268616437912, 0.006303288042545319, 0.027853073552250862, 0.013155520893633366, 0.000556875835172832, 0.010590068064630032, 0.02884874865412712, -0.0532090999186039, -0.047871533781290054, 0.023773949593305588, 0.0231358390301466, 0.05154486000537872, 0.12793675065040588, 0.08404280990362167, 0.04250147566199303, -0.038236409425735474, -0.03333425149321556, 0.010143792256712914, -0.055363669991493225, 0.04467497766017914, 0.05440286546945572, 0.03135812282562256, 0.09050814062356949, 0.06493355333805084, -0.027166370302438736, 0.01892004907131195, -0.04113224893808365, 0.004326251335442066, 0.027856463566422462, 0.030811306089162827, -0.07936044782400131, -0.014368491247296333, -0.04739109426736832, 7.275188169168894e-33, -0.05247442051768303, 0.02089761011302471, -0.013638334348797798, -0.03432188928127289, -0.009096954949200153, 0.08908461034297943, -0.006483339238911867, -0.011645475402474403, -0.0068611884489655495, -0.04992905631661415, -0.0670735239982605, 0.009745565243065357, -0.01718764565885067, -0.05643494799733162, -0.05177601799368858, -0.05973298102617264, 0.024806654080748558, 0.020105736330151558, 0.04891194403171539, 0.035925645381212234, 0.027809813618659973, -0.017844442278146744, -0.01797422021627426, -0.01141003705561161, -0.1399463415145874, -0.0062056006863713264, 0.02858579345047474, 0.02372264489531517, -0.03035827912390232, -0.006194565910845995, 0.018103662878274918, -0.10030614584684372, -0.03247284144163132, -0.03598305955529213, -0.09411178529262543, -0.06695997714996338, 0.05374370515346527, 0.06011169031262398, 0.04514394327998161, -0.05458076298236847, 0.03631491959095001, 0.09850922971963882, 0.07270864397287369, -0.02362099289894104, -0.03221328556537628, -0.03984638676047325, -0.011185910552740097, 0.09571651369333267, 0.10543008893728256, 0.05275502800941467, -0.041390467435121536, -0.019778333604335785, 0.0485600046813488, 0.048828691244125366, 0.030576014891266823, 0.05079677700996399, 0.06317123025655746, 0.027691172435879707, 0.045235611498355865, -0.09203337132930756, 0.01964334212243557, 0.03740452602505684, 0.011646106839179993, -0.078924760222435, 0.041743237525224686, 0.04152757674455643, -0.03778814524412155, 0.031099412590265274, -0.016704171895980835, 0.07108769565820694, 0.03321077302098274, -0.031777460128068924, 0.002136899158358574, 0.008660812862217426, -0.013910605572164059, 0.028440266847610474, -0.024880889803171158, 0.0359809473156929, -0.01200288999825716, 0.019208183512091637, -0.06058727204799652, 0.1094982847571373, -0.09658818691968918, -0.13391287624835968, -0.14138232171535492, 0.043632976710796356, -0.024195101112127304, -0.05588528513908386, -0.03337166830897331, 0.003668287768959999, -0.028109783306717873, 0.03300010412931442, -0.06217864528298378, 0.0386219397187233, -0.06447141617536545, -4.689863199319957e-33, 0.0004981893580406904, 0.11564833670854568, 0.1077982634305954, -0.03821266442537308, -0.019711948931217194, -0.011151047423481941, 0.03929733484983444, -0.04517446085810661, 0.05924525111913681, 0.052119702100753784, -0.006665889639407396, -0.1173357293009758, -0.010335896164178848, 0.04299934580922127, 0.10836319625377655, 0.008054142817854881, 0.019831953570246696, 0.04960500821471214, 0.00804321188479662, -0.037916507571935654, 0.06305614858865738, 0.04566795378923416, -0.07162287086248398, -0.01629781536757946, -0.08224118500947952, 0.07875634729862213, 0.034728843718767166, -0.009091055020689964, -0.03749943897128105, -0.06817389279603958, -0.1217542216181755, 0.04517093300819397, -0.05043245106935501, 0.0703931599855423, -0.00722336582839489, 0.008254463784396648, -0.06061991676688194, -0.02829202450811863, -0.04380953311920166, -0.13305911421775818, 0.04108971729874611, 0.09923151880502701, -0.04902845621109009, -0.042993683367967606, 0.02337457425892353, 0.03949470818042755, 0.010872644372284412, 0.04282326251268387, -0.02469433657824993, 0.005178863648325205, -0.08081567287445068, 0.048446785658597946, -0.017015768215060234, 0.04027418792247772, -0.057538677006959915, -0.013313793577253819, -0.05738752335309982, 0.0063689155504107475, 0.025440674275159836, -0.03391395881772041, -0.0281092319637537, -0.02827393263578415, -0.0756058618426323, 0.0009426886681467295, 0.0030075206886976957, 0.09038801491260529, 0.013045032508671284, 0.0020525804720818996, 0.0451149083673954, 0.047854673117399216, -0.003365948097780347, 0.03996547311544418, 0.05879775807261467, -0.07824338972568512, 0.04265458881855011, 0.015332466922700405, -0.002350666094571352, -0.04496341943740845, -0.034194182604551315, 0.006940255407243967, -0.013279219157993793, -0.011527353897690773, 0.041727904230356216, 0.05323835834860802, 0.00824400782585144, 0.03869251906871796, 0.0021964977495372295, 0.026029763743281364, 0.026423318311572075, 0.04311681538820267, 0.01610359363257885, 0.038306184113025665, 0.0877886712551117, 0.016012810170650482, 0.07742740213871002, -3.9710798205305764e-08, -0.016149764880537987, -0.03200480714440346, 0.019759206101298332, 0.049149129539728165, -0.0629807636141777, -0.04395310580730438, -0.08085647225379944, -0.04266700521111488, -0.04288328066468239, -0.07340551912784576, 0.0027458148542791605, -0.05350159853696823, -0.04359573498368263, 0.06233705207705498, -0.05238241329789162, 0.07597064971923828, -0.010370555333793163, -0.05337316170334816, 0.07352525740861893, -0.011879270896315575, 0.0033657322637736797, -0.031117243692278862, 0.10970032215118408, 0.07217249274253845, -0.02963550202548504, 0.07511844485998154, -0.04439936578273773, -0.013240267522633076, 0.06104203313589096, 0.05021391436457634, -0.03167843073606491, -0.04117421805858612, 0.048745036125183105, 0.025788279250264168, 0.0772392526268959, -0.028590764850378036, -0.027259934693574905, 0.04179518297314644, 0.006277449429035187, 0.13210617005825043, -0.08200213313102722, 0.058787595480680466, 0.04341825470328331, -0.006643146276473999, 0.11829162389039993, 0.07726375013589859, 0.015171462669968605, 0.038083940744400024, 0.015469931066036224, -0.10706785321235657, 0.10865018516778946, -0.015785617753863335, -0.007448605261743069, 0.022608434781432152, -0.0807715356349945, -0.04256654158234596, -0.008417912758886814, 0.0038472788874059916, 0.045933112502098083, -0.000804182724095881, -0.0026401509530842304, 0.04239632189273834, -0.07765382528305054, -0.06909878551959991 ] }, { "text": "# Step 6: Debias by equalizing e1 and e2 to the sum of their corrected projections\ne1 = corrected_e_w1B + mu_orth\ne2 = corrected_e_w2B + mu_orth\n\nreturn e1, e2\n\nIn [26]:\n\nprint(\"cosine similarities before equalizing:\")\nprint(\"cosine_similarity(word_to_vec_map[\\\"man\\\"], gender) = \", cosine_similarity(word_to_vec_map[\"man\"], g))\nprint(\"cosine_similarity(word_to_vec_map[\\\"woman\\\"], gender) = \", cosine_similarity(word_to_vec_map[\"woman\"], g))\nprint()\ne1, e2 = equalize((\"man\", \"woman\"), g, word_to_vec_map)\nprint(\"cosine similarities after equalizing:\")\nprint(\"cosine_similarity(e1, gender) = \", cosine_similarity(e1, g))\nprint(\"cosine_similarity(e2, gender) = \", cosine_similarity(e2, g))", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_30", "embedding": [ -0.03902507573366165, 0.048876386135816574, -0.006763135083019733, -0.011829978786408901, -0.023034749552607536, -0.05891415476799011, 0.008836915716528893, -0.02663320116698742, -0.12059734016656876, 0.010265852324664593, 0.08707791566848755, -0.08373995125293732, 0.05320179462432861, -0.04592416062951088, -0.025712382048368454, 0.020834850147366524, -0.01225364115089178, 0.06785906851291656, -0.07027453929185867, -0.06840470433235168, 0.023465486243367195, 0.028435900807380676, 0.013461392372846603, 0.0039291479624807835, 0.006056795362383127, 0.009503975510597229, 0.0051543437875807285, 0.10114636272192001, -0.06622327864170074, 0.008009292185306549, 0.0811978429555893, 0.004544390365481377, 0.07225221395492554, 0.04943984001874924, -0.009545600973069668, -0.005921157542616129, -0.0031851776875555515, -0.07599914073944092, 0.05827789381146431, 0.04726351797580719, -0.07346211373806, -0.03348909318447113, -0.06701856106519699, 0.052239228039979935, 0.009126131422817707, 0.05154697969555855, -0.05340752750635147, 0.052263043820858, -0.03699908405542374, -0.045779671519994736, -0.03353779390454292, 0.0217114370316267, -0.0949130728840828, -0.02540072239935398, -0.02588202990591526, -0.0009471283410675824, 0.027958430349826813, -0.011388696730136871, -0.007275572512298822, -0.1059860959649086, -0.016386330127716064, -0.07626952975988388, -0.006496375426650047, 0.03748467192053795, -0.008732845075428486, -0.012239670380949974, 0.07176144421100616, 0.051831405609846115, -0.0014673878904432058, 0.056469473987817764, 0.03963673114776611, 0.07546695321798325, -0.09186232835054398, 0.01106241438537836, -0.038673702627420425, 0.06218251958489418, 0.02454962581396103, -0.051839131861925125, 0.04813109338283539, -0.04811413213610649, -0.08288650959730148, -0.0640585720539093, 0.09346025437116623, 0.07643331587314606, 0.018383478745818138, -0.05960574373602867, -0.014205924235284328, -0.06345164775848389, -0.0149225490167737, -0.005654262378811836, -0.0223481897264719, -0.12244279682636261, 0.03509727492928505, -0.02895604632794857, 0.029663095250725746, 0.043971072882413864, -0.043345361948013306, 0.033109400421381, -0.018703609704971313, 0.023767756298184395, 0.00216707237996161, 0.03645547851920128, 0.013295536860823631, -0.08527304232120514, -0.044086162000894547, -0.029002994298934937, 0.10844750702381134, 0.010871092788875103, 0.021438399329781532, -0.09571579843759537, -0.018233448266983032, -0.08615605533123016, -0.03569880500435829, 0.07767348736524582, 0.026638126000761986, 0.01649256981909275, 0.058874085545539856, 0.06436926126480103, 0.07440458983182907, -0.031123727560043335, 0.0054848287254571915, 0.0011056587100028992, 0.03055441938340664, 0.015543564222753048, -0.06116068735718727, -0.05847044289112091, -0.019035862758755684, 1.7153118461046064e-33, -0.06883812695741653, 0.014646290801465511, 0.007932325825095177, 0.03510831296443939, -0.007667348254472017, 0.05696690082550049, -0.04769369959831238, -0.03211517259478569, -0.061519790440797806, -0.054365165531635284, -0.10609958320856094, 0.14223074913024902, -0.011000481434166431, -1.3305731044965796e-05, -0.10196641832590103, -0.021019360050559044, 0.022821888327598572, 0.009274155832827091, -0.08506662398576736, -0.0022302893921732903, 0.08705858886241913, 0.07015600800514221, -0.0313362255692482, -0.019375596195459366, -0.03507545217871666, -0.0581120140850544, -0.02020464837551117, -0.02458651177585125, -0.004554529208689928, -0.016972536221146584, -0.024876946583390236, -0.043731674551963806, 0.07537369430065155, 0.013485566712915897, 0.02206902951002121, -0.06198597699403763, 0.04947355389595032, -0.003449954092502594, -0.014674779027700424, -0.024759752675890923, -0.04778572544455528, 0.022480783984065056, 0.06366587430238724, -0.07523591816425323, 0.03270810469985008, 0.009603005833923817, -0.019330814480781555, 0.027515294030308723, 0.06624723970890045, 0.03467363119125366, 0.03553096950054169, -0.0271721463650465, 0.004957143682986498, 0.0766131728887558, -0.00846192892640829, 0.01601622998714447, 0.04689091071486473, 0.019258180633187294, 0.04380977153778076, -0.0013719821581616998, 0.05125240609049797, 0.0596616268157959, 0.07896474748849869, -0.005301423836499453, 0.07470053434371948, 0.03851829841732979, -0.030416443943977356, 0.000492058927193284, 0.02324858121573925, 0.07323502749204636, -0.05117373913526535, -0.0028818396385759115, -0.011235254816710949, 0.049992635846138, -0.014437157660722733, 0.07933932542800903, -0.015083042904734612, -0.05075862258672714, -0.06648501753807068, -0.02797597087919712, -0.08400769531726837, 0.01969587802886963, -0.022047266364097595, -0.15512710809707642, -0.14903992414474487, -0.07660272717475891, -0.007078420836478472, -0.11127349734306335, 0.028297636657953262, 0.033877838402986526, 0.008619735017418861, 0.056393831968307495, 0.004824934992939234, -0.01811123453080654, 0.018412914127111435, -3.853711292377017e-33, -0.1022377461194992, -0.02457515150308609, 0.05058153718709946, 0.010269676335155964, -0.033351391553878784, 0.0013014336582273245, 0.11750718206167221, -0.0773848369717598, 0.06290914863348007, -0.02870071306824684, -0.044020090252161026, -0.09117113053798676, 0.03948076441884041, 0.002285592257976532, 0.1300698220729828, 0.017656955868005753, 0.03945404663681984, 0.10194019228219986, -0.010945229791104794, 0.08906702697277069, 0.06370887160301208, 0.05983132869005203, -0.01125395204871893, -0.004649261478334665, 0.007842257618904114, 0.05731822922825813, 0.05968303233385086, -0.06501799821853638, 0.058843597769737244, -0.027594197541475296, -0.04128869250416756, -0.012345965020358562, -0.01452728919684887, 0.08706887811422348, -0.0251096710562706, -0.045982737094163895, -0.00971909798681736, 0.0019476993475109339, -0.014111397787928581, -0.07620199024677277, 0.0019546891562640667, 0.07006308436393738, -0.08464294672012329, -0.02660209871828556, 0.052474554628133774, 0.04421236366033554, 0.003794419579207897, -0.043267663568258286, 0.015441169030964375, -0.0016143361572176218, 0.03168143332004547, 0.018548350781202316, -0.11254116892814636, 0.04421401768922806, 0.03202580660581589, -0.05041509121656418, -0.016080275177955627, -0.07215992361307144, -0.09111889451742172, 0.003983713686466217, -0.04369351640343666, -0.03784402832388878, -0.010087152943015099, 0.060263656079769135, -0.00610329257324338, -0.008599657565355301, -0.02382500283420086, -0.022649193182587624, 0.021180257201194763, 0.035827603191137314, -0.02349930629134178, -0.008021722547709942, -0.05565313249826431, -0.07452446222305298, -0.003901399439200759, 0.044499319046735764, -0.053173668682575226, -0.011217654682695866, -0.08507069945335388, -0.022524552419781685, -0.03689276799559593, -0.050901927053928375, 0.022324254736304283, 0.08115204423666, -0.023205958306789398, 0.05116918683052063, 0.0031516554299741983, 0.06712837517261505, 0.033180709928274155, 0.07707154005765915, -0.01678544655442238, 0.0031052662525326014, -0.007169845048338175, 0.07422485947608948, 0.07689519226551056, -4.1578644527362485e-08, -0.013767884112894535, -0.022628381848335266, 0.00013800174929201603, 0.06736169755458832, -0.0054204100742936134, -0.08146973699331284, -0.02329089865088463, -0.10384655743837357, -0.08830685913562775, 0.0029259203001856804, -0.012070137076079845, 0.03929708153009415, -0.002473672619089484, 0.032046858221292496, 0.023052360862493515, 0.03987707942724228, 0.009098855778574944, -0.03729965537786484, 0.07370966672897339, -0.018825842067599297, 0.04199674725532532, -0.06464100629091263, -0.039497192949056625, 0.0793495625257492, -0.07600146532058716, 0.03987886384129524, -0.032560888677835464, 0.0194536242634058, 0.026520298793911934, -0.06752794981002808, 0.0909779965877533, -0.021717071533203125, 0.000734157336410135, -0.06348942965269089, 0.003988553304225206, -0.06012033671140671, 0.011523481458425522, 0.03291921690106392, -0.0050112660974264145, 0.0912405326962471, -0.004188800696283579, 0.032356876879930496, -0.002927744062617421, 0.027881542220711708, 0.16274425387382507, 0.021506907418370247, 0.10060711950063705, 0.02791493572294712, -0.011628261767327785, 0.016673754900693893, 0.013369209133088589, 0.01014760322868824, 0.017661036923527718, -0.027069447562098503, -0.017212310805916786, -0.06258133798837662, 0.011254669167101383, 0.07071096450090408, 0.020983505994081497, 0.037478893995285034, 0.02907872572541237, 0.0012602645438164473, 0.01485502440482378, -0.07118365913629532 ] }, { "text": "cosine similarities before equalizing:\ncosine_similarity(word_to_vec_map["man"], gender) = -0.11711095765336832\ncosine_similarity(word_to_vec_map["woman"], gender) = 0.35666618846270376\n\ncosine similarities after equalizing:\ncosine_similarity(e1, gender) = -0.7165727525843935\ncosine_similarity(e2, gender) = 0.7396596474928908\n\n5 - References¶\n\n• The debiasing algorithm is from Bolukbasi et al., 2016, [Man is to Computer Programmer as Woman is to\n•\n\nHomemaker? Debiasing Word Embeddings](https://papers.nips.cc/paper/6228-man-is-to-computer-programmer-as-woman-is-to-homemaker-debiasing-word-embeddings.pdf)\n\n• The GloVe word embeddings were due to Jeffrey Pennington, Richard Socher, and Christopher D. Manning. (https://nlp.stanford.edu/projects/glove/)\n•\n\nIn [ ]:", "source": "notebook: 2023-01-01-Word_Vectors.html", "type": "html_notebook", "chunk_id": "notebook: 2023-01-01-Word_Vectors.html_31", "embedding": [ -0.048487093299627304, 0.0071116345934569836, -0.01027590874582529, -0.06023751571774483, 0.05283980816602707, -0.05356799438595772, -0.015092197805643082, -0.025404537096619606, -0.043181393295526505, -0.004059781786054373, 0.05491143837571144, -0.01844239979982376, 0.06885609775781631, -0.003958611749112606, -0.02711515873670578, -0.011609083972871304, 0.036949194967746735, 0.04371253028512001, -0.07895338535308838, -0.027741946280002594, 0.018051285296678543, 0.011706885881721973, -0.006025511305779219, -0.0545942597091198, 0.05230265483260155, 0.003574957139790058, -0.009347175247967243, 0.01808769442141056, -0.041518837213516235, 0.02934766374528408, 0.05480865016579628, 0.04440679773688316, 0.07120473682880402, 0.026083827018737793, -0.06273945420980453, 0.03427017852663994, 0.020429087802767754, -0.04971553757786751, 0.06038890779018402, 0.04784330353140831, -0.0737687200307846, 0.023983526974916458, -0.034089528024196625, 0.0553506501019001, 0.028844403102993965, 0.07922670245170593, -0.061834461987018585, 0.02224018983542919, -0.05495618283748627, -0.015833010897040367, -0.027575483545660973, 0.021307874470949173, -0.0788988471031189, -0.008283511735498905, -0.05300155654549599, -0.011152337305247784, -0.02936078980565071, -0.006472042296081781, 0.006384737323969603, 0.005680886097252369, 0.038515836000442505, -0.061773691326379776, 0.007473247591406107, 0.030781390145421028, 0.0066916379146277905, -0.06653691083192825, 0.09895700961351395, -0.019123252481222153, -6.397849574568681e-07, 0.06695357710123062, 0.05066388100385666, 0.07587528228759766, -0.09144020825624466, 0.0843527689576149, 0.005260545294731855, 0.07077988237142563, 0.021468311548233032, -0.055850766599178314, 0.0861794725060463, -0.1036691665649414, -0.045298051089048386, -0.030325062572956085, 0.09094218909740448, 0.025149591267108917, 0.02054426819086075, 0.005727148614823818, -0.019034354016184807, -0.054624397307634354, -0.0040852585807442665, 0.02149975672364235, -0.11361759901046753, -0.10988263040781021, 0.04128959774971008, -0.013463118113577366, 0.02730933204293251, -0.04735514894127846, -0.04476142302155495, 0.10661980509757996, -0.05272166430950165, 0.030194982886314392, -0.026267696171998978, 0.041542232036590576, 0.02666393853724003, -0.04741102457046509, -0.01189599372446537, -0.04351505637168884, 0.08832920342683792, 0.026156164705753326, 0.011059039272367954, -0.08214889466762543, -0.056377287954092026, -0.02997015416622162, -0.0581112802028656, 0.02691146545112133, 0.006937547121196985, -0.008673630654811859, 0.10537761449813843, 0.0533084012567997, 0.09521342068910599, 0.0280397180467844, 0.020442521199584007, 0.01921420358121395, 0.02442212589085102, 0.025971166789531708, -0.021321387961506844, -0.04708755016326904, -0.027150794863700867, 5.182035704511541e-33, -0.04301280528306961, 0.088779516518116, 0.04378034546971321, 0.040276676416397095, -0.000587966525927186, 0.020875710994005203, -0.03368949890136719, 0.014166326262056828, -0.02207317389547825, -0.00023734982823953032, -0.08976694941520691, 0.14332415163516998, -0.023240292444825172, 0.0027626946102827787, 0.009556709788739681, 0.01788373850286007, -0.03403041511774063, -0.006657829508185387, -0.08911397308111191, -0.005811851006001234, 0.07193903625011444, 0.04054641351103783, -0.05209340155124664, 0.02060801535844803, -0.05107460170984268, -0.057236988097429276, -0.0016875544097274542, -0.01706201210618019, 0.03291088715195656, 0.009086253121495247, -0.051683589816093445, -0.019738567993044853, 0.044797565788030624, -0.00430417712777853, 0.03522256389260292, -0.04260968044400215, 0.021997293457388878, -0.01187360379844904, -0.01742914319038391, -0.007975629530847073, -0.0292497631162405, 0.009948068298399448, 0.0863293781876564, -0.14694996178150177, -0.002369694411754608, -0.0026245322078466415, 0.02527514100074768, 0.0036388442385941744, 0.009231459349393845, 0.015949582681059837, -0.008703570812940598, 0.055929381400346756, 0.027552355080842972, 0.07236182689666748, -0.05292884260416031, -0.015754513442516327, 0.058356016874313354, -0.003875350346788764, 0.043119899928569794, 0.04001294821500778, 0.04477982968091965, 0.013362353667616844, 0.07863081991672516, 0.00099344237241894, 0.06291624158620834, 0.015617124736309052, -0.015985671430826187, -0.02937164343893528, 0.04511101171374321, 0.06753993034362793, -0.013156251050531864, 0.013585478998720646, -0.04121270030736923, 0.05410449951887131, -0.03208327293395996, 0.06538483500480652, -0.012685099616646767, -0.02140101231634617, -0.02222261391580105, -0.021407999098300934, -0.0985545665025711, -0.005675747524946928, 0.01174752227962017, -0.16673171520233154, -0.15262913703918457, -0.10535934567451477, -0.016542769968509674, -0.11967556178569794, 0.018958380445837975, 0.04487663134932518, 0.059056274592876434, 0.03339698910713196, 0.005671411752700806, 0.018908897414803505, -0.012895381078124046, -5.870468379174429e-33, -0.14967982470989227, -0.04707968607544899, -0.023176539689302444, 0.04917366802692413, -0.048446569591760635, 0.021540436893701553, 0.1414571851491928, -0.05644252523779869, 0.04031513258814812, -0.04913552477955818, -0.0019110511057078838, -0.08948364853858948, 0.018159370869398117, 0.008626366965472698, 0.07841117680072784, -0.001031663385219872, -0.012314178049564362, 0.05511000379920006, -0.014018604531884193, 0.06335533410310745, 0.07786377519369125, 0.07144403457641602, 0.0013641673140227795, 0.008692553266882896, 0.06812192499637604, 0.07080093771219254, 0.04098083823919296, -0.09353214502334595, 0.0694458931684494, -0.009768765419721603, -0.03320315480232239, -0.03961537405848503, -0.05362473428249359, 0.04760627821087837, -0.056705743074417114, -0.043359480798244476, -0.01086764968931675, 0.028501277789473534, 0.028111731633543968, -0.06014590710401535, 0.03379163518548012, 0.030426131561398506, -0.12382069230079651, -0.027299251407384872, 0.01572946086525917, 0.017935071140527725, -0.037693385034799576, -0.05494631081819534, 0.05243677645921707, 0.026235617697238922, 0.0066713267005980015, 0.05826227739453316, -0.1463611125946045, 0.00030771034653298557, -0.0062341694720089436, -0.10121338069438934, 0.006493382155895233, -0.0619940385222435, -0.049716051667928696, 0.07335925102233887, -0.034153666347265244, -0.0011197731364518404, -0.023280583322048187, 0.08119259774684906, 0.005168215371668339, -0.040994253009557724, -0.028883688151836395, 0.03954768553376198, 0.016496745869517326, -0.016935892403125763, 0.056567367166280746, 0.01259566843509674, -0.038211893290281296, -0.01757522113621235, -0.06198501214385033, -0.036333829164505005, 0.055598869919776917, -0.008183373138308525, -0.0662313774228096, -0.09386999160051346, -0.04317767173051834, -0.07710617780685425, 0.06592180579900742, 0.05211218073964119, -0.024425607174634933, 0.05858641862869263, -0.013524254783987999, 0.05976669490337372, -0.024242255836725235, 0.0543818324804306, -0.06250729411840439, -0.028648991137742996, -0.04497170075774193, 0.06085322052240372, 0.032855112105607986, -5.510352707460697e-08, -0.03561209514737129, 0.008913849480450153, -0.028011130169034004, 0.016932480037212372, -0.04126071184873581, -0.03114139661192894, -0.012156860902905464, -0.06300011277198792, -0.06428864598274231, -0.017783913761377335, 0.012112809345126152, 0.030068401247262955, -0.0027232894208282232, 0.04969841614365578, 0.012847761623561382, 0.012230651453137398, -1.9875880752806552e-05, 0.009413707070052624, 0.0493592843413353, -0.0010320332366973162, 0.08928316831588745, -0.03341451659798622, -0.07696613669395447, 0.02432701177895069, -0.039495669305324554, 0.029545646160840988, -0.09438925981521606, 0.0982576236128807, 0.03515461087226868, -0.051111701875925064, 0.005608443170785904, 0.01639261096715927, -0.0015093174297362566, -0.08095567673444748, 0.010599990375339985, -0.011926165781915188, 0.013020618818700314, 0.044370826333761215, -0.06566333025693893, 0.06144852936267853, 0.012093020603060722, 0.024471154436469078, 0.0026481826789677143, 0.009433077648282051, 0.18733787536621094, 0.047656454145908356, 0.11314581334590912, 2.3071563191479072e-05, -0.014092211611568928, 0.02330031432211399, 0.05025383085012436, 0.04686550050973892, 0.027312172576785088, -0.04381585866212845, 0.0034120988566428423, -0.08870488405227661, -0.029359878972172737, 0.00668508792296052, 0.05416807532310486, 0.03917190060019493, 0.026800403371453285, -0.0581459142267704, 0.007328680716454983, -0.008817916736006737 ] }, { "text": "Anomaly_Detection_with_Numpy\n\nAnomaly Detection¶\n\nThese are my notes & codes from the lecture: Unsupervised Learning, Recommenders, Reinforcement Learning given by DeepLearning.AI in Coursera. In this notebook I will explain the anomaly detection with numpy. You may find the original notebook here.\n\nData includes: X_train, X_val and y_val.\n\n• Find mean, variance from training set.\n•\n\n• Calculate the p values from training set.\n•\n\n• Seelct the threshold epsilon using validation set:\n\n• Find p_val values from validation set.\n•\n\n• Get the range of p_val and create list of potential epsilon values.\n•\n\n• Try each of the potential epsilon values to calculate the TP, FP and TN. Calculate F1 score.\n•\n\n• Find the threshold which gives the maximum F1 score.\n•\n\n•", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_0", "embedding": [ -0.07533031702041626, -0.049289681017398834, -0.009207828901708126, 0.0030698131304234266, 0.059752222150564194, -0.0260159894824028, 0.01571732759475708, 0.07385310530662537, -0.07829790562391281, -0.024219881743192673, 0.0241320189088583, -0.04279893636703491, 0.007513950113207102, 0.03024081327021122, -0.08110793679952621, -0.015343171544373035, -0.008243134245276451, -0.0820876955986023, -0.012302815914154053, -0.055412959307432175, 0.002068365691229701, 0.07310912013053894, -0.0030275655444711447, 0.01696688123047352, -0.029631080105900764, 0.0031326196622103453, 0.035601526498794556, 0.08214305341243744, -0.04499223828315735, -0.04819036275148392, 0.04749717563390732, 0.032365474849939346, 0.025804636999964714, -0.022874604910612106, 0.03304784372448921, 0.011771101504564285, -0.055295683443546295, -0.006551802624017, -0.0016457822639495134, 0.014293083921074867, 0.02965800277888775, -0.10948295891284943, 0.04280541464686394, 0.0474301353096962, 0.05168741196393967, 0.013898600824177265, -0.0627368614077568, -0.018881233409047127, 0.09213870763778687, -0.09058094769716263, 0.010787418112158775, 0.0377732589840889, -0.058044373989105225, 0.017281027510762215, -0.030950097367167473, -0.05798378959298134, 0.026235416531562805, -0.07067196816205978, -0.05026494339108467, -0.08052709698677063, 0.04339688643813133, -0.016711438074707985, 0.002973134396597743, -0.028695836663246155, 0.04041833430528641, 0.006573146674782038, -0.05137774720788002, 0.042024221271276474, 0.06709252297878265, 0.0736088827252388, 0.02805216982960701, 0.052581481635570526, -0.05200977995991707, -0.03610777482390404, 0.04717717319726944, -0.028539683669805527, 0.02262069657444954, -0.005484332796186209, 0.002528212033212185, -0.03845931589603424, -0.01695888675749302, 0.026132361963391304, 0.05381138622760773, -0.06392180174589157, 0.04040789231657982, -0.04009081423282623, -0.021854693070054054, 0.05524482578039169, 0.09517841041088104, 0.07100458443164825, 0.047790590673685074, -0.004184980411082506, -0.07254625111818314, 0.025999702513217926, 0.08127143234014511, 0.06260854005813599, -0.05833062529563904, -0.07889582216739655, 0.026484191417694092, 0.023117922246456146, 0.019501933827996254, -0.024999182671308517, -0.06589148938655853, 0.05683833733201027, -0.0045773000456392765, 0.06718919426202774, 0.10325753688812256, -0.00785325188189745, 0.05357915535569191, -0.021930808201432228, -0.005292459391057491, -0.07519707828760147, 0.029154310002923012, -0.0004192458000034094, 0.05850290507078171, 0.11133987456560135, 0.05620613321661949, 0.12234210222959518, -0.0732559859752655, 0.0395638681948185, -0.04488763585686684, -0.014812987297773361, 0.0013483900111168623, 0.04807232320308685, -0.05695461854338646, 0.036980368196964264, -0.10312116891145706, 3.8362474870856286e-33, 0.01101347804069519, 0.04999706894159317, -0.005521929822862148, -0.06479832530021667, -0.04218299314379692, 0.030688919126987457, -0.001453577191568911, 0.017581311985850334, -0.06066814810037613, 0.07861409336328506, -0.11045785993337631, 0.00468953512609005, -0.035718947649002075, -0.009891357272863388, 0.04884987324476242, -0.0402987077832222, 0.02239249274134636, 0.006740527227520943, -0.0016234020004048944, -0.023061102256178856, 0.10519823431968689, -0.021581660956144333, -0.0038851103745400906, -0.019740328192710876, -0.003709834534674883, 0.06659695506095886, -0.07348701357841492, 0.008211521431803703, -0.024592723697423935, 0.0244753435254097, -0.10305381566286087, 0.04004876688122749, -0.01742136850953102, -0.03893721103668213, 0.04911775887012482, -0.0019024162320420146, -0.003453520592302084, 0.040314897894859314, 0.05520465224981308, -0.08390707522630692, -0.013607392087578773, -0.007111404091119766, 0.030685439705848694, -0.0312618725001812, 0.0010530268773436546, -0.006890106946229935, 0.014123559929430485, 0.06720999628305435, 0.004197574220597744, 0.015374289825558662, -0.12022598087787628, -0.041210468858480453, -0.002180350013077259, -0.02264772169291973, -0.08044243603944778, -0.007564435712993145, 0.02885613963007927, 0.08197437226772308, -0.02601107768714428, -0.04969920217990875, 0.13553597033023834, -0.02273532561957836, 0.04846154525876045, -0.04385140538215637, -0.010089139454066753, 0.028960730880498886, -0.04608052223920822, 0.022567953914403915, 0.05798236280679703, 0.12904344499111176, -0.02851955033838749, 0.06946664303541183, -0.03486412391066551, -0.05500363931059837, 0.05531807988882065, -0.016956305131316185, 0.10526113212108612, -0.032474275678396225, -0.014938008971512318, -0.11908407509326935, -0.05149546638131142, 0.003984808921813965, 0.003278993768617511, -0.07457707822322845, -0.09088876098394394, -0.016922418028116226, 0.011452993378043175, 0.015042884275317192, -0.04497363418340683, 0.0050063952803611755, -0.06106013059616089, 0.006267548073083162, -0.033137302845716476, 0.021457914263010025, -0.10537980496883392, -4.6368278329467325e-33, -0.023787183687090874, 0.159638449549675, -0.06823168694972992, 0.0013081177603453398, 0.043467193841934204, -0.014573040418326855, -0.04784858971834183, 0.035814713686704636, -0.006072598043829203, -0.005293452180922031, -0.04342864453792572, -0.039251428097486496, -0.014406677335500717, -0.04655731841921806, 0.027564052492380142, -0.010454744100570679, -0.055521100759506226, 0.05344377085566521, -0.05050086975097656, -0.012828629463911057, -0.033615417778491974, 0.0620981864631176, -0.0733841061592102, -0.006267969496548176, -0.05935906991362572, 0.06421472132205963, -0.026318347081542015, 0.0010461092460900545, -0.0510895811021328, 0.037300001829862595, -0.03830699622631073, 0.06963689625263214, -0.07099132984876633, 0.07797938585281372, 0.0689292699098587, -0.00256779114715755, 0.07065409421920776, -0.07764548063278198, 0.013513188809156418, -0.0006063716136850417, 0.10701300203800201, 0.13949692249298096, -0.015079217962920666, 0.007409140933305025, -0.0018879114650189877, 0.034622400999069214, 0.07302726060152054, 0.01684969663619995, -0.033900756388902664, -0.021145693957805634, 0.0008515746449120343, -0.05986041948199272, -0.009232953190803528, 0.07406112551689148, -0.10252901911735535, 0.056776754558086395, 0.010014595463871956, 0.01976138912141323, -0.07763384282588959, 0.022337866947054863, -0.017658839002251625, -0.0316733680665493, -0.07733935117721558, 0.03820459172129631, -0.018502583727240562, -0.02262572944164276, -0.06343230605125427, 0.07258600741624832, 0.013246813789010048, 0.007075720001012087, -0.02534494549036026, 0.04015284776687622, 0.03621605038642883, -0.01873975619673729, -0.06487584859132767, -0.04328889772295952, -0.07037875056266785, -0.027430063113570213, 0.0055534727871418, -0.031137509271502495, -0.02085462026298046, 0.0009505730704404414, 0.05899487063288689, 0.06718895584344864, -0.005944644100964069, 0.08853399008512497, 0.08991529047489166, 0.057885073125362396, 0.03155336529016495, -0.046638354659080505, -0.001620582421310246, 0.052391380071640015, -0.02667301334440708, -0.027972549200057983, 0.0021338299848139286, -4.6483819460263476e-08, -0.029004065319895744, -0.05609826743602753, -0.004002239555120468, 0.035362325608730316, 0.043767765164375305, 0.018071910366415977, -0.054113972932100296, -0.0010255954694002867, -0.03582374006509781, -0.009458795189857483, 0.019519265741109848, -0.11164000630378723, -0.07242493331432343, -0.10221747308969498, -0.009894287213683128, 0.08977764844894409, 0.005340651609003544, 0.10966731607913971, -0.04670349508523941, -0.04439913108944893, 0.01860733889043331, 0.0022116557229310274, 0.008961400017142296, -0.026292096823453903, -0.03940107300877571, -0.015786556527018547, -0.0403594933450222, 0.03200908005237579, 0.09213680028915405, -0.003864593105390668, 0.0466265045106411, -0.07512719184160233, 0.11932197958230972, -0.009273535571992397, -0.022794434800744057, 0.13546651601791382, 0.049942128360271454, -0.02718682400882244, -0.011232523247599602, 0.04015982151031494, -0.10685230046510696, 0.038635868579149246, -0.02944294735789299, -0.01545439288020134, -0.022561386227607727, -0.008235824294388294, -0.041187584400177, -0.05551862716674805, 0.019410258159041405, -0.03545800596475601, 0.01716935634613037, 0.034762196242809296, -0.03344124183058739, 0.09252440929412842, 0.03790163993835449, -0.024767190217971802, -0.08361555635929108, 0.02197244204580784, -0.033478282392024994, -0.001428408781066537, 0.055624011904001236, 0.04537193477153778, -0.03942626342177391, -0.04321695491671562 ] }, { "text": "• Find the threshold which gives the maximum F1 score.\n•\n\n•\n\n• Find the anomalies in training set using the selected epsilon value.\n•\n\nLet's import the libraries.\n\nIn [1]:\n\nimport numpy as np\nimport matplotlib.pyplot as plt\nfrom utils import *\n\n%matplotlib inline\n\nWe will use the training dataset to fit the Gaussian distribution. Then we will use validation dataset and known true y values to select the treshold.\n\nDataset¶\n\nIn [2]:\n\nX_train = np.array([[3.8, 4.0], [5.6, 4.7], [6.3, 3], [2.9, 4.6], [3.2, 4.9], [8,6], [9,7], [6.5,7], [5,5], [4,3], [6,7],\n[7.4, 9.5], [4,5], [3,7], [5,6], [14, 7], [3.8,4.6], [4, 5.5], [3,7.8], [5,7], [4,5], [8.5,1], [4,1.5], [3,2], [8,1],\n[10,3], [6,6], [9,5], [3,1.2], [8.5,10], [7,4], [5,4], [3,7], [12,10.5], [7,8], [10,9.2]])", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_1", "embedding": [ 0.03646652400493622, -0.06067226454615593, 0.018795784562826157, -0.04790208116173744, 0.10458941012620926, 0.0031253453344106674, 0.04815273359417915, 0.028624916449189186, -0.058986954391002655, -0.057892683893442154, -0.01336244773119688, -0.025311525911092758, 0.012822909280657768, 0.003690085606649518, -0.05327415093779564, -0.03240280970931053, 0.01832820475101471, -0.05424094572663307, 0.028295664116740227, -0.059669144451618195, 0.009252411313354969, 0.04525863006711006, -0.006460387259721756, 0.04699566215276718, 0.025040460750460625, -0.02154773846268654, 0.06809894740581512, 0.0339571014046669, -0.06479965150356293, -0.0691673532128334, 0.009749113582074642, 0.012024150229990482, 0.047709573060274124, 0.027958229184150696, -0.0390143021941185, -0.021116718649864197, -0.01600506901741028, 0.02851361222565174, 0.08911361545324326, 0.06756596267223358, -0.02848060615360737, -0.050245750695466995, 0.05150195211172104, -0.01469900831580162, 0.025374071672558784, 0.025088654831051826, -0.06991203874349594, -0.07179776579141617, 0.06956452876329422, 0.01901107281446457, 0.006052378099411726, 0.046664122492074966, -0.024111827835440636, 0.01689799875020981, 0.017034322023391724, -0.06429926306009293, 0.030239365994930267, -0.09491907805204391, 0.009463981725275517, -0.006885225418955088, 0.017594853416085243, -0.010159730911254883, -0.011146368458867073, -0.023761115968227386, -0.004951264709234238, 0.01407364197075367, -0.04691844806075096, -0.018060479313135147, -0.015249639749526978, 0.1074787974357605, 0.06570981442928314, 0.06156442314386368, -0.023264460265636444, -0.00835139025002718, -0.022683635354042053, 0.018130579963326454, 2.1300857042660937e-05, -0.0009781613480299711, -0.020384671166539192, 0.04874882102012634, -0.01663939468562603, 0.05391792580485344, 0.06017782911658287, -0.04759247228503227, 0.011786511167883873, -0.026027055457234383, 0.035412102937698364, 0.09538722783327103, 0.06932199746370316, 0.08740749210119247, -0.009607297368347645, 0.0333981029689312, -0.05011771619319916, 0.0546036995947361, 0.0021518885623663664, 0.061538733541965485, 0.007477739825844765, -0.08005779981613159, 0.04209049791097641, 0.06839720904827118, 0.01058491412550211, -0.0537225715816021, -0.02162371203303337, 0.05352459475398064, 0.07670067250728607, 0.0208456888794899, 0.05520782247185707, -0.002907393267378211, 0.026488328352570534, -0.09596230089664459, 0.025154495611786842, -0.04668165370821953, 0.02017534151673317, 0.022852983325719833, 0.020638050511479378, 0.08033104240894318, 0.020351039245724678, 0.1329168975353241, -0.1475811004638672, 0.09927460551261902, -0.028845487162470818, 0.011571872048079967, 0.04808195307850838, 0.05953704193234444, -0.005909373983740807, 0.015672937035560608, -0.08479025214910507, 6.974134974209186e-34, -0.034675635397434235, -0.05422439053654671, -0.0030446548480540514, -0.12165216356515884, -0.028390780091285706, 0.03538685292005539, 4.501848161453381e-05, -0.0459238700568676, -0.02137554995715618, 0.05431274324655533, -0.04538809508085251, -0.027545180171728134, -0.03850695863366127, -0.010419673286378384, 0.0605531744658947, -0.013763818889856339, -0.024195076897740364, -0.008990739472210407, -0.0424102284014225, -0.02062072977423668, 0.05940511077642441, -0.11840789020061493, 0.02046012505888939, -0.0215769000351429, -0.03866506740450859, -0.041372962296009064, -0.02253960259258747, -0.005599825643002987, -0.04337533935904503, 0.005273906048387289, -0.11292960494756699, 0.051358189433813095, 0.04209126904606819, -0.03866489604115486, 0.041730500757694244, -0.09631253778934479, 0.03472437709569931, 0.015859264880418777, 0.07059860974550247, -0.017100844532251358, 0.005249157082289457, -0.023230964317917824, 0.030176324769854546, 0.0033965110778808594, 0.012286217883229256, 0.04076840728521347, 0.020270099863409996, 0.05341041460633278, 0.014733722433447838, 0.022867510095238686, -0.06614072620868683, -0.06529013067483902, -0.014091485179960728, 0.008695169351994991, -0.05110657960176468, 0.011510837823152542, -0.02068313956260681, 0.027826698496937752, -0.0152006009593606, -0.06965730339288712, 0.08558877557516098, -0.06363176554441452, 0.005251401569694281, 0.022481104359030724, -0.007692219689488411, 0.05736171826720238, -0.01830802671611309, -0.08533407002687454, -0.0027864763978868723, 0.09818287193775177, -0.017471782863140106, -0.0250051561743021, -0.03168616443872452, -0.0475027859210968, 0.01953653246164322, -0.02096291445195675, 0.07944688946008682, 0.04996778443455696, 0.014920957386493683, -0.09085046499967575, -0.0328105092048645, 0.009834839031100273, -0.059647757560014725, -0.09610061347484589, -0.0017236772691830993, -0.0022026626393198967, 0.033574845641851425, 0.03137371316552162, -0.04701685160398483, -0.056550439447164536, -0.09292563796043396, 0.024416575208306313, -0.08012658357620239, -0.007932383567094803, -0.0625620037317276, 1.0721386426842532e-33, 0.028503846377134323, 0.14188431203365326, 0.06736206263303757, 0.03239298611879349, 0.05259009078145027, 0.014091876335442066, -0.0059812963008880615, 0.04765881225466728, -0.01908407174050808, 0.050324924290180206, -0.002316628582775593, -0.024760274216532707, 0.026634085923433304, -0.0465017668902874, 0.012849190272390842, 0.007639959454536438, -0.06428301334381104, 0.0382724329829216, -0.051412276923656464, -0.04321825131773949, -0.011368469335138798, -0.002921852981671691, -0.05284711346030235, 0.03944210335612297, -0.023726826533675194, 0.037448905408382416, -0.014232535846531391, -0.0028974139131605625, -0.05797787010669708, -0.018733317032456398, -0.0711970329284668, 0.05235397070646286, -0.0786776915192604, -0.029364757239818573, 0.06476034224033356, -0.005052184220403433, 0.08917153626680374, 0.0116436667740345, -0.07878942042589188, 0.05328145995736122, 0.04849454015493393, 0.0963212102651596, -0.0768376812338829, -0.01659577153623104, -0.003485908731818199, 0.029560040682554245, 0.04515289142727852, 0.020241832360625267, 0.013154053129255772, 0.019364353269338608, -0.03834202140569687, 0.038095004856586456, -0.02732725813984871, 0.11000281572341919, -0.04635491222143173, -0.01277354545891285, -0.04812411963939667, -0.005310051143169403, -0.0805734395980835, -0.0020280906464904547, -0.0019438373856246471, -0.0072787366807460785, -0.025183985009789467, 0.06908202916383743, 0.038845933973789215, 0.004130085930228233, -0.05275542661547661, 0.10313018411397934, -0.0011807422852143645, 0.11929627507925034, -0.02657286264002323, 0.012809064239263535, 0.09926505386829376, -0.04384998232126236, -0.03897944092750549, 0.014087083749473095, 0.0014376729959622025, -0.01740439236164093, 0.018182262778282166, 0.06166340783238411, 0.049777258187532425, 0.012759710662066936, 0.07334228605031967, 0.13110114634037018, 5.784659515484236e-05, 0.12131097167730331, 0.10053225606679916, 0.015260067768394947, 0.07356790453195572, -0.06370893120765686, 0.015873335301876068, 0.04390757158398628, 0.008635485544800758, -0.05570162460207939, -0.007520738989114761, -5.7293942035130385e-08, -0.08341224491596222, -0.05458928272128105, -0.024752091616392136, 0.014666867442429066, 0.08566306531429291, 0.06090312823653221, -0.01778663694858551, 0.01633281633257866, -0.057189665734767914, -0.0648692399263382, 0.03079877234995365, -0.03635764494538307, -0.02676771953701973, -0.004480309784412384, -0.018095849081873894, 0.004934240598231554, 0.008110052905976772, 0.16059117019176483, 0.0017439445946365595, 0.0736113116145134, 0.02733663283288479, -0.016902705654501915, 0.03673794865608215, 0.021546848118305206, 0.014417453669011593, -0.05569026991724968, -0.02804529294371605, -0.003211026778444648, 0.022279584780335426, 0.12391568720340729, -0.005649125669151545, -0.10095541179180145, 0.1287069320678711, -0.036212243139743805, 0.009020581841468811, 0.10609588772058487, -0.09430640190839767, -0.0008496263180859387, -0.047613874077796936, 0.055232178419828415, -0.10266382992267609, 0.04906923696398735, -0.017802683636546135, -0.06630657613277435, -0.0034295113291591406, -0.005006827879697084, -0.009552118368446827, -0.011763984337449074, 0.07616845518350601, -0.061204299330711365, 0.03328510373830795, -0.018293846398591995, 0.01078359130769968, 0.08179640024900436, 0.03628869354724884, -0.02159665711224079, -0.12853306531906128, 0.019079407677054405, -0.08195672184228897, -0.09394481778144836, 0.02265418879687786, -0.02400871366262436, 0.021474622189998627, -0.032524656504392624 ] }, { "text": "X_val = np.array([[3, 4.0], [5, 6], [6.1, 3.2], [1, 1.5], [4.6, 8], [7,9], [12,15], [4,7], [5,3], [3.5, 7], [14,2], [3, 9.5],\n[4,5.4], [3.2,3.4], [1,6.5], [13, 3.5], [12.5,6.4], [6.7, 12], [3.5,4.5], [4,9], [4,5], [8,1], [0.5,1.5],\n[3.1,5], [2,8.7], [9.1,3.4], [4,4], [8,12], [4,1], [11,10]])\n\ny_val = np.array([0,0,0,0,0,0,1,0,0,0,1,0,\n0,0,0,1,1,1,0,0,0,0,0,\n0,0,0,0,1,0,0])\n\nIn [3]:\n\nprint(X_train.shape)\nprint(X_val.shape)\nprint(y_val.shape)\n\n(36, 2)\n(30, 2)\n(30,)\n\nIn [4]:\n\n# Create a scatter plot of the data. To change the markers to blue \"x\",\n# we used the 'marker' and 'c' parameters\nplt.scatter(X_train[:, 0], X_train[:, 1], marker='x', c='b')", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_2", "embedding": [ 0.013119330629706383, -0.025554141029715538, 0.00811412837356329, -0.0981140211224556, 0.055890921503305435, -0.05964550003409386, 0.05059858411550522, -0.09813224524259567, -0.010138447396457195, -0.010422577150166035, -0.06988013535737991, 0.05341222509741783, -0.033029939979314804, -0.0003734212659765035, -0.08229681849479675, 0.03512800484895706, -0.05590854212641716, 0.010769565589725971, 0.046809177845716476, -0.09763499349355698, -0.024294601753354073, 0.056441716849803925, -0.08301873505115509, 0.00554142938926816, 0.10987236350774765, 0.07528788596391678, 0.10302998870611191, 0.10005369782447815, -0.058587297797203064, -0.010500263422727585, -0.04851749166846275, 0.00496419332921505, 0.010319141671061516, -0.06041449308395386, -0.06703189760446548, -0.007257835008203983, 0.026487484574317932, 0.07258833944797516, -0.02417755126953125, 0.08089973777532578, -0.02545556053519249, 0.040837761014699936, 0.07942541688680649, -0.05937929451465607, 0.05297805368900299, 0.009742607362568378, -0.0007340041920542717, -0.08595430105924606, 0.04257774353027344, -0.026634493842720985, -0.001995035447180271, -0.023394109681248665, -0.022361764684319496, 0.0030868800822645426, 0.02990635111927986, -0.13458020985126495, 0.05659691244363785, -0.11320684105157852, 0.052977290004491806, 0.017463164404034615, -0.005330023355782032, 0.046467263251543045, 0.0798085629940033, 0.015473594889044762, -0.045499060302972794, -0.0015411502681672573, -0.00838196836411953, 0.015433521009981632, -0.011414540000259876, 0.035350557416677475, 0.012868508696556091, 0.01566302962601185, -0.017156055197119713, -0.01872885599732399, -0.023026417940855026, -0.05196975916624069, 0.08060962706804276, -0.06491072475910187, -0.01161398645490408, 0.07036232948303223, -0.02835027687251568, 0.06403698027133942, -0.032109376043081284, -0.011170275509357452, -0.08952534943819046, -0.08231902122497559, -0.026855405420064926, 0.03448694571852684, 0.0868077352643013, 0.03939796984195709, -0.014041631482541561, 0.04815644025802612, -0.09121447056531906, -0.021497709676623344, 0.014122440479695797, 0.01891499198973179, 0.0962134525179863, -0.02602246403694153, 0.042314738035202026, 0.06346151977777481, 0.04945655167102814, -0.08007360249757767, -0.05662913993000984, 0.009759739972651005, 0.0914716124534607, 0.06658051162958145, 0.06017673388123512, -0.0031267129816114902, -0.02609180472791195, -0.07962308824062347, -0.028531987220048904, -0.10283538699150085, -0.013978344388306141, 0.08183234184980392, 0.02501845546066761, -0.014633693732321262, 0.03306204080581665, 0.06268872320652008, -0.017831433564424515, 0.05609368532896042, 0.006346539128571749, -0.006415497977286577, 0.07603199034929276, 0.051713548600673676, -0.04738142341375351, -0.0070346323773264885, -0.05882972851395607, -3.401796529965219e-33, -0.10152797400951385, -0.01968538761138916, 0.07607146352529526, -0.0684383437037468, 0.018460026010870934, -0.01521040964871645, 0.029741669073700905, -0.09459639340639114, -0.0017779923509806395, -0.004199506714940071, -0.030159013345837593, 0.022171493619680405, -0.031135620549321175, 0.00689913472160697, 0.01690363511443138, -0.05638498067855835, 0.026089634746313095, 0.028893332928419113, -0.025306686758995056, -0.0639922246336937, -0.0222044475376606, -0.10963183641433716, 0.04879069700837135, 0.04184689745306969, -0.08144675940275192, -0.06986205279827118, -0.0727158784866333, -0.02156743034720421, -0.017563091591000557, -0.024777065962553024, -0.07338802516460419, 0.11939097940921783, 0.023229902610182762, -0.036446038633584976, 0.07651136070489883, -0.05894410237669945, 0.09657399356365204, -0.004598148167133331, 0.07644196599721909, -0.015245761722326279, 0.04875423014163971, -0.0016505445819348097, 0.049841754138469696, -0.04695563763380051, 0.04023388773202896, 0.01226089522242546, 0.031388022005558014, 0.06284124404191971, 0.017699021846055984, 0.02460952289402485, -0.08513063937425613, -0.040429651737213135, 0.030535157769918442, 0.0376506932079792, -0.04227226972579956, -0.009735023602843285, 0.044067732989788055, 0.01021547894924879, 0.006230924744158983, -0.009017274715006351, 0.015834307298064232, -0.04308114945888519, 0.03519374132156372, 0.049895428121089935, 0.025594530627131462, 0.013386721722781658, 0.06099548563361168, 0.029628850519657135, 0.047866661101579666, 0.10419578105211258, 0.002049532951787114, 0.048961762338876724, -0.012911967001855373, -0.06720402091741562, -0.023727212101221085, -0.021994665265083313, -0.0008808810380287468, 0.049374889582395554, -0.036751698702573776, -0.07397646456956863, -0.01661020517349243, 0.047810785472393036, -0.03747411444783211, -0.08363466709852219, 0.011025750078260899, -0.012311296537518501, 0.012862867675721645, 0.00970225315541029, -0.06877893954515457, -0.04748177155852318, -0.14730268716812134, 0.03576914221048355, -0.044437527656555176, -0.019145973026752472, -0.04214411601424217, 1.8121141732368064e-33, -0.019300807267427444, 0.03649913892149925, 0.10170160979032516, 0.019122706726193428, -0.020086416974663734, -0.021820444613695145, 0.015471082180738449, -0.013249345123767853, 0.03870677947998047, 0.027132967486977577, 0.00017994451627600938, -0.05317152291536331, 0.02055390365421772, 0.0019064957741647959, 0.08591107279062271, 0.008281564339995384, -0.02232957072556019, 0.03979826718568802, -0.044352415949106216, -0.12758983671665192, -0.02654685452580452, 0.03714683651924133, 0.00532127870246768, -0.02386336959898472, -0.07419763505458832, -0.04446747153997421, 0.010351327247917652, -0.010337894782423973, -0.08052612096071243, -0.04485378414392471, 0.019120709970593452, 0.009409680031239986, -0.019191687926650047, 0.04677682742476463, 0.05160170793533325, 0.0725780576467514, 0.054078612476587296, -0.007754144258797169, -0.04595367982983589, -0.04046282917261124, 0.04526900872588158, 0.03666706755757332, -0.04970880225300789, -0.04385184124112129, -0.01847648061811924, 0.043186645954847336, 0.03783860430121422, 0.05669746175408363, -0.008438754826784134, 0.03158976882696152, -0.044199854135513306, 0.04219427704811096, -0.0446021631360054, 0.0695343166589737, -0.07283753156661987, 0.06002984568476677, -0.13820238411426544, 0.037036921828985214, 0.03554559499025345, -0.07336291670799255, -0.006503983400762081, -0.0781077966094017, -0.03790675476193428, 0.05247145891189575, 0.06886053085327148, 0.038112420588731766, -0.007687620352953672, 0.0200576800853014, 0.005966696888208389, 0.0968591719865799, 0.028964774683117867, -0.027620535343885422, 0.0709749385714531, -0.07599751651287079, -0.059458523988723755, -0.05521061643958092, 0.029697518795728683, -0.03118811920285225, -0.04507884755730629, 0.01584707945585251, -0.025973765179514885, -0.06718626618385315, 0.0518675334751606, 0.04582759365439415, -0.05330006033182144, 0.010104695335030556, 0.12438543885946274, 0.046775586903095245, 0.015546848997473717, -0.07184227555990219, 0.010721173137426376, 0.04314914345741272, -0.04091924801468849, -0.04079354926943779, -0.044188909232616425, -4.0336303186450095e-08, -0.02760200947523117, -0.07902581244707108, -0.03090996854007244, 0.038414716720581055, 0.04479098692536354, -0.00801311619579792, 0.05324099212884903, 0.022267211228609085, 0.0006780640105716884, -0.03364302217960358, 0.029433652758598328, -0.1389130800962448, 0.025200407952070236, 0.021490108221769333, -0.04386792331933975, 0.01808529905974865, -0.01959271915256977, 0.0701586976647377, 0.021023863926529884, -0.010640581138432026, 0.023371661081910133, 0.012017727829515934, -0.006039369385689497, -0.004241518676280975, -0.022127630189061165, 0.0006611536373384297, -0.04746152460575104, -0.0170297734439373, 0.10104583948850632, 0.050132326781749725, -0.02483549155294895, -0.035634756088256836, 0.09086577594280243, -0.036868203431367874, 0.04124533012509346, 0.07811755686998367, -0.07565601915121078, 0.02514423057436943, -0.04045787826180458, 0.017612313851714134, -0.12725929915905, 0.04304708540439606, 0.01052261795848608, -0.01932254619896412, 0.03662295266985893, 0.020607274025678635, -0.05213101953268051, 0.05109744146466255, 0.08173464983701706, -0.033293217420578, 0.007991409860551357, 0.047193825244903564, 0.06474979221820831, -0.033949658274650574, 0.09097960591316223, -0.025062188506126404, -0.068995401263237, 0.016258716583251953, 0.01602882705628872, -0.0003325316938571632, -0.004852531012147665, -0.05274147540330887, 0.012438904494047165, -0.0011594033567234874 ] }, { "text": "# Set the title\nplt.title(\"The first dataset\")\n# Set the y-axis label\nplt.ylabel('Throughput (mb/s)')\n# Set the x-axis label\nplt.xlabel('Latency (ms)')\n# Set axis range\nplt.axis([0, 15, 0, 15])\n\nplt.show()\n\nCalculate mean an variance using Numpy¶\n\nIf you have only 2 features, you can calculate/estimate mean value as follows:\n\nIn [5]:\n\ndata2 = np.array([[1,2],[4,8],[14,15]])\nm, n = data2.shape\nprint(data2[:,0].sum()/m)\nprint(data2[:,1].sum()/m)\n\nmu1 = np.array([data2[:,0].sum()/m, data2[:,1].sum()/m])\n\n6.333333333333333\n8.333333333333334\n\nOr, you can get advantage of np.mean module:\n\nIn [6]:\n\nmu2 = np.mean(data2, axis=0)\nmu2\n\nOut[6]:\n\narray([6.33333333, 8.33333333])\n\nIn [7]:\n\ndef estimate_gaussian(X):\n\"\"\"\nCalculates mean and variance of all features\nin the dataset", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_3", "embedding": [ 0.09594916552305222, -0.024553338065743446, 0.03259691968560219, -0.04943549633026123, -0.025550037622451782, -0.039697837084531784, -0.01642359234392643, 0.04513420909643173, -0.0027669421397149563, -0.057442035526037216, -0.04250310733914375, -0.015218837186694145, 0.02649288810789585, -0.02097526378929615, -0.0521107092499733, 0.05068238079547882, 0.05484249070286751, 0.014158995822072029, 0.06789662688970566, -0.0555524043738842, 0.07836831361055374, 0.06944531947374344, 0.006041001062840223, 0.054067306220531464, 0.10463843494653702, 0.008770775981247425, -0.06475529819726944, 0.061960864812135696, -0.016281597316265106, 0.008284461684525013, -5.414241968537681e-05, 0.009854513220489025, 0.017801769077777863, -0.006127717439085245, -0.06594518572092056, -0.05485052242875099, 0.049367163330316544, -0.0003265711129643023, -0.03214674070477486, -0.008264470845460892, -0.0017150017665699124, 0.062306445091962814, 0.013317182660102844, -0.043066542595624924, -0.004027044400572777, 0.04900166019797325, 0.012885542586445808, -0.11994262039661407, -0.0023569052573293447, 0.03428632766008377, 0.020874854177236557, -0.011198517866432667, -0.07455357164144516, -0.05325768515467644, 0.03747325390577316, -0.022095071151852608, 0.021686343476176262, -0.014514893293380737, 0.07108962535858154, -0.04452217370271683, 0.01140750665217638, -0.015673408284783363, 0.10397731512784958, -0.03485240787267685, 0.04597863554954529, -0.002496196888387203, 0.022326720878481865, 0.033376749604940414, -0.07544577866792679, -0.013465202413499355, 0.03385443240404129, 0.013731858693063259, -0.01414363831281662, -0.045801229774951935, -0.08745528012514114, -0.006015490274876356, 0.03271857276558876, 0.014188063330948353, 0.01596868969500065, 0.02187872678041458, -0.009156238287687302, 0.017146656289696693, 0.01549538318067789, 0.036112453788518906, -0.03465694561600685, 0.03249942883849144, 0.055524956434965134, 0.05749151110649109, -0.020989693701267242, -0.07240467518568039, 0.01183039415627718, -0.016395673155784607, -0.07959674298763275, 0.007935840636491776, 0.01047452911734581, 0.02405323088169098, 0.007138411048799753, -0.03934516757726669, 0.049560047686100006, 0.037175558507442474, 0.03619580343365669, -0.06078394502401352, 0.03299091011285782, -0.015483217313885689, 0.11576908081769943, 0.03319662809371948, 0.11459162831306458, -0.05934244766831398, -0.05332079157233238, -0.025093019008636475, -0.01909748651087284, -0.016724292188882828, -0.10389930754899979, 0.06142551824450493, 0.07586286962032318, 0.05326589569449425, 0.02307847887277603, 0.03822949901223183, 0.002398004988208413, -0.027470042929053307, -0.014657404273748398, -0.0015934684779495, 0.0716327577829361, 0.00021384662250056863, -0.01741942949593067, -0.030000846832990646, 0.011009694077074528, 9.532338075142287e-34, -0.09351633489131927, -0.09806858003139496, 0.0034956317394971848, -0.010348520241677761, 0.007872648537158966, 0.03473225235939026, 0.020498095080256462, -0.03311973065137863, 0.05378488078713417, 0.0059972950257360935, -0.028635771945118904, -0.023752573877573013, -0.0013712368672713637, -0.0896095559000969, 0.010224148631095886, -0.06967993080615997, 0.08629000186920166, -0.040707703679800034, 0.012531911954283714, -0.026086073368787766, 0.04360335320234299, 0.002805078634992242, 0.06613720208406448, 0.008719641715288162, -0.04930003359913826, -0.10274304449558258, -0.06490828096866608, -0.017536960542201996, 0.011984098702669144, -0.035575345158576965, -0.016106538474559784, 0.011852718889713287, -0.03275269642472267, -0.002532397862523794, -0.08645623177289963, -0.12673164904117584, 0.06537509709596634, 0.015026330016553402, 0.04725140333175659, -0.00476123346015811, 0.036554429680109024, 0.07056033611297607, -0.015394586138427258, -0.03802408650517464, -0.07710545510053635, 0.02065766416490078, -0.03178619220852852, 0.033040545880794525, 0.07428652793169022, 0.0720357820391655, -0.13206924498081207, -0.019429534673690796, -0.018671458587050438, 0.047563206404447556, -0.035320546478033066, 0.057015933096408844, 0.01456481497734785, 0.03733665496110916, -0.03704153373837471, -0.056563328951597214, -0.08823955059051514, -0.055320437997579575, 0.040080200880765915, 0.016192464157938957, 0.0346209853887558, 0.08016641438007355, 0.032587695866823196, 0.06869590282440186, 0.06569461524486542, 0.028588121756911278, -0.046668022871017456, -0.0046034618280828, -0.08037766814231873, -0.028228556737303734, -0.024521540850400925, -0.03479881212115288, -0.02321491576731205, 0.019785454496741295, -0.013929767534136772, -0.01951574720442295, 0.01872330717742443, 0.03142758831381798, -0.08826851099729538, -0.06464391201734543, 0.026728710159659386, 0.06312817335128784, -0.0012173822615295649, -0.022954853251576424, -0.0329674556851387, -0.045557502657175064, -0.1153288185596466, 0.05901481583714485, -0.008359466679394245, 0.03455111384391785, -0.14696183800697327, -1.787019940240643e-33, -0.02517825923860073, 0.11557791382074356, 0.09399771690368652, 0.08507166802883148, 0.07053375244140625, 0.0369405597448349, 0.02658950537443161, -0.040904298424720764, 0.017110664397478104, 0.039319250732660294, -0.09827839583158493, -0.10360439866781235, -0.0006650159484706819, -0.015078878030180931, 0.06863706558942795, 0.049570027738809586, -0.029848584905266762, 0.03828045353293419, 0.0656077191233635, -0.05750790983438492, -0.02469182386994362, -0.06638964265584946, -0.01790725067257881, -0.06818469613790512, -0.05312402918934822, 0.05508832260966301, -0.02319272793829441, -0.07727504521608353, -0.09810297191143036, -0.13638557493686676, -0.04455980658531189, 0.023756349459290504, -0.011407413519918919, 0.034828733652830124, 0.013193607330322266, -0.019495487213134766, 0.057609062641859055, -0.031667646020650864, -0.02771277353167534, -0.02117907628417015, 0.057212185114622116, 0.059897344559431076, 0.01796671375632286, -0.0006707780994474888, -0.007067657075822353, 0.13510720431804657, -0.06774827092885971, -0.004159948788583279, 0.0036767732817679644, -0.058115191757678986, 0.001386043499223888, -0.00540499622002244, -0.07038937509059906, 0.014717730693519115, -0.02244582399725914, -0.031115245074033737, -0.032161254435777664, 0.011454216204583645, -0.0006887281779199839, -0.032541703432798386, 0.038742996752262115, -0.1406639665365219, -0.14400988817214966, 0.022979769855737686, 0.02258281223475933, 0.06277364492416382, 0.0015842923894524574, -0.10731520503759384, -0.023208128288388252, 0.0671374648809433, 0.049535587430000305, 0.038979969918727875, 0.002745583886280656, -0.0805419459939003, 0.009852172806859016, 0.0009280125377699733, -0.0007840223261155188, -0.07934316247701645, 0.004235679749399424, 0.016501249745488167, 0.05091865360736847, -0.0020519872196018696, 0.07290157675743103, -0.06639641523361206, 0.010537838563323021, 0.044852156192064285, 0.06826918572187424, 0.038324806839227676, -4.471501597436145e-05, 0.05329718813300133, 0.001516511314548552, 0.06170650199055672, -0.02621166780591011, 0.01849706843495369, 0.04488914832472801, -5.128908853180292e-08, 0.04647253081202507, -0.07810502499341965, 0.001922057126648724, 0.031062841415405273, 0.012021193280816078, 0.053647834807634354, -0.08706138283014297, 0.007510252762585878, 0.009830371476709843, 0.020186785608530045, 0.0007435522857122123, -0.11910990625619888, -0.02172427624464035, 0.045781202614307404, -0.020307648926973343, 0.06846752017736435, 0.014416621066629887, -0.006257529370486736, 0.045450083911418915, -0.013193080201745033, 0.03472517803311348, -0.0015698909992352128, 0.06491543352603912, -0.01177811250090599, -0.0055106584914028645, 0.020051173865795135, -0.0390373133122921, 0.018806207925081253, 0.04225882142782211, 0.035850640386343, 0.051603153347969055, -0.03987887129187584, 0.06760979443788528, 0.01853143610060215, 0.039814677089452744, -0.054388780146837234, -0.05385976657271385, 0.04796157777309418, 0.026024188846349716, 0.13155055046081543, -0.07324507087469101, 0.065320685505867, -0.008134721778333187, -0.017603561282157898, 0.1253037303686142, 0.03125118091702461, 0.015204202383756638, -0.012916620820760727, 0.016031526029109955, -0.023128632456064224, 0.1338302344083786, -0.05717889219522476, 0.028641555458307266, 0.019278721883893013, -0.005685360636562109, 0.018838785588741302, -0.04902642220258713, 0.023076629266142845, 0.03592206910252571, -0.04403534531593323, -0.03744833916425705, -0.056125521659851074, -0.036521054804325104, -0.12912674248218536 ] }, { "text": "Out[6]:\n\narray([6.33333333, 8.33333333])\n\nIn [7]:\n\ndef estimate_gaussian(X):\n\"\"\"\nCalculates mean and variance of all features\nin the dataset\n\nArgs:\nX (ndarray): (m, n) Data matrix\n\nReturns:\nmu (ndarray): (n,) Mean of all features\nvar (ndarray): (n,) Variance of all features\n\"\"\"\n\nm, n = X.shape\nmu = np.mean(X, axis=0)\nvar = np.mean((X-mu)**2, axis=0)\nreturn mu, var\n\nIn [8]:\n\n# Estimate mean and variance of each feature\nmu, var = estimate_gaussian(X_train)\n\nprint(\"Mean of each feature:\", mu)\nprint(\"Variance of each feature:\", var)\n\nMean of each feature: [6.04166667 5.38888889]\nVariance of each feature: [7.52854167 6.0804321 ]\n\nCalculate p_val¶\n\nIn [9]:", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_4", "embedding": [ 0.05325465649366379, -0.06934522092342377, 0.07503707706928253, 0.005363097880035639, -0.0025559687055647373, -0.026609037071466446, -0.00307938433252275, 0.048699334263801575, -0.0630592629313469, -0.037394531071186066, -0.010542381554841995, 0.014109313488006592, 0.032391633838415146, -0.058897215873003006, -0.06049354746937752, 0.046446844935417175, -0.02139231748878956, -0.038964271545410156, 0.010459456592798233, -0.005571791902184486, 0.0702027976512909, 0.09073606878519058, 0.011580039747059345, 0.06334574520587921, 0.05834120512008667, 0.050024036318063736, 0.03158039227128029, 0.013907955959439278, -0.014794401824474335, 0.024640094488859177, -0.024812305346131325, 0.016665086150169373, 0.026102233678102493, -0.031493090093135834, -0.032828960567712784, -0.006908866111189127, -0.016886107623577118, 0.017566412687301636, -0.02304673008620739, 0.08281441777944565, -0.030474336817860603, -0.00994255393743515, -0.01901848614215851, 0.008416886441409588, 0.07216615974903107, 0.0734616369009018, 0.01497324276715517, -0.16117547452449799, 0.02972758188843727, -0.003665235824882984, 0.010864118114113808, 0.0319947749376297, -0.11706759035587311, -0.025880372151732445, -0.0012061827583238482, -0.10849585384130478, -0.05864463374018669, -0.06292983144521713, 0.08183573931455612, -0.007606319151818752, 0.01637122966349125, -0.02239428088068962, 0.08965054899454117, -0.006605722941458225, 0.037978172302246094, -0.018439818173646927, -0.04485015198588371, -0.008118502795696259, -0.08368085324764252, -0.04060020297765732, 0.052732791751623154, 0.08566686511039734, -0.06307986378669739, -0.07679715007543564, -0.049813270568847656, 0.016634851694107056, 0.03549983724951744, -0.0017842261586338282, 0.0009416969842277467, 0.050156574696302414, -0.04391203448176384, 0.03773743659257889, 0.06397844105958939, -0.04671424627304077, 0.023812005296349525, 0.02331489324569702, 0.04553208127617836, 0.06680996716022491, -0.02254088595509529, -0.015593892894685268, 0.07680151611566544, -0.05013788118958473, -0.0875115841627121, 0.0006126633379608393, 0.011430755257606506, 0.05584845691919327, 0.02180405706167221, -0.11484599113464355, 0.011560427024960518, 0.017781363800168037, 0.05001364275813103, 0.008595294319093227, 0.04003608971834183, 0.03689601644873619, 0.028516409918665886, 0.05557495355606079, 0.10312961786985397, -0.03850683942437172, -0.032653164118528366, -0.0014281696639955044, -0.018010416999459267, -0.0626232847571373, -0.09025917947292328, 0.04079832509160042, 0.024601202458143234, 0.09001141786575317, -0.04101279377937317, 0.08500570058822632, -0.05160722881555557, 0.08481941372156143, -0.03591310232877731, -0.028301198035478592, 0.08169212937355042, 0.07262377440929413, -0.037604376673698425, 0.06557653099298477, -0.07041376084089279, 9.433057107968783e-33, -0.05985127389431, -0.021576426923274994, 0.0050238799303770065, -0.05092884227633476, -0.012013699859380722, 0.09250369668006897, 0.01971270889043808, -0.06289231777191162, -0.029082385823130608, 0.020203277468681335, -0.07028594613075256, 0.044537659734487534, 0.0028244457207620144, -0.008738524280488491, -0.0028798608109354973, 0.05139966681599617, -0.01307111419737339, -0.03758632391691208, 0.029161760583519936, -0.002580090891569853, 0.13381606340408325, -0.006561841815710068, 0.005696280859410763, -0.02285992167890072, -0.12742851674556732, -0.051431722939014435, -0.05843070521950722, -0.050137028098106384, -0.12861421704292297, -0.026096701622009277, -0.03969960659742355, -0.002180803567171097, -0.01934782974421978, 0.05371811240911484, -0.07477211952209473, -0.12869638204574585, 0.08902604877948761, -0.008890064433217049, 0.015066100284457207, -0.1167541965842247, -0.024327898398041725, 0.02476934902369976, 0.059222400188446045, -0.03264278545975685, -0.0838213786482811, 0.025000857189297676, -0.03296205401420593, -0.04157780110836029, 0.08601697534322739, 0.06739238649606705, -0.08191217482089996, -0.02915773168206215, -0.008045438677072525, 0.07479717582464218, -0.04131779447197914, 0.010446101427078247, -0.02632397972047329, 0.01611870899796486, -0.0013254105579108, -0.06811065971851349, 0.04854757711291313, -0.028363676741719246, 0.03679274022579193, -0.09807943552732468, 0.038225166499614716, 0.061890918761491776, 0.02820754237473011, 0.08393780887126923, 0.052998799830675125, 0.07314810156822205, -0.040017351508140564, -0.023165637627243996, -0.06977451592683792, -0.03730190917849541, -0.058774612843990326, -0.05778288096189499, -0.039664894342422485, 0.02069580927491188, -0.0036136480048298836, 0.015035867691040039, 0.0030060219578444958, 0.08369316160678864, -0.10057497024536133, -0.053837958723306656, 0.00288772233761847, 0.046613987535238266, -0.01548441220074892, -0.04124293848872185, -0.035204458981752396, -0.022782761603593826, -0.019471531733870506, 0.03762233629822731, 0.01938718929886818, -0.02798045054078102, -0.13938705623149872, -1.0033775128857281e-32, 0.018063154071569443, 0.115109384059906, 0.05545860528945923, 0.03602897748351097, 0.04351714253425598, -0.038066551089286804, 0.01943358965218067, -0.010264864191412926, -0.002908367430791259, -0.03427988663315773, -0.04236749932169914, -0.03855399414896965, -0.0012547655496746302, 0.02423727698624134, 0.08948123455047607, 0.0023453643079847097, 0.011854445561766624, 0.01394600234925747, 0.00919605977833271, -0.12465809285640717, -0.05741503834724426, -0.04691344499588013, -0.046061921864748, -0.04523693397641182, -0.0322544164955616, 0.027516966685652733, 0.020539728924632072, -0.053676750510931015, -0.030103910714387894, -0.05630258098244667, -0.09517224133014679, 0.03150290250778198, -0.09923405200242996, 0.08493298292160034, 0.025329086929559708, -0.026149984449148178, 0.05603284388780594, 0.0357908234000206, -0.014620304107666016, -0.06308089941740036, 0.05252593010663986, 0.06335007399320602, 0.04246373102068901, 0.03816528990864754, 0.004700092598795891, 0.06883649528026581, 0.006448221858590841, 0.03390945494174957, 0.00577686307951808, -0.055861081928014755, 0.008421026170253754, 0.0020139573607593775, -0.10300297290086746, 0.044912636280059814, -0.0036223693750798702, 0.025515349581837654, -0.01594923436641693, -0.001910107210278511, -0.00230279378592968, -0.02600378915667534, 0.05399347096681595, -0.07555890828371048, -0.09962400048971176, -0.056075986474752426, -0.018368205055594444, 0.0567319430410862, -0.04480632394552231, 0.01709822751581669, -0.040999140590429306, 0.057993773370981216, -0.05609266832470894, -0.021678520366549492, 0.011167574673891068, -0.05504452437162399, 0.0040547531098127365, 0.00511173577979207, -0.00279239215888083, -0.04884761571884155, 0.03911981359124184, 0.029902057722210884, 0.07240284979343414, 0.0007892955327406526, 0.061318278312683105, -0.006712870206683874, 0.004842901136726141, 0.016088301315903664, 0.06108494848012924, 0.050325848162174225, 0.009252137504518032, -0.017930228263139725, 0.04137427732348442, 0.04475466534495354, 0.010597783140838146, 0.09431430697441101, 0.0006548231467604637, -6.117755191326069e-08, -0.007839184254407883, -0.05082418769598007, 0.010662569664418697, -0.0202560443431139, 0.03153952211141586, 0.0021298902574926615, -0.04475714638829231, 0.0006125611835159361, -0.04085182398557663, -0.04348543658852577, 0.1004241332411766, -0.13345085084438324, -0.0631311684846878, 0.06580820679664612, 0.02694464661180973, 0.06100717931985855, 0.0052621206268668175, 0.07074449211359024, 0.0026914754416793585, -0.03211071714758873, -0.015242100693285465, -0.10642234236001968, 0.004390085581690073, -0.013509204611182213, -0.021124333143234253, -0.025798846036195755, 0.00895673781633377, 0.033692989498376846, 0.0388294942677021, 0.07129700481891632, -0.014229018241167068, -0.08918016403913498, 0.06924628466367722, -0.016572043299674988, 0.010474304668605328, -0.02311791479587555, -0.020156731829047203, 0.015004889108240604, 0.0626717135310173, 0.070808045566082, -0.08106508105993271, 0.004289887845516205, 0.05101520195603371, -0.033129967749118805, 0.04168107360601425, 0.056032851338386536, 0.02248464711010456, -0.0926833301782608, 0.05431733280420303, 0.03677847608923912, 0.07760678976774216, -0.04112362116575241, 0.021623067557811737, 0.0640578493475914, 0.03409809619188309, 0.0010286620818078518, -0.017115645110607147, -0.003277903189882636, -0.00698640663176775, -0.08605838567018509, -0.03655427694320679, -0.015483194030821323, -0.0001844180515035987, -0.04778103157877922 ] }, { "text": "Mean of each feature: [6.04166667 5.38888889]\nVariance of each feature: [7.52854167 6.0804321 ]\n\nCalculate p_val¶\n\nIn [9]:\n\ndef multivariate_gaussian(X, mu, var):\n\"\"\"\nComputes the probability\ndensity function of the examples X under the multivariate gaussian\ndistribution with parameters mu and var. If var is a matrix, it is\ntreated as the covariance matrix. If var is a vector, it is treated\nas the var values of the variances in each dimension (a diagonal\ncovariance matrix\n\"\"\"\n\nk = len(mu)\n\nif var.ndim == 1:\nvar = np.diag(var)\n\nX = X - mu\np = (2* np.pi)**(-k/2) * np.linalg.det(var)**(-0.5) * \\\nnp.exp(-0.5 * np.sum(np.matmul(X, np.linalg.pinv(var)) * X, axis=1))\n\nreturn p\n\nIn [10]:", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_5", "embedding": [ 0.0607120655477047, -0.09872043877840042, 0.016902456060051918, -0.04065416380763054, 0.004282040521502495, -0.04215447977185249, 0.05105048418045044, 0.0004491155850701034, -0.04527037963271141, -0.03018110617995262, 0.05374407395720482, -0.001782599021680653, 0.04931704327464104, -0.019048282876610756, -0.04617586359381676, 0.02743481658399105, 0.002686683787032962, -0.0186411552131176, -0.0021085194312036037, 0.030171886086463928, 0.034600820392370224, 0.08825817704200745, -0.015355604700744152, 0.00023736892035230994, 0.06301950663328171, 0.01294536329805851, 0.04943221062421799, 0.01285546738654375, -0.039385609328746796, 0.025660552084445953, 0.03302349895238876, 0.028452331200242043, -0.013538964092731476, -0.04260808601975441, -0.010236860252916813, -0.0035386274103075266, -0.043501656502485275, -0.005037880502641201, -0.012865309603512287, 0.05812113732099533, 0.05312395840883255, -0.013133282773196697, -0.01762428507208824, 0.008843970485031605, 0.09492866694927216, 0.04910049960017204, -0.022965237498283386, -0.138508141040802, 0.06494822353124619, -0.06092853471636772, 0.04677090048789978, 0.026977799832820892, -0.12961488962173462, -0.01203940436244011, 0.04071277379989624, -0.1263151317834854, -0.01344287395477295, -0.07689125090837479, 0.05680910125374794, -0.027488358318805695, 0.01795383170247078, 0.0012902382295578718, 0.09048402309417725, 0.016515344381332397, 0.06276888400316238, 0.0012498789001256227, -0.06253483146429062, -0.05036671459674835, -0.07709389925003052, -0.06915424019098282, -0.05104447901248932, 0.07560931146144867, -0.03520548716187477, -0.07983975857496262, -0.06581665575504303, 0.04413578286767006, -0.05161038413643837, -0.01250266470015049, -0.03606497496366501, 0.019571732729673386, -0.009462774731218815, 0.029075853526592255, 0.02472034841775894, -0.04789898917078972, 0.026622269302606583, 0.02473727986216545, 0.017842646688222885, 0.040441256016492844, -0.02073606476187706, 0.01637866348028183, 0.07484737783670425, -0.05130746215581894, -0.060293879359960556, -0.05711803585290909, -0.038018908351659775, 0.022769512608647346, 0.03204812481999397, -0.08371826261281967, 0.023497136309742928, -0.008328880183398724, 0.020347092300653458, -0.04299868643283844, 0.07597380131483078, 0.010134189389646053, 0.030391089618206024, 0.0012742583639919758, 0.0976046770811081, 0.013917077332735062, -0.005488239228725433, -0.02464318834245205, -0.06148109585046768, -0.04132036864757538, -0.07768615335226059, 0.019214028492569923, 0.01794704794883728, 0.13969793915748596, 0.012588415294885635, 0.05156490206718445, -0.002000571694225073, 0.05385636165738106, -0.03615305572748184, -0.006280555855482817, 0.05892406031489372, 0.0452369749546051, -0.04678257182240486, 0.09583079069852829, -0.0644393190741539, 1.0269460276829211e-32, -0.0581979975104332, -0.01090881135314703, 0.011714077554643154, 0.02712535858154297, -0.060713570564985275, 0.11043950170278549, 0.026703055948019028, -0.07305750250816345, -0.008823910728096962, -0.0018832499627023935, -0.04689272493124008, 0.061033040285110474, 0.01561918668448925, -0.022677667438983917, -0.04407649114727974, 0.07855352759361267, -0.020119627937674522, -0.02243100106716156, 0.026013659313321114, 0.01498672179877758, 0.12714023888111115, 0.007417399436235428, -0.0017772521823644638, 0.03788137808442116, -0.10542640089988708, -0.03471740707755089, -0.0681259036064148, -0.04862971603870392, -0.09860125184059143, -0.006916913669556379, 0.008996170945465565, 0.019642896950244904, -0.029464391991496086, 0.08312945067882538, -0.05522273853421211, -0.096272774040699, 0.035210929811000824, -0.014286487363278866, 0.055302489548921585, -0.1134495958685875, -0.044601961970329285, -0.030881155282258987, 0.037644993513822556, -0.0027007933240383863, -0.08909425884485245, 0.013354717753827572, 0.02364525943994522, -0.02411501295864582, 0.0892333909869194, -0.00043661260860972106, -0.046354543417692184, 0.007974056527018547, 0.014735335484147072, 0.10122368484735489, -0.03556907922029495, 0.03713926672935486, 0.014311888255178928, -0.010666626505553722, 0.008262714371085167, -0.06082773581147194, 0.01510600559413433, 0.010902739129960537, -0.021054917946457863, -0.0990792065858841, 0.06085935980081558, 0.06036747992038727, 0.03707173466682434, 0.07026298344135284, 0.08345882594585419, 0.09708991646766663, 0.030542759224772453, 0.015510732308030128, -0.010145279578864574, -0.1004091128706932, -0.053219955414533615, -0.0038263823371380568, -0.0043295808136463165, -0.04244127497076988, -0.018202058970928192, 0.041994959115982056, -0.022305311635136604, 0.07818758487701416, -0.07077991217374802, -0.023159701377153397, 0.021324874833226204, 0.05453942343592644, -0.030369574204087257, -0.033519815653562546, -0.09791223704814911, -0.036779168993234634, 0.017554951831698418, 0.0523395799100399, -0.010636730119585991, -0.03365013748407364, -0.09501367807388306, -8.914669976727908e-33, -0.0010895079467445612, 0.0781756266951561, 0.05759536847472191, 0.03508992865681648, 0.06615245342254639, -0.05239858105778694, -0.005052823107689619, -0.03828882426023483, 0.003443825291469693, -0.04509656876325607, -0.05756671354174614, -0.03286789357662201, -0.0121157830581069, 0.003331886837258935, 0.0792924165725708, 0.06905151158571243, -0.050040993839502335, 0.007368272636085749, 0.044994957745075226, -0.09743750095367432, -0.039445359259843826, -0.033604059368371964, 0.0011857188073918223, -0.04264923930168152, -0.05201466754078865, 0.03925923630595207, 0.020359911024570465, -0.12066707760095596, -0.013621312566101551, -0.037725914269685745, -0.09457482397556305, 0.06693362444639206, -0.08009473234415054, 0.13867102563381195, -0.01366516388952732, -0.06624673306941986, 0.000809825025498867, 0.002623698441311717, 0.02264990471303463, -0.07950160652399063, 0.02610481157898903, 0.03643094003200531, -0.006581688765436411, -0.04370527341961861, 0.03835510089993477, 0.06469939649105072, 0.05702425166964531, 0.028066206723451614, 0.0750105157494545, -0.03173348307609558, -0.009834262542426586, 0.035554420202970505, -0.07619883120059967, 0.1167224794626236, -0.056396085768938065, 0.05650828778743744, -0.042846083641052246, 0.013459586538374424, 0.014009174890816212, -0.024360783398151398, 0.04601861909031868, -0.08306299149990082, -0.028409911319613457, -0.054740939289331436, -0.005120699293911457, 0.08484429121017456, 0.043887585401535034, -0.005363820120692253, -0.05235537514090538, 0.0008044245187193155, -0.026920238509774208, -0.02658851072192192, -2.0027373466291465e-05, -0.08985820412635803, -0.003986990079283714, -0.011142851784825325, -0.009049085900187492, -0.044751521199941635, 0.013291798532009125, 0.010856332257390022, 0.04116710647940636, -0.02632717974483967, 0.0055361101403832436, 0.029711822047829628, 0.02763824164867401, 0.011522484011948109, 0.0057654608972370625, 0.019145028665661812, 0.018664849922060966, -0.032215666025877, 0.010732676833868027, 0.07855692505836487, 0.025149401277303696, 0.034260787069797516, 0.024117939174175262, -6.090045445716896e-08, -0.004594584461301565, -0.015872685238718987, 0.00899774394929409, -0.03330037742853165, 0.06671230494976044, 0.03644779697060585, -0.017113856971263885, 0.05807666480541229, -0.0070153819397091866, -0.006275520659983158, 0.054824721068143845, -0.13502633571624756, -0.018055256456136703, 0.056124959141016006, 0.03358590602874756, 0.04405439645051956, -0.029267916455864906, 0.0450337789952755, 0.02164127677679062, -0.04671706259250641, 0.05250610411167145, -0.12164238840341568, 0.014444500207901001, 0.004803175572305918, -0.0883166566491127, -0.002926912857219577, 0.015678059309720993, 0.013213932514190674, 0.06838332861661911, 0.025151114910840988, -0.014482314698398113, -0.08765529841184616, -0.014770844019949436, 0.009206496179103851, 0.048795413225889206, 0.030082471668720245, -0.005236554425209761, 0.0009868750348687172, 0.05613064765930176, 0.12161578238010406, -0.050364743918180466, 0.027794333174824715, 0.04546093940734863, -0.0009997490560635924, 0.04145016893744469, 0.11839820444583893, 0.01582074724137783, -0.05939272418618202, 0.07235327363014221, 0.09899470955133438, 0.10268954187631607, -0.00998370349407196, 0.004978444427251816, 0.10828043520450592, -0.04682430997490883, -0.006794273387640715, 0.014289834536612034, 0.022662213072180748, 0.04992391914129257, -0.06589405983686447, -0.04102800041437149, -0.011560468003153801, -0.03226730227470398, -0.048958584666252136 ] }, { "text": "return p\n\nIn [10]:\n\ndef visualize_fit(X, mu, var):\n\"\"\"\nThis visualization shows you the\nprobability density function of the Gaussian distribution. Each example\nhas a location (x1, x2) that depends on its feature values.\n\"\"\"\n\nX1, X2 = np.meshgrid(np.arange(0, 20, 0.5), np.arange(0, 20, 0.5))\nZ = multivariate_gaussian(np.stack([X1.ravel(), X2.ravel()], axis=1), mu, var)\nZ = Z.reshape(X1.shape)\n\nplt.plot(X[:, 0], X[:, 1], 'bx')\n\nif np.sum(np.isinf(Z)) == 0:\nplt.contour(X1, X2, Z, levels=10**(np.arange(-20., 1, 3)), linewidths=1)\n\n# Set the title\nplt.title(\"The Gaussian contours of the distribution fit to the dataset\")\n# Set the y-axis label\nplt.ylabel('Throughput (mb/s)')\n# Set the x-axis label\nplt.xlabel('Latency (ms)')\n\nIn [11]:", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_6", "embedding": [ 0.03742106258869171, -0.08399596810340881, 0.04340527579188347, -0.04633589833974838, 0.08283201605081558, -0.04675155505537987, 0.08520732074975967, -0.011601638980209827, -0.06363043934106827, -0.06067309156060219, 0.02219981886446476, -0.07664807140827179, 0.10340661555528641, 0.008059555664658546, -0.018700681626796722, 0.04541058838367462, 0.006165776401758194, -0.03452527895569801, -0.035429466515779495, 0.024523885920643806, 0.07300088554620743, 0.023903872817754745, 0.010113085620105267, -0.06193152070045471, 0.06830118596553802, -0.014072581194341183, 0.1063709557056427, 0.05837050825357437, -0.02681226097047329, 0.012199576944112778, 0.040158919990062714, 0.012007727287709713, -0.009389129467308521, 0.012670435011386871, -0.0011646468192338943, -0.02156396396458149, -0.057799845933914185, 0.0677768737077713, -6.598696199944243e-05, 0.07160811871290207, 0.04470379278063774, 0.049146294593811035, -0.010413563810288906, -0.05842208489775658, 0.07767639309167862, 0.06073623523116112, -0.023516817018389702, -0.12200037389993668, 0.014172550290822983, -0.0354020856320858, 0.013227204792201519, -0.017569541931152344, -0.06970620900392532, -0.013461459428071976, 0.03016168251633644, 0.013430417515337467, 0.020042750984430313, -0.11182329803705215, 0.060685671865940094, -0.06541361659765244, 0.015712054446339607, 0.03341086953878403, 0.04144759103655815, 0.02246532030403614, 0.014032953418791294, 0.015220892615616322, -0.006186256650835276, 0.008689424954354763, -0.06140914186835289, 0.06806179881095886, -0.016956763342022896, 0.05958211049437523, -0.039452988654375076, -0.05764388665556908, -0.09175892174243927, -0.003799351630732417, 0.01396553311496973, -0.012413655407726765, -0.069369375705719, -0.027558395639061928, -0.0276205874979496, 0.03865642100572586, 0.041964635252952576, 0.034358300268650055, 0.00012476999836508185, -0.017194081097841263, 0.002514278283342719, 0.017685167491436005, -0.016318488866090775, -0.015354589559137821, 0.018181560561060905, 0.027930790558457375, -0.0948280617594719, -0.019700611010193825, -0.024057332426309586, 0.0052682776004076, 0.028655946254730225, -0.09815797954797745, 0.049279749393463135, -0.006923079956322908, 0.027467316016554832, -0.07644928246736526, 0.10622960329055786, -0.026754319667816162, -0.011707519181072712, -0.031331680715084076, 0.09593461453914642, 0.04869530349969864, 0.03468819707632065, -0.03906266763806343, -0.006397681776434183, -0.08231396228075027, 0.0077215684577822685, 0.06768152117729187, 0.023986656218767166, 0.10502401739358902, 0.024669215083122253, 0.06810092180967331, -0.05291450396180153, 0.03159129247069359, -0.016045430675148964, 0.018560482189059258, -0.0035543921403586864, -0.000967183499597013, -0.012139041908085346, 0.05793039873242378, -0.01999412104487419, 4.6568240938801735e-33, -0.06994444876909256, -0.0377248115837574, -0.054436467587947845, 0.033176761120557785, 0.0493980348110199, 0.1367812305688858, -0.017572730779647827, -0.04636447876691818, -0.026853861287236214, 0.03643544763326645, -0.07627347856760025, 0.04872977361083031, -0.041896652430295944, -0.004284634720534086, -0.06154510751366615, 0.028801726177334785, -0.026467666029930115, 0.047630637884140015, -0.03456823527812958, 0.06187332794070244, 0.012040205299854279, -0.011049911379814148, 0.013539536856114864, -0.031074190512299538, -0.09088081121444702, -0.06981299072504044, -0.06331184506416321, -1.1383323908376042e-05, -0.04959845542907715, -0.04921381548047066, -0.018262431025505066, 0.04954223334789276, -0.021751612424850464, -0.07579340785741806, -0.06643214821815491, -0.10167183727025986, 0.042325351387262344, -0.015484141185879707, -0.01902708411216736, -0.09551805257797241, -0.043562017381191254, 0.01220671832561493, 0.02288433350622654, 0.0013297074474394321, -0.024020152166485786, 0.05130715295672417, 0.014424779452383518, 0.06114816293120384, 0.04290912672877312, -0.025402987375855446, -0.017930006608366966, -0.019214188680052757, 0.022363370284438133, 0.04641019180417061, -0.026511764153838158, 0.024386631324887276, 0.008304747752845287, -0.04410655423998833, -0.015888497233390808, -0.0930454209446907, 0.03842392936348915, -0.02801961824297905, -0.049714867025613785, -0.024823687970638275, 0.05459238961338997, 0.09506384283304214, 0.051938578486442566, 0.023286838084459305, 0.0565752275288105, 0.13886643946170807, -0.04059410095214844, 0.01149878092110157, -0.06012944504618645, -0.05546799302101135, 0.009437420405447483, -0.010032901540398598, -0.030647695064544678, 0.005017761141061783, 0.01666048727929592, -0.01696687936782837, -0.028021015226840973, 0.03918556123971939, -0.030960217118263245, -0.0511283241212368, -0.05780448019504547, -0.03190205991268158, 0.0196335818618536, 0.004609164781868458, -0.12224946171045303, -0.12349908798933029, -0.032507579773664474, -0.04802577942609787, -0.008416392840445042, 0.017161395400762558, -0.07145704329013824, -4.332602180772247e-33, -0.009767523035407066, 0.07355178892612457, 0.09546846896409988, 0.024955203756690025, 0.06919705122709274, 0.028391772881150246, 0.013832386583089828, 0.007969395257532597, 0.040257032960653305, -0.014187565073370934, -0.0360451377928257, -0.05798475816845894, 0.01813819818198681, 0.0043540881015360355, 0.08409412950277328, 0.036378681659698486, -0.026018179953098297, 0.02044317126274109, -0.05331650748848915, -0.10874652862548828, 0.014296183362603188, -0.023872194811701775, -0.032409556210041046, -0.06275647133588791, -0.06978752464056015, 0.08493412286043167, 0.024774516001343727, -0.05886807665228844, -0.0339323915541172, -0.012052237056195736, -0.10610106587409973, 0.04002070054411888, -0.09596855938434601, 0.029658911749720573, 0.005531882401555777, -0.005033421330153942, 0.03550626337528229, -0.03570641204714775, -0.07773071527481079, -0.025434894487261772, 0.013296062126755714, 0.04519423469901085, 0.00492106145247817, -0.018222050741314888, -0.011175848543643951, 0.09171530604362488, 0.07042203843593597, -0.021565379574894905, 0.028910763561725616, 0.029049940407276154, -0.09325499832630157, 0.07752658426761627, 0.02296822890639305, 0.09725067019462585, -0.053215716034173965, 0.016188617795705795, -0.1481255441904068, -0.01757417619228363, -0.06452848762273788, -0.09129077941179276, -0.06895334273576736, -0.09571777284145355, -0.03938191384077072, 0.030390040948987007, -0.03081865794956684, 0.056713465601205826, 0.02055555395781994, 0.008575024083256721, 0.01796189323067665, 0.06334292888641357, -0.020155904814600945, -0.03487405925989151, 0.02055063657462597, -0.03201073780655861, -0.017757894471287727, 0.03481033444404602, 0.044930294156074524, -0.022758275270462036, -0.01918836683034897, 0.029867535457015038, 0.09041191637516022, -0.030317921191453934, 0.05200771242380142, 0.08142230659723282, 0.028458964079618454, 0.04279476776719093, -0.004895602818578482, 0.04821222275495529, 0.1279831826686859, -0.03476570174098015, 0.022432485595345497, 0.03712593391537666, 0.0046048820950090885, 0.055385418236255646, 0.028470227494835854, -5.367255795363235e-08, -0.04726000502705574, -0.034101955592632294, 0.029352940618991852, -0.05414644256234169, 0.060312651097774506, 0.0001112883910536766, 0.0016276740934699774, 0.025162486359477043, -0.03637929633259773, -0.012377364560961723, -0.01114782877266407, -0.07484278082847595, -0.029446633532643318, 0.0019112643785774708, -0.005855471361428499, 0.06508493423461914, -0.05680188164114952, 0.040288109332323074, 0.04114096239209175, -0.006097197532653809, -0.029573611915111542, -0.1049162968993187, -0.033850401639938354, 0.06687673926353455, -0.08423370122909546, -0.018014689907431602, -0.04868895187973976, -0.01665760576725006, 0.0049111791886389256, 0.08691722899675369, 0.03124821186065674, -0.05234120786190033, 0.03842150792479515, 0.05715160444378853, 0.023969607427716255, 0.03214199095964432, -0.03117348439991474, 0.020664047449827194, 0.04222540184855461, 0.08202764391899109, -0.04519442841410637, 0.07504942268133163, 0.09958170354366302, -0.0009675416513346136, 0.11135490238666534, 0.1004800796508789, 0.038810569792985916, -0.05944664776325226, 0.08661164343357086, 0.0788826197385788, 0.03850417956709862, -0.006874987855553627, -0.007393034640699625, 0.047406215220689774, -0.07328332215547562, -0.018683772534132004, -0.09383051842451096, 0.06892453879117966, 0.0034304154105484486, 0.005986914969980717, -0.07570528984069824, 0.04167903959751129, -0.014158884063363075, -0.06440002471208572 ] }, { "text": "In [11]:\n\np = multivariate_gaussian(X_train, mu, var)\nprint(p)\nvisualize_fit(X_train, mu, var)\n\n[0.01437701 0.02233177 0.01464769 0.01160346 0.01349121 0.01768254\n0.01062604 0.01873874 0.02161721 0.01115485 0.01899981 0.00518436\n0.01761434 0.01027897 0.02122577 0.00028315 0.01600785 0.01781667\n0.00788924 0.01768082 0.01761434 0.00323058 0.00514247 0.00494886\n0.0037409 0.00519717 0.02280922 0.01299177 0.00300614 0.00274066\n0.01888504 0.01867716 0.01027897 0.00025977 0.0126335 0.00251688]\n\nSelect the threshold $\\epsilon$¶\n\nWe will use F1 score on cross validation set.\n\nIf an example $x$ has a probability less than epsilon: $p(x) < \\varepsilon$, then it is classified as an anomaly.\n\nprec = TP / (TP + FP)\nrecall = TP/ (TP + FN)\n\nF1 = (2 prec recall) / (prec + recall)\n\nIn [12]:", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_7", "embedding": [ 0.020845701918005943, -0.09322714060544968, 0.002951133530586958, 0.01897587440907955, 0.04451484605669975, -0.023039359599351883, 0.005167349707335234, 0.07077506929636002, -0.0630432739853859, -0.0397656224668026, 0.04689762368798256, 0.023848844692111015, -0.0006526479264721274, 0.002331082709133625, -0.10803119838237762, -0.004266759380698204, -0.03331964090466499, -0.049826398491859436, 0.009150266647338867, -0.02513902261853218, 0.06045638024806976, 0.024939289316534996, 0.009922919794917107, -0.0288943350315094, 0.04595273360610008, 0.03614148497581482, 0.09188733249902725, 0.08803790807723999, -0.04437459632754326, 0.0011769096599891782, -0.008261813782155514, 0.03693397343158722, 0.06771339476108551, -0.029071176424622536, -0.039854563772678375, -0.01034442987293005, -0.013531419448554516, -0.022226739674806595, 0.01748848706483841, 0.12824495136737823, 0.02968856878578663, -0.012649314478039742, 0.023740705102682114, -0.02098066918551922, 0.05377297103404999, -0.006452587898820639, -0.07914711534976959, -0.11149811744689941, -0.0034199017100036144, -0.046951450407505035, -0.00916714034974575, 0.004692253191024065, -0.05228092893958092, -4.804254785994999e-05, -0.028423547744750977, -0.08268995583057404, -0.06520301848649979, -0.059042494744062424, 0.023750297725200653, 0.021402748301625252, -0.029075654223561287, 0.06335139274597168, 0.026388663798570633, -0.04767462611198425, 0.043743640184402466, 0.04075818508863449, -0.0947922021150589, 0.02319910377264023, -0.04104265570640564, 0.038421452045440674, -0.0007979830843396485, 0.020199883729219437, -0.0654054507613182, -0.08545714616775513, -0.05178886279463768, 0.010315246880054474, 0.06659378856420517, -0.02885659597814083, -0.03215932473540306, -0.07593689113855362, -0.06404764950275421, 0.021128380671143532, 0.011473780497908592, -0.07052004337310791, 0.044020358473062515, -0.019290437921881676, 0.028278939425945282, 0.007820626720786095, 0.043107639998197556, -0.0025381494779139757, 0.041606128215789795, 0.0598929300904274, -0.1701578050851822, 0.030180558562278748, -0.002700774697586894, 0.08749493211507797, 0.03789738938212395, -0.06685483455657959, 0.03044862486422062, -0.01671319268643856, 0.05079637095332146, -0.025302277877926826, 0.07480107992887497, 0.07688035815954208, -0.02037583291530609, -0.035324759781360626, 0.10086068511009216, 0.00500218290835619, -0.003401748137548566, -0.0847449004650116, -0.0007187704904936254, -0.008643914014101028, -0.008281446993350983, 0.02741655893623829, -0.0011787652038037777, 0.06163361668586731, -0.05603509768843651, 0.12110907584428787, -0.027923770248889923, 0.09447682648897171, -0.06412269920110703, -0.011145185679197311, 0.00642524566501379, 0.09548788517713547, -0.0455024428665638, -0.008108220063149929, -0.05076499283313751, 1.4756043768693532e-32, -0.06406326591968536, 0.008617028594017029, 0.01656239479780197, -0.0577164888381958, -0.04439008980989456, 0.0867658331990242, -0.036985136568546295, -0.1129787340760231, -0.03316905349493027, 0.06979770958423615, -0.09442103654146194, 0.04078284278512001, -0.020569205284118652, 0.051010433584451675, -0.027620533481240273, -0.0147385373711586, -0.07193686813116074, 0.04793456569314003, -0.04282821714878082, 0.01642630249261856, 0.07182049751281738, -0.004967667628079653, -0.004210494924336672, -0.07577076554298401, -0.03558945283293724, 0.055588044226169586, -0.021907277405261993, -0.0034489682875573635, -0.07537340372800827, 0.022302262485027313, -0.03604778274893761, 0.07111814618110657, -0.06861955672502518, -0.01843775250017643, -0.07864698022603989, -0.09471876174211502, -0.00936474185436964, 0.029548300430178642, -0.00759625481441617, -0.040922995656728745, -0.05651794746518135, 0.0038669316563755274, 0.05395947024226189, -0.019569475203752518, -0.05629045143723488, 0.002764929784461856, 0.05069510638713837, -0.0016012579435482621, 0.02846009097993374, -0.02969283238053322, -0.05640430375933647, -0.07321196794509888, -0.010463484562933445, -0.008062492124736309, -0.0059970710426568985, -0.018311208114027977, 0.04570918530225754, 0.031578898429870605, 0.033296678215265274, -0.011153483763337135, 0.04454704746603966, -0.001395963947288692, -0.023877138271927834, -0.05781155452132225, 0.039172299206256866, 0.05715944990515709, -0.005866602528840303, -0.06402501463890076, 0.050803642719984055, 0.13374227285385132, -0.0812782570719719, 0.024786029011011124, -0.014286531135439873, -0.07958395034074783, 0.04696745425462723, -0.045280009508132935, 0.018834639340639114, 0.05120263248682022, -0.008094234392046928, 0.03544832020998001, -0.07181541621685028, 0.090169757604599, -0.04018160328269005, -0.10934710502624512, -0.011228302493691444, -0.005370559636503458, -0.061803240329027176, -0.050388723611831665, -0.11060873419046402, -0.052050426602363586, -0.07366235554218292, 0.024271517992019653, 0.014252685941755772, -0.01928742416203022, -0.09209006279706955, -1.4881959784817738e-32, 0.014713049866259098, 0.12296877056360245, 0.10175780206918716, 0.05134059116244316, -0.019207682460546494, 0.007381523959338665, 0.03219722956418991, 0.027558276429772377, 0.02547309175133705, 0.08511628210544586, 0.04216102510690689, -0.08655395358800888, -0.02209392935037613, -0.003963100723922253, 0.10155811160802841, 0.00477641774341464, 0.039028752595186234, 0.05120101943612099, -0.021731523796916008, -0.1231088936328888, 0.07910217344760895, 0.027537094429135323, -0.06522725522518158, -0.036847762763500214, -0.010104094631969929, 0.03324287012219429, 0.0737919956445694, -0.040398623794317245, -0.06504354625940323, -0.018931597471237183, -0.11224721372127533, -0.035642676055431366, -0.0940576121211052, 0.0661110207438469, -0.02580874226987362, 0.03748130053281784, 0.009927925653755665, 0.042796507477760315, -0.0405542217195034, -0.002242504619061947, 0.03478724882006645, 0.05669000372290611, -0.058006566017866135, 0.014702854678034782, -0.025884853675961494, 0.02645370550453663, 0.09732181578874588, 0.01226879097521305, -0.005829561036080122, 0.01270885206758976, -0.005320738535374403, 0.049958694726228714, -0.07941795140504837, 0.035566773265600204, 0.01341245137155056, 0.013020092621445656, -0.06330733001232147, -0.04574691876769066, -0.05300627276301384, -0.09261633455753326, 0.022437293082475662, -0.05979907512664795, 0.01643240451812744, -0.03219011053442955, -0.01185954362154007, 0.03344641625881195, -0.006083480082452297, -0.0008548535988666117, 0.02755597047507763, 0.044332291930913925, 0.020098472014069557, -0.01181513536721468, -0.006200989242643118, 0.013656845316290855, -0.03165894001722336, 0.02256077714264393, -0.0009248023852705956, 0.04130733758211136, 0.0048496597446501255, 0.03780530393123627, 0.02830459363758564, -0.05281895026564598, 0.07965515553951263, 0.09921899437904358, 0.030185848474502563, 0.06194136664271355, -0.013089971616864204, 0.05631060153245926, 0.09871633350849152, -0.0694807693362236, 0.05289929732680321, 0.0593050941824913, 0.05384516343474388, 0.09092263877391815, -0.03045494668185711, -7.148971548076588e-08, -0.0677613839507103, -0.06891864538192749, -0.01217807549983263, -0.03949466720223427, 0.08028315752744675, 0.016533231362700462, -0.04475339129567146, -0.0008886164287105203, -0.07160759717226028, -0.027431990951299667, 0.06796720623970032, -0.062198590487241745, -0.06745244562625885, -0.021325871348381042, 0.02373640239238739, 0.025648564100265503, -0.005405195523053408, 0.0801159143447876, 0.004039089195430279, -0.031480658799409866, -0.011414064094424248, -0.03816734999418259, -0.05161377787590027, 0.008990124799311161, -0.043478213250637054, -0.051711272448301315, -0.041316792368888855, 0.03450118377804756, 0.022721000015735626, 0.018467707559466362, 0.02693643793463707, -0.033905502408742905, 0.06613492220640182, 0.027364108711481094, -0.006567445583641529, 0.039382338523864746, -0.03399106487631798, 0.059113506227731705, 0.010487659834325314, 0.03745928034186363, -0.08253004401922226, 0.024620814248919487, 0.032209984958171844, 0.016184505075216293, 0.09678513556718826, 0.0944477841258049, -0.019972119480371475, -0.07011391967535019, 0.05302594229578972, 0.032255031168460846, 0.015202773734927177, 0.00255375262349844, -0.016819089651107788, 0.06066183000802994, 0.003946985118091106, -0.004190270323306322, -0.043616943061351776, -0.06022416800260544, -0.09700895100831985, -0.04398176074028015, -0.05882125347852707, -0.04891900345683098, -0.038446154445409775, -0.026173891499638557 ] }, { "text": "prec = TP / (TP + FP)\nrecall = TP/ (TP + FN)\n\nF1 = (2 prec recall) / (prec + recall)\n\nIn [12]:\n\n#example\np_val = np.array([0.2, 0.35, 0.9, 0.1, 0.5])\ny_t = np.array([1,0,0,1,0])\nep = 0.4\npred = np.array(p_val best_F1:\nbest_F1 = F1\nbest_epsilon = epsilon\n\nreturn best_epsilon, best_F1\n\nIn [15]:\n\np_val = multivariate_gaussian(X_val, mu, var)\nepsilon, F1 = select_threshold(y_val, p_val)", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_9", "embedding": [ -0.01946255937218666, -0.023964881896972656, -0.04312020167708397, -0.03285592794418335, 0.0010756438132375479, -0.03767167776823044, -0.013053185306489468, 0.04512452706694603, -0.05300208553671837, -0.059529609978199005, -0.04781036451458931, -0.0598086379468441, -0.01852596178650856, 0.039763227105140686, -0.01723429560661316, 0.027313483878970146, -0.044028040021657944, 0.0697447657585144, 0.0204345490783453, -0.05965445190668106, 0.030379729345440865, 0.027646230533719063, 0.0356144942343235, 0.06454762816429138, -0.025024138391017914, -0.035765547305345535, -0.034464094787836075, 0.09989441186189651, -0.00994164403527975, -0.0382186584174633, -0.008418097160756588, 0.013268798589706421, 0.010055833496153355, 0.010930567048490047, -0.0399656668305397, 0.020040446892380714, -0.09185585379600525, -0.004435943439602852, 0.02832583338022232, 0.011615266092121601, -0.039495497941970825, -0.023100556805729866, -0.010933278128504753, -0.002761538838967681, 0.07865609973669052, 0.053175296634435654, -0.04816354438662529, 0.0010746901389211416, 0.03102850168943405, -0.024234134703874588, -0.02945741079747677, 0.13302300870418549, -0.03813641145825386, -0.05030428618192673, -0.04480195790529251, 0.0017886661225929856, 0.09384395182132721, -0.08757554739713669, -0.00983969122171402, -0.07615935057401657, -0.0030061278957873583, -0.11975820362567902, -0.014367371797561646, -0.04497719183564186, 0.01991928555071354, 0.0015330942114815116, -0.007275823969393969, -0.040069714188575745, 0.015747765079140663, 0.07384277135133743, 0.03379093110561371, 0.06113223358988762, 0.05456962436437607, 0.00045343340025283396, -0.08005447685718536, -0.004188213963061571, 0.03168356046080589, 0.002243319060653448, -0.0036167679354548454, 0.09908469766378403, -0.028306670486927032, 0.03069084696471691, 0.04073154181241989, -0.04460195451974869, 0.05121304467320442, -0.05576556548476219, 0.024537403136491776, 0.06838318705558777, 0.0947038009762764, 0.020537475124001503, 0.06321060657501221, 0.006182410754263401, -0.056595586240291595, -0.018904494121670723, 0.02685229294002056, 0.00810903962701559, -0.015852605924010277, -0.09836838394403458, -0.024915942922234535, 0.028502125293016434, 0.025913838297128677, 0.0033894735388457775, -0.06394229829311371, -0.0777585506439209, 0.06215335428714752, 0.05546892434358597, 0.11513544619083405, 0.053669415414333344, 0.05811843276023865, -0.024184586480259895, -0.009704550728201866, -0.034314654767513275, 0.049558065831661224, 0.057366788387298584, 0.015933310613036156, 0.09812012314796448, -0.0035625463351607323, 0.05782856419682503, 0.013186321593821049, 0.030602701008319855, -0.06551376730203629, 0.018287980929017067, 0.09990796446800232, 0.05226955935359001, 0.0046826438046991825, 0.013094075955450535, -0.06103671342134476, 1.0318321903573048e-32, -0.06392967700958252, 0.020261051133275032, 0.01392809022217989, -0.11702429503202438, -0.034954581409692764, 0.04408592730760574, -0.016899434849619865, -0.012054854072630405, -0.09789453446865082, -0.013681534677743912, -0.07061275094747543, -0.03753113001585007, -0.052413348108530045, -0.020243600010871887, 0.04365814849734306, -0.0947936624288559, -0.03025297448039055, 0.025801191106438637, -0.009650674648582935, -0.03304477781057358, 0.06834213435649872, -0.05296897143125534, 0.04746124520897865, -0.008367265574634075, -0.05384870246052742, -0.033687278628349304, -0.014172420836985111, 0.06376972049474716, -0.08844806998968124, 0.004912847653031349, -0.05173531174659729, -0.03275422751903534, 0.054307203739881516, -0.037753935903310776, 0.08213645964860916, -0.028266439214348793, 0.01408699806779623, 0.018436476588249207, 0.0755242332816124, -0.0478551983833313, -0.04230252280831337, 0.05161771923303604, 0.09639591723680496, -0.04134140536189079, -0.08768810331821442, -0.04542513191699982, -0.03961377590894699, 0.11683716624975204, 0.00939233135432005, 0.06550969928503036, -0.05731729045510292, -0.025715501978993416, -0.03685764595866203, -0.002577234758064151, -0.05462641641497612, -0.0004291083023417741, 0.023557469248771667, 0.0894978865981102, 0.02658890374004841, -0.004728253465145826, 0.011779312044382095, 0.002010516356676817, -0.03870362415909767, -0.045669615268707275, -0.03640936687588692, 0.04670405760407448, -0.021067103371024132, 0.04525526240468025, 0.03942845016717911, 0.037303462624549866, 0.009379896335303783, 0.007849648594856262, -0.010904423892498016, -0.021187130361795425, 0.04633481428027153, -0.06820917874574661, 0.12115655094385147, -0.014424451626837254, -0.021904366090893745, -0.12597545981407166, -0.023241885006427765, 0.04823264107108116, -0.07169564068317413, -0.04498470947146416, -0.01873483508825302, -0.004984324797987938, 0.04572591558098793, 0.015705488622188568, -0.09681571274995804, -0.029325751587748528, -0.07727871835231781, -0.011415517888963223, 0.01556333340704441, 0.003255815478041768, -0.10963083803653717, -9.546947816884077e-33, -0.05940753221511841, 0.08442454040050507, 0.029725778847932816, 0.05952940136194229, 0.004677253775298595, -0.02562025561928749, -0.02262967638671398, -0.06387948244810104, 0.011669378727674484, -0.011949167586863041, -0.02991596795618534, -0.03560056537389755, 0.012040376663208008, -0.025051115080714226, 0.017010407522320747, -0.007041402626782656, -0.08477175235748291, 0.04854260012507439, 0.032116297632455826, 0.007626820355653763, 0.01815619319677353, 0.02454601228237152, -0.03951728343963623, 0.046278126537799835, -0.06566612422466278, 0.02733474224805832, 0.0294478852301836, 0.027141284197568893, -0.049703337252140045, -0.06914255768060684, -0.04783118516206741, -0.0037129679694771767, -0.06295991688966751, 0.0885600820183754, 0.07400216907262802, -0.08385329693555832, 0.08094188570976257, -0.09618302434682846, -0.01562011893838644, 0.06679680198431015, 0.10126807540655136, 0.08294617384672165, -0.09568244963884354, -0.028477488085627556, -0.013776022009551525, 0.04075740650296211, -0.0007759309373795986, 0.041333574801683426, -0.011678408831357956, -0.04693770781159401, -0.049999479204416275, -0.007566702552139759, -0.03383846580982208, 0.1148541197180748, -0.010342011228203773, 0.008742811158299446, -0.0710151344537735, -0.052599094808101654, -0.06019056588411331, 0.022971821948885918, -0.06235047057271004, 0.030470840632915497, -0.056165456771850586, 0.04463732987642288, 0.09540554136037827, 0.015519973821938038, -0.04561313986778259, 0.0762157067656517, -0.01369126420468092, 0.09312601387500763, -0.04892577975988388, 0.08793321996927261, 0.03792170062661171, -0.027298036962747574, -0.021671917289495468, -0.05373356491327286, -0.027022751048207283, 0.005466954782605171, 0.004414001014083624, 0.0003796143573708832, 0.023741263896226883, 0.014159265905618668, 0.041218455880880356, 0.0844200998544693, -0.048233259469270706, 0.08200047165155411, 0.09674736112356186, 0.0704592615365982, 0.01053388137370348, 0.03928140178322792, 0.005616411101073027, 0.0775899812579155, 0.07953286916017532, -0.07309048622846603, -0.01960263028740883, -5.680258396978388e-08, -0.052445001900196075, -0.03998256102204323, 0.017261415719985962, 0.030648943036794662, 0.028430411592125893, -0.0100723160430789, -0.03709801286458969, -0.034090813249349594, -0.04636583477258682, -0.06953871995210648, 0.07560768723487854, -0.02619168534874916, -0.08778028190135956, -0.06313788890838623, -0.018520444631576538, 0.012401305139064789, 0.005024116951972246, 0.12084729969501495, -0.003907037898898125, -0.010622520931065083, -0.010897085070610046, -0.03766152635216713, 0.018423864617943764, -0.0014129484770819545, -0.03531107306480408, -0.006523138377815485, -0.02113829366862774, 0.05678563565015793, 0.07914336770772934, 0.062022242695093155, 0.013561636209487915, -0.08452878892421722, 0.09248149394989014, 0.020730722695589066, 0.06255685538053513, 0.06532981991767883, -0.01899409294128418, 0.051543112844228745, 0.03198551759123802, 0.06313883513212204, -0.09894514083862305, 0.041758351027965546, -0.06747808307409286, -0.021114874631166458, 0.02728516422212124, -0.01803448610007763, -0.06540126353502274, -0.044350095093250275, 0.03587903454899788, -0.02650493010878563, 0.051360417157411575, 0.03249003365635872, -0.048271797597408295, 0.08163793385028839, 0.007428113836795092, -0.010187569074332714, -0.14056731760501862, -0.03981093689799309, -0.06783320754766464, -0.005294448230415583, 0.03207540884613991, 0.049138154834508896, 0.016339896246790886, -0.020421234890818596 ] }, { "text": "return best_epsilon, best_F1\n\nIn [15]:\n\np_val = multivariate_gaussian(X_val, mu, var)\nepsilon, F1 = select_threshold(y_val, p_val)\n\nprint('Best epsilon found using cross-validation: %e' % epsilon)\nprint('Best F1 on Cross Validation Set: %f' % F1)\n\nBest epsilon found using cross-validation: 7.227568e-04\nBest F1 on Cross Validation Set: 0.909091\n\n:29: RuntimeWarning: invalid value encountered in long_scalars\nprecision = TP / (TP+FP)\n\nFind outliers on training set¶\n\nIn [16]:\n\n# Find the outliers in the training set\noutliers = p < epsilon\n\n# Visualize the fit\nvisualize_fit(X_train, mu, var)\n\n# Draw a red circle around those outliers\nplt.plot(X_train[outliers, 0], X_train[outliers, 1], 'ro',\nmarkersize= 10,markerfacecolor='none', markeredgewidth=2)", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_10", "embedding": [ 0.001362048671580851, -0.07662039995193481, 0.02944495901465416, -0.0025840720627456903, 0.1291850358247757, -0.05159293860197067, 0.044167134910821915, 0.0707608088850975, -0.08612952381372452, -0.08189906179904938, 0.026465900242328644, -0.01613282412290573, -0.000494889565743506, 0.0017880613449960947, -0.020652886480093002, 0.017872555181384087, 0.017011748626828194, 0.015589366666972637, -0.03509064391255379, -0.048828672617673874, -0.012587328441441059, 0.003315611509606242, -0.025500137358903885, 0.10092172771692276, -0.01711457595229149, -0.008304045535624027, -0.01762464828789234, 0.08173654228448868, -0.09002132713794708, -0.0303316842764616, -0.03736887499690056, 0.02291855588555336, -0.00293184001930058, -0.007517694961279631, 0.019017813727259636, 0.05204705521464348, -0.01206278894096613, 0.004507342353463173, 0.09770902246236801, 0.034358032047748566, -0.04212157800793648, -0.07617199420928955, 0.06026457995176315, 0.039470359683036804, 0.011072046123445034, -0.03410464897751808, -0.05367133393883705, -0.09052935242652893, -0.005755833350121975, -0.03925086557865143, -0.0801025927066803, 0.06866391003131866, -0.04235706478357315, -0.00102461245842278, 0.011864080093801022, -0.03560332953929901, -0.022455208003520966, -0.062093138694763184, 0.0011474931379780173, -0.05377466604113579, -0.00844908133149147, -0.019391052424907684, 0.026353904977440834, -0.016310907900333405, -0.003331804880872369, -0.0005435853381641209, -0.004833776503801346, 0.0025287300813943148, -0.028467867523431778, 0.11815343797206879, 0.04521438479423523, 0.06894122809171677, -0.09564851224422455, 0.009502911008894444, 0.006686076056212187, 0.02227127179503441, 0.04172326251864433, -0.0012013083323836327, -0.008143172599375248, -0.030843697488307953, -0.006234574597328901, 0.09352290630340576, 0.026606712490320206, -0.030646108090877533, 0.0397968664765358, -0.07785245776176453, 0.038378652185201645, 0.021966662257909775, 0.08334029465913773, 0.03672870621085167, 0.07994738221168518, 0.02893180213868618, -0.08926741033792496, 0.0585290789604187, 0.0558101087808609, 0.04211701452732086, -0.004890828859061003, -0.07905595749616623, 0.01556149311363697, 0.03304444998502731, 0.0027220796328037977, 0.0010509570129215717, -0.01455836184322834, 0.05810253322124481, 0.013887773267924786, -0.02010013908147812, 0.10192728042602539, 0.052215512841939926, 0.07417092472314835, -0.050152260810136795, 0.006832129321992397, -0.07216764986515045, 0.03844727948307991, 0.047948021441698074, 0.06649746745824814, 0.09040849655866623, -0.011302129365503788, 0.0898730605840683, -0.06133679673075676, 0.08235187083482742, -0.11761898547410965, 0.06406232714653015, 0.03282838687300682, 0.06622800976037979, -0.018059199675917625, 0.040801990777254105, -0.09733755886554718, 8.841542473163254e-33, -0.03288501128554344, 0.028912879526615143, 0.04333427920937538, -0.12072792649269104, -0.04603004828095436, 0.03675566613674164, -0.01376353483647108, -0.03334333002567291, -0.04045020043849945, 0.06057187169790268, -0.12460525333881378, -0.030448436737060547, -0.0366656556725502, -0.014096973463892937, 0.03237513452768326, 0.0046930150128901005, -0.02308589220046997, 0.01106775552034378, -0.07614830136299133, 0.014335601590573788, 0.1299399882555008, -0.08895041793584824, -0.020043576136231422, -0.05665523558855057, -0.030702505260705948, 0.019049005582928658, -0.0016211440088227391, 0.0592360757291317, -0.06583830714225769, 0.02994660660624504, -0.10438736528158188, 0.01919509284198284, 0.0751211866736412, -0.03817074000835419, 0.05656292289495468, -0.07816058397293091, -0.0023453915491700172, 0.013727051205933094, 0.07726797461509705, 0.006327610928565264, -0.04308122768998146, 0.016519129276275635, 0.027416100725531578, 0.0463210754096508, 0.07035718858242035, 0.0005847238935530186, -0.036591142416000366, 0.11500340700149536, -0.011082119308412075, 0.021875621750950813, -0.09056216478347778, -0.04896284267306328, -0.029982920736074448, 0.040894702076911926, -0.087886281311512, -0.010191776789724827, 0.031894780695438385, 0.05231458693742752, -0.008696470409631729, -0.022609341889619827, 0.037391163408756256, -0.04772954061627388, -0.026763731613755226, -0.07101815938949585, -0.024110663682222366, -0.009507473558187485, 0.005361194256693125, -0.004654401913285255, 0.013071926310658455, 0.09540122747421265, -0.05428290367126465, -0.0026416077744215727, -0.07075686007738113, -0.017079122364521027, 0.05776919424533844, -0.0653434544801712, 0.06275415420532227, 0.02129189297556877, 0.025065070018172264, -0.05503525584936142, -0.07874695211648941, 0.09748184680938721, -0.0778631791472435, -0.08314100652933121, -0.05620654299855232, -0.08620762825012207, 0.03094036504626274, -0.018654916435480118, -0.06049852818250656, 0.019519751891493797, -0.06573116779327393, -0.004408752545714378, 0.012526868842542171, -0.018284490332007408, -0.13302522897720337, -8.273236504946772e-33, 0.003456362057477236, 0.09146484732627869, 0.08808519691228867, 0.08454760164022446, 0.004506878089159727, -0.043559178709983826, 0.026257051154971123, 0.04197957366704941, 0.018240971490740776, 0.020802544429898262, 0.0006163812358863652, -0.06963283568620682, -0.004306116607040167, -0.007768625393509865, 0.0423392690718174, 0.02877662144601345, -0.04614723473787308, 0.0448099747300148, -0.01871112920343876, -0.03594382479786873, -0.0007993283215910196, -0.0012413676595315337, -0.034382570534944534, 0.061674561351537704, -0.008524645119905472, 0.05607618764042854, 0.060730766505002975, -0.03303210064768791, -0.07164111733436584, -0.030047651380300522, -0.0883001834154129, 0.04846759885549545, -0.054772086441516876, 0.08528869599103928, 0.08342714607715607, -0.03681618720293045, 0.06828184425830841, -0.09564460068941116, -0.04988279938697815, 0.0585949681699276, 0.06431706994771957, 0.1087508499622345, -0.06648407131433487, 0.03580116853117943, -0.04236829653382301, 0.06040718033909798, 0.01670810580253601, 0.004412401933223009, 0.02652326598763466, -0.002180954674258828, -0.0366026945412159, -0.038460083305835724, -0.026721831411123276, 0.0876462385058403, -0.0370393842458725, -0.03008745051920414, -0.06927674263715744, 0.009392701089382172, -0.10879586637020111, 0.00687053520232439, -0.03614679351449013, -0.015847360715270042, -0.037224434316158295, 0.044821597635746, 0.07015439122915268, -0.0036641268525272608, -0.0018329169834032655, 0.060346659272909164, 0.047558970749378204, 0.04213881120085716, -0.07477137446403503, -0.06058400124311447, -0.00651699211448431, 0.0008968304027803242, -0.03626730293035507, 0.04587722197175026, -0.026066072285175323, 2.2549259028892266e-06, 0.026310259476304054, 0.059186823666095734, 0.04401310905814171, 0.006769848987460136, 0.06040152162313461, 0.04499850049614906, -0.010329673998057842, 0.05189316347241402, 0.02824898064136505, 0.07435116171836853, 0.027757497504353523, -0.0792008638381958, 0.008927796967327595, -0.008638842031359673, 0.030012009665369987, 0.020541584119200706, 0.003351450664922595, -5.402806024790152e-08, -0.07468527555465698, -0.01411325391381979, 0.007878188043832779, 0.028852185234427452, 0.04053065925836563, -0.006185601465404034, -0.029556022956967354, 0.009442268870770931, -0.032020438462495804, -0.01215356308966875, 0.007858291268348694, -0.05576620623469353, -0.0788954347372055, -0.054467156529426575, 0.010554053820669651, -0.032642725855112076, -0.023760991171002388, 0.08610010892152786, -0.01899797096848488, -0.006206951104104519, -0.06328554451465607, -0.04936496540904045, -0.021984025835990906, -0.02342136763036251, -0.024809878319501877, -0.061333514750003815, -0.06485562771558762, 0.09506719559431076, 0.013002418912947178, 0.013887256383895874, 0.048208028078079224, -0.11187514662742615, 0.07726658880710602, 0.000680814846418798, -0.01572016440331936, 0.06891288608312607, -0.03589744493365288, 0.013056888245046139, 0.05076149106025696, 0.0728122666478157, -0.06771921366453171, 0.060545023530721664, -0.02971392497420311, -0.06311773508787155, 0.031157229095697403, -0.011211352422833443, 0.021578148007392883, -0.01259039156138897, 0.0022610102314502, -0.040773581713438034, 0.02094130776822567, -0.029258117079734802, -0.0038504882249981165, 0.07122231274843216, 0.008685731329023838, -0.04840311035513878, -0.09633760899305344, 0.04793704301118851, -0.08143045753240585, -0.060759760439395905, -0.006589212454855442, -0.01508892048150301, 0.047522541135549545, -0.03811987116932869 ] }, { "text": "Out[16]:\n\n[]", "source": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html", "type": "html_notebook", "chunk_id": "notebook: 2022-11-05-Anomaly_Detection_with_Numpy.html_11", "embedding": [ 0.027034109458327293, 0.0794205293059349, -0.03882359340786934, -0.08441591262817383, 0.05463565140962601, -0.07790624350309372, -0.04273040220141411, 0.011677303351461887, -0.03321768715977669, -0.036318354308605194, -0.009514565579593182, 0.00196915864944458, -0.049575574696063995, -0.0468975305557251, -0.0594598762691021, 0.08715824782848358, -0.13729636371135712, -0.07981904596090317, 0.012460415251553059, 0.040970709174871445, 0.05590466782450676, 0.020969511941075325, -0.07851451635360718, 0.025032715871930122, 0.03096442110836506, 0.033835094422101974, 0.07901404798030853, 0.06849183887243271, -0.028013721108436584, 0.04610821232199669, 0.05333114042878151, 0.09983295947313309, -0.017051557078957558, -0.006869807839393616, 0.052369896322488785, -0.03743170574307442, 0.12254603207111359, 0.02431720681488514, -0.030703237280249596, -0.0008804979152046144, 0.06325569748878479, 0.06869056820869446, 0.014444380067288876, -0.021154439076781273, 0.05042172595858574, -0.001730840071104467, 0.010161357931792736, -0.0935206264257431, 0.11608604341745377, 0.010102047584950924, -0.018262462690472603, 0.10982497781515121, -0.017662236467003822, 0.01874784752726555, 0.013727479614317417, -0.026911718770861626, 0.014404634945094585, -0.10904225707054138, 0.0963803231716156, -0.062378108501434326, 0.012506592087447643, 0.015689434483647346, 0.015319994650781155, 0.028791483491659164, -0.015028904192149639, -0.06120210140943527, -0.015387732535600662, 0.0483417734503746, -0.026124097406864166, 0.04652739688754082, -0.04607675224542618, -0.0019065439701080322, 0.013937241397798061, -0.02932562865316868, 0.0003852185618598014, -0.059251755475997925, -0.06782572716474533, -0.06272813677787781, 0.08244505524635315, -0.01923518255352974, -0.05311641842126846, -0.016749253496527672, 0.046024978160858154, 0.06482145935297012, -0.05401611328125, 0.04079904779791832, 0.0030162890907377005, -0.028306521475315094, 0.09126222878694534, 0.029014017432928085, -0.04186926782131195, 0.03348388150334358, -0.06467656046152115, 0.10183194279670715, -0.04285075515508652, -0.0030904386658221483, 0.1281518191099167, -0.05828886479139328, -0.05827366188168526, 0.03365588188171387, 0.06762826442718506, -0.0833049938082695, 0.00030707509722560644, 0.11364863812923431, 0.018593987450003624, -0.012468741275370121, 0.09609966725111008, 0.03310040012001991, -0.001416803919710219, 0.00888416450470686, 0.0703979879617691, -0.08149468153715134, 0.02421535551548004, 0.01221365388482809, 0.1737910807132721, 0.025001859292387962, -0.015776243060827255, 0.07589544355869293, -0.04945560544729233, 0.0485185831785202, -0.0339120551943779, -0.015019316226243973, -0.03194573521614075, 0.030636314302682877, -0.027972381561994553, -0.04444275423884392, 0.04298223927617073, 3.243460379645334e-33, -0.027655115351080894, -0.0011316167656332254, 0.030375881120562553, 0.0056993416510522366, 0.019638676196336746, -0.002561508445069194, -0.11616687476634979, -0.046413354575634, -0.019318174570798874, 0.06610095500946045, -0.07059494405984879, -0.1122627928853035, 0.037978705018758774, 0.03748977184295654, 0.019770141690969467, -0.07557761669158936, 0.06525580585002899, -0.013408515602350235, 0.005375648848712444, 0.013528707437217236, -0.04082946851849556, 0.04545235261321068, -0.004059435799717903, -0.00934420246630907, -0.04028204455971718, -0.020362431183457375, -0.02746674232184887, 0.0240444615483284, -0.02189810201525688, 0.031063221395015717, -0.015190000645816326, 0.002870135707780719, -0.0028627945575863123, -0.05640184506773949, -0.04881835728883743, -0.010938454419374466, 0.05600520223379135, -0.05791276693344116, -0.022082503885030746, -0.05933471396565437, -0.06252476572990417, 0.030482035130262375, 0.026821643114089966, -0.012625967152416706, 0.05861365422606468, 0.025888195261359215, 0.016637571156024933, 0.04280582070350647, 0.06859881430864334, 0.054099854081869125, -0.10791051387786865, 0.02838830277323723, 0.0007003159262239933, -0.04043586924672127, 0.015258031897246838, -0.05969323590397835, 0.02813299000263214, 0.014105353504419327, -0.015223451890051365, -0.017818469554185867, -0.006021955516189337, 0.0019810141529887915, 0.0032649929635226727, -0.014990097843110561, 0.03309153765439987, -0.0043267374858260155, 0.06656854599714279, -0.04949379339814186, -0.07439104467630386, 0.06382739543914795, -0.13539285957813263, 0.029693281278014183, 0.026771284639835358, -0.02025490067899227, -0.038247719407081604, -0.05788128823041916, -0.004687686916440725, 0.03607412800192833, -0.027834314852952957, 0.0011796539183706045, -0.0039995815604925156, -0.003007537918165326, -0.02379562146961689, -0.1605326235294342, -0.026637496426701546, -0.07603659480810165, 0.0646253451704979, -0.01972099021077156, -0.006016095634549856, -0.020657557994127274, -0.07399015873670578, -0.035175010561943054, -0.004415065981447697, 0.015119179151952267, -0.03423582389950752, -4.95778958594105e-33, 0.035924408584833145, 0.052627090364694595, 0.07436927407979965, -0.0487486869096756, -0.028506556525826454, 0.03045572340488434, 0.06939174979925156, 0.04276374727487564, 0.09132718294858932, 0.07135505974292755, 0.015452070161700249, -0.054425351321697235, -0.04283933714032173, -0.007671745028346777, 0.13653476536273956, 0.0058965012431144714, -0.024627670645713806, 0.050779782235622406, -0.02859259769320488, -0.11872492730617523, -0.07262582331895828, -0.005400627385824919, 0.05261010304093361, 0.03537410497665405, -0.018890919163823128, -0.003101842012256384, 0.045761797577142715, -0.028795275837183, -0.08552589267492294, -0.09451180696487427, -0.04226737841963768, 0.00409567030146718, -0.06958620995283127, 0.04766533896327019, -0.01784163899719715, 0.03702607750892639, 0.007316462229937315, -0.02471011132001877, -0.012133502401411533, -0.05810117721557617, 0.00673963688313961, 0.1315891146659851, -0.012015294283628464, 0.0025470126420259476, -0.05735742300748825, 0.00820923037827015, 0.020051442086696625, 0.0736619308590889, -0.018781494349241257, 0.014417292550206184, -0.04728067293763161, 0.07161112874746323, 0.05344707518815994, 0.05357137694954872, -0.016495557501912117, -0.006988764740526676, -0.026327190920710564, 0.0918315201997757, -0.006938716862350702, -0.0402262918651104, -0.02619769051671028, -0.09230587631464005, -0.06224297732114792, -0.008085176348686218, 0.0838584154844284, -0.009104488417506218, -0.07903677225112915, -0.0858333483338356, -0.014232337474822998, 0.07424148917198181, 0.05020182952284813, 0.020154152065515518, -0.07664714753627777, 0.01109384186565876, -0.02123161032795906, 0.005680369213223457, 0.011906049214303493, -0.0071778795681893826, -0.0185344610363245, 0.02041972242295742, 0.06530126929283142, 0.016065392643213272, 0.11649756133556366, 0.09678289294242859, -0.027047351002693176, -0.00400888454169035, -0.021586932241916656, 0.03715059533715248, 0.02829047664999962, -0.04707003012299538, 0.01921824924647808, -0.006497208494693041, -0.03437630087137222, 0.01188402995467186, 0.061567842960357666, -2.723522563030656e-08, -0.05781901255249977, -0.03397291153669357, 0.03839823231101036, -0.051343344151973724, 0.0009548400994390249, 0.07000633329153061, -0.03493405878543854, 0.013171892613172531, 0.0057395887561142445, 0.001703238463960588, 0.04180329665541649, 0.03275472670793533, -0.0998336523771286, -0.012722126208245754, 0.010479260236024857, -0.03146002069115639, -0.0031765305902808905, -0.04856402054429054, 0.020318906754255295, -0.030461283400654793, -0.0025497423484921455, -0.0733981654047966, -0.01862378790974617, 0.034582674503326416, -0.08251883089542389, -0.030729206278920174, -0.033607885241508484, 0.07347316294908524, -0.04246258735656738, 0.004411221947520971, 0.01896020397543907, -0.0661332905292511, 0.03090372309088707, -0.003472032956779003, 0.03568395972251892, 0.009666447527706623, -0.04371084272861481, 0.08328483253717422, 0.018571915104985237, 0.030306534841656685, -0.06271401047706604, 0.05465567484498024, 0.006956739816814661, -0.030690407380461693, 0.02754076011478901, -0.004041107837110758, -0.01313774287700653, -0.00020899057562928647, -0.019583843648433685, -0.045446738600730896, 0.0032856895122677088, 0.04398542642593384, 0.023497657850384712, -0.07566429674625397, -0.05414080247282982, -0.10256379097700119, -0.06485353410243988, 0.02489117905497551, -0.08944867551326752, 0.06567557901144028, 0.01417312677949667, 0.030410854145884514, -0.0068422709591686726, -0.06052546575665474 ] }, { "text": "CV - Pelin Balci\n\n• 🧠\">\n\n•\n\n🧠 Tiny AI World\n\nHome\nAll Notes\nProjects\nCV\nAbout\n\n🌙\n\nCurriculum Vitae\n\nPelin Balci\n\nMSc Industrial Engineer · Senior Lead Machine Learning Engineer\n\nI build production-grade machine learning systems and research Retrieval Augmented Generation, Knowledge Graphs, TinyML, NLP, Large Language Models, and Reinforcement Learning. With a foundation in industrial engineering and a passion for open-source collaboration, I deliver applied AI solutions that balance rigor and real-world impact.\n\nRAG & Knowledge Graphs\nNLP & LLMs\nTinyML\nReinforcement Learning\n\nPortfolio ↗\n\nLocation\nİstanbul, Turkey\n\nExperience\n10+ years\n\nFocus\nML Engineering & Optimization\n\nCommunity\nAYA contributor & mentor\n\nContact\n\nConnect across professional and publishing platforms.", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_0", "embedding": [ -0.037226900458335876, -0.0005706570809707046, -0.0037548670079559088, 0.02028125897049904, 0.047443125396966934, 0.0034727288875728846, 0.017881521955132484, 0.0709327980875969, -0.09539452195167542, 0.006081095430999994, 0.011417245492339134, -0.06346818059682846, 0.02367868274450302, -0.012067855335772038, -0.04136957228183746, 0.1195392906665802, -0.03444113954901695, 0.03448394685983658, -0.022262856364250183, -0.1542150378227234, -0.0546126589179039, 0.022228224202990532, 0.04060705751180649, -0.026084862649440765, -0.012602526694536209, 0.02671940252184868, 0.02349104918539524, 0.05221477523446083, 0.07392138987779617, -0.06366484612226486, -0.013258046470582485, 0.01487282756716013, 0.0682675689458847, 0.025888385251164436, 0.04797390475869179, 0.17755627632141113, -0.008698543533682823, -0.006697224453091621, 0.007805925793945789, -0.04025043919682503, -0.04503205791115761, -0.052046600729227066, -0.0017103932332247496, -0.0796988382935524, 0.09283720701932907, 0.004339085891842842, -0.023178184404969215, -0.08396631479263306, -0.018677957355976105, -0.03096959926187992, -0.10412856936454773, -0.13135333359241486, 0.026901816949248314, -0.05016312748193741, -0.04334203898906708, -0.022206725552678108, -0.011631249450147152, -0.02609044499695301, -0.06099428981542587, -0.05101502686738968, -0.013667897321283817, -0.02511574886739254, -0.042888786643743515, 0.02208574302494526, -0.05674173682928085, 0.0075661130249500275, -0.008769748732447624, 0.10299119353294373, -0.05240175500512123, -0.05776474252343178, 0.0066361203789711, 0.00545627111569047, -0.0607268288731575, 0.10542929172515869, 0.01659812033176422, -0.003160182386636734, 0.0156573336571455, -0.08662357181310654, 0.08640230447053909, 0.004863428883254528, -0.021104542538523674, 0.0198686420917511, -0.07951914519071579, 0.03133552893996239, -0.07777784764766693, -0.022706812247633934, 0.0444953553378582, -0.0161639042198658, 0.11823467165231705, -0.027983615174889565, 0.06095876544713974, 0.048687342554330826, 0.05144597962498665, 0.0274251326918602, 0.02975599840283394, -0.0126832015812397, 0.01930936425924301, -0.08136899769306183, -0.10525847226381302, 0.1046433299779892, -0.012103065848350525, 0.08707568049430847, 0.05012532323598862, 0.036736637353897095, -0.06908831745386124, 0.02332915924489498, 0.04720430076122284, 0.04389575496315956, 0.04657478258013725, -0.06513786315917969, 0.02043568342924118, 0.02596980147063732, -0.02195335365831852, -0.06035469472408295, 0.02999291568994522, -0.002441900549456477, -0.03875802457332611, -0.023458709940314293, -0.0025784263852983713, 0.0192632544785738, -0.06629971414804459, 0.05700603500008583, -0.06743722409009933, 0.059775590896606445, -0.043972160667181015, -0.041305094957351685, -0.028428751975297928, 6.0816955304675784e-33, -0.0034977674949914217, 0.08961260318756104, 0.06917647272348404, 0.07225243747234344, 0.04904939979314804, -0.010868589393794537, 0.028426988050341606, -0.011628362350165844, -0.06485291570425034, -0.03536694869399071, -0.02595893293619156, 0.0396089144051075, -0.0017563244327902794, 0.09611824154853821, 0.034599605947732925, -0.04907853528857231, 0.03064299188554287, -0.023793987929821014, 0.03367287293076515, 0.002133831847459078, 0.007146994583308697, -0.06266872584819794, -0.005728487856686115, 0.0012647024122998118, 0.04835914820432663, 0.017707211896777153, 0.11648928374052048, -0.03652244061231613, 0.06422560662031174, 0.041301969438791275, -0.04804987832903862, 0.08794348686933517, -0.09707682579755783, -0.0504872091114521, 0.012319148518145084, 0.04966028779745102, -0.04046311601996422, -0.08538182079792023, -0.026281917467713356, 0.04126277193427086, -0.04745286703109741, 0.0464860238134861, 0.028413889929652214, -0.07530859112739563, 0.0016234692884609103, -0.04152468964457512, 0.10430768132209778, 0.017189763486385345, 0.08065129071474075, -0.052633821964263916, -0.06450007110834122, 0.01992945931851864, -0.029010791331529617, -0.014599557034671307, 0.06999659538269043, 0.028724832460284233, 0.030635923147201538, 0.0259370319545269, -0.00849565677344799, 0.03214576467871666, 0.05144025757908821, 0.025462308898568153, -0.005857064388692379, -0.006387750618159771, 0.052158139646053314, 0.060196779668331146, -0.003563208971172571, 0.024487918242812157, 0.10302909463644028, 0.008291957899928093, -0.024923071265220642, 0.033256035298109055, 0.03601386025547981, -0.059602994471788406, -0.020931938663125038, -0.019197950139641762, -0.04197927936911583, -0.036378081887960434, 0.024076273664832115, -0.002100038807839155, -0.04305775836110115, 0.07128597795963287, -0.0038140243850648403, -0.031032219529151917, 0.05559532716870308, -0.04349496588110924, -0.005896536633372307, 0.03007594682276249, 0.001936382264830172, 0.03472651541233063, -0.060385044664144516, 0.024757178500294685, 0.017875293269753456, 0.08805502951145172, -0.040187615901231766, -6.1127987436483515e-33, -0.06676129251718521, -0.014446727931499481, -0.03805108368396759, 0.05465521663427353, 0.07764054834842682, -0.014334889128804207, -0.04383550584316254, 0.04534461349248886, 0.04623799026012421, 0.09883212298154831, -0.004794863052666187, -0.06011071801185608, -0.001823447528295219, -0.0323486290872097, -0.004553216975182295, 0.03133498504757881, -0.05997602641582489, -0.029451588168740273, -0.014869690872728825, 0.055888108909130096, 0.02275792881846428, 0.09169307351112366, -0.07121006399393082, 0.03676992282271385, 0.03551099821925163, 0.005009413696825504, 0.0006524743512272835, 0.03649738430976868, -0.030365079641342163, 0.022881092503666878, -0.03122560679912567, -0.08291842043399811, -0.10628900676965714, 0.03976859524846077, 0.005385186988860369, -0.01589859277009964, 0.032614223659038544, -0.04427943378686905, 0.011138278059661388, 0.06853627413511276, 0.05585651844739914, -0.01705961488187313, -0.05620831996202469, -0.08310791105031967, -0.06201719120144844, -0.0382450595498085, -0.04330289363861084, -0.030482009053230286, -0.01242639496922493, -0.10443390905857086, 0.0025779518764466047, 0.0006533606792800128, -0.01635299250483513, -0.09332253038883209, -0.047353945672512054, -0.022300468757748604, 0.07695718109607697, 0.029055994004011154, 0.019813450053334236, 0.013104751706123352, -0.07940765470266342, -0.04801936075091362, 0.03352144733071327, 0.05548062175512314, 0.027174806222319603, -0.01772570051252842, -0.031240027397871017, 0.0747482180595398, -0.09341894835233688, -0.08890941739082336, 0.018447469919919968, 0.030526267364621162, 0.03882776200771332, -0.042396705597639084, -0.03960796073079109, -0.028954796493053436, -0.04933296889066696, -0.0017781227361410856, -0.020951708778738976, -0.022818636149168015, 0.05690504610538483, -0.04589315503835678, 0.017605114728212357, 0.05730432644486427, 0.028190527111291885, 0.057854704558849335, 0.03028271719813347, -0.014838351868093014, 0.03277983516454697, 0.04355631396174431, -0.023728925734758377, 0.03506533429026604, 0.05900685861706734, 0.01151265949010849, -0.07426891475915909, -4.512749285368045e-08, -0.09842825680971146, 0.022329511120915413, -0.0023553958162665367, 0.054422881454229355, -0.003995112143456936, 0.009327368810772896, -0.03856249526143074, -0.0012470078654587269, -0.03955824673175812, 0.02836625464260578, 0.018482495099306107, -0.011621491983532906, -0.023942213505506516, 0.023165680468082428, 0.038424424827098846, 0.01866511069238186, -0.07254812866449356, 0.006679658778011799, -0.0005688383826054633, -0.10857754945755005, 0.1320829689502716, 0.007917625829577446, -0.008744326420128345, 0.03138014301657677, 0.012789693661034107, -0.11120381206274033, -0.046357281506061554, 0.06236441805958748, -0.027549443766474724, -0.0692935660481453, -0.05210011079907417, 0.039825934916734695, -0.009077084250748158, -0.032638609409332275, 0.10602425783872604, 0.0735754668712616, 0.07473467290401459, -0.07983759045600891, -0.05802620202302933, 0.014211706817150116, -0.04638081043958664, 0.028207940980792046, 0.02668149769306183, -0.059030625969171524, 0.017643922939896584, 0.05867648869752884, -0.005613973364233971, -0.13260431587696075, 0.03347861021757126, 0.01404479332268238, 0.04164476320147514, -0.04633806273341179, 0.08031589537858963, 0.09003540128469467, 0.06158795207738876, 0.003141990164294839, 0.008677474223077297, -0.08578938245773315, 0.017373261973261833, 0.021934445947408676, 0.05481142923235893, -0.05720696970820427, -0.03508741408586502, 0.016758587211370468 ] }, { "text": "Focus\nML Engineering & Optimization\n\nCommunity\nAYA contributor & mentor\n\nContact\n\nConnect across professional and publishing platforms.\n\nLinkedIn\nGitHub\nWebsite\nMedium\nYouTube\n\nSkills & Toolbox\n\nHands-on expertise spanning operations research, ML systems, and embedded AI.\n\nCore Domains\n\n• Operations Research, Mathematical Modeling, Simulation\n•\n\n• Machine Learning, Deep Learning, Reinforcement Learning\n•\n\n• Tiny Machine Learning, NLP, LLMs, Prompt Engineering\n•\n\n• Transformers, NER Models, Retrieval Augmented Generation\n•\n\nSoftware & Platforms\n\n• Python (Pandas, NumPy, scikit-learn, Matplotlib, PyTorch, TensorFlow, TensorFlow Lite, SimPy, Streamlit)\n•\n\n• LLM tooling: llama-index, LangChain\n•\n\n• SQL, GAMS, Power BI\n•\n\nExperience", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_1", "embedding": [ -0.04569851979613304, -0.13568967580795288, -0.03204842284321785, 0.04459463059902191, 0.030985282734036446, -0.10823991149663925, -0.0008330950513482094, 0.013475523330271244, -0.11277054250240326, -0.01085173524916172, -0.07230411469936371, -0.013088521547615528, 0.044046759605407715, -0.03945581242442131, 0.0012813708744943142, 0.09971940517425537, 0.005900929681956768, -0.008252372965216637, -0.02572978474199772, -0.12555371224880219, 0.0020396821200847626, 0.02756362594664097, 0.021625172346830368, -0.03487143665552139, 0.029550127685070038, -0.06157683953642845, 0.015549924224615097, -0.02552248351275921, 0.039302632212638855, -0.05162068083882332, -0.039749111980199814, 0.03027261048555374, -0.026340128853917122, 0.01360662654042244, -0.010924803093075752, 0.11111779510974884, -0.023303717374801636, -0.01066989079117775, 0.01674766093492508, -0.02459261566400528, -0.032243762165308, -0.08737686276435852, 0.05726112797856331, -0.1142413541674614, 0.07361346483230591, 0.000717461109161377, -0.0074242884293198586, -0.09887878596782684, 0.03399045392870903, -0.004340872168540955, -0.11386490613222122, -0.1363646239042282, -0.030373189598321915, -0.0020955309737473726, -0.029706377536058426, -0.004780094139277935, 0.04768696427345276, -0.01577596552670002, -0.006330233998596668, -0.021670065820217133, -0.02474808879196644, -0.03172405809164047, -0.025852547958493233, 0.02450801059603691, -0.025688491761684418, -0.03771130368113518, 0.00499555142596364, 0.11180032789707184, 0.008212507702410221, -0.10365082323551178, 0.00926970411092043, -0.019602082669734955, -0.05679367110133171, 0.05136125162243843, 0.0006403863080777228, -0.0020767739042639732, 0.038504473865032196, -0.015866784378886223, 0.11880210787057877, 0.007124000228941441, 0.004955894313752651, 0.024818921461701393, -0.0038554931525141, 0.05240408331155777, -0.06112319976091385, -0.04414268955588341, 0.010795732960104942, 0.0695890411734581, 0.05383409932255745, -0.0038476481568068266, 0.0713498517870903, 0.005813319236040115, 0.04047822207212448, 0.01718040183186531, 0.051483154296875, 0.004658710677176714, 0.03434225544333458, -0.11550316214561462, -0.08412932604551315, 0.06729358434677124, -0.03580794483423233, 0.002059705788269639, 0.00024123398179654032, -0.0254388228058815, -0.09064101427793503, 0.05498748645186424, 0.028443286195397377, 0.0921124815940857, 0.10666339099407196, -0.04107535630464554, 0.025816498324275017, 0.03387678414583206, -0.007324528880417347, -0.02479555457830429, 0.022666802629828453, -0.0417969636619091, 0.00827874056994915, -0.011541656218469143, 0.042938169091939926, 0.06731615960597992, -0.06100345402956009, 0.09337548166513443, -0.028574900701642036, -0.01304580643773079, 0.01650858484208584, -0.01231494452804327, -0.09792975336313248, 2.1750618293776114e-33, 0.003213902236893773, -0.0033460359554737806, -0.010599881410598755, 0.03351902961730957, 0.07722506672143936, -0.00850047916173935, 0.03380228579044342, 0.009732347913086414, -0.03753001615405083, -0.047491367906332016, -0.051652517169713974, 0.11722192168235779, -0.05155222490429878, 0.12072764337062836, 0.03519100323319435, -0.06864223629236221, 0.02822154015302658, 0.010335578583180904, -0.03965923562645912, -0.004926988389343023, 0.019732335582375526, -0.00919196754693985, -0.014750721864402294, 0.05455135926604271, 0.062223806977272034, 0.008484147489070892, 0.016575122252106667, -0.07316362857818604, 0.02839772403240204, 0.0422530435025692, -0.12080679088830948, 0.031971290707588196, -0.09439589828252792, -0.021399235352873802, 0.024141060188412666, 0.06488538533449173, -0.022600991651415825, -0.06475193053483963, -0.015722837299108505, 0.033040840178728104, -0.07314223796129227, 0.04504472017288208, 0.020350109785795212, -0.04182039201259613, -0.029364097863435745, 0.013942182995378971, 0.07672778517007828, 0.01778998412191868, 0.09773331880569458, -0.024848664179444313, -0.06879062205553055, -0.0459136925637722, 0.008411996066570282, 0.0189270731061697, 0.01796111650764942, 0.06985928863286972, 0.02556375414133072, 0.01815938390791416, 0.009518911130726337, 0.035583045333623886, -0.040199633687734604, 0.03164379671216011, 0.026837926357984543, -0.020455269142985344, 0.005912110675126314, -0.0023125712759792805, 0.018247470259666443, 0.01554152462631464, 0.09191157668828964, 0.005441346205770969, -0.013809172436594963, 0.06993760913610458, 0.0606904998421669, -0.018186304718255997, -0.032675325870513916, -0.03832027688622475, 0.0019575105980038643, -0.06993591785430908, 0.02961128018796444, 0.029530398547649384, 0.024315109476447105, 0.08380937576293945, 0.0017621511360630393, -0.0811346173286438, 0.0660136267542839, -0.03239629417657852, -0.03252851217985153, -0.005918591283261776, -0.05567595362663269, -0.0363461896777153, -0.04575655981898308, 0.022974394261837006, 0.02856486476957798, 0.0648035854101181, -0.06751085072755814, -2.8845044451805325e-33, -0.09525501728057861, 0.0001474550663260743, 0.0064166393131017685, 0.11504361033439636, 0.10050289332866669, -0.007682286202907562, -0.008277742192149162, -0.05780312046408653, 0.019062206149101257, 0.016090186312794685, -0.033697616308927536, -0.018108373507857323, -0.011487400159239769, 0.02235536463558674, -0.033783942461013794, -0.029275497421622276, -0.08440348505973816, -0.0649319440126419, -0.03725166618824005, 0.005434337537735701, -0.002896681195124984, 0.06711256504058838, -0.08050770312547684, 0.026422344148159027, 0.06467349827289581, -0.013485748320817947, -0.005953317973762751, 0.018812470138072968, 0.014517727307975292, 0.052998896688222885, 0.005792013835161924, -0.000967452593613416, -0.055309951305389404, -0.00775168975815177, 0.007260038051754236, 0.06687858700752258, 0.07456737756729126, -0.007562702056020498, 0.02338586561381817, 0.010678492486476898, 0.12619198858737946, -0.013805688358843327, 0.013368765823543072, -0.054574981331825256, -0.031112555414438248, 0.018484093248844147, -0.08734593540430069, 0.02834554761648178, 0.025005832314491272, -0.10878076404333115, -2.097652031807229e-05, -0.0652848482131958, 0.04657778516411781, -0.06739002466201782, -0.037266552448272705, -0.02962086908519268, 0.06626297533512115, -0.0015604025684297085, 0.012408360838890076, 0.0036628618836402893, -0.04687127470970154, -0.05405348539352417, 0.0706886276602745, 0.051897525787353516, -0.02374936081469059, -0.025516266003251076, -0.0027408557943999767, 0.05877068266272545, -0.15487338602542877, -0.07794740796089172, 0.03397591412067413, 0.011277396231889725, 0.0560903400182724, -0.040676459670066833, -0.05898946896195412, 0.01614261232316494, -0.03507193177938461, -0.04301232099533081, -0.029770899564027786, -0.033271193504333496, 0.04625741392374039, 0.01464535016566515, -0.005002941936254501, 0.050944238901138306, 0.0005826949491165578, 0.10756179690361023, 0.0929504856467247, 0.05545889586210251, 0.004912037868052721, -0.07105732709169388, -0.08865819126367569, 0.033903393894433975, 0.014043193310499191, 0.009983804076910019, -0.06037573888897896, -4.824466515174208e-08, -0.043725766241550446, 0.02946888841688633, 0.013067670166492462, 0.009907558560371399, 0.013248910196125507, 0.042277101427316666, -0.006759801413863897, 0.06365474313497543, -0.020910823717713356, 0.0031290629412978888, 0.05673356354236603, -0.044281620532274246, -0.07901380956172943, 0.04905597120523453, 0.1334059089422226, 0.02523256093263626, -0.007509327027946711, 0.020128820091485977, -0.008499989286065102, -0.12241644412279129, 0.09196873754262924, 0.023453637957572937, 0.03459363058209419, 0.006785125937312841, -0.017382735386490822, -0.085123211145401, -0.021818339824676514, 0.08564497530460358, 0.03585251048207283, -0.03043399006128311, -0.06099223345518112, 0.0002238419110653922, -0.00916836317628622, -0.018123812973499298, 0.0462486557662487, 0.013761158101260662, 0.03252969682216644, -0.07454346120357513, -0.025662926957011223, 0.029407894238829613, -0.07344003766775131, 0.04021025821566582, 0.07471553236246109, -0.038293689489364624, -0.004827470052987337, 0.029307765886187553, 0.0007938027265481651, -0.041756484657526016, -0.0014343023067340255, -0.0031724078580737114, 0.022135989740490913, -0.04903170466423035, -0.00800947193056345, 0.1091969758272171, 0.11476492136716843, 0.04497527331113815, 0.0135617321357131, -0.02537987008690834, 0.035380274057388306, 0.06504683196544647, 0.05432954430580139, -0.025246448814868927, -0.04954657331109047, 0.06668219715356827 ] }, { "text": "• LLM tooling: llama-index, LangChain\n•\n\n• SQL, GAMS, Power BI\n•\n\nExperience\n\nFrom ML engineering leadership to analytics and optimization roles.\n\n2024 – Present\n\nSenior Lead Machine Learning Engineer · Arçelik Global\n\n• Text classification pipelines with AWS deployment.\n•\n\n• RAG initiatives: knowledge graphs and metadata extraction.\n•\n\n2023\n\nLead Data Scientist / ML Engineer · SabancıDx\n\n• Azure OpenAI GPT project compiling keynote speech content.\n•\n\n• Web/App automation using NLP and GPT models.\n•\n\n• Air handling unit energy optimization with reinforcement learning.\n•\n\n2022\n\nSr. Data Scientist / ML Engineer · SabancıDx\n\n• Retail demand prediction and productionization.\n•\n\n2020 – 2022\n\nData Scientist / ML Engineer · SabancıDx", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_2", "embedding": [ -0.0765952318906784, -0.029129769653081894, 0.002069897949695587, 0.04639352485537529, 0.018954627215862274, -0.06213934347033501, -0.023708194494247437, -0.043615687638521194, -0.08935872465372086, 0.002707539824768901, -0.08231612294912338, -0.025617804378271103, 0.03878680616617203, -0.049894873052835464, 0.006499859504401684, 0.06456192582845688, -0.009341569617390633, -0.019204623997211456, -0.027608515694737434, -0.13425299525260925, -0.004003893118351698, 0.06159203499555588, -0.00616862066090107, -0.019152291119098663, 0.03051673248410225, 0.013800377026200294, 0.030956638976931572, 0.03906593099236488, -0.00046973314601927996, -0.026702849194407463, -0.04966644570231438, -0.04822191596031189, 0.030683275312185287, 0.08211789280176163, -0.026721296831965446, 0.09627291560173035, -0.029448891058564186, -0.022332552820444107, 0.020056508481502533, -0.03671230003237724, -0.0005729867843911052, -0.07998236268758774, -0.0014254074776545167, -0.05933956801891327, 0.054258108139038086, -0.019725605845451355, -0.04814469814300537, -0.10616713762283325, -0.057184137403964996, 0.04396488517522812, -0.062439147382974625, -0.12327723950147629, -0.049919355660676956, -0.011526642367243767, -0.04965389147400856, 0.033387571573257446, 0.04713732376694679, -0.029123220592737198, 0.031627021729946136, -0.06459828466176987, -0.038245610892772675, -0.09136577695608139, -0.016242150217294693, 0.018955983221530914, -0.016535673290491104, -0.015053155831992626, -0.037857454270124435, 0.08533421158790588, 0.014279857277870178, -0.0511307492852211, 0.032617054879665375, -0.014221127144992352, -0.0539514385163784, -0.0038819164037704468, -0.016902657225728035, 0.019116047769784927, 0.06014621630311012, 0.013509593904018402, 0.10055495798587799, 0.007810372393578291, 0.01670633815228939, 0.01074861641973257, -0.04280214384198189, 0.08805260062217712, -0.06055975332856178, -0.045416343957185745, -0.03086186572909355, 0.05221369117498398, 0.023059433326125145, 0.0003056121931876987, 0.011738802306354046, -0.05723760277032852, 0.0711909607052803, 0.03230096027255058, -0.04874484986066818, 0.015991875901818275, -0.06649554520845413, -0.07041674852371216, -0.07637673616409302, 0.025196412578225136, -0.015498836524784565, 0.03786748647689819, 0.0030031416099518538, 0.009073257446289062, -0.08249134570360184, -0.0010793436085805297, 0.021947776898741722, 0.059802014380693436, 0.032062187790870667, -0.05485972762107849, 0.030247924849390984, 0.023270178586244583, -0.04714180529117584, -0.04988739266991615, 0.050037894397974014, 0.024499574676156044, -0.0593155175447464, 0.025151805952191353, -0.015064693987369537, 0.08776412904262543, -0.02591731585562229, 0.05053091049194336, -0.006663027219474316, -0.0314558781683445, -0.001969823380932212, -0.02461870387196541, -0.07038230448961258, 3.077913489838116e-33, 0.026009321212768555, 0.0058581470511853695, 0.005605149548500776, -0.007438556756824255, 0.0908893346786499, 0.023905685171484947, 0.059050269424915314, 0.04953749477863312, -0.009184252470731735, -0.034036893397569656, -0.009143471717834473, 0.09129155427217484, -0.052722856402397156, 0.07018812000751495, 0.0012274624314159155, -0.02319716289639473, 0.04387245699763298, 0.050696153193712234, -0.04192043095827103, -0.03763201832771301, 0.04941888526082039, -0.04742054268717766, 0.039867423474788666, 0.0077854846604168415, 0.0402659997344017, 0.008604191243648529, 0.07097981870174408, -0.01624421775341034, 0.03413820266723633, 0.05786767229437828, -0.019032668322324753, 0.004583641886711121, -0.06882201135158539, 0.03297877684235573, -0.025178872048854828, 0.03710576891899109, -0.08544427901506424, -0.06779132783412933, 0.03196966275572777, 0.09401335567235947, -0.08552132546901703, 0.04232880845665932, 0.06227593496441841, -0.03864166513085365, -0.03919476643204689, 0.025262683629989624, 0.06863682717084885, 0.002074905438348651, 0.11504343152046204, 0.044005002826452255, -0.13230343163013458, -0.03531257063150406, 0.04792820289731026, 0.012907934375107288, 0.06703001260757446, 0.033521994948387146, 0.10600747168064117, -0.025099409744143486, -0.005746133159846067, 0.0008571372600272298, -0.08487498015165329, 0.04168307036161423, -0.026368776336312294, 0.06900748610496521, -0.017955053597688675, 0.015799960121512413, 0.029912110418081284, 0.023674096912145615, 0.09186825901269913, 0.001192436902783811, 0.013432511128485203, -0.0032992418855428696, 0.06134899705648422, 0.014551335014402866, -0.01118150819092989, -0.017499132081866264, 0.04552237689495087, -0.04037294164299965, 0.03842702507972717, 0.03782626613974571, -0.0515030138194561, 0.044487759470939636, 0.037566229701042175, -0.07190073281526566, -0.003349472302943468, -0.012859337963163853, 0.02440176159143448, -0.058745045214891434, 0.003428483149036765, 0.060738228261470795, -0.0881221666932106, -0.01301308162510395, -0.030585208907723427, 0.08516611158847809, -0.08623713999986649, -3.5701736060930345e-33, -0.062120478600263596, 0.08349116891622543, -0.03400038927793503, 0.07707681506872177, 0.10876280814409256, 0.002112391870468855, 0.02392323687672615, 0.0030143349431455135, 0.02370496839284897, 0.03234004229307175, 0.037838298827409744, 0.023162776604294777, 0.00304840668104589, 0.0288879182189703, 0.00783478282392025, -0.0020583909936249256, -0.014368945732712746, -0.11036112904548645, -0.04954175278544426, 0.030302375555038452, -0.040431033819913864, 0.08560715615749359, -0.1248670145869255, 0.04168647900223732, 0.04189811274409294, -0.004445722326636314, -0.02398056350648403, 0.0047010816633701324, -0.0005091761122457683, -0.0018201051279902458, -0.02372206375002861, 0.032166626304388046, -0.06686490029096603, 0.00828599464148283, -0.05568249151110649, -0.03365009278059006, 0.053452808409929276, 0.018938643857836723, 0.0021385045256465673, 0.08942394703626633, 0.10923468321561813, -0.0668778121471405, 0.012799528427422047, -0.054400935769081116, -0.05394363775849342, -0.009027962572872639, -0.03731785714626312, 0.012269513681530952, -0.013912289403378963, -0.08342265337705612, -0.03081250749528408, 0.03036721982061863, -0.0729164406657219, 0.002705708844587207, -0.021313613280653954, -0.034599609673023224, 0.020812783390283585, 0.0019481014460325241, -0.09604880958795547, -0.0206996351480484, 0.010186322964727879, 0.011643077246844769, 0.14499187469482422, 0.010516824200749397, -0.019457902759313583, -0.044354017823934555, 0.051049649715423584, 0.03179061785340309, -0.11413756012916565, -0.05554415285587311, 0.009213022887706757, -0.03752180188894272, -0.0247478224337101, -0.03270470350980759, -0.10169187188148499, -0.01023175846785307, -0.10022561252117157, -0.06037675216794014, -0.009031214751303196, -0.06421922892332077, 0.007898085750639439, 0.02500004880130291, 0.014078335836529732, 0.06761793792247772, 0.042024094611406326, 0.0500527024269104, 0.06130152568221092, 0.019737908616662025, 0.04219404608011246, -0.02789420448243618, -0.12112725526094437, -0.010890192352235317, -0.0315529890358448, 0.04074946418404579, -0.05463116988539696, -4.140352416470705e-08, -0.08826588094234467, 0.03195992112159729, -0.022547967731952667, 0.032408200204372406, 0.010186050087213516, -0.006146885454654694, -0.038254525512456894, 0.08628271520137787, 0.05191528797149658, 0.018717844039201736, 0.04987464100122452, -0.06067909672856331, -0.038701724261045456, 0.019462604075670242, 0.07856457680463791, 0.015064249746501446, -0.010863978415727615, 0.06597127765417099, -0.022133171558380127, -0.15756970643997192, 0.06500820815563202, 0.056666865944862366, 0.01385573111474514, -0.00747715774923563, 0.02208801545202732, -0.0415068045258522, -0.060777775943279266, 0.03687416762113571, 0.0182130578905344, 0.02221551351249218, -0.03740460053086281, -0.029293673112988472, -0.010619698092341423, -0.03276696056127548, 0.10024600476026535, 0.053485214710235596, 0.06711407005786896, -0.09273190051317215, 0.003418711479753256, 0.06275542825460434, -0.023368095979094505, 0.05567874014377594, -0.0065137785859405994, 0.034855954349040985, -0.026568695902824402, -0.015253877267241478, -0.025228401646018028, -0.028855521231889725, 0.0051122005097568035, 0.02131868153810501, 0.038042377680540085, -0.009903314523398876, -0.033821456134319305, 0.0652485117316246, 0.12466919422149658, 0.07035781443119049, 0.06081811338663101, -0.08102203160524368, -0.03322366252541542, 0.10784423351287842, 0.0896226242184639, -0.11898181587457657, -0.04587458446621895, 0.02400621399283409 ] }, { "text": "• Retail demand prediction and productionization.\n•\n\n2020 – 2022\n\nData Scientist / ML Engineer · SabancıDx\n\n• Production breakage prediction and sensor recommendation.\n•\n\n• IOT air quality product; monitoring with Power BI and Python.\n•\n\n• Energy imbalance direction prediction on Databricks.\n•\n\n• Delivery optimization: simulation with SimPy and staffing optimization with Gurobi.\n•\n\n2019 – 2020\n\nSr. Data Analyst · Adphorus (Sojern)\n\n• Algorithm performance reporting and A/B testing for digital marketing.\n•\n\n2017 – 2019\n\nCommodity Portfolio Management Specialist · Enerjisa Sales\n\n• Built mark-to-market reporting, hedging strategies, and demand analyses.\n•\n\n2015 – 2017\n\nPortfolio Optimization Specialist · Enerjisa Trading", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_3", "embedding": [ -0.07452765107154846, 0.012517230585217476, -0.040840595960617065, 0.042185209691524506, -0.026118837296962738, -0.0908793956041336, 0.017922189086675644, 0.029366012662649155, -0.13346576690673828, 0.01276075467467308, -0.03259824961423874, -0.03534149006009102, -0.01277871709316969, -0.035914622247219086, -0.0017266166396439075, -0.018756849691271782, 0.038576480001211166, -0.026164919137954712, -0.0025742684956640005, -0.11720816791057587, -0.001231241854839027, 0.0010042606154456735, -0.04858601465821266, -0.02455451898276806, 0.037485670298337936, -0.03659529611468315, 0.004763599950820208, 0.022279536351561546, -0.06075214594602585, -0.049723293632268906, 0.0010755512630566955, 0.0034406965132802725, 0.005245506297796965, -0.001375663443468511, 0.015440620481967926, 0.05424198880791664, -0.027683788910508156, 0.0053154053166508675, 0.03266686946153641, -0.0030082520097494125, -0.03510168194770813, -0.10031354427337646, -0.08071091026067734, -0.05194764956831932, 0.02287433110177517, -0.04284936562180519, -0.011745830997824669, 0.009664459154009819, 0.009929249063134193, 0.028539448976516724, -0.1640862673521042, -0.012074746191501617, -0.019158225506544113, -0.08991725742816925, -0.022414809092879295, -0.05060513690114021, 0.007695777807384729, -0.05106295645236969, 0.03536601364612579, 0.009550894610583782, 0.021389851346611977, -0.06673663854598999, 0.009310751222074032, 0.050096552819013596, 0.021134410053491592, -0.0642785131931305, -0.055918965488672256, 0.10752914845943451, -0.06602413952350616, 0.01577376201748848, 0.035050392150878906, -0.04629865288734436, -0.11419127881526947, -0.034906335175037384, -0.02698564901947975, 0.03736025467514992, 0.07669088244438171, -0.013932463712990284, 0.04212375730276108, -0.038467004895210266, 0.012133251875638962, -0.009684471413493156, -0.047939497977495193, -0.01759563758969307, -0.06351736932992935, -0.0397147499024868, 0.039720870554447174, 0.021608049049973488, 0.08528212457895279, 0.00385591434314847, 0.08793273568153381, -0.0020221632439643145, 0.0278010256588459, 0.06963935494422913, -0.0741250142455101, 0.013458839617669582, -0.038882456719875336, -0.019176362082362175, -0.03539391607046127, 0.006385291460901499, 0.029258722439408302, 0.02760007604956627, 0.04175620898604393, -0.0009022036101669073, -0.10173884779214859, -0.1210789680480957, 0.05843376740813255, -0.03000408597290516, 0.020733823999762535, -0.01419589389115572, -0.04777210205793381, 0.0435684435069561, -0.07303018867969513, -0.11044742166996002, -0.01632821559906006, 0.08119269460439682, -0.07353711128234863, 0.012834451161324978, -0.014793159440159798, 0.08185318857431412, 0.0027590233366936445, 0.051027897745370865, 0.02338983863592148, 0.034627918154001236, -0.010050547309219837, 0.0331171452999115, -0.0235064048320055, 3.272780514832704e-33, -0.11556859314441681, -0.025401456281542778, 0.03455473855137825, -0.026763536036014557, -0.03214539214968681, 0.023112673312425613, 0.030429668724536896, 0.008880682289600372, 0.00679800845682621, -0.03363579884171486, -0.001321825198829174, 0.06148064509034157, -0.0506434291601181, 0.08759094774723053, 0.01661739870905876, -0.026598211377859116, -0.0004278041305951774, 0.04158444330096245, 0.037662409245967865, -0.015478379093110561, 0.012524987570941448, -0.09567505866289139, -0.06096577271819115, 0.020924480631947517, 0.025671545416116714, 0.01826714538037777, 0.08916239440441132, -0.02004762552678585, 0.0007301309378817677, 0.05212054029107094, 0.045276492834091187, 0.013301245868206024, -0.06667299568653107, -0.018839001655578613, -0.06799214333295822, 0.022003423422574997, -0.0618000328540802, -0.05968398600816727, -0.009795356541872025, 0.049630120396614075, -0.07841871678829193, 0.06794904917478561, 0.008656442165374756, -0.044663216918706894, -0.10064896941184998, 0.014944694004952908, 0.06449182331562042, 0.033498942852020264, 0.07906680554151535, 0.0228628758341074, -0.13180845975875854, -0.04829387739300728, 0.021026792004704475, 0.03601832687854767, 0.021751271560788155, 0.07310767471790314, 0.026265209540724754, -0.11133496463298798, 0.018610190600156784, -0.00824573915451765, -0.07019045203924179, 0.0038550773169845343, 0.021313929930329323, -0.05275614559650421, -0.0365372933447361, 0.02026197500526905, 0.053331851959228516, -0.0028255947399884462, -0.0049171773716807365, 0.08441994339227676, 0.016612239181995392, -0.04501896724104881, 0.08634114265441895, 0.03469451144337654, 0.02010231837630272, -0.03384781628847122, -0.034687064588069916, 0.10674822330474854, -0.024408776313066483, 0.04255246743559837, -0.002733232919126749, 0.06379413604736328, 0.06352201104164124, -0.07113061845302582, 0.02760426141321659, -0.012065581977367401, 0.045794639736413956, -0.005098750349134207, 0.006216004956513643, 0.0386791005730629, -0.04868488386273384, 0.05993063375353813, -0.035147443413734436, 0.07627653330564499, -0.013861832208931446, -5.36676280503334e-33, -0.07737784832715988, 0.09508861601352692, -0.043410513550043106, 0.06397946923971176, 0.027713879942893982, -0.02495003119111061, -0.00798613391816616, 0.018715444952249527, 0.044206421822309494, 0.05334475263953209, -0.02411973848938942, -0.038014866411685944, 0.009304051287472248, -0.016807183623313904, -0.03048250451683998, 0.0040770587511360645, 0.0062772356905043125, -0.05118761956691742, -0.027681702747941017, -0.04001292213797569, -0.08851588517427444, 0.05496615543961525, -0.09219782054424286, 0.05759437754750252, -0.0359409861266613, 0.03477690368890762, 0.016179310157895088, 0.005906341131776571, -0.06855206936597824, -0.026626411825418472, -0.04904310405254364, 0.00481472909450531, -0.052813585847616196, 0.08982420712709427, -0.031813520938158035, -0.004656744189560413, 0.031733084470033646, 0.0036249870900064707, 0.05748217552900314, 0.12532971799373627, 0.07386811077594757, 0.04171627387404442, 0.03707345575094223, 0.00491289421916008, -0.026508281007409096, -0.010670321993529797, 0.0071044922806322575, -0.018056446686387062, 0.1032566949725151, -0.06941519677639008, -0.005824497435241938, 0.08185064047574997, -0.07385485619306564, 0.006722436286509037, -0.03532731905579567, 0.028003066778182983, 0.026938563212752342, 0.014889874495565891, -0.11065199971199036, -0.0002653679985087365, 0.06748192012310028, 0.058262892067432404, 0.13032026588916779, 0.01724960096180439, -0.027656909078359604, -0.04122896492481232, 0.03241697698831558, -0.06828697770833969, 0.027953488752245903, -0.0857265442609787, -0.015408157370984554, -0.028858643025159836, 0.06583751738071442, -0.022605009377002716, -0.09581883996725082, -0.0008832465391606092, -0.048981789499521255, -0.008605804294347763, 0.019886929541826248, -0.023321399465203285, -0.044923923909664154, 0.06518372893333435, 0.018247121945023537, 0.06918895989656448, 0.009300206787884235, 0.00795625988394022, 0.00902232713997364, 0.017331980168819427, 0.03593159094452858, -0.042111072689294815, -0.06099657341837883, -0.03107628971338272, 0.011813768185675144, 0.04780528321862221, 0.0017236600397154689, -4.932041619554184e-08, -0.03275575116276741, -0.10277249664068222, 0.06994959712028503, 0.015400146134197712, -0.017466379329562187, 0.013160854578018188, 0.0056824516505002975, 0.015446758829057217, 0.037530697882175446, 0.02103097178041935, 0.08393122255802155, -0.0195331871509552, -0.12644456326961517, 0.06549042463302612, 0.04192580282688141, -0.04125981032848358, 0.02872604876756668, 0.09601946920156479, -0.028581660240888596, -0.08199968189001083, 0.06992734968662262, 0.053776029497385025, 0.019732316955924034, -0.021461043506860733, 0.07570922374725342, 0.02908112294971943, 0.0108117014169693, 0.04158088564872742, 0.09566306322813034, 0.0041632018983364105, -0.051617205142974854, -0.03563941270112991, 0.024983244016766548, -0.04784794896841049, 0.0400688536465168, 0.07303841412067413, -0.007444713264703751, -0.012912489473819733, -0.02914668619632721, 0.07506196945905685, -0.083475761115551, 0.01637885719537735, -0.01719445176422596, 0.01754767633974552, 0.022719377651810646, 0.01590167172253132, -0.07200277596712112, 0.01253425981849432, 0.04045145586133003, -0.028556685894727707, -0.008055462501943111, -0.03915531188249588, 0.08677701652050018, 0.02626936510205269, 0.09053752571344376, 0.0539998896420002, -0.04944853112101555, -0.02134346403181553, -0.013834322802722454, 0.027782291173934937, 0.07487079501152039, -0.11269069463014603, -0.1370316445827484, 0.09169496595859528 ] }, { "text": "• Built mark-to-market reporting, hedging strategies, and demand analyses.\n•\n\n2015 – 2017\n\nPortfolio Optimization Specialist · Enerjisa Trading\n\n• Power generation optimization tools and long-term portfolio planning.\n•\n\n2013 – 2015\n\nProject Management Specialist · MilSOFT Software Technologies\n\n• Software project management (CMMI5, Agile/Scrum), risk management, and HR analytics.\n•\n\n2010 – 2012\n\nTeaching Assistant · Bilkent University\n\n• Industrial Engineering Department teaching and academic support.\n•\n\nProjects\n\nSelected personal and live applications.\n\nLive Apps\n\n• Apps Portfolio\n•\n\n• Movie Recommendation\n•\n\n• EasyOCR (Hugging Face Space)\n•\n\n• Language Detection (Hugging Face Space)\n•\n\nResearch & Engineering\n\n• Information Extraction from Pathology Reports\n•", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_4", "embedding": [ -0.042924974113702774, -0.007118487264961004, -0.02764417976140976, 0.02199818752706051, 0.02602192759513855, -0.04260319098830223, 0.005449282005429268, 0.10212811827659607, -0.0944717526435852, 0.027496078982949257, -0.01985219679772854, -0.03575636446475983, -0.004912888165563345, 0.07375291734933853, -0.07807642966508865, 0.004065011162310839, 0.004883653484284878, -0.008482975885272026, 0.0568176694214344, -0.04806455224752426, -0.019027449190616608, 0.05664060264825821, 0.04117375612258911, -0.027271324768662453, 0.003237574826925993, -0.02938351221382618, -0.06710939109325409, -0.04002849757671356, -0.03611502796411514, -0.016002271324396133, 0.00519686471670866, 0.030267711728811264, 0.015778128057718277, -0.03943948820233345, 0.04368581622838974, 0.11131152510643005, -0.02954781986773014, 0.053639814257621765, -0.04885711520910263, 0.012391851283609867, -0.10077840834856033, -0.07385159283876419, 0.013986187055706978, -0.03679818660020828, 0.06366081535816193, -0.15071897208690643, -0.07270917296409607, -0.028660204261541367, 0.055851370096206665, 0.029674461111426353, -0.14937210083007812, -0.11643441021442413, -0.005539573263376951, -0.026559945195913315, -0.061377305537462234, -0.014933857135474682, -0.0335344597697258, -0.03724740818142891, -0.04722902551293373, 0.020408865064382553, -0.03207525610923767, -0.004865297116339207, 0.013081114739179611, 0.06923403590917587, -0.023036032915115356, -0.026024315506219864, -0.01804981753230095, 0.06096751242876053, 0.030456209555268288, 0.05362636595964432, -0.004194832406938076, -0.04121026024222374, -0.05994478240609169, 0.047314926981925964, 0.025955060496926308, 0.02142701856791973, 0.026726683601737022, 0.01658000983297825, 0.11896765977144241, -0.048153575509786606, -0.0005478070816025138, 0.01718057319521904, 0.024487966671586037, 0.0393851175904274, -0.04196903109550476, -0.015424476936459541, 0.013731895945966244, 0.021104946732521057, 0.00478621618822217, 0.04837233945727348, 0.0405830442905426, -0.026515109464526176, 0.04461078718304634, 0.028529316186904907, -0.05493102967739105, -0.052902817726135254, -0.044589072465896606, -0.011202123016119003, -0.0574033223092556, 0.028125710785388947, -0.05589970201253891, -0.0728648379445076, 0.04815523326396942, 0.004233145620673895, -0.09107762575149536, -0.052986789494752884, 0.014537961222231388, 0.015730923041701317, 0.05546204373240471, 0.01715807244181633, 0.02300935797393322, 0.059182967990636826, -0.08274225145578384, -0.09709156304597855, 0.06661701947450638, 0.02187466062605381, -0.09160403162240982, -0.022495880722999573, 0.040558844804763794, 0.14194491505622864, -0.00479799835011363, 0.008896869607269764, -0.02169892191886902, -0.109282486140728, -0.0018639032496139407, 0.025883298367261887, -0.054048243910074234, 3.101949961589532e-33, 0.04984963312745094, 0.01101599633693695, 0.03279195353388786, 0.038674063980579376, -0.03837134689092636, 0.014313556253910065, -0.0008486991282552481, 0.05193982645869255, -0.014460581354796886, -0.06087709218263626, 0.04726644977927208, 0.1278190314769745, 0.0007263321313075721, 0.09607420861721039, 0.005357437301427126, 0.006783291231840849, -0.0554761178791523, 0.15671418607234955, -0.0035198668483644724, -0.0015289941802620888, -0.03950975462794304, -0.08842848986387253, -0.0003888685314450413, -0.006604286376386881, 0.021024007350206375, 0.018868152052164078, -0.008139095269143581, -0.035906508564949036, 0.022665148600935936, 0.026041945442557335, -0.06196564808487892, 0.01609147898852825, -0.010742914862930775, -0.09996166080236435, -0.036566052585840225, 0.06932290643453598, -0.02656533755362034, -0.1140337735414505, 0.0369248129427433, 0.06140336021780968, -0.024032818153500557, 0.05982187017798424, 0.007167962845414877, -0.04645989462733269, 0.01213599182665348, 0.029301080852746964, 0.04950496554374695, 0.022196657955646515, -0.023877186700701714, -0.005209939554333687, -0.027755415067076683, 0.014658031053841114, 0.01133640669286251, 0.010778864845633507, -0.031019575893878937, 0.08022946119308472, 0.009024491533637047, -0.07092461735010147, 0.03329409286379814, 0.03321773558855057, 0.07495450973510742, 0.0218045674264431, 0.016074499115347862, -0.019931750372052193, 0.018721625208854675, -0.012975988909602165, 0.05581618845462799, -0.020018670707941055, 0.008617828600108624, 0.0389622300863266, -0.05786418169736862, 0.024520451202988625, 0.09438233077526093, -0.034024663269519806, -0.007315313909202814, -0.005289415828883648, -0.01319166924804449, 0.0013587720459327102, -0.07085021585226059, 0.06335635483264923, -0.02571946009993553, 0.06198754534125328, -0.002262746449559927, -0.04134438559412956, 0.05365601181983948, 0.07591505348682404, -0.013062571175396442, -0.051705677062273026, -0.05401461198925972, 0.008716206066310406, 0.02618963085114956, 0.0004106467531528324, -0.04674823209643364, 0.07597341388463974, -0.07766115665435791, -4.526405567050333e-33, -0.05666857212781906, 0.0014926885487511754, -0.003006178652867675, -0.06119725853204727, 0.07436822354793549, -0.03229864314198494, -0.05117526650428772, 0.034001607447862625, 0.07286537438631058, 0.03665972873568535, 0.011890514753758907, -0.027262626215815544, -0.05053335055708885, -0.05972811579704285, -0.06663358956575394, -0.02558603510260582, -0.02672809362411499, -0.04089262709021568, -0.06948834657669067, 0.003822640050202608, -0.002623701933771372, 0.08019742369651794, -0.035765815526247025, 0.031036334112286568, -0.03124908357858658, 0.068886399269104, -0.010435347445309162, -0.04118560999631882, -0.015101536177098751, -0.036961231380701065, 0.013878223486244678, 0.021839790046215057, -0.0815814957022667, -0.026755690574645996, -0.032960910350084305, 0.035720109939575195, -0.043104421347379684, -0.09676928073167801, 0.05069693550467491, 0.06097899004817009, 0.11209312081336975, -0.01559344120323658, -0.0006737426156178117, -0.004474963527172804, 0.019149700179696083, -0.004710446111857891, -0.04968448728322983, -0.017202163115143776, 0.09938438981771469, -0.026891283690929413, -0.005817623343318701, 0.03998105227947235, -0.04758014529943466, -0.04279383271932602, -0.052551575005054474, -0.05999695509672165, 0.01307965163141489, -0.038127556443214417, -0.06728922575712204, 0.030371708795428276, 0.04801368713378906, 0.07545636594295502, -0.03964011371135712, 0.06479419767856598, 0.017260951921343803, 0.033576421439647675, 0.029860198497772217, -0.04999399185180664, -0.10492239892482758, -0.05447768792510033, 0.015408966690301895, -0.017952559515833855, 0.004195782821625471, -0.015347341075539589, -0.06294726580381393, 0.04502677172422409, 0.023570964112877846, -0.05028851702809334, -0.05463380739092827, -0.001081936527043581, -0.008181264623999596, -0.111152783036232, 0.07473836839199066, 0.07692541182041168, -0.004266919568181038, 0.01536499708890915, -0.061647139489650726, -0.026881709694862366, -0.023247262462973595, -0.030987953767180443, -0.05952346697449684, -0.02405734173953533, 0.02095765434205532, -0.020079677924513817, -0.01229542400687933, -5.150383586283169e-08, 0.0007450044504366815, -0.05302226170897484, 0.02701394446194172, -0.03288190811872482, -0.045453839004039764, 0.00797878485172987, -0.1098514199256897, 0.07089710980653763, 0.07812809199094772, 0.031252771615982056, -0.015922728925943375, -0.01322016492486, -0.1031491756439209, 0.010680865496397018, 0.0684666559100151, -0.01341145858168602, -0.01283367071300745, 0.1256844848394394, -0.04346408322453499, -0.1175357922911644, -0.0018392401980236173, 0.02157752215862274, 0.055757977068424225, 0.016600351780653, 0.012815875001251698, -0.0687377005815506, 0.04120464250445366, 0.0952470451593399, 0.07701367884874344, 0.03280337154865265, -0.031514573842287064, 0.03836400434374809, 0.040513020008802414, 0.005083873867988586, 0.07142925262451172, 0.025663407519459724, 0.05545225366950035, -0.05121586099267006, -0.04170515388250351, 0.08154432475566864, -0.018911583349108696, 0.02418462373316288, 0.03971222788095474, 0.03469973802566528, -0.03605585917830467, 0.03234022110700607, -0.010662024840712547, -0.015528768301010132, 0.04226865991950035, -0.07969024032354355, 0.009836128912866116, -0.03514650836586952, 0.029022803530097008, 0.04429979622364044, -0.02905976213514805, 0.16000866889953613, 0.0623808391392231, -0.008269005455076694, -0.0026395285967737436, 0.07574578374624252, 0.07073888182640076, -0.13272932171821594, 0.008688719011843204, 0.11414950340986252 ] }, { "text": "• Language Detection (Hugging Face Space)\n•\n\nResearch & Engineering\n\n• Information Extraction from Pathology Reports\n•\n\n• Hugging Face Portfolio\n•\n\n• Occupancy Detection (TensorFlow Lite & Neuton AI)\n•\n\n• Audio Classifier with Edge Impulse\n•\n\n• Motion Classifier with Edge Impulse\n•\n\nEducation\n\nFormal studies in industrial engineering and optimization.\n\nMaster of Science, Industrial Engineering\n\nBilkent University Graduate School of Engineering and Science (2010 – 2013) — GPA: 3.09 / 4.00\n\nMaster’s Thesis: Analysis of Locations of Existing Fire Stations in Ankara in Comparison to Optimized Locations\n\nBachelor of Science, Industrial Engineering\n\nGazi University Engineering and Architecture Faculty (2005 – 2010) — GPA: 3.44 / 4.00\n\nCertifications & Trainings", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_5", "embedding": [ 0.003985527902841568, 0.007735936902463436, 0.012825246900320053, -0.012609535828232765, 0.02918325737118721, -0.02483857050538063, 0.005040534306317568, -0.04021525755524635, -0.08190635591745377, -0.07263664156198502, -0.0492393933236599, -0.02796909399330616, -0.0019894533324986696, 0.04925568774342537, -0.046572037041187286, -0.040424562990665436, 0.042685367166996, 0.055157486349344254, 0.019711587578058243, -0.12520335614681244, 0.032600805163383484, 0.04340950399637222, 0.09711107611656189, -0.05633164569735527, -0.004963344428688288, 0.01569477468729019, 0.020781848579645157, 0.0017511616460978985, -0.013974469155073166, -0.020707134157419205, 0.0941896066069603, 0.02405710704624653, 0.01822146587073803, 0.024471182376146317, 0.06737332791090012, 0.04066772758960724, 0.0019378716824576259, 0.028159746900200844, 0.0010739084100350738, 0.11250951886177063, -0.07655399292707443, -0.059069905430078506, 0.0009358545066788793, -0.054068904370069504, 0.0638410672545433, -0.0072450414299964905, -0.06163201481103897, -0.10294973105192184, 0.030238259583711624, -0.024727506563067436, -0.06792370229959488, -0.09255401045084, -0.017449691891670227, -0.0008983887382782996, -0.03760074824094772, -0.03115922026336193, 0.01851138472557068, 0.007612681947648525, -0.01683800108730793, -0.012978990562260151, 0.044366076588630676, -0.010884386487305164, -0.030177349224686623, 0.032795365899801254, -0.0316384881734848, -0.04457945376634598, -0.004734213929623365, 0.08054549247026443, 0.06053805723786354, -0.02222246117889881, 0.05118497461080551, 0.042751431465148926, -0.029921744018793106, 0.009375328198075294, 0.01833960972726345, 0.01186066959053278, -0.0034896761644631624, 0.04373851418495178, 0.08232998847961426, 0.009179719723761082, 0.061572734266519547, -0.0713835060596466, 0.04636993631720543, -0.026819687336683273, -0.0636315569281578, -0.013171468861401081, -0.048904865980148315, -0.04411888122558594, -0.009235084056854248, 0.07130630314350128, 0.07625259459018707, -0.012196512892842293, 0.017549589276313782, 0.0055391364730894566, 0.04534117504954338, -0.010638609528541565, -0.05706462636590004, -0.029914041981101036, 0.02879955992102623, 0.03600655868649483, -0.0989171639084816, -0.0923244059085846, -0.08096820116043091, 0.04379323497414589, -0.03463166579604149, -0.04346409812569618, -0.049448832869529724, 0.015112420544028282, 0.09164018929004669, -0.03679213300347328, 0.01589752919971943, -0.008729916997253895, -0.048430074006319046, -0.030420472845435143, 0.022840334102511406, 0.027965165674686432, -0.017880743369460106, -0.042610205709934235, 0.07317196577787399, 0.06388435512781143, -0.03379800543189049, -0.0038536428473889828, 0.019487367942929268, 0.027548376470804214, 0.006269097328186035, -0.0230606347322464, -0.08114569634199142, 3.388463852633002e-33, 0.0002777668705675751, 0.0763394683599472, -0.027018733322620392, -0.03744731843471527, 0.016816098242998123, -0.05585149675607681, -0.03196142986416817, -0.01349277701228857, 0.022116998210549355, 0.08311932533979416, -0.045691266655921936, 0.09945882111787796, -0.014006596989929676, 0.0090456772595644, 0.06678400188684464, 0.008510681800544262, 0.0005735535523854196, 0.07114578783512115, -0.0800720825791359, 0.018025008961558342, -0.050489507615566254, -0.10871833562850952, 0.07885963469743729, 0.016540858894586563, 0.021788308396935463, 0.08108346909284592, -0.006112032104283571, -0.05553416162729263, 0.07084210962057114, 0.0017476805951446295, -0.0584917850792408, -0.005168887320905924, -0.07664566487073898, -0.09373967349529266, -0.0013451874256134033, 0.031347718089818954, -0.03970526531338692, -0.06152576580643654, -0.03226003423333168, -0.06209525093436241, -0.04889015108346939, 0.07320356369018555, 0.05942337587475777, -0.06273332238197327, 0.032472677528858185, 0.10025588423013687, 0.004052089061588049, 0.0549221932888031, 0.047407861799001694, 0.013137414120137691, -0.05139296129345894, 0.015164385549724102, 0.019494157284498215, -0.0023488400038331747, 0.02360432967543602, 0.08921481668949127, 0.03231608495116234, 0.06925107538700104, 0.09658665210008621, 0.025710444897413254, -0.00874122604727745, 0.05662142485380173, 0.052290912717580795, -0.05052360147237778, 0.05355033650994301, -0.06039123609662056, -0.05433160811662674, 0.0039044192526489496, 0.17030400037765503, 0.005155621096491814, -0.01627294346690178, 0.011061159893870354, -0.0033426512964069843, -0.0011489217868074775, -0.02666659466922283, -0.038616880774497986, -0.019440673291683197, -0.0071813506074249744, -0.03659001737833023, 0.046536918729543686, -0.06642606109380722, 0.05879274010658264, 0.04759177193045616, -0.11610517650842667, 0.04709635302424431, -0.001156204380095005, 0.00837370753288269, -0.07154378294944763, -0.07467329502105713, 0.07896742224693298, -0.0814046710729599, 0.042100097984075546, -0.001141618937253952, 0.10338404029607773, -0.03555566817522049, -4.171040400485309e-33, 0.030130911618471146, 0.04290372505784035, 0.002702179132029414, -0.0018780259415507317, 0.024607587605714798, 0.059937119483947754, -0.010276488028466702, 0.012416385114192963, 0.03163895756006241, 0.09149213880300522, 0.010406416840851307, -0.021074460819363594, 0.07082963734865189, 0.0015055220574140549, -0.038298916071653366, -0.02210666798055172, 0.005441661924123764, 0.0004716212279163301, -0.05387222394347191, 0.07341437041759491, -0.014088748022913933, 0.08912797272205353, -0.08357174694538116, 0.023734018206596375, -0.12604519724845886, 0.01231006532907486, -0.04808714613318443, -0.03255825862288475, -0.04266659542918205, -0.07005614042282104, -0.013134857639670372, 0.011432661674916744, -0.1242840439081192, 0.08630051463842392, 0.023461464792490005, 0.020361080765724182, 0.050899624824523926, -0.0012554327258840203, -0.0027017812244594097, 0.07703094184398651, 0.12990956008434296, 0.024889936670660973, -0.05413322150707245, 0.03200117126107216, 0.028789889067411423, -0.05852558836340904, -0.0040846699848771095, 0.0716501995921135, -0.009992476552724838, -0.03437941521406174, 0.01071130484342575, -0.017742643132805824, -0.10320491343736649, -0.0012665711110457778, 0.005830671638250351, -0.026213474571704865, 0.05846770107746124, -0.030020564794540405, -0.04809125140309334, 0.030543720349669456, 0.08987493813037872, -0.01323320809751749, -0.04233212396502495, 0.049075476825237274, -0.04872835427522659, 0.0239255428314209, -0.048518016934394836, 0.04740220308303833, -0.04207297042012215, 0.014511685818433762, 0.02629009075462818, 0.0537232905626297, -0.00024345148995053023, 0.05480220541357994, -0.11325464397668839, -0.030073629692196846, 0.04306643456220627, -0.0006203986704349518, -0.010826893150806427, -0.037882134318351746, -0.04265853762626648, -0.032758790999650955, -0.020171307027339935, 0.10294954478740692, 0.07593167573213577, 0.05406304448843002, 0.058399200439453125, -0.07420606166124344, 0.05469226837158203, -0.050888821482658386, -0.040976569056510925, 0.02611302211880684, 0.02740481123328209, -0.03813232481479645, -0.05443515256047249, -4.775863970962746e-08, -0.06846435368061066, -0.024705402553081512, -0.0005402844399213791, -0.011074647307395935, -0.04534893110394478, -0.036929573863744736, -0.010958444327116013, -0.029336808249354362, -0.06942716240882874, -0.069963239133358, -0.06287451833486557, -0.015606113709509373, -0.03866367042064667, 0.046004485338926315, 0.010862541384994984, 0.019288422539830208, -0.00955037958920002, 0.12554959952831268, -0.0381334125995636, -0.033246614038944244, 0.09961754828691483, -0.012035899795591831, 0.04507875069975853, 0.059884559363126755, -0.04503588005900383, -0.04829959571361542, -0.013058994896709919, 0.00029053358593955636, 0.03988439589738846, 0.05005659908056259, -0.04710143059492111, 0.031598206609487534, 0.021183423697948456, -0.05781063809990883, 0.1335768848657608, 0.04939351975917816, 0.0504862405359745, -0.05019688233733177, -0.057952143251895905, 0.04931499436497688, -0.12527741491794586, -0.06968880444765091, 0.0076670111157000065, -0.03567947819828987, -0.01894950121641159, -0.005370721220970154, 0.0558256097137928, -0.11158823221921921, -0.002361317165195942, 0.0847722738981247, 0.04253046587109566, -0.04864273592829704, -0.028082024306058884, 0.017388133332133293, 0.044407930225133896, -0.008401487022638321, 0.026376936584711075, -0.07680438458919525, -0.013492685742676258, 0.060305021703243256, 0.03423566743731499, -0.04072825610637665, -0.06300584971904755, -0.010198240168392658 ] }, { "text": "Gazi University Engineering and Architecture Faculty (2005 – 2010) — GPA: 3.44 / 4.00\n\nCertifications & Trainings\n\nContinuous learning across deep learning, embedded ML, machine learning, and leadership.\n\nDeep Learning & Generative AI\n\n• AWS AI Practitioner Certification, Nov 2025\n•\n\n• OxML 2025\n•\n\n• DeepLearning.AI 2024 highlights\n•\n\n• Retrieval Optimization to Vector Quantization; Knowledge Graphs for RAG; Quality & Safety for LLM Applications\n•\n\n• Building Applications with Vector Databases\n•\n\n• Google Cloud Generative AI, Introduction to LLMs (Coursera, 2023)\n•\n\n• Generative AI with Large Language Models (Coursera, 2023)\n•\n\n• ChatGPT Teach-Out (University of Michigan, 2023)\n•\n\n• Deep Learning Specialization modules on NLP, sequence models, CNNs, TensorFlow (2021–2022)\n•", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_6", "embedding": [ -0.09893455356359482, -0.042832501232624054, 0.08843456953763962, 0.015477401204407215, 0.009623682126402855, -0.0010786119382828474, -0.02686431258916855, -0.08076878637075424, -0.0474710687994957, -0.04464687779545784, -0.06689300388097763, -0.02907457761466503, 0.0041847131215035915, 0.019350804388523102, -0.0319482684135437, 0.039117734879255295, 0.06283437460660934, 0.0468018464744091, -0.0704253539443016, -0.10753268748521805, 0.01943025179207325, 0.15452051162719727, 0.0356932207942009, -0.031175004318356514, 0.0209803469479084, 0.011206666938960552, 0.01911604404449463, -0.06695012003183365, 0.07922257483005524, -0.058776501566171646, 0.03609871491789818, 0.020689861848950386, 0.0025164331309497356, 0.12277235090732574, -0.03716905787587166, 0.11442819237709045, -0.05790473893284798, -0.05043535307049751, 0.031085411086678505, -0.004732685163617134, 0.010692435316741467, -0.042201463133096695, 0.015665138140320778, -0.053665030747652054, 0.08891695737838745, 0.031982749700546265, -0.08504122495651245, -0.07186584174633026, 0.0006124850478954613, 0.04379550740122795, -0.07490108907222748, -0.06854406744241714, -7.887939864303917e-05, 0.07274753600358963, -0.03433220461010933, 0.022262457758188248, 0.04012783616781235, -0.010260447859764099, -0.02445431426167488, -0.04974796250462532, -0.023723656311631203, -0.08043993264436722, 0.021856805309653282, -0.029017623513936996, -0.0008072668570093811, -0.022657394409179688, -0.023534270003437996, 0.10799562186002731, 0.0030955306719988585, -0.0164530947804451, 0.05154874920845032, 0.05795372650027275, -0.08091293275356293, 0.07474275678396225, -0.00597714725881815, 0.07518091797828674, 0.05945326387882233, -0.02853848971426487, 0.1103052943944931, -0.05197887122631073, -0.007384045049548149, 0.021444067358970642, 0.022322919219732285, 0.03002217970788479, 0.02323383092880249, -0.05973915383219719, 0.0049189552664756775, 0.04644455388188362, 0.026747241616249084, -0.0013011805713176727, 0.028377395123243332, -0.023540116846561432, 0.06713137030601501, 0.014449810609221458, 0.06774553656578064, 0.04809782654047012, -0.01069176197052002, -0.07152260839939117, -0.052508410066366196, 0.03721283748745918, 0.013508317060768604, 0.04194560647010803, -0.007558370009064674, -0.044870663434267044, -0.028101686388254166, -0.022983791306614876, 0.020634347572922707, 0.04030269756913185, 0.018874628469347954, -0.12363719195127487, 0.03588726371526718, 0.041584573686122894, 0.008536290377378464, -0.024393409490585327, 0.0013372560497373343, -0.010923922061920166, -0.010388794355094433, -0.022433560341596603, 0.014647736214101315, 0.07522095739841461, -0.022407229989767075, 0.031456850469112396, -0.026702458038926125, 0.04297731816768646, -0.026592426002025604, -0.0708688348531723, -0.053934432566165924, 1.057004520259401e-33, 0.05300605297088623, -0.014475325122475624, -0.024667978286743164, 0.047660794109106064, 0.04849109798669815, 0.06886409223079681, 0.008106863126158714, 0.07218463718891144, -0.08990885317325592, -0.009247472509741783, -0.10744547843933105, 0.03635258600115776, -0.11331794410943985, 0.07773744314908981, 0.054838135838508606, 0.00557802664116025, -0.008461390621960163, 0.010967614129185677, 0.002079945057630539, -0.04996794834733009, 0.06394738703966141, -0.013588697649538517, 0.0052950698882341385, 0.03579363226890564, 0.029498331248760223, 0.049957286566495895, 0.08810063451528549, -0.0683029368519783, 0.008181968703866005, 0.017305094748735428, -0.0955202504992485, -0.04755617678165436, -0.05153600871562958, 0.03116297349333763, 0.010611716657876968, 0.03214450180530548, -0.07314988970756531, -0.029726872220635414, -0.021965518593788147, -0.0018264730460941792, -0.038926053792238235, 0.021227532997727394, 0.0022299059201031923, -0.04338408261537552, -0.07049620896577835, -0.013150513172149658, 0.08313246816396713, -0.02189076505601406, 0.08213292807340622, -0.04181455448269844, -0.028427647426724434, -0.054699309170246124, -0.07341011613607407, -0.035580266267061234, 0.060794148594141006, -0.01150915864855051, 0.024586820974946022, 0.08310148119926453, 0.002077187644317746, -0.027111345902085304, -0.029348008334636688, 0.03513532131910324, -0.02500140108168125, 0.057956572622060776, -0.01653490960597992, -0.04750082641839981, -0.0575123205780983, 0.07096730172634125, 0.0812833160161972, 0.018776001408696175, 0.02860892005264759, 0.02653234824538231, 0.02979157865047455, -0.03026251681149006, 0.011872745119035244, -0.03861532732844353, 0.022210830822587013, -0.10433974862098694, 0.01844489574432373, 0.08159925043582916, -0.0329408161342144, 0.03759158402681351, -0.009881003759801388, -0.04183850437402725, -0.014828276820480824, -0.06379343569278717, 0.026667943224310875, -0.044607412070035934, -0.007215771824121475, 0.03961411863565445, -0.10568806529045105, -0.02944781631231308, 0.033649057149887085, 0.06621836125850677, -0.10017857700586319, -3.3544248423110504e-33, -0.06345801055431366, 0.09983070939779282, -0.009741105139255524, 0.07417185604572296, 0.05096401274204254, -0.06993158906698227, -0.025544213131070137, 0.04190061613917351, -0.05219179764389992, -0.04013025015592575, 0.005920602008700371, -0.027240075170993805, 0.06003081053495407, -0.039140988141298294, 0.04253516346216202, -0.018404975533485413, -0.06837834417819977, -0.0920473113656044, -0.06524840742349625, 0.0544101856648922, 0.006124106235802174, 0.07414094358682632, -0.08275505155324936, 0.02959299273788929, -0.0098796421661973, -0.0022496203891932964, -0.03710128366947174, 0.05036097392439842, 0.010808560997247696, 0.03162975236773491, 0.006457866635173559, -0.037328846752643585, -0.09754615277051926, 0.025014786049723625, -0.058223821222782135, 0.0017462022369727492, 0.0810614675283432, 0.01323733665049076, -0.024481678381562233, 0.08145011216402054, 0.11403138935565948, -0.05500001087784767, -0.0571306087076664, 0.008117067627608776, -0.0027455829549580812, -0.014152775518596172, -0.07457190006971359, 0.04261917993426323, 0.06056524068117142, 0.00108927336987108, -0.022803761065006256, -0.009702862240374088, -0.05956573784351349, 0.011048126965761185, 0.014566866680979729, -0.07040047645568848, 0.03041745536029339, -0.007483064197003841, -0.013696937821805477, 0.02881339192390442, -0.036561064422130585, -0.05320759490132332, 0.06982672214508057, -0.026793992146849632, -0.04084601253271103, -0.04564475268125534, -0.03522961586713791, 0.04461229592561722, -0.044766250997781754, -0.005642044357955456, 0.046567678451538086, -0.0415339320898056, -0.02497522532939911, 0.006169395055621862, -0.05031611770391464, -0.026314575225114822, -0.02664225921034813, -0.041755519807338715, 0.013272018171846867, -0.11288918554782867, 0.021802188828587532, -0.009487172588706017, 0.00758327217772603, 0.10499321669340134, 0.09120681881904602, 0.02908574976027012, 0.039709094911813736, 0.017045944929122925, 0.0437714159488678, 0.07220372557640076, -0.056626368314027786, -0.019336529076099396, -0.02692694589495659, -0.02475229650735855, -0.043609872460365295, -4.485551841071356e-08, -0.11737149953842163, 0.04742427542805672, 0.004191576037555933, 0.004439744167029858, 0.07860635966062546, -0.02378472127020359, -0.0324334017932415, 0.07112939655780792, 0.011436866596341133, 0.0018408128526061773, 0.081372931599617, -0.05421576276421547, -0.08794363588094711, -0.0668419748544693, 0.08394630253314972, 0.02575037255883217, -0.006826404016464949, 0.0011977484682574868, 0.015380739234387875, -0.09734553843736649, 0.0842205137014389, 0.029725125059485435, -0.018068350851535797, 0.04871663451194763, -0.009287803433835506, -0.05690251663327217, -0.00945579819381237, 0.08577386289834976, 0.03737792372703552, 0.027019686996936798, -0.0614924430847168, 0.023347504436969757, 0.04579222947359085, -0.02735373005270958, 0.08606580644845963, 0.057806216180324554, 0.012445399537682533, -0.0988788977265358, -0.0038482288364320993, -0.006096337456256151, -0.015060889534652233, 0.08090826123952866, -0.06143675744533539, -0.007381770294159651, 0.019569450989365578, 0.016647804528474808, 0.027138175442814827, -0.0789550244808197, 0.0033349799923598766, 0.10933785885572433, 0.017933428287506104, -0.092307448387146, 0.03406151384115219, 0.0833466649055481, 0.07071524858474731, 0.013493666425347328, 0.045412782579660416, -0.09757252037525177, 0.04366736859083176, 0.014883051626384258, 0.030779877677559853, -0.03642774745821953, -0.059040606021881104, 0.020930614322423935 ] }, { "text": "• ChatGPT Teach-Out (University of Michigan, 2023)\n•\n\n• Deep Learning Specialization modules on NLP, sequence models, CNNs, TensorFlow (2021–2022)\n•\n\n• CS231n Convolutional Neural Networks for Visual Recognition (Stanford)\n•\n\nEmbedded & Classical ML\n\n• Applications of TinyML; Fundamentals of TinyML (HarvardX, 2022)\n•\n\n• Introduction to Embedded Machine Learning (Edge Impulse, 2021)\n•\n\n• Machine Learning Specialization (DeepLearning.AI, 2022)\n•\n\n• Unsupervised Learning, Recommenders, Reinforcement Learning (DeepLearning.AI, 2022)\n•\n\n• AWS Machine Learning Foundations (Udacity, 2020)\n•\n\n• Google Machine Learning Crash Course with TensorFlow API (2020)\n•\n\n• Udacity Intro to Machine Learning; Bayesian Machine Learning via Python (Udemy)\n•", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_7", "embedding": [ -0.08264724910259247, -0.11941584199666977, 0.10121168196201324, 0.004357083234935999, 0.07062442600727081, 0.03889106214046478, -0.04282143712043762, 0.028294207528233528, -0.0966806411743164, -0.04911736026406288, -0.02712589129805565, -0.038355160504579544, -0.012033303268253803, 0.016781244426965714, -0.06149844080209732, 0.04939540475606918, 0.05812549591064453, 0.0767165943980217, -0.1195221096277237, -0.09040550887584686, 0.008897028863430023, 0.07770933210849762, 0.022883087396621704, -0.05797978490591049, 0.008464165031909943, 0.0030756911728531122, 0.047000523656606674, -0.015302890911698341, 0.027668384835124016, -0.02988610416650772, -0.014310607686638832, -0.03398677706718445, -0.0031693298369646072, 0.029972491785883904, -0.007549988105893135, 0.09178206324577332, -0.04460414871573448, -0.08635969460010529, 0.0002124389575328678, -0.020242838189005852, -0.00520475534722209, -0.006681007798761129, 0.04246456176042557, -0.021795177832245827, 0.08245710283517838, -0.00607982836663723, -0.052509550005197525, -0.06530608981847763, 0.05946243926882744, 0.006118828896433115, -0.08292710036039352, -0.028070887550711632, 0.013885607942938805, 0.07507196813821793, -0.054959893226623535, -0.006890426855534315, 0.0026648028288036585, -0.029618848115205765, 0.00041567074367776513, -0.01693667657673359, 0.01955173909664154, -0.08981218189001083, 0.005152631551027298, -0.023311669006943703, -0.002995771821588278, 0.0576520711183548, 0.0044140443205833435, 0.03089076653122902, 0.0445043109357357, 0.02049994096159935, 0.0025425245985388756, 0.08211592584848404, -0.023097120225429535, 0.08678712695837021, -0.005183693487197161, -0.005448068957775831, 0.050342340022325516, -0.08766704797744751, 0.021925002336502075, -0.07570099830627441, -0.021099073812365532, -0.017950844019651413, -0.02404966950416565, -0.02482871152460575, 0.05228443071246147, -0.05660368874669075, -0.022030675783753395, 0.05170394107699394, 0.004117402248084545, 0.025744101032614708, 0.007859377190470695, -0.032328810542821884, 0.06260108202695847, -0.07136531174182892, 0.027323583140969276, 0.05388446897268295, -0.02501293271780014, -0.09154628962278366, -0.05542810261249542, 0.06807862222194672, -0.00036556582199409604, 0.031783271580934525, 0.020658085122704506, -0.0073831346817314625, -0.003139112377539277, 0.0008730796980671585, 0.049974747002124786, 0.013126837089657784, 0.08997470140457153, -0.1117570623755455, 0.058729253709316254, -0.009189723059535027, 0.014245438389480114, -0.027625052258372307, -0.014264221303164959, -0.015286995097994804, -0.010827275924384594, -0.07990305125713348, 0.004104613326489925, 0.09040956944227219, -0.051735393702983856, 0.00025059949257411063, -0.047322336584329605, -0.02649316005408764, 0.00697317672893405, -0.0012789135798811913, -0.07041747123003006, 1.8877879077679374e-33, 0.029267041012644768, -0.042635999619960785, 0.024447990581393242, -0.01784239336848259, 0.08592479676008224, -0.015965236350893974, -0.021555282175540924, -0.020765705034136772, -0.11185012757778168, -0.027198081836104393, -0.059653811156749725, 0.02254806086421013, -0.06757397949695587, 0.10628636926412582, 0.021465877071022987, -0.10016564279794693, 0.032223716378211975, 0.023755380883812904, 0.0020275928545743227, 0.026106957346200943, -0.00043698411900550127, 0.05759718269109726, -0.001566010876558721, 0.008896942250430584, -0.0022010793909430504, 0.04669955000281334, 0.0608154721558094, -0.027055524289608, 0.04504327103495598, 0.035635098814964294, -0.11263301223516464, 0.034251619130373, -0.08379360288381577, 0.0024608990643173456, 0.06664692610502243, 0.002409551292657852, -0.038361649960279465, -0.031397055834531784, 0.0027996262069791555, 0.002797630848363042, -0.08157044649124146, 0.040155183523893356, -0.04543919861316681, -0.06485872715711594, -0.06029728055000305, -0.07970202714204788, 0.041675664484500885, 0.017518367618322372, 0.07080841064453125, -0.06439734250307083, -0.01086937915533781, -0.06870052963495255, -0.028283925727009773, -0.10980567336082458, 0.03537051007151604, -0.01336713507771492, 0.03478097915649414, 0.04490502178668976, 0.0010016149608418345, -0.011338389478623867, 0.051318686455488205, 0.0056123812682926655, 0.017694594338536263, 0.00045994381071068347, -0.04003334045410156, -0.030318574979901314, 0.02176942303776741, 0.07767973840236664, -0.011422328650951385, -0.005190261639654636, 0.004662785679101944, 0.09921274334192276, 0.030375521630048752, -0.04767768830060959, 0.0597921758890152, 0.07448862493038177, 0.06536729633808136, -0.10226292908191681, -0.01581696607172489, 0.06501557677984238, -0.038500797003507614, 0.0020171955693513155, 0.0444224514067173, -0.05032014474272728, -0.07137835770845413, -0.018440496176481247, 0.026570389047265053, -0.041609905660152435, -0.0332968533039093, -0.04677096754312515, -0.109379343688488, 0.001486129011027515, 0.011278852820396423, 0.03160332143306732, -0.05962885543704033, -4.186449294714666e-33, -0.04811813682317734, 0.13917659223079681, -0.015377656556665897, 0.0732804462313652, 0.02076864428818226, -0.002125343307852745, 0.022210804745554924, 0.05760614201426506, -0.027616670355200768, -0.02922515943646431, -0.002397602191194892, 0.01372678205370903, 0.019961640238761902, -0.02248855121433735, 0.04887351766228676, -0.001404101145453751, -0.06360562890768051, -0.05041037127375603, -0.048860713839530945, 0.01818181574344635, 0.007672018371522427, 0.0851469561457634, -0.08395615220069885, 0.04322775825858116, 0.013171626254916191, 0.01731209084391594, -0.06430120021104813, 0.07370311766862869, -0.03474307432770729, -0.027899818494915962, -0.010756970383226871, 0.02769544906914234, -0.08650010079145432, 0.014563546516001225, 0.004725451115518808, 0.05258937180042267, 0.07761221379041672, -0.043052107095718384, -0.033669762313365936, 0.05146114528179169, 0.1333480030298233, -0.01859823428094387, -0.06389147788286209, -0.027451716363430023, -0.013373887166380882, -0.082161545753479, -0.07104874402284622, 0.04608163610100746, 0.028930919244885445, -0.02330067940056324, -0.029991626739501953, 0.026173003017902374, -0.05077126622200012, 0.01438479870557785, -0.06124844029545784, 0.01622701622545719, 0.08531471341848373, 0.024546124041080475, 0.07592737674713135, 0.04258420318365097, -0.10279425978660583, -0.07644593715667725, 0.02919124811887741, 0.02364503964781761, -0.03317738324403763, -0.043562985956668854, -0.07752863317728043, 0.020666560158133507, -0.04616396501660347, -0.029161982238292694, 0.027977636083960533, 0.03509514033794403, 0.01038269605487585, -0.003979716449975967, -0.04529016837477684, 0.028651447966694832, -0.01903134398162365, 0.012347721494734287, -7.27075821487233e-05, -0.017278095707297325, 0.10900722444057465, -0.01572638936340809, -0.00657373433932662, 0.11919601261615753, 0.10323748737573624, 0.11166628450155258, 0.05709920451045036, -0.019779697060585022, 0.04390052333474159, -0.023000886663794518, -0.14535705745220184, 0.03336089104413986, -0.0052678752690553665, 0.06524094939231873, -0.09247475862503052, -4.03475475252435e-08, -0.08518657088279724, 0.0676519125699997, 0.04374407231807709, 0.024911925196647644, 0.04719821736216545, -0.039079152047634125, -0.017230866476893425, 0.08101523667573929, -0.017933309078216553, 0.025708185508847237, 0.035028282552957535, -0.04805342108011246, -0.07241177558898926, -0.05032641440629959, 0.031086575239896774, 0.08096931874752045, 0.008627357892692089, -0.02269092947244644, 0.023575283586978912, -0.0012763995910063386, 0.07323558628559113, 0.02348005771636963, 0.029411084949970245, 0.041235100477933884, -0.05961785092949867, -0.09572084993124008, 0.01849166490137577, 0.10046685487031937, 0.028566831722855568, -0.01822400465607643, -0.05681942030787468, 0.026583224534988403, 0.022248847410082817, -0.0628448948264122, 0.056923530995845795, 0.07206699252128601, -0.0018293008906766772, -0.06798647344112396, -0.031261030584573746, 0.004635934717953205, -0.03315512090921402, 0.04365883767604828, -0.05202390253543854, -0.01124547515064478, 0.04011496901512146, 0.029454490169882774, 0.05018456280231476, -0.07787884026765823, 0.0011512776836752892, 0.07306302338838577, -0.02375977113842964, -0.054942287504673004, -0.016632530838251114, 0.10571086406707764, 0.0338180735707283, 0.03445001691579819, 0.05052046477794647, -0.06726378947496414, 0.0026256386190652847, 0.08362643420696259, -0.020945582538843155, 0.033754732459783554, -0.016452886164188385, 0.053435470908880234 ] }, { "text": "• Udacity Intro to Machine Learning; Bayesian Machine Learning via Python (Udemy)\n•\n\n• Advanced Data Analytics, Data Scientist Track (Sabancı University, 2018)\n•\n\nLeadership & Other\n\n• The Science of Stem Cells (AMNH, 2023)\n•\n\n• Self Awareness and the Effective Leader (Rice University, 2022)\n•\n\n• Discrete Optimization (University of Melbourne, 2020)\n•\n\n• Udacity Nanodegrees: Bertelsmann Data Analyst; Google Android Basics\n•\n\n• Intermediate/Intro to Python for Data Science (DataCamp, 2017)\n•\n\n• Data Science Orientation (edX, 2017)\n•\n\nAwards & Scholarships\n\n• Advanced Data Analytics (Data Scientist Track) — 3rd Prize, Sabancı University (2018)\n•\n\n• Brabant Water Demand Prediction — 3rd Prize, JADS 7th Data Challenge Week (2019)\n•", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_8", "embedding": [ -0.1343856304883957, -0.0427531823515892, 0.06046343967318535, -0.017370667308568954, 0.04544899985194206, -0.057842254638671875, -0.03546639904379845, 0.0014218325959518552, -0.09706646203994751, 0.059704333543777466, -0.08870051801204681, -0.10341305285692215, 0.006315137259662151, -0.0016022755298763514, -0.08009335398674011, 0.047456029802560806, -0.08475937694311142, 0.01746543124318123, -0.06585422903299332, -0.10602425783872604, 0.011612356640398502, 0.0472453236579895, 0.0069094570353627205, -0.02022779919207096, 0.06265939772129059, 0.0034660082310438156, 0.11244594305753708, 0.05165238305926323, -0.035396758466959, -0.044442545622587204, -0.015720104798674583, -0.008730153553187847, 0.045050304383039474, -0.07259774208068848, -0.030437681823968887, -0.006447658874094486, -0.06704031676054001, -0.02350098080933094, -0.03640728071331978, 0.0158961471170187, 0.042030833661556244, -0.06982050836086273, 0.05275250971317291, 0.035423923283815384, 0.043331146240234375, 0.004492636304348707, -0.04029267281293869, -0.08068771660327911, 0.035817701369524, -0.02994248829782009, -0.05142346769571304, -0.09504670649766922, -0.028795119374990463, 0.04912441223859787, -0.07383348792791367, 0.020160021260380745, 0.029135635122656822, -0.06664736568927765, 0.031411971896886826, -0.06555754691362381, 0.013674098998308182, -0.0774931088089943, -0.03715895861387253, 0.011816766113042831, 0.026149215176701546, 0.0392683669924736, -0.03335356339812279, 0.1309005618095398, -0.0072038434445858, 0.018164096400141716, 0.04942430928349495, 0.07540552318096161, -0.023310909047722816, 0.04174356535077095, 0.045710012316703796, -0.016569586470723152, 0.03527626395225525, 0.02366156317293644, 0.09665906429290771, -0.018524380400776863, -0.04832020401954651, -0.04491981118917465, -0.03812447190284729, 0.023319581523537636, -0.006772718392312527, -0.004597054794430733, -0.021104995161294937, 0.03480145335197449, -0.014083855785429478, 0.007373555563390255, 0.013746652752161026, 0.06433726102113724, 0.04015200585126877, 0.005670088343322277, -0.13317741453647614, 0.07904579490423203, 0.011991584673523903, -0.0870562270283699, 0.030117888003587723, 0.035460080951452255, -0.05691433697938919, 0.09318242967128754, -0.028477728366851807, 0.002269687596708536, 0.043613139539957047, -0.10321502387523651, 0.019151831045746803, -0.012087314389646053, 0.08612638711929321, -0.013439073227345943, 0.006729351356625557, -0.014372164383530617, -0.007282165810465813, 0.037558842450380325, -0.047746263444423676, 0.019677918404340744, -0.002541244262829423, -0.011207215487957, -0.006777660921216011, 0.03806805983185768, -0.055777065455913544, -0.034646086394786835, -0.04354952648282051, -0.02761855162680149, 0.002379181794822216, -0.010070123709738255, -0.09353245049715042, 3.866455120507869e-33, 0.005558203440159559, -0.09982270002365112, 0.047573357820510864, 0.003276907140389085, -0.015486461110413074, -0.06721144914627075, -0.02364480309188366, -0.05160039663314819, -0.09513157606124878, -0.043390970677137375, -0.10485965758562088, 0.08080648630857468, -0.07926681637763977, 0.040193066000938416, -0.014492898248136044, -0.07976756244897842, 0.03444458544254303, 0.03592071309685707, -0.0673646479845047, 0.014304989948868752, 0.038188643753528595, -0.03843153640627861, -0.02346723899245262, -0.02146870829164982, 0.04230915755033493, -0.021399442106485367, 0.027422066777944565, -0.02065807767212391, 0.06544791162014008, 0.041079405695199966, -0.047061849385499954, 0.011256630532443523, -0.11179157346487045, -0.021276040002703667, 0.029914384707808495, 0.022779054939746857, -0.0035242410376667976, -0.08538416028022766, 0.04428252950310707, 0.016716942191123962, -0.0621161088347435, 0.018438495695590973, 0.11843285709619522, -0.05084443464875221, -0.038592636585235596, -0.010040133260190487, 0.04807239770889282, -0.06614549458026886, 0.07448003441095352, -0.02375444583594799, -0.04926605522632599, -0.02343803085386753, 0.026827054098248482, -0.06198282167315483, 0.007944593206048012, 0.03828086704015732, -0.04451250657439232, 0.00994961243122816, -0.0215062964707613, 0.003709263401106, -0.01462717168033123, 0.03766806051135063, -0.00958436168730259, 0.003168832277879119, -0.014131728559732437, 0.09648462384939194, -0.019653262570500374, 0.02020327001810074, 0.058245912194252014, 0.023394154384732246, 0.059365708380937576, 0.009333939291536808, 0.024312809109687805, -0.04497535899281502, 0.06503797322511673, 0.0717453807592392, 0.10338561236858368, -0.015460256487131119, -0.011695182882249355, -0.03157597780227661, -0.054581861943006516, -0.017008967697620392, -0.024725742638111115, -0.04443095624446869, 0.021373609080910683, 0.008411218412220478, 0.022817185148596764, -0.055167343467473984, -0.05903533846139908, -0.05457620695233345, -0.053237125277519226, -0.0027278584893792868, 0.019870787858963013, -0.023537196218967438, -0.07359430193901062, -5.9497782483404396e-33, -0.0196745116263628, 0.07130596041679382, 0.023411519825458527, 0.05383561924099922, 0.1739080399274826, 0.015766026452183723, 0.016229309141635895, 0.00836099311709404, 0.10451342910528183, -0.017658432945609093, 1.5246472685248591e-05, 0.05547275021672249, 0.016759682446718216, -0.017309023067355156, 0.012362520210444927, 0.02720775082707405, -0.04778343066573143, -0.05054733157157898, -0.09591343998908997, -0.019233252853155136, -0.09093170613050461, 0.12520593404769897, -0.047017041593790054, 0.05460168421268463, -0.042608462274074554, 0.001667270204052329, -0.04916916787624359, 0.05702051520347595, -0.0004027733230032027, 0.010625516064465046, -0.06714842468500137, 0.03528083115816116, -0.12149925529956818, 0.020527716726064682, -0.04397442191839218, 0.05628742277622223, 0.07821910083293915, -0.028102528303861618, -0.006651766132563353, 0.054808955639600754, 0.0579446479678154, -0.015561477281153202, -0.07813545316457748, -0.02856200933456421, 0.041659992188215256, -0.029930531978607178, -0.032576434314250946, 0.059043120592832565, 0.06034247204661369, -0.0025692624039947987, -0.03939848393201828, 0.06949180364608765, -0.03646448627114296, 0.03903813287615776, -0.03301388397812843, 0.016747351735830307, 0.05311530828475952, -0.009598400443792343, -0.008614743128418922, -0.004319565836340189, -0.05844782292842865, -0.02329965867102146, 0.037065062671899796, 0.10104426741600037, -0.050063274800777435, -0.015273666940629482, 0.03553951159119606, 0.03737955912947655, -0.055688705295324326, -0.04482221603393555, 0.03747354447841644, 0.06316904723644257, 0.06408662348985672, -0.028344755992293358, -0.04151220619678497, 0.008283430710434914, -0.04332367330789566, 0.010817176662385464, -0.031350549310445786, 0.03299457207322121, 0.02990024723112583, 0.06277940422296524, 0.014587456360459328, 0.08890649676322937, 0.0894957184791565, 0.024343280121684074, 0.06343843042850494, -0.047325171530246735, 0.0695367380976677, -0.004426547791808844, -0.084840327501297, -0.05513278767466545, -0.043533533811569214, 0.06689488887786865, -0.025820791721343994, -4.803156272714659e-08, 0.02715609222650528, 0.05164390057325363, 0.03722882270812988, 0.007468250580132008, 0.09153936058282852, 0.017925824970006943, -0.10068435966968536, 0.05069952458143234, 0.0069930520839989185, -0.03543185442686081, 0.05974555015563965, 0.02900484763085842, -0.043718453496694565, -0.003934032283723354, -0.011438312940299511, 0.11777962744235992, -0.0003120811306871474, -0.02068150043487549, -0.03501463681459427, -0.07739037275314331, 0.0034045514184981585, 0.03429912030696869, -0.03396206349134445, 0.05351363494992256, 0.012152567505836487, -0.005342757795006037, -0.008758189156651497, 0.03322543203830719, 0.057261787354946136, -0.0011939292307943106, -0.011702729389071465, -0.022773901000618935, 0.05846499651670456, 0.018217889592051506, 0.07169365882873535, 0.10025379806756973, 0.012204760685563087, -0.04633649066090584, -0.031498994678258896, 0.04599231481552124, -0.08051691949367523, 0.01976483128964901, -0.08504611253738403, 0.02934376895427704, 0.02297268435359001, 0.03764830902218819, 0.010370025411248207, 0.03508448600769043, 0.03969237580895424, -0.018392890691757202, 0.03407754376530647, -0.0582277812063694, -0.01811249367892742, 0.0032218717969954014, 0.09189393371343613, 0.08360467106103897, -0.05187355354428291, -0.022578570991754532, -0.029372181743383408, 0.04919268190860748, 0.10678388923406601, -0.08659188449382782, -0.01824340596795082, 0.05191712826490402 ] }, { "text": "• Brabant Water Demand Prediction — 3rd Prize, JADS 7th Data Challenge Week (2019)\n•\n\n• Bilkent University Graduate School of Engineering and Science Scholarship (2010–2012)\n•\n\n• TÜBİTAK Graduate Scholarship (2010–2012)\n•\n\nLanguages & Interests\n\nLanguages\n\nEnglish (Advanced), Spanish (Beginner), German (Beginner)\n\nInterests\n\nMinimalism, Cycling, Lindy Hop & Solo Jazz, Chess, Solar car racing (TÜBİTAK Formula-G), Tech community building.\n\n© 2025 Tiny AI World. Free and Open Source.\n\nGitHub •\nLicense •\nAbout", "source": "CV / Resume", "type": "html_page", "chunk_id": "CV / Resume_9", "embedding": [ -0.04358993098139763, 0.011620563454926014, 0.08337245136499405, 0.034076254814863205, 0.027297595515847206, -0.009852931834757328, 0.007470875512808561, 0.0514022596180439, -0.10786122828722, -0.03480049967765808, -0.08127401024103165, -0.18175892531871796, -0.03235236555337906, 0.03965238854289055, -0.07194612175226212, -5.371751467464492e-05, -0.016990752890706062, -0.006300888489931822, -0.0525861494243145, -0.09991580992937088, 0.05301028862595558, -0.0028870683163404465, -0.01903088577091694, -0.007256605196744204, 0.08730520308017731, 0.04465005546808243, 0.05118658021092415, 0.005194127559661865, -0.012090692296624184, -0.02354639209806919, -0.10381574183702469, 0.04220396652817726, 0.014824151992797852, -0.09030604362487793, 0.0016244729049503803, -0.03226958215236664, -0.10769105702638626, -0.07624515891075134, -0.014488514512777328, 0.015112701803445816, -0.01802421547472477, -0.1127874106168747, 0.052933771163225174, 0.024212190881371498, 0.04098276048898697, 0.08799650520086288, 0.025856319814920425, 0.006798851303756237, 0.006149060092866421, 0.029276328161358833, -0.0403234027326107, -0.09920363873243332, -0.042446695268154144, -0.0044075255282223225, -0.07456990331411362, -0.06799528002738953, 0.013986865989863873, -0.004372024908661842, 0.02387244999408722, 0.0011861500097438693, 0.040648285299539566, -0.022594185546040535, -0.056629229336977005, 0.06202109530568123, 0.05215782672166824, 0.030232630670070648, -0.1136089563369751, 0.12945562601089478, -0.05009273812174797, -0.014007505029439926, 0.0658210813999176, 0.05973482504487038, -0.01973884366452694, 0.01656002551317215, 0.0072547816671431065, -0.05071229860186577, 0.002099242527037859, 0.05635266378521919, 0.06697136163711548, 0.030605092644691467, -0.025438910350203514, -0.08191027492284775, 0.010694263502955437, -0.012981661595404148, 0.0047679683193564415, 0.016142500564455986, 0.09437236189842224, -0.008252324536442757, 0.04427526146173477, -0.08480603247880936, -0.007826090790331364, 0.03486466035246849, -0.002051481744274497, 0.022306079044938087, -0.05547066777944565, 0.0755983293056488, -0.0010466671083122492, -0.0694451555609703, -0.05417270585894585, 0.07084383815526962, -0.017835306003689766, 0.07310660928487778, 0.054109130054712296, 0.03188591077923775, -0.00717386556789279, -0.025938114151358604, 0.05991123244166374, 0.02175026759505272, 0.06408092379570007, -0.020564712584018707, -0.04319865629076958, -0.020863711833953857, 0.06640312820672989, -0.01796473190188408, -0.03562329709529877, -0.013098366558551788, 0.018152831122279167, -0.03798781335353851, 0.03342873230576515, 0.07750558108091354, -0.0655580386519432, -0.03371293470263481, -0.046852149069309235, 0.013383561745285988, 0.043573733419179916, 0.08643875271081924, -0.01691935397684574, 2.9269475054268944e-33, -0.027371354401111603, -0.10902272164821625, 0.0431547686457634, 0.008131849579513073, 0.014512504450976849, -0.05835628882050514, -0.06062948331236839, -0.021084720268845558, -0.04447035491466522, -0.05323317274451256, -0.051954422146081924, 0.0357007272541523, -0.09563075751066208, 0.010836431756615639, 0.07020800560712814, -0.04512299597263336, 0.04230428487062454, -0.018109705299139023, 0.0036786715500056744, 0.02546658366918564, -0.02780795469880104, -0.02754843607544899, 0.00037094528670422733, -0.016708655282855034, 0.0041917432099580765, 0.032584819942712784, 0.10037627816200256, -0.08984945714473724, 0.02047601528465748, 0.0398281030356884, 0.007978531531989574, -0.0032686367630958557, -0.1265927106142044, -0.05552158132195473, -0.061866238713264465, -0.00150958145968616, 0.01246268767863512, -0.04047435149550438, -0.02800869569182396, 0.006507000420242548, -0.044193267822265625, 0.0009539855527691543, 0.030608847737312317, -0.01531807892024517, -0.027862152084708214, -0.03142489865422249, 0.12013939768075943, 0.000977749819867313, 0.03860921412706375, 0.0037504679057747126, -0.04317277669906616, -0.01792488805949688, -0.08325234055519104, -0.003987801726907492, 0.04325112700462341, 0.018369954079389572, 0.03952927514910698, -0.011158286593854427, -0.05406833440065384, -0.007669967599213123, -0.07595944404602051, 0.035174768418073654, 0.06226102635264397, -0.03147093951702118, 0.037200022488832474, 0.125630721449852, -0.018964961171150208, 0.03631138429045677, 0.05366220697760582, -0.024414213374257088, -0.027565769851207733, -0.051027581095695496, 0.08856341987848282, 0.014630482532083988, 0.04824655503034592, 0.03801250830292702, 0.10216820985078812, -0.11924619227647781, -0.005374767351895571, -0.002459246665239334, -0.07711279392242432, -0.03703009709715843, 0.029363008216023445, -0.04264403134584427, -0.004835810046643019, -0.007547774352133274, 0.06017433851957321, -0.0922727957367897, -0.017001178115606308, -0.01276666484773159, -0.06312970072031021, 0.049485769122838974, -0.021031487733125687, 0.021478349342942238, -0.019412260502576828, -3.844486233116954e-33, -0.027675427496433258, 0.0750405564904213, -0.04572077840566635, 0.06048629805445671, 0.12505795061588287, -0.00401804456487298, -0.012927521951496601, -0.0003608539991546422, 0.05701276287436485, 0.09107377380132675, -0.061921652406454086, 0.027963854372501373, 0.040563665330410004, 0.026061387732625008, 0.01902116648852825, 0.005687150172889233, 0.024787798523902893, -0.07749415934085846, -0.027168383821845055, 0.024286817759275436, -0.03247954696416855, 0.03762158751487732, -0.05393252521753311, 0.055092841386795044, -0.06647321581840515, 0.04100634530186653, -0.046135615557432175, -0.004520232789218426, -0.0199479628354311, 0.03712568059563637, -0.08409632742404938, -0.02247968502342701, -0.04278744384646416, -0.009301599115133286, -0.05277103930711746, 0.04744426906108856, 0.04329530522227287, 0.0347110740840435, -0.039937395602464676, 0.09060013294219971, 0.05050898343324661, -0.0919494703412056, -0.007289306726306677, -0.05481616035103798, -0.05087666213512421, 0.007827767170965672, 0.030669452622532845, 0.008318066596984863, -0.023152710869908333, -0.03591741621494293, 0.05558182671666145, 0.017048873007297516, -0.09754671901464462, 0.005228088703006506, -0.039561618119478226, 0.010088895447552204, 0.05646917223930359, 0.01715778559446335, -0.03597097471356392, 0.005629268940538168, -0.003143932204693556, -0.00048172331298701465, 0.015450195409357548, 0.034973666071891785, -0.01437802892178297, -0.05348040163516998, -0.0024310126900672913, 0.015522121451795101, 0.01668880507349968, -0.1178935170173645, 0.0327397882938385, 0.01711290515959263, 0.09309132397174835, 0.04655664786696434, 0.0050672497600317, -0.03284315764904022, 0.03606347367167473, 0.09404724091291428, 0.01837141066789627, -0.015177241526544094, 0.008224167861044407, 0.12985794246196747, 0.012460180558264256, -0.014968530274927616, 0.08309910446405411, -0.016544731333851814, -0.01251031830906868, -0.045320987701416016, 0.03571554645895958, 0.1006385013461113, -0.04646359011530876, 0.10567102581262589, -0.020129406824707985, 0.05849776417016983, -0.03759775310754776, -4.497218597521169e-08, -0.008114313706755638, -0.014504310674965382, 0.05159097537398338, 0.09286956489086151, 0.009450903162360191, -0.032747454941272736, -0.007148653268814087, 0.04078403115272522, -0.06464572995901108, 0.0027901805005967617, 0.04779287055134773, 0.008732536807656288, -0.00676876213401556, 0.07463768124580383, 0.01751772128045559, 0.05714854225516319, 0.033246997743844986, -0.0014745077351108193, -0.06655993312597275, -0.045282766222953796, 0.061720434576272964, 0.024308843538165092, -0.020785542204976082, 0.008035100996494293, 0.007005902472883463, -0.02048678882420063, -0.03373212367296219, 0.03722964972257614, 0.007589792832732201, -0.0407719761133194, 0.02047237753868103, 0.04588216915726662, 0.035322416573762894, -0.030878735706210136, 0.012829631567001343, 0.1169174388051033, -0.07357969880104065, 0.026137420907616615, -0.06292323768138885, -0.00750366784632206, -0.10359227657318115, 0.009899139404296875, -0.033558815717697144, -0.029753906652331352, 0.05973544344305992, 0.037942808121442795, -0.02248418517410755, -0.05911244451999664, 0.07849415391683578, 0.0192586500197649, -0.024696383625268936, -0.0613432377576828, 0.043767109513282776, 0.07751212269067764, 0.14627082645893097, 0.035023994743824005, -0.028933033347129822, -0.0490553192794323, -0.020262936130166054, 0.027331093326210976, 0.06992579251527786, -0.029613733291625977, -0.0869016945362091, 0.025574421510100365 ] }, { "text": "Projects - Tiny AI World\n\n• 🧠\">\n\n•\n\n🧠 Tiny AI World\n\nHome\nAll Notes\nProjects\nCV\nAbout\n\n🌙\n\nProjects\n\nExperiments, implementations, and real-world applications\n\nFEATURED\n\nTiny AI World\n\nAn interactive platform for organizing and visualizing learning materials.\nBuilt with D3.js, this project demonstrates the power of connected knowledge and visual learning. Thanks to Claude and ChatGPT.\n\nD3.js\nJavaScript\nGitHub Pages\n\nView Project\n\nGitHub Repo\n\nMy Awesome Projects\n\n🤖\n\nEasy OCR\n\nThis project aims to use EasyOCR to detect the text in the images. It is deployed to\nHuggingFace Space and the UI is designed with Streamlit.\n\nPython\nStreamlit\nEasyOCR\n\nLive Demo →\n\n📊\n\nLanguage Detection\n\nI've learned how to use HuggingFace and Streamlit with this project. It is a simple language detection UI.", "source": "Projects Page", "type": "html_page", "chunk_id": "Projects Page_0", "embedding": [ -0.07826749235391617, -0.026709718629717827, -0.004467293154448271, -0.010793904773890972, 0.09708930552005768, -0.08018194139003754, 0.0034970673732459545, -0.04848991706967354, -0.03361302614212036, -0.0701986625790596, 0.0422627292573452, -0.06898966431617737, -0.013894864358007908, 0.08959215879440308, 0.015430564992129803, 0.0011076736263930798, -0.028229407966136932, 0.039913058280944824, 0.006860814522951841, -0.10961037874221802, 0.006885589566081762, -0.037662625312805176, 0.09198348969221115, -0.05367124080657959, 0.032187290489673615, 0.11211087554693222, 0.008560669608414173, -0.008923280984163284, 0.07117840647697449, -0.041159942746162415, 0.016818279400467873, 0.0049210828728973866, 0.06208990514278412, 0.02277420461177826, 0.011926216073334217, 0.07770314812660217, 0.010438595898449421, 0.015962811186909676, -0.0856221467256546, -0.0021947103086858988, -0.04090575873851776, 0.011915789917111397, 0.04156610369682312, -0.07982491701841354, 0.062142547219991684, 0.051682136952877045, -0.06822317093610764, -0.024064289405941963, -0.01888936199247837, -0.020047765225172043, -0.06638164073228836, -0.13535672426223755, -0.017880311235785484, 0.043102677911520004, -0.07679198682308197, -0.001304333796724677, 0.02796359546482563, -0.03673257678747177, 0.02596040442585945, -0.004147128667682409, -0.005750197917222977, -0.05217600613832474, 0.10519405454397202, 0.03183601051568985, 0.013393914327025414, 0.04188656061887741, 0.023478703573346138, 0.036696095019578934, 0.0035507192369550467, -0.07751499861478806, -0.01313209068030119, 0.05397113785147667, 0.05390524864196777, 0.07676228135824203, 0.021853972226381302, -0.05754775553941727, -0.01579693704843521, -0.03959324583411217, 0.017176320776343346, -0.037430617958307266, 0.0032465497497469187, -0.05565077066421509, 0.022411314770579338, 0.1350729912519455, 0.015043588355183601, 0.03456682711839676, -0.04484827443957329, -0.002477815840393305, -0.014839589595794678, 0.015351689420640469, -0.010354376398026943, -0.06621930003166199, -0.007313543930649757, -0.018401816487312317, -0.02338562346994877, -0.017518769949674606, 0.0566636398434639, -0.05307185277342796, -0.15365616977214813, 0.03457139804959297, -0.04458720237016678, -0.0835663303732872, 0.08537168800830841, -0.05131358280777931, 0.03465649113059044, 0.02325514145195484, 0.0713321790099144, -0.05139143764972687, 0.08831454068422318, -0.029038159176707268, -0.0012437958503142, -0.0018853815272450447, -0.008429928682744503, -0.029781199991703033, 0.00502181937918067, 0.0011424076510593295, 0.025613805279135704, -0.0014012999599799514, 0.0618252195417881, 0.04015090689063072, 0.016539564356207848, -0.00791848823428154, -0.044428594410419464, -0.0032731881365180016, 0.10066165775060654, 0.003760888008400798, -0.031136762350797653, 5.9284048223066134e-33, 0.08918766677379608, 0.08882855623960495, -0.02009996585547924, 0.049303293228149414, 0.0447973757982254, -0.07143909484148026, 0.05825616046786308, -0.011893359944224358, -0.12812058627605438, -0.02818943001329899, -0.0006492002285085618, 0.030461572110652924, -0.0675281211733818, 0.09551812708377838, 0.054223645478487015, -0.11589948832988739, -0.02008611336350441, 0.008010505698621273, -0.01871310919523239, 0.055316172540187836, -0.019852183759212494, -0.035966500639915466, 0.0627497136592865, -0.02016080915927887, -0.020665360614657402, 0.031194504350423813, 0.03735858574509621, -0.06095496192574501, 0.07249335199594498, 0.011857538484036922, -0.047966118901968, 0.020818915218114853, 0.010438968427479267, 0.024419520050287247, 0.02873539924621582, -0.06295927613973618, 0.008530797436833382, -0.05360254645347595, -0.02337886020541191, 0.0278923399746418, 0.0010076473699882627, 0.015802323818206787, 0.04462895914912224, -0.14844416081905365, -0.03139619156718254, 0.056155141443014145, 0.002406245330348611, 0.024553606286644936, 0.01134150568395853, -0.012350330129265785, 0.03695530816912651, 0.035094987601041794, -0.10814303904771805, -0.023673279210925102, 0.07155606150627136, -0.0046548969112336636, 0.019057316705584526, 0.029764637351036072, 0.02433221973478794, -0.0018106598872691393, 0.009307042695581913, 0.052085939794778824, 0.0762721374630928, 0.06002429127693176, 0.030446909368038177, 0.0051140375435352325, 0.006149425636976957, -0.019719332456588745, -0.003566192463040352, -0.03360996022820473, -0.032764680683612823, -0.003467786591500044, 0.003301889169961214, -0.00044967563007958233, 0.018880344927310944, 0.0017532381461933255, 0.03652489185333252, -0.0775785744190216, -0.014890182763338089, -0.04506213217973709, 0.005182862281799316, -0.09502050280570984, 0.07542602717876434, -0.01762808859348297, -0.07481586188077927, -0.017488673329353333, 0.03845563530921936, -0.11551300436258316, -0.03008035384118557, -0.003272161353379488, -0.06873605400323868, -0.03140987083315849, 0.021087972447276115, -0.059732258319854736, -0.060995977371931076, -5.351479541762727e-33, 0.014924180693924427, -0.02665678597986698, -0.01489074993878603, 0.01141676027327776, -0.02560819312930107, -0.033262383192777634, 0.024328166618943214, 0.1418919563293457, 0.06862051784992218, -4.9865557230077684e-05, -0.01245619636029005, 0.020702771842479706, -0.05339342728257179, -0.06018941104412079, 0.028952371329069138, 0.05074547603726387, 0.011721883900463581, -0.03023422509431839, 0.0558621883392334, 0.0036644968204200268, -0.0021807022858411074, 0.017454635351896286, -0.11834125965833664, -0.0009613978327251971, -0.04491986334323883, 0.06686725467443466, 0.030657650902867317, -0.01390265952795744, -0.01309224497526884, 0.015299881808459759, -0.060574647039175034, -0.023779742419719696, -0.06448926031589508, 0.04002467170357704, 0.015722522512078285, 0.012670251540839672, 0.030511245131492615, -0.05603331699967384, -0.07757284492254257, -0.016975801438093185, 0.117231085896492, -0.018261743709445, -0.1094028428196907, -0.017648901790380478, -0.02961728163063526, 0.044986676424741745, -0.12223950028419495, 0.09879621863365173, -0.05119488015770912, 0.020700613036751747, 0.00923999585211277, -0.041572146117687225, 0.003366421675309539, -0.08076860010623932, -0.03883109986782074, 0.0042877295054495335, 0.0937037318944931, 0.006780171766877174, -0.04833901301026344, 0.038332339376211166, -0.07927149534225464, -0.09749584645032883, -0.021415604278445244, -0.04277532920241356, -0.01164065208286047, 0.02673107199370861, -0.045680198818445206, 0.010673632845282555, 0.009708862751722336, -0.06841685622930527, 0.13230052590370178, -0.005624460056424141, 0.031418487429618835, 0.013739252462983131, -0.0007311346125788987, 0.07536133378744125, -0.0054972064681351185, -0.017877545207738876, -0.012640411034226418, 0.006502757780253887, 0.011182686313986778, -0.0019469695398584008, 0.006747760344296694, 0.0829228013753891, 0.08231748640537262, 0.07699662446975708, 0.027857283130288124, 0.014507775194942951, 0.03737403452396393, 0.03513159230351448, -0.03936082869768143, 0.13377800583839417, 0.05761231854557991, 0.045875661075115204, -0.00016032738494686782, -4.440119028004119e-08, -0.04452691227197647, -0.05272890254855156, -0.044747550040483475, -0.034740518778562546, -0.07562848180532455, -0.025341223925352097, 0.010702771134674549, 0.002939321333542466, -0.03397927060723305, -0.03664882481098175, 0.04269471392035484, -0.030494051054120064, -0.025294438004493713, 0.007103148382157087, 0.049314871430397034, 0.087440125644207, 0.010432157665491104, 0.07178574800491333, -0.019318947568535805, 0.014961713925004005, 0.0766458660364151, 0.025876224040985107, 0.02746662311255932, 0.0391228049993515, -0.08409342914819717, -0.048534248024225235, -0.043944425880908966, 0.030744323506951332, -0.06090997904539108, -0.08488555997610092, 0.01805538311600685, 0.032932065427303314, 0.022262174636125565, 0.03771989420056343, 0.044963933527469635, 0.07048557698726654, -0.07773333042860031, -0.09355580806732178, -0.001417188555933535, 0.027727873995900154, 0.019699178636074066, 0.047889143228530884, -0.07407994568347931, -0.05784998834133148, 0.031410932540893555, 0.022958889603614807, 0.03373902663588524, -0.15531319379806519, 0.017235590144991875, 0.040159013122320175, -0.0366695411503315, -0.010213399305939674, -0.030167872086167336, 0.011748619377613068, 0.06615646183490753, 0.005348388571292162, 0.010896945372223854, -0.013242913410067558, -0.013441229239106178, 0.1121135726571083, 0.021369703114032745, 0.07982422411441803, 0.025199173018336296, 0.044129323214292526 ] }, { "text": "Live Demo →\n\n📊\n\nLanguage Detection\n\nI've learned how to use HuggingFace and Streamlit with this project. It is a simple language detection UI.\n\nPython\nStreamlit\n\nLive Demo →\n\n🎬\n\nMovie Recommendation System\n\nA personalized movie recommendation engine using collaborative filtering with matrix factorization. Rate movies you've seen and get tailored suggestions based on learned preferences.\n\nPython\nTensorFlow\nStreamlit\n\nView Code →\n\n💡\n\nView My GitHub\n\nYou may come across some interesting works.\n\nMy Portfolio on GitHub →\n\nGoogle Colab Notebooks\n\nInteractive tutorials and experiments you can run in your browser\n\nQuantization\n\nQuantization with PyTorch and TensorFlow\n\nOpen in Colab\n\nDeep Dream from Scratch\n\nUnderstanding how neural networks \"see\" through feature visualization with PyTorch", "source": "Projects Page", "type": "html_page", "chunk_id": "Projects Page_1", "embedding": [ -0.06739245355129242, -0.1274867206811905, -0.013157708570361137, -0.01177510991692543, 0.08046318590641022, 0.060988899320364, 0.029643161222338676, -0.06360107660293579, -0.053570639342069626, -0.1359243541955948, -0.01157432235777378, -0.04807259514927864, -0.044667474925518036, 0.08392138034105301, -0.012373622506856918, -0.0014625987969338894, 0.04107482731342316, 0.07042033970355988, -0.03685595095157623, -0.14910714328289032, -0.0013801978202536702, -0.03247443214058876, 0.05440230667591095, -0.014292271807789803, 0.054617058485746384, 0.057143617421388626, 0.016965318471193314, 0.00387995271012187, 0.023299092426896095, 0.007046087644994259, 0.03891954571008682, 0.03729584813117981, -0.0016416431171819568, 0.005059370771050453, -0.038664307445287704, -0.0025227779988199472, -0.03754575178027153, -0.0316389761865139, -0.07632744312286377, -0.03401842340826988, -0.05588217452168465, 0.005547512788325548, 0.036841921508312225, -0.03394163399934769, 0.06476974487304688, 0.008396552875638008, -0.03338189795613289, -0.004450039938092232, 0.00480677280575037, 0.0026490415912121534, -0.14378970861434937, -0.07792939245700836, 0.008910931646823883, 0.03626328706741333, -0.04046998545527458, -0.044110145419836044, 0.05182687193155289, -0.01723216287791729, 0.010313712991774082, -0.050781626254320145, -0.023395294323563576, -0.08546789735555649, 0.04636691138148308, 0.017888911068439484, -0.006808889098465443, 0.03812915459275246, 0.001946910284459591, 0.06443959474563599, 0.08569090813398361, -0.06342095136642456, -0.04243091866374016, 0.047725994139909744, 0.02036612294614315, 0.0634603425860405, -0.02363274246454239, -0.03635616600513458, 6.284270784817636e-05, -0.0710253044962883, 0.019691433757543564, -0.04354146867990494, -0.02353234775364399, -0.06484144181013107, 0.0755041241645813, 0.04375940188765526, 0.06242811307311058, -0.0320756733417511, 0.0048043392598629, 0.019594652578234673, -0.032724346965551376, 0.05558586120605469, -0.034904953092336655, -0.013070577755570412, 0.006668619811534882, -0.02868526056408882, 0.022628972306847572, 0.055417750030756, -0.007511431351304054, -0.05857314169406891, -0.07013775408267975, 0.01297762431204319, -0.02878144010901451, -0.06562236696481705, 0.03451259806752205, -0.03498565033078194, 0.0018135278951376677, -0.004399547819048166, 0.052093587815761566, 0.03650978207588196, 0.09007936716079712, -0.031104369089007378, -0.004546034149825573, 0.049734994769096375, -0.01986045576632023, -0.05767188221216202, 0.05954795330762863, 0.04611346498131752, 0.05191566050052643, 0.026756662875413895, 0.05703970417380333, 0.02083524502813816, -0.017238978296518326, 0.07552903890609741, -0.033295996487140656, -0.05425502359867096, 0.05071065574884415, 0.04701094329357147, -0.04324379190802574, 7.133743137986356e-33, 0.08923560380935669, 0.011990870349109173, 0.02528725005686283, 0.006766116712242365, 0.025155803188681602, -0.08968713134527206, 0.05293712764978409, 0.015073793940246105, -0.06902441382408142, -0.04836452007293701, 0.03146747499704361, 0.037817541509866714, -0.08447056263685226, 0.11796696484088898, -0.05772135779261589, -0.14345954358577728, -0.06556810438632965, -0.019041461870074272, 0.006943455431610346, 0.01208440214395523, -0.005620300304144621, 0.03317338600754738, 0.015987420454621315, 0.022861164063215256, -0.04728000611066818, -0.034546419978141785, -0.013923351652920246, -0.03487106040120125, 0.04715999960899353, 0.01948975771665573, -0.09396890550851822, 0.011570139788091183, -0.03873765096068382, -0.034243255853652954, 0.03709574416279793, -0.09451482445001602, -0.04833116754889488, -0.025798054412007332, 0.03571309521794319, -0.019588885828852654, 0.0070076980628073215, -0.050734251737594604, -0.03383457288146019, -0.09975482523441315, -0.07069209963083267, 0.07159626483917236, -0.03857479244470596, 0.037998393177986145, -0.02172541245818138, -0.014121941290795803, 0.02589174173772335, 0.00906766764819622, -0.03799111396074295, 0.07537789642810822, 0.009451055899262428, 0.03374173492193222, 0.05002446472644806, 0.00422590272501111, 0.04413653910160065, -0.050054099410772324, 0.0403362400829792, 0.03764047101140022, 0.07852939516305923, -0.004100233316421509, -0.02053307741880417, 0.02406361699104309, 0.004273247439414263, 0.05841546878218651, 0.06215484440326691, -0.0004651077906601131, -0.0844850093126297, 0.050856586545705795, 0.013881036080420017, -0.001729974988847971, -0.0003102036425843835, 0.01748659461736679, 0.02887449786067009, -0.039380211383104324, 0.03205425292253494, -0.009742223657667637, -0.000817066291347146, -0.08627580851316452, 0.11948076635599136, -0.057971030473709106, -0.06435888260602951, 0.019438426941633224, 0.012159168720245361, -0.09323245286941528, 0.015703001990914345, -0.024907471612095833, -0.054608240723609924, -0.039824049919843674, 0.054264165461063385, 0.0019149488070979714, 0.025963161140680313, -6.539028219810713e-33, 0.008790276944637299, 0.01774163357913494, -0.008436114527285099, 0.003922345582395792, -0.01629037596285343, -0.06481235474348068, -0.031082894653081894, 0.06784062087535858, 0.10508111119270325, -0.03969834744930267, -0.022463485598564148, -0.0555250346660614, -0.026876749470829964, -0.0276431106030941, 0.014878868125379086, -0.001838691416196525, -0.016416164115071297, -0.02316885069012642, 0.016673412173986435, 0.041996538639068604, -0.08087681978940964, 0.042151402682065964, -0.1202964037656784, -0.07141949236392975, -0.05417727679014206, -0.010803475975990295, -0.0006115461001172662, -0.01746646873652935, 0.028189027681946754, -0.02331276424229145, 0.007921324111521244, -0.003454117337241769, -0.052918825298547745, 0.04256073385477066, -0.02156045287847519, 0.014833824709057808, 0.06306017190217972, -0.07611096650362015, -0.0007612426416017115, 0.06596910953521729, 0.11484696716070175, 0.04545681178569794, -0.10039380192756653, -0.0031317356042563915, 0.016431240364909172, 0.06514111906290054, -0.11946645379066467, 0.07162651419639587, -0.09641528129577637, -0.03694945201277733, -0.026415593922138214, 0.03893725946545601, -0.005519534461200237, -0.04517802596092224, -0.04566939175128937, -0.03815833851695061, 0.14245454967021942, 0.012881385162472725, 0.04812918230891228, 0.033297356218099594, -0.10469847917556763, -0.08332056552171707, -0.002635928336530924, -0.10981932282447815, -0.02606094442307949, -0.030162394046783447, -0.05664899945259094, 0.04899604618549347, 0.027781562879681587, -0.06493328511714935, 0.0805266946554184, -0.01642378233373165, 0.008219351060688496, 0.04657001048326492, -0.009897632524371147, 0.03975088894367218, 0.022275298833847046, 0.009342290461063385, 0.027091020718216896, -0.001414590165950358, 0.032878246158361435, -0.011405029334127903, 0.028984518721699715, 0.004935641307383776, 0.10387521237134933, 0.10423841327428818, 0.019713593646883965, 0.013637623749673367, 0.0840190201997757, 0.00038238143315538764, -0.022404784336686134, 0.04590084031224251, 0.028906283900141716, 0.04768546670675278, -0.0019270332995802164, -4.039035061964569e-08, -0.08126574754714966, -0.011086408980190754, -0.04444476589560509, 0.06766180694103241, -0.03577752783894539, -0.009793695993721485, 0.035553354769945145, 0.06634826958179474, 0.023217668756842613, -0.017815401777625084, 0.0027160795871168375, -0.010293086059391499, -0.04116453602910042, -0.008509505540132523, -0.04810645431280136, 0.06828734278678894, -0.0009312091278843582, 0.09077565371990204, 0.02538480795919895, 0.021499648690223694, 0.08573850989341736, 0.01303770113736391, 0.0527300126850605, 0.07339927554130554, -0.055559780448675156, 0.00825435295701027, 0.01643930934369564, 0.03615938499569893, 0.0004761861637234688, -0.020604686811566353, -0.013279324397444725, 0.035840652883052826, 0.03094344399869442, -0.05403324216604233, 0.09052056819200516, 0.12240077555179596, -0.04075240343809128, -0.11628750711679459, -0.012496036477386951, 0.04741864651441574, -0.004863387905061245, -0.023001790046691895, -0.0431552454829216, -0.061771247535943985, 0.03415647894144058, 0.039586372673511505, 0.03983995318412781, -0.15129302442073822, 0.004016991704702377, 0.04805979132652283, 0.008009187877178192, 0.015359069220721722, -0.0341552197933197, 0.07927247881889343, 0.09077312797307968, 0.03869060054421425, -0.0785687267780304, 0.022246887907385826, 0.0007579263183288276, 0.07058035582304001, 0.00787418708205223, 0.10967429727315903, 0.020157627761363983, 0.03300812840461731 ] }, { "text": "Open in Colab\n\nDeep Dream from Scratch\n\nUnderstanding how neural networks \"see\" through feature visualization with PyTorch\n\nOpen in Colab\n\nReach me\n\nif you have any questions about my projects!\n\nLinkedin ->\n\n© 2025 Tiny AI World. Free and Open Source.\n\nGitHub •\nLicense •\nAbout", "source": "Projects Page", "type": "html_page", "chunk_id": "Projects Page_2", "embedding": [ -0.032897211611270905, -0.131740003824234, 0.003940045367926359, 0.04605565592646599, 0.06472162157297134, 0.016438843682408333, -0.03839568793773651, 0.017772166058421135, -0.03243958577513695, -0.07363244891166687, -0.05109351500868797, -0.050469912588596344, -0.05309173837304115, -0.022475803270936012, -0.05517507344484329, 0.08177584409713745, 0.02323952689766884, 0.032727375626564026, -0.07845980674028397, -0.12821534276008606, 0.006529463920742273, -0.05714382231235504, 0.017409855499863625, -0.04330474138259888, 0.014353463426232338, 0.018959062173962593, 0.045829690992832184, -0.02882293425500393, 0.038906313478946686, -0.03816332668066025, 0.00957401841878891, 0.02405261993408203, 0.0187863577157259, 0.019640645012259483, 0.02471638098359108, 0.051425013691186905, -0.0074342116713523865, -0.01055101491510868, -0.09160837531089783, -0.10876475274562836, 0.05608720704913139, -0.02990005351603031, -0.001293327659368515, -0.002002439461648464, 0.09105615317821503, -0.00029832348809577525, -0.010577174834907055, -0.06712722778320312, 0.061014849692583084, -0.04357965290546417, -0.12483096122741699, -0.10542230308055878, -0.04438523203134537, 0.004201095085591078, 0.01489209197461605, 0.046324681490659714, 0.040269847959280014, -0.06935683637857437, -0.022609062492847443, -0.00947696715593338, 0.0605119913816452, -0.03866439685225487, 0.03414072096347809, 0.03030385635793209, 0.07220863550901413, 0.01966743730008602, -0.011991488747298717, 0.04617038741707802, 0.03943439945578575, -0.1606529802083969, 0.0637323260307312, 0.04583628475666046, -0.03759482130408287, 0.006994671653956175, -0.0034410760272294283, -0.02526894211769104, 0.004585921764373779, 0.003954540938138962, 0.033473629504442215, -0.02523043192923069, -0.028921248391270638, -0.02726675197482109, 0.02929919958114624, 0.07405515015125275, 0.007600697688758373, 0.03719481825828552, -0.024436092004179955, 0.03439657390117645, -0.024257594719529152, -0.009871642105281353, 0.00422597024589777, -0.020734669640660286, -0.04696961119771004, -0.019391249865293503, 0.021500596776604652, -0.06615803390741348, 0.0383908711373806, -0.0901138111948967, -0.05360284820199013, 0.05261809751391411, -0.05356119945645332, -0.044647663831710815, 0.04254714399576187, -0.02094508893787861, -0.02197253704071045, 0.045124344527721405, 0.12043094635009766, 0.016919396817684174, 0.0849931538105011, 0.0029000479262322187, 0.030855117365717888, -0.019683491438627243, 0.05163342133164406, -0.013012771494686604, 0.054784078150987625, -0.0031594526953995228, -0.04519122093915939, 0.05661026015877724, 0.0757298469543457, 0.01652059704065323, -0.06736347079277039, 0.03899907320737839, -0.05430078133940697, 0.011829344555735588, -0.011470157653093338, 0.0057635861448943615, -0.08359798789024353, 3.868329666655446e-33, 0.04397742822766304, -0.028803354129195213, 0.02203277498483658, 0.013569948263466358, 0.10549069941043854, -0.08245165646076202, 0.04556821659207344, 0.006719182711094618, -0.09663485735654831, 0.03713866323232651, -0.010400919243693352, 0.022108422592282295, -0.06037576496601105, 0.13220569491386414, -0.0029462554957717657, -0.11819513142108917, -0.0004196337249595672, -0.005587929859757423, -0.02060159109532833, -0.01246173307299614, 0.012405093759298325, -0.007622830104082823, -0.015010072849690914, 0.08013221621513367, -0.0001744573237374425, 0.002998847048729658, 0.0029272236861288548, -0.022138061001896858, 0.06672688573598862, 0.01261015236377716, -0.05583171173930168, 0.09848027676343918, -0.06329920887947083, -0.006851817946881056, -0.03498847410082817, -0.007613906636834145, -0.015558592043817043, -0.027404138818383217, -0.004838717635720968, -0.0030146059580147266, -0.02631681226193905, 0.023222440853714943, -0.038898076862096786, -0.043398063629865646, -0.0469198152422905, -0.0033019131515175104, 0.025052152574062347, 0.08968452364206314, -0.004293553531169891, -0.04130875691771507, -0.07202257961034775, 0.0018537761643528938, -0.1248394250869751, 0.006503347307443619, 0.07815081626176834, -0.020249826833605766, 0.017907289788126945, -0.0025649406015872955, 0.028892938047647476, 0.03290621191263199, 0.04666196182370186, 0.05842943117022514, 0.004379947204142809, 0.019564857706427574, -0.046381864696741104, 0.10010940581560135, -0.0432024709880352, 0.0471724234521389, 0.052548568695783615, 0.07184681296348572, -0.06834713369607925, 0.08709481358528137, -0.011560761369764805, -0.020367080345749855, 0.02570943348109722, 0.050497546792030334, 0.006606007926166058, -0.06882882118225098, 0.00883158016949892, -0.014566449448466301, -0.010856488719582558, -0.0064506614580750465, -0.0076502785086631775, 0.021411603316664696, -0.056405119597911835, 0.013015015050768852, 0.0037416887935250998, -0.0471823513507843, -0.008391731418669224, 0.006280797999352217, -0.07442566007375717, -0.019035929813981056, 0.025184908881783485, -0.03531690314412117, -0.07207188755273819, -3.575272312839726e-33, -0.04861827567219734, 0.05760978162288666, -0.029684239998459816, 0.029729871079325676, 0.004735284950584173, -0.019780371338129044, -0.060798823833465576, 0.015835974365472794, 0.048995207995176315, 0.05500011146068573, 0.004287466872483492, 0.01988808624446392, 0.009010310284793377, -0.01921483874320984, 0.03165866807103157, 0.003060337156057358, 0.017379848286509514, -0.0231782253831625, -0.052078887820243835, -0.007317285519093275, -0.05247166007757187, 0.09799008816480637, -0.0643438845872879, -0.05926564335823059, 0.01191740296781063, 0.0009418551926501095, -0.0362677238881588, 0.01667112112045288, -0.012177794240415096, -0.025233693420886993, -0.017416952177882195, -0.02777007408440113, -0.09845691174268723, 0.011804166249930859, -0.00032126635778695345, 0.056644171476364136, 0.04468844085931778, -0.10657250136137009, 0.014107338152825832, -0.011800847016274929, 0.0576733835041523, -0.04508469998836517, -0.0810299962759018, -0.025300659239292145, -0.036378271877765656, 0.010876868851482868, -0.09419828653335571, 0.0602133609354496, -0.06478585302829742, 0.003559945849701762, -0.0024968627840280533, 0.025416957214474678, 0.0011528864270076156, -0.08719367533922195, -0.06057310476899147, 0.0016068773111328483, 0.12127979099750519, 0.01721782609820366, 0.04272400587797165, -0.0005279696197248995, -0.046898771077394485, -0.12057815492153168, -0.003187978407368064, -0.022808359935879707, -0.048787131905555725, -0.02721957117319107, -0.021910471841692924, 0.13036948442459106, 0.042201701551675797, -0.07786311954259872, 0.00011514962534420192, 0.003137914463877678, 0.10275640338659286, 0.09430856257677078, -0.022354919463396072, 0.016237400472164154, 0.0017502177506685257, 0.017750298604369164, 0.030475202947854996, 0.02489403635263443, 0.052788037806749344, 0.002271234290674329, 0.06050264835357666, 0.029754022136330605, 0.11186600476503372, 0.10774707794189453, 0.07821667194366455, 0.02416648529469967, 0.06680072098970413, 0.06384488195180893, -0.10530892759561539, 0.07063816487789154, 0.002496990840882063, 0.10701564699411392, -0.021205386146903038, -3.1707070746733734e-08, -0.06332939863204956, 0.021167142316699028, 0.049136701971292496, 0.0476357564330101, -0.007713954895734787, -0.02863248437643051, 0.032907698303461075, 0.05927014723420143, -0.05060937628149986, 0.028401466086506844, -0.035462044179439545, -0.004140845034271479, -0.06940655410289764, 0.025175264105200768, 0.023681558668613434, 0.10223112255334854, 0.01948588714003563, -0.023286862298846245, 0.03537312150001526, -0.04797665402293205, 0.048184800893068314, 0.008174194023013115, 0.035307928919792175, 0.08823946863412857, -0.046668268740177155, -0.09187263995409012, -0.09203754365444183, 0.06263936311006546, -0.05710441619157791, -0.009013975970447063, 0.027351658791303635, 0.06840038299560547, 0.08438287675380707, -0.02431860752403736, 0.08623239398002625, 0.09614009410142899, -0.01831226982176304, 0.035167474299669266, -0.033161818981170654, 0.010480494238436222, -0.07648029178380966, -0.004426216706633568, 0.008077576756477356, -0.047296732664108276, -0.04904629662632942, -0.029024025425314903, 0.027987567707896233, -0.11198071390390396, 0.010571960359811783, 0.06982188671827316, -0.008525040931999683, 0.05164078250527382, -0.008961109444499016, 0.09579169750213623, 0.07537300884723663, 0.034158892929553986, -0.026710204780101776, -0.04911462962627411, -0.027235619723796844, 0.08527783304452896, -0.04619990661740303, 0.05181404575705528, -0.04740285500884056, -0.03546764329075813 ] }, { "text": "About - Tiny AI World\n\n• 🧠\">\n\n•\n\n🧠 Tiny AI World\n\nHome\nAll Notes\nProjects\nCV\nAbout\n\n🌙\n\nAbout Tiny AI World\n\nA personal platform for exploring AI, Machine Learning, and beyond.\n\n🌍 What is This?\n\nTiny AI World is an interactive platform that visualizes the connections between\ndifferent topics in AI, machine learning, programming, and data science. Unlike traditional\nnote-taking apps, this platform shows how concepts relate to each other, making it easier\nto understand the bigger picture.\n\nEvery node in the graph represents a topic, and the connections show how these topics\nare related. Click on any node to dive deeper into that subject.\n\n🎯 The Mission", "source": "About Page", "type": "html_page", "chunk_id": "About Page_0", "embedding": [ 0.03441380709409714, 0.005690385587513447, -0.010818722657859325, 0.03960743173956871, 0.12525099515914917, -0.04782754182815552, 0.0036850383039563894, 0.01676575094461441, -0.03859356418251991, 0.014007099904119968, 0.015081341378390789, -0.06705771386623383, 0.040977731347084045, 0.01535360049456358, -0.05078179016709328, 0.07903753221035004, -0.021722184494137764, -0.03388502821326256, -0.06635971367359161, -0.10235828906297684, -0.025779029354453087, -0.0025418330915272236, -0.02212398126721382, -0.009702296927571297, -0.014488019980490208, 0.08972680568695068, -0.0022113099694252014, -0.03806040436029434, 0.04383595660328865, -0.017576107755303383, -0.01685894839465618, 0.033789247274398804, 0.036317627876996994, 0.02900746837258339, -0.011584628373384476, 0.10209522396326065, -0.02658720314502716, -0.0011102833086624742, 0.0326814167201519, -0.006999985780566931, 0.02643074281513691, -0.0263877771794796, 0.04189905896782875, -0.06418386846780777, 0.034648437052965164, 0.06074903532862663, -0.07393142580986023, -0.06133163720369339, -0.03999320790171623, -0.01434126403182745, -0.13311649858951569, -0.09305457025766373, -0.08541767299175262, 0.008089772425591946, -0.05660944804549217, 0.013531507924199104, 0.007519218605011702, -0.026466989889740944, 0.014357219450175762, 0.016091452911496162, 0.06778788566589355, -0.07423093914985657, 0.10571762174367905, 0.044311728328466415, 0.07079894095659256, 0.05709539353847504, -0.022392289713025093, -0.0029672228265553713, -0.02302895113825798, -0.13287459313869476, 0.04475948214530945, 0.043393269181251526, -0.0540943443775177, 0.12273715436458588, -0.008785178884863853, -0.04372737556695938, -0.007894239388406277, -0.02266409620642662, 0.045241277664899826, 0.03395059332251549, -0.06079787388443947, -0.008764847181737423, -0.04231686145067215, 0.0688321590423584, -0.016821712255477905, 0.008129773661494255, -0.005269329994916916, -0.05894903838634491, 0.055679112672805786, -0.0294876117259264, 0.010181505233049393, -0.007713848724961281, 0.03772971034049988, 0.0007502077496610582, 0.014942264184355736, -0.046348102390766144, 0.028349675238132477, -0.11600730568170547, -0.11517468839883804, 0.06172192841768265, 0.019056105986237526, 0.024306965991854668, 0.05934697389602661, 0.01596379093825817, -0.012493148446083069, 0.05702587217092514, 0.0762990415096283, -0.04571226239204407, 0.05350615829229355, 0.0011206294875591993, -0.0644102618098259, 0.02816188894212246, -0.00222561857663095, -0.027909819036722183, 0.021812528371810913, -0.04413712024688721, 0.032606132328510284, 0.0369722917675972, 0.03227192163467407, 0.06724345684051514, -0.006082193925976753, -0.03068147413432598, -0.03954502195119858, -0.03208315372467041, 0.07271243631839752, 0.03688248246908188, -0.06221213564276695, 3.611394152214541e-33, 0.036374349147081375, 0.039935920387506485, 0.026288744062185287, 0.011181303299963474, 0.0996352955698967, -0.04334409162402153, 0.020682819187641144, -0.013443216681480408, -0.0923108458518982, 0.011136068031191826, -0.03899504244327545, 0.04648512229323387, -0.02390848845243454, 0.0693054273724556, 0.06910040974617004, -0.07926877588033676, 0.046943213790655136, 0.0023271841928362846, 0.004531785845756531, 0.03937285393476486, -0.0033072703517973423, -0.03984684869647026, 0.018468383699655533, 0.04909893870353699, 0.06378963589668274, 0.029414085671305656, 0.07836231589317322, -0.06688657402992249, 0.06817100942134857, 0.022665882483124733, -0.09188144654035568, 0.031308289617300034, -0.08534753322601318, -0.05314401909708977, 0.007822279818356037, 0.0030569268856197596, -0.0026096762157976627, -0.028453756123781204, 0.00024566942011006176, 0.009528666734695435, -0.015617012046277523, 0.02798919752240181, -6.618086445087101e-06, -0.09625890105962753, -0.02041797712445259, -0.002099879551678896, 0.07454829663038254, -0.009307163767516613, 0.03567270562052727, -0.07598403841257095, -0.04341365024447441, -0.01117598544806242, -0.039304595440626144, -0.05041477084159851, 0.10960279405117035, -0.006287978962063789, 0.005040024872869253, 0.011038697324693203, -0.02164042554795742, 0.01081458292901516, 0.04193822294473648, -0.006172943860292435, -0.020207613706588745, 0.0755876749753952, 0.03691166639328003, 0.06720423698425293, 0.021286912262439728, -0.012606733478605747, 0.07388851791620255, 0.019025886431336403, -0.02242901921272278, 0.04171401634812355, 0.08938165009021759, 0.0059623802080750465, 0.006237650755792856, -0.0014762599021196365, -0.0008814363391138613, -0.10868965834379196, -0.04712049290537834, -0.0197773315012455, -0.08560851961374283, -0.054831717163324356, -0.017096713185310364, -0.008960457518696785, -0.0027573537081480026, -0.10354945063591003, 0.0245533250272274, -0.0181757602840662, -0.041009195148944855, -0.04956034570932388, -0.09163159132003784, 0.009830225259065628, 0.010866750963032246, 0.011368601582944393, -0.07976400852203369, -3.9126564565990004e-33, -0.11159814149141312, -0.04185306653380394, -0.038862694054841995, 0.035369884222745895, 0.002403823658823967, -0.014033537358045578, -0.010022083297371864, 0.040512815117836, -0.025006931275129318, 0.10048790276050568, -0.03307538852095604, -0.009909733198583126, 0.009436901658773422, -0.033060021698474884, 0.015375996008515358, 0.07500294595956802, -0.006195985712110996, -0.07025130093097687, 0.053031083196401596, 0.023123979568481445, 0.06985299289226532, 0.017490673810243607, -0.08230376243591309, -0.007374349050223827, 0.07344213128089905, 0.031176550313830376, 0.005171638913452625, 0.011365015991032124, 0.0017602451844140887, 0.011618152260780334, -0.08794032037258148, -0.0706733763217926, -0.0791994109749794, -0.02678000181913376, 0.020892281085252762, -0.0070514134131371975, -0.020818300545215607, -0.10082342475652695, -0.016548708081245422, 0.017501551657915115, 0.054903700947761536, -0.07029113173484802, -0.04782336950302124, -0.026088537648320198, -0.07703376561403275, 0.009041561745107174, -0.07794611155986786, 0.1035836711525917, -0.019827211275696754, -0.03260910511016846, 0.021573657169938087, -0.011059950105845928, 0.0007920353673398495, -0.08876240253448486, -0.10162919014692307, 0.0205973032861948, 0.049348264932632446, 0.08466268330812454, -0.0008915042853914201, 0.010358146391808987, -0.05920230224728584, -0.11976150423288345, 0.007540435530245304, 0.054200273007154465, -0.07534972578287125, 0.014040696434676647, 0.014977790415287018, 0.04982422664761543, -0.04067416116595268, -0.05405491963028908, 0.06501466035842896, 0.03929910436272621, 0.05660739913582802, 0.0024356134235858917, -0.029495494440197945, 0.026635410264134407, -0.044461823999881744, -0.015155150555074215, 0.030980946496129036, -0.019169272854924202, 0.07809723168611526, 0.025859752669930458, 0.010571755468845367, 0.006685514934360981, 0.09413165599107742, 0.03226621076464653, 0.0036393769551068544, 0.06175142899155617, -0.046579509973526, 0.06858901679515839, -0.08494993299245834, 0.09567371010780334, 0.01672719419002533, -0.003447649534791708, -0.16868717968463898, -4.454318869306917e-08, -0.01762557402253151, -0.024383436888456345, 0.08938807249069214, 0.00704239634796977, 0.0014892782783135772, -0.005009112413972616, 0.01256414595991373, 0.03262950852513313, -0.03977014496922493, 0.06600647419691086, 0.03221740201115608, -0.051654115319252014, -0.04141589254140854, 0.06620869785547256, 0.08872789144515991, 0.05208291858434677, -0.011943357065320015, -0.0509926863014698, 0.04453836753964424, -0.0038022317457944155, 0.10533152520656586, -0.005487047601491213, -0.025515204295516014, 0.026260633021593094, 0.017200728878378868, -0.12198575586080551, -0.019774718210101128, 0.07270564883947372, -0.11652589589357376, -0.06990750133991241, -0.025249755010008812, 0.06316696107387543, 0.014612097293138504, 0.025119727477431297, -0.0010179666569456458, 0.08179546892642975, 0.025257548317313194, -0.0039304750971496105, -0.039607368409633636, -0.04822671785950661, -0.03561275452375412, 0.03908320516347885, -0.01078843418508768, -0.035281743854284286, 0.02309345453977585, 0.004324514884501696, 0.013864357955753803, -0.12468653917312622, 0.0676896721124649, 0.00820629857480526, -0.05910101532936096, -0.008139737881720066, 0.013702268712222576, 0.03637164086103439, 0.09291552752256393, 0.04562080278992653, 0.020706521347165108, -0.04314560815691948, 0.036703962832689285, 0.10263021290302277, 0.022672506049275398, 0.06272367388010025, -0.02270720712840557, -0.005321512930095196 ] }, { "text": "🎯 The Mission\n\nMy goal is to create a free, open-source learning resource that helps people understand\ncomplex AI/ML concepts through connected, bite-sized notes. Knowledge is better when it's\nshared, and learning is more effective when you can see the relationships between ideas.\n\n👋 About Me\n\nHi! I'm Pelin, an Industrial Engineer with MSc and Machine Learning Engineer passionate about\nartificial intelligence, machine learning, and building tools that help people learn.\n\nI created Tiny AI World to organize my own learning journey and share knowledge with others.\nThrough this platform, I document what I learn, build connections between concepts, and\nhopefully help others on their learning path.\n\nConnect with me:\n\nGitHub\n\nLinkedIn\n\nTwitter\n\nMedium\n\n🛠️ Built With\n\nD3.js", "source": "About Page", "type": "html_page", "chunk_id": "About Page_1", "embedding": [ -0.052269648760557175, -0.12361407279968262, -0.010787861421704292, 0.029400881379842758, 0.07954664528369904, -0.05036746710538864, 0.032524075359106064, 0.03967465087771416, 0.014117270708084106, 0.023594768717885017, 0.02556527964770794, 0.04363347589969635, -0.0035310261882841587, 0.002114587463438511, 0.0357808880507946, 0.08289588987827301, -0.018202755600214005, 0.01772838644683361, -0.057887002825737, -0.11614808440208435, -0.008882812224328518, -0.012000896967947483, 0.04923577606678009, 0.011204995214939117, 0.021386759355664253, 0.017391441389918327, -0.004900028929114342, -0.02904883399605751, 0.07280061393976212, -0.021612031385302544, -0.004425679333508015, -0.009729761630296707, -0.032692644745111465, -0.008023701608181, -0.01414804719388485, 0.1312480866909027, -0.050818461924791336, 0.016928624361753464, -0.008110564202070236, 0.013914636336266994, -0.00799285527318716, -0.006295809522271156, -0.0027838770765811205, -0.03761645779013634, 0.08608830720186234, 0.05091799795627594, -0.08191832154989243, -0.06705331057310104, -0.005480846855789423, 0.018250616267323494, -0.14509092271327972, -0.12858152389526367, -0.01607704348862171, 0.031526993960142136, -0.008862350136041641, 0.047890231013298035, -0.0042583514004945755, 0.028440335765480995, -0.05065101385116577, -0.05037587508559227, 0.07346876710653305, -0.09358380734920502, 0.02959379553794861, -0.03147516027092934, 0.017351293936371803, 0.007684853859245777, -0.03793533146381378, 0.13813385367393494, 0.010491247288882732, -0.08501119166612625, 0.020769676193594933, 0.08432681113481522, 0.015102938748896122, 0.09421583265066147, -0.00915850792080164, 0.014912262558937073, 0.0034047383815050125, -0.026516512036323547, 0.004987672436982393, -0.027997786179184914, -0.018414031714200974, 0.06668490916490555, 0.02040497399866581, 0.08325743675231934, 0.0002402220998192206, -0.004151041153818369, 0.0391845740377903, -0.01684839092195034, -0.0059730843640863895, 0.06308263540267944, 0.019296057522296906, 0.03532291203737259, 0.009779302403330803, -0.03282000496983528, 0.09123124927282333, 0.03016439452767372, 0.02522195130586624, -0.11597289144992828, -0.10266244411468506, 0.047695938497781754, -0.06621373444795609, 0.09254080802202225, 0.0409928634762764, -0.01877358928322792, -0.007547912187874317, 0.12334637343883514, -0.0251297689974308, 0.03547605127096176, 0.04839787259697914, -0.023479780182242393, 0.026136398315429688, 0.02452034130692482, -0.034228838980197906, -0.05142674967646599, 0.024738427251577377, -0.018197719007730484, 0.03768552839756012, -0.0005826016422361135, 0.17354066669940948, 0.05002986639738083, 0.009382559917867184, 0.08086279779672623, -0.02876443974673748, 0.0015820051776245236, 0.04157049208879471, -0.011961794458329678, -0.051724787801504135, 3.4965505581911115e-33, 0.09293579310178757, 0.0706389769911766, 0.010816618800163269, 0.042663831263780594, 0.02417590469121933, -0.06345047801733017, -0.03571346402168274, 0.011868090368807316, -0.1605905145406723, -0.020166924223303795, -0.03769818693399429, 0.0742855966091156, -0.04101403057575226, 0.05286562070250511, -0.019459625706076622, -0.10865984112024307, -0.03209908679127693, 0.02463441528379917, 0.01602666638791561, 0.01747259311378002, 0.028190212324261665, -0.04356199875473976, -0.026578199118375778, 0.029950125142931938, 0.0217535812407732, -0.0062414915300905704, 0.059680745005607605, -0.05732957273721695, 0.06655575335025787, -0.014225597493350506, -0.031170250847935677, 0.05292925983667374, -0.0292624793946743, -0.07144759595394135, 0.013910111971199512, -0.053811196237802505, -0.0669017806649208, -0.025623377412557602, -0.022835226729512215, 0.0025395164266228676, 0.009753088466823101, -0.015698106959462166, 0.058809876441955566, -0.10138736665248871, -0.0759798064827919, 0.055847082287073135, 0.048105090856552124, -0.06836320459842682, 0.06003629416227341, -0.08912326395511627, -0.04595800116658211, -0.048110250383615494, -0.04872315376996994, 0.011243966408073902, 0.039847929030656815, -0.035705555230379105, -0.03332653269171715, 0.044481221586465836, 0.04872000962495804, -0.020207015797495842, 0.018569938838481903, 0.039798296988010406, 0.0013977179769426584, 0.05862991884350777, 0.0038002722430974245, 0.03975500911474228, -0.04438680037856102, 0.03276669606566429, 0.08845268934965134, -0.06775330752134323, -0.024908924475312233, 0.038793355226516724, 0.03281624615192413, -0.02752566896378994, -0.04027732461690903, -0.021113703027367592, -0.05013098567724228, -0.11350427567958832, 0.03995807468891144, -0.030577775090932846, 0.0022616509813815355, -0.0673270896077156, 0.04571806639432907, -0.013792046345770359, -0.022765010595321655, -0.005533522926270962, -0.021348118782043457, -0.056765537708997726, 0.013763386756181717, 0.04536181315779686, -0.042668409645557404, 0.0407027043402195, -0.0025339522399008274, 0.03657500073313713, -0.09646505117416382, -3.1916188747221636e-33, -0.0520760752260685, 0.010234642773866653, 0.013610433787107468, 0.04216647893190384, 0.043209534138441086, 0.07097296416759491, -0.0698733702301979, 0.07409496605396271, 0.011792670004069805, 0.07324577867984772, -0.0052354903891682625, -0.02651270665228367, -0.07840201258659363, -0.030183134600520134, -0.03481300175189972, -0.020092353224754333, 0.006881313864141703, -0.06387972086668015, -0.010643032379448414, -0.006867308169603348, -0.04892420396208763, 0.026238346472382545, -0.07238451391458511, 0.028644243255257607, 0.06658584624528885, 0.037856899201869965, 0.012518756091594696, 0.02902504801750183, -0.03201557323336601, 0.08497811108827591, -0.03938416764140129, -0.062202177941799164, -0.01507608499377966, 0.007712547201663256, -0.01817876659333706, 0.05288773775100708, -0.02279352955520153, -0.03915829584002495, -0.004673886112868786, 0.006493662018328905, 0.10839132964611053, -0.056346114724874496, -0.035078614950180054, -0.12126204371452332, -0.07258083671331406, -0.005705834832042456, -0.0771714523434639, 0.062283601611852646, -0.04705499857664108, 0.0071121701039373875, 0.030231967568397522, -0.04734175652265549, 0.06246993690729141, -0.13030147552490234, -0.042670078575611115, -0.015295563265681267, 0.09974946826696396, -0.004964390303939581, -0.038021400570869446, 0.020816128700971603, -0.05550776422023773, -0.06404449045658112, 0.013358074240386486, 0.06724836677312851, -0.03407156839966774, -0.08030422776937485, -0.030363477766513824, 0.07594114542007446, -0.022854097187519073, -0.04116515442728996, -0.008709280751645565, 0.048312846571207047, 0.054136455059051514, -0.08034741133451462, 0.045169662684202194, 0.007985595613718033, -0.018682481721043587, 0.015177696943283081, -0.028877032920718193, -0.017108572646975517, 0.02338995970785618, -0.008966813795268536, 0.03445933014154434, 0.046855829656124115, 0.10006549209356308, 0.09176317602396011, 0.044298820197582245, 0.07801008224487305, -0.019032031297683716, 0.028874795883893967, -0.06728620827198029, 0.09456998109817505, -0.0033222853671759367, 0.07357688248157501, -0.05192386731505394, -4.390452090774488e-08, -0.05731562525033951, -0.04907478392124176, -0.01720651052892208, 0.03992355987429619, -0.02519422210752964, 0.00018548403750173748, 0.009996348060667515, 0.06357256323099136, -0.0647376999258995, 0.09788060188293457, 0.008568231016397476, -0.030272351577878, -0.06855130940675735, 0.030142389237880707, 0.02310038171708584, 0.02779773436486721, -0.010870725847780704, -0.04678736999630928, 0.02096696011722088, -0.07839016616344452, 0.10207749158143997, -0.0020394925959408283, -0.04098062217235565, 0.03522329404950142, 0.03016742318868637, -0.06075296923518181, -0.03479814901947975, 0.08218703418970108, -0.09199564903974533, -0.04955762252211571, -0.01637973077595234, 0.030735153704881668, -0.008283867500722408, -0.0243573896586895, 0.04346737638115883, 0.039797864854335785, 0.014960463158786297, -0.04469051584601402, -0.017462393268942833, -0.02137739025056362, -0.002609996357932687, 0.0758533626794815, 0.049421340227127075, -0.03974606841802597, 0.026550956070423126, 0.03809838369488716, -0.013239449821412563, -0.06797872483730316, -0.02196834608912468, -0.010946862399578094, -0.04251441732048988, 0.005881535820662975, 0.02981298416852951, 0.04032522439956665, 0.09805364906787872, 0.01094929687678814, 0.0048657553270459175, 0.0628342553973198, -1.2292460269236472e-05, 0.06194118782877922, 0.022901898249983788, 0.011361369863152504, -0.04047367349267006, 0.051888465881347656 ] }, { "text": "Connect with me:\n\nGitHub\n\nLinkedIn\n\nTwitter\n\nMedium\n\n🛠️ Built With\n\nD3.js\n\nInteractive graph visualization\n\nVanilla JS\n\nLightweight and fast\n\nMarkdown\n\nEasy content creation\n\nGitHub Pages\n\nFree hosting\n\n✨ Features\n\n• Interactive knowledge graph visualization\n•\n\n• Search across all topics\n•\n\n• Category-based filtering\n•\n\n• Dark/Light mode\n•\n\n• Mobile responsive design\n•\n\n• Easy note creation with Markdown\n•\n\n• Automatic relationship mapping\n•\n\n• Free and open source\n•\n\n🤝 Contributing\n\nThis is an open-source project! If you find errors, have suggestions, or want to contribute\ncontent, feel free to:\n\n• Open an issue on GitHub\n•\n\n• Submit a pull request\n•\n\n• Share feedback via email\n•\n\n• Fork the project for your own knowledge graph\n•\n\n📄 License", "source": "About Page", "type": "html_page", "chunk_id": "About Page_2", "embedding": [ -0.022123245522379875, -0.0665658488869667, 0.0074740927666425705, 0.020270243287086487, 0.07897904515266418, -0.07234509289264679, -0.0418461337685585, -0.0016791585367172956, -0.00787941925227642, 0.10235737264156342, 0.014882080256938934, 0.025913799181580544, 0.009456046856939793, 0.02460857480764389, 0.057670269161462784, 0.06106110289692879, -0.0012971226824447513, 0.015372617170214653, 0.017472021281719208, -0.1062784492969513, -0.03413228690624237, -0.01420065201818943, 0.0361635759472847, 0.0010080923093482852, 0.08392734825611115, -0.05671690031886101, -0.05619506910443306, -0.0013408921658992767, 0.01889578439295292, -0.03804454952478409, -0.05501197651028633, 0.017681043595075607, -0.04644722118973732, -0.009121554903686047, -0.010181641206145287, 0.07612194865942001, 0.036690082401037216, 0.052753105759620667, -0.03450801223516464, 0.025304650887846947, -0.04357360303401947, -0.03041817620396614, 0.02847997099161148, 0.021317176520824432, -0.006173024885356426, 0.015462932176887989, -0.13001154363155365, -0.022409893572330475, -0.007476589642465115, -0.005415898282080889, -0.08024034649133682, -0.14037461578845978, 0.009586582891643047, -0.013419639319181442, 0.025979045778512955, 0.03154682368040085, -0.06661781668663025, -0.03390657901763916, -0.011804529465734959, -0.013134695589542389, 0.034020572900772095, -0.01042400673031807, 0.02153906412422657, 0.013116068206727505, 0.07331971079111099, -0.0009529716917313635, -0.03804890066385269, 0.09240398555994034, -0.00419751089066267, -0.0054117352701723576, 0.017848486080765724, 0.011856813915073872, -0.015468661673367023, 0.018789153546094894, -0.028577549383044243, 0.0032025661785155535, -0.015666982159018517, 0.0034054387360811234, -0.05310920998454094, -0.06874990463256836, -0.018688874319195747, 0.03208364173769951, -0.041988421231508255, 0.1368357241153717, -0.0470568910241127, 0.003218921832740307, -0.0015892625087872148, -0.0006300710374489427, -0.05716751143336296, 0.03745463490486145, -0.021154215559363365, 0.05025077611207962, 0.0728602483868599, -0.04239451885223389, 0.03140803799033165, 0.028094105422496796, 0.04756751284003258, -0.14517781138420105, -0.0899830237030983, 0.055755626410245895, -0.06916654855012894, 0.03764011710882187, 0.08949407190084457, -0.04970811307430267, -0.022331150248646736, 0.05704214423894882, -0.030462151393294334, 0.06297065317630768, 0.020113784819841385, 0.03601258993148804, -0.01678464561700821, 0.02110954560339451, -0.045732833445072174, -0.0427088588476181, 0.006918613333255053, -0.04887533560395241, 0.03311943635344505, -0.06929343938827515, 0.15986280143260956, 0.02144322544336319, 0.05998516082763672, 0.08295907825231552, -0.029145585373044014, -0.06121956184506416, 0.010906239040195942, -0.01858033984899521, 0.030102374032139778, 4.829518907695353e-33, 0.15962451696395874, 0.052104201167821884, 0.00236074673011899, 0.0339595265686512, 0.06917279213666916, -0.01391866710036993, -0.09469768404960632, -0.038047295063734055, -0.20287105441093445, -0.026087068021297455, -0.02079787105321884, 0.06418801099061966, -0.04355717822909355, 0.08484280854463577, 0.007839811034500599, -0.11306445300579071, 0.029652254655957222, 0.0528789684176445, -0.03309689089655876, -0.007013257127255201, -0.03322480246424675, -0.02325665019452572, -0.04566909745335579, 0.09164055436849594, 0.032747674733400345, 0.05027784779667854, 0.024980798363685608, 0.019927602261304855, 0.041455525904893875, -0.021391358226537704, -0.041007936000823975, 0.06859000772237778, -0.009831189177930355, -0.05331459268927574, -0.00888940691947937, -0.05977451428771019, -0.08393394947052002, -0.07424308359622955, 0.01844608038663864, -0.0050486112013459206, 0.018789460882544518, -0.013841059990227222, -0.01914602890610695, -0.04195799678564072, -0.011912844143807888, 0.10689154267311096, 0.07506732642650604, -0.04763757809996605, 0.0685158520936966, 0.006119800731539726, 0.003745497902855277, -0.0008990023052319884, -0.06387511640787125, 0.04059331864118576, 0.030377639457583427, -0.03077147714793682, -0.012903111055493355, 0.0055396417155861855, 0.06292527914047241, 0.010054396465420723, 0.01889203116297722, 0.0040885587222874165, -0.00860792025923729, -0.027906538918614388, -0.004056495614349842, 0.04112057760357857, -0.09002416580915451, -0.018178030848503113, 0.046668052673339844, -0.019106652587652206, -0.047183558344841, 0.0821995809674263, 0.04567569121718407, 0.028162995353341103, -0.020435437560081482, -0.00040313287172466516, -0.08192630857229233, -0.08029263466596603, 0.03280675783753395, -0.042561378329992294, -0.03171427547931671, -0.13367249071598053, -0.016482455655932426, -0.0222045686095953, 0.05929939076304436, -0.0003904751793015748, 0.0005439842352643609, -0.026499386876821518, -0.04719202592968941, 0.05334218963980675, -0.025109993293881416, 0.060934390872716904, 0.029129449278116226, -0.017466336488723755, -0.0730881467461586, -4.473886683507501e-33, -0.07174433767795563, 0.01179536897689104, 0.037287019193172455, 0.07555203884840012, 0.07790528982877731, -0.0014457651413977146, -0.0922362357378006, 0.06582407653331757, 0.07376363128423691, 0.05753219127655029, 0.02034316584467888, -0.051380306482315063, -0.07139528542757034, -0.045869044959545135, -0.0027601104229688644, 0.02378539741039276, 0.016372233629226685, -0.07760663330554962, -0.054905373603105545, -0.01264877151697874, 0.018735749647021294, 0.028702642768621445, -0.11147640645503998, 0.07313922792673111, 0.06527049839496613, 0.057568591088056564, 0.026922505348920822, -0.018083760514855385, -0.026527276262640953, 0.039293959736824036, -0.017455197870731354, -0.0700896680355072, -0.02561822719871998, -0.013176416046917439, 0.0363197922706604, 0.045318081974983215, 0.00965808890759945, -0.008844825439155102, 0.0012182535137981176, -0.01459440216422081, 0.07359056174755096, -0.03989848494529724, -0.0069959769025444984, -0.08291902393102646, -0.014000612311065197, 0.01650453545153141, -0.10124389082193375, 0.06684209406375885, -0.0463804230093956, 0.0033626535441726446, 0.020399929955601692, -0.026438161730766296, 0.13026562333106995, -0.11477816104888916, 0.003257098840549588, -0.051338423043489456, 0.10008411109447479, 0.052981335669755936, -0.0007463527726940811, 0.0144570367410779, -0.025347189977765083, -0.08359997719526291, -0.0017145759193226695, 0.06036563962697983, -0.027218187227845192, -0.07784779369831085, -0.039760198444128036, 0.012120343744754791, -0.024483710527420044, -0.018176600337028503, 0.010971266776323318, 0.0422939732670784, 0.01663709059357643, -0.11080388724803925, 0.09781384468078613, -0.03295786678791046, 0.036955803632736206, 0.03078090399503708, -0.0361524373292923, 0.003634712193161249, -0.0006089007947593927, 0.049520764499902725, 0.06255774199962616, 0.012697126716375351, 0.03948599845170975, 0.06522887200117111, 0.005505899898707867, 0.08390223979949951, -0.023514393717050552, 0.014160818420350552, -0.06596257537603378, 0.021274778991937637, -0.03520495444536209, 0.11035528779029846, 0.013430336490273476, -4.855937163483759e-08, -0.03385583311319351, -0.011989465914666653, -0.05827730521559715, -0.03379184752702713, -0.02103077434003353, 0.044646382331848145, 0.11135328561067581, 0.037431277334690094, -0.020382849499583244, 0.042047686874866486, 0.02987435832619667, 0.027443664148449898, -0.07482320815324783, 0.054609302431344986, 0.0300592090934515, -0.01601630263030529, -0.061633430421352386, 0.02792358212172985, 0.0017844391986727715, -0.05086169019341469, 0.009636463597416878, 0.027960089966654778, -0.06622796505689621, 0.0308943260461092, -0.006301041226834059, 0.01858389936387539, -0.017942119389772415, 0.09425501525402069, -0.04506402090191841, -0.0370074100792408, 0.0025041287299245596, -0.005817767698317766, 0.009501120075583458, -0.03590966761112213, -0.004414349794387817, -0.0003427657939027995, -0.04110259935259819, -0.04771501570940018, 0.004372304771095514, 0.006131333764642477, 0.0274233166128397, 0.11094702035188675, 0.007590039633214474, 0.00984274037182331, -0.05711163580417633, 0.03671560809016228, -0.0014483791310340166, 0.006950407288968563, -0.056193236261606216, -0.08067590743303299, -0.05872488394379616, -0.0076515041291713715, -0.0022239696700125933, -0.009923323057591915, 0.05646389722824097, 0.05412578582763672, 0.01883389614522457, 0.044217195361852646, 0.04452863708138466, 0.0026687225326895714, 0.09340385347604752, -0.04866497218608856, -0.014257843606173992, 0.0670684352517128 ] }, { "text": "• Open an issue on GitHub\n•\n\n• Submit a pull request\n•\n\n• Share feedback via email\n•\n\n• Fork the project for your own knowledge graph\n•\n\n📄 License\n\nThis project is licensed under the MIT License. Feel free to use, modify, and share!\n\nView License\n\nReady to Explore?\n\nDive into the knowledge graph and discover how topics connect!\n\nExplore the Graph\n\n© 2025 Tiny AI World. Free and Open Source.\n\nGitHub •\nLicense •\nAbout", "source": "About Page", "type": "html_page", "chunk_id": "About Page_3", "embedding": [ 0.026637597009539604, -0.026161853224039078, -0.05462484806776047, 0.04992574825882912, 0.09299399703741074, -0.014369002543389797, -0.014589028432965279, 0.05430852621793747, -0.04426473006606102, 0.08257651329040527, 0.019144264981150627, -0.037619855254888535, 0.06075286120176315, 0.04407550022006035, -0.03544297069311142, 0.12256146222352982, -0.002070387825369835, -0.004632220137864351, -0.04288279637694359, -0.11177749186754227, 0.0240379199385643, -0.009633904322981834, -0.017759377136826515, -0.011234931647777557, 0.024377096444368362, 0.014219897799193859, -0.02084636315703392, -0.05044352635741234, 0.031372372061014175, -0.048727408051490784, -0.031376589089632034, 0.04670017957687378, 0.05810365080833435, 0.018414001911878586, 0.01802237331867218, 0.01936490274965763, 0.04025331884622574, 0.07070013135671616, 0.04089046269655228, -0.0004844185314141214, -0.0041782790794968605, -0.04133228957653046, 0.03280226141214371, -0.005575021728873253, 0.01975216530263424, 0.13632674515247345, -0.10717342793941498, -0.011335118673741817, 0.020044377073645592, 0.029429985210299492, -0.12330783903598785, -0.10223865509033203, -0.06970757991075516, -0.011313763447105885, 0.021652700379490852, -0.004190152511000633, -0.040562186390161514, -0.073618583381176, -0.021163154393434525, 0.03295986354351044, 0.07506094127893448, -0.05678659677505493, -0.009560083039104939, 0.06268037110567093, 0.031433749943971634, 0.05811489745974541, -0.01615474745631218, 0.05076592415571213, -0.02941403165459633, -0.12055175751447678, 0.04216182231903076, 0.037095606327056885, -0.017758527770638466, 0.02664741314947605, 0.05447426065802574, -0.006659835577011108, -0.008543691597878933, 0.01724444143474102, -0.006744013633579016, -0.07556575536727905, -0.07245555520057678, 0.017893999814987183, -0.02356642484664917, 0.1124064177274704, -0.02223479561507702, -0.002703720470890403, 0.060982298105955124, 0.017166314646601677, 0.10122472047805786, 0.007236605044454336, -0.03898859769105911, 0.017420334741473198, 0.0811244323849678, -0.027436379343271255, 0.10711891949176788, 0.008881589397788048, 0.011704092845320702, -0.10912903398275375, -0.08348961919546127, 0.08723430335521698, -0.03271670639514923, 0.015521693974733353, 0.005945094861090183, -0.04970807209610939, -0.019165117293596268, 0.053610268980264664, 0.02417009137570858, -0.03762984648346901, 0.0703083798289299, -0.01712481491267681, -0.015596987679600716, 0.026003791019320488, 0.054640501737594604, -0.07588348537683487, 0.05525954067707062, -0.00407695397734642, -0.007719232235103846, 0.010706636123359203, 0.04000363498926163, 0.01841903105378151, -0.04003618285059929, -0.010128219611942768, -0.026472952216863632, -0.01721678301692009, 0.02289794757962227, 0.014887677505612373, -0.07616092264652252, 2.5964137386680294e-33, 0.02726326882839203, 0.05120496451854706, 0.0819832906126976, 0.020225204527378082, 0.06782799959182739, -0.02613484114408493, -0.036908749490976334, -0.04010412096977234, -0.1288316696882248, -0.013646265491843224, -0.017651459202170372, 0.035668883472681046, -0.03355938568711281, 0.012070371769368649, 0.030465561896562576, -0.0742107704281807, 0.025245143100619316, 0.025833947584033012, -0.013661263510584831, 0.03261213004589081, 0.01927626132965088, -0.05658683180809021, -0.035818636417388916, 0.08737534284591675, 0.046058543026447296, 0.030234644189476967, 0.04318135976791382, -0.017215561121702194, 0.11560875922441483, 0.006837534252554178, -0.08501111716032028, 0.051183585077524185, -0.0680118128657341, -0.01312725804746151, -0.008671493269503117, -0.020253948867321014, -0.04721091315150261, -0.05310925468802452, 0.0016574518522247672, -0.004706099163740873, -0.027392355725169182, 0.02324836701154709, -0.04121696576476097, -0.062269143760204315, -0.014913231134414673, 0.016369478777050972, 0.07530731707811356, -0.05778764933347702, 0.06365036219358444, -0.043889496475458145, -0.025054866448044777, -3.2297139114234596e-05, -0.03754578158259392, -0.027862640097737312, 0.05310704559087753, -0.0004892311990261078, -0.023894669488072395, -0.010659607127308846, -0.0026183603331446648, 0.013200449757277966, -0.008372721262276173, 0.018406810238957405, 0.004299947526305914, 0.020503507927060127, 0.06297457963228226, 0.08158252388238907, -0.05062800645828247, -0.013907750137150288, 0.0909811407327652, 0.006811480037868023, -0.03325216844677925, 0.04911240562796593, 0.029633695259690285, -0.05245555192232132, -0.09316049516201019, -0.0013317093253135681, -0.08814236521720886, -0.08813987672328949, -0.011131844483315945, -0.029126979410648346, -0.09122182428836823, -0.08791758865118027, -0.05311931297183037, -0.057225506752729416, 0.010682190768420696, -0.04884490743279457, -0.0018515007104724646, 0.008664942346513271, 0.00340215303003788, 0.014109902083873749, -0.05526018142700195, -0.005614439956843853, -0.012435500510036945, 0.03757032752037048, -0.03567267954349518, -2.2795423386725887e-33, -0.09848172217607498, 0.004816511645913124, -0.009900789707899094, 0.05163281410932541, 0.0594661645591259, -0.014021184295415878, -0.06193339079618454, 0.0439801923930645, -0.009630382061004639, 0.07380539923906326, -0.025426654145121574, -0.06743641197681427, -0.07739469408988953, -0.02261853963136673, 0.022727414965629578, 0.016283100470900536, 0.025006888434290886, -0.029059646651148796, 0.0141244325786829, 0.023296814411878586, -0.013804684393107891, 0.057493243366479874, -0.12327541410923004, 0.02822866663336754, 0.060802947729825974, 0.05227676033973694, -0.007336359471082687, 0.0051961601711809635, 0.025450170040130615, 0.04793265834450722, -0.012888047844171524, -0.08093764632940292, -0.10874468833208084, -0.02338622324168682, -0.0007185686263255775, 0.032068945467472076, 0.011098066344857216, -0.05548788607120514, 0.003061369527131319, -0.038079969584941864, 0.032282400876283646, -0.040972743183374405, -0.05890410766005516, -0.12173687666654587, -0.046940725296735764, 0.012967031449079514, -0.029132260009646416, 0.10627813637256622, -0.03205186501145363, -0.02392417937517166, 0.03131081163883209, 0.002350850263610482, 0.04079969599843025, -0.13870732486248016, -0.07486562430858612, 0.043795883655548096, 0.13390524685382843, 0.1153574138879776, 0.011148924939334393, -0.009231384843587875, -0.03628630191087723, -0.1403440237045288, -0.0471307598054409, 0.037963856011629105, -0.020248165354132652, 0.030702386051416397, -0.006922977510839701, 0.053750038146972656, -0.04970873147249222, -0.011417076922953129, -0.02149934321641922, 0.057658035308122635, 0.01579536311328411, -0.06343953311443329, 0.06852597743272781, 0.015293232165277004, 0.000863994937390089, 0.021943317726254463, -0.0390917994081974, -0.0322946161031723, 0.033895354717969894, 0.005378322210162878, 0.08754488080739975, 0.009464295580983162, 0.03893975540995598, 0.0611804723739624, 0.0035632019862532616, 0.035125307738780975, 0.026066971942782402, 0.07786361128091812, -0.1395864486694336, 0.011629759334027767, -0.013679840601980686, 0.031816884875297546, -0.10119905322790146, -4.271499776109522e-08, -0.06685570627450943, -0.008128182031214237, 0.06525130569934845, 0.018235698342323303, 0.04420570284128189, 0.04075765237212181, 0.002832468831911683, 0.06417977809906006, -0.06373012065887451, 0.08107495307922363, 0.021558575332164764, -0.011107193306088448, -0.04580593854188919, 0.08027254045009613, 0.08748797327280045, -0.015778226777911186, 0.012170147150754929, 0.005435702856630087, 0.021729687228798866, -0.06288499385118484, 0.11755644530057907, -0.0383521132171154, -0.03472667187452316, 0.07061896473169327, -0.019643928855657578, -0.08496695011854172, -0.023568036034703255, 0.10954023152589798, -0.09130991995334625, 0.019198652356863022, -0.015837639570236206, -7.18193405191414e-05, 0.018306570127606392, -0.003541559213772416, 0.06393569707870483, 0.04596301168203354, -0.013259485363960266, -0.03426291421055794, 0.014924312010407448, -0.02036125212907791, -0.008799617178738117, 0.0985136330127716, -0.015065118670463562, 0.024539317935705185, -0.0081046586856246, 0.05256973206996918, 0.017276257276535034, -0.10158156603574753, 0.028910551220178604, 0.03721490502357483, -0.04839189723134041, -0.009545725770294666, 0.03325815126299858, 0.04301672428846359, 0.06757558137178421, 0.054092228412628174, 0.021754179149866104, -0.040325865149497986, 0.06306284666061401, 0.05115233734250069, 0.04235159233212471, 0.009957547299563885, 0.027227211743593216, 0.02865835465490818 ] } ]