Buckets:
| === per-cell ToMBench gamma === | |
| condition topic seed acc gamma file | |
| influence adult_content 42 0.497203 -0.031335 c2ttom_expA_tombench_adult_content_s42_tombench_eval.json | |
| influence adult_content 43 0.486014 -0.053133 c2ttom_expA_tombench_adult_content_s43_tombench_eval.json | |
| influence adult_content 44 0.497902 -0.029973 c2ttom_expA_tombench_adult_content_s44_tombench_eval.json | |
| influence art_and_design 42 0.509091 -0.008174 c2ttom_expA_tombench_art_and_design_s42_tombench_eval.json | |
| influence art_and_design 43 0.510839 -0.004768 c2ttom_expA_tombench_art_and_design_s43_tombench_eval.json | |
| influence art_and_design 44 0.500350 -0.025204 c2ttom_expA_tombench_art_and_design_s44_tombench_eval.json | |
| influence crime_and_law 42 0.506993 -0.012262 c2ttom_expA_tombench_crime_and_law_s42_tombench_eval.json | |
| influence crime_and_law 43 0.514336 0.002044 c2ttom_expA_tombench_crime_and_law_s43_tombench_eval.json | |
| influence crime_and_law 44 0.506643 -0.012943 c2ttom_expA_tombench_crime_and_law_s44_tombench_eval.json | |
| influence education_and_jobs 42 0.483566 -0.057902 c2ttom_expA_tombench_education_and_jobs_s42_tombench_eval.json | |
| influence education_and_jobs 43 0.453846 -0.115804 c2ttom_expA_tombench_education_and_jobs_s43_tombench_eval.json | |
| influence education_and_jobs 44 0.512937 -0.000681 c2ttom_expA_tombench_education_and_jobs_s44_tombench_eval.json | |
| influence electronics_and_hardware 42 0.495804 -0.034060 c2ttom_expA_tombench_electronics_and_hardware_s42_tombench_eval.json | |
| influence electronics_and_hardware 43 0.511538 -0.003406 c2ttom_expA_tombench_electronics_and_hardware_s43_tombench_eval.json | |
| influence electronics_and_hardware 44 0.508042 -0.010218 c2ttom_expA_tombench_electronics_and_hardware_s44_tombench_eval.json | |
| influence entertainment 42 0.424825 -0.172343 c2ttom_expA_tombench_entertainment_s42_tombench_eval.json | |
| influence entertainment 43 0.439860 -0.143052 c2ttom_expA_tombench_entertainment_s43_tombench_eval.json | |
| influence entertainment 44 0.474476 -0.075613 c2ttom_expA_tombench_entertainment_s44_tombench_eval.json | |
| influence fashion_and_beauty 42 0.481818 -0.061308 c2ttom_expA_tombench_fashion_and_beauty_s42_tombench_eval.json | |
| influence fashion_and_beauty 43 0.468531 -0.087193 c2ttom_expA_tombench_fashion_and_beauty_s43_tombench_eval.json | |
| influence fashion_and_beauty 44 0.475874 -0.072888 c2ttom_expA_tombench_fashion_and_beauty_s44_tombench_eval.json | |
| influence finance_and_business 42 0.499650 -0.026567 c2ttom_expA_tombench_finance_and_business_s42_tombench_eval.json | |
| influence finance_and_business 43 0.509790 -0.006812 c2ttom_expA_tombench_finance_and_business_s43_tombench_eval.json | |
| influence finance_and_business 44 0.512587 -0.001362 c2ttom_expA_tombench_finance_and_business_s44_tombench_eval.json | |
| influence food_and_dining 42 0.470979 -0.082425 c2ttom_expA_tombench_food_and_dining_s42_tombench_eval.json | |
| influence food_and_dining 43 0.481818 -0.061308 c2ttom_expA_tombench_food_and_dining_s43_tombench_eval.json | |
| influence food_and_dining 44 0.446154 -0.130790 c2ttom_expA_tombench_food_and_dining_s44_tombench_eval.json | |
| influence games 42 0.518881 0.010899 c2ttom_expA_tombench_games_s42_tombench_eval.json | |
| influence games 43 0.517832 0.008856 c2ttom_expA_tombench_games_s43_tombench_eval.json | |
| influence games 44 0.500699 -0.024523 c2ttom_expA_tombench_games_s44_tombench_eval.json | |
| influence health 42 0.489161 -0.047003 c2ttom_expA_tombench_health_s42_tombench_eval.json | |
| influence health 43 0.499301 -0.027248 c2ttom_expA_tombench_health_s43_tombench_eval.json | |
| influence health 44 0.491259 -0.042916 c2ttom_expA_tombench_health_s44_tombench_eval.json | |
| influence history_and_geography 42 0.467832 -0.088556 c2ttom_expA_tombench_history_and_geography_s42_tombench_eval.json | |
| influence history_and_geography 43 0.413287 -0.194823 c2ttom_expA_tombench_history_and_geography_s43_tombench_eval.json | |
| influence history_and_geography 44 0.450699 -0.121935 c2ttom_expA_tombench_history_and_geography_s44_tombench_eval.json | |
| influence home_and_hobbies 42 0.496154 -0.033379 c2ttom_expA_tombench_home_and_hobbies_s42_tombench_eval.json | |
| influence home_and_hobbies 43 0.496853 -0.032016 c2ttom_expA_tombench_home_and_hobbies_s43_tombench_eval.json | |
| influence home_and_hobbies 44 0.494406 -0.036785 c2ttom_expA_tombench_home_and_hobbies_s44_tombench_eval.json | |
| influence industrial 42 0.496154 -0.033379 c2ttom_expA_tombench_industrial_s42_tombench_eval.json | |
| influence industrial 43 0.501748 -0.022480 c2ttom_expA_tombench_industrial_s43_tombench_eval.json | |
| influence industrial 44 0.504545 -0.017030 c2ttom_expA_tombench_industrial_s44_tombench_eval.json | |
| influence literature 42 0.486713 -0.051771 c2ttom_expA_tombench_literature_s42_tombench_eval.json | |
| influence literature 43 0.472727 -0.079019 c2ttom_expA_tombench_literature_s43_tombench_eval.json | |
| influence literature 44 0.467832 -0.088556 c2ttom_expA_tombench_literature_s44_tombench_eval.json | |
| influence politics 42 0.470979 -0.082425 c2ttom_expA_tombench_politics_s42_tombench_eval.json | |
| influence politics 43 0.472727 -0.079019 c2ttom_expA_tombench_politics_s43_tombench_eval.json | |
| influence politics 44 0.480070 -0.064714 c2ttom_expA_tombench_politics_s44_tombench_eval.json | |
| influence religion 42 0.515385 0.004087 c2ttom_expA_tombench_religion_s42_tombench_eval.json | |
| influence religion 43 0.524476 0.021798 c2ttom_expA_tombench_religion_s43_tombench_eval.json | |
| influence religion 44 0.526224 0.025204 c2ttom_expA_tombench_religion_s44_tombench_eval.json | |
| influence science_math_and_technology 42 0.495804 -0.034060 c2ttom_expA_tombench_science_math_and_technology_s42_tombench_eval.json | |
| influence science_math_and_technology 43 0.507692 -0.010899 c2ttom_expA_tombench_science_math_and_technology_s43_tombench_eval.json | |
| influence science_math_and_technology 44 0.492657 -0.040191 c2ttom_expA_tombench_science_math_and_technology_s44_tombench_eval.json | |
| influence social_life 42 0.457692 -0.108311 c2ttom_expA_tombench_social_life_s42_tombench_eval.json | |
| influence social_life 43 0.498252 -0.029292 c2ttom_expA_tombench_social_life_s43_tombench_eval.json | |
| influence social_life 44 0.470629 -0.083106 c2ttom_expA_tombench_social_life_s44_tombench_eval.json | |
| influence software 42 0.522727 0.018392 c2ttom_expA_tombench_software_s42_tombench_eval.json | |
| influence software 43 0.520979 0.014986 c2ttom_expA_tombench_software_s43_tombench_eval.json | |
| influence software 44 0.509091 -0.008174 c2ttom_expA_tombench_software_s44_tombench_eval.json | |
| influence software_development 42 0.508392 -0.009537 c2ttom_expA_tombench_software_development_s42_tombench_eval.json | |
| influence software_development 43 0.501399 -0.023161 c2ttom_expA_tombench_software_development_s43_tombench_eval.json | |
| influence software_development 44 0.505944 -0.014305 c2ttom_expA_tombench_software_development_s44_tombench_eval.json | |
| influence sports_and_fitness 42 0.475175 -0.074251 c2ttom_expA_tombench_sports_and_fitness_s42_tombench_eval.json | |
| influence sports_and_fitness 43 0.474126 -0.076294 c2ttom_expA_tombench_sports_and_fitness_s43_tombench_eval.json | |
| influence sports_and_fitness 44 0.471329 -0.081744 c2ttom_expA_tombench_sports_and_fitness_s44_tombench_eval.json | |
| influence transportation 42 0.515385 0.004087 c2ttom_expA_tombench_transportation_s42_tombench_eval.json | |
| influence transportation 43 0.519930 0.012943 c2ttom_expA_tombench_transportation_s43_tombench_eval.json | |
| influence transportation 44 0.526573 0.025886 c2ttom_expA_tombench_transportation_s44_tombench_eval.json | |
| influence travel_and_tourism 42 0.497902 -0.029973 c2ttom_expA_tombench_travel_and_tourism_s42_tombench_eval.json | |
| influence travel_and_tourism 43 0.507692 -0.010899 c2ttom_expA_tombench_travel_and_tourism_s43_tombench_eval.json | |
| influence travel_and_tourism 44 0.496503 -0.032698 c2ttom_expA_tombench_travel_and_tourism_s44_tombench_eval.json | |
| random adult_content 42 0.511538 -0.003406 exp1_adult_content_s42_tombench_eval.json | |
| random adult_content 43 0.491259 -0.042916 exp1_adult_content_s43_tombench_eval.json | |
| random adult_content 44 0.508392 -0.009537 exp1_adult_content_s44_tombench_eval.json | |
| random art_and_design 42 0.537063 0.046322 exp1_art_and_design_s42_tombench_eval.json | |
| random art_and_design 43 0.507343 -0.011580 exp1_art_and_design_s43_tombench_eval.json | |
| random art_and_design 44 0.525175 0.023161 exp1_art_and_design_s44_tombench_eval.json | |
| random crime_and_law 42 0.517832 0.008856 exp1_crime_and_law_s42_tombench_eval.json | |
| random crime_and_law 43 0.526923 0.026567 exp1_crime_and_law_s43_tombench_eval.json | |
| random crime_and_law 44 0.505245 -0.015668 exp1_crime_and_law_s44_tombench_eval.json | |
| random education_and_jobs 42 0.341259 -0.335150 exp1_education_and_jobs_s42_tombench_eval.json | |
| random education_and_jobs 43 0.403147 -0.214578 exp1_education_and_jobs_s43_tombench_eval.json | |
| random education_and_jobs 44 0.444056 -0.134877 exp1_education_and_jobs_s44_tombench_eval.json | |
| random electronics_and_hardware 42 0.533217 0.038828 exp1_electronics_and_hardware_s42_tombench_eval.json | |
| random electronics_and_hardware 43 0.519930 0.012943 exp1_electronics_and_hardware_s43_tombench_eval.json | |
| random electronics_and_hardware 44 0.508741 -0.008856 exp1_electronics_and_hardware_s44_tombench_eval.json | |
| random entertainment 42 0.508042 -0.010218 exp1_entertainment_s42_tombench_eval.json | |
| random entertainment 43 0.479371 -0.066076 exp1_entertainment_s43_tombench_eval.json | |
| random entertainment 44 0.490210 -0.044959 exp1_entertainment_s44_tombench_eval.json | |
| random fashion_and_beauty 42 0.503846 -0.018392 exp1_fashion_and_beauty_s42_tombench_eval.json | |
| random fashion_and_beauty 43 0.488112 -0.049046 exp1_fashion_and_beauty_s43_tombench_eval.json | |
| random fashion_and_beauty 44 0.405594 -0.209809 exp1_fashion_and_beauty_s44_tombench_eval.json | |
| random finance_and_business 42 0.482867 -0.059264 exp1_finance_and_business_s42_tombench_eval.json | |
| random finance_and_business 43 0.507692 -0.010899 exp1_finance_and_business_s43_tombench_eval.json | |
| random finance_and_business 44 0.478322 -0.068120 exp1_finance_and_business_s44_tombench_eval.json | |
| random food_and_dining 42 0.482168 -0.060627 exp1_food_and_dining_s42_tombench_eval.json | |
| random food_and_dining 43 0.506294 -0.013624 exp1_food_and_dining_s43_tombench_eval.json | |
| random food_and_dining 44 0.490210 -0.044959 exp1_food_and_dining_s44_tombench_eval.json | |
| random games 42 0.498951 -0.027929 exp1_games_s42_tombench_eval.json | |
| random games 43 0.504196 -0.017711 exp1_games_s43_tombench_eval.json | |
| random games 44 0.497552 -0.030654 exp1_games_s44_tombench_eval.json | |
| random health 42 0.435664 -0.151226 exp1_health_s42_tombench_eval.json | |
| random health 43 0.386364 -0.247275 exp1_health_s43_tombench_eval.json | |
| random health 44 0.481818 -0.061308 exp1_health_s44_tombench_eval.json | |
| random history_and_geography 42 0.495105 -0.035422 exp1_history_and_geography_s42_tombench_eval.json | |
| random history_and_geography 43 0.513636 0.000681 exp1_history_and_geography_s43_tombench_eval.json | |
| random history_and_geography 44 0.493007 -0.039510 exp1_history_and_geography_s44_tombench_eval.json | |
| random home_and_hobbies 42 0.504545 -0.017030 exp1_home_and_hobbies_s42_tombench_eval.json | |
| random home_and_hobbies 43 0.506643 -0.012943 exp1_home_and_hobbies_s43_tombench_eval.json | |
| random home_and_hobbies 44 0.507343 -0.011580 exp1_home_and_hobbies_s44_tombench_eval.json | |
| random industrial 42 0.505245 -0.015668 exp1_industrial_s42_tombench_eval.json | |
| random industrial 43 0.503147 -0.019755 exp1_industrial_s43_tombench_eval.json | |
| random industrial 44 0.505245 -0.015668 exp1_industrial_s44_tombench_eval.json | |
| random literature 42 0.526224 0.025204 exp1_literature_s42_tombench_eval.json | |
| random literature 43 0.525524 0.023842 exp1_literature_s43_tombench_eval.json | |
| random literature 44 0.493706 -0.038147 exp1_literature_s44_tombench_eval.json | |
| random politics 42 0.505594 -0.014986 exp1_politics_s42_tombench_eval.json | |
| random politics 43 0.476224 -0.072207 exp1_politics_s43_tombench_eval.json | |
| random politics 44 0.482867 -0.059264 exp1_politics_s44_tombench_eval.json | |
| random religion 42 0.514336 0.002044 exp1_religion_s42_tombench_eval.json | |
| random religion 43 0.516084 0.005450 exp1_religion_s43_tombench_eval.json | |
| random religion 44 0.510839 -0.004768 exp1_religion_s44_tombench_eval.json | |
| random science_math_and_technology 42 0.502448 -0.021117 exp1_science_math_and_technology_s42_tombench_eval.json | |
| random science_math_and_technology 43 0.509091 -0.008174 exp1_science_math_and_technology_s43_tombench_eval.json | |
| random science_math_and_technology 44 0.498951 -0.027929 exp1_science_math_and_technology_s44_tombench_eval.json | |
| random social_life 42 0.489161 -0.047003 exp1_social_life_s42_tombench_eval.json | |
| random social_life 43 0.490909 -0.043597 exp1_social_life_s43_tombench_eval.json | |
| random social_life 44 0.480420 -0.064033 exp1_social_life_s44_tombench_eval.json | |
| random software 42 0.563636 0.098093 exp1_software_s42_tombench_eval.json | |
| random software 43 0.535315 0.042916 exp1_software_s43_tombench_eval.json | |
| random software 44 0.567133 0.104905 exp1_software_s44_tombench_eval.json | |
| random software_development 42 0.539161 0.050409 exp1_software_development_s42_tombench_eval.json | |
| random software_development 43 0.531119 0.034741 exp1_software_development_s43_tombench_eval.json | |
| random software_development 44 0.548601 0.068801 exp1_software_development_s44_tombench_eval.json | |
| random sports_and_fitness 42 0.445804 -0.131471 exp1_sports_and_fitness_s42_tombench_eval.json | |
| random sports_and_fitness 43 0.522028 0.017030 exp1_sports_and_fitness_s43_tombench_eval.json | |
| random sports_and_fitness 44 0.500000 -0.025886 exp1_sports_and_fitness_s44_tombench_eval.json | |
| random transportation 42 0.501748 -0.022480 exp1_transportation_s42_tombench_eval.json | |
| random transportation 43 0.501049 -0.023842 exp1_transportation_s43_tombench_eval.json | |
| random transportation 44 0.502098 -0.021798 exp1_transportation_s44_tombench_eval.json | |
| random travel_and_tourism 42 0.477273 -0.070163 exp1_travel_and_tourism_s42_tombench_eval.json | |
| random travel_and_tourism 43 0.498252 -0.029292 exp1_travel_and_tourism_s43_tombench_eval.json | |
| random travel_and_tourism 44 0.476923 -0.070845 exp1_travel_and_tourism_s44_tombench_eval.json | |
| === paired (influence - random) by (topic, seed) === | |
| topic seed gamma_influence gamma_random d | |
| adult_content 42 -0.031335 -0.003406 -0.027929 | |
| adult_content 43 -0.053133 -0.042916 -0.010218 | |
| adult_content 44 -0.029973 -0.009537 -0.020436 | |
| art_and_design 42 -0.008174 0.046322 -0.054496 | |
| art_and_design 43 -0.004768 -0.011580 0.006812 | |
| art_and_design 44 -0.025204 0.023161 -0.048365 | |
| crime_and_law 42 -0.012262 0.008856 -0.021117 | |
| crime_and_law 43 0.002044 0.026567 -0.024523 | |
| crime_and_law 44 -0.012943 -0.015668 0.002725 | |
| education_and_jobs 42 -0.057902 -0.335150 0.277248 | |
| education_and_jobs 43 -0.115804 -0.214578 0.098774 | |
| education_and_jobs 44 -0.000681 -0.134877 0.134196 | |
| electronics_and_hardware 42 -0.034060 0.038828 -0.072888 | |
| electronics_and_hardware 43 -0.003406 0.012943 -0.016349 | |
| electronics_and_hardware 44 -0.010218 -0.008856 -0.001362 | |
| entertainment 42 -0.172343 -0.010218 -0.162125 | |
| entertainment 43 -0.143052 -0.066076 -0.076975 | |
| entertainment 44 -0.075613 -0.044959 -0.030654 | |
| fashion_and_beauty 42 -0.061308 -0.018392 -0.042916 | |
| fashion_and_beauty 43 -0.087193 -0.049046 -0.038147 | |
| fashion_and_beauty 44 -0.072888 -0.209809 0.136921 | |
| finance_and_business 42 -0.026567 -0.059264 0.032698 | |
| finance_and_business 43 -0.006812 -0.010899 0.004087 | |
| finance_and_business 44 -0.001362 -0.068120 0.066757 | |
| food_and_dining 42 -0.082425 -0.060627 -0.021798 | |
| food_and_dining 43 -0.061308 -0.013624 -0.047684 | |
| food_and_dining 44 -0.130790 -0.044959 -0.085831 | |
| games 42 0.010899 -0.027929 0.038828 | |
| games 43 0.008856 -0.017711 0.026567 | |
| games 44 -0.024523 -0.030654 0.006131 | |
| health 42 -0.047003 -0.151226 0.104223 | |
| health 43 -0.027248 -0.247275 0.220027 | |
| health 44 -0.042916 -0.061308 0.018392 | |
| history_and_geography 42 -0.088556 -0.035422 -0.053134 | |
| history_and_geography 43 -0.194823 0.000681 -0.195504 | |
| history_and_geography 44 -0.121935 -0.039510 -0.082425 | |
| home_and_hobbies 42 -0.033379 -0.017030 -0.016349 | |
| home_and_hobbies 43 -0.032016 -0.012943 -0.019074 | |
| home_and_hobbies 44 -0.036785 -0.011580 -0.025204 | |
| industrial 42 -0.033379 -0.015668 -0.017711 | |
| industrial 43 -0.022480 -0.019755 -0.002725 | |
| industrial 44 -0.017030 -0.015668 -0.001362 | |
| literature 42 -0.051771 0.025204 -0.076975 | |
| literature 43 -0.079019 0.023842 -0.102861 | |
| literature 44 -0.088556 -0.038147 -0.050409 | |
| politics 42 -0.082425 -0.014986 -0.067439 | |
| politics 43 -0.079019 -0.072207 -0.006812 | |
| politics 44 -0.064714 -0.059264 -0.005450 | |
| religion 42 0.004087 0.002044 0.002044 | |
| religion 43 0.021798 0.005450 0.016349 | |
| religion 44 0.025204 -0.004768 0.029973 | |
| science_math_and_technology 42 -0.034060 -0.021117 -0.012943 | |
| science_math_and_technology 43 -0.010899 -0.008174 -0.002725 | |
| science_math_and_technology 44 -0.040191 -0.027929 -0.012262 | |
| social_life 42 -0.108311 -0.047003 -0.061308 | |
| social_life 43 -0.029292 -0.043597 0.014305 | |
| social_life 44 -0.083106 -0.064033 -0.019074 | |
| software_development 42 -0.009537 0.050409 -0.059946 | |
| software_development 43 -0.023161 0.034741 -0.057902 | |
| software_development 44 -0.014305 0.068801 -0.083106 | |
| software 42 0.018392 0.098093 -0.079700 | |
| software 43 0.014986 0.042916 -0.027929 | |
| software 44 -0.008174 0.104905 -0.113079 | |
| sports_and_fitness 42 -0.074251 -0.131471 0.057221 | |
| sports_and_fitness 43 -0.076294 0.017030 -0.093324 | |
| sports_and_fitness 44 -0.081744 -0.025886 -0.055858 | |
| transportation 42 0.004087 -0.022480 0.026567 | |
| transportation 43 0.012943 -0.023842 0.036785 | |
| transportation 44 0.025886 -0.021798 0.047684 | |
| travel_and_tourism 42 -0.029973 -0.070163 0.040191 | |
| travel_and_tourism 43 -0.010899 -0.029292 0.018392 | |
| travel_and_tourism 44 -0.032698 -0.070845 0.038147 | |
| === per-topic gamma means (influence arm) === | |
| mean count | |
| topic | |
| adult_content -0.038147 3 | |
| art_and_design -0.012716 3 | |
| crime_and_law -0.007720 3 | |
| education_and_jobs -0.058129 3 | |
| electronics_and_hardware -0.015895 3 | |
| entertainment -0.130336 3 | |
| fashion_and_beauty -0.073797 3 | |
| finance_and_business -0.011580 3 | |
| food_and_dining -0.091508 3 | |
| games -0.001589 3 | |
| health -0.039055 3 | |
| history_and_geography -0.135104 3 | |
| home_and_hobbies -0.034060 3 | |
| industrial -0.024296 3 | |
| literature -0.073115 3 | |
| politics -0.075386 3 | |
| religion 0.017030 3 | |
| science_math_and_technology -0.028383 3 | |
| social_life -0.073569 3 | |
| software 0.008401 3 | |
| software_development -0.015668 3 | |
| sports_and_fitness -0.077430 3 | |
| transportation 0.014305 3 | |
| travel_and_tourism -0.024523 3 | |
| === paired-selectivity summary (d = gamma_influence - gamma_random > 0) === | |
| n_pairs: 72 | |
| median_d: -0.01634877426515904 | |
| mean_d: -0.009782773489684269 | |
| d_z: -0.13384622088134449 | |
| sign_pos: 26/72 | |
| sign_p_onesided: 0.9936127022309675 | |
| wilcoxon_p_onesided: 0.9825715763684802 | |
| wrote /storage/ice-shared/cs7634/staff/TDA/comma/tom_unlearning/tom_paired.csv | |
Xet Storage Details
- Size:
- 26.5 kB
- Xet hash:
- 0ed988e172a684302ba7a7000f7b652b26d8f7dcab2b269d01ac68b6ab286514
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.