Add BERTopic model

README.md

@@ -0,0 +1,161 @@
+
+---
+tags:
+- bertopic
+library_name: bertopic
+pipeline_tag: text-classification
+---
+
+# MARTINI_enrich_BERTopic_TheConspiracyHole
+
+This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. 
+BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. 
+
+## Usage 
+
+To use this model, please install BERTopic:
+
+```
+pip install -U bertopic
+```
+
+You can use the model as follows:
+
+```python
+from bertopic import BERTopic
+topic_model = BERTopic.load("AIDA-UPM/MARTINI_enrich_BERTopic_TheConspiracyHole")
+
+topic_model.get_topic_info()
+```
+
+## Topic overview
+
+* Number of topics: 92
+* Number of training documents: 13678
+
+<details>
+  <summary>Click here for an overview of all topics.</summary>
+  
+  | Topic ID | Topic Keywords | Topic Frequency | Label | 
+|----------|----------------|-----------------|-------| 
+| -1 | vaccinated - 2021 - biden - satanic - link | 20 | -1_vaccinated_2021_biden_satanic | 
+| 0 | psalms - salvation - thessalonians - nkjv - righteousness | 8018 | 0_psalms_salvation_thessalonians_nkjv | 
+| 1 | illuminati - freemasons - lucifer - demiurge - pentagram | 367 | 1_illuminati_freemasons_lucifer_demiurge | 
+| 2 | famine - shortages - usda - harvest - soybeans | 191 | 2_famine_shortages_usda_harvest | 
+| 3 | ukraine - kremlin - zaporizhzhia - missiles - warnews | 182 | 3_ukraine_kremlin_zaporizhzhia_missiles | 
+| 4 | pentecost - ephesians - sunday - hosanna - rejoice | 159 | 4_pentecost_ephesians_sunday_hosanna | 
+| 5 | nsw - arrested - australians - protests - lockdown | 155 | 5_nsw_arrested_australians_protests | 
+| 6 | zionist - jews - rothschild - holocaust - bolsheviks | 146 | 6_zionist_jews_rothschild_holocaust | 
+| 7 | wormhole - timeline - hellbound - kingsman - 2026 | 142 | 7_wormhole_timeline_hellbound_kingsman | 
+| 8 | nasa - mooned - apollo - satellites - liftoff | 131 | 8_nasa_mooned_apollo_satellites | 
+| 9 | hamas - hezbollah - netanyahu - airstrikes - beirut | 131 | 9_hamas_hezbollah_netanyahu_airstrikes | 
+| 10 | illegals - deported - border - smugglers - panama | 120 | 10_illegals_deported_border_smugglers | 
+| 11 | pizzagate - clinton - ghislaine - scandals - blackmail | 116 | 11_pizzagate_clinton_ghislaine_scandals | 
+| 12 | covidiots - videos - australia - falsified - alltheworlsastage | 113 | 12_covidiots_videos_australia_falsified | 
+| 13 | chatgpt - bot - artificial - robots - sophia | 112 | 13_chatgpt_bot_artificial_robots | 
+| 14 | chemtrails - rainmaking - spraying - cloud - stratospheric | 102 | 14_chemtrails_rainmaking_spraying_cloud | 
+| 15 | vaers - vaccinations - pfizer - fatalities - injections | 94 | 15_vaers_vaccinations_pfizer_fatalities | 
+| 16 | shortages - gazprom - price - surged - crude | 93 | 16_shortages_gazprom_price_surged | 
+| 17 | gunman - victims - police - stabbed - texas | 92 | 17_gunman_victims_police_stabbed | 
+| 18 | ethnocentrism - racists - whites - raceblind - mulatto | 89 | 18_ethnocentrism_racists_whites_raceblind | 
+| 19 | vaxxholes - mrna - injections - adenovirus - immunologist | 84 | 19_vaxxholes_mrna_injections_adenovirus | 
+| 20 | ballots - rigged - lindell - smartmatic - newsmax | 82 | 20_ballots_rigged_lindell_smartmatic | 
+| 21 | convoy - truckers - ottawa - blockade - tow | 82 | 21_convoy_truckers_ottawa_blockade | 
+| 22 | cashless - fednow - abolishing - dollar - bitcoin | 81 | 22_cashless_fednow_abolishing_dollar | 
+| 23 | 911truth - mossad - 9ll - silverstein - bombs | 80 | 23_911truth_mossad_9ll_silverstein | 
+| 24 | xenobots - neuromorphic - embryo - implants - musk | 80 | 24_xenobots_neuromorphic_embryo_implants | 
+| 25 | doug - mablog - pastor - postmillennialism - episode | 75 | 25_doug_mablog_pastor_postmillennialism | 
+| 26 | censorship - zuckerberg - decentralized - blocked - websites | 73 | 26_censorship_zuckerberg_decentralized_blocked | 
+| 27 | starforts - worlds - buildings - tartaria - forbidden | 67 | 27_starforts_worlds_buildings_tartaria | 
+| 28 | nephilim - angels - elohim - israelites - giants | 67 | 28_nephilim_angels_elohim_israelites | 
+| 29 | gates - corbettreport - immunization - plandemic - billions | 65 | 29_gates_corbettreport_immunization_plandemic | 
+| 30 | ufo - meteor - sighting - pentagon - fighters | 64 | 30_ufo_meteor_sighting_pentagon | 
+| 31 | coronovirus - plague - noninfected - bullshit - vesicles | 63 | 31_coronovirus_plague_noninfected_bullshit | 
+| 32 | mandates - vaccinated - employers - biden - statewide | 62 | 32_mandates_vaccinated_employers_biden | 
+| 33 | antichrist - satanic - illuminati - prophecies - kundalini | 58 | 33_antichrist_satanic_illuminati_prophecies | 
+| 34 | youtube - shakingmyhead - contributed - jackdawkins - f_zion | 57 | 34_youtube_shakingmyhead_contributed_jackdawkins | 
+| 35 | biometric - fingerprint - identities - surveillance - article__https | 57 | 35_biometric_fingerprint_identities_surveillance | 
+| 36 | mkultra - hypnotic - controlled - link__monarch - dissociation | 56 | 36_mkultra_hypnotic_controlled_link__monarch | 
+| 37 | lennon - faked - jfk - zapruder - assassinations | 53 | 37_lennon_faked_jfk_zapruder | 
+| 38 | earther - globe - cosmogonies - spherical - compasses | 50 | 38_earther_globe_cosmogonies_spherical | 
+| 39 | davos - weltwirtschaftsforums - crisis - agenda - reawakening | 49 | 39_davos_weltwirtschaftsforums_crisis_agenda | 
+| 40 | antifa - rioters - arrests - videos - atlanta | 49 | 40_antifa_rioters_arrests_videos | 
+| 41 | cointelpro - rulers - mcveigh - reptilians - albuquerque | 48 | 41_cointelpro_rulers_mcveigh_reptilians | 
+| 42 | novavax - doses - booster - walgreens - immunocompromised | 47 | 42_novavax_doses_booster_walgreens | 
+| 43 | transgender - puberty - medicalization - pediatricians - hysterectomies | 47 | 43_transgender_puberty_medicalization_pediatricians | 
+| 44 | extraterrestrials - link__ufo - debunked - sitchin - demons | 47 | 44_extraterrestrials_link__ufo_debunked_sitchin | 
+| 45 | egyptologists - pyramids - karnak - hieroglyphics - magical | 46 | 45_egyptologists_pyramids_karnak_hieroglyphics | 
+| 46 | scotus - overruling - filibuster - amendment - rifles | 45 | 46_scotus_overruling_filibuster_amendment | 
+| 47 | numerology - 36th - trump - days - mayhem | 44 | 47_numerology_36th_trump_days | 
+| 48 | killers - dahmer - link__programed - satanic - mcgowan | 43 | 48_killers_dahmer_link__programed_satanic | 
+| 49 | giants - megaliths - nephilim - polydactylism - skeletons | 43 | 49_giants_megaliths_nephilim_polydactylism | 
+| 50 | taiwan - defence - warplanes - invade - wei | 43 | 50_taiwan_defence_warplanes_invade | 
+| 51 | masks - covidpass - oxygen - mandatory - biohazardous | 42 | 51_masks_covidpass_oxygen_mandatory | 
+| 52 | fauci - coronaviruses - funded - vaccinia - institutes | 42 | 52_fauci_coronaviruses_funded_vaccinia | 
+| 53 | trump - antichrist - ultimately - grover - link__is | 41 | 53_trump_antichrist_ultimately_grover | 
+| 54 | communismbythebackdoor - illuminati - tyrants - revolutions - thegreateststorynevertold | 41 | 54_communismbythebackdoor_illuminati_tyrants_revolutions | 
+| 55 | quantumofconscience - download - watching - crap - nilc | 40 | 55_quantumofconscience_download_watching_crap | 
+| 56 | mandela - staveley - statue - columbo - misremembering | 38 | 56_mandela_staveley_statue_columbo | 
+| 57 | rothschild - jekyll - edward - conspired - wealthy | 37 | 57_rothschild_jekyll_edward_conspired | 
+| 58 | hoaxathon - videos - shooting - terroranschlag - zionist | 37 | 58_hoaxathon_videos_shooting_terroranschlag | 
+| 59 | fbi - informant - seditious - unindicted - subpoenas | 36 | 59_fbi_informant_seditious_unindicted | 
+| 60 | vatican - jesuits - catacombs - seminarians - archives | 35 | 60_vatican_jesuits_catacombs_seminarians | 
+| 61 | link__propaganda - bernays - brainwashing - subconsciously - governed | 35 | 61_link__propaganda_bernays_brainwashing_subconsciously | 
+| 62 | sunday - orthodoxchristianperspective - godsquad - withgodeverthingspossible - mingmingnomercy | 35 | 62_sunday_orthodoxchristianperspective_godsquad_withgodeverthingspossible | 
+| 63 | simulacra - brainwashing - huxley - panpsychism - 1984 | 33 | 63_simulacra_brainwashing_huxley_panpsychism | 
+| 64 | fetuses - aborted - abortionist - centerformedicalprogress - dissected | 33 | 64_fetuses_aborted_abortionist_centerformedicalprogress | 
+| 65 | fdic - depositors - jpmorgan - imploding - solvency | 33 | 65_fdic_depositors_jpmorgan_imploding | 
+| 66 | bullshit - meme - yall - retarded - gay | 32 | 66_bullshit_meme_yall_retarded | 
+| 67 | musk - billionaire - twitter - shares - nbcuniversal | 32 | 67_musk_billionaire_twitter_shares | 
+| 68 | archiviokubrick - odyssey - snowpiercer - nasa - wonka | 31 | 68_archiviokubrick_odyssey_snowpiercer_nasa | 
+| 69 | thimerosal - vaccinated - measles - antibodies - hpv | 30 | 69_thimerosal_vaccinated_measles_antibodies | 
+| 70 | _5g - verizon - 60ghz - jammer - radiation | 30 | 70__5g_verizon_60ghz_jammer | 
+| 71 | seminar - michael - godhead - melchizedek - demonic | 30 | 71_seminar_michael_godhead_melchizedek | 
+| 72 | mortalities - cdc - seroprevalence - percent - 67000 | 30 | 72_mortalities_cdc_seroprevalence_percent | 
+| 73 | sdgs - unsustainable - globohomo - 2030 - collectivist | 29 | 73_sdgs_unsustainable_globohomo_2030 | 
+| 74 | rates - inflation - raised - federal - surges | 28 | 74_rates_inflation_raised_federal | 
+| 75 | transhumania - cyborgs - technocracy - nanobots - biotechnologies | 28 | 75_transhumania_cyborgs_technocracy_nanobots | 
+| 76 | nephilim - clowns - rakshasa - gorgonesque - coulrophobia | 25 | 76_nephilim_clowns_rakshasa_gorgonesque | 
+| 77 | antarctica - shackleton - republic - beyond - adventurer | 25 | 77_antarctica_shackleton_republic_beyond | 
+| 78 | omicron - variants - contagious - delta - colorado | 24 | 78_omicron_variants_contagious_delta | 
+| 79 | teachers - superintendent - fwisd - fairfax - heterosexual | 23 | 79_teachers_superintendent_fwisd_fairfax | 
+| 80 | nukes - megatons - uranium - hiroshima - fishbowl | 23 | 80_nukes_megatons_uranium_hiroshima | 
+| 81 | link__babylon - samhain - pagan - syncretism - semiramis | 23 | 81_link__babylon_samhain_pagan_syncretism | 
+| 82 | kilauea - supervolcano - eruptions - stratovolcano - volcanologists | 23 | 82_kilauea_supervolcano_eruptions_stratovolcano | 
+| 83 | saxons - phoenicians - teutoburg - subverting - verschworungstheorien | 23 | 83_saxons_phoenicians_teutoburg_subverting | 
+| 84 | monkeypox - outbreaks - macaque - ghebreyesus - homosexuals | 22 | 84_monkeypox_outbreaks_macaque_ghebreyesus | 
+| 85 | tornadoes - us_stormwatch - blizzard - iowa - meteorologist | 22 | 85_tornadoes_us_stormwatch_blizzard_iowa | 
+| 86 | eclipses - solstice - supermoons - penumbral - crescent | 22 | 86_eclipses_solstice_supermoons_penumbral | 
+| 87 | footballer - died - coulibaly - cpr - qatar | 22 | 87_footballer_died_coulibaly_cpr | 
+| 88 | milgram - experimented - atrocities - coerced - obey | 22 | 88_milgram_experimented_atrocities_coerced | 
+| 89 | fluoridated - toothpaste - mercola - neurotoxicity - sucralose | 21 | 89_fluoridated_toothpaste_mercola_neurotoxicity | 
+| 90 | dollarization - yuan - rupees - reserves - chinadaily | 20 | 90_dollarization_yuan_rupees_reserves |
+  
+</details>
+
+## Training hyperparameters
+
+* calculate_probabilities: True
+* language: None
+* low_memory: False
+* min_topic_size: 10
+* n_gram_range: (1, 1)
+* nr_topics: None
+* seed_topic_list: None
+* top_n_words: 10
+* verbose: False
+* zeroshot_min_similarity: 0.7
+* zeroshot_topic_list: None
+
+## Framework versions
+
+* Numpy: 1.26.4
+* HDBSCAN: 0.8.40
+* UMAP: 0.5.7
+* Pandas: 2.2.3
+* Scikit-Learn: 1.5.2
+* Sentence-transformers: 3.3.1
+* Transformers: 4.46.3
+* Numba: 0.60.0
+* Plotly: 5.24.1
+* Python: 3.10.12

config.json

@@ -0,0 +1,16 @@
+{
+  "calculate_probabilities": true,
+  "language": null,
+  "low_memory": false,
+  "min_topic_size": 10,
+  "n_gram_range": [
+    1,
+    1
+  ],
+  "nr_topics": null,
+  "seed_topic_list": null,
+  "top_n_words": 10,
+  "verbose": false,
+  "zeroshot_min_similarity": 0.7,
+  "zeroshot_topic_list": null
+}

ctfidf.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89fdc29a42ac9f69b3bf86fd8f5a4d35bafd896e4a112cd5ae0552a2e00a56f9
+size 1600472

topic_embeddings.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76eacd6edeb4dd2fa342b7febb7691b65d08b86b89820728af53e248a7833d03
+size 376920