| |
|
| | --- |
| | tags: |
| | - bertopic |
| | library_name: bertopic |
| | pipeline_tag: text-classification |
| | --- |
| | |
| | # MARTINI_enrich_BERTopic_STFNREPORT |
| | |
| | This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. |
| | BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. |
| | |
| | ## Usage |
| | |
| | To use this model, please install BERTopic: |
| | |
| | ``` |
| | pip install -U bertopic |
| | ``` |
| | |
| | You can use the model as follows: |
| | |
| | ```python |
| | from bertopic import BERTopic |
| | topic_model = BERTopic.load("AIDA-UPM/MARTINI_enrich_BERTopic_STFNREPORT") |
| | |
| | topic_model.get_topic_info() |
| | ``` |
| | |
| | ## Topic overview |
| | |
| | * Number of topics: 43 |
| | * Number of training documents: 5385 |
| | |
| | <details> |
| | <summary>Click here for an overview of all topics.</summary> |
| | |
| | | Topic ID | Topic Keywords | Topic Frequency | Label | |
| | |----------|----------------|-----------------|-------| |
| | | -1 | fauci - plandemic - vaccinated - sheeple - fake | 20 | -1_fauci_plandemic_vaccinated_sheeple | |
| | | 0 | ukraine - mariupol - russians - kaliningrad - nazis | 3086 | 0_ukraine_mariupol_russians_kaliningrad | |
| | | 1 | 5g - radiofrequency - coronavirus - cell - towers | 195 | 1_5g_radiofrequency_coronavirus_cell | |
| | | 2 | shielding - mylar - vaxxers - microwave - orgone | 124 | 2_shielding_mylar_vaxxers_microwave | |
| | | 3 | chemtrail - poisoned - volcano - sulfur - lithium | 115 | 3_chemtrail_poisoned_volcano_sulfur | |
| | | 4 | fbi - blinken - banned - colluded - disinformation | 107 | 4_fbi_blinken_banned_colluded | |
| | | 5 | trudeau - manitoba - trucker - convoys - protesters | 102 | 5_trudeau_manitoba_trucker_convoys | |
| | | 6 | died - vaccine - myocarditis - clots - iowa | 86 | 6_died_vaccine_myocarditis_clots | |
| | | 7 | france - macron - dictatorship - protesters - passsanitaire | 80 | 7_france_macron_dictatorship_protesters | |
| | | 8 | kjv - ephesians - revelation - blessed - satan | 76 | 8_kjv_ephesians_revelation_blessed | |
| | | 9 | antivaxxers - vaccinate - hivaccine - hsv - immunodeficiency | 70 | 9_antivaxxers_vaccinate_hivaccine_hsv | |
| | | 10 | lindell - voting - rigged - demoncrats - whistleblower | 69 | 10_lindell_voting_rigged_demoncrats | |
| | | 11 | reptilians - arcturians - ufo - nasa - moon | 65 | 11_reptilians_arcturians_ufo_nasa | |
| | | 12 | tyrants - freedom - guillotines - worldwidedemonstration - revolutions | 64 | 12_tyrants_freedom_guillotines_worldwidedemonstration | |
| | | 13 | pedophiles - sodomites - indoctrination - libtards - educators | 63 | 13_pedophiles_sodomites_indoctrination_libtards | |
| | | 14 | pfizer - viagra - pages - adverse - victims | 62 | 14_pfizer_viagra_pages_adverse | |
| | | 15 | farmers - rebellion - globalists - starve - pitchforks | 61 | 15_farmers_rebellion_globalists_starve | |
| | | 16 | canberra - lockdown - victoria - protesters - mullumbimby | 57 | 16_canberra_lockdown_victoria_protesters | |
| | | 17 | gates - billionaires - microsoft - donated - malaria | 55 | 17_gates_billionaires_microsoft_donated | |
| | | 18 | vaxxers - mandatory - cuomo - unconstitutional - citizenship | 49 | 18_vaxxers_mandatory_cuomo_unconstitutional | |
| | | 19 | inflation - liquidating - lehman - monopolies - plunge | 46 | 19_inflation_liquidating_lehman_monopolies | |
| | | 20 | invermectin - hydroxychloroquine - remdesevir - resistanceisvictory - prescribe | 46 | 20_invermectin_hydroxychloroquine_remdesevir_resistanceisvictory | |
| | | 21 | neuralink - musk - transhuman - robots - amazon | 46 | 21_neuralink_musk_transhuman_robots | |
| | | 22 | gestapo - protesters - berlin - thebritishnews - awakenweare | 43 | 22_gestapo_protesters_berlin_thebritishnews | |
| | | 23 | unvaxxed - pfizer - bioweapons - mrna - injected | 42 | 23_unvaxxed_pfizer_bioweapons_mrna | |
| | | 24 | masks - schoolchildren - walkout - wearethefaithful - exposealaskaairlines | 41 | 24_masks_schoolchildren_walkout_wearethefaithful | |
| | | 25 | bots - telegram - unbanned - bitchute - reposting | 41 | 25_bots_telegram_unbanned_bitchute | |
| | | 26 | davos - leaders - bezos - gates - meeting | 37 | 26_davos_leaders_bezos_gates | |
| | | 27 | riots - blacks - johannesburg - racist - rhodesia | 37 | 27_riots_blacks_johannesburg_racist | |
| | | 28 | trump - impeached - vaccines - suckered - never | 35 | 28_trump_impeached_vaccines_suckered | |
| | | 29 | ursula - chancellor - nazi - buchenwald - zelensky | 34 | 29_ursula_chancellor_nazi_buchenwald | |
| | | 30 | nazis - zionism - socialism - genocides - liberated | 34 | 30_nazis_zionism_socialism_genocides | |
| | | 31 | skynet - cyborgs - darpa - doomed - technology | 31 | 31_skynet_cyborgs_darpa_doomed | |
| | | 32 | plandemic - nuremberg - criminals - genocided - censorship | 30 | 32_plandemic_nuremberg_criminals_genocided | |
| | | 33 | wikileaks - extradited - guantanamo - mediaocracy - belmarsh | 29 | 33_wikileaks_extradited_guantanamo_mediaocracy | |
| | | 34 | nanobots - atoms - vials - covid_exposed - morgellons | 28 | 34_nanobots_atoms_vials_covid_exposed | |
| | | 35 | trannies - dysphoria - lunatics - dsm - indoctrination | 28 | 35_trannies_dysphoria_lunatics_dsm | |
| | | 36 | vaccinated - deaths - doses - quadrupled - 95 | 28 | 36_vaccinated_deaths_doses_quadrupled | |
| | | 37 | petroleum - biden - reserves - saudi - gallon | 27 | 37_petroleum_biden_reserves_saudi | |
| | | 38 | vaxed - israelis - lockdowns - denmark - reimposes | 27 | 38_vaxed_israelis_lockdowns_denmark | |
| | | 39 | telegram - playstore - downloading - banned - uninstall | 26 | 39_telegram_playstore_downloading_banned | |
| | | 40 | libtards - retarded - sodomites - nutters - fuck | 22 | 40_libtards_retarded_sodomites_nutters | |
| | | 41 | shootings - gunman - ramos - suspect - classroom | 21 | 41_shootings_gunman_ramos_suspect | |
| | |
| | </details> |
| | |
| | ## Training hyperparameters |
| | |
| | * calculate_probabilities: True |
| | * language: None |
| | * low_memory: False |
| | * min_topic_size: 10 |
| | * n_gram_range: (1, 1) |
| | * nr_topics: None |
| | * seed_topic_list: None |
| | * top_n_words: 10 |
| | * verbose: False |
| | * zeroshot_min_similarity: 0.7 |
| | * zeroshot_topic_list: None |
| | |
| | ## Framework versions |
| | |
| | * Numpy: 1.26.4 |
| | * HDBSCAN: 0.8.40 |
| | * UMAP: 0.5.7 |
| | * Pandas: 2.2.3 |
| | * Scikit-Learn: 1.5.2 |
| | * Sentence-transformers: 3.3.1 |
| | * Transformers: 4.46.3 |
| | * Numba: 0.60.0 |
| | * Plotly: 5.24.1 |
| | * Python: 3.10.12 |
| | |
