BERTopic_ArXiv

This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

Usage

To use this model, please install BERTopic:

pip install -U bertopic

You can use the model as follows:

from bertopic import BERTopic
topic_model = BERTopic.load("ConquerPig/BERTopic_ArXiv")

topic_model.get_topic_info()

Topic overview

• Number of topics: 232
• Number of training documents: 18846

Click here for an overview of all topics.

Topic ID	Topic Keywords	Topic Frequency	Label
-1	to - the - of - and - is	10	-1_to_the_of_and
0	game - team - games - he - players	6842	0_game_team_games_he
1	key - clipper - chip - encryption - keys	1835	1_key_clipper_chip_encryption
2	israel - israeli - jews - arab - jewish	568	2_israel_israeli_jews_arab
3	health - cancer - email - list - newsgroup	472	3_health_cancer_email_list
4	fbi - fire - koresh - gas - compound	297	4_fbi_fire_koresh_gas
5	openwindows - motif - windows - xfree86 - version	256	5_openwindows_motif_windows_xfree86
6	amp - condition - stereo - asking - sale	222	6_amp_condition_stereo_asking
7	car - cars - ford - mustang - v8	179	7_car_cars_ford_mustang
8	jpeg - image - gif - format - images	166	8_jpeg_image_gif_format
9	atheists - god - atheism - atheist - belief	161	9_atheists_god_atheism_atheist
10	gun - guns - crime - deaths - firearms	156	10_gun_guns_crime_deaths
11	window - widget - event - application - expose	152	11_window_widget_event_application
12	drive - drives - disk - controller - bios	141	12_drive_drives_disk_controller
13	bike - tires - bikes - tire - miles	133	13_bike_tires_bikes_tire
14	deleted - stuff - ditto - andi - oh	132	14_deleted_stuff_ditto_andi
15	moral - objective - morality - immoral - morals	104	15_moral_objective_morality_immoral
16	armenian - armenians - turkish - genocide - turkey	100	16_armenian_armenians_turkish_genocide
17	den - polygon - points - algorithm - xxxx	100	17_den_polygon_points_algorithm
18	ted - post - you - posts - teel	98	18_ted_post_you_posts
19	3d - graphics - grafsys - animation - search	91	19_3d_graphics_grafsys_animation
20	simms - simm - vram - ram - memory	83	20_simms_simm_vram_ram
21	db - mov - windows - memory - blbh	83	21_db_mov_windows_memory
22	drive - drives - scsi - multisession - hard	81	22_drive_drives_scsi_multisession
23	islam - quran - rushdie - islamic - muhammad	79	23_islam_quran_rushdie_islamic
24	cancer - doctor - medical - medicine - gr	77	24_cancer_doctor_medical_medicine
25	games - sega - joystick - game - arcade	76	25_games_sega_joystick_game
26	pain - migraine - diet - cancer - drug	74	26_pain_migraine_diet_cancer
27	symbol - error - undefined - libxmulibxmuso - doug	73	27_symbol_error_undefined_libxmulibxmuso
28	ites - - - -	72	28_ites___
29	homosexuality - homosexual - homosexuals - sex - paul	72	29_homosexuality_homosexual_homosexuals_sex
30	modem - fax - modems - courier - v32bis	70	30_modem_fax_modems_courier
31	msg - food - chinese - foods - glutamate	69	31_msg_food_chinese_foods
32	meg - drive - ram - serial - sale	68	32_meg_drive_ram_serial
33	printer - ink - hp - printers - deskjet	63	33_printer_ink_hp_printers
34	dos - pom - cds - mpc - cd	62	34_dos_pom_cds_mpc
35	solar - planets - spacecraft - planet - earth	62	35_solar_planets_spacecraft_planet
36	radar - detector - detectors - alarm - ka	62	36_radar_detector_detectors_alarm
37	sky - advertising - billboard - billboards - light	61	37_sky_advertising_billboard_billboards
38	space - launch - station - nasa - redesign	60	38_space_launch_station_nasa
39	candida - yeast - infection - infections - antibiotic	60	39_candida_yeast_infection_infections
40	- - - -	58	40____
41	tax - senior - administration - russia - taxes	58	41_tax_senior_administration_russia
42	batf - warrant - raid - fbi - compound	58	42_batf_warrant_raid_fbi
43	xv - 24bit - image - bit - images	57	43_xv_24bit_image_bit
44	kinsey - sex - men - gay - sexual	55	44_kinsey_sex_men_gay
45	diesel - diesels - emissions - oil - teflon	54	45_diesel_diesels_emissions_oil
46	- - - -	54	46____
47	scsi - scsi2 - scsi1 - ide - asynchronous	53	47_scsi_scsi2_scsi1_ide
48	- - - -	53	48____
49	colormap - gc - color - visual - window	52	49_colormap_gc_color_visual
50	os2 - windows - nt - apps - run	52	50_os2_windows_nt_apps
51	kuwait - iran - iraq - gulf - arabia	51	51_kuwait_iran_iraq_gulf
52	hell - eternal - god - heaven - jesus	50	52_hell_eternal_god_heaven
53	mary - her - she - bernadette - sin	49	53_mary_her_she_bernadette
54	oil - drain - indicators - bolt - car	49	54_oil_drain_indicators_bolt
55	were - armenians - they - azerbaijan - her	49	55_were_armenians_they_azerbaijan
56	reno - waco - president - federal - fbi	48	56_reno_waco_president_federal
57	battery - batteries - concrete - discharge - temperature	48	57_battery_batteries_concrete_discharge
58	copy - protection - program - backup - software	48	58_copy_protection_program_backup
59	paint - wax - plastic - scratches - finish	46	59_paint_wax_plastic_scratches
60	insurance - geico - car - accident - rates	46	60_insurance_geico_car_accident
61	science - methodology - scientific - empirical - theory	46	61_science_methodology_scientific_empirical
62	hst - reboost - mission - shuttle - orbit	45	62_hst_reboost_mission_shuttle
63	moon - lunar - prize - billion - money	44	63_moon_lunar_prize_billion
64	militia - amendment - arms - bear - right	44	64_militia_amendment_arms_bear
65	mouse - driver - mice - ball - mousecom	43	65_mouse_driver_mice_ball
66	evidence - exist - existence - evolution - god	43	66_evidence_exist_existence_evolution
67	book - books - chemistry - paperback - spice	43	67_book_books_chemistry_paperback
68	each - - - -	43	68_each___
69	books - canon - scripture - bible - hebrew	42	69_books_canon_scripture_bible
70	drugs - drug - cocaine - marijuana - lsd	42	70_drugs_drug_cocaine_marijuana
71	greek - greece - turkish - greeks - cyprus	42	71_greek_greece_turkish_greeks
72	serbs - muslims - bosnian - croats - serbian	41	72_serbs_muslims_bosnian_croats
73	cheek - yep - huh - -	41	73_cheek_yep_huh_
74	miles - car - toyota - amfm - condition	41	74_miles_car_toyota_amfm
75	- - - -	40	75____
76	dog - dogs - bike - chase - trained	40	76_dog_dogs_bike_chase
77	trial - cooper - spence - boomer - court	39	77_trial_cooper_spence_boomer
78	clutch - shift - transmission - gear - gears	39	78_clutch_shift_transmission_gear
79	motherboard - ram - mb - bios - supply	39	79_motherboard_ram_mb_bios
80	government - libertarians - libertarian - regulation - libertarianism	39	80_government_libertarians_libertarian_regulation
81	hotel - voucher - package - vacation - room	38	81_hotel_voucher_package_vacation
82	cop - ticket - drunk - driving - dwi	38	82_cop_ticket_drunk_driving
83	phone - dial - number - line - lines	38	83_phone_dial_number_line
84	lane - car - behind - traffic - bike	38	84_lane_car_behind_traffic
85	penalty - death - punishment - cruel - murder	37	85_penalty_death_punishment_cruel
86	tape - backup - tapes - drive - munroe	37	86_tape_backup_tapes_drive
87	- - - -	37	87____
88	modem - serial - cts - dce - null	37	88_modem_serial_cts_dce
89	antenna - circuits - antennas - design - mixer	37	89_antenna_circuits_antennas_design
90	- - - -	36	90____
91	ra - satan - ezekiel - god - thou	36	91_ra_satan_ezekiel_god
92	board - connector - motherboard - card - docs	36	92_board_connector_motherboard_card
93	oort - cloud - grbs - gamma - burst	36	93_oort_cloud_grbs_gamma
94	server - xdm - 00 - login - error	35	94_server_xdm_00_login
95	ripem - key - entry - des - rsa	35	95_ripem_key_entry_des
96	jehovah - elohim - lord - mormon - mcconkie	35	96_jehovah_elohim_lord_mormon
97	fan - cpu - heat - sink - fans	34	97_fan_cpu_heat_sink
98	drivers - card - driver - cirrus - bitblaster	34	98_drivers_card_driver_cirrus
99	water - dept - phd - energy - environmental	34	99_water_dept_phd_energy
100	countersteering - bike - lean - technique - turn	34	100_countersteering_bike_lean_technique
101	kirlian - photography - leaf - pictures - krillean	34	101_kirlian_photography_leaf_pictures
102	jesus - disciples - tomb - he - resurrection	32	102_jesus_disciples_tomb_he
103	- - - -	32	103____
104	insurance - health - private - care - canada	32	104_insurance_health_private_care
105	fonts - font - tt - truetype - atm	32	105_fonts_font_tt_truetype
106	monitor - vga - monitors - lc - video	31	106_monitor_vga_monitors_lc
107	marriage - married - marry - ceremony - marriages	31	107_marriage_married_marry_ceremony
108	hb - sb - firearms - nra - committee	31	108_hb_sb_firearms_nra
109	allocation - linked - dos - cross - unit	31	109_allocation_linked_dos_cross
110	- - - -	31	110____
111	aaron - baptism - sin - infants - faith	31	111_aaron_baptism_sin_infants
112	data - ftp - available - images - image	30	112_data_ftp_available_images
113	hacker - computer - hackers - ethic - cs	30	113_hacker_computer_hackers_ethic
114	boeing - letter - mail - advertising - house	30	114_boeing_letter_mail_advertising
115	guide - shipping - disks - manuals - sale	30	115_guide_shipping_disks_manuals
116	spacecraft - probe - mission - mars - probes	30	116_spacecraft_probe_mission_mars
117	scanner - logitech - ocr - scanners - scanman	29	117_scanner_logitech_ocr_scanners
118	sexual - enviroleague - homosexuality - homosexuals - bestiality	29	118_sexual_enviroleague_homosexuality_homosexuals
119	pds - nubus - lc - slot - card	29	119_pds_nubus_lc_slot
120	art - - - -	28	120_art___
121	dealer - price - saturn - std - car	28	121_dealer_price_saturn_std
122	monitor - off - turn - computer - electricity	28	122_monitor_off_turn_computer
123	bolick - godless - maddi - nickname - nicknames	28	123_bolick_godless_maddi_nickname
124	1st - wolverine - comics - hulk - art	27	124_1st_wolverine_comics_hulk
125	uv - leds - light - blue - bulb	27	125_uv_leds_light_blue
126	meat - carcinogenic - food - smoke - carcinogens	27	126_meat_carcinogenic_food_smoke
127	duo - clock - date - bios - battery	27	127_duo_clock_date_bios
128	graphics - ray - 3d - widget - rayshade	27	128_graphics_ray_3d_widget
129	mhz - clock - cpu - operational - fpu	26	129_mhz_clock_cpu_operational
130	printer - laserwriter - print - driver - ls	26	130_printer_laserwriter_print_driver
131	cancer - medical - center - centers - research	26	131_cancer_medical_center_centers
132	helmet - liner - foam - cb - helmets	26	132_helmet_liner_foam_cb
133	winbench - vlb - graphite - winmarks - stealth	25	133_winbench_vlb_graphite_winmarks
134	mhz - 486dx250 - bus - speed - 50mhz	25	134_mhz_486dx250_bus_speed
135	maxaxaxaxaxaxaxaxaxaxaxaxaxaxax - mg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9v - m4 - mp - 14	25	135_maxaxaxaxaxaxaxaxaxaxaxaxaxaxax_mg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9v_m4_mp
136	schools - moment - silence - prayer - cult	25	136_schools_moment_silence_prayer
137	ghostscript - postscript - pageview - ghostview - dsc	25	137_ghostscript_postscript_pageview_ghostview
138	celp - speech - dsp - voice - compression	25	138_celp_speech_dsp_voice
139	christian - christianity - oo - you - yourself	24	139_christian_christianity_oo_you
140	irq - com3 - com1 - port - com	24	140_irq_com3_com1_port
141	myers - stephanopoulos - president - ms - mr	24	141_myers_stephanopoulos_president_ms
142	professors - university - class - schools - champaignurbana	24	142_professors_university_class_schools
143	pope - church - schism - orthodox - creed	24	143_pope_church_schism_orthodox
144	shaft - wheelie - wheelies - shaftdrive - wheel	24	144_shaft_wheelie_wheelies_shaftdrive
145	clinton - bush - quayle - fingers - hed	24	145_clinton_bush_quayle_fingers
146	mode - vesa - modes - vga - video	24	146_mode_vesa_modes_vga
147	scope - scopes - oscilloscope - tektronix - 205	23	147_scope_scopes_oscilloscope_tektronix
148	odometer - sensor - mileage - speedo - gauge	23	148_odometer_sensor_mileage_speedo
149	bmw - list - bmws - message - matty	23	149_bmw_list_bmws_message
150	midi - driver - sound - blaster - soundblaster	22	150_midi_driver_sound_blaster
151	lock - kryptonite - cable - locks - bike	22	151_lock_kryptonite_cable_locks
152	monitor - problem - apple - 610 - centris	22	152_monitor_problem_apple_610
153	lens - camera - nikon - zoom - flash	21	153_lens_camera_nikon_zoom
154	hiv - aids - needles - health - patients	21	154_hiv_aids_needles_health
155	nuclear - weapons - plutonium - weapon - clancy	21	155_nuclear_weapons_plutonium_weapon
156	wave - bikers - harley - riders - waving	21	156_wave_bikers_harley_riders
157	truth - bible - arrogance - absolute - ra	21	157_truth_bible_arrogance_absolute
158	17 - trinitron - nanao - viewsonic - tube	21	158_17_trinitron_nanao_viewsonic
159	zane - 2ti - church - faith - book	21	159_zane_2ti_church_faith
160	rights - foa - right - slavery - labor	20	160_rights_foa_right_slavery
161	machine - card - beeps - error - register	20	161_machine_card_beeps_error
162	eye - prk - cornea - rk - vision	19	162_eye_prk_cornea_rk
163	cooling - water - steam - towers - plants	19	163_cooling_water_steam_towers
164	ear - wax - ears - acne - syringe	19	164_ear_wax_ears_acne
165	muscle - papillomatosis - disease - spasms - dn	18	165_muscle_papillomatosis_disease_spasms
166	revolver - kratz - gun - safety - glock	18	166_revolver_kratz_gun_safety
167	jim - context - articles - hypocrite - trm	18	167_jim_context_articles_hypocrite
168	tempest - equipment - monitor - emissions - radiation	18	168_tempest_equipment_monitor_emissions
169	cramer - homosexual - men - male - homosexuals	18	169_cramer_homosexual_men_male
170	ham - interference - radio - rf - transmitter	18	170_ham_interference_radio_rf
171	quoting - article - 1993apr150242468076virginiaedu - nough - ejv2jvirginiaedu	17	171_quoting_article_1993apr150242468076virginiaedu_nough
172	agrep - pgp - code - source - encryption	17	172_agrep_pgp_code_source
173	dma - bus - ide - isa - mbs	17	173_dma_bus_ide_isa
174	autoexecbat - desktop - norton - ndw - windows	17	174_autoexecbat_desktop_norton_ndw
175	ms - survey - microsoft - users - msdos	17	175_ms_survey_microsoft_users
176	dialing - tone - sweden - phone - germany	17	176_dialing_tone_sweden_phone
177	her - bike - passenger - ride - she	17	177_her_bike_passenger_ride
178	ups - weick - him - stock - chaparral	16	178_ups_weick_him_stock
179	prophecies - prophecy - lord - scripture - prophet	16	179_prophecies_prophecy_lord_scripture
180	test - abo - b4 - message - consistently	16	180_test_abo_b4_message
181	son - god - jesus - father - holy	16	181_son_god_jesus_father
182	sabbath - moses - tablets - commandments - ceremonial	16	182_sabbath_moses_tablets_commandments
183	jacket - womens - pants - clothing - pockets	16	183_jacket_womens_pants_clothing
184	xterm - xterms - cursor - emu - blinking	16	184_xterm_xterms_cursor_emu
185	abortion - abortions - women - choice - pregnancy	15	185_abortion_abortions_women_choice
186	card - ati - s3 - cards - orchid	15	186_card_ati_s3_cards
187	wasps - chiggers - centipedes - millipedes - polish	15	187_wasps_chiggers_centipedes_millipedes
188	image - processing - analysis - tools - plplot	15	188_image_processing_analysis_tools
189	fonts - pi - fences - truetype - select	15	189_fonts_pi_fences_truetype
190	cview - temp - directory - files - disk	15	190_cview_temp_directory_files
191	easter - resurrection - pagan - goddess - celebration	15	191_easter_resurrection_pagan_goddess
192	windows - network - dos - files - lan	15	192_windows_network_dos_files
193	fat - weight - insulin - muscle - chromium	15	193_fat_weight_insulin_muscle
194	icon - icons - click - winini - saver	14	194_icon_icons_click_winini
195	sampling - rate - oversampling - pcboard - filter	14	195_sampling_rate_oversampling_pcboard
196	crohns - inflammation - cleansing - fatty - patients	14	196_crohns_inflammation_cleansing_fatty
197	kidney - stones - calcium - magnesium - stone	14	197_kidney_stones_calcium_magnesium
198	manhattan - bobbeviceicotekcom - beauchaine - sank - bronx	14	198_manhattan_bobbeviceicotekcom_beauchaine_sank
199	ground - grounding - conductor - neutral - wire	14	199_ground_grounding_conductor_neutral
200	keyboard - rsi - typing - exercises - pc	14	200_keyboard_rsi_typing_exercises
201	tongues - language - speak - tounges - church	14	201_tongues_language_speak_tounges
202	610 - iivx - centris - c610 - apple	13	202_610_iivx_centris_c610
203	anonymous - anonymity - privacy - internet - encryption	13	203_anonymous_anonymity_privacy_internet
204	rosicrucian - rosicrucians - amorc - lectorium - crucis	13	204_rosicrucian_rosicrucians_amorc_lectorium
205	apple - dock - duo - powerpc - powerbook	13	205_apple_dock_duo_powerpc
206	diamond - stealth - drivers - card - video	13	206_diamond_stealth_drivers_card
207	religion - justifiable - war - wars - history	13	207_religion_justifiable_war_wars
208	sin - hate - love - sinner - hating	13	208_sin_hate_love_sinner
209	software - process - level - shuttle - wingert	12	209_software_process_level_shuttle
210	memory - shared - server - pixmaps - xputimage	12	210_memory_shared_server_pixmaps
211	smiley - karla - smileys - kuiper - qb1	12	211_smiley_karla_smileys_kuiper
212	68070 - 68040 - motorola - instruction - 68010	12	212_68070_68040_motorola_instruction
213	markocsmdocscom - book - wilson - 13016012215 - 18009229204	12	213_markocsmdocscom_book_wilson_13016012215
214	stud - footpeg - bike - leg - hole	12	214_stud_footpeg_bike_leg
215	42 - tea - question - answer - universe	12	215_42_tea_question_answer
216	blacks - african - white - culture - americans	12	216_blacks_african_white_culture
217	boards - solder - mask - green - board	11	217_boards_solder_mask_green
218	clinton - slightest - bush - choosing - government	11	218_clinton_slightest_bush_choosing
219	placebo - jb - rr - medicine - effect	11	219_placebo_jb_rr_medicine
220	8177 - techniciandr - dod - student - speed	11	220_8177_techniciandr_dod_student
221	8051 - nextstep - hendry - assembler - signetics	11	221_8051_nextstep_hendry_assembler
222	church - crossroads - movement - churches - boston	11	222_church_crossroads_movement_churches
223	stuffit - system - files - disk - macintosh	11	223_stuffit_system_files_disk
224	whatever - ye - shall - lord - heaven	11	224_whatever_ye_shall_lord
225	vv - mac - eeeee - eeee - iigs	10	225_vv_mac_eeeee_eeee
226	media - nw - washington - dc - street	10	226_media_nw_washington_dc
227	looking - sale - drills - eli - condition	10	227_looking_sale_drills_eli
228	print - printer - drag - file - capture	10	228_print_printer_drag_file
229	magi - osiris - masonry - zoroastrian - zoroastrianism	10	229_magi_osiris_masonry_zoroastrian
230	stephanopoulos - mr - president - serbs - bosnia	10	230_stephanopoulos_mr_president_serbs

Training hyperparameters

• calculate_probabilities: False
• language: english
• low_memory: False
• min_topic_size: 10
• n_gram_range: (1, 1)
• nr_topics: None
• seed_topic_list: None
• top_n_words: 10
• verbose: False
• zeroshot_min_similarity: 0.7
• zeroshot_topic_list: None

Framework versions

• Numpy: 2.3.5
• HDBSCAN: 0.8.41
• UMAP: 0.5.11
• Pandas: 3.0.0
• Scikit-Learn: 1.8.0
• Sentence-transformers: 5.2.0
• Transformers: 4.57.6
• Numba: 0.63.1
• Plotly: 6.5.2
• Python: 3.11.14