| |
|
| | --- |
| | tags: |
| | - bertopic |
| | library_name: bertopic |
| | pipeline_tag: text-classification |
| | --- |
| | |
| | # ISSR_Dark_Web_68Topics |
| | |
| | This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. |
| | BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. |
| | |
| | ## Usage |
| | |
| | To use this model, please install BERTopic: |
| | |
| | ``` |
| | pip install -U bertopic |
| | ``` |
| | |
| | You can use the model as follows: |
| | |
| | ```python |
| | from bertopic import BERTopic |
| | topic_model = BERTopic.load("D0men1c0/ISSR_Dark_Web_68Topics") |
| | |
| | topic_model.get_topic_info() |
| | ``` |
| | |
| | You can make predictions as follows: |
| | ```python |
| | sentence = ['Fentanyl'] |
| | topic, _ = topic_model.transform(sentence) |
| | topic_model.get_topic_info(topic[0]) |
| | ``` |
| | |
| | ## Topic overview |
| | |
| | * Number of topics: 69 |
| | * Number of training documents: 65529 |
| | |
| | <details> |
| | <summary>Click here for an overview of all topics.</summary> |
| | |
| | | Topic ID | Topic Keywords | Topic Frequency | Label | |
| | |----------|----------------|-----------------|-------| |
| | | -1 | anyone - get - update - review - new | 178 | outliers | |
| | | 0 | weed - cannabis - cart - thc - review | 18900 | Cannabis Weed Vape Cart Reviews | |
| | | 1 | help - guy - sub - need - back | 5021 | Subreddit Help Needed | |
| | | 2 | order - shipping - package - pack - delivery | 2035 | USPS Package Delivery | |
| | | 3 | empire - empire market - empire empire - market - deposit | 2005 | Empire Market Deposit Issues | |
| | | 4 | vendor - vendor vendor - vendor inquiry - inquiry - new vendor | 1815 | Trusted Vendor Inquiries | |
| | | 5 | scammer - scam - exit - scamming - scammed | 3142 | Exit Scammer Warning | |
| | | 6 | darknet - dark - web - dark web - darkfail | 1649 | Dark Web Drug Trafficking Arrests | |
| | | 7 | mdma - mda - mdma vendor - domestic - usa | 1390 | MDMA Vendor USA Sale | |
| | | 8 | xanax - mg - diazepam - xanax vendor - valium | 1319 | Xanax Vendor Xanax Bars | |
| | | 9 | lsd - ug - tab - lsd vendor - acid | 1233 | LSD Vendor Tab List | |
| | | 10 | crosspost - giveaway - review crosspost - crosspost vendor - review | 1012 | Giveaway Crossposts | |
| | | 11 | monero - btc - bitcoin - coin - wallet | 999 | Monero Exchange | |
| | | 12 | carding - card - credit - credit card - debit | 933 | Credit Card Service | |
| | | 13 | dream - dream market - nightmare - market - dream dream | 909 | Dream Market | |
| | | 14 | dispute - mod - moderator - dispute dispute - please | 882 | Dispute resolution | |
| | | 15 | cocaine - cocaine vendor - fishscale - peruvian - colombian | 763 | Cocaine Vendor Fish | |
| | | 16 | review - vendor review - review vendor - vendor - review review | 771 | Vendor Reviews Product | |
| | | 17 | market - market market - new market - markets - marketplace | 998 | New Market Core | |
| | | 18 | pgp - key - pgp key - public - public pgp | 1020 | Public PGP Key | |
| | | 19 | deposit - deposited - ticket - address - double | 654 | Double Deposit Support Ticket | |
| | | 20 | bar - bunk - bars - selaminy - hulk | 646 | Bar Reviews | |
| | | 21 | oxycodone - mg - oxy - opiate - opiateconnect | 590 | Oxycodone and Dilaudid Purchase | |
| | | 22 | id - passport - fake - fake id - license | 608 | Fake IDs and Licenses | |
| | | 23 | drug - drugsuk - drugs - selling drug - drug dealer | 544 | Drug Misadvertizing Risks | |
| | | 24 | coke - coke vendor - best coke - uk coke - uk | 556 | Coke Topic | |
| | | 25 | pill - xtc - xtc pill - ecstasy - pills | 544 | xtc pills for sale | |
| | | 26 | counterfeit - note - euro - money - counterfeit money | 509 | Counterfeit Notes | |
| | | 27 | ketamine - ketamine vendor - ketamine review - mdma ketamine - review ketamine | 483 | Ketamine Vendor | |
| | | 28 | wsm - wsm wsm - wsm vendor - vendor wsm - wsm order | 467 | WSM Vendor | |
| | | 29 | meth - crystal meth - crystal - meth vendor - methamphetamine | 485 | Crystal Meth Vendor Review | |
| | | 30 | ticket - support ticket - support - please - ticket support | 479 | Ticket Support | |
| | | 31 | hacked - hacker - hacking - job - lfw | 480 | Hacker Developer Job Exploits | |
| | | 32 | login - account - password - log - fa | 471 | Login Issues | |
| | | 33 | adderall - mg - ir - ritalin - vyvanse | 470 | Adderall Pharmacy Brand Name | |
| | | 34 | xmr - btc xmr - btc - xmrto - xmr btc | 474 | xmr xmr | |
| | | 35 | tails - tail - electrum - wallet - whonix | 433 | Tails Electrum Monero Wallet Issue | |
| | | 36 | mushroom - mushrooms - shrooms - magic - cubensis | 393 | Mushrooms Magic Penis | |
| | | 37 | dread - dread dread - cafe dread - cafe - dread word | 371 | Cafe Dread Topics | |
| | | 38 | cc - cvv - vbv - cc vendor - cc cvv | 419 | cc vending | |
| | | 39 | cryptonia - cryptonia market - cryptonia cryptonia - dcdutchconnectionuk - empire cryptonia | 382 | Cryptonia Vendor | |
| | | 40 | withdraw - withdrawal - withdrawl - withdraws - btc | 375 | Withdrawal Issues BTC | |
| | | 41 | escrow - multisig - escrow escrow - full escrow - escrow order | 397 | Escrow Services and Multisig | |
| | | 42 | heroin - heroin vendor - afghan - afghan heroin - synthetic heroin | 335 | Afghan Heroin Sale | |
| | | 43 | de - har - noen - som - fra | 378 | Discussion Topics | |
| | | 44 | dnm - dnms - dn - bible - dnstars | 341 | DNMS Bible | |
| | | 45 | wallstreet - wall - wall street - street - wall st | 339 | Wall Street Market | |
| | | 46 | ddos - ddos attack - attack - ddos ddos - ddos attacks | 306 | DDOS Attacks | |
| | | 47 | paypal - transfer - paypal transfer - paypal account - western union | 283 | PayPal Transfer Scams | |
| | | 48 | heard - happened - anyone - anyone heard - thewizzardnl | 327 | Document Mentions | |
| | | 49 | benzos - benzo - rc - benzo vendor - rc benzos | 281 | Benzos Vendors | |
| | | 50 | fraud - fraudsters - fraud vendor - loan fraud - fraudfox | 308 | Fraud Vendor Loan | |
| | | 51 | dream - dream vendor - dream market - vendor dream - vendor | 326 | Dream Market Vendor Inquiry | |
| | | 52 | order - cancel - cancelled - refund - cancel order | 497 | Order Cancelled | |
| | | 53 | bank - bank log - bank drop - log - bank account | 331 | Bank Fraud Cards | |
| | | 54 | onion - onion site - site - onion link - onion list | 328 | Onion links | |
| | | 55 | phishing - phishing link - phished - link - warning | 245 | Phishing Warning | |
| | | 56 | apollon - apollon market - market - apollon apollon - mysteryland | 253 | Apollon Market | |
| | | 57 | opsec - opsec opsec - opsec question - bad opsec - question | 242 | Opsec and Guides | |
| | | 58 | link - working link - working - pm - link please | 226 | PM Working Share Links | |
| | | 59 | mirror - working mirror - working - mirror link - empire mirror | 229 | mirror link | |
| | | 60 | fentanyl - fent - carfentanil - selling fentanyl - analogue | 219 | Fentanyl | |
| | | 61 | cgmc - invite - invite code - code - cgmc invite | 221 | Invite Code CGMC | |
| | | 62 | alprazolam - powder - alprazolam powder - flualprazolam - etizolam | 211 | Alprazolam Powder | |
| | | 63 | dmt - dmt vendor - dmt vape - odsmt - dmt dmt | 290 | DMT Vendors | |
| | | 64 | captcha - rapture - rapture market - captcha captcha - incorrect | 202 | Rapture Market Captcha | |
| | | 65 | chemical - research - research chemical - chems - research chemicals | 187 | Research Chemicals | |
| | | 66 | tor - tor browser - browser - tor network - network | 198 | Tor Browser Research | |
| | | 67 | mephedrone - meopcp - mxe - mescaline - mmc | 222 | Mephedrone | |
| | |
| | </details> |
| | |
| | ## Training hyperparameters |
| | |
| | * calculate_probabilities: True |
| | * language: None |
| | * low_memory: False |
| | * min_topic_size: 10 |
| | * n_gram_range: (1, 2) |
| | * nr_topics: None |
| | * seed_topic_list: None |
| | * top_n_words: 10 |
| | * verbose: True |
| | * zeroshot_min_similarity: 0.7 |
| | * zeroshot_topic_list: None |
| | |
| | ## Framework versions |
| | |
| | * Numpy: 1.26.4 |
| | * HDBSCAN: 0.8.36 |
| | * UMAP: 0.5.6 |
| | * Pandas: 2.2.1 |
| | * Scikit-Learn: 1.4.1.post1 |
| | * Sentence-transformers: 3.0.1 |
| | * Transformers: 4.39.3 |
| | * Numba: 0.60.0 |
| | * Plotly: 5.22.0 |
| | * Python: 3.12.2 |
| | |
