|
|
|
|
|
--- |
|
|
tags: |
|
|
- bertopic |
|
|
library_name: bertopic |
|
|
pipeline_tag: text-classification |
|
|
--- |
|
|
|
|
|
# ISSR_Dark_Web_Merged_Models_Content_Thread |
|
|
|
|
|
This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. |
|
|
BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. |
|
|
|
|
|
## Usage |
|
|
|
|
|
To use this model, please install BERTopic: |
|
|
|
|
|
``` |
|
|
pip install -U bertopic |
|
|
``` |
|
|
|
|
|
You can use the model as follows: |
|
|
|
|
|
```python |
|
|
from bertopic import BERTopic |
|
|
topic_model = BERTopic.load("D0men1c0/ISSR_Dark_Web_Merged_Models_Content_Thread") |
|
|
|
|
|
topic_model.get_topic_info() |
|
|
``` |
|
|
|
|
|
You can make predictions as follows: |
|
|
```python |
|
|
sentence = ["recently closed Samsara market"] |
|
|
topic, _ = topic_model.transform(sentence) |
|
|
topic_model.get_topic_info(topic[0]) |
|
|
``` |
|
|
|
|
|
## Topic overview |
|
|
|
|
|
* Number of topics: 133 |
|
|
* Number of training documents: 326525 |
|
|
|
|
|
<details> |
|
|
<summary>Click here for an overview of all topics.</summary> |
|
|
|
|
|
| Topic ID | Topic Keywords | Topic Frequency | Label | |
|
|
|----------|----------------|-----------------|-------| |
|
|
| -1 | vendor - order - nt - market - link | 178 | -1_vendor_order_nt_market | |
|
|
| 0 | cart - weed - strain - thc - bud | 110608 | Weed Products | |
|
|
| 1 | deposit - address - ticket - btc - wallet | 19104 | BTC Wallet Transactions | |
|
|
| 2 | key - pgp - account - pgp key - password | 6011 | PGP Key Management | |
|
|
| 3 | order - shipped - ordered - day - week | 6350 | The topic is about the status updates for orders | |
|
|
| 4 | scam - scammer - scam scam - scam scam scam - scammed | 3368 | Scam Vendors | |
|
|
| 5 | thanks - thank - lol - man - bro | 4836 | Thanks mate | |
|
|
| 6 | ship - country - eu - shipping - uk | 4584 | International Shipping Countries | |
|
|
| 7 | coke - cocaine - quality - product - good | 3425 | Cocaine Quality | |
|
|
| 8 | card - carding - cc - gift card - gift | 4161 | Card Fraud Techniques | |
|
|
| 9 | pgp - begin pgp - begin - pgp signature - signature | 4192 | PGP Signatures | |
|
|
| 10 | lsd - tab - ug - acid - blotter | 2462 | LSD Vendor | |
|
|
| 11 | vendor - good - anyone - know - legit | 3574 | Find Legit Vendor | |
|
|
| 12 | dispute - refund - mod - order - moderator | 5834 | Dispute Resolution | |
|
|
| 13 | wsm - dream - market - exit - vendor | 2863 | WSM Exit Dream Market Scam | |
|
|
| 14 | drug - police - get - nt - house | 2455 | Drug raid | |
|
|
| 15 | monero - xmr - wallet - btc - exchange | 2214 | Monero Wallet Usage | |
|
|
| 16 | ddos - attack - ddos attack - mirror - market | 3928 | DDoS Attack Mirror Market | |
|
|
| 17 | mdma - mda - price - quality - vendor | 2056 | MDMA Price & Quality | |
|
|
| 18 | darknet - clearnet - dark - link - darknetmarkets | 3244 | Darknet Marketplaces | |
|
|
| 19 | sub - post - mod - banned - link | 3277 | Moderation and Bans | |
|
|
| 20 | bar - alp - hulk - press - pack | 1942 | Product Reviews | |
|
|
| 21 | xanax - bar - alp - mg - alprazolam | 2940 | Alprazolam Pills | |
|
|
| 22 | market - new market - market market - good - new | 3269 | Market Introduction | |
|
|
| 23 | feedback - review - vendor - negative - positive | 2670 | Vendor Reviews | |
|
|
| 24 | mirror - working - working mirror - mirror link - link | 1802 | Mirror Working Links | |
|
|
| 25 | mg - pill - tablet - price - xtc | 1447 | MDMA Products | |
|
|
| 26 | box - mail - package - address - po | 4287 | Mailbox Addresses | |
|
|
| 27 | review - thanks - thanks review - review thanks - nice review | 2829 | Positive Reviews | |
|
|
| 28 | ticket - support ticket - support - se en - se | 2240 | Support Ticket | |
|
|
| 29 | cryptonia - market - empire - nightmare - vendor | 1811 | Cryptonia Market | |
|
|
| 30 | escrow - fe - use escrow - vendor - market | 1589 | Escrow Services | |
|
|
| 31 | onion - dot onion - dot - onion link - onion site | 1551 | Onion Links | |
|
|
| 32 | det - er - og - har - jeg | 1471 | Kola;Vendor;Stealth Shipping;Review;Norway | |
|
|
| 33 | tor - browser - network - javascript - tor browser | 1126 | Tor Browser | |
|
|
| 34 | dread - reddit - post - dread dread - sub | 1331 | Reddit Dread Community | |
|
|
| 35 | meth - business day - business - day - good | 1493 | Drug Cartel Business | |
|
|
| 36 | fent - fentanyl - opiate - heroin - nt | 1640 | Drug Overdose | |
|
|
| 37 | link - link link - point link comment - link point link - link comment post | 2294 | Links and Comments | |
|
|
| 38 | pack - week - day - ordered - land | 1332 | Packaged Goods Delivery | |
|
|
| 39 | pm - interested - looking - find - please | 1499 | PM Interested Help Explanation | |
|
|
| 40 | hugbunter - hugbunter hugbunter - link hugbunter - hugbunter link - link hugbunter hugbunter | 1157 | Hugbunter Links | |
|
|
| 41 | drug - police - court - enforcement - investigation | 923 | Dark web drug | |
|
|
| 42 | stealth - good - good stealth - vendor - shipping | 849 | Stealth Vendor Order | |
|
|
| 43 | counterfeit - note - euro - bill - pen | 968 | Counterfeit Euro Bills | |
|
|
| 44 | empire - nightmare - empire empire - find empire - empire nightmare | 1493 | Empire Support | |
|
|
| 45 | day - waiting - week - month - hour | 1040 | Time Waiting | |
|
|
| 46 | id - passport - fake - license - scan | 1681 | Fake IDs & Licenses | |
|
|
| 47 | bank - account - drop - bank drop - cash | 1623 | Bank Transactions | |
|
|
| 48 | wickr - use wickr - using wickr - contact - via wickr | 2178 | Wickr Usage | |
|
|
| 49 | de - und - que - un - da | 751 | German Darknet Market | |
|
|
| 50 | phishing - phishing link - link - phished - phishing site | 1081 | Phishing Links | |
|
|
| 51 | dream - nightmare - dream dream - anyone - like | 1294 | Dream Analysis | |
|
|
| 52 | price - sale - promo - sell - buy | 756 | Sale and Promotions | |
|
|
| 53 | tails - tail - usb - electrum - persistent | 1101 | Tail Electrum USB Persistent File | |
|
|
| 54 | adderall - amphetamine - mg - replacement - speed | 1583 | ADHD Medications | |
|
|
| 55 | cancel - order - auto - cancel order - day | 1353 | Order Cancellation | |
|
|
| 56 | mushroom - shrooms - cubensis - psilocybin - spore | 1294 | Mushroom Growing Tips | |
|
|
| 57 | ketamine - gm - gm gm - gm gm gm - vendor | 1134 | Ketamine Vendor Quality | |
|
|
| 58 | exit - exit scam - scam - exit scamming - exit scammed | 1163 | Exit Scams Market | |
|
|
| 59 | phone - burner - sim - card - number | 691 | Burner Phone SIM Card | |
|
|
| 60 | dream - market - dream market - nightmare - nightmare market | 830 | Dream Market | |
|
|
| 61 | bond - vendor bond - vendor - bond back - market | 2239 | Vendor Bond Back | |
|
|
| 62 | vpn - tor - use - using - proxy | 546 | VPN/Proxy Security Tools | |
|
|
| 63 | jabber - telegram - xmpp - pidgin - otr | 1054 | Instant Messaging Apps | |
|
|
| 64 | dmt - psychedelics - per - psychedelic - changa | 588 | Psychedelics | |
|
|
| 65 | captcha - captchas - page - enter - login | 899 | Captcha Login Page | |
|
|
| 66 | sample - free sample - free - review - sample pack | 713 | Sample Requests | |
|
|
| 67 | update - issue - problem - working - fixed | 682 | Bug Fix Progress | |
|
|
| 68 | cgmc - invite - vendor - cgmc cgmc - link cgmc | 1410 | CGMC Invite Vendor Links | |
|
|
| 69 | apollon - apollon market - market - empire - apollomarket | 694 | Apollon Marketplace | |
|
|
| 70 | paypal - transfer - account - paypal account - paypal transfer | 750 | PayPal Transfer | |
|
|
| 71 | giveaway - win - number - winner - contest | 1008 | Giveaway Contest | |
|
|
| 72 | pm - working link - link - link please - please | 739 | PM Link | |
|
|
| 73 | darkfail - link - fail - dark - dark fail | 745 | Dark Fail Link | |
|
|
| 74 | empire - market - empire market - nightmare - alphabay | 598 | Empire Market | |
|
|
| 75 | package - pack - delivery - tracking - day | 2959 | Package Tracking | |
|
|
| 76 | bag - dog - seal - mylar - vac | 3821 | Vacuum Sealing | |
|
|
| 77 | opsec - opsec opsec - link opsec - opsec link - opsec opsec link | 542 | OpSec Strategies | |
|
|
| 78 | link - working - working link - main link - link working | 618 | Working Links | |
|
|
| 79 | money - pay - money back - dollar - get | 875 | Financial Gain - pay | |
|
|
| 80 | tracking - tracking number - number - order - day | 513 | Tracking Order | |
|
|
| 81 | guide - tutorial - outdated - thanks - method | 1078 | Guides and Tutorials | |
|
|
| 82 | bir - bu - kai - ama - var | 357 | Bir Kai Var | |
|
|
| 83 | rc - mxe - dck - rcs - fdck | 356 | Molecular Simulations | |
|
|
| 84 | cash - btc - bitcoin - coinbase - atm | 549 | Cryptocurrency Trading | |
|
|
| 85 | olympus - market - fe escrow - olympus market - dream | 1271 | Olympus Market Exit Scam | |
|
|
| 86 | log - logged - logging - login - page | 338 | Logging and Login | |
|
|
| 87 | vacation - vacation mode - mode - back - profile | 401 | Vacation Mode | |
|
|
| 88 | message - contact - email - support - send | 331 | Email Support | |
|
|
| 89 | post - mod - comment - delete - thread | 748 | Forum Moderation | |
|
|
| 90 | xmr - wallet - deposit - monero - payment id | 3404 | Monero Wallet Deposit | |
|
|
| 91 | image - exif - upload - exif data - data | 946 | Image | |
|
|
| 92 | back - hope - welcome back - luck - good | 399 | Welcome Back | |
|
|
| 93 | review - template - pic - picture - table | 2240 | Template Review | |
|
|
| 94 | cheer - cheer cheer - cheer mate - mate - anyone | 547 | Cheering Mates | |
|
|
| 95 | bulk - price - kratom - good - kg | 307 | Kratom Bulk Price Comparison | |
|
|
| 96 | wallstreet - wall st - wall - st - wallstreetmarket | 675 | Wall Street Market | |
|
|
| 97 | product - stealth - shipping - quality - price | 685 | Product Reviews | |
|
|
| 98 | listing - list - superlist - vendor - search | 2037 | List Vendor Superlist | |
|
|
| 99 | fuck - cunt - dick - fud fud - fud fud fud | 493 | Mom sex - Insults | |
|
|
| 100 | empire - exit - market - scam - exit scam | 3076 | Empire Market Scam | |
|
|
| 101 | protonmail - protonmailcom - email - proton - secmail | 1138 | Proton Mail Security | |
|
|
| 102 | wallet - node - gui - monero - remote node | 296 | Monero Wallet | |
|
|
| 103 | multisig - market - transaction - escrow - use multisig | 423 | Multisig Market Usage | |
|
|
| 104 | bunk - bunk bar - bar - hulk - sent bunk | 307 | Bunk Bar Hulk | |
|
|
| 105 | mg - benzo - benzos - alprazolam - alp | 355 | Drug Classification | |
|
|
| 106 | pelican - bird - pelicanvendor - bigbird - pelicanvendor pelicanvendor link | 2750 | Pelican Bird Vendor Links | |
|
|
| 107 | heinekenexpress - link heinekenexpress - heinekenexpress link - heinekenexpress heinekenexpress - link heinekenexpress heinekenexpress | 249 | Heineken Express Review | |
|
|
| 108 | rdp - sock - vpn - ip - card | 266 | RDP VPN Sockets | |
|
|
| 109 | dnm - dm - dread - forum - link | 401 | DNS Community Forum | |
|
|
| 110 | pic - picture - photo - photoshop - post pic | 937 | Visual Editing Requests | |
|
|
| 111 | empire - link - empiremarket - empire link - link empire | 476 | Empire Market Link | |
|
|
| 112 | invite - invite code - code - need invite - get invite | 398 | Invites and Codes | |
|
|
| 113 | samsara - market - samsara market - sam - dream | 224 | Samsara Market | |
|
|
| 114 | chemical - test - lab - powder - product | 290 | Research Chemicals Testing | |
|
|
| 115 | rapture - rapture market - rapturemarket - market - gbp | 1262 | Rapture Market | |
|
|
| 116 | water - acetone - powder - dry - ml | 214 | Acetone Solution Prep | |
|
|
| 117 | witchman - link witchman - link - witchman link - witchman witchman | 1754 | Witchman Links | |
|
|
| 118 | tochka - market - tochka market - tochka tochka - use tochka | 218 | Tochka marketplace | |
|
|
| 119 | post - know guy know - guy know guy - know guy - guy know | 210 | Know Guy Posts | |
|
|
| 120 | subdread - sub - post - subdreads - create | 2589 | SubDread Forum Creation | |
|
|
| 121 | crosspost - giveaway - review crosspost - crosspost vendor - review | 509 | Crosspost Giveaway Review | |
|
|
| 122 | oxycodone - mg - oxy - opiate - opiateconnect | 999 | Opiate Dosages | |
|
|
| 123 | drug - drugsuk - drugs - selling drug - drug dealer | 608 | Drugs and Drug Market | |
|
|
| 124 | hacked - hacker - hacking - job - lfw | 556 | Hacker Job | |
|
|
| 125 | login - account - password - log - fa | 471 | Login and Registration Issues | |
|
|
| 126 | cc - cvv - vbv - cc vendor - cc cvv | 470 | Credit Card Data | |
|
|
| 127 | withdraw - withdrawal - withdrawl - withdraws - btc | 382 | Bitcoin Withdrawal | |
|
|
| 128 | heard - happened - anyone - anyone heard - thewizzardnl | 397 | Something Happened | |
|
|
| 129 | benzos - benzo - rc - benzo vendor - rc benzos | 281 | Benzos Vendors | |
|
|
| 130 | fraud - fraudsters - fraud vendor - loan fraud - fraudfox | 308 | Fraud and Loan Scams | |
|
|
| 131 | mephedrone - meopcp - mxe - mescaline - mmc | 326 | Chemicals and Drugs | |
|
|
|
|
|
</details> |
|
|
|
|
|
## Training hyperparameters |
|
|
|
|
|
* calculate_probabilities: True |
|
|
* language: None |
|
|
* low_memory: True |
|
|
* min_topic_size: 10 |
|
|
* n_gram_range: (1, 3) |
|
|
* nr_topics: None |
|
|
* seed_topic_list: None |
|
|
* top_n_words: 10 |
|
|
* verbose: True |
|
|
* zeroshot_min_similarity: 0.7 |
|
|
* zeroshot_topic_list: None |
|
|
|
|
|
## Framework versions |
|
|
|
|
|
* Numpy: 1.26.4 |
|
|
* HDBSCAN: 0.8.36 |
|
|
* UMAP: 0.5.6 |
|
|
* Pandas: 2.2.1 |
|
|
* Scikit-Learn: 1.4.1.post1 |
|
|
* Sentence-transformers: 3.0.1 |
|
|
* Transformers: 4.39.3 |
|
|
* Numba: 0.60.0 |
|
|
* Plotly: 5.22.0 |
|
|
* Python: 3.12.2 |
|
|
|
