Add BERTopic model

README.md

@@ -0,0 +1,138 @@
+
+---
+tags:
+- bertopic
+library_name: bertopic
+pipeline_tag: text-classification
+---
+
+# ISSR_Dark_Web_68Topics
+
+This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. 
+BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. 
+
+## Usage 
+
+To use this model, please install BERTopic:
+
+```
+pip install -U bertopic
+```
+
+You can use the model as follows:
+
+```python
+from bertopic import BERTopic
+topic_model = BERTopic.load("D0men1c0/ISSR_Dark_Web_68Topics")
+
+topic_model.get_topic_info()
+```
+
+## Topic overview
+
+* Number of topics: 69
+* Number of training documents: 65529
+
+<details>
+  <summary>Click here for an overview of all topics.</summary>
+  
+  | Topic ID | Topic Keywords | Topic Frequency | Label | 
+|----------|----------------|-----------------|-------| 
+| -1 | anyone - get - update - review - new | 178 | outliers | 
+| 0 | weed - cannabis - cart - thc - review | 18900 | Cannabis Weed Vape Cart Reviews | 
+| 1 | help - guy - sub - need - back | 5021 | Subreddit Help Needed | 
+| 2 | order - shipping - package - pack - delivery | 2035 | USPS Package Delivery | 
+| 3 | empire - empire market - empire empire - market - deposit | 2005 | Empire Market Deposit Issues | 
+| 4 | vendor - vendor vendor - vendor inquiry - inquiry - new vendor | 1815 | Trusted Vendor Inquiries | 
+| 5 | scammer - scam - exit - scamming - scammed | 3142 | Exit Scammer Warning | 
+| 6 | darknet - dark - web - dark web - darkfail | 1649 | Dark Web Drug Trafficking Arrests | 
+| 7 | mdma - mda - mdma vendor - domestic - usa | 1390 | MDMA Vendor USA Sale | 
+| 8 | xanax - mg - diazepam - xanax vendor - valium | 1319 | Xanax Vendor Xanax Bars | 
+| 9 | lsd - ug - tab - lsd vendor - acid | 1233 | LSD Vendor Tab List | 
+| 10 | crosspost - giveaway - review crosspost - crosspost vendor - review | 1012 | Giveaway Crossposts | 
+| 11 | monero - btc - bitcoin - coin - wallet | 999 | Monero Exchange | 
+| 12 | carding - card - credit - credit card - debit | 933 | Credit Card Service | 
+| 13 | dream - dream market - nightmare - market - dream dream | 909 | Dream Market | 
+| 14 | dispute - mod - moderator - dispute dispute - please | 882 | Dispute resolution | 
+| 15 | cocaine - cocaine vendor - fishscale - peruvian - colombian | 763 | Cocaine Vendor Fish | 
+| 16 | review - vendor review - review vendor - vendor - review review | 771 | Vendor Reviews Product | 
+| 17 | market - market market - new market - markets - marketplace | 998 | New Market Core | 
+| 18 | pgp - key - pgp key - public - public pgp | 1020 | Public PGP Key | 
+| 19 | deposit - deposited - ticket - address - double | 654 | Double Deposit Support Ticket | 
+| 20 | bar - bunk - bars - selaminy - hulk | 646 | Bar Reviews | 
+| 21 | oxycodone - mg - oxy - opiate - opiateconnect | 590 | Oxycodone and Dilaudid Purchase | 
+| 22 | id - passport - fake - fake id - license | 608 | Fake IDs and Licenses | 
+| 23 | drug - drugsuk - drugs - selling drug - drug dealer | 544 | Drug Misadvertizing Risks | 
+| 24 | coke - coke vendor - best coke - uk coke - uk | 556 | Coke Topic | 
+| 25 | pill - xtc - xtc pill - ecstasy - pills | 544 | xtc pills for sale | 
+| 26 | counterfeit - note - euro - money - counterfeit money | 509 | Counterfeit Notes | 
+| 27 | ketamine - ketamine vendor - ketamine review - mdma ketamine - review ketamine | 483 | Ketamine Vendor | 
+| 28 | wsm - wsm wsm - wsm vendor - vendor wsm - wsm order | 467 | WSM Vendor | 
+| 29 | meth - crystal meth - crystal - meth vendor - methamphetamine | 485 | Crystal Meth Vendor Review | 
+| 30 | ticket - support ticket - support - please - ticket support | 479 | Ticket Support | 
+| 31 | hacked - hacker - hacking - job - lfw | 480 | Hacker Developer Job Exploits | 
+| 32 | login - account - password - log - fa | 471 | Login Issues | 
+| 33 | adderall - mg - ir - ritalin - vyvanse | 470 | Adderall Pharmacy Brand Name | 
+| 34 | xmr - btc xmr - btc - xmrto - xmr btc | 474 | xmr xmr | 
+| 35 | tails - tail - electrum - wallet - whonix | 433 | Tails Electrum Monero Wallet Issue | 
+| 36 | mushroom - mushrooms - shrooms - magic - cubensis | 393 | Mushrooms Magic Penis | 
+| 37 | dread - dread dread - cafe dread - cafe - dread word | 371 | Cafe Dread Topics | 
+| 38 | cc - cvv - vbv - cc vendor - cc cvv | 419 | cc vending | 
+| 39 | cryptonia - cryptonia market - cryptonia cryptonia - dcdutchconnectionuk - empire cryptonia | 382 | Cryptonia Vendor | 
+| 40 | withdraw - withdrawal - withdrawl - withdraws - btc | 375 | Withdrawal Issues BTC | 
+| 41 | escrow - multisig - escrow escrow - full escrow - escrow order | 397 | Escrow Services and Multisig | 
+| 42 | heroin - heroin vendor - afghan - afghan heroin - synthetic heroin | 335 | Afghan Heroin Sale | 
+| 43 | de - har - noen - som - fra | 378 | Discussion Topics | 
+| 44 | dnm - dnms - dn - bible - dnstars | 341 | DNMS Bible | 
+| 45 | wallstreet - wall - wall street - street - wall st | 339 | Wall Street Market | 
+| 46 | ddos - ddos attack - attack - ddos ddos - ddos attacks | 306 | DDOS Attacks | 
+| 47 | paypal - transfer - paypal transfer - paypal account - western union | 283 | PayPal Transfer Scams | 
+| 48 | heard - happened - anyone - anyone heard - thewizzardnl | 327 | Document Mentions | 
+| 49 | benzos - benzo - rc - benzo vendor - rc benzos | 281 | Benzos Vendors | 
+| 50 | fraud - fraudsters - fraud vendor - loan fraud - fraudfox | 308 | Fraud Vendor Loan | 
+| 51 | dream - dream vendor - dream market - vendor dream - vendor | 326 | Dream Market Vendor Inquiry | 
+| 52 | order - cancel - cancelled - refund - cancel order | 497 | Order Cancelled | 
+| 53 | bank - bank log - bank drop - log - bank account | 331 | Bank Fraud Cards | 
+| 54 | onion - onion site - site - onion link - onion list | 328 | Onion links | 
+| 55 | phishing - phishing link - phished - link - warning | 245 | Phishing Warning | 
+| 56 | apollon - apollon market - market - apollon apollon - mysteryland | 253 | Apollon Market | 
+| 57 | opsec - opsec opsec - opsec question - bad opsec - question | 242 | Opsec and Guides | 
+| 58 | link - working link - working - pm - link please | 226 | PM Working Share Links | 
+| 59 | mirror - working mirror - working - mirror link - empire mirror | 229 | mirror link | 
+| 60 | fentanyl - fent - carfentanil - selling fentanyl - analogue | 219 | Fentanyl | 
+| 61 | cgmc - invite - invite code - code - cgmc invite | 221 | Invite Code CGMC | 
+| 62 | alprazolam - powder - alprazolam powder - flualprazolam - etizolam | 211 | Alprazolam Powder | 
+| 63 | dmt - dmt vendor - dmt vape - odsmt - dmt dmt | 290 | DMT Vendors | 
+| 64 | captcha - rapture - rapture market - captcha captcha - incorrect | 202 | Rapture Market Captcha | 
+| 65 | chemical - research - research chemical - chems - research chemicals | 187 | Research Chemicals | 
+| 66 | tor - tor browser - browser - tor network - network | 198 | Tor Browser Research | 
+| 67 | mephedrone - meopcp - mxe - mescaline - mmc | 222 | Mephedrone |
+  
+</details>
+
+## Training hyperparameters
+
+* calculate_probabilities: True
+* language: None
+* low_memory: False
+* min_topic_size: 10
+* n_gram_range: (1, 2)
+* nr_topics: None
+* seed_topic_list: None
+* top_n_words: 10
+* verbose: True
+* zeroshot_min_similarity: 0.7
+* zeroshot_topic_list: None
+
+## Framework versions
+
+* Numpy: 1.26.4
+* HDBSCAN: 0.8.36
+* UMAP: 0.5.6
+* Pandas: 2.2.1
+* Scikit-Learn: 1.4.1.post1
+* Sentence-transformers: 3.0.1
+* Transformers: 4.39.3
+* Numba: 0.60.0
+* Plotly: 5.22.0
+* Python: 3.12.2

config.json

@@ -0,0 +1,17 @@
+{
+  "calculate_probabilities": true,
+  "language": null,
+  "low_memory": false,
+  "min_topic_size": 10,
+  "n_gram_range": [
+    1,
+    2
+  ],
+  "nr_topics": null,
+  "seed_topic_list": null,
+  "top_n_words": 10,
+  "verbose": true,
+  "zeroshot_min_similarity": 0.7,
+  "zeroshot_topic_list": null,
+  "embedding_model": "all-MiniLM-L6-v2"
+}

ctfidf.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1ad3ce7fe13070f89799cec9cc3b3127d5638ed1017b995f2c3201bc6e93943
+size 5661292

topic_embeddings.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8fe5935815052732831c8f48547a9a73bdab2727e3ee2e6159734be5d176e196
+size 106072