Add BERTopic model

README.md

@@ -0,0 +1,117 @@
+
+---
+tags:
+- bertopic
+library_name: bertopic
+pipeline_tag: text-classification
+---
+
+# rugby
+
+This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. 
+BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. 
+
+## Usage 
+
+To use this model, please install BERTopic:
+
+```
+pip install -U bertopic
+```
+
+You can use the model as follows:
+
+```python
+from bertopic import BERTopic
+topic_model = BERTopic.load("Anonymised/rugby")
+
+topic_model.get_topic_info()
+```
+
+## Topic overview
+
+* Number of topics: 50
+* Number of training documents: 27774
+
+<details>
+  <summary>Click here for an overview of all topics.</summary>
+  
+  | Topic ID | Topic Keywords | Topic Frequency | Label | 
+|----------|----------------|-----------------|-------| 
+| 0 | premiership - premiership rugby - gloucester - bristol - saints | 1226 | Premiership - England | 
+| 1 | hansen - foster - blacks - cane - steve hansen | 1077 | New Zealand Rugby - New Zealand | 
+| 2 | erasmus - rassie - springboks - rassie erasmus - boks | 1001 | South Africa Rugby - South Africa | 
+| 3 | marler - farrell - vunipola - tuilagi - owen farrell | 986 | England Rugby - England | 
+| 4 | champions cup - champions - european - challenge cup - challenge | 908 | European Cup - Europe | 
+| 5 | connacht - zebre - dragons - benetton - ulster | 837 | Pro14 - Various Countries | 
+| 6 | urc - united rugby - united rugby championship - hendrikse - bulls | 828 | United Rugby Championship - Various Countries | 
+| 7 | sexton - schmidt - ireland - johnny sexton - tadhg | 807 | Six Nations - Various Countries | 
+| 8 | rebels - melbourne - melbourne rebels - waratahs - brumbies | 798 | Super Rugby - Various Countries | 
+| 9 | saracens - premiership - rfu - wasps - worcester | 732 | Premiership - England | 
+| 10 | rennie - cheika - wallabies - hooper - cooper | 722 | Super Rugby - Australia | 
+| 11 | springboks - boks - rugby championship - championship - south africa | 717 | Rugby Championship - Various Countries | 
+| 12 | toulon - montpellier - french - agence france presse - agence france | 710 | Top 14 - France | 
+| 13 | urc - united rugby - united rugby championship - munster - dobson | 696 | United Rugby Championship - Various Countries | 
+| 14 | highlanders - dixon - ioane - lienert - lienert brown | 667 | Super Rugby - Various Countries | 
+| 15 | nienaber - springbok - boks - coetzee - marx | 638 | Rugby Championship - Various Countries | 
+| 16 | wales - wyn - wyn jones - biggar - alun wyn | 628 | Six Nations - Various Countries | 
+| 17 | jones - eddie - jones england - eddie jones - england | 627 |  World Cup - Various Countries | 
+| 18 | currie cup - currie - province - western province - golden lions | 596 | Currie Cup - South Africa | 
+| 19 | clermont - rochelle - la rochelle - bordeaux - toulon | 591 | Top 14 - France | 
+| 20 | sevens - series - world series - dubai - powell | 591 | Sevens - Various Countries | 
+| 21 | reds - queensland - queensland reds - brumbies - waratahs | 579 | Super Rugby - Various Countries | 
+| 22 | scotland - russell - hogg - townsend - finn | 575 | Six Nations - Various Countries | 
+| 23 | crusaders - robertson - havili - scott barrett - codie | 565 | Super Rugby - Various Countries | 
+| 24 | griquas - province - western province - currie cup - currie | 560 | Currie Cup - South Africa | 
+| 25 | italy - tommaso - nations - scotland - italian | 551 | Six Nations - Various Countries | 
+| 26 | santiago - argentina - sanchez - matias - creevy | 551 | Rugby Championship - Various Countries | 
+| 27 | sanzaar - zealand rugby - new zealand rugby - nz - pacific | 538 | Super Rugby - New Zealand | 
+| 28 | brumbies - force - nsw - western force - waratahs | 530 | Super Rugby AU - Australia | 
+| 29 | bulls - van zyl - zyl - odendaal - visagie | 517 | Premiership - England | 
+| 30 | fleck - stormers - dobson - kolisi - newlands | 498 | Super Rugby - South Africa | 
+| 31 | hurricanes - canterbury - savea - wellington - laumape | 492 | Super Rugby - New Zealand | 
+| 32 | world rugby - rugby world - japan - world - rugby world cup | 480 | Rugby World Cup - Various Countries | 
+| 33 | whiteley - ackermann - lions - elton - elton jantjies | 477 | Currie Cup - South Africa | 
+| 34 | sharks - preez - du preez - bosch - du | 470 | Super Rugby - South Africa | 
+| 35 | dupont - les - romain - france - french | 454 | Six Nations - Various Countries | 
+| 36 | cardiff - munster - ospreys - ulster - academy | 450 | Pro14 - Various Countries | 
+| 37 | pumas - blue bulls - blue - griquas - currie cup | 423 | Currie Cup - South Africa | 
+| 38 | bledisloe - bledisloe cup - wallabies - blacks - cheika | 359 | Bledisloe Cup - Australia/New Zealand | 
+| 39 | fiji - kenya - canada - samoa - spain | 350 | Sevens - Various Countries | 
+| 40 | wales - gatland - owens - welsh - stadium | 317 | Six Nations - Various Countries | 
+| 41 | samoa - tonga - fiji - world cup - rugby world | 307 | Rugby World Cup - Various Countries | 
+| 42 | sunwolves - japanese - tokyo - rebels - waratahs | 282 | Super Rugby - Japan | 
+| 43 | wprfu - marais - saru - wp - newlands | 278 | Currie Cup - South Africa | 
+| 44 | sa rugby - saru - sa - roux - kings | 254 | Rugby Championship - Various Countries | 
+| 45 | gatland - lions - irish lions - british irish - british irish lions | 253 | British Irish Lions - Various Countries | 
+| 46 | hendrikse - stormers - bulls - jacobs - sharks | 110 | United Rugby Championship - Various Countries | 
+| 47 | folau - israel - rugby australia - million - australia | 104 | Rugby Championship - Various Countries | 
+| 48 | committee - sanzaar - weeks - nigel - player | 60 | SANZAAR - Various Countries | 
+| 49 | lyon - bulls - pretoria - burger - champions | 7 | Top 14 - France |
+  
+</details>
+
+## Training hyperparameters
+
+* calculate_probabilities: False
+* language: None
+* low_memory: False
+* min_topic_size: 10
+* n_gram_range: (1, 1)
+* nr_topics: None
+* seed_topic_list: None
+* top_n_words: 20
+* verbose: True
+
+## Framework versions
+
+* Numpy: 1.21.0
+* HDBSCAN: 0.8.29
+* UMAP: 0.5.3
+* Pandas: 2.0.2
+* Scikit-Learn: 1.2.2
+* Sentence-transformers: 2.2.2
+* Transformers: 4.29.2
+* Numba: 0.57.0
+* Plotly: 5.14.1
+* Python: 3.9.6

config.json

@@ -0,0 +1,15 @@
+{
+  "calculate_probabilities": false,
+  "language": null,
+  "low_memory": false,
+  "min_topic_size": 10,
+  "n_gram_range": [
+    1,
+    1
+  ],
+  "nr_topics": null,
+  "seed_topic_list": null,
+  "top_n_words": 20,
+  "verbose": true,
+  "embedding_model": "distiluse-base-multilingual-cased-v1"
+}

topic_embeddings.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:315443da0f29df8c4e2374a00b0184782e833f1cd23f0c2b895219eb2007ba3e
+size 102488