seanpedrickcase/topic_modelling at 381f959544100d6aa4a6f81444b54fd764cbde4f

topic_modelling / funcs

125 kB

4 contributors

Allowed for uploading custom regex for cleaning. Fixed calculate all probabilities, reduce outliers. Added text tree for hierarchical modelling.

381f959 almost 2 years ago

__init__.py
0 Bytes

first commit almost 2 years ago
anonymiser.py
10.2 kB

Added clean data options, improved re-representation options and visualisation. General format changes almost 2 years ago
bertopic_hierarchical_documents.py
15.4 kB

Changed Phi model to smaller StableLM 2 1.6. Fixed a None type detection error. almost 2 years ago
bertopic_hierarchical_documents_to_df.py
12.2 kB

Changed Phi model to smaller StableLM 2 1.6. Fixed a None type detection error. almost 2 years ago
bertopic_vis_documents.py
30.5 kB

Allowed for loading in external topic labels. A few visualisation modifications. almost 2 years ago
clean_funcs.py
5.42 kB

Allowed for uploading custom regex for cleaning. Fixed calculate all probabilities, reduce outliers. Added text tree for hierarchical modelling. almost 2 years ago
embeddings.py
2.54 kB

Hopefully now LLM download from hub should work almost 2 years ago
helper_functions.py
9.89 kB

Allowed for uploading custom regex for cleaning. Fixed calculate all probabilities, reduce outliers. Added text tree for hierarchical modelling. almost 2 years ago
presidio_analyzer_custom.py
4.18 kB

Added clean data options, improved re-representation options and visualisation. General format changes almost 2 years ago
prompts.py
4.86 kB

Model export changed to safetensors. Improved representational model function. Got zero shot topic modelling working almost 2 years ago
representation_model.py
6.74 kB

Hopefully now LLM download from hub should work almost 2 years ago
topic_core_funcs.py
22.9 kB

Allowed for uploading custom regex for cleaning. Fixed calculate all probabilities, reduce outliers. Added text tree for hierarchical modelling. almost 2 years ago