| tags: | |
| - coherence | |
| - brownian-bridge | |
| - gpt2 | |
| - simpsy | |
| library_name: pytorch | |
| # BBScore encoder — wiki_dim8 | |
| BBScore encoder checkpoint (latent_dim=8) trained on Wikisection, used for the | |
| Brownian Bridge coherence score in the [simpsy](https://github.com/bVendeville/simpsy) | |
| text simplification evaluation library. | |
| ## Usage | |
| ```python | |
| from simpsy import evaluate | |
| df = evaluate( | |
| ["The cat sat on the mat. It watched the mouse. Then it pounced."], | |
| families=["bbscore"], | |
| # simpsy reads the checkpoint from SIMPSY_BBSCORE_HF_REPO, defaulting | |
| # to this repo once wired in as the simpsy default. | |
| ) | |
| ``` | |
| Or point simpsy at this repo explicitly: | |
| ```bash | |
| export SIMPSY_BBSCORE_HF_REPO=BVendeville/bbscore-wiki-dim8 | |
| ``` | |
| ## Citation | |
| Sheng et al. (2024), "BBScore: A Brownian Bridge Based Metric for | |
| Assessing Text Coherence" — <https://arxiv.org/abs/2312.16893>. | |