metadata
tags:
- coherence
- brownian-bridge
- gpt2
- simpsy
library_name: pytorch
BBScore encoder — wiki_dim8
BBScore encoder checkpoint (latent_dim=8) trained on Wikisection, used for the Brownian Bridge coherence score in the simpsy text simplification evaluation library.
Usage
from simpsy import evaluate
df = evaluate(
["The cat sat on the mat. It watched the mouse. Then it pounced."],
families=["bbscore"],
# simpsy reads the checkpoint from SIMPSY_BBSCORE_HF_REPO, defaulting
# to this repo once wired in as the simpsy default.
)
Or point simpsy at this repo explicitly:
export SIMPSY_BBSCORE_HF_REPO=BVendeville/bbscore-wiki-dim8
Citation
Sheng et al. (2024), "BBScore: A Brownian Bridge Based Metric for Assessing Text Coherence" — https://arxiv.org/abs/2312.16893.