Spaces:

edugp
/

perplexity-lenses

Runtime error

App Files Files Community

perplexity-lenses / tests

510 Bytes

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

edugp's picture

Run tokenizer before computing perplexity and format

7b62017 over 4 years ago

__init__.py

0 Bytes
Add tests and fix issue when splitting into sentences, to grab the minimum number between total sentences and sample size, rather than total original documents and sample size over 4 years ago
test_data.py

510 Bytes
Run tokenizer before computing perplexity and format over 4 years ago