tim1900 commited on
Commit
9b80b3f
·
verified ·
1 Parent(s): 6b26f41

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -57,7 +57,7 @@ text="In the heart of the bustling city, where towering skyscrapers touch the cl
57
  With each passing light year, the anticipation of unraveling secrets that could alter humanity's\
58
  understanding of life in the universe grew ever stronger."
59
 
60
- # chunk the text. The lower threshold is, the more chunks will be generated. Can be negative or positive.
61
  chunks=model.chunk_text(text, tokenizer, threshold=0)
62
 
63
  # print chunks
 
57
  With each passing light year, the anticipation of unraveling secrets that could alter humanity's\
58
  understanding of life in the universe grew ever stronger."
59
 
60
+ # chunk the text. The lower threshold is, the more chunks will be generated. Can be (-inf, +inf).
61
  chunks=model.chunk_text(text, tokenizer, threshold=0)
62
 
63
  # print chunks