Hugging Face's logo

Spaces:
codys12
/
MergeLlama-7b
Paused

App Files Community
2
codys12 commited on
Commit
14acdab
·
1 Parent(s): 598f44b

default tok length

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -15,7 +15,7 @@ if not torch.cuda.is_available():
15
  DESCRIPTION += "\n<p>Running on CPU 🥶 This demo does not work on CPU.</p>"
16
 
17
  MAX_MAX_NEW_TOKENS = 2048
18
- DEFAULT_MAX_NEW_TOKENS = 1024
19
  MAX_INPUT_TOKEN_LENGTH = 4096
20
 
21
  if torch.cuda.is_available():
 
15
  DESCRIPTION += "\n<p>Running on CPU 🥶 This demo does not work on CPU.</p>"
16
 
17
  MAX_MAX_NEW_TOKENS = 2048
18
+ DEFAULT_MAX_NEW_TOKENS = 256
19
  MAX_INPUT_TOKEN_LENGTH = 4096
20
 
21
  if torch.cuda.is_available():