Hugging Face's logo

Spaces:
NLPark
/
llama-python-streamingllm
Runtime error

App Files Community
Limour commited on
Commit
2c53b67
·
verified ·
1 Parent(s): 3881622

Upload rp_sample_config.json

Browse files
Files changed (1) hide show
  1. config/rp_sample_config.json +4 -1
config/rp_sample_config.json CHANGED
@@ -6,7 +6,10 @@
6
  "value": 4294967295
7
  },
8
  "setting_n_gpu_layers": {
9
- "value": 20
 
 
 
10
  },
11
  "setting_max_tokens": {
12
  "value": 1024,
 
6
  "value": 4294967295
7
  },
8
  "setting_n_gpu_layers": {
9
+ "value": 0
10
+ },
11
+ "setting_ctx": {
12
+ "value": 4096
13
  },
14
  "setting_max_tokens": {
15
  "value": 1024,