File size: 869 Bytes
b219d99 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
### RWKV-7 "Goose" enabled ###
SamplerConfig(
max_tokens=4096,
temperature=1.0,
top_p=0.3,
presence_penalty=0.5,
count_penalty=0.5,
penalty_decay=0.996,
stop=['\n\n'],
stop_tokens=[0]
)
Loading models\rwkv7-g1a-0.1b-20250728-ctx4096 (cpu fp16)
INFO: 127.0.0.1:50012 - "POST /api/v1/chat/completions HTTP/1.1" 200 OK
INFO: 127.0.0.1:50128 - "POST /api/v1/chat/completions HTTP/1.1" 200 OK
INFO: 127.0.0.1:50128 - "POST /api/v1/chat/completions HTTP/1.1" 200 OK
INFO: 127.0.0.1:50763 - "POST /api/v1/chat/completions HTTP/1.1" 200 OK
INFO: 127.0.0.1:50973 - "POST /api/v1/chat/completions HTTP/1.1" 200 OK
INFO: 127.0.0.1:51134 - "POST /api/v1/chat/completions HTTP/1.1" 422 Unprocessable Entity
INFO: 127.0.0.1:51144 - "POST /api/v1/chat/completions HTTP/1.1" 422 Unprocessable Entity
|