Metrics for 110k context size?
1
#4 opened 9 months ago
by
Thireus
6 tokens / seconds Epyc 7532 512 Go ram 7 RTX 3090 65000 Tokens context with ik_llama and this LLM: Thank's !!!
👍 😎 2
4
#2 opened 9 months ago
by
martossien
Wahoo thanks for sharing your work!
38
#1 opened 9 months ago
by
ubergarm