Sam Vance
Samvanity
AI & ML interests
None yet
Organizations
None yet
what is the expected effective context length for this model?
3
#1 opened over 1 year ago
by
Samvanity
Can you make a 4.65 bpw?
5
#1 opened almost 2 years ago
by
Samvanity
what is the minimum Hardware requirement?
3
#3 opened almost 2 years ago
by
Arunmass
What calibration dataset did you use to convert it?
1
#1 opened almost 2 years ago
by
Samvanity
using context above 4096 - need to set compress_pos_emb above 1?
5
#1 opened almost 2 years ago
by
Samvanity
Recommended settings?
9
#1 opened almost 2 years ago
by
zaq-hack
Wrong eos_token_id set in config.json
2
#1 opened almost 2 years ago
by
Samvanity
What is the context length of this model?
3
#4 opened about 2 years ago
by
MrHillsss