Quantizations of https://huggingface.co/euclaise/ReMask-3B
From original readme
Prompt format
The format for reddit-instruct and oasst2 was:
<|user|>
[insert instruction here]
<|assistant|>
[insert response here]
<|user|>
...
The format for TinyCoT was:
<|user|>
[insert instruction here]
<|rationale|>
[insert reasoning here]
<|answer|>
[insert direct answer here]
- Downloads last month
- 87
Hardware compatibility
Log In to add your hardware
1-bit
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit