👀's picture

👀

toxibunny

·

AI & ML interests

None yet

Recent Activity

liked a model about 5 hours ago

SicariusSicariiStuff/Assistant_Pepe_32B

reacted to elinas's post with 👀 about 8 hours ago

We conducted an experiment in an effort to revive LLaMA 1 33B as it had unique prose and a lack of "GPT-isms" and "slop" in its pretraining data, as well as being one of the favorites at the time. With multiple finetune runs, we were able to extend the model from it's pretrained base of 2048 to ~12,000 tokens adding approx. 500M tokens in the process. The effective length is 16,384 but it's better to keep it on the lower range. It writes well and in multiple formats. In the future, we have some ideas like implementing GQA. Please take a look and we would love to hear your feedback! https://huggingface.co/ZeusLabs/Chronos-Divergence-33B

liked a model about 8 hours ago

PinkPixel/Pip-2B

View all activity

Organizations

None yet

toxibunny 's models 6

toxibunny/Mistral-Small-22B-ArliAI-RPMax-Diluted-Q5_K_M-GGUF

22B • Updated Oct 26, 2024 • 2

toxibunny/Mistral-Small-22B-ArliAI-RPMax-Diluted

Text Generation • 22B • Updated Oct 26, 2024 • 4

toxibunny/mistral-small-rpmax-base-rpmax-shallow-v-curve-slerp-Q5_K_M-GGUF

22B • Updated Oct 25, 2024 • 7

toxibunny/mistral-small-rpmax-base-rpmax-shallow-v-curve-slerp

Text Generation • 22B • Updated Oct 25, 2024 • 2

toxibunny/mistral-small-unsloth-base-rpmax-base-v-curve-slerp-Q5_K_M-GGUF

22B • Updated Oct 25, 2024 • 7 • 1

toxibunny/mistral-small-unsloth-base-rpmax-base-v-curve-slerp

Text Generation • 22B • Updated Oct 25, 2024 • 6