GGUF

by rUpere - opened Nov 30, 2024

Hello Rani, Nanda and Saha, Bikash and Maurya, Vikas and Shukla, Sandeep Kumar

Would like to try this model as part of the agentic workflows that I plan to develop using openwebui+ollama. But first I have to add it as GGUF.

Any plans to release a GGUF version for ollama? :)

BTW is it ATT&CK v15 or v14 that you trained the model?

Thanks for R&D efforts on getting from a lot of text, right away the essence - TTPs.

Hello @rUpere ,

I don't think GGUF + Roberta models are compatible as llama.cpp doesn't support Roberta-based models. May be there can be a GGML version instead.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment