should i expect lower accuracy from the original model
#2
by YairFr - opened
but sending the same prompt, one time to the original model , using LlamaForCausalLM.from_pretrained
and one time via wrapping the ggml model via Llamacpp and use it in langchain's AgentExecutor - i get different (and worse) results
Can you provide an example of those differences?
what i wrote here https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML/discussions/9 is relevant also for this model.