duyntnet/Delexa-Instruct-V0.1-7b-imatrix-GGUF

Quantizations of https://huggingface.co/lex-hue/Delexa-Instruct-V0.1-7b

From original readme

Delexa-V0.1-Instruct-7b: Our Newest and Best Model Yet!

We are excited to announce the release of Delexa-V0.1-Instruct-7b, our newest and best model yet! Delexa-V0.1-Instruct-7b has shown excellent performance on a variety of tasks, and we are confident that it will be a valuable asset to the research community.

Eval Results

Delexa-V0.1-Instruct-7b was evaluated on a dataset of question-answer pairs. The model was given a single question and three different answer choices, and it was tasked with selecting the best answer. Delexa-V0.1-Instruct-7b achieved an average score of 8.27 on this task.

Here is a table showing the detailed eval results:

Model	Turn 1	Turn 2	Average
gpt-4	8.95625	9.0250	8.990625
Delexa-V0.1-Instruct-7b	8.57500	7.9500	8.268750
claude-v1	8.15000	7.6500	7.900000
gpt-3.5-turbo	8.07500	7.8125	7.943750
vicuna-13b-v1.3	6.81250	5.9625	6.387500
palm-2-chat-bison-001	6.71250	6.0875	6.400000