TheBloke
/

Falcon-7B-Instruct-GPTQ

Text Generation

RefinedWebModel

text-generation-inference

4-bit precision

Model card Files Files and versions

Fix eos_token_id to align with vocabulary of this model

#6

by mike-ravkine - opened May 31, 2023

base: refs/heads/main

←

from: refs/pr/6

Discussion Files changed

Same problem as the 40b model in this repo.

See https://huggingface.co/TheBloke/falcon-40b-instruct-GPTQ/discussions/8

Upstream discussion: https://huggingface.co/tiiuae/falcon-40b-instruct/discussions/11

Fix eos_token_id to align with vocabulary of this model214ede75

TheBloke changed pull request status to merged May 31, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment