zephyr-7b-beta-oga / README.md
SamTheDev's picture
Upload folder using huggingface_hub
abedb70 verified
|
Raw
History Blame Contribute Delete
231 Bytes
metadata
license: mit
base_model:
  - HuggingFaceH4/zephyr-7b-beta
pipeline_tag: text-generation
tags:
  - onnx
  - onnxruntime-genai
  - oga

My personal favorite model of all time

My Tests (Tesla P4)

  • CUDA int4: TBD
  • CUDA int4_plh: TBD