GGUF
feature-extraction
How to use from the
Use from the
llama-cpp-python library
# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="fudanjx/med-embed-models",
	filename="medical-bge-large-mix2-F16.gguf",
)
output = llm(
	"Once upon a time,",
	max_tokens=512,
	echo=True
)
print(output)

This repo has collection of fine tuned medical embedding model based on bge

Downloads last month
4
GGUF
Model size
0.3B params
Architecture
bert
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support