Image-Text-to-Text
GGUF
English
agent
llm
vl
consciousness
conscious
bce
prettybird
cicikuş
text-generation-inference
conversational
Instructions to use pthinc/prettybird_bce_basic_vl_8b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use pthinc/prettybird_bce_basic_vl_8b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf pthinc/prettybird_bce_basic_vl_8b:Q4_K_M # Run inference directly in the terminal: llama cli -hf pthinc/prettybird_bce_basic_vl_8b:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf pthinc/prettybird_bce_basic_vl_8b:Q4_K_M # Run inference directly in the terminal: llama cli -hf pthinc/prettybird_bce_basic_vl_8b:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf pthinc/prettybird_bce_basic_vl_8b:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf pthinc/prettybird_bce_basic_vl_8b:Q4_K_M
Use Docker
docker model run hf.co/pthinc/prettybird_bce_basic_vl_8b:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use pthinc/prettybird_bce_basic_vl_8b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "pthinc/prettybird_bce_basic_vl_8b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "pthinc/prettybird_bce_basic_vl_8b", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/pthinc/prettybird_bce_basic_vl_8b:Q4_K_M
- Ollama
How to use pthinc/prettybird_bce_basic_vl_8b with Ollama:
ollama run hf.co/pthinc/prettybird_bce_basic_vl_8b:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use pthinc/prettybird_bce_basic_vl_8b with Docker Model Runner:
docker model run hf.co/pthinc/prettybird_bce_basic_vl_8b:Q4_K_M
- Lemonade
How to use pthinc/prettybird_bce_basic_vl_8b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull pthinc/prettybird_bce_basic_vl_8b:Q4_K_M
Run and chat with the model
lemonade run user.prettybird_bce_basic_vl_8b-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
-
Rename LICENSE to LICENSE.md
Verified signature093e43d
-
Update README.md
Verified signaturef9abe06
-
Update Modelfile
Verified signature67e8f0b
-
Update README.md
Verified signaturefb8372c -
Update README.md
Verified signature49698cc
-
Update Modelfile
Prometech Computer Sciences CorpVerified signature8b25d5d -
Update README.md
Prometech Computer Sciences CorpVerified signature61f2746 -
Update README.md
Prometech Computer Sciences CorpVerified signaturecc3d4dc -
Update README.md
Prometech Computer Sciences CorpVerified signaturee8fc0d3 -
Update LICENSE
Prometech Computer Sciences CorpVerified signaturecd006de -
Update Modelfile
Prometech Computer Sciences CorpVerified signaturefb39af1 -
Update README.md
Prometech Computer Sciences CorpVerified signaturec9eb7a8 -
Update README.md
Prometech Computer Sciences CorpVerified signature9f4a6a8 -
Rename prettybird_bce_basic_vl_7b_q2_k.gguf to prettybird_bce_basic_vl_8b_q2_k.gguf
Prometech Computer Sciences CorpVerified signaturea5107e6 -
Rename prettybird_bce_basic_vl_7b_q4_k_m.gguf to prettybird_bce_basic_vl_8b_q4_k_m.gguf
Prometech Computer Sciences CorpVerified signatured2a1ca9 -
Rename prettybird_bce_basic_vl_7b_q8_0.gguf to prettybird_bce_basic_vl_8b_q8_0.gguf
Prometech Computer Sciences CorpVerified signatureca6a227 -
Rename prettybird_bce_basic_vl_7b_fp16.gguf to prettybird_bce_basic_vl_8b_fp16.gguf
Prometech Computer Sciences CorpVerified signature966caec -
Rename qwen2.5-vl-q8_0.gguf to prettybird_bce_basic_vl_7b_q8_0.gguf
Prometech Computer Sciences CorpVerified signature6e461db -
Rename qwen2.5-vl-q4_k_m.gguf to prettybird_bce_basic_vl_7b_q4_k_m.gguf
Prometech Computer Sciences CorpVerified signature5a48684 -
Rename qwen2.5-vl-q2_k.gguf to prettybird_bce_basic_vl_7b_q2_k.gguf
Prometech Computer Sciences CorpVerified signaturef9cdb61 -
Rename qwen2.5-vl-fp16.gguf to prettybird_bce_basic_vl_7b_fp16.gguf
Prometech Computer Sciences CorpVerified signaturebff0541 -
Update Modelfile
Prometech Computer Sciences CorpVerified signature8776f34 -
Upload qwen2.5-vl-q8_0.gguf with huggingface_hub
Prometech Computer Sciences CorpVerified signaturefd76505 -
Upload qwen2.5-vl-q4_k_m.gguf with huggingface_hub
Prometech Computer Sciences CorpVerified signaturecec3fcf -
Upload qwen2.5-vl-q2_k.gguf with huggingface_hub
Prometech Computer Sciences CorpVerified signature628f0b9 -
Upload qwen2.5-vl-fp16.gguf with huggingface_hub
Prometech Computer Sciences CorpVerified signature14fb454 -
Upload Modelfile with huggingface_hub
Prometech Computer Sciences CorpVerified signature621707c -
initial commit
Prometech Computer Sciences CorpVerified signature69eb5f0