Instructions to use Neura-Tech-AI/Nexa-AI-VL-4x4B-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Neura-Tech-AI/Nexa-AI-VL-4x4B-Base with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="Neura-Tech-AI/Nexa-AI-VL-4x4B-Base", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("Neura-Tech-AI/Nexa-AI-VL-4x4B-Base", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Neura-Tech-AI/Nexa-AI-VL-4x4B-Base with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Neura-Tech-AI/Nexa-AI-VL-4x4B-Base"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Neura-Tech-AI/Nexa-AI-VL-4x4B-Base",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/Neura-Tech-AI/Nexa-AI-VL-4x4B-Base

SGLang

How to use Neura-Tech-AI/Nexa-AI-VL-4x4B-Base with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Neura-Tech-AI/Nexa-AI-VL-4x4B-Base" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Neura-Tech-AI/Nexa-AI-VL-4x4B-Base",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Neura-Tech-AI/Nexa-AI-VL-4x4B-Base" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Neura-Tech-AI/Nexa-AI-VL-4x4B-Base",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use Neura-Tech-AI/Nexa-AI-VL-4x4B-Base with Docker Model Runner:
```
docker model run hf.co/Neura-Tech-AI/Nexa-AI-VL-4x4B-Base
```

Nexa-AI-VL-4x4B-Base / README.md

Neura-Tech-AI

Update README.md

7be6b86 verified 26 days ago

preview code

Raw

History Blame Contribute Delete

1.15 kB

metadata

license: apache-2.0
base_model:
  - Neura-Tech-AI/Nexa-AI-4x4B-Instruct
  - google/siglip2-so400m-patch16-naflex
new_version: Neura-Tech-AI/Nexa-AI-VL-4x4B-Base
pipeline_tag: image-text-to-text
library_name: transformers

⚠️ Experimental Release

This model is provided for research and experimental purposes only. It contains experimental modifications and may not function correctly in all environments, inference frameworks, or hardware configurations. Performance, stability, compatibility, and output quality are not guaranteed.

This is not a production-ready release. If the model does not work as expected, fails to load, produces incorrect results, or encounters compatibility issues, please consider these as expected risks of an experimental model.

Disclaimer: This model is released as is, without any warranty or guarantee of any kind. By using this model, you acknowledge that it is experimental and accept full responsibility for its use. The authors are not responsible for any issues, incompatibilities, data loss, or damages resulting from the use of this model.

Use this model at your own discretion and risk.