Image-Text-to-Text
Transformers
Safetensors
English
Chinese
sensenova_loop
text-generation
nvfp4
modelopt
quantized
multimodal
looped-transformer
mhc
mtp
custom_code
conversational
8-bit precision
Instructions to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="gitcommit90/SenseNova-Loop-9B-Preview-NVFP4", trust_remote_code=True) messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("gitcommit90/SenseNova-Loop-9B-Preview-NVFP4", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/gitcommit90/SenseNova-Loop-9B-Preview-NVFP4
- SGLang
How to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with Docker Model Runner:
docker model run hf.co/gitcommit90/SenseNova-Loop-9B-Preview-NVFP4
NVFP4 (ModelOpt) quantization of sensenova/SenseNova-Loop-9B-Preview @27abea77 with BF16 MTP head
a57aa9f verified Download quantization/requirements-quant.lock from gitcommit90/SenseNova-Loop-9B-Preview-NVFP4: direct link, hf CLI and curl.
- Browser
- Download file 1.99 kB
-
https://huggingface.co/gitcommit90/SenseNova-Loop-9B-Preview-NVFP4/resolve/main/quantization/requirements-quant.lock
- Command line
-
hf download hf://gitcommit90/SenseNova-Loop-9B-Preview-NVFP4/quantization/requirements-quant.lock
-
curl -L -o requirements-quant.lock https://huggingface.co/gitcommit90/SenseNova-Loop-9B-Preview-NVFP4/resolve/main/quantization/requirements-quant.lock
1.99 kB
| accelerate==1.15.0 | |
| aiohappyeyeballs==2.7.1 | |
| aiohttp==3.14.5 | |
| aiosignal==1.4.0 | |
| annotated-doc==0.0.5 | |
| annotated-types==0.8.0 | |
| anyio==4.15.1 | |
| attrs==26.1.0 | |
| certifi==2026.10.23 | |
| charset-normalizer==3.5.2 | |
| click==8.5.0 | |
| cloudpickle==3.1.2 | |
| cuda-bindings==13.4.4 | |
| cuda-pathfinder==1.8.4 | |
| cuda-toolkit==13.0.2 | |
| datasets==5.1.0 | |
| deepspeed==0.19.9 | |
| defusedxml==0.7.1 | |
| diffusers==0.42.1 | |
| dill==0.4.1 | |
| einops==0.8.2 | |
| filelock==4.2.4 | |
| frozenlist==1.8.0 | |
| fsspec==2026.7.0 | |
| h11==0.16.0 | |
| hf-xet==1.8.0 | |
| hjson==3.1.0 | |
| httpcore==1.0.9 | |
| httpcore2==2.16.0 | |
| httpx==0.28.1 | |
| httpx2==2.16.0 | |
| huggingface-hub==2.4.0 | |
| idna==3.20 | |
| importlib-metadata==10.1.0 | |
| jinja2==3.1.6 | |
| joblib==1.6.0 | |
| markdown-it-py==4.2.0 | |
| markupsafe==3.0.3 | |
| mdurl==0.1.2 | |
| mpmath==1.3.0 | |
| msgpack==1.2.4 | |
| multidict==7.2.1 | |
| multiprocess==0.70.19 | |
| networkx==3.7 | |
| ninja==1.13.2 | |
| nltk==3.10.4 | |
| numpy==2.5.4 | |
| nvidia-cublas==13.1.0.3 | |
| nvidia-cuda-cccl==13.3.4.3.1 | |
| nvidia-cuda-cupti==13.0.85 | |
| nvidia-cuda-nvrtc==13.0.88 | |
| nvidia-cuda-runtime==13.0.96 | |
| nvidia-cudnn-cu13==9.19.0.56 | |
| nvidia-cufft==12.0.0.61 | |
| nvidia-cufile==1.15.1.6 | |
| nvidia-curand==10.4.0.35 | |
| nvidia-cusolver==12.0.4.66 | |
| nvidia-cusparse==12.6.3.3 | |
| nvidia-cusparselt-cu13==0.8.0 | |
| nvidia-ml-py==13.615.71 | |
| nvidia-modelopt==0.48.0rc1 | |
| nvidia-nccl-cu13==2.28.9 | |
| nvidia-nvjitlink==13.0.88 | |
| nvidia-nvshmem-cu13==3.4.5 | |
| nvidia-nvtx==13.0.85 | |
| omegaconf==2.4.0 | |
| packaging==26.3 | |
| pandas==3.1.0 | |
| peft==0.21.2 | |
| pillow==13.0.0 | |
| propcache==0.5.4 | |
| psutil==7.2.2 | |
| pulp==3.3.2 | |
| py-cpuinfo==9.0.0 | |
| pyarrow==26.0.0 | |
| pydantic==2.14.2 | |
| pydantic-core==2.50.2 | |
| pygments==2.21.0 | |
| python-dateutil==3.0.0 | |
| pyyaml==6.0.3 | |
| regex==2026.9.29 | |
| requests==2.34.2 | |
| rich==15.0.0 | |
| safetensors==0.8.0 | |
| scipy==1.18.1 | |
| sentencepiece==0.2.2 | |
| setuptools==81.0.0 | |
| shellingham==1.5.4 | |
| six==1.17.0 | |
| sympy==1.14.0 | |
| tiktoken==0.14.0 | |
| tokenizers==0.23.3 | |
| torch==2.11.0+cu130 | |
| torchvision==0.26.0+cu130 | |
| tqdm==4.70.1 | |
| transformers==5.18.0 | |
| triton==3.6.0 | |
| truststore==0.10.5 | |
| typer==0.27.3 | |
| typing-extensions==4.16.0 | |
| typing-inspection==0.4.4 | |
| tzdata==2026.6 | |
| urllib3==2.8.0 | |
| wonderwords==3.0.1 | |
| xxhash==4.0.2 | |
| yarl==1.25.1 | |
| zipp==4.1.2 | |