Instructions to use PrpEndo/gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use PrpEndo/gguf with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="PrpEndo/gguf")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("PrpEndo/gguf", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use PrpEndo/gguf with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "PrpEndo/gguf" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PrpEndo/gguf", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/PrpEndo/gguf
- SGLang
How to use PrpEndo/gguf with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "PrpEndo/gguf" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PrpEndo/gguf", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "PrpEndo/gguf" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PrpEndo/gguf", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use PrpEndo/gguf with Docker Model Runner:
docker model run hf.co/PrpEndo/gguf
Commit History
-
Upload LTX-2.3 Sulphur - Cum Shot v3.safetensors
Verified signature39def20
-
Upload DasiwaWAN22I2V14BLightspeed_boundbiteHighV10.safetensors
Verified signaturef6e1f30
-
Upload LTX2.3_2d_NSFW_motion_enhancer.safetensors
Verified signature6ff82f0
-
Upload taeltx2_3.safetensors
Verified signature62e9ecd
-
Delete ltx2310eros_beta.safetensors
Verified signature10140ec
-
Delete Wan22_CumV2_High.safetensors
Verified signatureb797a46 -
Delete Wan22_CumV2_Low.safetensors
Verified signature083aa46 -
Delete apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors
Verified signature2b5c6f3 -
Delete cr3ampi3_animation_i2v_ltx2_v1.0.safetensors
Verified signatureaa4c1eb -
Delete blobcg.safetensors
Verified signatureb1e3e2e -
Delete gitattributes
Verified signaturef8d024b -
Delete last-000002.safetensors
Verified signature4cdad75 -
Delete mmaudio_large_44k_v2_fp16.safetensors
Verified signature710651e -
Delete mmaudio_synchformer_fp16.safetensors
Verified signature3aff388 -
Delete nsfwWanUMT5XXLGGUF_q5AndQ4KM.gguf
Verified signaturecd5b228 -
Upload ltx-2.3-22b-ic-lora-union-control-ref0.5.safetensors
Verified signature0b9c2c0 -
Upload 2 files
Verified signature2b930c8 -
Delete ltx219BAllYouNeedIs_ltx2SPATIALUPSCALER.safetensors
Verified signature3d0942b
-
Upload ltx-2.3-22b-distilled-lora-384-1.1.safetensors
Verified signature8d6c54d -
Upload gemma_3_12B_it_heretic_fp8_e4m3fn.safetensors
Verified signature642d192 -
Upload ltx2310eros_beta.safetensors
Verified signature11240b1
-
Upload ltx2310eros_beta.safetensors
Verified signature4c3f2da -
Delete ltx2310eros_beta.safetensors
Verified signature12a56ed
-
Upload 3 files
Verified signaturee72b804 -
Delete st0m4chBulg3_FUSED_HN.safetensors
Verified signature7473a40 -
Delete wan2.2anime to realv2 low.safetensors
Verified signatured27e4fd -
Delete wan2.2anime to realv2 high.safetensors
Verified signature36f976c -
Delete st0m4chBulg3_FUSED_LN.safetensors
Verified signaturee4ede1a -
Delete SmoothXXXAnimation_High.safetensors
Verified signature766bc40 -
Delete wan22EnhancedNSFWSVICamera_nolightningSVICfQ8H.gguf
Verified signature6139c87 -
Delete wan22EnhancedNSFWSVICamera_nolightningSVICfQ8L.gguf
Verified signature37e5e44 -
Delete 1515.fp16.safetensors
Verified signaturea2f14bb
-
Upload 3 files
Verified signature08977cb -
Delete 56Low noise-Cumshot Aesthetics.safetensors
Verified signature91c1119 -
Delete 23High noise-Cumshot Aesthetics.safetensors
Verified signature7c46589 -
Delete LTX-2 better NSFW motion g@n.safetensors
Verified signaturea0cc950 -
Delete DR34ML4Y_LTXXX_PREVIEW_RC1.safetensors
Verified signature59837fe -
Delete taeltx_2.safetensors
Verified signature82f4db5
-
Upload 2 files
Verified signature8fb5a47 -
Upload 2 files
Verified signaturefbff58e -
Delete DasiwaWAN22I2V14BSynthseduction_q8Low.gguf
Verified signature2b9c033 -
Delete DasiwaWAN22I2V14BSynthseduction_q8High.gguf
Verified signature02fa10d -
Upload LTX23_video_vae_bf16.safetensors
Verified signature613066b -
Upload LTX23_audio_vae_bf16.safetensors
Verified signature6311676
-
Upload 2 files
Verified signaturec5f8310
-
Upload 3 files
Verified signature2af83aa
-
Upload 2 files
Verified signaturef753b02 -
Upload ltx2310eros_beta.safetensors
Verified signaturea0be2c2
-
Upload gemma-3-12b-abliterated-text-encoder.safetensors
Verified signature4a28434
-
Upload 9 files
Verified signaturedd6a6de