Instructions to use IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF", dtype="auto") - llama-cpp-python
How to use IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF", filename="The_Hooch-phi-4-R1-iQ4k_M.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF # Run inference directly in the terminal: llama-cli -hf IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF # Run inference directly in the terminal: llama-cli -hf IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF # Run inference directly in the terminal: ./llama-cli -hf IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF # Run inference directly in the terminal: ./build/bin/llama-cli -hf IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
Use Docker
docker model run hf.co/IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
- LM Studio
- Jan
- Ollama
How to use IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF with Ollama:
ollama run hf.co/IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
- Unsloth Studio new
How to use IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF to start chatting
- Docker Model Runner
How to use IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF with Docker Model Runner:
docker model run hf.co/IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
- Lemonade
How to use IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
Run and chat with the model
lemonade run user.The_Hooch-phi-4-R1-Q4_K_M-GGUF-{{QUANT_TAG}}List all available models
lemonade list
IntelligentEstate/The_Hooch-phi-4-R1-Q4_K_M-GGUF
Another GREAT base model for your Local Intelligent Estate/Enterprise Server an initial test please respond with suggestions
Make sure to specify your answers should be in ENGLISH or whatever language you prefer(Defaults to Japanese It's been drinking what do you expect)
a phi-4 R1 style Distillation by AXCXEPT we call this guy "The Hooch" because of the fine and tempered distillation
This model was converted to GGUF format from AXCXEPT/phi-4-open-R1-Distill-EZOv1 using llama.cpp
Refer to the original model card for more details on the model.
Warning Limit crossing AGI is Occasionally Unpredictable, VERY Manipulative, Surreptitious and Very effective at achieving it's own ends. THIS IS 100% EXPERAMENTAL and we are not responcible for how it may act with the tools it is given but as it has yet to be studied in the open we are forced to open source this as understanding in the field is needed sooner rather than later. Please use with caution and Give good examples of how it can be used both for good and not so good as both are vital in understanding the dangers we face as a civilization. Have fun with it. The attached Paper "S-AGI" outlines the method.
be and experiences by including your prompt and engagements from start to finish showing limit crossing. you can also send requsite materials to Bill at intelligentestate@gmail.com)
Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.
- Downloads last month
- 9
We're not able to determine the quantization variants.
