Instructions to use jialinyyzz/humanizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use jialinyyzz/humanizer with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="jialinyyzz/humanizer")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("jialinyyzz/humanizer")
model = AutoModelForMultimodalLM.from_pretrained("jialinyyzz/humanizer", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use jialinyyzz/humanizer with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf jialinyyzz/humanizer:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf jialinyyzz/humanizer:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf jialinyyzz/humanizer:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf jialinyyzz/humanizer:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf jialinyyzz/humanizer:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf jialinyyzz/humanizer:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf jialinyyzz/humanizer:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf jialinyyzz/humanizer:Q4_K_M

Use Docker

docker model run hf.co/jialinyyzz/humanizer:Q4_K_M

LM Studio
Jan

vLLM

How to use jialinyyzz/humanizer with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "jialinyyzz/humanizer"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jialinyyzz/humanizer",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/jialinyyzz/humanizer:Q4_K_M

SGLang

How to use jialinyyzz/humanizer with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "jialinyyzz/humanizer" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jialinyyzz/humanizer",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "jialinyyzz/humanizer" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "jialinyyzz/humanizer",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Ollama
How to use jialinyyzz/humanizer with Ollama:
```
ollama run hf.co/jialinyyzz/humanizer:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use jialinyyzz/humanizer with Docker Model Runner:
```
docker model run hf.co/jialinyyzz/humanizer:Q4_K_M
```

Lemonade

How to use jialinyyzz/humanizer with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull jialinyyzz/humanizer:Q4_K_M

Run and chat with the model

lemonade run user.humanizer-Q4_K_M

List all available models

lemonade list

Atomic Chat

Is is not what I expected

by ddonofrio - opened 3 days ago

Discussion

ddonofrio

3 days ago

•

edited about 10 hours ago

It did not matched my expectations.

jialinyyzz

Owner 3 days ago

Sorry :( just to be clear it's not a generic chat/instruct type model. It only does one thing - you take some ai-written draft, and paste it in to have it rewritten to look like a human wrote it. Preserving meaning, numbers, names etc. but with different words, style etc.

So don't ask questions or tell it to do anything. You paste the draft in as your message in its entirety (ggufs have a chat template so paste text in LM studio/ollama)

To get the idea of what it does most easily, try it in the space which is all set up - https://huggingface.co/spaces/jialinyyzz/humanizer

I didn't train it on AI detectors but as a second-check on rewrite quality, it's undetectable by any AI detector

I'd be glad to have a look if you can share what you tried (input/settings).

akiko19191

2 days ago

I do not understand what is this model good for. Honestly, it is a crap.

I am not related to humanizer in any way and just an avid user , but i truly think it takes a lot of effort to make a model selflessly for the open source community - and just straightway without understanding it and labeling it as crap hurts the spirit of open source.
I have seen this behaviour on a lot of community posts on huggingface these days and its ... sad.

jialinyyzz

Owner 1 day ago

Thank you so much, I appreciate it 🩷

yethdev

about 21 hours ago

Like akiko, I am also not related to jialinyyzz, but what this looks like to me is you just put the model into a regular chatbot interface, said "humanize this text" and expected it to work.

also, just a note for jialinyyzz, this project is pretty obviously vibe coded and the irony that the readme is ai generated according to gpt zero is pretty funny, but ddonofrio wasnt being fair here

jialinyyzz

Owner about 21 hours ago

Yes！The readme is purely generated by claude lol (even without humanizing)

ddonofrio changed discussion title from Pure crap to Is is not what I expected about 10 hours ago

yethdev

about 10 hours ago

im crine

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment