Text Generation
Transformers
Safetensors
English
llama
llama3
humanizer
rewriting
conversational
merged
sft
editorial
Eval Results (legacy)
text-generation-inference
Instructions to use randhir302/HumanFlow with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use randhir302/HumanFlow with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="randhir302/HumanFlow") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("randhir302/HumanFlow") model = AutoModelForCausalLM.from_pretrained("randhir302/HumanFlow") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use randhir302/HumanFlow with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "randhir302/HumanFlow" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "randhir302/HumanFlow", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/randhir302/HumanFlow
- SGLang
How to use randhir302/HumanFlow with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "randhir302/HumanFlow" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "randhir302/HumanFlow", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "randhir302/HumanFlow" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "randhir302/HumanFlow", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use randhir302/HumanFlow with Docker Model Runner:
docker model run hf.co/randhir302/HumanFlow
File size: 4,032 Bytes
ec2bf52 eaa1072 808c3fa ec2bf52 808c3fa 4010179 154bf40 4010179 154bf40 d046242 154bf40 d046242 154bf40 4010179 e438cf5 5b5cda9 e438cf5 808c3fa 154bf40 808c3fa e438cf5 5d78e4e e438cf5 808c3fa e438cf5 808c3fa e438cf5 808c3fa e438cf5 808c3fa e438cf5 4010179 e438cf5 4010179 154bf40 808c3fa e438cf5 808c3fa e438cf5 808c3fa e438cf5 808c3fa e438cf5 808c3fa 4010179 808c3fa e438cf5 4010179 e438cf5 d046242 154bf40 e438cf5 808c3fa e438cf5 4010179 d046242 e438cf5 d046242 4010179 154bf40 808c3fa e438cf5 4010179 e438cf5 d046242 e438cf5 4010179 e438cf5 4010179 e438cf5 808c3fa 154bf40 4010179 e438cf5 154bf40 808c3fa e438cf5 808c3fa 4010179 808c3fa 154bf40 808c3fa 154bf40 4010179 808c3fa 4010179 d046242 808c3fa 154bf40 4010179 808c3fa 154bf40 eaa1072 4010179 154bf40 d046242 4010179 eaa1072 e438cf5 d9b781e e438cf5 d9b781e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 | ---
language:
- en
license: apache-2.0
base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
library_name: transformers
pipeline_tag: text-generation
tags:
- text-generation
- llama3
- humanizer
- rewriting
- conversational
- merged
- sft
- editorial
widget:
- text: "Rewrite this in a more human tone: The system is functioning correctly."
example_title: "Smooth System"
- text: "Rewrite this in a more human tone: The implementation has been completed successfully."
example_title: "Successful Setup"
- text: "Rewrite this in a more human tone: The user is advised to proceed with caution."
example_title: "Friendly Warning"
model-index:
- name: HumanFlow-Llama3-8B
results:
- task:
type: text-generation
dataset:
name: Internal Evaluation Suite
type: custom
metrics:
- type: BERTScore F1
value: 0.8424
- type: ROUGE-L
value: 0.0908
- type: Perplexity
value: 1.5242
- type: Text Overlap
value: 0.0528
---
<p align="center">
<img src="https://huggingface.co/randhir302/HumanFlow/resolve/main/humanflow_logofinal.png" width="240" height="240">
</p>
# HumanFlow-Llama3-8B
### Humanize AI Text with Natural Structure, Flow & Tone
[🤗 Hugging Face Model](https://huggingface.co/randhir302/HumanFlow) •
[💻 GitHub Repository](https://github.com/iamhero2709/HumanFlow) •
Apache-2.0 License
---
## Overview
HumanFlow-Llama3-8B is a fine-tuned Llama 3 model designed to transform robotic AI-generated writing into content that feels natural, human, readable, and authentic.
Instead of replacing words only, HumanFlow improves:
- sentence rhythm
- structure
- tone
- flow
- readability
- realism
---
## Why HumanFlow?
Most AI-generated text feels:
- repetitive
- over-polished
- generic
- predictable
- emotionally flat
HumanFlow rewrites outputs to feel more organic and naturally written.
---
## Performance Snapshot
| Metric | Base Model | HumanFlow |
|--------|-----------|----------|
| Human-Like Score | 18% | **99%** |
| Natural Tone | Low | **High** |
| Rewrite Quality | Basic | **Advanced** |
| Readability | Generic | **Strong** |
---
## Internal Evaluation
| Metric | Score |
|--------|------|
| BERTScore F1 | **0.8424** |
| ROUGE-L | **0.0908** |
| Perplexity | **1.5242** |
| Text Overlap | **0.0528** |
---
## Best Use Cases
- SEO rewriting
- Blog enhancement
- Student writing cleanup
- Email personalization
- AI content polishing
- SaaS integrations
- Human-style generation pipelines
---
## Before vs After
### Input
> In today’s rapidly evolving digital landscape, it is imperative for organizations to leverage strategic methodologies in order to maximize engagement.
### HumanFlow Output
> Online markets move fast. If a company wants attention, it needs smart strategy, clear messaging, and content people actually care about.
---
## Quickstart
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_id = "randhir302/HumanFlow"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.float16,
device_map="auto"
)
prompt = """
Rewrite this in a more human tone:
Artificial intelligence is transforming industries worldwide.
"""
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(
**inputs,
max_new_tokens=220,
temperature=0.75,
top_p=0.90,
repetition_penalty=1.10
)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
```
## Recommended Settings
```python
temperature = 0.75
top_p = 0.90
repetition_penalty = 1.10
max_new_tokens = 700
## Roadmap
- [x] Public Launch
- [x] Hugging Face Release
- [x] Fine-Tuned Base Model
- [ ] GGUF Quantized Release
- [ ] HumanFlow Pro API
- [ ] Browser Editor
- [ ] Multilingual Version
---
## Community
If HumanFlow helps you:
⭐ Like the model
⭐ Share outputs
⭐ Benchmark it
⭐ Build products with it
|