Instructions to use nieila/frametheproblem32bfeedback with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use nieila/frametheproblem32bfeedback with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/home/appadmin/.cache/huggingface/hub/models--Qwen--Qwen3-32B/snapshots/9216db5781bf21249d130ec9da846c4624c16137") model = PeftModel.from_pretrained(base_model, "nieila/frametheproblem32bfeedback") - Transformers
How to use nieila/frametheproblem32bfeedback with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="nieila/frametheproblem32bfeedback") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("nieila/frametheproblem32bfeedback") model = AutoModelForCausalLM.from_pretrained("nieila/frametheproblem32bfeedback", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use nieila/frametheproblem32bfeedback with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "nieila/frametheproblem32bfeedback" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nieila/frametheproblem32bfeedback", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/nieila/frametheproblem32bfeedback
- SGLang
How to use nieila/frametheproblem32bfeedback with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "nieila/frametheproblem32bfeedback" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nieila/frametheproblem32bfeedback", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "nieila/frametheproblem32bfeedback" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nieila/frametheproblem32bfeedback", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use nieila/frametheproblem32bfeedback with Docker Model Runner:
docker model run hf.co/nieila/frametheproblem32bfeedback
Download base_model_fingerprint.json from nieila/frametheproblem32bfeedback: direct link, hf CLI and curl.
- Browser
- Download file 2.44 kB
-
https://huggingface.co/nieila/frametheproblem32bfeedback/resolve/main/base_model_fingerprint.json
- Command line
-
hf download hf://nieila/frametheproblem32bfeedback/base_model_fingerprint.json
-
curl -L -o base_model_fingerprint.json https://huggingface.co/nieila/frametheproblem32bfeedback/resolve/main/base_model_fingerprint.json
2.44 kB
| { | |
| "config.json": "97e295b63283935788fac5e4f8860862a56d4089538cafc93f0431f2ebe483bb", | |
| "generation_config.json": "2325da0f15bb848e018c5ae071b7943332e9f871d6b60e2ed22ca97d4cb993d2", | |
| "merges.txt": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5", | |
| "model.safetensors.index.json": "bed42c6c55274bc08a1f616bceb3bcb84b3f02cb6584c573bd18c6519291ecd0", | |
| "tokenizer.json": "aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4", | |
| "tokenizer_config.json": "d5d09f07b48c3086c508b30d1c9114bd1189145b74e982a265350c923acd8101", | |
| "vocab.json": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910", | |
| "model-00001-of-00017.safetensors": "52562b2ff97b61764260273e71bf5b4cf8a66f569399398f26dec0300fcf1316", | |
| "model-00002-of-00017.safetensors": "e26764b2c6878e3fb7198895fa833ec62838d84a19665e6abfbae43c6daf02b3", | |
| "model-00003-of-00017.safetensors": "6c5ba7bed9c52bc121e75cbe8a7be46936d0006cc80f42a6d5886ed40b4c2a62", | |
| "model-00004-of-00017.safetensors": "f736f6ac4d8c30866107fb1185a05b3c3cfce9717720082f466fa44e691bcec8", | |
| "model-00005-of-00017.safetensors": "a52ed375c083209c54d42ac510afeb1fbb5af4f193be2dc7d103f665a0f212d3", | |
| "model-00006-of-00017.safetensors": "37fae28990b0e4a70228549d040c0393e87bee3820d59e58e47844974d8dff5b", | |
| "model-00007-of-00017.safetensors": "37776006aeaba29eca8bc73b2b963fe3477e1c2e3f6a27cb9527be75b905e1bf", | |
| "model-00008-of-00017.safetensors": "73e74e9129674fe330948005075d70ab4fa0b92b68fb220c5a693f9cea553730", | |
| "model-00009-of-00017.safetensors": "a044b3602a01bd8ea62ff51badf9cc038ab1d73d97399480e6a55b4c86fa7fa6", | |
| "model-00010-of-00017.safetensors": "9966612ba7ecfc2cd2e592fb95224b86d743271ff88e172cc272a4b26382aa75", | |
| "model-00011-of-00017.safetensors": "e2a058a0ac7d4b992b731c29221ecfb4b76b8a48d9004d0e8a62ba44f699845c", | |
| "model-00012-of-00017.safetensors": "58a1aa89093fea07325f787072a468e3482a470ff4b7fe5ead5f749683907c40", | |
| "model-00013-of-00017.safetensors": "35f3381bab31a23370c37d922290aeecdf603418336058fb86fe42d8f51ac40c", | |
| "model-00014-of-00017.safetensors": "8713b062ddc178acf5917610b7f4b64eede833b2ea4aa37bd562dcf2f3a3339d", | |
| "model-00015-of-00017.safetensors": "bec439d23931821a236d8f62fa79deecf5551bd25602278aa2ae0ce432b378cf", | |
| "model-00016-of-00017.safetensors": "e569139fadd61fe7c8f9eb1c976d9a627cae48c57ddf228cfbd0593c59c64ff7", | |
| "model-00017-of-00017.safetensors": "1f47c318fcd7797c0f85b4233cb754438b10e795b8bc874889090c416a94bd38" | |
| } | |