Instructions to use Neel003/IRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Neel003/IRA with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Neel003/IRA") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Neel003/IRA") model = AutoModelForCausalLM.from_pretrained("Neel003/IRA") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Neel003/IRA with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Neel003/IRA" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Neel003/IRA", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Neel003/IRA
- SGLang
How to use Neel003/IRA with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Neel003/IRA" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Neel003/IRA", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Neel003/IRA" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Neel003/IRA", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Neel003/IRA with Docker Model Runner:
docker model run hf.co/Neel003/IRA
Create README.md
Browse filesTo fill the **Description** section of your **IRA** model card effectively, you should focus on its identity as a custom, high-performance architecture.
Copy and paste the following into the description area of your `README.md` to complete your model's profile:
---
## Model Description
**IRA (Integrated Reasoning Architecture)** is a proprietary, custom fine-tuned model developed by **Neel003**. It represents a specialized leap in **Mixture-of-Experts (MoE)** technology, engineered specifically for high-precision reasoning and advanced cognitive tasks.
Unlike standard base models, **IRA** has undergone an extensive fine-tuning process to optimize its internal weights for **complex problem solving**, **nuanced text synthesis**, and **advanced logic**.
### Key Technical Attributes
* **Developer:** Neel003
* **Model Name:** IRA (Integrated Reasoning Architecture)
* **Total Parameters:** 47B
* **Architecture Type:** Mixture-of-Experts (MoE)
* **Storage Format:** High-fidelity Safetensors, sharded into 19 parts for stable loading
### Intended Use
IRA is designed for professional-grade reasoning tasks where standard models struggle with logical depth or consistency. It is best utilized in environments requiring:
* Deep analytical reasoning
* Complex multi-step logic
* High-accuracy information synthesis
### Ownership and Terms
Copyright © 2026 Neel003. All rights reserved. These are **proprietary weights**. Unauthorized redistribution, duplication, or use of the IRA architecture without explicit permission from the developer is strictly prohibited.
---
**Would you like me to help you create a "Getting Started" or "Installation" section to add right below this description?**