Text Generation
Transformers
Safetensors
English
phi3
text-generation-inference
code
agent
custom-tune
slerp-merge
ties-merge
reasoning
conversational
Instructions to use Jagneshdeveloper/Ekant-14b-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Jagneshdeveloper/Ekant-14b-small with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Jagneshdeveloper/Ekant-14b-small") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Jagneshdeveloper/Ekant-14b-small") model = AutoModelForCausalLM.from_pretrained("Jagneshdeveloper/Ekant-14b-small", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Jagneshdeveloper/Ekant-14b-small with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Jagneshdeveloper/Ekant-14b-small" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jagneshdeveloper/Ekant-14b-small", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Jagneshdeveloper/Ekant-14b-small
- SGLang
How to use Jagneshdeveloper/Ekant-14b-small with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Jagneshdeveloper/Ekant-14b-small" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jagneshdeveloper/Ekant-14b-small", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Jagneshdeveloper/Ekant-14b-small" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jagneshdeveloper/Ekant-14b-small", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Jagneshdeveloper/Ekant-14b-small with Docker Model Runner:
docker model run hf.co/Jagneshdeveloper/Ekant-14b-small
File size: 5,356 Bytes
c49da07 294e16f c49da07 c614cae c49da07 efbded6 c49da07 e73eb8e c49da07 efbded6 c49da07 c614cae c49da07 efbded6 c49da07 c614cae c49da07 c614cae c49da07 c614cae c49da07 efbded6 c49da07 c614cae | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 | ---
license: apache-2.0
tags:
- text-generation-inference
- transformers
- code
- agent
- text-generation
- custom-tune
- slerp-merge
- ties-merge
- reasoning
base_model:
- microsoft/phi-4
- microsoft/Phi-4-reasoning-plus
language:
- en
pipeline_tag: text-generation
---
<div align="center">
# ๐ฎ๐ณ Ekant-14B-small (Agentic Reasoning Edition)
## ๐ **Made in India** ๐
<h3>๐ A High-Performance Specialist Model Fused with Deep Reasoning</h3>
<p align="center">
Developed by <b>Jagneshdeveloper</b>
</p>
---
`๐ License: Apache 2.0` | `โ๏ธ Parameters: 14 Billion` | `๐ป Focus: Elite Coding, Reasoning & Agents`
</div>
---
## ๐ Overview
**Ekant-14B-small** is an advanced 14-billion parameter large language model proudly developed by **Jagneshdeveloper**. While initially initialized via custom-trained adapter matrices, this final artifact is a **fully unquantized standalone model** in true `float16` precision.
Built on top of the powerful **microsoft/phi-4** architecture, this model has been custom-engineered and cross-compiled across multiple advanced mathematical optimization passes (including **SLERP** and **TIES** multi-model fusion protocols) to integrate elite agentic logic with deep, multi-step validation tracking.
---
## ๐ฌ Fusing & Pipeline Lifecycle
This model was compiled under a strict resource-constrained hardware architecture using custom disk-free sharded watchdog pipelines to guarantee full float precision mapping without accuracy loss:
1. **LoRA Fine-Tuning**: Initial specialized instruction sets were targeted and compiled into low-rank matrix sub-layers (`ekant-adapter`).
2. **Base Integration**: Unquantized adapter weights were chemically baked directly back into the core 29.3GB `microsoft/phi-4` tensor layers.
3. **Vanilla Alignment**: Merged via **SLERP** (Spherical Linear Interpolation) at a calibrated `0.6/0.4` ratio back with the foundational base model to act as a stabilizing anchor and counteract catastrophic forgetting.
4. **Deep Reasoning Injection**: Fused via **TIES** (Trimming, Electing, and Merging) to combine our custom capabilities directly with reinforcement-learned o3-style logic pathways.
---
## โก Key Capabilities
* **๐ง Deep Reasoning plus**: Features integrated reflection traces, error self-correction blocks, and highly granular problem-solving structures.
* **๐ป Coding Specialist**: Optimized to write, debug, analyze, and safely refactor high-complexity code structures across Python, JavaScript, C++, Rust, and Go.
* **๐ค Agentic Excellence**: High structural accuracy for tool-use, functional api execution loops, and generating strictly formatted outputs (like complex JSON or nested system commands).
---
## ๐ Model Summary
* **Model Name:** Ekant-14B-small (Agentic Ultimate Edition)
* **Developer:** Jagneshdeveloper
* **Base Architecture:** Built on top of Microsoft Phi-4 (Phi3 For Causal LM Core Class)
* **Parameters:** 14 Billion (14B)
* **License:** Apache 2.0 (Permissive Open-Source)
* **Primary Language:** English (en)
---
## ๐ป Quick Start
You can quickly load and deploy **Ekant-14B-small** using the Hugging Face `transformers` library:
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
# Real repository target path verified on your profile
model_name = "Jagneshdeveloper/ultimate-Ekant-14b"
# Load the optimized tokenizer and model
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
model_name,
device_map="auto",
torch_dtype=torch.float16,
trust_remote_code=True
)
# Test prompt for deep reasoning & agentic execution
prompt = "Write an optimized Python script to scrape website data dynamically, handle API authentication token refreshes, and format it into a structured JSON array."
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(
**inputs,
max_new_tokens=512,
temperature=0.5,
do_sample=True,
pad_token_id=tokenizer.eos_token_id
)
print(tokenizer.decode(outputs, skip_special_tokens=True))
```
---
## ๐ ๏ธ Intended Uses & Limitations
### Ideal Use Cases
* Building autonomous AI agents and automated API execution loops.
* Serving as a local or cloud-hosted programming and mathematical reasoning assistant.
* Handling multi-step logical text generation and complex data extraction tasks.
### Limitations
* Standard 14B computing constraints apply; heavy inference calls may require sharding or quantization depending on available VRAM allocations.
* Users should verify complex logic outputs before running generated scripts straight into a live production workspace.
---
## ๐ค Attribution & Support
Created with โค๏ธ by **Jagneshdeveloper** in India. This model is distributed under the open and permissive **Apache 2.0 License**, providing full freedom for commercial deployment, modifications, and distributed derivatives.
Special credit and attribution are extended to **Microsoft** for their foundational open-weights research contributions (`phi-4` and `Phi-4-reasoning-plus`), which served as the essential structural pillars and base anchors for this advanced mathematical crossover fusion project.
For feedback, feature requests, or collaborations, feel free to open a discussion in the community tab!
|