How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Subject-Emu-5259/NeuralAI"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Subject-Emu-5259/NeuralAI",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Use Docker
docker model run hf.co/Subject-Emu-5259/NeuralAI
Quick Links

Configuration Parsing Warning:In adapter_config.json: "peft.base_model_name_or_path" must be a string

NeuralAI β€” D17 DPO LoRA Adapter (v17)

NeuralAI is a DPO-aligned generative AI engine by De'Andrew Preston Harris. This repository publishes the D17 DPO LoRA adapter (v17), a continuation of the v16 adapter, trained on top of HuggingFaceTB/SmolLM2-360M-Instruct.

Training (D17 / v17 β€” 2026-07-20)

  • Base model: HuggingFaceTB/SmolLM2-360M-Instruct (360M)
  • Method: DPO (TRL), LoRA r=32 / alpha=64, dropout 0.05
  • Seed adapter: v16 (checkpoints/v2_model)
  • Dataset: 679 preference pairs (data/train_dpo_v16_combined.jsonl)
  • Epochs: 3 β€” Steps: 129 β€” Duration: ~31 min (Colab GPU)
  • Final train loss: ~0.39 (0.692 β†’ 0.396)
  • Reward accuracy: 0.975 (chosen preferred over rejected)
  • Reward margin: ~0.9 (stable, no collapse)
  • Entropy: ~2.15–2.33 (stable)

D17 is a DPO continuation of v16 β€” an alignment refinement, not new knowledge injection. Across the 679-pair distribution it sharpened preferences toward correct code, safe refusals, identity-accurate responses, sound math/reasoning, clean code style, concise answers, and proper tool usage, while down-ranking rejected patterns. Chosen-response rewards rose (0.54 β†’ 0.69) and rejected rewards fell (βˆ’0.19 β†’ βˆ’0.26) with a healthy ~0.9 margin and stable entropy β€” textbook successful DPO with no sign of reward hacking or mode collapse. No held-out eval set was configured, so generalization is inferred from training reward signals only.

Usage (PEFT)

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained("HuggingFaceTB/SmolLM2-360M-Instruct")
model = PeftModel.from_pretrained(base, "Subject-Emu-5259/NeuralAI")
tokenizer = AutoTokenizer.from_pretrained("Subject-Emu-5259/NeuralAI")

Links

Downloads last month
1,026
Safetensors
Model size
0.4B params
Tensor type
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Subject-Emu-5259/NeuralAI

Adapter
(38)
this model
Adapters
1 model