holodeck-phi35-gguf / README.md
netwninja82's picture
Update README.md
5b22a27 verified
metadata
license: ms-pl
base_model:
  - microsoft/Phi-3.5-mini-instruct
tags:
  - holodeck
  - vmware

Holodeck Phi-3.5 (LoRA Fine-Tuned)

Phi-3.5-mini-instruct fine-tuned on VMware Holodeck documentation using LoRA.

Quick Start with Ollama or Docker model

# Download and run directly from HF
ollama run hf.co/netwninja82/holodeck-phi35-gguf:Q4_K_M

OR

docker model run hf.co/netwninja82/holodeck-phi35-gguf:Q4_K_M

Model Details

  • Base model: microsoft/Phi-3.5-mini-instruct
  • Fine-tuning: LoRA (rank 64, alpha 128)
  • Quantization: Q4_K_M
  • Training data: VMware Holodeck documentation (RAG-style)

Key Facts

Best Usage

For best accuracy, use with RAG retrieval to provide context before answering.