| ---
|
| license: apache-2.0
|
| base_model: Qwen/Qwen2.5-0.5B-Instruct
|
| tags:
|
| - gguf
|
| - python
|
| - code-generation
|
| - qwen2.5
|
| ---
|
|
|
| # PyCoder
|
|
|
| PyCoder is a Qwen2.5-0.5B-Instruct fine-tune for Python code generation. This repository includes the merged model in Q8_0 GGUF format, an Ollama Modelfile, a small Ollama API client, and the source scripts used for training.
|
|
|
| ## Use with Ollama
|
|
|
| The quickest option is to install [Ollama](https://ollama.com) and run:
|
|
|
| ```powershell
|
| ollama run hf.co/Safeeq/pycoder-gguf:Q8_0
|
| ```
|
|
|
| To download the files and create a local Ollama model instead:
|
|
|
| ```powershell
|
| hf download Safeeq/pycoder-gguf --local-dir pycoder-gguf
|
| cd pycoder-gguf
|
| ollama create pycoder -f Modelfile
|
| ollama run pycoder
|
| ```
|
|
|
| The `hf` command is provided by `huggingface_hub` (`pip install huggingface_hub`). Alternatively, download `pycoder-q8_0.gguf` and `Modelfile` from the Files and versions tab, keep them in the same directory, and run the `ollama create` command there.
|
|
|
| ## Use the Python helper
|
|
|
| The included [run_pycoder.py](run_pycoder.py) sends a prompt to a local Ollama server. First create or run the `pycoder` model using the steps above, then run:
|
|
|
| ```powershell
|
| python run_pycoder.py "Write a function that reverses a string"
|
| ```
|
|
|
| The helper uses only the Python standard library. Ollama must be installed and running locally.
|
|
|
| ## Model behavior and limitations
|
|
|
| - Intended for generating Python code. For unrelated requests it is trained to return `# ERROR: Only Python code requests are supported.`
|
| - This behavior is learned, not a security boundary; prompts can still produce other content.
|
| - This is a small 0.5B-parameter model. Outputs can be incorrect, incomplete, or invalid Python, and no formal benchmark results are provided here.
|
| - Review and test all generated code. Do not run untrusted output directly; use an isolated environment when executing generated code.
|
|
|
| ## Training
|
|
|
| The model was fine-tuned from [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) with LoRA. `make_dataset.py` prepares examples based on `iamtarun/python_code_instructions_18k_alpaca` plus off-topic refusal examples. The training scripts and dependencies are included for reference; training requires a compatible environment and hardware. The generated `data.jsonl`, intermediate checkpoints, and merged full-precision model are not included.
|
|
|
| ## Files
|
|
|
| - `pycoder-q8_0.gguf`: quantized model weights.
|
| - `Modelfile`: Ollama configuration for the local GGUF.
|
| - `run_pycoder.py`: small client for the local Ollama API.
|
| - `common.py`, `make_dataset.py`, `train.py`, `merge.py`, `test_model.py`: training and testing source.
|
| - `requirements.txt`: dependencies for the training scripts and upload helper.
|
| - `LICENSE`: license terms.
|
|
|
| ## License
|
|
|
| The files in this repository are provided under the Apache License 2.0. The model is based on [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct); review the upstream model and dataset terms when redistributing or using their materials.
|
|
|
