Text Generation
Transformers
Safetensors
PEFT
English
qwen2
code-review
security-analysis
static-analysis
python
code-quality
qlora
fine-tuned
sql-injection
vulnerability-detection
python-security
code-optimization
conversational
text-generation-inference
Instructions to use alenphilip/Code_Review_Assistant_Model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use alenphilip/Code_Review_Assistant_Model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="alenphilip/Code_Review_Assistant_Model") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("alenphilip/Code_Review_Assistant_Model") model = AutoModelForCausalLM.from_pretrained("alenphilip/Code_Review_Assistant_Model") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - PEFT
How to use alenphilip/Code_Review_Assistant_Model with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use alenphilip/Code_Review_Assistant_Model with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "alenphilip/Code_Review_Assistant_Model" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "alenphilip/Code_Review_Assistant_Model", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/alenphilip/Code_Review_Assistant_Model
- SGLang
How to use alenphilip/Code_Review_Assistant_Model with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "alenphilip/Code_Review_Assistant_Model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "alenphilip/Code_Review_Assistant_Model", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "alenphilip/Code_Review_Assistant_Model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "alenphilip/Code_Review_Assistant_Model", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use alenphilip/Code_Review_Assistant_Model with Docker Model Runner:
docker model run hf.co/alenphilip/Code_Review_Assistant_Model
Update README.md
Browse files
README.md
CHANGED
|
@@ -185,8 +185,9 @@ The model was trained on a comprehensive dataset of Python code review examples
|
|
| 185 |
- Error Handling and Logging
|
| 186 |
|
| 187 |
## Training Procedure
|
|
|
|
| 188 |
### Training Hyperparameters
|
| 189 |
-
- Training regime: bf16 mixed precision with QLoRA
|
| 190 |
- Base Model: Qwen2.5-7B-Instruct
|
| 191 |
- LoRA Rank: 32
|
| 192 |
- LoRA Alpha: 64
|
|
@@ -209,9 +210,9 @@ Testing Data
|
|
| 209 |
Evaluation performed on held-out Python code examples from the same dataset distribution.
|
| 210 |
|
| 211 |
### Metrics
|
| 212 |
-
ROUGE-L: 0.754
|
| 213 |
-
BLEU: 61.99
|
| 214 |
-
Validation Loss: 0.595
|
| 215 |
|
| 216 |
## Results
|
| 217 |
The model achieved strong performance on code review tasks, particularly excelling at:
|
|
@@ -253,12 +254,12 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
|
|
| 253 |
publisher = {Hugging Face}
|
| 254 |
}
|
| 255 |
## Model Card Authors
|
| 256 |
-
|
| 257 |
|
| 258 |
## Model Card Contact
|
| 259 |
-
Hugging Face: alenphilip
|
| 260 |
LinkedIn: [alenphilipgeorge](linkedin.com/in/alen-philip-george-130226254)
|
| 261 |
-
Email: alenphilipgeorge@gmail.com
|
| 262 |
|
| 263 |
|
| 264 |
For questions about this model, please use the Hugging Face model repository discussions or contact via the above channels.
|
|
|
|
| 185 |
- Error Handling and Logging
|
| 186 |
|
| 187 |
## Training Procedure
|
| 188 |
+
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/alenphilip2071-google/huggingface/runs/d27nrifd)
|
| 189 |
### Training Hyperparameters
|
| 190 |
+
- Training regime: bf16 mixed precision with SFT & QLoRA
|
| 191 |
- Base Model: Qwen2.5-7B-Instruct
|
| 192 |
- LoRA Rank: 32
|
| 193 |
- LoRA Alpha: 64
|
|
|
|
| 210 |
Evaluation performed on held-out Python code examples from the same dataset distribution.
|
| 211 |
|
| 212 |
### Metrics
|
| 213 |
+
ROUGE-L: 0.754
|
| 214 |
+
BLEU: 61.99
|
| 215 |
+
Validation Loss: 0.595
|
| 216 |
|
| 217 |
## Results
|
| 218 |
The model achieved strong performance on code review tasks, particularly excelling at:
|
|
|
|
| 254 |
publisher = {Hugging Face}
|
| 255 |
}
|
| 256 |
## Model Card Authors
|
| 257 |
+
Alen Philip George
|
| 258 |
|
| 259 |
## Model Card Contact
|
| 260 |
+
Hugging Face: [alenphilip](https://huggingface.co/alenphilip)
|
| 261 |
LinkedIn: [alenphilipgeorge](linkedin.com/in/alen-philip-george-130226254)
|
| 262 |
+
Email: [alenphilipgeorge@gmail.com](mailto:alenphilipgeorge@gmail.com)
|
| 263 |
|
| 264 |
|
| 265 |
For questions about this model, please use the Hugging Face model repository discussions or contact via the above channels.
|