File size: 1,753 Bytes
5795485
 
 
 
c3879e0
5795485
 
337c784
5795485
 
337c784
 
 
 
 
5795485
337c784
 
5795485
a26d522
 
5795485
 
 
 
 
 
 
 
337c784
5795485
8f2def9
720ad65
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
---
license: mit
language: en
pipeline_tag: text-generation
base_model: unsloth/Qwen2.5-3B-Instruct
---


# Commgpt‑3B

**Commgpt‑3B** is a conversational language model fine-tuned from [unsloth/Qwen2.5-3B-Instruct](https://huggingface.co/unsloth/Qwen2.5-3B-Instruct), adapted specifically for **Advanced Communication Systems (EECE 442)** at the American University of Beirut.

The model was trained using a curriculum of domain-specific Q&A pairs and evaluated on a custom benchmark of 450 communication systems questions. It was originally deployed with a retrieval-augmented generation (RAG) pipeline and Gradio interface.

This repo contains **only the model weights** and a **detailed implementation report**.

📄 Full report and documentation:  
[https://github.com/DavidA00/Commgpt-final-year-project](https://github.com/DavidA00/Commgpt-final-year-project)

This work was part of a final year project conducted during Sept 2024 - May 2025. 

## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline

model = AutoModelForCausalLM.from_pretrained("dabboud/Commgpt-3B")
tokenizer = AutoTokenizer.from_pretrained("dabboud/Commgpt-3B")

generator = pipeline("text-generation", model=model, tokenizer=tokenizer)
output = generator("What is Nyquist rate?", max_new_tokens=100)
print(output[0]["generated_text"])
```
---
## Citation
```latex
@misc{CommGPT2025,
  title   = {CommGPT: A Domain-Tuned Qwen 2.5-3B Model for Advanced Communication Systems},
  author  = {Abboud, David and Eid, Alex and Menassa, Alexander and Abou Faycal, Ibrahim and Fahs, Jihad and Zaraket, Fadi and Chokr, Sally},
  note    = {Model and report available at \url{https://huggingface.co/dabboud/Commgpt-3B}},
  year    = {2025}
}
```