File size: 7,536 Bytes
22d89ed
 
 
82171eb
 
 
 
 
 
aacaf89
 
f2c48f5
de9bd42
82171eb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d29cc1a
82171eb
 
 
 
 
aacaf89
 
82171eb
f2c48f5
82171eb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d29cc1a
82171eb
 
 
d29cc1a
82171eb
 
 
 
 
 
 
 
 
 
 
 
27fdbd3
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
---
license: gpl
---
# CMuSeNet

> Complex-Valued Multi-Signal Segmentation Network for Cognitive Radio Systems.

---

[![IEEE Xplore](https://img.shields.io/badge/IEEE-Xplore-blue)](https://github.com/UNL-CPN-Lab/CMuSeNet)
[![Github](https://img.shields.io/badge/Github-CMuSeNet-purple)](https://github.com/UNL-CPN-Lab/CMuSeNet)
[![arXiv](https://img.shields.io/badge/arXiv-CMuSeNet-red)](https://doi.org/10.48550/arXiv.2506.11048)
[![IEEE Dataport](https://img.shields.io/badge/IEEE-Dataport-blue)](https://ieee-dataport.org/documents/cv-musenet-complex-valued-multi-signal-segmentation-dataset-0)
[![License](https://img.shields.io/badge/License-GPL%20Family-green)]()

---

## Overview

**CMuSeNet** is a Complex-Valued Neural Network (CVNN)-based residual architecture designed for wideband spectrum segmentation in challenging low-SNR environments.  
It leverages complex signal properties (phase, amplitude) inherently using complex-valued convolutions and introduces:

- **Complex-Valued Fourier Spectrum Focal Loss (CFL)** for robust low-SNR training
- **Complex Plane Intersection-over-Union (CIoU)** for accurate segmentation evaluation
- **Residual CVNN architecture** for enhanced feature extraction

<img src="assets/overview.png" alt="CMuSeNet Overview" width="400"/>

**Key highlights:**
- Up to **9.2%** improvement in segmentation accuracy over RVNNs
- **99.4%** Average Accuracy over SNR of [-20, 10] dB with synthetic dataset and **98.98** Average Accuracy over SNR of [-10, 10] dB with Indoor OTA dataset
- **33.1%** reduction in total training time compared to RVNN models
- Achieves equivalent RVNN accuracy within **2 epochs** vs **27 epochs**
- Evaluated on Synthetic, Indoor Over-The-Air (OTA), and Real-World Broadband Irregularly-sampled Geographical Radio Environment Dataset (BIG-RED).
- Dataset publicly available on IEEE DataPort

## CMuSeNet Architecture

CMuSeNet employs a residual Complex-Valued Neural Network (CVNN) architecture based on complex convolutions, batch normalization, and CReLU activation.  
FFT preprocessing preserves signal phase and amplitude in the frequency domain before feeding into the network.

<img src="assets/architecture_training.png" alt="CMuSeNet Architecture" width="400"/>

---

## Complex Fourier Spectrum Focal Loss (CFL)

CMuSeNet introduces a novel **Complex-Valued Fourier Spectrum Focal Loss (CFL)** to improve training for multi-signal segmentation under low-SNR conditions.

- Instead of reducing FFT outputs to real-valued magnitudes, CFL retains real and imaginary components separately.
- Applies a focal loss formulation on the **real** and **imaginary** parts of the Fourier spectrum.
- Focuses learning on **hard-to-detect weak signals** by dynamically adjusting the loss contribution.
- Allows the network to preserve **phase** and **amplitude** information crucial for accurate segmentation.

CFL enhances model robustness and convergence speed, achieving faster training and better low-SNR performance compared to real-valued losses.

<img src="assets/ComplexFL.png" alt="Complex Fourier Spectrum Focal Loss Concept" width="400"/>

---


## Complex Plane Intersection over Union (CIoU) Concept

Unlike traditional segmentation that treats outputs as magnitude-only, CMuSeNet evaluates predictions over the complex-valued Fourier spectrum using a novel CIoU metric.  
This treats real and imaginary axes jointly, improving boundary detection for signals in low-SNR environments.

<img src="assets/ComplexIoU.png" alt="Complex IoU Concept" width="400"/>


Detailed technical description available in:

> **Reference:**  
> Sangwon Shin, Mehmet C. Vuran, “I Can’t Believe It’s Not Real: CV-MuSeNet: Complex-Valued Multi-Signal Segmentation”, in *Proc. IEEE Dynamic Spectrum Access Networks (DySPAN'25)*, IEEE, May 2025.

---

## Model and Dataset Links

- [GitHub](https://github.com/UNL-CPN-Lab/CMuSeNet)
- [IEEE Dataport Dataset](https://ieee-dataport.org/documents/cv-musenet-complex-valued-multi-signal-segmentation-dataset-0)
- IEEE Xplore Publication: *(Link will be updated once available)*
- [arXiv](https://doi.org/10.48550/arXiv.2506.11048)
---

## Requirements

- CUDA-capable NVIDIA GPU (e.g., Tesla V100)
- Intel CPU with i7 or higher
- Python 3.8
- Jupyter Notebook
- Anaconda (preferred) or pip

## Evaluation setup

- Intel Xeon Silver 4110 CPU
- NVIDIA Tesla V100 - 16GB VRAM
- 187 GB RAM

---

## Installation

### Anaconda (Recommended)

```bash
conda create -n cmusenet python=3.8
conda activate cmusenet

conda install tqdm
conda install pytorch torchvision torchaudio pytorch-cuda=12.4 -c pytorch -c nvidia
conda install -c conda-forge tensorflow
conda install scikit-learn
conda install numpy scipy matplotlib -y
conda install git
pip install git+https://github.com/wavefrontshaping/complexPyTorch.git
conda install -c anaconda ipykernel
```

### Pure pip (Alternative)

```bash
python -m venv cmusenet-env
source cmusenet-env/bin/activate  # (Linux/Mac) or .\cmusenet-env\Scripts\activate (Windows)

pip install tqdm
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124
pip install tensorflow
pip install scikit-learn
pip install numpy scipy matplotlib
pip install gitpython
pip install git+https://github.com/wavefrontshaping/complexPyTorch.git
pip install ipykernel
```

---

## Quick Start

### Clone the Repository

```bash
git clone https://github.com/your_username/CMuSeNet.git
cd CMuSeNet
```

> Replace `your_username` with your GitHub ID if publishing!

### Launch Jupyter Notebook

```bash
jupyter notebook
```

Open and run:

- `Seek_VGG_ResNet_CVNN_RawComplexValue`
- `Seek_ResNet_CVNN_OTA`
- `BIGRED_Seek_ResNet_CVNN`

**Note:**  
Ensure datasets are downloaded and change the dataset direction in the code.

---

## Training and Evaluation

Each notebook contains detailed blocks for:

- Loading synthetic, Indoor-OTA, or Broadband Irregularly-sampled Geographical Radio Environment Dataset BIG-RED data
- Model initialization
- Training with complex-valued loss
- Validation metrics tracking (CIoU, CFL)

Hyperparameters tuned for low-SNR robustness:
- Batch size = 64
- Early stopping patience = 3
- CFL loss parameters γ = 1, α = 3

Transfer learning supported from Synthetic → OTA → BIG-RED datasets.

---

## Additional Citations

This project also uses [complexPyTorch](https://github.com/wavefrontshaping/complexPyTorch):

```bibtex
@misc{meunier2023complexpytorch,
  title={complexPyTorch},
  author={S\u00e9bastien Meunier},
  year={2023},
  publisher={GitHub},
  howpublished={\url{https://github.com/wavefrontshaping/complexPyTorch}}
}


## License

This project is licensed under the **GPL family** (General Public License) terms.  
Details will be updated following IEEE publication.

---

## Citation

If you use this code, dataset, or model, please cite:

```bibtex
@inproceedings{shin2025cmusenet,
  title={I Can't Believe It's Not Real: {CV-MuSeNet}: Complex-Valued Multi-Signal Segmentation},
  author={Sangwon Shin and Mehmet C. Vuran},
  booktitle={IEEE Dynamic Spectrum Access Networks (DySPAN)},
  year={2025},
  organization={IEEE}
}
```

## Acknowledgement
Office of Naval Research, NSWC Crane N00174-23-1-0007

This work relates to Department of Navy award N00174-23-1-0007 issued by the Office of Naval Research, NSWC Crane. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the Office of Naval Research.


---
license: gpl-3.0
---