waterfall109 commited on
Commit
306e0b8
·
1 Parent(s): 09924e9

Add Detailed data description

Browse files
Files changed (1) hide show
  1. DATA_DESCRIPTION.md +216 -0
DATA_DESCRIPTION.md ADDED
@@ -0,0 +1,216 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # FRTSearch Data Description
2
+
3
+ This document describes all model weights and test data files included in this repository.
4
+
5
+ ---
6
+
7
+ ## Model Weights
8
+
9
+ ### `models/hrnet_epoch_36.pth`
10
+ - **Size**: 381.75 MB
11
+ - **Architecture**: HRNet (High-Resolution Network)
12
+ - **Training Epoch**: 36
13
+ - **Purpose**: FRB detection and classification model trained on diverse FRB datasets
14
+ - **Input Dimensions**: 256 (freq) × 8192 (time)
15
+ - **Description**: This model has been trained on a wide range of observation parameters, enabling FRTSearch to handle both drift scan short-term observations and tracking long-term observation data processing.
16
+
17
+ ---
18
+
19
+ ## Test Data Files
20
+
21
+ ### FITS Format (FAST Telescope)
22
+
23
+ PSRFITS format files from the Five-hundred-meter Aperture Spherical radio Telescope (FAST).
24
+
25
+ #### 1. `test_sample/FRB20121102_0038.fits`
26
+ - **Size**: 243.77 MB
27
+ - **Telescope**: FAST
28
+ - **Source**: FRB 20121102 (repeating FRB)
29
+ - **Reference**: [Guo et al. (2025)](https://doi.org/10.3847/1538-4365/adf42d)
30
+ - **Sampling Time**: 98.304 μs
31
+ - **Frequency Range**: 1000-1500 MHz
32
+ - **Channels**: 4096
33
+ - **DM**: 565.0 pc cm⁻³
34
+ - **ToA**: 2.39 s
35
+ - **Bits**: 8-bit
36
+ - **Description**: High time-resolution observation of the famous repeating FRB 20121102
37
+
38
+ #### 2. `test_sample/FRB20180301_0004.fits`
39
+ - **Size**: 487.52 MB
40
+ - **Telescope**: FAST
41
+ - **Source**: FRB 20180301
42
+ - **Reference**: [Guo et al. (2025)](https://doi.org/10.3847/1538-4365/adf42d)
43
+ - **Sampling Time**: 49.152 μs
44
+ - **Frequency Range**: 1000-1500 MHz
45
+ - **Channels**: 4096
46
+ - **DM**: 420.0 pc cm⁻³
47
+ - **ToA**: 2.83 s
48
+ - **Bits**: 8-bit
49
+ - **Description**: Ultra-high time-resolution FAST observation demonstrating FRTSearch's capability with fine temporal sampling
50
+
51
+ #### 3. `test_sample/FRB20201124_0016.fits`
52
+ - **Size**: 487.52 MB
53
+ - **Telescope**: FAST
54
+ - **Source**: FRB 20201124 (repeating FRB)
55
+ - **Reference**: [Guo et al. (2025)](https://doi.org/10.3847/1538-4365/adf42d)
56
+ - **Sampling Time**: 49.152 μs
57
+ - **Frequency Range**: 1000-1500 MHz
58
+ - **Channels**: 4096
59
+ - **DM**: 525.0 pc cm⁻³
60
+ - **ToA**: 2.44 s
61
+ - **Bits**: 8-bit
62
+ - **Description**: Another repeating FRB with ultra-high time-resolution, ideal for testing detection algorithms
63
+
64
+ ---
65
+
66
+ ### Filterbank Format (.fil)
67
+
68
+ Standard filterbank format files from Parkes and SKA telescopes.
69
+
70
+ #### 4. `test_sample/FRB110220_Parkes_190_240.fil`
71
+ - **Size**: 190.74 MB
72
+ - **Telescope**: Parkes
73
+ - **Source**: FRB 110220
74
+ - **Reference**: [Keane et al. (2015)](https://doi.org/10.1093/mnras/stu2650)
75
+ - **Sampling Time**: 122.88 μs
76
+ - **Frequency Range**: 190-240 MHz
77
+ - **Channels**: 512
78
+ - **DM**: 944.0 pc cm⁻³
79
+ - **ToA**: 7.93 s
80
+ - **Bits**: 2-bit
81
+ - **Description**: Low-frequency observation from Parkes telescope, demonstrating FRTSearch's adaptability to different frequency ranges and bit depths
82
+
83
+ #### 5. `test_sample/FRB20180119_SKA_1660_1710.fil`
84
+ - **Size**: 12.65 MB
85
+ - **Telescope**: SKA (Australian Square Kilometre Array Pathfinder)
86
+ - **Source**: FRB 20180119
87
+ - **Reference**: [Shannon et al. (2018)](https://doi.org/10.1038/s41586-018-0588-y)
88
+ - **Sampling Time**: 1265.625 μs
89
+ - **Frequency Range**: 1660-1710 MHz
90
+ - **Channels**: 336
91
+ - **DM**: 400.0 pc cm⁻³
92
+ - **ToA**: 0.07 s
93
+ - **Bits**: 1-bit
94
+ - **Description**: SKA pathfinder observation with 1-bit quantization, testing FRTSearch on low-bitrate data
95
+
96
+ #### 6. `test_sample/FRB20180212_SKA_1820_1870.fil`
97
+ - **Size**: 12.65 MB
98
+ - **Telescope**: SKA
99
+ - **Source**: FRB 20180212
100
+ - **Reference**: [Shannon et al. (2018)](https://doi.org/10.1038/s41586-018-0588-y)
101
+ - **Sampling Time**: 1265.625 μs
102
+ - **Frequency Range**: 1820-1870 MHz
103
+ - **Channels**: 336
104
+ - **DM**: 167.7 pc cm⁻³
105
+ - **ToA**: 0.07 s
106
+ - **Bits**: 1-bit
107
+ - **Description**: Another SKA observation demonstrating consistency across different frequency sub-bands
108
+
109
+ #### 7. `test_sample/FRB20220610A_SKA_1260_1303.fil`
110
+ - **Size**: 47.35 MB
111
+ - **Telescope**: SKA
112
+ - **Source**: FRB 20220610A (host galaxy localized)
113
+ - **Reference**: [Ryder et al. (2022)](https://doi.org/10.1126/science.adf2678)
114
+ - **Sampling Time**: 1265.625 μs
115
+ - **Frequency Range**: 1260-1303 MHz
116
+ - **Channels**: 336
117
+ - **DM**: 1457.6 pc cm⁻³
118
+ - **ToA**: 0.39 s
119
+ - **Bits**: 1-bit
120
+ - **Description**: Observation of FRB 20220610A with precisely localized host galaxy, featuring high DM value
121
+
122
+ ---
123
+
124
+ ## Summary Statistics
125
+
126
+ | **Category** | **Count** | **Total Size** | **Telescopes** | **Bit Depths** |
127
+ |--------------|-----------|----------------|----------------|----------------|
128
+ | Model Weights | 1 | 381.75 MB | N/A | N/A |
129
+ | FITS Files | 3 | 1.22 GB | FAST | 8-bit |
130
+ | Filterbank Files | 4 | 263.39 MB | Parkes, SKA | 1-bit, 2-bit |
131
+ | **Total Data** | **7** | **~1.86 GB** | **3 telescopes** | **1, 2, 8-bit** |
132
+
133
+ ---
134
+
135
+ ## Telescope Coverage
136
+
137
+ ### FAST (Five-hundred-meter Aperture Spherical radio Telescope)
138
+ - Location: Guizhou, China
139
+ - Frequency Range: 1000-1500 MHz
140
+ - Time Resolution: 49.152 - 98.304 μs
141
+ - Channels: 4096
142
+ - Bit Depth: 8-bit
143
+
144
+ ### Parkes
145
+ - Location: New South Wales, Australia
146
+ - Frequency Range: 190-240 MHz
147
+ - Time Resolution: 122.88 μs
148
+ - Channels: 512
149
+ - Bit Depth: 2-bit
150
+
151
+ ### SKA (Square Kilometre Array Pathfinder / ASKAP)
152
+ - Location: Western Australia
153
+ - Frequency Range: 1260-1870 MHz
154
+ - Time Resolution: 1265.625 μs
155
+ - Channels: 336
156
+ - Bit Depth: 1-bit
157
+
158
+ ---
159
+
160
+ ## Usage
161
+
162
+ These test samples cover diverse observational parameters:
163
+ - **Time Resolution**: 49.152 μs to 1265.625 μs (26× range)
164
+ - **Frequency Coverage**: 190 MHz to 1870 MHz
165
+ - **DM Range**: 167.7 to 1457.6 pc cm⁻³
166
+ - **Bit Depths**: 1-bit, 2-bit, and 8-bit quantization
167
+
168
+ This diversity allows comprehensive evaluation of FRTSearch's performance across different telescope specifications and observing modes.
169
+
170
+ For detailed hyperparameter tuning guidelines for each telescope, see `test_sample/README.md`.
171
+
172
+ ---
173
+
174
+ ## Citations
175
+
176
+ If you use these test samples, please cite the original publications:
177
+
178
+ ```bibtex
179
+ @article{Guo2025,
180
+ title={FAST FRB Catalog},
181
+ author={Guo et al.},
182
+ journal={ApJS},
183
+ year={2025},
184
+ doi={10.3847/1538-4365/adf42d}
185
+ }
186
+
187
+ @article{Shannon2018,
188
+ title={The dispersion-brightness relation for fast radio bursts from a wide-field survey},
189
+ author={Shannon, R. M. and others},
190
+ journal={Nature},
191
+ volume={562},
192
+ pages={386--390},
193
+ year={2018},
194
+ doi={10.1038/s41586-018-0588-y}
195
+ }
196
+
197
+ @article{Keane2015,
198
+ title={The host galaxy of a fast radio burst},
199
+ author={Keane, E. F. and others},
200
+ journal={MNRAS},
201
+ volume={447},
202
+ pages={2852--2856},
203
+ year={2015},
204
+ doi={10.1093/mnras/stu2650}
205
+ }
206
+
207
+ @article{Ryder2022,
208
+ title={A luminous fast radio burst that probes the Universe at redshift 1},
209
+ author={Ryder, S. D. and others},
210
+ journal={Science},
211
+ volume={382},
212
+ pages={294--299},
213
+ year={2022},
214
+ doi={10.1126/science.adf2678}
215
+ }
216
+ ```