Add pimm export (repackaged from DeepLearnPhysics/panda)
Browse files- README.md +46 -1
- model.safetensors +3 -0
- training_config.json +64 -0
README.md
CHANGED
|
@@ -1,3 +1,48 @@
|
|
| 1 |
---
|
| 2 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
library_name: pimm
|
| 3 |
+
tags:
|
| 4 |
+
- particle-physics
|
| 5 |
+
- lartpc
|
| 6 |
+
- point-cloud
|
| 7 |
+
- point-transformer-v3
|
| 8 |
---
|
| 9 |
+
|
| 10 |
+
# Panda — PointTransformerV3 encoder (pretrained)
|
| 11 |
+
|
| 12 |
+
A PointTransformerV3 (`PT-v3m2`) encoder pretrained with masked
|
| 13 |
+
point modeling on LArTPC (PILArNet) data. Intended as a backbone / warm-start for
|
| 14 |
+
downstream segmentation and detection tasks (it produces multi-scale point
|
| 15 |
+
features; it has no task head).
|
| 16 |
+
|
| 17 |
+
- **pimm type:** `PT-v3m2`
|
| 18 |
+
- **enc_depths:** (3, 3, 3, 9, 3) · **enc_channels:** (48, 96, 192, 384, 512)
|
| 19 |
+
- **encoder-only** (`enc_mode=True`), masked-modeling token enabled.
|
| 20 |
+
|
| 21 |
+
## Loading
|
| 22 |
+
|
| 23 |
+
```python
|
| 24 |
+
import pimm
|
| 25 |
+
model = pimm.from_pretrained("hf://deeplearnphysics/panda-base")
|
| 26 |
+
```
|
| 27 |
+
|
| 28 |
+
The architecture and all hyper-parameters are carried in `training_config.json`,
|
| 29 |
+
so no config file is needed. Weights are bitwise-identical to the original
|
| 30 |
+
checkpoint.
|
| 31 |
+
|
| 32 |
+
## Input
|
| 33 |
+
|
| 34 |
+
A pimm `Point` dict for LArTPC (PILArNet) point clouds: `coord` (xyz) + `energy`,
|
| 35 |
+
collected as `feat_keys=("coord", "energy")` (4 input channels). Coordinates are
|
| 36 |
+
normalized in the model forward.
|
| 37 |
+
|
| 38 |
+
## Notes
|
| 39 |
+
|
| 40 |
+
- Config sets `enable_flash=True`. On CPU or non-FlashAttention setups, override
|
| 41 |
+
it (e.g. pass `enable_flash=False` to `from_pretrained`, or for detectors set it
|
| 42 |
+
on the `backbone`).
|
| 43 |
+
|
| 44 |
+
## Provenance
|
| 45 |
+
|
| 46 |
+
Repackaged from the original [`DeepLearnPhysics/panda`](https://github.com/DeepLearnPhysics/panda) checkpoints into the
|
| 47 |
+
[`pimm`](https://github.com/youngsm/particle-imaging-models) export format. Inherits
|
| 48 |
+
the license of the source repository.
|
model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e942ea9947989c8f848f04a2d9c0ca949149edfec167ccbc6852d556986c202d
|
| 3 |
+
size 363078520
|
training_config.json
ADDED
|
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": {
|
| 3 |
+
"type": "PT-v3m2",
|
| 4 |
+
"in_channels": 4,
|
| 5 |
+
"order": [
|
| 6 |
+
"hilbert",
|
| 7 |
+
"hilbert-trans",
|
| 8 |
+
"z",
|
| 9 |
+
"z-trans"
|
| 10 |
+
],
|
| 11 |
+
"stride": [
|
| 12 |
+
2,
|
| 13 |
+
2,
|
| 14 |
+
2,
|
| 15 |
+
2
|
| 16 |
+
],
|
| 17 |
+
"enc_depths": [
|
| 18 |
+
3,
|
| 19 |
+
3,
|
| 20 |
+
3,
|
| 21 |
+
9,
|
| 22 |
+
3
|
| 23 |
+
],
|
| 24 |
+
"enc_channels": [
|
| 25 |
+
48,
|
| 26 |
+
96,
|
| 27 |
+
192,
|
| 28 |
+
384,
|
| 29 |
+
512
|
| 30 |
+
],
|
| 31 |
+
"enc_num_head": [
|
| 32 |
+
3,
|
| 33 |
+
6,
|
| 34 |
+
12,
|
| 35 |
+
24,
|
| 36 |
+
32
|
| 37 |
+
],
|
| 38 |
+
"enc_patch_size": [
|
| 39 |
+
256,
|
| 40 |
+
256,
|
| 41 |
+
256,
|
| 42 |
+
256,
|
| 43 |
+
256
|
| 44 |
+
],
|
| 45 |
+
"mlp_ratio": 4,
|
| 46 |
+
"qkv_bias": true,
|
| 47 |
+
"qk_scale": null,
|
| 48 |
+
"layer_scale": 1e-05,
|
| 49 |
+
"attn_drop": 0.0,
|
| 50 |
+
"proj_drop": 0.0,
|
| 51 |
+
"drop_path": 0.3,
|
| 52 |
+
"shuffle_orders": true,
|
| 53 |
+
"pre_norm": true,
|
| 54 |
+
"enable_rpe": false,
|
| 55 |
+
"enable_flash": true,
|
| 56 |
+
"upcast_attention": false,
|
| 57 |
+
"upcast_softmax": false,
|
| 58 |
+
"traceable": true,
|
| 59 |
+
"enc_mode": true,
|
| 60 |
+
"mask_token": true,
|
| 61 |
+
"cpe_first_layer_only": false,
|
| 62 |
+
"cpe_shared_weight": false
|
| 63 |
+
}
|
| 64 |
+
}
|