File size: 2,137 Bytes
805995b 8f72751 03a649a f5438e0 7daa541 805995b 279283d 03a649a 805995b 17a1fdd 805995b 68550ad 805995b 7daa541 805995b 03a649a 805995b 17a1fdd f03bea8 eda93f8 805995b eb4bb1e eda93f8 3b7bd13 eb4bb1e 8767932 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 |
---
library_name: transformers
license: creativeml-openrail-m
language:
- en
base_model:
- facebook/detr-resnet-50-panoptic
pipeline_tag: image-segmentation
tags:
- biology
datasets:
- FriedParrot/a-large-scale-fish-dataset
---
# Fish-segmentation-model
This is a Model using `ResNet-50` backbone and customized Multi-task Head and loss to make classification, boundary box prediction and segmentation (24.7M parameters).
Note that I only use processor of `detr-resnet-50-panotic` and `resnet-50` backbone of the base model, not use transformers. All the model, task heads and loss are self-defined.
Another model by directly fine-tuning DETR model can be found at https://huggingface.co/FriedParrot/fish-segmentation-simple
This model use kaggle dataset [A Large Scale Fish Dataset](https://www.kaggle.com/datasets/crowww/a-large-scale-fish-dataset) as dataset for training. And for convenience, I also made a copy version for this dataset available on [huggingface](https://huggingface.co/datasets/FriedParrot/a-large-scale-fish-dataset), this is just for making it easier for u to use.
Tasks :
- Classification
- BBoxes prediction, and
- Segmentation
> [!warning]
> Since this model include customized type, then `AutoModel()` and `AutoConfig()` may fail, but `AutoProcessor()` will work correctly (Since I use a DetrImageProcessor for this)
>
> If you want using this model, you can **go to my source code below** and look for `FishSegmentationModel` and `FishSegmentModelConfig` for load these models correctly.
>
### Model Sources
For **source code & Tutorials** : check [my github](https://github.com/FRIEDparrot/fish-segmentation)
---
### Results and test
I trained this model in my pc(RTX4060 8GB + cu126), and those are some pictures tested in fish datase :
(The model predicted the mullet a shrip lol😂 since classification head of this model is not very accurate😂) |