EfficientFormer (backbone) + SegFormer (head)

by skyeom - opened Jan 11, 2023

Hi Bearnardd,

Thank you for sharing pretrained efficientformer (classification) models.

I'd like to test efficientformer by change head of efficientformer into another head (i.e. SegFormer).

Is there any way to easily try to test for it?

Thanks for reaching out! Let me get back to you tomorrow since I am half a sleep at the moment :) .

At the moment EfficientFormer is still not on main branch since I had a little bug in the implementation which I just fixed but I also got several comments to apply in my PR (which you can follow https://github.com/huggingface/transformers/pull/20459) so it will probably be finished in the next week. In case of changing the head of the model you can use EfficientFormer as a base model and add custom head on top of it. You can take a look at this blog post on how to achieve that https://towardsdatascience.com/adding-custom-layers-on-top-of-a-hugging-face-model-f1ccdfc257bd).

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment