Update README.md
Browse files
README.md
CHANGED
|
@@ -8,12 +8,16 @@ library_name: timm
|
|
| 8 |
|
| 9 |
# Model Card for Model ID
|
| 10 |
|
| 11 |
-
Based on **quasi-linear hyperbolic systems of PDEs** [
|
| 12 |
|
| 13 |
-
*This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).*
|
| 14 |
|
| 15 |

|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
## Model Details
|
| 18 |
|
| 19 |
### Model Description
|
|
|
|
| 8 |
|
| 9 |
# Model Card for Model ID
|
| 10 |
|
| 11 |
+
Based on **quasi-linear hyperbolic systems of PDEs** [[Liu et al, 2023](https://github.com/liuyao12/ConvNets-PDE-perspective)], the QLNet enters an uncharted water of ConvNet model space marked by the use of (element-wise) multiplication instead of ReLU as the primary nonlinearity. It achieves comparable performance as ResNet50 on ImageNet-1k (acc=78.4), demonstrating that its capacity/expressivity, and deserves more study (hyper-paremeter tuning, optimizer, etc.) by the community.
|
| 12 |
|
|
|
|
| 13 |
|
| 14 |

|
| 15 |
|
| 16 |
+
One notable feature of the architecture is the absence of ReLU or other element-wise activation functions, which enables the model to admit a *continuous* symmetry in its parameters. Check out the [notebook](https://colab.research.google.com/#fileId=https://huggingface.co/liuyao/QLNet/blob/main/QLNet_symmetry.ipynb) for a demonstration that transforms the weights while leaving the output unchanged.
|
| 17 |
+
|
| 18 |
+
*This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).*
|
| 19 |
+
|
| 20 |
+
|
| 21 |
## Model Details
|
| 22 |
|
| 23 |
### Model Description
|