|
|
|
|
|
--- |
|
|
license: cc-by-nc-sa-4.0 |
|
|
library_name: pytorch |
|
|
tags: |
|
|
- activation-function |
|
|
- activation_function |
|
|
- dynamic_activation_function |
|
|
- dynamic-activation-function |
|
|
--- |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
# Universal Activation Function |
|
|
|
|
|
Tensorflow and Pytorch source code for the paper |
|
|
|
|
|
[Yuen, Brosnan, Minh Tu Hoang, Xiaodai Dong, and Tao Lu. "Universal activation function for machine learning." Scientific reports 11, no. 1 (2021): 1-11.](https://www.nature.com/articles/s41598-021-96723-8) |
|
|
|
|
|
|
|
|
# Getting the code |
|
|
|
|
|
Requires [Docker](https://docs.docker.com/get-docker/) |
|
|
|
|
|
|
|
|
Use git to pull this repo |
|
|
``` |
|
|
git clone https://github.com/SensorOrgNet/Universal_Activation_Function.git |
|
|
``` |
|
|
|
|
|
|
|
|
# Running the Tensorflow 2 version |
|
|
|
|
|
|
|
|
Install CUDA 11.2 container |
|
|
``` |
|
|
docker run --name UAF --gpus all -v /home/username/UAF/:/workspace -w /workspace -it nvcr.io/nvidia/cuda:11.2.0-cudnn8-devel-ubuntu20.04 bash |
|
|
``` |
|
|
|
|
|
|
|
|
Install python |
|
|
``` |
|
|
apt update |
|
|
apt install python3-pip |
|
|
``` |
|
|
|
|
|
|
|
|
Install pytorch and pytorch geometric |
|
|
``` |
|
|
pip3 install tensorflow==2.7.0 |
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Run the MLP with UAF for MNIST dataset |
|
|
``` |
|
|
cd Universal_Activation_Function/tensorflow/ |
|
|
python3 ./mnist_UAF.py |
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
# Running the Pytorch version |
|
|
|
|
|
|
|
|
Install CUDA 11.3 container |
|
|
``` |
|
|
docker run --name UAF --gpus all -v /home/username/UAF/:/workspace -w /workspace -it nvcr.io/nvidia/cuda:11.3.0-cudnn8-devel-ubuntu20.04 bash |
|
|
``` |
|
|
|
|
|
Install python |
|
|
``` |
|
|
apt update |
|
|
apt install python3-pip |
|
|
``` |
|
|
|
|
|
Install pytorch and pytorch geometric |
|
|
``` |
|
|
pip3 install torch==1.10.0+cu113 torchvision==0.11.1+cu113 torchaudio==0.10.0+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html |
|
|
pip3 install torch-scatter -f https://data.pyg.org/whl/torch-1.10.0+cu113.html |
|
|
pip3 install torch-sparse -f https://data.pyg.org/whl/torch-1.10.0+cu113.html |
|
|
pip3 install torch-cluster -f https://data.pyg.org/whl/torch-1.10.0+cu113.html |
|
|
pip3 install torch-spline-conv -f https://data.pyg.org/whl/torch-1.10.0+cu113.html |
|
|
pip3 install torch-geometric |
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Run the CNN with UAF for MNIST dataset |
|
|
``` |
|
|
cd Universal_Activation_Function/pytorch/ |
|
|
python3 ./mnist_UAF.py |
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Run the GCN2 with UAF for CORA dataset. The fold number is represented by the number at the end |
|
|
``` |
|
|
cd Universal_Activation_Function/pytorch/ |
|
|
python3 ./gcn2_cora_UAF.py 0 |
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Run the PNA with UAF for ZNC dataset. The fold number is represented by the number at the end |
|
|
``` |
|
|
cd Universal_Activation_Function/pytorch/ |
|
|
python3 ./pna_UAF.py 0 |
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
|
