Spaces:
Sleeping
Sleeping
File size: 4,456 Bytes
29b9c56 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 | Introduction
============
|Build Status|
.. |Build Status| image:: https://travis-ci.org/fbcotter/pytorch_wavelets.png?branch=master
:target: https://travis-ci.org/fbcotter/pytorch_wavelets
This package provides support for computing the 2D discrete wavelet and
the 2d dual-tree complex wavelet transforms, their inverses, and passing
gradients through both using pytorch.
The implementation is designed to be used with batches of multichannel images.
We use the standard pytorch implementation of having 'NCHW' data format.
This repo originally was only for the use of the DTCWT, but I have added some DWT support. This is still in development,
and has the following known issues:
- Uses reflection padding instead of symmetric padding for the DWT
- Doesn't compute the DWT separably, instead uses the full `N x N` kernel.
.. figure:: dwt.png
:align: center
The subband implementation of the discrete wavelet transform
.. figure:: dwt_bands.png
:align: center
The equivalent point spread functions of the dwt (a) and the areas of the
frequency plane each filter selects (b). Image taken from
:cite:`selesnick_dual-tree_2005`.
.. figure:: dtcwt.png
:align: center
The subband implementation of the dual tree complex wavelet transform
.. figure:: dtcwt_bands2.png
:align: center
The equivalent point spread functions of the dtcwt (a) and the areas of the
frequency plane each filter selects (b). Image taken from
:cite:`selesnick_dual-tree_2005`.
Installation
````````````
The easiest way to install ``pytorch_wavelets`` is to clone the repo and pip install
it. Later versions will be released on PyPi but the docs need to updated first::
$ git clone https://github.com/fbcotter/pytorch_wavelets
$ cd pytorch_wavelets
$ pip install .
(Although the `develop` command may be more useful if you intend to perform any
significant modification to the library.) A test suite is provided so that you
may verify the code works on your system::
$ pip install -r tests/requirements.txt
$ pytest tests/
Notes
`````
See the other docs
Floating Point Type
~~~~~~~~~~~~~~~~~~~
By default, the filters will use 32-bit precision, as is the common case with
gpu operations. You can change to 64-bit by calling
:code:`torch.set_default_dtype(torch.float64)` before the transforms are
constructed.
Running on the GPU
~~~~~~~~~~~~~~~~~~
This should come as no surprise to pytorch users. The DWT and DTCWT transforms support
cuda calling:
.. code:: python
import torch
from pytorch_wavelets import DTCWTForward, DTCWTInverse
xfm = DTCWTForward(J=3, biort='near_sym_b', qshift='qshift_b').cuda()
X = torch.randn(10,5,64,64).cuda()
Yl, Yh = xfm(X)
ifm = DTCWTInverse(J=3, biort='near_sym_b', qshift='qshift_b').cuda()
Y = ifm((Yl, Yh))
The automated tests cannot test the gpu functionality, but do check cpu running.
To test whether the repo is working on your gpu, you can download the repo,
ensure you have pytorch with cuda enabled (the tests will check to see if
:code:`torch.cuda.is_available()` returns true), and run:
.. code::
pip install -r tests/requirements.txt
pytest tests/
From the base of the repo.
Backpropagation
~~~~~~~~~~~~~~~
It is possible to pass gradients through the forward and backward transforms.
All you need to do is ensure that the input to each has the required_grad
attribute set to true.
Speed Tests
~~~~~~~~~~~
We compare doing the dtcwt with the python package and doing the dwt with
PyWavelets to doing both in pytorch_wavelets, using a GTX1080. The numpy methods
were run on a 14 core Xeon Phi machine using intel's parallel python. For the
dtwcwt we use the `near_sym_a` filters for the first scale and the `qshift_a`
filters for subsequent scales. For the dwt we use the `db4` filters.
For a fixed input size, but varying the number of scales (from 1 to 4) we have
the following speeds (averaged over 5 runs):
.. image:: scale.png
For an input size with height and width 512 by 512, we also vary the batch size
for a 3 scale transform. The resulting speeds were:
.. image:: batchsize.png
Provenance
``````````
Based on the Dual-Tree Complex Wavelet Transform Pack for MATLAB by Nick
Kingsbury, Cambridge University. The original README can be found in
ORIGINAL_README.txt. This file outlines the conditions of use of the original
MATLAB toolbox.
.. bibliography:: references.bib
.. vim:sw=4:sts=4:et
|