P064 - DRMIME: Differentiable Mutual Information and Matrix Exponential for Multi-Resolution Image Registration

Abhishek Nan, Matthew Tennant, Uriel Rubin, Nilanjan Ray

Show abstract - Show schedule - Proceedings - PDF - Reviews - Teaser

In this work, we present a novel unsupervised image registration algorithm. It is differentiable end-to-end and can be used for both multi-modal and mono-modal registration. This is done using mutual information (MI) as a metric. The novelty here is that rather than using traditional ways of approximating MI which are often histogram based, we use a neural estimator called MINE and supplement it with matrix exponential for transformation matrix computation. The introduction of MINE tackles some of the drawbacks of histogram based MI computation and matrix exponential makes the optimization process smoother. We also introduce the idea of a multi-resolution loss, which makes the optimization process faster and more robust. This leads to improved results as compared to the standard algorithms available out-of-the-box in state-of-the-art image registration toolboxes, both in terms of time as well as registration accuracy, which we empirically demonstrate on publicly available datasets.
Hide abstract

Poster Session #4 - 14:30 - 16:00 UTC-4 (Tuesday)
Hide schedule

Access paper channel

Spotlight presentation

Can't display slides, your browser doesn't support embedding PDFs. You can still download the slides:

Download slides