Technical note: probabilistic visual and electromagnetic data fusion for robust drift-free sequential mosaicking: application to fetoscopy

Marcel Tella-Amo; Loic Peter; Dzhoshkun I. Shakir; Jan Deprest; Danail Stoyanov; Juan Eugenio Iglesias; Tom Vercauteren; Sebastien Ourselin

doi:10.1117/12.2319839

13 March 2018 Technical note: probabilistic visual and electromagnetic data fusion for robust drift-free sequential mosaicking: application to fetoscopy

Marcel Tella-Amo, Loic Peter, Dzhoshkun I. Shakir, Jan Deprest, Danail Stoyanov, Juan Eugenio Iglesias, Tom Vercauteren, Sebastien Ourselin

Author Affiliations +

Proceedings Volume 10576, Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling; 105760I (2018) https://doi.org/10.1117/12.2319839
Event: SPIE Medical Imaging, 2018, Houston, Texas, United States

Abstract

The most e↵ective treatment for Twin-to-Twin Transfusion Syndrome is laser photocoagulation of the shared vascular anastomoses in the placenta. Vascular connections are extremely challenging to locate due to their caliber and the reduced field of view of the fetoscope. Therefore, mosaicking techniques are beneficial to expand the scene, facilitate navigation and allow vessel photocoagulation decision-making. Local vision-based mosaicking algorithms inherently drift over time due to the use of pairwise transformations. We propose the use of an electromagnetic tracker (EMT) sensor mounted at the tip of the fetoscope to obtain camera pose measurements, which we incorporate into a probabilistic framework with frame-to-frame visual information to achieve globally consistent sequential mosaics. We parametrize the problem in terms of plane and camera poses constrained by EMT measurements to enforce global consistency while leveraging pairwise image relationships in a sequential fashion through the use of Local Bundle Adjustment. We show that our approach is drift-free and performs similarly to state-of-the-art global alignment techniques like Bundle Adjustment albeit with much less computational burden. Additionally, we propose a version of Bundle Adjustment that uses EMT information. We demonstrate the robustness to EMT noise and loss of visual information and evaluate mosaics for synthetic, phantom-based and ex vivo datasets.

Citation Download Citation

Marcel Tella-Amo, Loic Peter, Dzhoshkun I. Shakir, Jan Deprest, Danail Stoyanov, Juan Eugenio Iglesias, Tom Vercauteren, and Sebastien Ourselin "Technical note: probabilistic visual and electromagnetic data fusion for robust drift-free sequential mosaicking: application to fetoscopy", Proc. SPIE 10576, Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, 105760I (13 March 2018); https://doi.org/10.1117/12.2319839

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Visualization

Information visualization

Video

Electromagnetism

Motion models

Visual process modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years