Skip to Main content Skip to Navigation
Journal articles

Combining Visual Cues with Interactions for 3D–2D Registration in Liver Laparoscopy

Abstract : Augmented Reality (AR) in monocular liver laparoscopy requires one to register a preoperative 3D liver model to a laparoscopy image. This is a difficult problem because the preoperative shape may significantly differ from the unknown intraoperative shape and the liver is only partially visible in the laparoscopy image. Previous approaches are either manual, using a rigid model, or automatic, using visual cues and a biomechanical model. We propose a new approach called the hybrid approach combining the best of both worlds. The visual cues allow us to capture the machine perception while user interaction allows us to take advantage of the surgeon's prior knowledge and spatial understanding of the patient anatomy. The registration accuracy and repeatability were evaluated on phantom, animal ex vivo and patient data respectively. The proposed registration outperforms the state of the art methods both in terms of accuracy and repeatability. An average registration error below the 1 cm oncologic margin advised in the literature for tumour resection in laparoscopy hepatectomy was obtained.
Document type :
Journal articles
Complete list of metadata
Contributor : Bertrand Le Roy Connect in order to contact the contributor
Submitted on : Friday, June 12, 2020 - 4:33:53 PM
Last modification on : Tuesday, September 7, 2021 - 3:44:02 PM


Distributed under a Creative Commons Attribution 4.0 International License



Yamid Espinel, Erol Ozgür, Lilian Calvet, Bertrand Le Roy, Emmanuel Buc, et al.. Combining Visual Cues with Interactions for 3D–2D Registration in Liver Laparoscopy. Annals of Biomedical Engineering, Springer Verlag, 2020, 48 (6), pp.1712-1727. ⟨10.1007/s10439-020-02479-z⟩. ⟨hal-02866682⟩



Record views