Adaptive Direct RGB-D Registration and Mapping for Large Motions

Renato Martins 1, 2 Eduardo Fernandez-Moral 2 Patrick Rives 2
2 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : Dense direct RGB-D registration methods are widely used in tasks ranging from localization and tracking to 3D scene reconstruction. This work addresses a peculiar aspect which drastically limits the applicability of direct registration, namely the weakness of the convergence domain. First, we propose an activation function based on the conditioning of the RGB and ICP point-to-plane error terms. This function strengthens the geometric error influence in the first coarse iterations, while the intensity data term dominates in the finer increments. The information gathered from the geometric and photometric cost functions is not only considered for improving the system observability, but for exploiting the different convergence properties and convexity of each data term. Next, we develop a set of strategies as a flexible regularization and a pixel saliency selection to further improve the quality and robustness of this approach. The methodology is formulated for a generic warping model and results are given using perspective and spherical sensor models. Finally, our method is validated in different RGB-D spherical datasets, including both indoor and outdoor real sequences and using the KITTI VO/SLAM benchmark dataset. We show that the different proposed techniques (weighted activation function, regularization, saliency pixel selection), lead to faster convergence and larger convergence domains, which are the main limitations to the use of direct methods.
Type de document :
Communication dans un congrès
Lai Shang-Hong, Lepetit Vincent, Nishino Ko, Sato Yoichi Computer Vision – ACCV 2016 13th Asian Conference on Computer Vision, Nov 2016, Taipei, Taiwan. Lecture Notes in Computer Science 10114, pp.191-206, 2017, 〈10.1007/978-3-319-54190-7_12〉
Liste complète des métadonnées

https://hal-mines-paristech.archives-ouvertes.fr/hal-01506682
Contributeur : Magalie Prudon <>
Soumis le : mercredi 12 avril 2017 - 11:05:25
Dernière modification le : mercredi 16 mai 2018 - 11:23:03

Lien texte intégral

Identifiants

Citation

Renato Martins, Eduardo Fernandez-Moral, Patrick Rives. Adaptive Direct RGB-D Registration and Mapping for Large Motions. Lai Shang-Hong, Lepetit Vincent, Nishino Ko, Sato Yoichi Computer Vision – ACCV 2016 13th Asian Conference on Computer Vision, Nov 2016, Taipei, Taiwan. Lecture Notes in Computer Science 10114, pp.191-206, 2017, 〈10.1007/978-3-319-54190-7_12〉. 〈hal-01506682〉

Partager

Métriques

Consultations de la notice

643