Urban Localization with Street Views using a Convolutional Neural Network for End-to-End Camera Pose Regression - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année :

Urban Localization with Street Views using a Convolutional Neural Network for End-to-End Camera Pose Regression

(1) , (1) , (2) , (2)
1
2
Yu Li
  • Fonction : Auteur
  • PersonId : 1156158
  • IdRef : 10051054X
Cyril Joly
Fabien Moutarde

Résumé

This paper presents an end-to-end real-time monocular absolute localization approach that uses Google Street View panoramas as a prior source of information to train a Convolutional Neural Network (CNN). We propose an adaptation of the PoseNet architecture [8] to a sparse database of panoramas. We show that we can expand the latter by synthesizing new images and consequently improve the accuracy of the pose regressor. The main advantage of our method is that it does not require a first passage of an equipped vehicle to build a map. Moreover, the offline data generation and CNN training are automatic and does not require the input of an operator. In the online phase, the approach only uses one camera for localization and regresses poses in a global frame. The conducted experiments show that augmenting the training set as presented in this paper drastically improves the accuracy of the CNN. The results, when compared to a handcrafted-feature-based approach, are less accurate (around 7.5 to 8 m against 2.5 to 3 m) but also less dependent on the position of the camera inside the vehicle. Furthermore, our CNN-based method computes the pose approximately 40 times faster (75 ms per image instead of 3 s) than the handcrafted approach.
Fichier principal
Vignette du fichier
localization_StView-convNet_IV2019_VeDeCom-MINES_ParisTech_FINAL.pdf (3.76 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02156721 , version 1 (14-06-2019)

Identifiants

  • HAL Id : hal-02156721 , version 1

Citer

Guillaume Bresson, Yu Li, Cyril Joly, Fabien Moutarde. Urban Localization with Street Views using a Convolutional Neural Network for End-to-End Camera Pose Regression. 2019 IEEE Intelligent Vehicles Symposium (IV 19), Jun 2019, Paris, France. ⟨hal-02156721⟩
111 Consultations
286 Téléchargements

Partager

Gmail Facebook Twitter LinkedIn More