HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Urban Localization with Street Views using a Convolutional Neural Network for End-to-End Camera Pose Regression

Abstract : This paper presents an end-to-end real-time monocular absolute localization approach that uses Google Street View panoramas as a prior source of information to train a Convolutional Neural Network (CNN). We propose an adaptation of the PoseNet architecture [8] to a sparse database of panoramas. We show that we can expand the latter by synthesizing new images and consequently improve the accuracy of the pose regressor. The main advantage of our method is that it does not require a first passage of an equipped vehicle to build a map. Moreover, the offline data generation and CNN training are automatic and does not require the input of an operator. In the online phase, the approach only uses one camera for localization and regresses poses in a global frame. The conducted experiments show that augmenting the training set as presented in this paper drastically improves the accuracy of the CNN. The results, when compared to a handcrafted-feature-based approach, are less accurate (around 7.5 to 8 m against 2.5 to 3 m) but also less dependent on the position of the camera inside the vehicle. Furthermore, our CNN-based method computes the pose approximately 40 times faster (75 ms per image instead of 3 s) than the handcrafted approach.
Complete list of metadata

Cited literature [24 references]  Display  Hide  Download

Contributor : Fabien Moutarde Connect in order to contact the contributor
Submitted on : Friday, June 14, 2019 - 4:06:54 PM
Last modification on : Wednesday, November 17, 2021 - 12:31:07 PM


Files produced by the author(s)


  • HAL Id : hal-02156721, version 1


Guillaume Bresson, Yu Li, Cyril Joly, Fabien Moutarde. Urban Localization with Street Views using a Convolutional Neural Network for End-to-End Camera Pose Regression. 2019 IEEE Intelligent Vehicles Symposium (IV 19), Jun 2019, Paris, France. ⟨hal-02156721⟩



Record views


Files downloads