Estimation of Vehicle Pose and Position with Monocular Camera at Urban Road Intersections
Jin-Zhao Yuan1, Hui Chen1,*, Bin Zhao2, Yanyan Xu3,
1 School of Information Science and Engineering, Shandong University, Jinan 250100, China;
2 Beijing Xuanlongding-xun Technology Co., Ltd., Beijing 100041, China;
3 Department of Civil and Environmental Engineering, Massachusetts Institute of Technology, Cambridge 02139, U.S.A
Abstract With the rapid development of urban, the scale of the city is expanding day by day. The road environment is becoming more and more complicated. The vehicle ego-localization in complex road environment puts forward imperative requirements for intelligent driving technology. The reliable vehicle ego-localization, including the lane recognition and the vehicle position and attitude estimation, at the complex traffic intersection is significant for the intelligent driving of the vehicle. In this article, we focus on the complex road environment of the city, and propose a pose and position estimation method based on the road sign using only a monocular camera and a common GPS (global positioning system). Associated with the multi-sensor cascade system, this method can be a stable and reliable alternative when the precision of multi-sensor cascade system decreases. The experimental results show that, within 100 meters distance to the road signs, the pose error is less than 2 degrees, and the position error is less than one meter, which can reach the lane-level positioning accuracy. Through the comparison with the Beidou high-precision positioning system L202, our method is more accurate for detecting which lane the vehicle is driving on.
This work was supported by the Key Project of National Natural Science Foundation of China under Grant No. 61332015 and the Natural Science Foundation of Shandong Province of China under Grant Nos. ZR2013FM302 and ZR2017MF057.
About author: Jin-Zhao Yuan is a postgraduate student at the School of Information Science and Engineering in Shandong University,Jinan.His research interests include autonomous driving,camera calibration,and 3D vision analysis.
Cite this article:
Jin-Zhao Yuan, Hui Chen, Bin Zhao, Yanyan Xu.Estimation of Vehicle Pose and Position with Monocular Camera at Urban Road Intersections[J] Journal of Computer Science and Technology, 2017,V32(6): 1150-1161
 Abbott H, Powell D. Land-vehicle navigation using GPS. Proceedings of the IEEE, 1999, 87(1):145-162. Liu Y, Bai B. Research on GPRS vehicle location network service system. In Proc. IEEE International Conference on Computer, Mechatronics, Control and Electronic Engineering, Aug. 2010, pp.401-404. Choi B S, Lee J J. Mobile robot localization in indoor environment using RFID and sonar fusion system. In Proc. IEEE International Conference on Intelligent Robots and Systems, Oct. 2009, pp.2039-2044. Armesto L, Tornero J. Robust and efficient mobile robot self-localization using laser scanner and geometrical maps. In Proc. IEEE International Conference on Intelligent Robots and Systems, Oct. 2006, pp.3080-3085. Lategahn H, Schreiber M, Ziegler J et al. Urban localization with camera and inertial measurement unit. In Proc. IEEE Intelligent Vehicles Symposium, Jun. 2013, pp.719-724. Wahab A A, Khattab A, Fahmy Y A. Two-way TOA with limited dead reckoning for GPS-free vehicle localization using single RSU. In Proc. the 13th IEEE International Conference on ITS Telecommunications, Nov. 2013, pp.244-249. Wei L, Cappelle C, Ruichek Y. Camera/laser/GPS fusion method for vehicle positioning under extended NIS-based sensor validation. IEEE Transactions on Instrumentation & Measurement, 2013, 62(11):3110-3122. Rezaei S, Sengupta R. Kalman filter-based Integration of DGPS and vehicle sensors for localization. IEEE Transactions on Control Systems Technology, 2007, 15(6):1080-1088. Tuna G, Gulez K, Gungor V C et al. Evaluations of different simultaneous localization and mapping (SLAM) algorithms. In Proc. the 38th IEEE Conference on Industrial Electronics Society, Oct. 2012, pp.2693-2698. Chausse F, Laneurit J, Chapuis R. Vehicle localization on a digital map using particles filtering. In Proc. IEEE Intelligent Vehicles Symposium, Jun. 2005, pp.243-248. Peng J, EI Najjar E B, Pomorski M et al. Virtual 3D city model for intelligent vehicle geo-localization. In Proc. IEEE International Conference on Intelligent Transport Systems Telecommunications, Oct. 2009, pp.477-480. Uchiyama H, Deguchi D, Takahashi T et al. Egolocalization using streetscape image sequences from invehicle cameras. In Proc. IEEE Intelligent Vehicles Symposium, Jun. 2009, pp.185-190. Wong D, Deguchi D, Ide I et al. Single camera vehicle localization using SURF scale and dynamic time warping. In Proc. IEEE Intelligent Vehicles Symposium, Jun. 2014, pp.681-686. Song R, Chen H, Xiao Z, Xu Y, Klette R. Lane detection algorithm based on geometric moment sampling. SCIENTIA SINICA Informationis, 2017, 47(4):455-467. (in Chinese) Lai A H S, Yung N H C. Lane detection by orientation and length discrimination. IEEE Transactions on Systems Man & Cybernetics, Part B, 2000, 30(4):539-548. Lakshmanan S, Grimmer D. A deformable template approach to detecting straight edges in radar images. IEEE Transactions on Pattern Analysis & Machine Intelligence, 1996, 18(4):438-443. Kaliyaperumal K, Lakshmanan S, Kluge K. An algorithm for detecting roads and obstacles in radar images. IEEE Transactions on Vehicular Technology, 2001, 50(1):170-182. Nedevschi S, Popescu V, Danescu R et al. Accurate egovehicle global localization at intersections through alignment of visual data with digital map. IEEE Transactions on Intelligent Transportation Systems, 2013, 14(2):673-687. Ansar A, Daniilidis K. Linear pose estimation from points or lines. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2003, 25(5):578-589. Schweighofer G, Pinz A. Globally optimal O(n) solution to the PnP problem for general camera models. In Proc. British Machine Vision Conference, Sept. 2008. Lepetit V, Moreno-Noguer F, Fua P. EPnP:An accurate O(n) solution to the PnP problem. International Journal of Computer Vision, 2009, 81(2):155-166. Lasota M, Skoczylas M. Recognition of multiple traffic signs using keypoints feature detectors. In Proc. IEEE International Conference and Exposition on Electrical and Power Engineering, Oct. 2016, pp.535-540. Teunissen P J, Odolinski R, Odijk D. Instantaneous BeiDou+GPS RTK positioning with high cut-off elevation angles. Journal of Geodesy, 2014, 88(4):335-350. Ren F X, Huang J, Jiang R et al. General traffic sign recognition by feature matching. In Proc. IEEE Image and Vision Computing New Zealand, Nov. 2009, pp.409-414. Ellahyani A, Ansari M E, Jaafari I E. Traffic sign detection and recognition based on random forests. Appl. Soft. Comput., 2016, 46:805-815. Maldonado-Bascon S, Lafuente-Arroyo S, Gil-Jimenez P et al. Road-sign detection and recognition based on support vector machines. IEEE Transactions on Intelligent Transportation Systems, 2007, 8(2):264-278. Yuan Y, Xiong Z, Wang Q. An incremental framework for video-based traffic sign detection, tracking, and recognition. IEEE Transactions on Intelligent Transportation Systems, 2017, 18(7):1918-1929. Fartaj M, Ghofrani S. Traffic road sign detection and classification. Majlesi Journal of Electrical Engineering, 2012, 6(4):54-62. Zhang Z. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2000, 22(11):1330-1334.
Copyright 2010 by Journal of Computer Science and Technology