Benedict Evans, a general partner at Andreessen Horowitz, claims that “almost all autonomy” projects are using lidar for SLAM, and that not all of them use HD maps.

An MIT group is testing self-driving cars on public roads without HD maps.

My question is whether the difference in error between lidar and cameras is significant. Benedict Evans and others claim that lidar is necessary for accurate enough SLAM in self-driving cars, but at first glance the KITTI benchmark data seems to contradict that claim. I want to confirm or refute that impression.

The KITTI Vision benchmark leaderboard for visual odometry/SLAM methods shows a lidar-based method called V-LOAM in first place, and a stereo camera-based method called SOFT2 in fourth place. They have the same rotation error, and a percentage point difference of 0.05 in their respective translation errors.

Is a 0.05 percentage point difference in translation accuracy large or insignificant, when it comes to an autonomous car navigation?

The KITTI Vision benchmark leaderboard for odometry/SLAM methods:

The KITTI Vision benchmark leaderboard for odometry/SLAM methods

  • Fair enough! I've rolled the comments you made here back into the question and reopened it. – Chuck Aug 8 at 12:41

In other words, could this difference noticeably impact safety or reliability? -> not at all in my opinion.

What important in autonomous car navigation is localization stability rather than the odometry estimation accuracy. Maps for autonomous driving are usually prebuilt and globally optimized before they are used for a navigation. It is never required to build such an open loop trajectory for a navigation.

Even for a map building, 0.05% is almost meaningless if there is a proper place recognition system.

Your Answer


By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.