Questions tagged [visual-odometry]

visual odometry is the process of determining the position and orientation of a robot by analyzing the associated camera images.

Filter by
Sorted by
Tagged with
1 vote
1 answer
16 views

Understanding reprojection error / visual residual in ORB-SLAM3

I am trying to understand ORB-SLAM3 paper. It gives visual residual / reprojectio error equation as follows: $$r_{ij}=u_{ij}-\prod(T_{CB}T^{-1}_i\oplus x_j)$$ where, $r_{ij}$ is reprojection error ...
Mahesha999's user avatar
0 votes
2 answers
305 views

Marginalization vs Dropping states for sliding window VO

When doing fixed lag smoothing or Windowed Smoothing for visual odometry and map construction, how does marginaliztion differ from dropping past states? How does each work? I assumed fixed lag ...
FourierFlux's user avatar
1 vote
0 answers
199 views

How does IMU pre-integration work and how is it different from EKF?

My understanding is that IMU pre-integration is to get away from having to re-integrate the the IMU between key-frame intervals when doing bundle adjustment. The formulations I ave seen involve a ...
FourierFlux's user avatar
0 votes
2 answers
48 views

The choice of using quaternions and using gyro & accel separately in EKF

I am working on realising the self-navigation of a vehicle. I have already written an extended Kalman filter with a state vector using position, velocity, Euler angle, acceleration, and angular ...
chen_441's user avatar
0 votes
1 answer
238 views

What should I use for a Visual+IMU+GPS fusion? A Madgwick or a Kalman?

I am new to robotics, and recently I am involving in a sensor fusion task using visual input (binocular at present), an IMU, and a GPS module. I have searched for related journal papers for a ...
chen_441's user avatar
2 votes
0 answers
76 views

How does marginalization work in fixed lag smoothing?

I have read in SLAM papers talk about marginalization. I am confused about how this process works, why you do it and how it differs from global smoothing. In particular if you're interested in ...
FourierFlux's user avatar
1 vote
0 answers
116 views

Using an optical mouse sensor for odometry?

I'm trying to use a mouse sensor for odometry on my robot. Most datasheets I have found use SPI or SDIO interfaces for communicating but my microcontroller would require an I2C interface. Would it be ...
AleXutzZu's user avatar
4 votes
2 answers
267 views

Why do we need to know the translation between Camera and IMU?

In Visual Inertial Odometry, assuming the camera and the IMU are attached to the same rigid body, why isn't it enough to know just the relative rotation between the camera and the IMU? Why do we need ...
jordi's user avatar
  • 163
0 votes
0 answers
57 views

Stereo Bundle Adjustment

When doing stereo based visual odometry and bundle adjustment how does the stereo constraint get factored into the photometric error? Do you use the fact the second cameras location is known wrt the ...
FourierFlux's user avatar
0 votes
1 answer
64 views

Question about bundle adjustment

When doing bundle adjustment do landmarks gets optimized as stand alone variables or are they viewed as a function of the robots first position when they are detected?
FourierFlux's user avatar
0 votes
0 answers
19 views

What is Rotation when pose is looking back?

I've model a relative pose between two cameras. $T_0$ is origin and $T_1$ has the relative pose. The $Camera_0$ is facing a the map point $X$, and I can get a vector $v_0$ from $Camera_0$ toward $X$. ...
Chen OT's user avatar
  • 101
1 vote
2 answers
831 views

/rtabmap/rtabmap: Did not receive data since 5 seconds

trying to run RtabMap on my realsense-435 device. I've set up all the topics and made sure they are published and subscribed, nevertheless, RtabMap gives me this error: ...
mobiiin's user avatar
  • 51
0 votes
0 answers
227 views

Uncontrolled drift of Visual Inertial Odometry

I'm trying to use the VINS-Fusion package to obtain odometry for a quadcopter. The primary sensor is an Intel Realsense D435i. I've calibrated the camera and IMU extrinsics using Kalibr. IMU ...
Kaapeine's user avatar
1 vote
1 answer
1k views

How to loop over each timestep in rosbags using Python?

I am using rosbag api to record rgb, depth and imu data coming off a robot. For an offline Visual Odometry experiment, I am in need of synchronizing RGB data with the imu data at the correct timesteps....
Azmyin Md. Kamal's user avatar
0 votes
1 answer
68 views

How does baseline work with forward motion in Monocular Visual Odometry

In my computer vision class we are studying visual odometry. In this we calculate the Fundamental matrix using 2 frames from forward motion using the concept of stereo-vision. But in stereo vision the ...
sdhar's user avatar
  • 1
1 vote
3 answers
2k views

Difference between motion-only bundle adjustment and pose-graph optimization

I've been trying to figure out the difference between motion-only bundle adjustment and pose-graph optimization, when talking about systems that only use cameras to estimate motion between frames, but ...
indigoblue's user avatar
3 votes
1 answer
954 views

Calculate information matrix for graph slam

0 I am new to SLAM. I am working on graph slam where I need to do pose graph optimisation. For this requirement information matrix is required between two edges for which the transformation has ...
Rajat's user avatar
  • 31
0 votes
1 answer
152 views

Relative scale problem

I am doing Monocular Visual Odometry, and I have problem with relative scale. Most of the time its value is between 0.8-1.1, but sometimes it goes crazy and it has value 3,4 and once it had value 25. ...
Cluv's user avatar
  • 1
0 votes
0 answers
179 views

Pose-Graph Optimization in MATLAB does not give expected results

I am trying to optimize a pose graph I created in MATLAB using either the optimizePoses(viewSet)-function on the imageViewSet that I have or the ...
DocRobson's user avatar
3 votes
2 answers
1k views

What's the difference between factor graph optimization and bundle adjustment?

I see that in SLAM literature, factor graph optimization is frequently used. While in Structure from Motion (SfM) literature , they usually use bundle adjustment. What's the difference between the two ...
zhouch's user avatar
  • 31
2 votes
1 answer
613 views

Visual Odometry terminology: Scale, Relative scale, absolute scale

I'm watching a MOOC about Machine Vision for Robotics, but I really do not know the meaning of some vocabulary of this domain. For example, What does the professor mean when he says this: However, we ...
sci9's user avatar
  • 189
0 votes
1 answer
206 views

Mono VIO vs. Stereo-Camera to recover Depth Information

I have a question. I have found some papers, where they use a Mono-VIO to recover depth of a scene. My question is: Suppose I have a robot arm and attach a mono-VIO system to it. Then I move this arm ...
user27536's user avatar
0 votes
1 answer
18 views

What are the parameters that I need to consider when figuring out the horizontal viewing distance of a camera mounted overhead for effective tracking?

I am currently working on developing a hybrid Indoor Positioning system where images from an overhead camera will be used to identify and track people. I am new to the field of visual tracking and a ...
Azmyin Md. Kamal's user avatar
0 votes
1 answer
173 views

How can I calibrate 3 cameras without knowing global pose of the object & camera locations? How can I find the pose of each camera wrt the first one?

I have camera feed (in the form of RGB images) from 3 cameras with partially overlapping Field-of-view i.e. for the time stamp 0 to 100, I have total 300 frames or say synchronized 100 RGB frames for ...
Raj's user avatar
  • 15
1 vote
0 answers
2k views

What does the normalized image coordinates imply?

In VSLAM or visual odometry, we use a camera matrix P to transform 3D scene points to 2D image points. When using homogeneous representation, we may choose the image coordinates as the normalized ...
lzx071021's user avatar
1 vote
1 answer
173 views

How is the depth estimation done in DTAM / LSD-SLAM (direct VSLAM)?

I know that DTAM and LSD-SLAM both employ the photometric error between two keyframes to estimate the image depth. But I don't know what the photometric error describes precisely. In the DTAM paper, I ...
fraukejr's user avatar
0 votes
2 answers
289 views

Custom implementation of robot_localization package

I plan to implement a sensor fusion of IMU + Visual odometry using an EKF. I came across the excellent robot_localization package which does pretty much all that I want. However, I need to use perform ...
OlorinIstari's user avatar
0 votes
1 answer
366 views

How to find visual odometry by video from cellphone camera mounted on robot?

I am writing codes in python for visual odometry from single camera. I used cell phone camera for testing. I took video of 35 sec with camera moving. I used code below to read first image ...
Vinitha Patil's user avatar
0 votes
1 answer
4 views

ZED VO vs Rtabmap VO

I'm using ZED cameras and also running Rtabmap. Both systems have visual odom available. What are the pros and cons of using ZED VO instead of rtabmap? Do I get gains from using one over the other? ...
user avatar
0 votes
1 answer
2 views

Rtab map stereo visual odometry pose scale?

Hello I'm kind of new to ROS, I'm trying to use the stereo visual odometry of RTAB map to produce odometry for localization, I have tried it on gazebo, the pose in the odom topic is translated in ...
user avatar
1 vote
0 answers
168 views

How does inverse compositional Lucas–Kanade algorithm work?

I am trying to understand the Lucas–Kanade algorithm since I am reading a paper in which is applied the inverse compositional Lucas–Kanade algorithm, but in order to understand the latter I have to ...
J.D.'s user avatar
  • 469
1 vote
1 answer
85 views

Problem understanding a paper about visual odometry

I am reading the following paper: SVO: Semi-Direct Visual Odometry for Monocular and Multi-Camera Systems , and I am having some problem understanding some concepts. Before starting I have to say ...
J.D.'s user avatar
  • 469
1 vote
0 answers
379 views

What is the definition of the phrase "ego robot"?

What does the phrase "ego robot" mean? I see it used in the context of multi robot systems like in the paper Game Theoretic Motion Planning for Multi-robot Racing by Zijian Wang, Riccardo Spica & ...
Ahmed Essam El Fakharany's user avatar
0 votes
1 answer
127 views

Planar Robot Boundary Detection

I am tasked with building a robot that needs to localise and navigate itself on a rectangular surface (like a large desk). The rectangle's shorter sides will be marked with a red tape (or with two ...
SupanovaZA's user avatar
1 vote
1 answer
169 views

How to derive the camera trajectory from ICP

This may be a very simple question so please bear with me... Suppose I have a stationary object and point clouds, $n$ $(x,y,z)$ points, of that object taken by a moving camera at time steps $t_i$, $...
Abe's user avatar
  • 113
0 votes
1 answer
172 views

SLAM techniques based on contact, odometry and one front camera

Consider a mobile robot provided with a contact sensor that randomly travels in a closed environment, changing direction every time an obstacle is encountered. Is it possible to reconstruct the 2D map ...
firion's user avatar
  • 101
1 vote
1 answer
203 views

How to plot the 3D camera trajectory from a VSLAM output

I am totally new to VSLAM algorithms and would want to plot the path followed by the moving camera. I am using the open source implementation of ORB_SLAM2 for a rgb-d camera on benchmark dataset. The ...
rotating_image's user avatar
4 votes
1 answer
148 views

Performing Image alignment using pyramid levels with semi dense depth

To gain some confidence, I want to implement the camera tracking (optimization problem) discussed in Semi Dense Visual Odometry for a monocular cameraJ Engel, J Strum, D Cremers $$E(\xi) = \underset{i}...
vyi's user avatar
  • 205
2 votes
1 answer
347 views

Why do strong rotations affect Monocular Vision based Visual Odometry?

In context of the paper Semi Dense Visual Odometry for a Monocular Camera J Engel, J Sturms, D Cremers At page 7, last paragraph the author writes The achieved tracking accuracy for two feasible ...
vyi's user avatar
  • 205
2 votes
1 answer
330 views

How to publish odometry from 3 wheeled omnidirectional robot?

I'm new to ROS and robotics and I'm trying to implement the ROS navigation stack in a 3 wheeled omnidirectional robot. I already made the map using RTABMap but now I'm stuck in the 'Publishing ...
Vahzahhun's user avatar
0 votes
1 answer
5 views

Improving odometry from RTAB mapping

I'm using real-time appearance-based mapping (rtabmap_ros) to perform SLAM with a first-generation Kinect RGBD sensor, and this is working fairly well. However, ...
user avatar
1 vote
0 answers
85 views

Map initialization problem in Mono SLAM

I'm reading and trying to implement the paper Monofusion(V. Pradeep, C. Rhemann, S. Izadi, C. Zach, M. Bleyer and S. Bathiche, "MonoFusion: Real-time 3D reconstruction of small scenes with a single ...
kju's user avatar
  • 11
0 votes
1 answer
76 views

Which algorithms to locate a static 3D object relative to a moving camera/IMU?

I am using typical setup with camera and IMU as found on a smartphone. Using this, I would like to estimate the relative pose between the camera and an object (for simplicity, let's say a cube). The ...
Daniel Eckert's user avatar
5 votes
1 answer
69 views

Accuracy of monocular visual-inertial odometry

I am currently considering to use monocular visual-inertial odometry (VIO) to localize a smartphone relative to a known object. Now, what I would like to understand is, what kind of accuracy I can ...
Daniel Eckert's user avatar
2 votes
2 answers
175 views

Is pose estimation using images necessary in visual-inertial SLAM

In visual SLAM, pose estimation is performed between two adjacent frames or keyframes using feature detection and pose estitmation from corresponding features. However in visual-inertial SLAM, pose ...
Jogging Song's user avatar
0 votes
1 answer
3 views

robot_pose_ekf visual odometry

Hi all, I am working on a project which runs SLAM (RTAB map) on an autonomous land rover. The rover is equipped with a real sense D415 camera, a wheel odometry system and Pixhawk. We have been using ...
user avatar
9 votes
1 answer
322 views

In practical terms, how close is the accuracy of camera-based visual odometry/SLAM methods to lidar-based methods for autonomous car navigation?

Benedict Evans, a general partner at Andreessen Horowitz, claims that “almost all autonomy” projects are using lidar for SLAM, and that not all of them use HD maps. An MIT group is testing self-...
T.A. Eady's user avatar
0 votes
1 answer
3 views

Pointers towards using robot_localization for VO + Wheel odometry

Hey , i am trying to setup a EKF fusion for combining odometry coming from two topics Visual Odometry (X , Y and yaw) Wheel Encoders ( X , Y and yaw) The main source of Odometry is coming from wheel ...
user avatar
0 votes
1 answer
7 views

Visual Odometry with Realsense Camera

I am trying to implement a visual odometry package with my Intel Realsense camera. Is there a way to implement stereo visual odometry with this camera since the depth is calculated with infrared ...
user avatar
2 votes
1 answer
180 views

SE3 composition operator gives unexpected results

Given Data and Algorithm I have a stream of SE3 poses supplied by a basic wheel encoder odometry through ROS message passing system. Odometry publishes data in traditional to ROS ENU coordinate frame ...
Dmitri K's user avatar
  • 131