Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [visual-odometry]

visual odometry is the process of determining the position and orientation of a robot by analyzing the associated camera images.

Filter by
Sorted by
Tagged with
1 vote
0 answers
14 views

How do you deal with target image boundaries in direct image alignment?

In direct image alignment, given a set of points $x_{\\{M\\}}$ that appear in a template $T_1$ and image $I_2$, the pose can be found by minimizing the photometric error $E(x_{\\{M\\}})$. \begin{...
wgr's user avatar
  • 11
1 vote
0 answers
40 views

What are my camera interface options to integrate with Jetson for ORB-SLAM3? [closed]

I want to try out drone visual odometry using a thermal camera and ORB-SLAM3 running on ROS and Jetson. The device would likely be Orin Nano or AGX Xavier but I'm flexible on this and will use ...
Alex Bausk's user avatar
0 votes
2 answers
32 views

Use of Nav2 Stack and Commander API without AMCL , with just odometry data

I want to test Nav2 for teach and repeat with just odometry data without building a map. Basically, I want to collect a series of waypoints indoors using odometry data and then start from same ...
user40071's user avatar
0 votes
1 answer
92 views

robot_localization no output (using only VO, Compass, and GPS)

I'm using robot_localization (ROS2 Humble on Ubuntu) for a boat integration and want to fuse my LiDAR odometry (ideally to be used more in the harbors etc) with GPS data (ideally to be used on open ...
LucasMS's user avatar
1 vote
1 answer
115 views

Understanding reprojection error / visual residual in ORB-SLAM3

I am trying to understand ORB-SLAM3 paper. It gives visual residual / reprojectio error equation as follows: $$r_{ij}=u_{ij}-\prod(T_{CB}T^{-1}_i\oplus x_j)$$ where, $r_{ij}$ is reprojection error ...
Mahesha999's user avatar
0 votes
2 answers
516 views

Marginalization vs Dropping states for sliding window VO

When doing fixed lag smoothing or Windowed Smoothing for visual odometry and map construction, how does marginaliztion differ from dropping past states? How does each work? I assumed fixed lag ...
FourierFlux's user avatar
1 vote
0 answers
415 views

How does IMU pre-integration work and how is it different from EKF?

My understanding is that IMU pre-integration is to get away from having to re-integrate the the IMU between key-frame intervals when doing bundle adjustment. The formulations I ave seen involve a ...
FourierFlux's user avatar
0 votes
2 answers
58 views

The choice of using quaternions and using gyro & accel separately in EKF

I am working on realising the self-navigation of a vehicle. I have already written an extended Kalman filter with a state vector using position, velocity, Euler angle, acceleration, and angular ...
chen_441's user avatar
0 votes
1 answer
451 views

What should I use for a Visual+IMU+GPS fusion? A Madgwick or a Kalman?

I am new to robotics, and recently I am involving in a sensor fusion task using visual input (binocular at present), an IMU, and a GPS module. I have searched for related journal papers for a ...
chen_441's user avatar
2 votes
0 answers
92 views

How does marginalization work in fixed lag smoothing?

I have read in SLAM papers talk about marginalization. I am confused about how this process works, why you do it and how it differs from global smoothing. In particular if you're interested in ...
FourierFlux's user avatar
1 vote
0 answers
151 views

Using an optical mouse sensor for odometry?

I'm trying to use a mouse sensor for odometry on my robot. Most datasheets I have found use SPI or SDIO interfaces for communicating but my microcontroller would require an I2C interface. Would it be ...
AleXutzZu's user avatar
5 votes
2 answers
368 views

Why do we need to know the translation between Camera and IMU?

In Visual Inertial Odometry, assuming the camera and the IMU are attached to the same rigid body, why isn't it enough to know just the relative rotation between the camera and the IMU? Why do we need ...
jordi's user avatar
  • 173
0 votes
0 answers
68 views

Stereo Bundle Adjustment

When doing stereo based visual odometry and bundle adjustment how does the stereo constraint get factored into the photometric error? Do you use the fact the second cameras location is known wrt the ...
FourierFlux's user avatar
0 votes
1 answer
77 views

Question about bundle adjustment

When doing bundle adjustment do landmarks gets optimized as stand alone variables or are they viewed as a function of the robots first position when they are detected?
FourierFlux's user avatar
0 votes
0 answers
21 views

What is Rotation when pose is looking back?

I've model a relative pose between two cameras. $T_0$ is origin and $T_1$ has the relative pose. The $Camera_0$ is facing a the map point $X$, and I can get a vector $v_0$ from $Camera_0$ toward $X$. ...
Chen OT's user avatar
  • 101
2 votes
2 answers
1k views

/rtabmap/rtabmap: Did not receive data since 5 seconds

trying to run RtabMap on my realsense-435 device. I've set up all the topics and made sure they are published and subscribed, nevertheless, RtabMap gives me this error: ...
mobiiin's user avatar
  • 61
0 votes
0 answers
293 views

Uncontrolled drift of Visual Inertial Odometry

I'm trying to use the VINS-Fusion package to obtain odometry for a quadcopter. The primary sensor is an Intel Realsense D435i. I've calibrated the camera and IMU extrinsics using Kalibr. IMU ...
Kaapeine's user avatar
1 vote
1 answer
2k views

How to loop over each timestep in rosbags using Python?

I am using rosbag api to record rgb, depth and imu data coming off a robot. For an offline Visual Odometry experiment, I am in need of synchronizing RGB data with the imu data at the correct timesteps....
Azmyin Md. Kamal's user avatar
0 votes
1 answer
75 views

How does baseline work with forward motion in Monocular Visual Odometry

In my computer vision class we are studying visual odometry. In this we calculate the Fundamental matrix using 2 frames from forward motion using the concept of stereo-vision. But in stereo vision the ...
sdhar's user avatar
  • 1
1 vote
3 answers
2k views

Difference between motion-only bundle adjustment and pose-graph optimization

I've been trying to figure out the difference between motion-only bundle adjustment and pose-graph optimization, when talking about systems that only use cameras to estimate motion between frames, but ...
indigoblue's user avatar
3 votes
1 answer
1k views

Calculate information matrix for graph slam

0 I am new to SLAM. I am working on graph slam where I need to do pose graph optimisation. For this requirement information matrix is required between two edges for which the transformation has ...
Rajat's user avatar
  • 31
0 votes
1 answer
187 views

Relative scale problem

I am doing Monocular Visual Odometry, and I have problem with relative scale. Most of the time its value is between 0.8-1.1, but sometimes it goes crazy and it has value 3,4 and once it had value 25. ...
Cluv's user avatar
  • 1
0 votes
0 answers
200 views

Pose-Graph Optimization in MATLAB does not give expected results

I am trying to optimize a pose graph I created in MATLAB using either the optimizePoses(viewSet)-function on the imageViewSet that I have or the ...
DocRobson's user avatar
4 votes
2 answers
1k views

What's the difference between factor graph optimization and bundle adjustment?

I see that in SLAM literature, factor graph optimization is frequently used. While in Structure from Motion (SfM) literature , they usually use bundle adjustment. What's the difference between the two ...
zhouch's user avatar
  • 41
2 votes
1 answer
710 views

Visual Odometry terminology: Scale, Relative scale, absolute scale

I'm watching a MOOC about Machine Vision for Robotics, but I really do not know the meaning of some vocabulary of this domain. For example, What does the professor mean when he says this: However, we ...
sci9's user avatar
  • 189
1 vote
1 answer
272 views

Mono VIO vs. Stereo-Camera to recover Depth Information

I have a question. I have found some papers, where they use a Mono-VIO to recover depth of a scene. My question is: Suppose I have a robot arm and attach a mono-VIO system to it. Then I move this arm ...
user27536's user avatar
0 votes
1 answer
18 views

What are the parameters that I need to consider when figuring out the horizontal viewing distance of a camera mounted overhead for effective tracking?

I am currently working on developing a hybrid Indoor Positioning system where images from an overhead camera will be used to identify and track people. I am new to the field of visual tracking and a ...
Azmyin Md. Kamal's user avatar
0 votes
1 answer
213 views

How can I calibrate 3 cameras without knowing global pose of the object & camera locations? How can I find the pose of each camera wrt the first one?

I have camera feed (in the form of RGB images) from 3 cameras with partially overlapping Field-of-view i.e. for the time stamp 0 to 100, I have total 300 frames or say synchronized 100 RGB frames for ...
Raj's user avatar
  • 15
1 vote
0 answers
2k views

What does the normalized image coordinates imply?

In VSLAM or visual odometry, we use a camera matrix P to transform 3D scene points to 2D image points. When using homogeneous representation, we may choose the image coordinates as the normalized ...
lzx071021's user avatar
1 vote
1 answer
193 views

How is the depth estimation done in DTAM / LSD-SLAM (direct VSLAM)?

I know that DTAM and LSD-SLAM both employ the photometric error between two keyframes to estimate the image depth. But I don't know what the photometric error describes precisely. In the DTAM paper, I ...
fraukejr's user avatar
0 votes
2 answers
322 views

Custom implementation of robot_localization package

I plan to implement a sensor fusion of IMU + Visual odometry using an EKF. I came across the excellent robot_localization package which does pretty much all that I want. However, I need to use perform ...
OlorinIstari's user avatar
0 votes
1 answer
396 views

How to find visual odometry by video from cellphone camera mounted on robot?

I am writing codes in python for visual odometry from single camera. I used cell phone camera for testing. I took video of 35 sec with camera moving. I used code below to read first image ...
Vinitha Patil's user avatar
0 votes
1 answer
8 views

ZED VO vs Rtabmap VO

I'm using ZED cameras and also running Rtabmap. Both systems have visual odom available. What are the pros and cons of using ZED VO instead of rtabmap? Do I get gains from using one over the other? ...
user avatar
0 votes
1 answer
5 views

Rtab map stereo visual odometry pose scale?

Hello I'm kind of new to ROS, I'm trying to use the stereo visual odometry of RTAB map to produce odometry for localization, I have tried it on gazebo, the pose in the odom topic is translated in ...
user avatar
1 vote
0 answers
202 views

How does inverse compositional Lucas–Kanade algorithm work?

I am trying to understand the Lucas–Kanade algorithm since I am reading a paper in which is applied the inverse compositional Lucas–Kanade algorithm, but in order to understand the latter I have to ...
J.D.'s user avatar
  • 479
2 votes
1 answer
94 views

Problem understanding a paper about visual odometry

I am reading the following paper: SVO: Semi-Direct Visual Odometry for Monocular and Multi-Camera Systems , and I am having some problem understanding some concepts. Before starting I have to say ...
J.D.'s user avatar
  • 479
1 vote
0 answers
413 views

What is the definition of the phrase "ego robot"?

What does the phrase "ego robot" mean? I see it used in the context of multi robot systems like in the paper Game Theoretic Motion Planning for Multi-robot Racing by Zijian Wang, Riccardo Spica & ...
Ahmed Essam El Fakharany's user avatar
0 votes
1 answer
132 views

Planar Robot Boundary Detection

I am tasked with building a robot that needs to localise and navigate itself on a rectangular surface (like a large desk). The rectangle's shorter sides will be marked with a red tape (or with two ...
SupanovaZA's user avatar
1 vote
1 answer
222 views

How to derive the camera trajectory from ICP

This may be a very simple question so please bear with me... Suppose I have a stationary object and point clouds, $n$ $(x,y,z)$ points, of that object taken by a moving camera at time steps $t_i$, $...
Abe's user avatar
  • 113
0 votes
1 answer
185 views

SLAM techniques based on contact, odometry and one front camera

Consider a mobile robot provided with a contact sensor that randomly travels in a closed environment, changing direction every time an obstacle is encountered. Is it possible to reconstruct the 2D map ...
firion's user avatar
  • 111
1 vote
1 answer
231 views

How to plot the 3D camera trajectory from a VSLAM output

I am totally new to VSLAM algorithms and would want to plot the path followed by the moving camera. I am using the open source implementation of ORB_SLAM2 for a rgb-d camera on benchmark dataset. The ...
rotating_image's user avatar
4 votes
1 answer
163 views

Performing Image alignment using pyramid levels with semi dense depth

To gain some confidence, I want to implement the camera tracking (optimization problem) discussed in Semi Dense Visual Odometry for a monocular cameraJ Engel, J Strum, D Cremers $$E(\xi) = \underset{i}...
vyi's user avatar
  • 215
3 votes
1 answer
396 views

Why do strong rotations affect Monocular Vision based Visual Odometry?

In context of the paper Semi Dense Visual Odometry for a Monocular Camera J Engel, J Sturms, D Cremers At page 7, last paragraph the author writes The achieved tracking accuracy for two feasible ...
vyi's user avatar
  • 215
2 votes
1 answer
346 views

How to publish odometry from 3 wheeled omnidirectional robot?

I'm new to ROS and robotics and I'm trying to implement the ROS navigation stack in a 3 wheeled omnidirectional robot. I already made the map using RTABMap but now I'm stuck in the 'Publishing ...
Vahzahhun's user avatar
0 votes
1 answer
35 views

Improving odometry from RTAB mapping

I'm using real-time appearance-based mapping (rtabmap_ros) to perform SLAM with a first-generation Kinect RGBD sensor, and this is working fairly well. However, ...
user avatar
1 vote
0 answers
89 views

Map initialization problem in Mono SLAM

I'm reading and trying to implement the paper Monofusion(V. Pradeep, C. Rhemann, S. Izadi, C. Zach, M. Bleyer and S. Bathiche, "MonoFusion: Real-time 3D reconstruction of small scenes with a single ...
kju's user avatar
  • 11
0 votes
1 answer
83 views

Which algorithms to locate a static 3D object relative to a moving camera/IMU?

I am using typical setup with camera and IMU as found on a smartphone. Using this, I would like to estimate the relative pose between the camera and an object (for simplicity, let's say a cube). The ...
Daniel Eckert's user avatar
5 votes
1 answer
91 views

Accuracy of monocular visual-inertial odometry

I am currently considering to use monocular visual-inertial odometry (VIO) to localize a smartphone relative to a known object. Now, what I would like to understand is, what kind of accuracy I can ...
Daniel Eckert's user avatar
2 votes
2 answers
191 views

Is pose estimation using images necessary in visual-inertial SLAM

In visual SLAM, pose estimation is performed between two adjacent frames or keyframes using feature detection and pose estitmation from corresponding features. However in visual-inertial SLAM, pose ...
Jogging Song's user avatar
0 votes
1 answer
8 views

robot_pose_ekf visual odometry

Hi all, I am working on a project which runs SLAM (RTAB map) on an autonomous land rover. The rover is equipped with a real sense D415 camera, a wheel odometry system and Pixhawk. We have been using ...
user avatar