Questions tagged [sensor-fusion]
Sensor fusion is a process by which data from several different sensors are "fused" to compute something more than could be determined by any one sensor alone.
170
questions
0
votes
0
answers
12
views
How to fuse two costmaps (laser and visual) together and use them with move_base?
I have a simulation with a Turtlebot3 where I use the Gazebo RGB camera plugin to retrieve visual information about the environment. My goal is to record an RGB image, run inference to detect grass ...
- 1
0
votes
0
answers
30
views
robot_localization getting nan fusing odometry
I am trying to fuse odometry and imu data with the robot_localization for an omnidirectional robot. I always get the error:
...
- 17
0
votes
1
answer
30
views
Random initial Orientation Madgwick filter
(ROS2 Humble) I am using the Madgwick filter to get an estimate of the imu orientation from linear accelerations and angular velocities and then I fuse the orientation (yaw) with the robot wheel ...
- 13
0
votes
1
answer
48
views
How to combine ORB-SLAM3 with robot_localization
I'm using robot_localization package to estimate the pose of my robot wrt odom frame. I managed to fuse both data coming from my wheel odometry and IMU.
My robot has a fisheye camera and I have used ...
0
votes
2
answers
35
views
How do I handle map/odom transforms if I want to use robot_localization as well as slam_toolbox?
I'm trying to use slam_toolbox (2d LIDAR) in conjunction with robot_localization (IMU + Wheel Odom). So far my best idea for managing the frames is as shown in the pictures below. However, this ...
- 51
0
votes
0
answers
12
views
Robot_pose_ekf not publishing transformation of odom_combined frame
I am using the ROS melodic and trying to fuse the odom and IMU using robot_pose_ekf package
Here is my code
...
0
votes
0
answers
39
views
2D LIDAR and Camera D435i Fusion
I have a question about data fusion. Can I use the tf2 tool to fuse LIDAR and camera data ?
1
vote
1
answer
134
views
Sensor fusion in ROS2: 360 lidar + depth camera
I recently purchased an OAKD-Lite camera and I'm trying to integrate it into my ROS 2-operated robot to detect obstacles that are lower than the 360lidar, preventing collisions. So far, I've succeeded ...
- 11
1
vote
1
answer
60
views
LiDAR and Camera Fusion
Can anyone tell me about how can I fuse LiDAR and Camera data in a way that the PointClouds are colorised based upon the Image color.For example (in Gazebo Simulation) in an autonomous vehicle there ...
- 45
1
vote
1
answer
71
views
Pointcloud2 dropping message
My robot consists of an IMU, a LiDAR and a TOF sensor(in form of depth camera), which are all connected to the base_link. I want to visualize all the sensor data and the end goal is to achieve sensor ...
- 13
0
votes
1
answer
38
views
pointcloud fusion of 4 intelrealsese depth camera
I'm having a robot that has intelrealsense 435d depth camera on all the four sides.How can i fuse pointcloud data from each depth camera to make a 360deg pointcloud of the environment around the robot....
1
vote
1
answer
49
views
sensor fusion with many sensors and different update rates
It seems like there is no shortage of sensor fusion libraries that can fuse basic common odometric sensors like IMUs and GPS, but none that can fuse from an arbitrary number of sources, especially ...
- 111
1
vote
0
answers
48
views
Running SLAM without encoders
I am new to the concept of SLAM and mapping, however I ordered a robot vehicle platform which I bought here so that I can explore and practice it on the platform. I also got a 2d liDAR, depth camera ...
0
votes
2
answers
74
views
/odometry/filtered output arrow not showing in rviz
I am using a VM Box to work on sensor fusion for turtlebot3 on ROS2-Humble. When i run my turltebot launch file and ekf launch file..it runs...and when I launch rviz to visualize the arrows from both ...
- 11
0
votes
0
answers
45
views
robot_localization performance with two IMU+GPS combinations
I use the same config file to compare the performance of two different IMU+GPS fusion for the same experiments. The performance of one pair of the IMU+GPS sensor fusion performs great when ...
1
vote
0
answers
37
views
Kalman filter for heading estimation provides oscillating output
I am designing a Kalman filter for heading estimation in 2D using magnetic compass, gyroscope and wheel encoder. The system state is
$ X = [h, w] $ and the measurements are $Z = [h_{mag}, g_z,d_h]$, ...
- 111
0
votes
0
answers
22
views
Aligning Point Cloud with IMU Heading in Sensor Fusion Setup
I'm currently working on a sensor fusion setup involving an IMU that provides absolute orientation with respect to True North and an Ouster Lidar generating PointCloud2 data. The IMU publishes to the ...
0
votes
1
answer
56
views
How odometry data generated from IMU and motor encoders
I am working on an autonomous robot that needs nav_msgs/Odometry to work with ros navigation stack
nav_msgs/Odometry
...
- 7
0
votes
0
answers
46
views
Projection of boundig box from lidar frame to camera image
i am trying to project the bounding box in 3d from lidar frame to camera image in 2d. I am doing this work in ignition-gazebo simulation. so, basically there is no real hardware except my pc. there is ...
- 96
1
vote
1
answer
298
views
sensor fusion of lidar and camera detection
I am trying to achieve sensor fusion between two sensors(camera and lidar). I have two separate node(one is publishing detection results using camera, and other is using lidar and they both are ...
- 96
0
votes
0
answers
39
views
What are some resources to learn Probability, Statistics and Stochastic Processes so I can understand Optimal State Estimation?
I went to grad school for Mechanical Engineering almost 7 years ago, where I avoided any probability/stats coursework like plague and stuck to linear algebra and differential equations for my math ...
- 1
0
votes
1
answer
64
views
Fusing pressure/depth sensor/IMU for Nav2
Can I fuse a depth sensor or a pressure sensor's readings with imu to publish /odom (odometry) in Nav2 stack? I don't have wheel encoders in my robot, and I don't know what to use. Any resources?
0
votes
0
answers
177
views
Finding North direction from magnetometer and accelerometer fusion
I was understanding accelerometer and gyro sensor fusion from this video. At time 3:56, Brian says:
To get north, we need to do some cross products. We can start with our measured mag (magnetometer) ...
- 151
0
votes
0
answers
74
views
robot_localization package position output is the same as input absolute pose
Hello my question is whether this type of output is a proper output? I fuse absolute pose from slam and fuse linear velocity from wheel odometry, but the filter output position data is the same as the ...
- 1
1
vote
1
answer
151
views
Understanding reprojection error / visual residual in ORB-SLAM3
I am trying to understand ORB-SLAM3 paper. It gives visual residual / reprojectio error equation as follows:
$$r_{ij}=u_{ij}-\prod(T_{CB}T^{-1}_i\oplus x_j)$$
where,
$r_{ij}$ is reprojection error ...
- 151
0
votes
1
answer
63
views
UM7 Orientation Sensor IMU not Publishing at 255 Hz. It is around 20-45 Hz, How to fix?
I really want to ask you about the UM7 Orientation Sensor we purchased. We want so much to use the UM7 in our research.
As it is mentioned on the Pololu website, the IMU transmits data using human-...
1
vote
1
answer
179
views
Odometry jumping IMU/GPS fusion robot_localization
I am trying to fuse IMU and GPS with the help of robot_localization pkg. I might also fuse encoder data in the future. I get this weird jumping in odometry in rviz. I get that GPS is published every ...
- 11
1
vote
1
answer
509
views
Differential Drive Controller 'enable_odom_tf: false' doesn't work
I have 2 wheels diff_drive robot that use diff_drive_controller from ros2_control,so this first work as diff_cont (diff_drive_controller name) publish transform from odom to base_link on /tf.
Now I ...
- 13
0
votes
1
answer
435
views
Sensor fusion with ros2_control
I built 4 wheels robot that uses diff_driver_cont in ros2_control, the controller get encoders reading to calculate interface status and interface command.
later, I used robot_localization package to ...
0
votes
0
answers
292
views
Estimating gyroscope bias for attitude IMU sensor fusion with an unscented Kalman filter
I'm trying to use a UKF as the attitude estimator for a drone with just a gyroscope and accelerometer as sensors. So far, it's going well and after some tuning appears to perform basically as well as ...
- 101
0
votes
1
answer
693
views
Combining Multiple Sensor Data for Costmap Generation in NAV2
I am currently developing an off-road navigation system using NAV2 and various sensing modalities. Our setup includes two 3D Velodyne Lidars and a 2D SICK Lidar, each mounted at different orientations ...
- 273
0
votes
1
answer
163
views
What is the most suitable sensor fusion filter for my application?
I am currently working on a hobby project involving a device that will be attached to a golf driver club. Its primary function is to continuously measure the angles (pitch, roll, yaw) throughout the ...
- 3
0
votes
1
answer
21
views
External camera as SLAM sensor/input for navigation
Hi everyone!
If this question has been asked somewhere else, please point me there.
Consider the following challenge: onboard navigation is not accurate enough.
We'd like to enhance it using outboard ...
Theodoro Cardoso
0
votes
2
answers
241
views
Odometry into EKF for localization
I want to fuse a Lidar-Odometry into my EKF where I'm already using encoder, IMU, GPS. The odometry has as output a delta pose, how to put that into the filter? How to deal with the covariances?
1
vote
0
answers
57
views
Compensate tractor's (vehicle's) tilts in the GNSS-IMU based system
I have the following setup: a tractor with a dual band antenna (from ublox) installed on the vehicle's symmetry axis on the roof (h=3m), approx. 1m ahead of the center of the rear axis (which I ...
- 11
0
votes
2
answers
59
views
The choice of using quaternions and using gyro & accel separately in EKF
I am working on realising the self-navigation of a vehicle.
I have already written an extended Kalman filter with a state vector using position, velocity, Euler angle, acceleration, and angular ...
- 5
0
votes
0
answers
27
views
Do MEMS or optical gyroscope record Earth's rotational and revolutional angular velocities?
I am using a 3 axis gyroscope (Android device) to record angular velocities using a sensor data logger application.
When the device is placed stationary, the gyroscope recorded the following values:
...
- 43
0
votes
1
answer
533
views
What should I use for a Visual+IMU+GPS fusion? A Madgwick or a Kalman?
I am new to robotics, and recently I am involving in a sensor fusion task using visual input (binocular at present), an IMU, and a GPS module. I have searched for related journal papers for a ...
- 5
1
vote
2
answers
655
views
How to deal with asynchronous samples in a kalman filter framework multi-sensor fusion?
I have setup a sensor fusion problem to estimate a classical 2d position + orientation of a wheeled mobile robot in an embedded environment.
Sensor measurements include:
IMU (6axis accl+gyro) @ 40Hz
...
- 271
0
votes
1
answer
206
views
accelerometer and gyroscope fusion using extended kalman filter
I'm working on my graduation project which is characterizing human body posture. I'm using IMU so I get measurements from the accelerometer and gyroscope and I'm wealing to fuse these two filters so I ...
1
vote
1
answer
182
views
Rotate sensor frame to body frame
I'm working with a lsm303agr from ST. Here is the frame attached to the chip
Here is the body frame
So I have some doubts about the rotations, before to fuse data ...
- 173
0
votes
1
answer
943
views
odom frame keeps moving in ROS GPS robot_localization
I am using two instances of ROS robot_localization package to get the local and global odometry. In the local one, I am fusing IMU and twist messages. It is working fine. But when I use the second ...
1
vote
1
answer
195
views
Questions about sensor fusion with Lidar - Extended Kalman Filter
I am attempting to teach myself sensor fusion as I suspect I'll need to do this down the road with lidar and some other sensors. In all my research so far it sounds like a version of the extended ...
- 111
0
votes
0
answers
75
views
Nonlinear continuous system function of IMU sensor fusion robot
For my robotics course I have to implement the nonlinear continuous system function for a mobile robot that is equipped with a GPS receiver and an IMU consisting of an accelerometer and a gyroscope. ...
- 1
1
vote
2
answers
392
views
SLAM with multiple cameras and asynchronous sensors
I'm pretty sure this is the right place for this question, but if not, please point me in the right direction!
Basically, I would like to know how do SLAM using multiple cameras and sensors that are ...
1
vote
1
answer
114
views
Will there be any interference when distance sensors facing each other?
I'm working a robot racing project using small RC toy cars on a premade track and a main goal for the robots to do is to be able to avoid hitting the wall and the racing opponents. Avoiding wall is no ...
- 11
4
votes
0
answers
624
views
How to fuse IMU with encoders in EKF
Background
I have a car-like mobile robot (4 wheels, where the forward ones are steering wheels) and I want to estimate its pose and velocity assuming 2D planar motion. I'm trying to solve this ...
0
votes
1
answer
206
views
Get rotation of IMU data snapshot
I received snippets of data of an IMU with 9 DoF in motion. For these I wanted to get their rotation by angles relative to the earth frame. My goal is to receive ...
0
votes
1
answer
35
views
Include information on the environment in map-aware particle filter
I have a robot equipped with some sensors for estimating the movement in a 2D environment (IMU, odometer). The robot is free to move within an area delimited by some walls. The map of the environment (...
- 111
1
vote
1
answer
132
views
IMU Senosr fusion algorithm of gyro and accelerometer during acceleration of vehicle
Hello so we have a car with 10 IMUs mounted at different locations of the car and the idea is the measure the centripetal force at each location of the car and compare it to each other. We also need ...
