I have a general question about the benefit of Hand-Eye calibration. I know that the Hand-Eye calibration can be done with many softawres by solving the AX=XB or AX=ZB equation. But my question is, how can I use this calibration information afterwards.
Say, I have an eye-to-hand calibration configuration where a 2D camera is stationary and a gripper is mounted on the robot arm. After doing the calibration I would have the trasformation from 2D Camera to the robot base. Now I would like to detect some object using the 2D Camera and send its position to the robot to grip it. But since I don't have the depth information for this object I wouldn't be able to calculate the 3d Position of the object in the robot base, even though I have the calibration information.
So for me it seems that using a single 2D camera isn't helpful to work with a robot arm. One should use a 3D camera to be able to extract useful information and then send them to the robot. Or am I missing something?