I am trying to design a robotic hand that is able to adaptively grasp unfamiliar objects. I am initially thinking that using OpenCV for pose estimation might make doing so easier.

Assuming that I am able to successfully estimate the pose of an object, how might I go about finding the initial contact points for each finger on the object? (or how does each finger know where to go in order to grasp the object?)


This is an excellent question that is currently being explored directly by field experts. Here are some of the latest publications that consider the problem you are encountering:

The first item here considers an interesting application of supervised learning. Since we can't rely on our object detection algorithm to classify our object, we can instead seek to learn high probability grasping points.

The other three papers I included may simply be of additional interest, but I won't get into their details here. I do strongly recommend giving them a read.

If you provide more details on your specific problem (i.e. where the camera is in relation to the hand, what is the view angle available by the camera, etc.) and let us know what you have tried/considered in detail, then I would be happy to give the specific problem a go and edit my answer accordingly (This likely should have been a comment, but I don't have that privilege yet).


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.