7
$\begingroup$

I am not sure if this has been tried before but I am trying to use Kinect and detect gestures made by the Nao robot.

I have made a Kinect application, a gesture based picture viewer and it detects humans fine(Obviously it does!) What I wanted to try was (lazy as I am), to see if I could use some (say, voice) command to tell the Nao to do a Swipe Right gesture and have my application identify that gesture. The Nao can easily identify my command and do some gesture. The problem however is, when I put the Nao in front of the Kinect sensor, the Kinect does not track it.

What I want to know is, are there some basics behind Kinect's human body motion tracking that essentially fails when a robot is placed in front of it instead of a human?

PS: I have kept the Nao at the right distance from the sensor. I have also checked if the entire robot is in the field of view of the sensor.

EDIT: This has been posted on stackoverflow and on msdn by me so as to target a large audience as this problem has not been encountered by anyone in the past.

Improve this question
$\endgroup$
4
  • $\begingroup$ I've found no reference to anyone trying this, mostly because the search results get buried within people using the kinect to track human gestures for the Nao to copy. BUt as an aside, while cross-posting to no SE-sites is not explicitly discouraged (as far as I am aware), it would be nice to mention this and link to the other post so that posters here are also aware of the suggestions you already got. $\endgroup$
    – ThomasH
    Commented Oct 26, 2012 at 8:55
  • $\begingroup$ I posted this at the same time yesterday. I am editing my post right now to make sure all the cross posts I made are linked. $\endgroup$
    – Karan Thakkar
    Commented Oct 26, 2012 at 10:46
  • $\begingroup$ Note that generally speaking multi-posts are frowned upon. If this were done outside of private beta it would probably be stomped on as sooon as someone noticed the multi-post. $\endgroup$
    – Mark Booth
    Commented Oct 26, 2012 at 17:14
  • $\begingroup$ I know that which was why I wasnt sure if I should share those links or whether I should multi-post. $\endgroup$
    – Karan Thakkar
    Commented Oct 27, 2012 at 12:34

1 Answer 1

Reset to default
5
$\begingroup$

You should read the paper published by Microsoft research on the actual algorithm behind the human motion tracking.

Real-Time Human Pose Recognition in Parts from a Single Depth Image, Shotton et. al, http://research.microsoft.com/apps/pubs/default.aspx?id=145347

It relies on large labeled training data from the human body. That is why the Nao cannot just be tracked with the same method out of the box. To achieve that, you would need to re-train the algorithm with labeled data from the Nao in different poses.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.