Gesture recognition using a depth camera for human robot collaboration on assembly line

Abstract : We present a framework and preliminary experimental results for technical gestures recognition using a RGB-D camera. We have studied a collaborative task between a robot and an operator: the assembly of a motor hoses. The goal is to enable the robot to understand which task has just been executed by a human operator in order to anticipate on his actions, to adapt his speed and react properly if an unusual event occurs. The depth camera is placed above the operator, to minimize the possible occlusion on an assembly line, and we track the head and the hands of the operator using the geodesic distance between the head and the pixels of his torso. To describe his movements we used the shape of the shortest routes joining the head and the hands. We then used a discreet HMM to learn and recognize five gestures performed during the motor hoses assembly. By using gesture from the same operator for the learning and the recognition, we reach a good recognition rate of 93%. These results are encouraging and ongoing work will lead us to experiment our set up on a larger pool of operators and recognize the gesture in real time.
Type de document :
Article dans une revue
Procedia Manufacturing, 2015, 3, pp.518-525. 〈10.1016/j.promfg.2015.07.216〉
Liste complète des métadonnées

Littérature citée [28 références]  Voir  Masquer  Télécharger

https://hal-mines-paristech.archives-ouvertes.fr/hal-01256351
Contributeur : Fabien Moutarde <>
Soumis le : jeudi 14 janvier 2016 - 16:39:25
Dernière modification le : lundi 12 novembre 2018 - 10:56:42
Document(s) archivé(s) le : samedi 16 avril 2016 - 10:58:35

Fichier

GestRecog-HumanRobotCollab_Min...
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

Collections

Citation

Eva Coupeté, Fabien Moutarde, Sotiris Manitsaris. Gesture recognition using a depth camera for human robot collaboration on assembly line. Procedia Manufacturing, 2015, 3, pp.518-525. 〈10.1016/j.promfg.2015.07.216〉. 〈hal-01256351〉

Partager

Métriques

Consultations de la notice

186

Téléchargements de fichiers

197