The integration of contactless static pose recognition and dynamic hand motion tracking control system for industrial human and robot collaboration

Author： Tang Gilbert Asif Seemal Webb Phil

Publisher： Emerald Group Publishing Ltd

E-ISSN： 1758-5791|42|5|416-428

ISSN： 0143-991X

Source： Industrial Robot: An International Journal, Vol.42, Iss.5, 2015-08, pp. : 416-428

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Previous Menu Next

Abstract

<title content-type="abstract-heading">Purpose</title>– The purpose of this paper is to describe the integration of a gesture control system for industrial collaborative robot. Human and robot collaborative systems can be a viable manufacturing solution, but efficient control and communication are required for operations to be carried out effectively and safely.<title content-type="abstract-heading">Design/methodology/approach</title>– The integrated system consists of facial recognition, static pose recognition and dynamic hand motion tracking. Each sub-system has been tested in isolation before integration and demonstration of a sample task.<title content-type="abstract-heading">Findings</title>– It is demonstrated that the combination of multiple gesture control methods can increase its potential applications for industrial robots.<title content-type="abstract-heading">Originality/value</title>– The novelty of the system is the combination of a dual gesture controls method which allows operators to command an industrial robot by posing hand gestures as well as control the robot motion by moving one of their hands in front of the sensor. A facial verification system is integrated to improve the robustness, reliability and security of the control system which also allows assignment of permission levels to different users.