Robot Arm

Movies
Project Description
Word Recognition System
Control System
Vision System
Obstacle Avoidance

 

Movies and Pictures

 


To see the Robot Arm in operation, click one of the links from the table below.

Robot Arm Videos
128kbps
64kbps
28kbps

 

Project Description

The application aims at the development of an environment which integrates several intelligent systems. Four main sub-systems work cooperatively  to perform the desired task: a robust speak-independent word recognition,  computer vision,  robot arm  trajectory  planner  with obstacle avoidance and a multivariable self-tuning control.  The goal of this application is to allow any operator to command by voice a SCARA  robot arm  to pick up a specific tool placed on a table among others tools and obstacles avoiding any obstacles which may collide with its grip. 

Word Recognition System

The speech recognition sub-system is word orientated and speaker independent. A Recursive Neural Network architecture is used to recognize trained and untrained  words. The network is totally interconnected and a backpropagation trainining algorithm is used. The advantage of the recursive neural network is its ability to avoid the generation of "false alarms". In fact, the network seems to be able to build in more knowledge on the internal syllables of the word.

Vision System

The robot arm scans its work area in a sequence of steps by performing a rotation of the robot arm shoulder. At each step the image captured by a CCD camera is analyzed. The object recognition sub-system is based on the extraction of geometric attributes from the object images. It's robust in relation of illumination conditions and the system recognizes the object and its rotation angle with one degree of precision.  

Control System

A multivariable self-tuning control algorithm is responsible for making the robot arm grip precisely track the pre-defined trajectory. Self-tuning is an attractive approach for the design  of robot arm controllers due to its ability to cope with the non-linearities of the robot arm dynamics. In addition, with the use of the multivariable algorithms, the interaction forces among the robot arm joints are taken into consideration and a better model of the robot arm dynamics is achieved. 

Obstacle Avoidance System

During the work area  scanning process, all the detected obstacles are memorized  and this information is recovered at each new movement in order to planning a suitable  path which the robot arm grip should follow to reach a specific goal.  The trajectory to be followed by the robot arm under self-tuning control is determined using either Visibility Graphs or Potential Field techniques.