Please login first

A Visuo-Haptic Framework for Object Recognition Inspired from human tactile perception
Ghazal Rouhafzay * , Ana-Maria Cretu
1  Department of systems and computer engineering, Carleton University


This paper addresses the issue of robotic haptic exploration of 3D objects using an enhanced model of visual attention where the latter is applied to obtain a sequence of eye fixations on the surface of objects guiding the haptic exploratory procedure. According to psychological studies, somatosensory data resulted as a response to surface changes sensed by human skin is used in combination with kinesthetic cues from muscles and tendons to recognize object. Accordingly, a series of sequential tactile images are obtained for each object from various viewpoint during an exploration process. We take advantage of the contourlet transform to extract several features from each tactile image whose dimensionality is reduced to one using a Self Organizing Map. Through this process, a numerical sequence is obtained for each exploration. Similar sequences are then grouped in clusters whose labels are used as features for a classification algorithm. In addition to this somatosensory feature, other kinesthetic inputs including the probing locations and the angle of the sensor surface with respect to the object, in consecutive contacts are added as features and further used for the purpose of object recognition. The proposed framework is applied to a set of four virtual objects and a virtual force sensing resistor array (FSR) is used to capture tactile (haptic) imprints. Trained classifiers are finally tested to recognize data from new objects of same categories.

Keywords: Haptic exploration; Visual attention; Visuo-Haptic interaction; Object recognition
Comments on this paper
Alivina Jocalke
I like this contextual Education since this examination can likewise be applied to a wide scope of various situations or different applications (e.g., pharmacological medication design)are considered. Here dissertation writers for hire for you to get help with thesis online. This data is pertinent for the advancement of examination frameworks for myocardial disappointment conclusion dependent on cTnI identification.