FPGA-based translation system from colombian sign language to text

Miniatura

Autores

Guerrero Balaguera, Juan David
Pérez Holguín, Wilson Javier

Director

Tipo de contenido

Artículo de revista

Idioma del documento

Español

Fecha de publicación

2015-01-01

Título de la revista

ISSN de la revista

Título del volumen

Documentos PDF

Resumen

This paper presents the development of a system aimed to facilitate the communication and interaction of people with severe hearing impairment with other people. The system employs artificial vision techniques to the recognition of static signs of Colombian Sign Language (LSC). The system has four stages: Image capture, preprocessing, feature extraction and recognition. The image is captured by a digital camera TRDB-D5M for Altera’s DE1 and DE2 development boards. In the preprocessing stage, the sign is extracted from the background of the image using the thresholding segmentation method; then, the segmented image is filtered using a morphological operation to remove the noise. The feature extraction stage is based on the creation of two vectors to characterize the shape of the hand used to make the sign. The recognition stage is made up a multilayer perceptron neural network (MLP), which functions as a classifier. The system was implemented in the Altera’s Cyclone II FPGA EP2C70F896C6 device and does not require the use of gloves or visual markers for its proper operation. The results show that the system is able to recognize all the 23 signs of the LSC with a recognition rate of 98.15 %.

Abstract

Descripción Física/Lógica/Digital

Palabras clave

Citación

Colecciones