Speech to sign language translation system for Spanish

San Segundo Hernández, Rubén; Barra Chicote, Roberto; Córdoba Herralde, Ricardo de; D'haro Enríquez, Luis Fernando; Fernández Martínez, Fernando; Ferreiros López, Javier; Lucas Cuesta, Juan Manuel; Macías Guarasa, Javier; Montero Martínez, Juan Manuel y Pardo Muñoz, José Manuel (2008). Speech to sign language translation system for Spanish. "Speech Communication", v. 50 (n. 11); pp. 1009-1020. ISSN 0167-6393. https://doi.org/10.1016/j.specom.2008.02.001.

Descripción

Título: Speech to sign language translation system for Spanish
Autor/es:
  • San Segundo Hernández, Rubén
  • Barra Chicote, Roberto
  • Córdoba Herralde, Ricardo de
  • D'haro Enríquez, Luis Fernando
  • Fernández Martínez, Fernando
  • Ferreiros López, Javier
  • Lucas Cuesta, Juan Manuel
  • Macías Guarasa, Javier
  • Montero Martínez, Juan Manuel
  • Pardo Muñoz, José Manuel
Tipo de Documento: Artículo
Título de Revista/Publicación: Speech Communication
Fecha: Noviembre 2008
Volumen: 50
Materias:
Palabras Clave Informales: Spanish Sign Language (LSE), Spoken language translation, Sign animation.
Escuela: E.T.S.I. Telecomunicación (UPM)
Departamento: Ingeniería Electrónica
Licencias Creative Commons: Reconocimiento - Sin obra derivada - No comercial

Texto completo

[img]
Vista Previa
PDF (Document Portable Format) - Se necesita un visor de ficheros PDF, como GSview, Xpdf o Adobe Acrobat Reader
Descargar (3MB) | Vista Previa

Resumen

This paper describes the development of and the first experiments in a Spanish to sign language translation system in a real domain. The developed system focuses on the sentences spoken by an official when assisting people applying for, or renewing their Identity Card. The system translates official explanations into Spanish Sign Language (LSE: Lengua de Signos Espan¿ola) for Deaf people. The translation system is made up of a speech recognizer (for decoding the spoken utterance into a word sequence), a natural language translator (for converting a word sequence into a sequence of signs belonging to the sign language), and a 3D avatar animation module (for playing back the hand movements). Two proposals for natural language translation have been evaluated: a rule-based translation module (that computes sign confidence measures from the word confidence measures obtained in the speech recognition module) and a statistical translation module (in this case, parallel corpora were used for training the statistical model). The best configuration reported 31.6% SER (Sign Error Rate) and 0.5780 BLEU (BiLingual Evaluation Understudy). The paper also describes the eSIGN 3D avatar animation module (considering the sign confidence), and the limitations found when implementing a strategy for reducing the delay between the spoken utterance and the sign sequence animation.

Más información

ID de Registro: 2139
Identificador DC: http://oa.upm.es/2139/
Identificador OAI: oai:oa.upm.es:2139
Identificador DOI: 10.1016/j.specom.2008.02.001
URL Oficial: http://www.sciencedirect.com/science/journal/01676393
Depositado por: Memoria Investigacion
Depositado el: 02 Feb 2010 11:49
Ultima Modificación: 29 Sep 2014 18:23
  • Open Access
  • Open Access
  • Sherpa-Romeo
    Compruebe si la revista anglosajona en la que ha publicado un artículo permite también su publicación en abierto.
  • Dulcinea
    Compruebe si la revista española en la que ha publicado un artículo permite también su publicación en abierto.
  • Recolecta
  • e-ciencia
  • Observatorio I+D+i UPM
  • OpenCourseWare UPM