A survey on mouth modeling and analysis for Sign Language recognition

File Description SizeFormat 
antonakos2015survey.pdfAccepted version3.47 MBAdobe PDFView/Open
Title: A survey on mouth modeling and analysis for Sign Language recognition
Authors: Antonakos, E
Roussos, A
Zafeiriou, S
Item Type: Conference Paper
Abstract: © 2015 IEEE.Around 70 million Deaf worldwide use Sign Languages (SLs) as their native languages. At the same time, they have limited reading/writing skills in the spoken language. This puts them at a severe disadvantage in many contexts, including education, work, usage of computers and the Internet. Automatic Sign Language Recognition (ASLR) can support the Deaf in many ways, e.g. by enabling the development of systems for Human-Computer Interaction in SL and translation between sign and spoken language. Research in ASLR usually revolves around automatic understanding of manual signs. Recently, ASLR research community has started to appreciate the importance of non-manuals, since they are related to the lexical meaning of a sign, the syntax and the prosody. Nonmanuals include body and head pose, movement of the eyebrows and the eyes, as well as blinks and squints. Arguably, the mouth is one of the most involved parts of the face in non-manuals. Mouth actions related to ASLR can be either mouthings, i.e. visual syllables with the mouth while signing, or non-verbal mouth gestures. Both are very important in ASLR. In this paper, we present the first survey on mouth non-manuals in ASLR. We start by showing why mouth motion is important in SL and the relevant techniques that exist within ASLR. Since limited research has been conducted regarding automatic analysis of mouth motion in the context of ALSR, we proceed by surveying relevant techniques from the areas of automatic mouth expression and visual speech recognition which can be applied to the task. Finally, we conclude by presenting the challenges and potentials of automatic analysis of mouth motion in the context of ASLR.
Issue Date: 17-Jul-2015
Date of Acceptance: 4-May-2015
URI: http://hdl.handle.net/10044/1/31945
DOI: https://dx.doi.org/10.1109/FG.2015.7163162
ISBN: 9781479960262
Publisher: IEEE
Start Page: 1
End Page: 7
Journal / Book Title: 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition 2015
Copyright Statement: © 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor/Funder: Engineering & Physical Science Research Council (EPSRC)
Engineering & Physical Science Research Council (EPSRC)
Funder's Grant Number: EP/J017787/1
EP/L026813/1
Conference Name: FG 2015
Publication Status: Published
Start Date: 2015-05-04
Finish Date: 2015-05-08
Conference Place: Ljubljana
Appears in Collections:Faculty of Engineering
Computing



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commonsx