D-CIS Publication Database

Publication

Type of publication:Inproceedings
Entered by:SF
TitleA context aware and user tailored multimodal information generation in a multimodal HCI framework
Bibtex cite ID
Booktitle Euromedia'2008
Year published 2008
Pages 95-103
Publisher Eurosis
Keywords Multimodal fission output,natural language generation,visual-language generation.
Abstract
In recent years, we have developed a framework of humancomputer interaction that offers recognition of various communication modalities including speech, lip movement, facial expression, handwriting and drawing, body gesture, text and visual symbols. The framework allows the rapid construction of a multimodal, multi-devices, and multi-user communication system within crisis management. This paper reports the multimodal information presentation module combining language, speech, visual-language and graphics, which can be used in isolation, but also as part of the framework. It provides a communication channel between the system and users with different communication devices. The module is able to specify and produce context-sensitive and user-tailored output. By the employment of ontology, it receives the system�s view about the world and dialogue actions from a dialogue manager and generates appropriate multimodal responses.
Authors
Fitrianie, Siska
Tatomir, Iulia
Rothkrantz, Leon
Topics
=SEE CLASSIFICATION DIFFERENCE FROM OTHERS=
BibTeXBibTeX
RISRIS
Attachments
 
Total mark: 5