Abstract: In crisis situations, decision-making capabilities rely on reports from all parties involved. For achieving the necessary capabilities of crisis technology, a communication-interface prototype representing concepts and ideas has been developed. To support language-independent communication and to reduce the ambiguity and multitude of semantic interpretation of human observers reports, the messages are constructed using a spatial arrangement of visual symbols. We developed a dedicated grammar to interpret and convert the visual language messages to (natural language) text and speech. The communication interface also provides an icon prediction to have faster interaction in next icon selections. The system processes the incoming messages to build a world model by the employment of ontology. A blackboard structure in a Mobile Ad-Hoc Network is used to share and distribute information. We deployed our visual language interface in a serious game environment of a disaster and rescue simulator. The current implementation of this environment is capable of simulating real disaster situations using information from human user observers reports.
Abstract: As language is fundamental to human activities, proficiency in other languages becomes important. Besides for developing abilities for communication, the knowledge is also a tool for a survival. With the introduction of computerized mobile devices, i.e. PDAs, new opportunities for communicating in other language arose. This paper describes a new communication paradigm that is language independent using icon language on a PDA. Users can create iconic messages as realization of their concepts or ideas in mind. The proof of concept tool is able to interpret and convert the messages to (natural language) text and speech in different languages. To provide faster interactions in next icon selection, the tool has icon prediction. Our user test results confirmed that using provided icons our target users could express their concepts and ideas solely using a spatial arrangement of icons.