Multimodal Interaction for Future Control Centers: An Interactive Demonstrator

Publikation aus Digital
Connected Computing

Fuhrmann F., Kaiser R.

New York, USA Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14), p66-67, 2014


This interactive demo exhibits a visionary multimodal interaction concept designed to support operators in future control centers. The applied multi-layered hardware and software architecture directly supports the operators in performing their lengthy monitoring and urgent alarm handling tasks. Operators are presented with visual information on three completely configurable levels of screen displays. Gesture interaction via skeleton and finger tracking acts as the main control interaction principle. We particularly developed a special sensor-equipped chair as well as an audio interface allowing for speaking and listening in isolation without any wearable device.