Multimodal Interfaces

Abstract

In this project, we implemented a generic VR environment to measure cognitive workload. The user was asked to manipulate cubes by voice and gesture commands (color, size, position, insert or delete). To develop the speech and gesture interface, we used and modified ATN grammar..