Privacy and Security in Mixed Reality Learning Environments by Input and User/Bot Interaction Protection

Asia Pacific Information Technology Conference (APIT), pp. 63–71

Abstract

Mixed reality is known as an advanced technology that provides a new approach for learning environments. Such environments allow learners to interact with both virtual and real worlds and bringing in potential enhancements to the learning process at the same time. For example, chatbots can facilitate the learning process. However, security and privacy settings for interacting with chatbots in such mixed reality environments are complex. In this paper, we introduce a mixed reality virtual assistant that is integrated into the collaborative environment of our existing application VIAProMa. This embodied chatbot allows lecturers and students to participate in mixed reality and online classrooms in real-time. The participants can interact with each other via VIAProMa’s avatar representations and can communicate with the chatbot that is represented by the mixed reality bot. The bot is realized by connecting a Slack chatbot with the mixed reality learning environment. It is displayed as an intuitive 3D model and is able to communicate with the users in spoken language. In this environment, privacy and security settings are conducted to protect the user input and user interaction with the bot. The evaluation results show that the system works stably with good performance. All the visualizations and features are well designed and were understood by the users. Users preferred the speech interface with the bot over a textual interface. The research has a strong impact on the design of security and privacy features for mixed reality environments in general.

Authors 4

1. Lan Anh Tran

   King Mongkut's University of Technology North Bangkok

   Affiliation as printed

   The Sirindhorn International Thai-German Graduate School of Engineering(TGGS), King Mongkut's University of Technology North Bangkok(KMUTNB), Thailand

2. Benedikt Hensen Aachen Chair of Computer Science 5

   RWTH Aachen University

   Affiliation as printed

   Chair of Computer Science 5(Information Systems and Databases), RWTH Aachen University, Germany

3. Ralf Klamma Aachen Chair of Computer Science 5

   RWTH Aachen University

   Affiliation as printed

   Chair of Computer Science 5(Information Systems and Databases), RWTH Aachen University, Germany

4. Soamsiri Chantaraskul

   King Mongkut's University of Technology North Bangkok

   Affiliation as printed

   The Sirindhorn International Thai-German Graduate School of Engineering(TGGS), King Mongkut's University of Technology North Bangkok(KMUTNB), Thailand