This project is to create a Multi-players Virtual Reality Learning platform with Voice Actionable Capabilities powered by Alexa. It is specially designed for Special Education students for enhancing learner experience thru Gamification.
Why did you decide to make it?
Organically, I have prototyped an web based WebVR app based on aFrame.io and Socket.io for a multiplayer interactive Virtual Reality platform with the intend of building a gamification learning system for special needs kids include my son! With Alexa, I have extended the design (REST API) to accept voice instructions for manipulating 3D objects allowing designing voice interactions thru Alexa skills!
How does it work?
A multiplayer WebVR environment allowing interactions with the 3D objects from any Alexa endpoints or web browsers. For instance, the instructor can voice instruct an object in the VR classroom environment visual learning for students -- memory palace!
Technical Briefs
Adding remote control capability of DOM objects within any WebVR (aframe.io) based Virtual Reality environments through socket.io based REST API (node.js) for interactivity. Thru Alexa Skills (Lambda), it allows action triggers to manipulate any 3D DOM objects.
Design
downloadable pdf at Github (https://github.com/JANQLIANGTSAI/voicereality)
VUI
downloadable pdf at Github (https://github.com/JANQLIANGTSAI/voicereality)
Comments