Eye Tracking in VR


During Escape Room problem solving, eye gaze co-ordinates (x, y, z) detected by the Vive Pro Eye headset are converted into a stream of gaze direction vectors.  These vectors are combined with information about the user’s head direction and eye position inside the game world in order to create a ray.  In the top image, the player’s head is represented by the avatar, and her line of gaze is represented as the pink ray.   In the middle image, the spotlight is centered on a fixated object, which, in this case, is a book.  When the spotlight (or ray) collides with an object (e.g. the book), the unique name of the object and the amount of time spent in contact with the object are recorded (bottom image).   This information is synchronized with time-series EEG samples and other physiological data streams via Lab Streaming Layer.   https://github.com/sccn/labstreaminglayer


(Note: Spotlights and rays are not visible to the user in the VR environment.  They are only seen by the experimenter.)


Leave a Reply

Your email address will not be published. Required fields are marked *