An Eye-Tracking Musical Expression Controller

2016 Nov 12

Focal is an exciting experimental platform for musicians using Pupil eye tracking add-ons for the the Epson Moverio BT-200.

Focal enables musicians to manage and control electronic effects while both hands are occupied. The musician can control many virtual electronic audio effects and synthesis parameters by fixating on effects displayed in the AR GUI.

A foot pedal can be used to adjust the selected effects enabling a musician to maintain posture and balance for minimal disturbance during performance. Check out Stewart Greenhill and Cathie Travers full paper for NIME 2016 here.

Focal System
Image source: Focal

The Focal system consists of four main technical components:

Focal uses the Epson Moverio BT-200 with a Pupil eye tracking add-on. Greenhill and Tavers have have provided excellent documentation of their process here.

Watch and listen to their demo demo.