An Eye-Tracking Musical Expression Controller

Focal is an exciting experimental platform for musicians using Pupil eye tracking add-ons for the the Epson Moverio BT-200.

Focal enables musicians to manage and control electronic effects while both hands are occupied. The musician can control many virtual electronic audio effects and synthesis parameters by fixating on effects displayed in the AR GUI.

A foot pedal can be used to adjust the selected effects enabling a musician to maintain posture and balance for minimal disturbance during performance. Check out Stewart Greenhill and Cathie Travers full paper for NIME 2016 here.

The Focal system consists of four main technical components:

• Epson Moverio BT 200 AR headset

• Pupil eye tracking add-on for Epson BT 200

• 2 Foot pedals

• Focal software application

• Pupil Software

Focal uses the Epson Moverio BT-200 with a Pupil eye tracking add-on. Greenhill and Tavers have have provided excellent documentation of their process here.