An Eye-Tracking Musical Expression Controller
Focal is an exciting experimental platform for musicians using Pupil eye tracking add-ons for the the Epson Moverio BT-200.
Focal enables musicians to manage and control electronic effects while both hands are occupied. The musician can control many virtual electronic audio effects and synthesis parameters by fixating on effects displayed in the AR GUI.
A foot pedal can be used to adjust the selected effects enabling a musician to maintain posture and balance for minimal disturbance during performance. Check out Stewart Greenhill and Cathie Travers full paper for NIME 2016 here.
The Focal system consists of four main technical components:
- Epson Moverio BT 200 AR headset
- Pupil eye tracking add-on for Epson BT 200
- 2 Foot pedals
- Focal software application
- Pupil Software
Watch and listen to their demo demo.