How does it work?

Neon is a video-based head-mounted eye tracker that uses deep learning to estimate gaze position. Similar to Pupil Invisible but better. Unlike Pupil Invisible, Neon will provide pupil size and eye state data.

NeonNet has been trained with data from a wide variety of individuals in diverse environments. The Neon module has two tiny cameras that capture videos of your eyes and one camera that captures your field of view (the scene camera). The Neon module is designed to connect to a variety of frames. Frames have a very simple electrical interface with the module and USB-C cable that connects to the Companion Device. The Companion Device provides power for the module, runs NeonNet, streams real-time gaze data, and syncs with Cloud.

What kind of accuracy can I expect?

The R&D team is fine tuning the network and we’re still gathering more training data. That being said, you can expect accuracy to be an improvement upon what can be achieved with Pupil Invisible. We can already report that parallax error has been greatly reduced.

Can I use Neon for research in the lab?

Yes! We designed Neon to provide high accuracy as well as real world robustness, combining the best of Pupil Core and Pupil Invisible. We believe Neon will do great both in controlled lab conditions and the wild.

What kind of data will I be able to access?

You will always have access to all the raw, intermediate, and final data - no special licenses required. (Note: some data will initially require Cloud access and will become available in Q2 2023)

• Gaze data: x, y coordinates in scene camera space
• Blinks (available in Pupil Cloud)
• Fixations (available in Pupil Cloud)
• Pupil Diameter (Later in 2023. Available in Pupil Cloud)
• Eye state: full 3D pose of each eye (Expected in Q2 2023 in Pupil Cloud)
• Scene video
• Eye Video
• Audio
• Head pose from the built in 9-DoF IMU (fused and independent accelerometer, gyroscope, and magnetometer).
• Events
• Recording template and wearer data

Do I need to calibrate?

No, the system is calibration free. That means that anyone can just put it on and immediately get gaze data. In the future, we will offer an optional calibration to fine-tune the gaze estimation pipeline for each subject.

What sensors are in the Neon module?

The Neon module contains 2 x infrared eye cameras that run at 200 Hz, 1 x Scene camera running at 30 Hz, stereo microphones and an inertial measurement unit (gyroscope, accelerometer, and magnetometer).

The scene camera deserves some special attention. It has a super wide field of view: 132 degrees horizontal by 81 degrees vertical at a resolution of 1600 x 1200 px.

Image quality is hard to quantify, we worked hard to get the best possible image quality given the extremely small form factor of the lens and sensor. We think it is a big step up from Pupil Invisible and other head-mounted cameras.

Will Neon be compatible with Pupil Cloud?

Yes! Neon is fully compatible with Pupil Cloud. User management, templates, recording upload, enrichments, and more!

Can I use the Neon module with the Pupil Core Software?

Yes you can! We made sure to add support in Pupil Capture for the Neon scene and eye cameras. You can use the Neon module as if it was a Pupil Core headset by plugging it into your Computer and running the latest version of Pupil Capture. Note, that in this case gaze estimation will not be done using NeonNet, but using the Pupil Core's gaze estimation pipeline.

When will Neon ship?

How much is it going to cost?

Neon with a Standard Frame and Companion Device will cost the same as Pupil Invisible: 5900 EUR (5200 EUR with academic discount). We will also roll out more frames in the near future at different prices.

What's in the box?

Neon module, Standard Frame (We call it “Just act natural”) with cable, Companion Device (OnePlus 8T), Companion Device wall charger, and lens cleaning cloth. Pupil Cloud access included.

When can I pre-order Neon?

I need a frame that you dont have!

We would love to help you out! Reach out to us via email (info@pupil-labs.com) and we can discuss making a custom one-off for you or add another frame to our collection!

Can I build my own frame?

Yes! We will open source both the mechanical and electrical interface. You can make your own interface PCB or buy the one we use in our frames directly from us!

How much power does Neon use?

Cameras can be power hungry, especially when running at 200 Hz. We worked hard to reduce power consumption as much as possible. Right now the module uses 1.2 Watts. With the current Companion Device we expect a recording time of up to 5 hours!

Is Neon open source?

Yes and No. The Neural Network (NeonNet) and the Source Code for the Android app running on the Companion Device are not.

Here is what will be open:

• Data format of the recordings
• USB interface and protocol of the Neon module
• Mechanical interface of the Neon module
• Real-time network protocol used by the app running on the Companion Device
• Performance evaluation and working principle of NeonNet in the form of a white paper
• Performance evaluation and working principle of the fixation detector in the form of a white paper
• Cloud API
• The Pupil Monitor web app
• Python client for the real-time API
• All helper tools and scripts we provide

What’s going to happen with Pupil Core and Pupil Invisible?

We think Neon is better than Pupil Core and Pupil Invisible in almost every aspect. We generally think you should get Neon for your next eye tracker.

That being said, we know how much our users have come to depend on and trust Pupil Core and Invisible. Therefore, we will continue to sell and support these products for the foreseeable future.

But I have more questions…

Head over to Discord and chat with us! Or send us an email at info@pupil-labs.com.