All software releases

We are excited to announce new a big update with two new features for Pupil Cloud. We added a new manual gaze mapping enrichment - Manual Mapper - as well as the ability to offset gaze post-hoc - Gaze Offset.

Manual Mapper

This tool provides a streamlined interface enabling you to manually map fixations onto a reference image. Click on the reference image to map the fixation and the recording will automatically advance to the next fixation. Mark fixations as not on the reference image by clicking outside of the reference image boundary.

You will see all fixations and their durations visualized in the timeline below.

After mapping is complete you can visualize the mapped data just as you would with any of our automated gaze mapping tools. Generate heatmaps, draw AOIs + get metrics on AOIs, and export mapped data as CSVs.

The Manual Mapper was designed for standard fixation mapping tasks, but has a lot of potential for further exploration e.g. semantic labeling tasks. We encourage you to explore!

Gaze Offset

For some subjects, you may find a constant offset in their gaze estimates. This is usually compensated for in the Neon Companion App. Now you can also do this post-hoc in Pupil Cloud. Click on the gaze offset icon and drag the gaze circle to apply the offset.

Note: Modifying the gaze offset impacts all downstream data, such as fixations, mapped gaze from enrichments, and visualizations. Where possible, data is updated instantly. If not, the respective data will be deleted, requiring (partial) re-computation of enrichments or visualizations.

Heatmap Updates

We have added the ability to update the position and size of labels in AOI heatmaps. Click to select a label, drag the label to position, select and drag a corner to adjust the size.

We also added the legend to the downloaded heatmap image.

Editing the Wearer in a Recording

It is now possible to change the assigned wearer in a recording post hoc in Pupil Cloud. Simply select “Change Wearer” from the context menu of a recording!

We are excited to announce another round of updates for Pupil Cloud. This release focuses mostly on stability, but we’re also adding a few nice UI updates as well!

Enrichment timeline visualization

We have put more design work into the enrichment timelines to make it easier for researchers to discover the results of enrichments. Timelines for enrichments now visualize three states:

1. Processing: The processing states of the enrichment. Ready, Processing, Done.

2. Localization: Visualizes where the reference image or surface detected in the recording.

3. Gaze on reference: Visualizes where the subject is looking at the reference image or surface in the recording.

Automated recording recovery

We developed an automatic recovery tool that fixes recordings that were not playable on the Companion Device or that were directly exported from the Companion Device to desktop.

AOI Heatmap Metrics: Fixation Count

We’ve added average fixation count metric to the AOI Heatmap visualization.

Marker Mapper Image

The Marker Mapper image now automatically selects an image where all markers are visible from within the enrichment section.

Workspace management

You can now leave workspaces. This can be useful if you are no longer contributing to a workspace and want to clean up the list of workspaces associated with your account. You can always join a workspace again by accepting an invite from a workspace admin.

Follow mode for playback as default

We’ve added a new feature so that the playhead is always in view during playback. This is now the default playback mode. If you want to switch back to the old style, you can click the “follow mode” button.

Improved Fullscreen Experience

We removed the top application bars when in fullscreen so that we can maximize the available space for fullscreen viewing.

We are excited to announce another round of updates for Pupil Cloud! We are introducing Area of Interest (AOI) analysis, improvements for the recording timeline, and several other smaller changes.

Areas of Interest

We are excited to launch AOI tools in Pupil Cloud! Use the AOI Editor in your Reference Image Mapper and Marker Mapper enrichments to draw AOIs on top of the reference image or surface. You can draw anything from simple polygons to multiple disconnected shapes.

AOI Metrics

After you have drawn AOIs you will automatically get CSV files of standard metrics of fixations on AOIs: total fixation duration, average fixation duration, time to first fixation, and reach.

AOI Heatmaps

Create visualizations of AOI metrics using an AOI Heatmap!

Enrichment Results in the Timeline

The recording timeline now contains visualizations for enrichments that indicate when they successfully tracked the reference image, surface, or face respectively.

This provides you with a high-level overview of when the stimuli were in the subject’s field of view.

Timeline Zoom

You can now zoom in the timeline. Zoom out for an overview of the entire recording and zoom in up to 1-second intervals to inspect the details.

Project Layout Changes

Enrichments now have a dedicated table. This enables you to search/sort enrichments and view more information about each enrichment in a single view. It also cleans up the sidebar!

Create Button

We added a “create” button in the enrichment and visualization views. Each button opens a modal that also contains more information about each enrichment and visualization. The aim is to make it easier to understand the setup and output of enrichments and visualizations.

Faster Downloads

Downloads of Marker Mapper and Reference Image Mapper exports are now 20x faster!

Search

You can now search for workspaces and projects by their ID.

Native Recording Data

If you want to download recording data from Pupil Cloud, in the same format it was saved on the Neon Companion Device, it is now called Native Recording Data.

Timestamps

We have switched to hardware based timestamps for video feeds for increased accuracy. If you need old recordings in Pupil Cloud updated to hardware timestamps reach out info@pupil-labs.com