Program

Friday, August 21, 2026 | 8:30 AM — 12:30 PM CEST

Room C1 (Louis Néel Building)

(P = Presenter)

8:30 AM
Welcome and opening remarks by the workshop organizers
Session 1 – Behavioral Insights: Assessing Attention, Experience, and Intent
8:45 AM
Re-streamed Validation of Real-Time Cognitive Load Measurement
[Abstract]  -  Andrew Duchowski (P), Samaneh Zamanifard, Sonja Cecchetti, Marco Cavallo, Andy Edmonds
Real-time measurement of cognitive load is important for interactive, adaptive systems where task difficulty could be adjusted to match the user’s level of engagement. Although some attempts have been made towards windowed versions of earlier offline measures, to date no real-time measurement of cognitive load is as yet available. Here, three different interactive scenarios are used to evaluate performance of a recently introduced real-time cognitive load metric based on pupil oscillation in response to task difficulty. Although analysis re-streams offline data, results suggest that the approach is effective in distinguishing between high and low levels of cognitive load.
9:05 AM
Tracking Estimated Attention Levels During Oral Character String Reading
[Abstract]  -  Minoru Nakayama (P)
Cognitive workload during the oral reading of character strings was evaluated using microsaccade (MS) rates and pupillary changes from an open dataset. The data consisted of four types of character strings under both short and long length conditions. Both binocular MS rates and pupillary sizes were chronologically summarised at 500 ms intervals. Analysis revealed that string length significantly affects the temporal changes in both metrics. To uncover the latent reactions to workload, a modelling technique was applied to both metrics to evaluate attentional levels across task conditions. Finally, the underlying cognitive dynamics during oral reading tasks are discussed on these estimated attentional changes.
9:25 AM
Gaze Behavior in Task- and Non-Task-Related Web Interaction: Implications for Usability and UX
[Abstract]  -  Fabian Engl (P), Erik Buchmann, Michael Burmester, Jürgen Mottok
Several studies show that eye movements differ between task-related search and non-task-related free web browsing. Yet, experiments typically rely on simplified single-page websites or screenshots. This paper extends that line of research by analyzing gaze recordings from 121 participants interacting with multi-page websites. We investigated whether core eye-tracking metrics systematically differ between both user states in complex real-world web interactions. The analysis revealed statistically significant effects for fixation duration, fixation distribution (x- and y-coordinates), and saccade duration, with medium to large Cohen’s d effect sizes. Consequently, our findings highlight that task- and non-task-related user states persist in real-world web contexts and represent distinct interaction modes characterized by systematically different gaze patterns. This distinguishability has important implications for the design of usability- and UX-oriented eye-tracking studies, as both product qualities are defined by task-relatedness. Our results suggest that certain eye movements may be more usability- or UX-related depending on the user’s interaction state.
9:45 AM
SeeIntent: A Real-Time Multimodal Intent Recognition System in XR Using Spatio-Temporal LLM
[Abstract]  -  Gathik Jindal (P), Jayant Sharma (P), Beryl Gnanaraj, Jaya Sreevalsan-Nair
Recognizing user intent in Mixed Reality (MR) environments is essential for HCI and assistive technologies, where human intent drives adaptive systems. However, it remains a challenging open problem due to the multimodal and highly dynamic nature of such interactions. We present SeeIntent - a novel end-to-end real-time multimodal emotionally-aware intent recognition system from an egocentric user perspective, which fuses object-level visual context, emotional state, and spatial focus, derived using Facial Action Coding System, head rotation, and gaze de- scriptors streamed from the XR headset. The aggregated state is encoded into a rolling temporal history and submitted to a locally-deployed open- weight Large Language Model (LLM) backend for action-intent genera- tion. We introduce a temporal context-window architecture, termed the Brain, which maintains a history of multimodal state vectors and con- ditions LLM inference based on historical context. Our framework offers a replicable, dataset-agnostic methodology for the cognitive analysis of user behavior in First Person Vision research. To validate the proposed egocentric emotion context, we introduce a novel annotated pilot dataset collected under naturalistic, in-the-wild conditions, providing ground- truth labels for scene-level objects, fixation targets, egocentric emotional state, and intended action. Evaluation on EPIC-KITCHENS and our pi- lot dataset shows that while the higher-parameter LLM models achieve the highest semantic matching accuracy, smaller model variants offer competitive performance at substantially lower inference latency (under 300 ms), making them better suited for real-time interactive deployment.
10:05 AM
Peripheral Attention Index (PAI): Area-Weighted Distal Polygonal Areas Of Interest
[Abstract]  -  Andrew Duchowski (P), Nina Gehrer, Jennifer Svaldi
Unary Area-of-Interest (AOI) fixation- or gaze-based selection discards potentially valuable proximal AOIs that fall within the perifoveal or peripheral visual span of attention. This results in abrupt transitions in gaze visualizations with misleading connotations of pin- point foveal gaze at the exclusion of peripheral influence. We derive a simple, parameter-free Peripheral Attention Index (PAI) that can be used as both an indicator of peripherally influential AOIs and as a simple opacity function that uses the ratio of Object-Gaze Distance (OGD; minimum distance to any AOI vertex) to Centroid-Gaze Distance (OCD) as a geometrically meaningful normalizer. The resulting soft highlighting is fully opaque inside the AOI, decays smoothly outside, and automatically adapts to AOI size and shape. Extensions incorporating AOI area are discussed. The method is computationally straightforward, visually intuitive, and directly compatible with existing eye-tracking pipelines.
10:30 AM
Coffee break
Session 2 – Computational Foundations: Predictive Modeling and Data Integrity
11:00 AM
Gaze-Anchored Social Net: Decoding Implicit Relations via Joint Modeling
[Abstract]  -  Yuqi Hou (P), Zhuo Chen, Han Hu, Je Woo Kim, Jianbo Jiao, Hyung Jin Chang
Human gaze does more than point to visual targets; it serves as a subtle indicator of social intent within static images, whereas standard models typically process individuals independently, treating gaze as an i.i.d. quantity or predicting social semantics in isolation. Recent multi-person methods attempt to address this but often treat social relations as rigid, post-hoc classifications decoupled from the gaze estimation process. This oversimplification fails to capture the nuanced nature of social intent, which acts as an underlying driver of gaze behavior rather than a secondary categorical output. We address these limitations by proposing ANCHOR, a target-centric paradigm designed to decode gaze-anchored social intent by modeling the joint distribution of visual attention and latent implicit relations. Our approach surfaces these dependencies as the latent structural scaffolding of gaze behavior. The architecture utilizes a relational attention mechanism to capture fine-grained interper- sonal links, leveraging feature-wise modulation for efficient multi-person parsing from a single vision backbone. To stabilize the training of this coupled formulation, we implement an optimization synergy to resolve the inherent conflicts between spatial gaze accuracy and latent social reasoning soning. This approach ensures robust generalization by seeking stable, flat minima while simultaneously harmonizing competing task gradients. We validate our framework on an extended benchmark featuring dense multi-person annotations and novel social influence rankings. Our results demonstrate state-of-the-art performance and provide the first quantitative evidence that implicit social hierarchies can be robustly disentangled and learned directly from static gaze patterns.
11:20 AM
VSP: Visual Scanpath Predictor for Egocentric Videos
[Abstract]  -  Sansitha Panchadsaram (P), James J. Clark
Scanpath prediction for egocentric videos is a challenging task because human gaze is constantly moving with ongoing actions, while the first-person viewpoint is also continuously changing. Existing approaches incorporate additional inputs, such as hand movements, body poses, or audio signals, which may not always be available and can reduce generalization. In this work, we present VSP, a Visual Scanpath Predictor for egocentric video that predicts the next fixation location using only past RGB video frames and fixation history, without needing additional modalities. Based on the USP architecture and evaluated on the EGTEA Gaze+ dataset, VSP includes a Dynamic Attention Module (DAM), modality-specific encoders, an Attentive Convolutional LSTM (ALSTM), and a convolutional Gated Multimodal Unit (GMU) to pre- dict the next fixation in a scanpath. Unlike prior work that predicts continuous saliency maps, VSP directly predicts the next fixation location, resulting in predictions that align with real-world human scanpaths. Experiments demonstrate that VSP achieves an F1 score of 55.30%, with ablation studies confirming that each architectural component contributes meaningfully to overall performance. Our results suggest that an accurate prediction of egocentric fixation can be achieved without relying on computationally expensive or environment-specific additional inputs.
11:40 AM
Decoupling Identity and Visual Attention: Integrating Latent Diffusion and Gaze Estimation for Privacy-Preserving Pediatric Video
[Abstract]  -  Elia Nastasio (P), Mattia Savardi, Matteo Verga, Cesare Furlanello, Alberto Signoroni
The analysis of human gaze behavior serves as a critical, objective biomarker in pediatric research, particularly for assessing neuro-developmental disorders and evaluating visual rehabilitation in unstructured, naturalistic settings. While unconstrained, single-camera video recordings offer a non-invasive alternative to eye-tracking hardware, they inherently collect highly sensitive clinical data from vulnerable minors, raising severe ethical and privacy concerns. This lack of secure data-sharing methodologies represents a significant bottleneck for collaborative research. Traditional face anonymization techniques (blurring, pixelation) are inadequate, as they distort key facial features and render subsequent gaze behavior analysis impossible. To bridge this gap, this paper introduces a novel, training-free pipeline that uniquely integrates a state-of-the-art latent diffusion inversion model, NullFace, with an advanced scene-aware gaze estimator, Gaze-LLE. By leveraging diffusion-based identity suppression, our approach precisely anonymizes the subject’s face while preserving the subtle ocular and geometric cues required for high-fidelity gaze analysis. We validate our pipeline on the highly dynamic and unconstrained ChildPlay-Gaze dataset, which serves as a rigorous proxy for naturalistic and unstructured clinical environments By quantifying the gaze deviation introduced by anonymization and demonstrating an optimal balance between identity suppression and gaze preservation, we show that our architecture successfully decouples identity from gaze metrics. This work establishes the first viable methodology for privacy-preserving pediatric gaze estimation, paving the way for secure, large-scale dataset sharing in neurodevelopmental and rehabilitative research.
12:00 PM
PCCR+: Leveraging Pupil Dynamics for Correcting PCCR Slippage Error
[Abstract]  -  Diako Mardanbegi (P)
Head-mounted eye tracking is pivotal for extended reality but suffers from mechanical slippage. Unlike model-based approaches, regression-based Pupil Center-Corneal Reflection (PCCR) methods are not very robust against sensor displacement as they discard absolute geometric information of the eye features. This paper presents PCCR+ , a dynamic correction method that leverages absolute pupil dynamics to mitigate slippage error. A correction term is introduced, derived from the discrepancy between absolute pupil estimates and relative PCCR estimates. Utilizing a secondary "slip-calibration", a mapping is established between the PCCR vector and a dynamic gain coefficient. Simulation evaluations demonstrate that PCCR+ reduces mean absolute error by approximately 82% compared to the conventional PCCR method. While empirical validation remains for future work, this theoretical framework establishes a robust mathematical foundation for mitigating slippage errors in off-the-shelf solutions, without necessitating the complex geometric reconstruction required by model-based approaches.
12:20 PM
Closing remarks by the workshop organizers