Program
Friday, August 21, 2026 | 8:30 AM — 12:30 PM CEST
(P = Presenter)
8:30 AM
Welcome and opening remarks by the workshop organizers
Session 1 – Behavioral Insights: Assessing Attention, Experience, and Intent
9:25 AM
Gaze Behavior in Task- and Non-Task-Related Web Interaction: Implications for Usability and UX
[
Abstract] -
Fabian Engl (P), Erik Buchmann, Michael Burmester, Jürgen Mottok
Several studies show that eye movements differ between task-related
search and non-task-related free web browsing. Yet, experiments
typically rely on simplified single-page websites or screenshots. This
paper extends that line of research by analyzing gaze recordings from
121 participants interacting with multi-page websites. We investigated
whether core eye-tracking metrics systematically differ between both user
states in complex real-world web interactions. The analysis revealed
statistically significant effects for fixation duration, fixation distribution
(x- and y-coordinates), and saccade duration, with medium to large Cohen’s
d effect sizes. Consequently, our findings highlight that task- and
non-task-related user states persist in real-world web contexts and represent
distinct interaction modes characterized by systematically different gaze
patterns. This distinguishability has important implications for the
design of usability- and UX-oriented eye-tracking studies, as both product
qualities are defined by task-relatedness. Our results suggest that
certain eye movements may be more usability- or UX-related depending
on the user’s interaction state.
9:45 AM
SeeIntent: A Real-Time Multimodal Intent Recognition System in XR Using Spatio-Temporal LLM
[
Abstract] -
Gathik Jindal (P), Jayant Sharma (P), Beryl Gnanaraj, Jaya Sreevalsan-Nair
Recognizing user intent in Mixed Reality (MR) environments
is essential for HCI and assistive technologies, where human intent drives
adaptive systems. However, it remains a challenging open problem due
to the multimodal and highly dynamic nature of such interactions. We
present SeeIntent - a novel end-to-end real-time multimodal emotionally-aware
intent recognition system from an egocentric user perspective,
which fuses object-level visual context, emotional state, and spatial focus,
derived using Facial Action Coding System, head rotation, and gaze de-
scriptors streamed from the XR headset. The aggregated state is encoded
into a rolling temporal history and submitted to a locally-deployed open-
weight Large Language Model (LLM) backend for action-intent genera-
tion. We introduce a temporal context-window architecture, termed the
Brain, which maintains a history of multimodal state vectors and con-
ditions LLM inference based on historical context. Our framework offers
a replicable, dataset-agnostic methodology for the cognitive analysis of
user behavior in First Person Vision research. To validate the proposed
egocentric emotion context, we introduce a novel annotated pilot dataset
collected under naturalistic, in-the-wild conditions, providing ground-
truth labels for scene-level objects, fixation targets, egocentric emotional
state, and intended action. Evaluation on EPIC-KITCHENS and our pi-
lot dataset shows that while the higher-parameter LLM models achieve
the highest semantic matching accuracy, smaller model variants offer
competitive performance at substantially lower inference latency (under
300 ms), making them better suited for real-time interactive deployment.
Session 2 – Computational Foundations: Predictive Modeling and Data Integrity
11:00 AM
Gaze-Anchored Social Net: Decoding Implicit Relations via Joint Modeling
[
Abstract] -
Yuqi Hou (P), Zhuo Chen, Han Hu, Je Woo Kim, Jianbo Jiao, Hyung Jin Chang
Human gaze does more than point to visual targets; it serves
as a subtle indicator of social intent within static images, whereas standard
models typically process individuals independently, treating gaze as
an i.i.d. quantity or predicting social semantics in isolation. Recent multi-person
methods attempt to address this but often treat social relations
as rigid, post-hoc classifications decoupled from the gaze estimation process.
This oversimplification fails to capture the nuanced nature of social
intent, which acts as an underlying driver of gaze behavior rather than a
secondary categorical output. We address these limitations by proposing
ANCHOR, a target-centric paradigm designed to decode gaze-anchored
social intent by modeling the joint distribution of visual attention and
latent implicit relations. Our approach surfaces these dependencies as
the latent structural scaffolding of gaze behavior. The architecture utilizes
a relational attention mechanism to capture fine-grained interper-
sonal links, leveraging feature-wise modulation for efficient multi-person
parsing from a single vision backbone. To stabilize the training of this
coupled formulation, we implement an optimization synergy to resolve
the inherent conflicts between spatial gaze accuracy and latent social reasoning
soning. This approach ensures robust generalization by seeking stable,
flat minima while simultaneously harmonizing competing task gradients.
We validate our framework on an extended benchmark featuring dense
multi-person annotations and novel social influence rankings. Our results
demonstrate state-of-the-art performance and provide the first quantitative
evidence that implicit social hierarchies can be robustly disentangled
and learned directly from static gaze patterns.
11:20 AM
VSP: Visual Scanpath Predictor for Egocentric Videos
[
Abstract] -
Sansitha Panchadsaram (P), James J. Clark
Scanpath prediction for egocentric videos is a challenging
task because human gaze is constantly moving with ongoing actions,
while the first-person viewpoint is also continuously changing. Existing
approaches incorporate additional inputs, such as hand movements, body
poses, or audio signals, which may not always be available and can reduce
generalization. In this work, we present VSP, a Visual Scanpath
Predictor for egocentric video that predicts the next fixation location
using only past RGB video frames and fixation history, without needing
additional modalities. Based on the USP architecture and evaluated on
the EGTEA Gaze+ dataset, VSP includes a Dynamic Attention Module
(DAM), modality-specific encoders, an Attentive Convolutional LSTM
(ALSTM), and a convolutional Gated Multimodal Unit (GMU) to pre-
dict the next fixation in a scanpath. Unlike prior work that predicts
continuous saliency maps, VSP directly predicts the next fixation location,
resulting in predictions that align with real-world human scanpaths.
Experiments demonstrate that VSP achieves an F1 score of 55.30%,
with ablation studies confirming that each architectural component contributes
meaningfully to overall performance. Our results suggest that
an accurate prediction of egocentric fixation can be achieved without
relying on computationally expensive or environment-specific additional
inputs.
11:40 AM
Decoupling Identity and Visual Attention: Integrating Latent Diffusion and Gaze Estimation for Privacy-Preserving Pediatric Video
[
Abstract] -
Elia Nastasio (P), Mattia Savardi, Matteo Verga, Cesare Furlanello, Alberto Signoroni
The analysis of human gaze behavior serves as a critical, objective
biomarker in pediatric research, particularly for assessing
neuro-developmental disorders and evaluating visual rehabilitation in unstructured,
naturalistic settings. While unconstrained, single-camera video
recordings offer a non-invasive alternative to eye-tracking hardware, they
inherently collect highly sensitive clinical data from vulnerable minors,
raising severe ethical and privacy concerns. This lack of secure data-sharing
methodologies represents a significant bottleneck for collaborative
research. Traditional face anonymization techniques (blurring, pixelation)
are inadequate, as they distort key facial features and render
subsequent gaze behavior analysis impossible. To bridge this gap, this
paper introduces a novel, training-free pipeline that uniquely integrates
a state-of-the-art latent diffusion inversion model, NullFace, with an advanced
scene-aware gaze estimator, Gaze-LLE. By leveraging diffusion-based
identity suppression, our approach precisely anonymizes the
subject’s face while preserving the subtle ocular and geometric cues
required for high-fidelity gaze analysis. We validate our pipeline on the
highly dynamic and unconstrained ChildPlay-Gaze dataset, which serves
as a rigorous proxy for naturalistic and unstructured clinical environments
By quantifying the gaze deviation introduced by anonymization
and demonstrating an optimal balance between identity suppression and
gaze preservation, we show that our architecture successfully decouples
identity from gaze metrics. This work establishes the first viable methodology
for privacy-preserving pediatric gaze estimation, paving the way
for secure, large-scale dataset sharing in neurodevelopmental and
rehabilitative research.
12:00 PM
PCCR+: Leveraging Pupil Dynamics for Correcting PCCR Slippage Error
[
Abstract] -
Diako Mardanbegi (P)
Head-mounted eye tracking is pivotal for extended reality
but suffers from mechanical slippage. Unlike model-based approaches,
regression-based Pupil Center-Corneal Reflection (PCCR) methods are
not very robust against sensor displacement as they discard absolute
geometric information of the eye features. This paper presents PCCR+ ,
a dynamic correction method that leverages absolute pupil dynamics to
mitigate slippage error. A correction term is introduced, derived from the
discrepancy between absolute pupil estimates and relative PCCR estimates.
Utilizing a secondary "slip-calibration", a mapping is established
between the PCCR vector and a dynamic gain coefficient. Simulation
evaluations demonstrate that PCCR+ reduces mean absolute error by
approximately 82% compared to the conventional PCCR method. While
empirical validation remains for future work, this theoretical framework
establishes a robust mathematical foundation for mitigating slippage
errors in off-the-shelf solutions, without necessitating the complex geometric
reconstruction required by model-based approaches.
12:20 PM
Closing remarks by the workshop organizers