“An Unscented Hound forWorking Memory” and the Cognitive Adaptation of User Interfaces

Bruno Massoni Sguerra (1, 2, 3) , Pierre Jouvelot (1, 3, 2)

1 PSL - Université Paris sciences et lettres
2 CRI - Centre de Recherche en Informatique
3 Mines Paris - PSL (École nationale supérieure des mines de Paris)

We introduce An Unscented Hound for Working Memory (AUHWM), a new framework for the real-time tracking of human Working Memory (WM) that can be used to adapt computer interfaces to users' available cognitive resources. WM is the part of human cog-nition responsible for the short term storing and handling of information ; it can, in stressful situations, under information overload, or when suffering from dementia-like diseases, become severely limited, possibly leading to poor decision making. Our preliminary results suggest that AUHWM can provide a precise and timely assessment of WM capacity, so that the cognitive load a specific task imposes on users can be adapted, e.g., at the User Interface (UI) level. AUHWM is based on a low-level stochastic discrete model of human WM dynamics, implemented as a Gradient-Boosting-derived deterministic algorithm that simulates users' oblivion. AUHWM also performs Unscented Kalman filtering to track users' WM-specific parameters in real time, thus providing a dynamic assessment of their cognitive resources. Our approach has been tested and validated using data collected from Match 2 s, a visual memory game played by 18 users in another study. Going beyond real-time WM tracking, AUHWM is intended to also be used for WM prediction, paving the way to the adaptation of tasks and their UIs in real time as a function of users' cognitive abilities; we detail an example of such an adapted system, and provide experimental evidence this approach has the potential to lead to enhanced WM-adapted UIs in the future.

Mots clés: UI adaptation; Working Memory; Unscented Kalman filter; Cognitive adaptation; Gradient Boosting

Domaines: Sciences cognitives; Informatique

Bruno Massoni Sguerra, Pierre Jouvelot. “An Unscented Hound forWorking Memory” and the Cognitive Adaptation of User Interfaces. 2019. ⟨hal-02011002⟩