Assessing Cognitive Load on Web Search Tasks

Assessing cognitive load on web search is useful for characterizing search system features and search tasks with respect to their demands on the searcher’s mental effort. It is also helpful for examining how individual differences among searchers (e.g. cognitive abilities) affect the search process. We examined cognitive load from the perspective of primary and secondary task performance. A controlled web search study was conducted with 48 participants. The primary task performance components were found to be significantly related to both the objective and the subjective task difficulty. However, the relationship between objective and subjective task difficulty and the secondary task performance measures was weaker than expected. The results indicate that the dual-task approach needs to be used with caution.

💡 Research Summary

The paper investigates how to measure the cognitive load experienced by users during web‑search tasks by employing a dual‑task methodology. Forty‑eight participants performed a series of controlled search scenarios that varied systematically in objective difficulty (e.g., number of documents, information complexity, query ambiguity). While carrying out the primary search task, participants were also required to respond to a secondary task—a simple color‑change detection task presented intermittently on the screen. Primary‑task performance was captured through multiple metrics: success rate, average search time, number of clicks, and page transitions. Subjective workload was collected using the NASA‑TLX questionnaire, providing a self‑reported measure of perceived difficulty.

The results show a strong correspondence between primary‑task performance and both objective and subjective difficulty levels. As task difficulty increased, success rates dropped, search times and click counts rose, and participants reported higher perceived workload. In contrast, secondary‑task performance (reaction time and accuracy) displayed only a weak relationship with the difficulty manipulations. Even in the most demanding search conditions, participants’ reaction times to the color‑change stimulus did not deteriorate markedly, and accuracy remained relatively stable. This suggests that users may allocate cognitive resources preferentially to the search task, effectively suppressing or efficiently managing the secondary task. Moreover, individual differences in cognitive abilities (working‑memory capacity, general intelligence) did not produce statistically significant effects on secondary‑task outcomes, indicating that the dual‑task approach may be insensitive to personal variability in this context.

The authors interpret these findings as a cautionary note on the use of dual‑task paradigms for assessing cognitive load in complex, real‑world activities such as web searching. They argue that the secondary task must be carefully calibrated; its difficulty and modality can dramatically influence the degree of interference with the primary task. The paper recommends augmenting dual‑task measurements with physiological indicators (eye‑tracking, heart‑rate variability, EEG) to obtain a richer, multimodal picture of mental effort. Additionally, future studies should incorporate more ecologically valid search environments—varying interface designs, dynamic information needs, and time pressure—to better reflect everyday searching behavior.

From a practical standpoint, the research underscores that search system designers should aim to reduce cognitive load by providing supportive UI features (e.g., query suggestions, result summarization) and by personalizing interfaces according to users’ cognitive profiles. Overall, the study contributes valuable empirical evidence that primary‑task metrics reliably reflect both objective and perceived difficulty, while secondary‑task metrics may require refinement before they can serve as robust indicators of cognitive load in web‑search contexts.