Designing Effective Human-Swarm Interaction Interfaces: Insights from a User Study on Task Performance

In this paper, we present a systematic method of design for human-swarm interaction interfaces, combining theoretical insights with empirical evaluation. We first derived ten design principles from existing literature, applying them to key information dimensions identified through goal-directed task analysis and developed a tablet-based interface for a target search task. We then conducted a user study with 31 participants where humans were required to guide a robotic swarm to a target in the presence of three types of hazards that pose a risk to the robots: Distributed, Moving, and Spreading. Performance was measured based on the proximity of the robots to the target and the number of deactivated robots at the end of the task. Results indicate that at least one robot was brought closer to the target in 98% of tasks, demonstrating the interface’s success in fulfilling the primary objective of the task. Additionally, in nearly 67% of tasks, more than 50% of the robots reached the target. Moreover, particularly better performance was noted in moving hazards. Additionally, the interface appeared to help minimise robot deactivation, as evidenced by nearly 94% of tasks where participants managed to keep more than 50% of the robots active, ensuring that most of the swarm remained operational. However, its effectiveness varied across hazards, with robot deactivation being lowest in distributed hazard scenarios, suggesting that the interface provided the most support in these conditions.

💡 Research Summary

This paper presents a systematic approach to designing human‑swarm interaction (HSI) interfaces, bridging theoretical foundations with empirical validation. The authors first synthesize existing human‑robot interaction (HRI) and multi‑robot system (MRS) literature to derive ten concrete design principles tailored for HSI. These principles emphasize (1) leveraging local swarm information to build a global picture, (2) supporting smooth transitions between swarm autonomy and human control, (3) offering versatile interaction modalities, (4) enabling tactical switching of interaction modes, tools, and algorithms, (5) prioritising intrinsic modalities such as gestures, voice, and touch, (6) minimising the interaction gap in direct human‑to‑robot exchanges, (7) minimising the gap in indirect human‑to‑environment exchanges, (8) encouraging active engagement with displayed information, (9) reducing reliance on memory by externalising data, and (10) assisting attention management to prevent overload.

Guided by these principles, the authors develop a tablet‑based user interface for a target‑search scenario. The interface visualises 20 simulated robots (in CoppeliaSim), the target area, and three types of hazards (distributed, moving, spreading). Users receive hazard alerts, can mark or delete avoidance regions with simple tap/long‑press gestures, and can zoom or pan to focus on specific robots or zones. Real‑time updates, colour‑coded timers, and automatic zooming embody principles 8‑10, while the use of gestures and touch satisfies principle 5. The design process is documented in detail, with a table mapping each information dimension (location, motion, time, environment) to specific UI decisions.

A user study with 31 non‑expert participants evaluated the interface across the three hazard conditions. Performance metrics were: (i) the proportion of trials where at least one robot approached the target (98 % of trials), (ii) the proportion where more than 50 % of robots reached the target (≈ 67 % of trials), and (iii) the proportion where more than 50 % of robots remained active (≈ 94 % of trials). Results indicate that the interface reliably supports the primary task objective. Notably, performance was highest in the moving‑hazard condition, suggesting that dynamic visual feedback and rapid hazard marking were especially effective. The lowest robot deactivation rates occurred in the distributed‑hazard scenario, implying that the interface’s ability to handle multiple simultaneous avoidance zones helped preserve swarm integrity.

The paper’s contributions are threefold: (1) a concise, principle‑based framework for HSI design, (2) a concrete, principle‑driven tablet UI with a transparent design rationale, and (3) quantitative evidence that such an interface can achieve high task success and low robot loss across varied hazard types. The authors acknowledge limitations, including the modest swarm size, limited hazard complexity, and the exclusive focus on non‑expert users. They propose future work on scaling to larger swarms, incorporating adaptive autonomy levels, testing with expert operators, and extending the interface to real‑world robotic platforms in disaster‑response or industrial settings.

Overall, the study demonstrates that grounding HSI interface design in well‑articulated principles can yield interfaces that enhance situational awareness, reduce cognitive load, and improve operational performance in dynamic, risk‑laden environments.