Differential Analysis of Pseudo Haptic Feedback: Novel Comparative Study of Visual and Auditory Cue Integration for Psychophysical Evaluation

Pseudo-haptics exploit carefully crafted visual or auditory cues to trick the brain into"feeling"forces that are never physically applied, offering a low-cost alternative to traditional haptic hardware. Here, we present a comparative psychophysical study that quantifies how visual and auditory stimuli combine to evoke pseudo-haptic pressure sensations on a commodity tablet. Using a Unity-based Rollball game, participants (n = 4) guided a virtual ball across three textured terrains while their finger forces were captured in real time with a Robotous RFT40 force-torque sensor. Each terrain was paired with a distinct rolling-sound profile spanning 440 Hz - 4.7 kHz, 440 Hz - 13.1 kHz, or 440 Hz - 8.9 kHz; crevice collisions triggered additional"knocking"bursts to heighten realism. Average tactile forces increased systematically with cue intensity: 0.40 N, 0.79 N and 0.88 N for visual-only trials and 0.41 N, 0.81 N and 0.90 N for audio-only trials on Terrains 1-3, respectively. Higher audio frequencies and denser visual textures both elicited stronger muscle activation, and their combination further reduced the force needed to perceive surface changes, confirming multisensory integration. These results demonstrate that consumer-grade isometric devices can reliably induce and measure graded pseudo-haptic feedback without specialized actuators, opening a path toward affordable rehabilitation tools, training simulators and assistive interfaces.

💡 Research Summary

The paper investigates how carefully designed visual and auditory cues can be combined to evoke pseudo‑haptic pressure sensations on a standard tablet, providing a low‑cost alternative to conventional haptic hardware. Using a Unity‑based “Rollball” game, four participants guided a virtual ball across three textured terrains while a Robotous RFT40 force‑torque sensor recorded the real‑time vertical finger force. Each terrain was paired with a distinct rolling‑sound profile covering different frequency ranges (440 Hz‑4.7 kHz, 440 Hz‑13.1 kHz, 440 Hz‑8.9 kHz); collisions generated additional “knocking” bursts to enhance realism.

The experimental conditions comprised visual‑only, audio‑only, and combined visual‑audio cues, presented in random order. Force data were filtered, baseline‑corrected, and averaged per trial. Results showed a systematic increase in average force with cue intensity: for visual‑only trials the mean forces were 0.40 N, 0.79 N, and 0.88 N across Terrains 1‑3, while audio‑only trials yielded 0.41 N, 0.81 N, and 0.90 N respectively. When visual and auditory cues were presented together, the required force to perceive surface changes decreased by roughly 5 %, indicating a multisensory integration effect that reduces perceptual effort.

The authors interpret higher audio frequencies as inducing greater muscle activation, and denser visual textures as raising the brain’s expectation of friction, both contributing to stronger perceived forces. The combination of cues appears to amplify the sensory signal, allowing participants to detect terrain variations with less physical effort.

Key limitations include the very small sample size (n = 4), lack of control for individual sensory sensitivity, and reliance solely on force‑torque measurements without direct electromyographic data. The authors suggest future work incorporating EMG, expanding participant demographics, and systematically varying cue parameters (texture density, sound volume, frequency bandwidth) to refine models of pseudo‑haptic perception.

In conclusion, the study demonstrates that consumer‑grade isometric devices and ordinary tablets can reliably generate graded pseudo‑haptic feedback without specialized actuators. This opens pathways for affordable rehabilitation tools, training simulators, and assistive interfaces that leverage visual and auditory cues to simulate tactile forces, potentially democratizing haptic experiences across a wide range of applications.