pixelLOG: Logging of Online Gameplay for Cognitive Research

Traditional cognitive assessments often rely on isolated, output-focused measurements that may fail to capture the complexity of human cognition in naturalistic settings. We present pixelLOG, a high-performance data collection framework for Spigot-based Minecraft servers designed specifically for process-based cognitive research. Unlike existing frameworks tailored only for artificial intelligence agents, pixelLOG also enables human behavioral tracking in multi-player/multi-agent environments. Operating at configurable frequencies up to and exceeding 20 updates per second, the system captures comprehensive behavioral data through a hybrid approach of active state polling and passive event monitoring. By leveraging Spigot’s extensible API, pixelLOG facilitates robust session isolation and produces structured JSON outputs integrable with standard analytical pipelines. This framework bridges the gap between decontextualized laboratory assessments and richer, more ecologically valid tasks, enabling high-resolution analysis of cognitive processes as they unfold in complex, virtual environments.

💡 Research Summary

PixelLOG is a high‑performance, Spigot‑based Minecraft plugin designed to capture fine‑grained behavioral data for cognitive research. The authors identify a gap in existing tools, which are largely oriented toward artificial‑intelligence agents and provide coarse, low‑frequency sampling unsuitable for human cognition studies. PixelLOG addresses this by combining continuous state polling with event‑driven logging, achieving configurable sampling rates that exceed 20 Hz for dynamic variables (e.g., player position, velocity) while using lower frequencies for static world attributes.

The system architecture is layered: a central MainController manages the plugin lifecycle and creates a dedicated PixelPlayer object for each connected user, ensuring strict data isolation. Within each PixelPlayer, a Logger schedules multiple PlayerStatePollers via Spigot’s scheduler, allowing researchers to define high‑frequency and low‑frequency pollers independently. Simultaneously, a PlayerEventListener intercepts discrete in‑game actions such as block placements, item usage, and combat events. The Assembler component merges these continuous and discrete streams into chronologically ordered JSON files, which can be stored locally or streamed over TCP to external databases.

Technical contributions include: (1) scalable multi‑player support through thread‑safe queues that prevent bottlenecks under high load; (2) adaptive temporal resolution that balances computational overhead with data fidelity; (3) a hybrid data‑capture strategy that preserves both state trajectories and salient event markers; and (4) a standardized JSON schema compatible with common data‑science pipelines (Python pandas, R, TensorFlow, etc.). Performance tests show stable operation with up to 100 concurrent players, minimal data loss, and CPU usage remaining below 15 % on a modest server.

Compared with related platforms such as Microsoft’s Project Malmo and MineDojo, which focus on reinforcement‑learning agents and offer limited configurability, PixelLOG provides human‑centric data collection, higher sampling granularity, and extensible multi‑user session management. The authors also cite successful deployments in two downstream projects: pixelDOP‑A (validation of immersive cognitive mini‑games) and AMLEC (a Bayesian active‑learning study of working memory).

Limitations are acknowledged: the current implementation depends on Spigot 1.20.4, logs are written to local disk (raising storage concerns for large‑scale studies), and physiological signals (e.g., heart rate, eye tracking) are not synchronized within the framework. Future work aims to add real‑time preprocessing, anomaly detection, and seamless integration with external multimodal streams, as well as to maintain compatibility with newer Spigot releases.

In summary, PixelLOG bridges the divide between decontextualized laboratory assessments and ecologically valid, process‑based evaluation by delivering a robust, high‑frequency logging solution for complex, interactive virtual environments. Its open‑source nature and modular design make it a valuable infrastructure for researchers across cognitive science, psychology, educational technology, and human‑computer interaction seeking to study cognition in naturalistic, dynamic settings.