Augmented reality provides new possibilities to propose environments where the designers can take advantage of the physicality of the artifacts while keeping the versatility of digital environments. Mixed objects can therefore provide new media in the interactions between stakeholders. Besides, the increasing interest in user participation in early design phases is limited by the poor representations or the expensive mock ups to be provided in design meetings. Therefore, understanding the role of these mixed artifacts by analyzing and characterizing the interactions is crucial to the development of both design methods and environments. By focusing on multimodal interactions, we aim at providing new results in terms of the design process, in particular by studying the contribution of the gesture in collaborative product co-creativity sessions but also by understanding the role of these multiple interactions in an augmented reality environment.
Deep Dive into Analysis of the co-design activity: influence of a mixed artifact and contribution of the gestural function in a spatial augmented reality environment.
Augmented reality provides new possibilities to propose environments where the designers can take advantage of the physicality of the artifacts while keeping the versatility of digital environments. Mixed objects can therefore provide new media in the interactions between stakeholders. Besides, the increasing interest in user participation in early design phases is limited by the poor representations or the expensive mock ups to be provided in design meetings. Therefore, understanding the role of these mixed artifacts by analyzing and characterizing the interactions is crucial to the development of both design methods and environments. By focusing on multimodal interactions, we aim at providing new results in terms of the design process, in particular by studying the contribution of the gesture in collaborative product co-creativity sessions but also by understanding the role of these multiple interactions in an augmented reality environment.
Analysis of the co-design activity: influence of a mixed artifact
and contribution of the gestural function in a spatial augmented
reality environment
Maud Poulin
Univ. Grenoble Alpes, CNRS, Grenoble INP,
G-SCOP,
46 Avenue Felix Viallet, 38000 Grenoble,
France
maud.poulin@grenoble-inp.fr
Cédric Masclet
Univ. Grenoble Alpes, CNRS, Grenoble INP,
G-SCOP,
46 Avenue Felix Viallet, 38000 Grenoble,
France
cedric.masclet@gscop.eu
Jean-François Boujut
Univ. Grenoble Alpes, CNRS, Grenoble INP,
G-SCOP,
46 Avenue Felix Viallet, 38000 Grenoble,
France
jean-francois.boujut@grenoble-inp.fr
ABSTRACT
Augmented reality provides new possibilities to propose
environments where the designers can take advantage of
the physicality of the artifacts while keeping the versatility
of digital environments. Mixed objects can therefore
provide
new
media
in
the
interactions
between
stakeholders. Besides, the increasing interest in user
participation in early design phases is limited by the poor
representations or the expensive mock ups to be provided
in design meetings. Therefore, understanding the role of
these mixed artifacts by analyzing and characterizing the
interactions is crucial to the development of both design
methods and environments. By focusing on multimodal
interactions, we aim at providing new results in terms of
the design process, in particular by studying the
contribution of the gesture in collaborative product co-
creativity sessions but also by understanding the role of
these multiple interactions in an augmented reality
environment.
KEY-WORDS
Co-design;
activity
analysis;
augmented
reality;
intermediary objects; multimodal interactions; human
system interaction
INTRODUCTION
The G-SCOP lab and six of its partners were involved in
the European project SPARK H2020 (http://spark-
project.net/). The goal of the project is to facilitate
interactions within co-design sessions involving designers
and customers. The project has provided a responsive ICT
platform based on Spatial Augmented Reality (SAR)
technology. One of the objectives of the SPARK project
was to study the influence of a mixed artifact (in a spatial
augmented reality environment) on the interactions
between designers and clients, and to determine if these
influences are beneficial for the overall results from the co-
design sessions. This allowed us to focus on gestures made
during
artifact-centric
interactions.
Thanks
to
the
development of a real-time quantitative data collection tool
and the constitution of an artifact-based interaction coding
methodology, we were able to gather information on the
type of artefact used by designers and clients during these
interactions. Six real co-design sessions were conducted
using three different technologies: spatial augmented reality
(SAR), augmented reality (AR), and a standard session of
tangible artifacts. The results obtained in this project
showed
that
artifact-centric
interactions
(tangible,
numerical, mixed) were more used than unsupported
artifact
interactions
(about
70%
of
artifact-centric
interactions against 30% of ephemeral interactions).
Although we have collected results showing a major trend
of artifact-centric interactions in contrary to gestures made
in the air, we still know little on the use of these latest
category. This is why we want to deepen our work on the
influence of such a technology, involving a mixed artifact,
on the co-design process. For this, we must proceed to an
analysis of the co-design activity by the speech and the
gesture of which we will strive to define the roles.
CONTEXT AND PRELIMINARY RESULTS
Co-designing is a large and complex human activity where
the problem is still poorly defined, and involves several
acceptable solutions at the end of the sessions [1]. Given
the co-evolution of problem-solution in design [2], many
studies have been conducted to analyze and understand the
cognitive activity underlying the design task. Ericsson and
Simon [3] are at the origin of the method of analysis of
individual protocols whose objective is to understand the
cognitive mechanisms and processes that produce relations
between the stimulus and the response that appear during
human activity. However, verbal interactions remain the
most analyzed and traditionally used modality during
protocol analysis. Indeed, Jiang and Yen [4] have identified
that the use of verbal protocol analysis has significantly
increased since the Ericsson and Simon publications and
that two types of studies coexist in the literature: the
analysis of the individual design and group design analysis
with a predominance for the method of “think-aloud” [5].
Wishing to stay closer to the reality of the co-design
sessions, think-aloud method does not appear to be relevant
in our study because it is more relevant in an individual and
experimental design situation.
A study c
…(Full text truncated)…
This content is AI-processed based on ArXiv data.