Название: A Dialogue of the Senses: Designing Interaction with the Body in Mind
Автор: Sile O’Modhrain
Издательство: The MIT Press
Год: 2026
Страниц: 469
Язык: английский
Формат: pdf (true)
Размер: 32.7 MB

A comprehensive introduction to embodied cognition for designers of interactive artifacts, systems, and environments.

In this introduction to embodied cognition and the design of interactive systems, A Dialogue of the Senses, Sile O’Modhrain argues for turning the interaction design process inside out. We cannot design the experiences of those who use our artifacts and devices, she says; we can only put in place the conditions under which users can bring forth, through their actions, an embodied experience of the world that includes the things we build. Our interactions with artifacts and devices are physical interactions, even if partly or wholly simulated.

The world our devices bring into being is one that people experience by moving their bodies to elicit changes in the stimuli they pick up through their senses. O’Modhrain centers the role of movement in interaction design, introducing techniques of motion capture, design practices in movement-based interaction, and considerations of the many perceptual and motor skills that people bring to bear when they interact with their digitally augmented world through devices such as phones, home assistants, and VR gaming controllers.

This book is about the relationship among perception, action, and design. It is intended as a resource for designers of interactive digitally augmented systems and artifacts that test the ability to learn through experience, just as in everyday life. Such learning is more than remembering a sequence of tasks. It goes down to the muscular level, so that seeing, hearing, or feeling the body’s responses to an action ­will guide ­performance of a subsequent action. Anyone who has ever played an augmented real­ity (AR) or virtual real­ity (VR) game that tracks player movements and gives visual, auditory, and/or haptic feedback ­will recall the ­process of figuring out what the system expects. In a virtual golf game, for example, a player might have to deduce what the system considers a “good” swing. This is subtly dif­fer­ent from the memory of a good swing with a real golf club, but the body nonetheless quickly learns how to do what the game expects. This book investigates our ­human ability to learn how to perform actions in a computationally enhanced environment.