NEXT
Animal Biscuits
Dec 14 2022
MERAKI Exhibition

#Human-Computer Interaction #Augmented Reality #Collaborative AR #Interactive Storytelling #Storyboarding #Accessibility #Multimedia Art #Animation #Participatory Design #Colourblind Filters #Haptic Feedback #Online Community #UI/UX Design #User Engagement

Role: Individual Project

Overview

Animal Biscuits is an multi-sensory AR experience exploring how augmented reality can support participation, accessibility, and collaboration. The project extends a static printed image into an interactive narrative, using AR as a medium to investigate human–computer interaction within an artistic context.

Problem / Purpose

The project was shaped by research into how AR can function as an accessible and flexible medium for artistic experiences. I was particularly interested in how multi-sensory interaction can improve accessibility, how mobile-based AR allows the work to adapt across different contexts and scales, and how interaction design can encourage engagement and participation. This informed the purpose of the project: to explore AR’s potential in art as a medium that not only creates more immersive and engaging experiences, but also enhances inclusiveness for diverse users.

Process

The inspiration for the artwork was Apple’s live photo. When the user presses and holds a live photo, a short animation from the time when the photo was taken will be played. The artwork uses Augmented Reality (AR) technology; when the viewer scans the photo print with the mobile app, the photo will turn into AR animation to tell the story behind it.

I designed and developed both the narrative and the AR experience. The story was first storyboarded and illustrated, then translated into animation and integrated into a mobile AR workflow. Alongside the visual narrative, I designed the interaction flow for scanning and triggering the experience, ensuring it remained clear and intuitive for first-time users.

A key part of my contribution was developing the multi-sensory and accessibility features, including dual soundtracks, haptic feedback, and colour-adjustment filters, allowing the experience to be perceived through different sensory channels. I also designed a collaborative interaction layer, enabling users to contribute to the artwork while maintaining the integrity of the original piece.

Outcome

The final outcome is an interactive AR artwork that demonstrates how storytelling, animation, and interface design can be combined with research-led approaches to create inclusive and participatory experiences. It highlights the potential of AR not just as a visual tool, but as a medium for accessible, multi-sensory, and collaborative interaction.