Satisfying Interaction: Touch-Based Metaphors
We think with our bodies as well as our minds. My designs leverage spatial cognition and proprioceptive memory to enable fluid and instinctual ways to discover meaning in data. I was awarded a Microsoft Research gift to prototype radically different interface metaphors for the production of music and video content. Valuing the element of play in discovery, our work began by shutting off the table-sized touch surface and pouring a bag of rice on the screen. I videotaped students as they interacted with the rice and found gestures that had naturally associated meanings such as gathering, cleaning up, or digging down. We interviewed artists to map these within the context of digital editing tools and applied these to the design approach.
We developed three new approaches to touch interfaces: one that enables searching for connections by ‘wiggling’ icons, similar to a patch bay; another that provides for a multi-touch zoomable user interface; the final offering a way to allow the user to build interfaces themselves at the same time they were working on the content, modifying their tools to meet the task. This work led to a DARPA grant to discover ways to use the body to better analyze large datasets as part of their XDATA and, later, PLAN-X projects and integrating touch techniques with our tablet-based hybrid immersive viewer – the inVRrse.
Using the Phantogram Technique for a Collaborative Stereoscopic Multitouch Tabletop Game. 10th International Conference on Creating, Connecting, and Collaborating through Computing, pp. 23-28, 2012.
Tablet-Based Interaction Panels for Immersive Environments. IEEE Virtual Reality, pp. 91-92, pp.175-176, 2014. Demonstration abstract.
A Raycast Approach To Hybrid Touch / Motion Capture Virtual Reality User Experience. ACM Symposium on Spatial User Interaction, p. 160, 2014. Poster.
Design Approach for Multi-Touch Interfaces in Creative Production Environments. Workshop of the 2nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 365-366, 2010.
Hybrid stereoscopic viewing device. Hoberman, P., Bolas, M., Phan, T. 2014: U.S. Patent Application No.14/216,143 (Pending publication)
The Surface and the Recording Studio, Microsoft Faculty Summit Presentation, 2010
Uncovering Natural Gestures
User Authored Live Controls
Immersive Touch, Physiological Testing