A Breif Rant on The Future of Interaction Design
By Brett Victor
I see a device that knows where our body is at all moments. As we move, it registers our unique gestures and translates them into commands. Like augmented reality, everything we interact with (via touch, voice, whatever) can give us feedback and/or amplify our capabilities.
Imagine we pick up a book and flip through the pages. Our device can register each and every one of those pages and display them for us even if we are no longer looking down at the book. If we get annoyed and squint our eyes, the device knows we are no longer interested and takes that information away. If we say; “Wait a minute, what was that quote from this book I heard the other day at the movies?” the device will put up the quote and even link to the part of the movie were it was used.
When we are riding a bike this same device will know how fast we are traveling and how long (with traffic) it will take us to get to our destination. It will even be able to estimate if we are going to want a drink when we get there and have it ready if we confirm it.
Haptic feedback is the key to all of this. We will need gestures not just for “pictures under the glass” but also for real-world interactions.