Scribd
Upload
47 views1 page

Skintro CACM2011

Skinput adds interactivity via a pico-projector and vibration sensing. The change induced by ubiquitous projection is that the computer disappears, says scott klemmer. Systems like Skinput that flexibly sense body pose, movements, and gestures illustrate how interaction design benefits from innovating both software and hardware, he says.

Uploaded by

srklemmer
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
47 views1 page

Skintro CACM2011

Skinput adds interactivity via a pico-projector and vibration sensing. The change induced by ubiquitous projection is that the computer disappears, says scott klemmer. Systems like Skinput that flexibly sense body pose, movements, and gestures illustrate how interaction design benefits from innovating both software and hardware, he says.

Uploaded by

srklemmer
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 1

research highlights

Doi:10.1145/1978542.1 9 7 8 5 6 3

technical Perspective skintroducing the future


By Scott Klemmer
for mobile devices seem intrinsically in conflict. For carrying, the smaller the better. Yet for interacting, more real estate is generally better. This tension makes for great sketch comedy: absurdly tiny phones that are impossible to interact with, or giant touch screens that are back-breaking to carry. Chris Harrison and colleagues may have the last laugh. What if the body itself could be an input surface? The average body surface area of an adult (1.73 m2, according to Wikipedia) is 400 times greater than a touch-screen phone (0.004 m2, by my estimate). Sailors and tattoo parlors have long seen opportunities for the body as a display. Skinput adds interactivity via a pico-projector and vibration sensing: tap an image projected on your arm, and the resulting arm vibrations control an application. How is this a harbinger of a fundamental change, and what makes its appeal more thanskin deep? One powerful contribution of the graphical interface is input on output: direct manipulation. In the coming years, pervasive direct manipulationwhere Skinput is an early foraywill likely mature and become a major force. Every surface is a potential site for both projection and input, breaking the picture frame of the desktop interface. Phenomenologically, the change induced by ubiquitous projection is that the computer disappears by seamlessly weaving computing into the physical world. Skinput showcases three key tools for building disappearing computers: rich sensing, machine learning, and flexible projection. Systems like Skinput that flexibly sense body pose, movements, and gestures illustrate how interaction design benefits from innovating both software and hardware. Does Skinput spell doom for touchscreens? Maybe not. The discourse around interactive systems often
t wO c r i t i c a l G Oa l s

frames technical evolution in terms of generations of interfaces. That there were punch cards. Then the terminal. Then the mouse and graphical interface. Each supplanting the previous one. On this view, the logical question to ask is: Whats next? With input, this is often phrased as: What will replace the keyboard and mouse? Of course, different paradigms are good for different tasks. While new tools reshape the landscape and supplant some old tools, people benefit from a diverse interface ecosystem. Today, ones computing likely spans direct manipulation, gestures, keyboard commands, and search. The screwdriver does not obviate the value of a hammer. In some cases, ubiquitous projection and sensing will enable fluid interactive experiences. In other cases, like text messaging, technologies can become powerful and pervasive even though the interface itself is quite primitive. Isnt an interactive forearm a little ridiculous? (Come on! People wont really interact this way.) Watch the video (http://research.microsoft.com/ cue/skinput); its amazing. Also, Skinput is an early prototype in two important ways. First, its a sketch of a possible future: suggestive rather than complete. The viewers imagination is key to filling in the details. Menu selection is just one of many things this approach enables. Second, it instantiates a time-honored computer science research strategy: Build the bulky, expensive thing now to understand what its like to live in a world with that technology; future revisions will get smaller and cheaper. It pays to be broad when prototyping the future. Explore 10 future realities, and if any come to pass, thats a win. Furthermore, research can succeed by inspirational value beyond its direct utility. Expanding the input repertoire will pay broad dividends. With the forearm as the input surface, Skinput is very literally embod-

ied interaction. Embodied interactions can offer incredible power by leveraging the amazing implicit intelligence of the human perceptuo-motor system. At the same time, bodies have clear physical limitations; you get tired holding your arm still. Unless the goal is to get into better shape, such mundane factors impose real constraints on what interfaces youre likely to actually adopt. One enabling insight that cant be ignored: the tap sensing is really creative. (By which I mean, I wish Id thought of that.) Tapping on skin yields both transverse waves (ripples) and longitudinal waves (bone vibration). These subtle waves generally elude peoples notice, but high-frequency sensors can track them reliably. (So can high-speed camerasanother reason to watch the video.) The authors use piezoelectric sensors to measure the deformation. Today, such sensors are commonly used as guitar pick-ups. Increasingly diverseand cheapsensing technologies make this a really exciting time for inventing new interactive systems. Research probes like Skinput currently require building bespoke systems. The next step is to flesh out the design space of alternatives, understand their trade-offs, and build theories. This exploration will require tools (and curricula) for rapidly and flexibly creating interfaces with rich sensing and machine learning. The DIY and research communities have made great strides here, and much exciting work remains. Interactive tattoos? That remains future work.

Scott Klemmer ([email protected]) is an assistant professor of computer science at stanford university, where he co-directs the human-computer Interaction group.

2011 acm 0001-0782/11/08 $10.00

110

Communi Cations of t h e aC m

| au g uST 2 0 1 1 | vo l . 5 4 | n o. 8

You might also like