Detector reliably uses arm taps as input

SLAM: debunk creationism, pseudoscience, and superstitions. Discuss logic and morality.

Moderator: Alyrium Denryle

Post Reply
User avatar
Highlord Laan
Jedi Master
Posts: 1394
Joined: 2009-11-08 02:36pm
Location: Christo-fundie Theofascist Dominion of Nebraskistan

Detector reliably uses arm taps as input

Post by Highlord Laan »

http://news.bbc.co.uk/2/hi/technology/8587486.stm

Sensors turn skin into gadget control pad
Mark Ward
Technology correspondent, BBC News

Skinput, Chris Harrison
The sensors can spot many different locations on the arm

Tapping your forearm or hand with a finger could soon be the way you interact with gadgets.

US researchers have found a way to work out where the tap touches and use that to control phones and music players.

Coupled with a tiny projector the system can use the skin as a surface on which to display menu choices, a number pad or a screen.

Early work suggests the system, called Skinput, can be learned with about 20 minutes of training.

"The human body is the ultimate input device," Chris Harrison, Skinput's creator, told BBC News.

Sound solution

He came up with the skin-based input system to overcome the problems of interacting with the gadgets we increasingly tote around.

Gadgets cannot shrink much further, said Mr Harrison, and their miniaturisation was being held back by the way people are forced to interact with them.

The size of human fingers dictates, to a great degree, how small portable devices can get. "We are becoming the bottleneck," said Mr Harrison.

Skinput armband, Chris Harrison
A finished device would be far smaller than the bulky prototype

To get around this Mr Harrison, a PhD student in computer science at Carnegie Mellon and colleagues Desney Tan and Dan Morris from Microsoft Research, use sensors on the arm to listen for input.

A tap with a finger on the skin scatters useful acoustic signals throughout the arm, he said. Some waves travel along the skin surface and others propagate through the body. Even better, he said, the physiology of the arm makes it straightforward to work out where the skin was touched.

Differences in bone density, arm mass as well as the "filtering" effects that occur when sound waves travel through soft tissue and joints make many of the locations on the arm distinct.

Software coupled with the sensors can be taught which sound means which location. Different functions, start, stop, louder, softer, can be bound to different locations. The system can even be used to pick up very subtle movements such as a pinch or muscle twitch.

"The wonderful thing about the human body is that we are familiar with it," said Mr Harrison. "Proprioception means that even if I spin you around in circles and tell you to touch your fingertips behind your back, you'll be able to do it."

"That gives people a lot more accuracy then we have ever had with a mouse," he said.

Early trials show that after a short amount of training the sensor/software system can pick up a five-location system with accuracy in excess of 95%.

Accuracy does drop when 10 or more locations are used, said Mr Harrison, but having 10 means being able to dial numbers and use the text prediction system that comes as standard on many mobile phones.

The prototype developed by the research team sees the sensors enclosed in a bulky cuff. However, said Mr Harrison, it would be easy to scale them down and put them in a gadget little bigger than a wrist watch.

Mr Harrison said he envisages the device being used in three distinct ways.

The sensors could be coupled with Bluetooth to control a gadget, such as a mobile phone, in a pocket. It could be used to control a music player strapped to the upper arm.

Finally, he said, the sensors could work with a pico-projector that uses the forearm or hand as a display surface. This could show buttons, a hierarchical menu, a number pad or a small screen. Skinput can even be used to play games such as Tetris by tapping on fingers to rotate blocks.

Mr Harrison would not be drawn on how long it might take Skinput to get from the lab to a commercial product. "But," he said, "in the future your hand could be your iPhone and your handset could be watch-sized on your wrist."
I love seeing science progress. I'd snag one of these in a heartbeat. Combine it with a monocle HUD and an earbud cellphone/wireless network link and I'd be set.

Fixed the thread title to be more ... accurate.
Never underestimate the ingenuity and cruelty of the Irish.
User avatar
Stark
Emperor's Hand
Posts: 36169
Joined: 2002-07-03 09:56pm
Location: Brisbane, Australia

Re: "Mass Effect" Omni Tool soon to be a reality.

Post by Stark »

Most misleading thread title of 2010? This is an input system that isn't hovering interactive holograms and doesn't control nanotech do-anything gel.
User avatar
DudeGuyMan
Jedi Knight
Posts: 587
Joined: 2010-03-25 03:25am

Re: Detector reliably uses arm taps as input

Post by DudeGuyMan »

I'd rather have a giant keyboard that plugs into my head ala Shadowrun.
User avatar
Molyneux
Emperor's Hand
Posts: 7186
Joined: 2005-03-04 08:47am
Location: Long Island

Re: Detector reliably uses arm taps as input

Post by Molyneux »

I haven't seen any video of this, but the still images look freaking fantastic. Force-feedback is probably a bit less of a problem when you're touching something that has feeling on both ends - gives you a fairly good idea of where you're touching even before you take prioperception into account.
Ceci n'est pas une signature.
User avatar
NecronLord
Harbinger of Doom
Harbinger of Doom
Posts: 27384
Joined: 2002-07-07 06:30am
Location: The Lost City

Re: Detector reliably uses arm taps as input

Post by NecronLord »

Molyneux wrote:I haven't seen any video of this, but the still images look freaking fantastic. Force-feedback is probably a bit less of a problem when you're touching something that has feeling on both ends - gives you a fairly good idea of where you're touching even before you take prioperception into account.
I've actually seen the inventor's youtube videos before while researching Sci-fi world building ideas, so...

Superior Moderator - BotB - HAB [Drill Instructor]-Writer- Stardestroyer.net's resident Star-God.
"We believe in the systematic understanding of the physical world through observation and experimentation, argument and debate and most of all freedom of will." ~ Stargate: The Ark of Truth
User avatar
Molyneux
Emperor's Hand
Posts: 7186
Joined: 2005-03-04 08:47am
Location: Long Island

Re: Detector reliably uses arm taps as input

Post by Molyneux »

NecronLord wrote:
Molyneux wrote:I haven't seen any video of this, but the still images look freaking fantastic. Force-feedback is probably a bit less of a problem when you're touching something that has feeling on both ends - gives you a fairly good idea of where you're touching even before you take prioperception into account.
I've actually seen the inventor's youtube videos before while researching Sci-fi world building ideas, so...

Ah, I hadn't realized that the projection was just being sent from a "normal" device attached to the rig - so you have to make sure that it's aligned with the body part you're using as a control surface, or you'll wind up hitting the wrong commands.

Slightly less "OMG SCIFI", but still very neat - I honestly can't fathom how this device works, though.
Ceci n'est pas une signature.
User avatar
Dave
Jedi Knight
Posts: 901
Joined: 2004-02-06 11:55pm
Location: Kansas City, MO

Re: Detector reliably uses arm taps as input

Post by Dave »

Molyneux wrote: Slightly less "OMG SCIFI", but still very neat - I honestly can't fathom how this device works, though.
My impression was that the device detected the different sounds made by tapping different parts of the arm. Not the sounds through the air, but the sounds (vibrations) sent through the arm by a solid tap.

Presumably, each tap on a different body part sounds different, and that can be translated into an action either as a "hotkey" kind of gesture (like making the OK sign means, say, skip to next song) or by knowing what is being projected on the body (the "Settings" button is projected halfway down the left forearm; hearing a tap from halfway down the left forearm means they wanted the Settings page.)
Post Reply