• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

3

Trump, who has repeatedly called climate change fake, is now threatening Brazil with tariffs over the deforestation of the Amazon

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

3

Trump, who has repeatedly called climate change fake, is now threatening Brazil with tariffs over the deforestation of the Amazon

Why your finger will never replace your mouse

By
John Patrick Pullen
John Patrick Pullen
Down Arrow Button Icon
By
John Patrick Pullen
John Patrick Pullen
Down Arrow Button Icon
August 6, 2013, 5:00 AM ET
Can’t touch this.

FORTUNE — He shot me. After a good eight seconds of flailing, grabbing, and poking at the air above my desk, Frank Welty finally unholstered his sidearm and put me out of my misery. Alas, it was only a game, but I never really stood a chance. My shooter, which in this case was my pointer finger, hadn’t hit a damn thing all day.

The game,
Fast Iron
, is just one of dozens of apps available for the newly launched Leap Motion Controller. A peripheral that lets users control their computer through hand gestures, this device showed plenty of promise when it was announced in May 2012. Now, more than a year later, the $79 product has come to market, and after a week of feeling it out, it’s hard to point a finger at what exactly is wrong with gesture-based computing, at least in its current state.

Setting up the Leap Motion Controller was unexpectedly easy. I had imagined having to input measurements like the controller’s distance to the screen, or heeding requirements like keeping the device at a certain height, but none of that was necessary. Other than downloading a software suite, the peripheral was more-or-less plug-and-play, the unit powered and connected to my Mac via a USB cable.

The Leap Motion software involved minimal hand-holding, and gave the impression that gesture-based controls would be easy to master, with the sensor seeming to pick up each finger and hand rotation cleanly. But the program’s lack of finish caught my eye — running on my Mac, the software’s full-screen capability resized all my other applications windows (a huge annoyance), and its graphics looked choppy, almost like they were low-resolution. The device couldn’t detect my hands shaking with worry over these concerns, but in hindsight, they were clear indicators of a lack of finish that would plague my experience with the controller.

MORE: The myth of America’s missing software engineers

For example, as I continued pawing through the device’s compatible software, poor graphics soon became the least of Leap Motion’s problems. The company’s Airspace Store, a proprietary app marketplace that sells third-party created software for the device, offers users a mix of free and paid apps for both Macs and PCs. The selection is mostly games, but there are learning and productivity titles already in the mix that show the range of what the Leap Motion Controller can do.

The first app I tried out was Swoosh. Upon launching the program, my computer totally freaked out, as if I was using the Leap to shadow box. At the same time, iTunes mysteriously launched and started playing the first movie file in my library (Anchorman, if you must know), blasting Swoosh’s music over the video. This happened every time I launched the third-party title, until finally I figured out the problem. Swoosh is a deejaying app that plays music from your iTunes library, and users can “spin” and “scratch” the tracks like a record with the Leap Motion Controller. I only discovered this after locating the app’s missing full-screen window, which for some unknown reason had been minimized. And when I finally loaded a song from my library into the software, the controls were unresponsive and unpredictable. I couldn’t do much of anything with it, except for throw my hands up and walk away.

That experience became a familiar one as I continued testing the device. I downloaded Frog Dissection, and managed to somehow zip open a virtual reptile using “wax on, wax off” gestures à la Karate Kid. I fiddled with Flocking, a visualization app that looks great but bores quickly, with simulated fish swimming to bits of light controlled by my fingers. I pinched and zoomed through the virtual universe with Exoplanet but had a heck of a time touching the stars. (Imagine trying to poke a pin with a wet noodle — it will make you reconsider any belief that God sticks his fingers in our tiny earthly concerns.). Meanwhile, another visualization app, Gravilux, worked as well as it does on other platforms (Android, iOS, Mac, and PC). Its developer, Scott Snibbe, also ported his iOS-based music app, OscilloScoop, to the Leap platform, proving perhaps that the controller’s problems are more about software execution than anything else.

While the Leap Motion’s games are underwhelming, there’s no denying that entertainment plays an important role in emerging technology. Just like computer gamers from the 1980s and 1990s evolved into the computer-savvy workforce at the 2000s tech boom, and the social media generation has matured into a crop of info-fueled workers today, forward-leaning products like the Leap Motion Controller have the potential to breed a future wave of dextrous, gesture hackers.

MORE: Too busy? Too lazy? There’s a startup for that.

And though it is nowhere near as powerful (or expensive) as Microsoft’s (MSFT) Kinect sensor, the Leap Motion Controller did detect every movement — to a fault. If I pointed my finger out, the device often detected my thumb, too. If I was wearing my Nike+ (NKE) Fuelband, it would think the bracelet’s shiny metal clasp was another, mystery finger. Still, as an everyday Mac user, I am jealous of the Windows 8 touch interface, and I had hoped to use the Leap Motion as a smear-free touchscreen to drive my Apple (AAPL) computer — if only I could adjust to its overactive sensors.

To run the Mac operating system, Airspace offers two apps: Touchless for Mac (they have a PC equivalent, too) and Better Touch Tool. Both free programs, Touchless was made by Leap Motion, while Better Touch Tool was developed by German indie coder Andreas Hegenberg. Touchless consists of two zones, one for “hovering” (or moving the cursor) and the other for “touching” (or clicking the mouse). Using it was precise but awkward, akin to trying to use an iPhone with magnetic gloves. Sure, you can do it, but it wasn’t really meant to work like that. The Mac operating system’s buttons were too small to be pressed with a finger, let alone a quivering, airborne ghost digit that’s as fat as a hot dog. After about a half hour of trying to acclimate to the system, I finally gave the software the finger (totally undetected!) and went back to my trusty mouse.

Better Touch Tool returned much improved results but still has a way to go. By turning actual gestures (bringing both hands together like a slow clap, for example) into keyboard shortcuts (close window, sleep, etc.) at last the Leap sprang to life. I programmed a slew of moves that made sense to me, such as three finger wag left as “back” in Safari, but when it came time to use them, I swear the device wasn’t looking. Waving, I got nothing. Flicking, not a blip of recognition. Finally, I mimed choking the wretched thing, but my computer stared back, unamused.

So, I’ve decided to wave goodbye to the Leap for now. Hopefully, the next time I plug it in, I can give it a thumbs up — and maybe then, it will know exactly what I mean.

About the Author
By John Patrick Pullen
See full bioRight Arrow Button Icon

Latest in

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in

Man in a white shirt and jacket.
InnovationBrainstorm Tech
Marc Lore’s robots make 500 burrito bowls an hour. A human can make 45
By Amanda GerutJune 9, 2026
6 hours ago
Sam Bankman-Fried formally files for pardon—but White House reiterates that FTX cofounder’s odds are slim
CryptoSam Bankman-Fried
Sam Bankman-Fried formally files for pardon—but White House reiterates that FTX cofounder’s odds are slim
By Camila Grigera NaonJune 9, 2026
8 hours ago
A trader works on the floor of the New York Stock Exchange (NYSE) in New York, US, on Wednesday, June 3, 2026
InvestingWall Street
Wall Street dumped nearly $1 trillion in tech stocks by midday—then clawed it back and bought peanut butter and paint
By Eva RoytburgJune 9, 2026
9 hours ago
The entrance to a U.S. Immigration and Customs (ICE) detention facility
North AmericaDepartment of Homeland Security
Texas ICE facility spent $11.5 million on guards, medical services, transportation and meals weeks before the camp even held detainees, GAO finds
By Michael Biesecker, Ryan J. Foley and The Associated PressJune 9, 2026
9 hours ago
AI isn’t replacing Hyatt’s salespeople—it’s freeing up a full day of work every week, according to the CEO
AIBrainstorm Tech
AI isn’t replacing Hyatt’s salespeople—it’s freeing up a full day of work every week, according to the CEO
By Sharon GoldmanJune 9, 2026
9 hours ago
America’s grid is reeling. General Motors offers itself as a distributed utility in disguise
EnergyAutos
America’s grid is reeling. General Motors offers itself as a distributed utility in disguise
By Nick LichtenbergJune 9, 2026
9 hours ago

Most Popular

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
Asia
Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
By Kate O'Keeffe and BloombergJune 8, 2026
1 day ago
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
Economy
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
By Nick LichtenbergJune 9, 2026
14 hours ago
Trump, who has repeatedly called climate change fake, is now threatening Brazil with tariffs over the deforestation of the Amazon
Environment
Trump, who has repeatedly called climate change fake, is now threatening Brazil with tariffs over the deforestation of the Amazon
By Sasha RogelbergJune 8, 2026
1 day ago
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
Success
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
By Preston ForeJune 8, 2026
2 days ago
Current price of oil as of June 8, 2026
Personal Finance
Current price of oil as of June 8, 2026
By Joseph HostetlerJune 8, 2026
2 days ago
Gen Zers are arriving at college unable to even read a sentence—professors warn it could lead to a generation of anxious and lonely graduates
Success
Gen Zers are arriving at college unable to even read a sentence—professors warn it could lead to a generation of anxious and lonely graduates
By Preston ForeJune 7, 2026
3 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.