Sunday 10 November 2024
Font Size
   
Tuesday, 28 June 2011 18:00

Kinect Hackers Are Changing the Future of Robotics

Rate this item
(0 votes)

The Kinect lets people navigate the digital world through gestures rather than mouseclicks.
Illustration: Justin Wood

For 25 years, the field of robotics has been bedeviled by a fundamental problem: If a robot is to move through the world, it needs to be able to create a map of its environment and understand its place within it. Roboticists have developed tools to accomplish this task, known as simultaneous localization and mapping, or SLAM. But the sensors required to build that map have traditionally been either expensive and bulky or cheap and inaccurate. Laser arrays cost a few thousand dollars and weigh several pounds, and the images they capture are only two-dimensional. Stereo cameras are less expensive, lighter, and can construct 3-D maps, but they require a massive amount of computing power. Until a reasonably priced, easier method could be designed, autonomous robots were trapped in the lab.

On November 4, a solution was discovered—in a videogame. That’s the day Microsoft released the Kinect for Xbox 360, a $150 add-on that allows players to direct the action in a game simply by moving their bodies. Most of the world focused on the controller-free interface, but roboticists saw something else entirely: an affordable, lightweight camera that could capture 3-D images in real time.

Within weeks of the device’s release, YouTube was filled with videos of Kinect-enabled robots. A group from UC Berkeley strapped a Kinect to a quadrotor—a small helicopter with four propellers—enabling it to fly autonomously around a room. A couple of students at the University of Bundeswehr Munich attached a Kinect to a robotic car and sent it through an obstacle course. And a team from the University of Warwick in the UK built a robot that had the potential to navigate around post-earthquake rubble and search for trapped victims. “When something is that cheap, it opens up all sorts of possibilities,” says Ken Conley of Willow Garage, which sells a $500 open source robotics kit that incorporates the Kinect. (The previous non-Kinect version cost $280,000.) “Now it’s in the hands of just about anybody.”

Robot freaks weren’t the only people to explore the Kinect’s possibilities. Researchers, visual artists, and pornographers have all begun cobbling together home-brewed Kinect projects and posting the results online. Artist Robert Hodgin built a makeshift motion-capture animation program that allows users to manipulate video of themselves on the fly, turning their bodies into bulbous cartoon characters or reflective mercury-like blobs. Two students at Germany’s University of Konstanz bolted a Kinect to a helmet, creating a bare-bones navigational system for the blind. And a company called ThriXXX built a rudimentary sex game that allows players to rub women’s body parts with a creepy disembodied hand.

None of these projects were sanctioned by Microsoft (especially that last one). Indeed, for the past few months, if you wanted to use the Kinect on anything other than an Xbox, you had to install homemade drivers cobbled together by a dedicated group of hackers. Yet the company’s official response to all this activity has gone from hostility to acceptance to vigorous support. In June, Microsoft expects to release a software development kit that makes it easier for any academic or hobbyist to build Windows applications using the Kinect’s camera and microphones. The company is also granting access to the high-powered algorithms that help the machine recognize individual bodies and track motion, unleashing the kind of power that was previously available to only a small group of PhDs. (Microsoft is also working on a commercial version of its software development kit, which will allow entire new businesses to be built using the Kinect’s technology.)

Major manufacturers have long recognized the value of letting customers modify their products, a fact obvious to anyone who has ever swapped out factory-issue tires for performance treads. Many successful technology companies have encouraged independent developers to build on top of their platforms—consider, for instance, Windows, Facebook, and the iPhone App Store. And over the years, modders have introduced several innovations that have grown into entire product categories—like mountain bikes, heart-lung machines, and rodeo kayaks.

But today, unsanctioned tinkerers have more power than ever. Sophisticated computers, sensors, and accelerometers are all common ingredients in personal electronics, available for $100 or less at Best Buy. As a result, the kind of equipment that was recently available only to research universities or major corporations is now accessible to anyone with a cell phone and a soldering iron. That has dramatically altered the kind of projects modders can take on. “If you’re talking about changing the spoiler on the back of a Ford, that serves a very specific purpose,” says Eric von Hippel, a professor of technological innovation at MIT’s Sloan School of Management. “But a depth camera or an accelerometer or a GPS chip enables not just one application but a wide range of new activities.”

When DIYers combine those cheap, powerful tools with the collaborative potential of the Internet, they can come up with the kinds of innovations that once sprang only from big-budget R&D labs. In 2009, a PhD student named Daniel Reetz turned two Canon PowerShot A590s into an improvised high-speed book scanner. He detailed the project on a website, DIYbookscanner.org, where readers have since posted hundreds of tweaks, suggestions, upgrades, and entirely new designs. The open source MPGuino project, which uses an Arduino microcontroller to track gas consumption as you drive, has inspired a small community of fans who help refine and customize the gizmo. In December 2007, a Carnegie Mellon PhD candidate named Johnny Chung Lee reverse-engineered the Nintendo Wiimote to create a 3-D display that responded to the position of his head. Videos of his hack garnered millions of views on YouTube. Eventually, Lee landed a job at Microsoft’s Applied Sciences Group, where he worked on the Kinect, among other projects.

Pages: Previous 123 | Illustration: Justin Wood Full Page | Next

Authors:

French (Fr)English (United Kingdom)

Parmi nos clients