Leap is also opening the door to augmented reality by letting developers tap into the controller’s raw infrared imagery. This could be used to show your arms and body when you look downward, or show the position of other people and objects nearby.
The Oculus Rift already has a few Leap-enabled demos, but the controller’s usefulness is limited when it’s just sitting on a table or desk. It only tracks motion up to two feet away, so it’ll lose sight of users’ hands if they turn too far out of range. The head mount will let users keep their hands in front of them as they turn and move.
Still, the mount is only a half-measure for Leap as it wades into virtual reality. Eventually, the company hopes to embed its sensors into VR headsets, so that hand tracking is a standard feature. Leap says it’s already working on a new sensor for this purpose, with “greater-than-HD image resolution, color and infrared imagery, and a significantly larger field of view.”
If any of this sounds vaguely familiar, it’s because embedding directly into devices has always been a big goal for Leap. Shortly after the motion tracker launched last year, HP embedded the sensor into one of its larger laptops. But that effort hasn’t gone too far, as the use cases for motion control on a traditional laptop or desktop are slim. Manipulating 3D objects in front of a 2D screen rarely feels quite right.
Leap’s controller seems like a natural fit for virtual reality, which is all about putting you inside a 3D space. If Leap can stoke enough developer interest with its head mount, the controller may finally get its killer app.