PixelTone is an image editing app that takes voice commands
We already use voice recognition to add appointments to our calendars and look up stuff (and make our phones say silly things). But soon, you might be able to edit an image by simply telling your photo editing app what you want to do.
Programmers from Adobe Research and the University of Michigan are working on a prototype app called PixelTone that does exactly that. It’s not just a concept, either; the team already has a working app that adjusts images using a combination of voice commands and gestures.
Editing your photos with the app is as simple as telling it to darken part of the photo or to apply one of your favorite filters. The app is also capable of some more hands-on editing that lets you select where you want to crop the picture or apply blur in a certain direction.
In addition to some basic photo editing commands, the app is also intelligent enough to learn objects. For example, you could circle a person’s face or an object and identify it by name, and the app will remember who or what it is. This allows you to quickly make later adjustments to elements of the photo—such as “brighten Sara’s face” or “change the color of this shirt” without having to reselect the area.
The researchers will present their work on the PixelTone app this April at the Computer-Human Interaction conference in Paris. If you are interested in learning more about this new technology, Michigan assistant professor Eytan Adar has posted a paper documenting the app on his website.