Their algorithm, Photo Wake-Up, can take a person from a 2D photo or a work of art and make them run, walk or jump out of the frame. The system also allows users to view the animation in three dimensions using augmented reality tools. The researchers will be presenting their results June 19 at the Conference on Computer Vision and Pattern Recognition in Long Beach, California. This research first attracted media attention when it was posted in preprint form in December on ArXiv.
"This is a very hard fundamental problem in computer vision," said co-author Ira Kemelmacher-Shlizerman, an associate professor at the UW's Paul G. Allen School of Computer Science & Engineering. "The big challenge here is that the input is only from a single camera position, so part of the person is invisible. Our work combines technical advancement on an open problem in the field with artistic creative visualization."
Researchers - Person - Photo
Previously, researchers thought it would be impossible to animate a person running out of a single photo.
"There is some previous work that tries to create a 3D character using multiple viewpoints," said co-author Brian Curless, a professor in the Allen School. "But you still couldn't bring someone to life and have them run out of a scene, and you couldn't bring AR into it. It was really surprising that we could get some compelling results with using just one photo."
Applications - Photo - Wake-Up - Team - Researchers
The applications of Photo Wake-Up are numerous, the team says. The researchers envision this could lead to a new way for gamers to create avatars that actually look like them, a method for visitors to interact with paintings in an art museum -- say sitting down to have tea with Mona Lisa -- or something that lets children to bring their drawings to life. Examples in the research paper include animating the Golden...
Wake Up To Breaking News!