19th Ave New York, NY 95822, USA

"Post-reality" video of CG images projected on a man dancing at a high rate

I'm not sure what to add to the title, really. Well, I guess I should probably explain a little bit.

In 2016, researchers from the University of Tokyo published an interesting video showing a projector and a motion tracking system working together to project an image onto moving and deformed surfaces, such as a paper flapping or the shirt of the person dancing.

Panasonic has increased this display with a more impressive display the following year, but the original lab has applauded with a new video (spotted by New Atlas) that combines the clumsiness of the university with the clumsiness of dancing alone in the dark. And a quote from "The Matrix."

Really, it's pretty cool. Discover the material:

This dynamic projection mapping system, which they call DynaFlash v2, works at 947 frames per second, using a depth detection system operating at the same rate to determine exactly where to find it. image must be.

Not only does this leave an image tracking the movement and orientation of a person, but also deformations in the material, such as stretching or natural contortions of the body when moving.

The extreme precision of this process makes odd possibilities. As Ishikawa Watanabe, the head of the laboratory, says:

The dynamic mapping capability linking these components is not limited to fusing the unrealistic and colorful texture to reality. It can freely reproduce the gloss and irregularity of non-existent materials by adaptively controlling the projected image according to the three-dimensional structure and the movement of the applicable surface.

Perhaps it's easier to show you:

Creepy, is not it? It's using the rendering techniques most often seen in games to produce the illusion that there is light shining on nonexistent tubes on the dancer's body. The illusion is remarkably convincing.

This is a pretty different approach to augmented reality, and although I do not see it in a lot of shows, it's really cool not to use it – expect to see some cool demonstrations of technology and performance companies. the musicians. I can not wait to see what Watanabe is coming next.

Leave a comment