Skip to content

"Post-reality" video of CG images projected on a man dancing at a high rate

I do not really know what to add to the title, really. Well, I guess I should probably explain a little bit.


In 2016, researchers from the University of Tokyo published an interesting video showing a projector and a motion tracking system working together to project an image onto moving and deformed surfaces, such as a paper that slap or a person dancing shirt.

Panasonic has increased this display with a more impressive display the following year, but the original lab has replicated with a new video (spotted by New Atlas) that combines the clumsiness of the university with the clumsiness of dancing alone in the dark. And a quote from "The Matrix."

Really, it's pretty cool. Discover the material:

This dynamic projection mapping system, which they call DynaFlash v2, works at 947 fps, using a depth-sensing system operating at the same speed to determine exactly where it's going. image must be.

Not only does this leave an image tracking the movement and orientation of a person, but also deformations in the material, such as stretching or natural contortions of the body when moving.

The extreme accuracy of this process makes odd possibilities. As Ishikawa Watanabe, the head of the laboratory, says:

The dynamic mapping capability linking these components is not limited to fusing the unrealistic and colorful texture to reality. It can freely reproduce the brilliance and irregularity of non-existent materials by adaptively controlling the projected image according to the three-dimensional structure and the movement of the applicable surface.

Perhaps it's easier to show you:

Creepy, is not it? It's using the rendering techniques most often seen in games to produce the illusion that there is light shining on nonexistent tubes on the dancer's body. The illusion is remarkably convincing.

See also  Lishtot's TestDrop tells you if the water is drinkable without even touching it

It's a pretty different approach to augmented reality, and although I can not see it in a lot of shows, it's really too cool not to use it – expect to see it some cool demonstrations of technology and performance companies. the musicians. I can not wait to see what Watanabe is coming next.