Researchers at MIT have created a technology that makes it possible to stretch, move and modify objects in the captured video directly on the screen of any device, and this does not require any additional devices.
The new technology is based on capturing the movements of vibrated objects. For several years, scientists from CSAIL (Computer Science and Artificial Intelligence Laboratory), a division of MIT responsible for developments in computer technology and artificial intelligence, have been developing.
The invention of MIT is based on the analysis of vibrations passing through an object during shooting. Almost any video camera will be suitable for recording. Video snapshot analysis takes several seconds, after which interactive objects are formed on the basis of the footage, which can be changed while preserving all the physical properties. That is, it is impossible to stretch your friend’s arm by 2 meters, but you can easily take your hand to the side, lift, bend or completely remove a person from the frame. Moreover, not all objects need to vibrate in order for the algorithm to work. For bushes and trees, for example, it is enough to blow the wind, which will change the position of the leaves and branches like vibration.
The developers themselves find a lot of applications of the new technology. From shooting simple videos to creating special effects in movies and video games. MIT scientists see great potential in using technology along with virtual and augmented reality. “If we manage to improve the algorithm so that it can process objects on the fly, this will open up a huge scope for creativity. Take, for example, the now popular Pokemon Go. If all the objects around the Pokemon are calculated in real time, the pocket monster will be able to interact with them in every way: hide behind the bench or climb a tree. ”
The MIT algorithm can be used not only for entertainment purposes. It is possible to recreate the interactive details of the production lines of cars and change them directly on the tablet screen. For more information about the technology was released video available below.
The article is based on materials .
Comments
Post a Comment