Google’s new AI can intelligently crop videos for any screen size
1Reported today on TheNextWeb
For the full article visit: https://thenextweb.com/neural/2020/02/14/googles-new-ai-can-intelligently-crop-videos-for-any-screen-size/
Google's new AI can intelligently crop videos for any screen size
How many times have you seen a video being badly cropped when you watch it on a mobile device? It's quite frustrating and annoying, and most of the time, there's not much you can do about it.
To address this problem, Google's AI team has developed an open-source solution, Autoflip, that reframes the video that suits the target device or dimension (landscape, square, portrait, etc.).
Autoflip works in three stages: Shot (scene) detection, video content analysis, and reframing. The first part is scene detection, in which the machine learning model needs to detect the point before a cut or a jump from one scene to another. So it compares one frame with the previous one before to detect the change of colors and elements.
Once the model determines a shot, it moves on to the video content analysis to determine important objects in a scene. It uses a deep learning neural network to determine not just people or animals, but motion and moving balls in sports, and logos in commercials.
For