[Google Storybook Creation Test] Creating a Completely Different Picture Book from a YouTube Video
0I tested a feature that could turn YouTube videos into picture books. I have several character chat gameplay videos on my channel, and among them, I chose the one-hour-long [Grock Animation] Character Chat: RE: Please Speak to the X-Like Constellation (Battle of Balkan). After a few tries, the results were impressive.
00:00 Original character chat YouTube video
04:53 A case where the content of the original video was turned into a picture book (recognizing the content of the original video)
06:49 Conversely, a case where the content was completely different from the original video, but the AI seemed to tell its own story, breaking the fourth-dimensional barrier (recognizing the text details of the original video)
The video at 06:49 shows the resulting picture book video. At first glance, it seemed like a failure because it was completely different from the YouTube content. However, upon closer inspection, I found that the names of the two characters were Grok and Gemini. The original video doesn't feature Grok or Gemini at all, but in the video description, I mentioned that I used Grok's companion animations with TTS while filming the video and that the character chat AI, Gemini Pro 2.5, produced incredible writing. While the video itself didn't reflect the content of the video, I felt it reflected what I wrote in the description and created a picture book based on my own personal storytelling.
I was curious to see what the result would be when I restarted, so I tried again and got the 04:53 video. This time, it recreated the battle scene from the original video and eliminated the characters Grok and Gemini. However, Seongharu's constellation name is Geumbong, which appears to be pronounced as Geumbong. This suggests that the video itself wasn't recognized, but rather the text in the video was read by TTS, which resulted in poor pronunciation and was pronounced as Geumbong.
Originally, the result should have been 04:53 or something similar, but it was refreshing to see a completely different result like 06:49. Above all, it was impressive that the AI creating the picture book seemed to write its own autobiographical story. While we might think AI produces only one visible result, it likely has several or even hundreds of internal thoughts during the process, some of which are not expressed in the visible result. I suspect that this particular internal thought, which should not normally be expressed, was created and expressed as a result. I found this intriguing, so I made a separate video.
#Storybook
#CharacterChat
#Storybook
#PictureBook
#storybook