How-To on creating stereo "3D" 360s and 180s in a number of tools made for the Unreal Engine
22Why capturing standard video & images isn’t enough when it comes to VR promotional material.
0:00 Opening
Examples of 360s done to promote gaming or movie experiences
5:07 - Hellblade: Senua’s Sacrifice - https://youtu.be/Kz2xpeGkcRU
7:51 - VR Spacewalk Experience | BBC HOME - https://youtu.be/hEdzv7D4CbQ
9:52 - GTA V - 360 VR Video - https://youtu.be/SWiWKrJdb18
10:51 - Darth Vader Immortal - https://youtu.be/GcLhDx10Em0
11:54 - Hot Cocoa in VR - https://youtube.com/playlist?list=PLqnhoKrXoLPEAkSfPvk1WlOvYqsOVpSrZ
13:43 - Excursion: 137 Minutes on the Moon - https://youtube.com/playlist?list=PLqnhoKrXoLPEbIPDT4AeJUOG31u5cwCmG
Tools for capturing and editing Video and Audio in the Unreal Engine
17:20 - Kite & Lightning Panoramic Capture Tool - https://docs.unrealengine.com/en-US/WorkingWithMedia/StereoPanoramicCapture/index.html
20:52 - NVIDIA Ansel - https://www.nvidia.com/en-us/geforce/geforce-experience/ansel/#:~:text=NVIDIA%20Ansel%20is%20a%20powerful,%2C%20HDR%2C%20and%20stereo%20photographs.
22:01 - Surreal Capture - https://www.surrealcapture.com/
24:40 - Unreal Scene Capture Cube - https://docs.unrealengine.com/en-US/Resources/ContentExamples/Reflections/1_6/index.html#:~:text=Scene%20Capture%20Cubes%20capture%20a,a%20texture%20within%20any%20Material.
25:43 - John Carmack’s Quest (Android) 360 capture player - https://developer.oculus.com/downloads/package/vr5kplayer/
29:08 - Spatial Media Metadata Injector - https://github.com/google/spatial-media/releases
30:24 - Google 180 Creator - https://arvr.google.com/vr180/apps/
- Adobe Premiere
Video
30:53 Audio - http://www.willyurman.com/teaching/handouts/Ambisonic_in_Premiere.pdf
31:22 - Facebook Spatial Audio - https://www.facebook.com/formedia/blog/introducing-spatial-audio-for-360-videos-on-facebook
31:39 - Reaper Digital Audio Workstation - https://reaper.fm
360 Capturing ﹘ The Process
33:24 - Panoramic Capture Tool
Quick Start - https://docs.unrealengine.com/en-US/WorkingWithMedia/StereoPanoramicCapture/QuickStart/index.html
Reference - https://docs.unrealengine.com/en-US/WorkingWithMedia/StereoPanoramicCapture/Reference/index.html
Tips & Tricks - https://docs.unrealengine.com/en-US/WorkingWithMedia/StereoPanoramicCapture/TipsAndTricks/index.html
Other stuff to make your life easier - https://www.unrealengine.com/en-US/tech-blog/capturing-stereoscopic-360-screenshots-videos-movies-unreal-engine-4?sessionInvalidated=true
47:46 - NVIDIA Ansel Photography Plugin
Overview - https://docs.unrealengine.com/en-US/WorkingWithMedia/Ansel/Overview/index.html
Variable Reference - https://docs.unrealengine.com/en-US/WorkingWithMedia/Ansel/Reference/ConsoleVariables/index.html
Testing - https://docs.unrealengine.com/en-US/WorkingWithMedia/Ansel/Testing/index.html
Missing Ansel folder - https://nvidia.custhelp.com/app/answers/detail/a_id/4932
Ibrews ‘Macro Creator’ hack to capture video frames - https://gumroad.com/l/dAgAT
1:01:59 - Unreal Scene Capture Cube
Overview
Implementing (see this video)
Forum - https://forums.unrealengine.com/development-discussion/rendering/40943-cuberendertarget-to-2d-texture
Sergey Marasov - http://brabl.com/360-video-capture-in-unreal-engine-4/
1:13:00 - Unreal Stereo Capture Cube
Overview
Implementing (see this video)
1:17:45 - Surreal Capture
Overview
Tips and Tricks
360 Image Uploading
- Kuula 360 - https://kuula.co/
360 & 180 Video Uploading
- YouTube - https://support.google.com/youtube/answer/6178631?hl=en
- Facebook - https://www.facebook.com/help/828417127257368
- Oculus Quest or other Android based VR HMD - https://developer.oculus.com/blog/techniques-for-improved-vr-video-w-john-carmack/?locale=es_ES
- Standalone 360 Players
Desktop
"Hot Cocoa in VR" YouTube 360 - https://youtu.be/B0yN4gyi7K8
"Hot Cocoa in VR" Google 180 - https://youtu.be/-tpR8_uluN4
Actual "Hot Cocoa in VR" VR app for Steam VR & Oculus (desktop) - https://owlcreektech.itch.io/hot-cocoa-in-vr (Open XR coming soon)