What is Volumetric Video?
Real Scene Captured
Volumetric video starts with a capture stage where a scene is surrounded by over a dozen volumetric video cameras. Videos from these cameras combine to create a three-dimensional representation of a real scene.
Complete Freedom of Movement
Volumetric video creates 3D world where users have complete freedom of movement. They have the ability to move in front, behind, and even above the 3D models.
Stream Everywhere at Once
Volumetric Video can be streamed anywhere – home, office, laptop, phone, or XR headset. Multiple people can view the same stream simultaneously, each with their own perspective.
Volumetric Use Cases
Live Sports
Imagine 100 cameras surrounding a soccer pitch in a stadium. All the players and fans are captured volumetrically in real time. The viewer can pause, rewind and even see the game in slow motion at any time. With a VR headset the viewer can walk anywhere in the stadium including the pitch.
​
With an XR headset the viewer can project the game onto a coffee table and watch the game in their living room. A viewer can also watch the game on their 60″ big screen tv and change the camera angles like a video game, using their remote control or game controller.
Immersive Experiences
Imagine a sick patient can go to their general doctor’s office where there is a volumetric capture room to stream them in 3D. A specialist doctor, hundreds of miles away, will put on a VR headset and be able to walk around the patient, examining them from all angles. They can immediately determine whether they need to travel a great distance for an in person visit.
Companies can also use volumetric technology to allow customers to try virtual products. For example, person can be captured as a 3D model and then a shoe company can create a 3D version of the show to allow the person to virtually try on the shoe before buying it. This can be part of an event like at a soccer game in which the shoe manufacturer is a sponsor of the event allowing fans to see what it would be like to wear the shoes but also be projected in AR onto the soccer pitch.
SFX and Virtual Production
The SFX and virtual production time-consuming techniques like rotoscoping and compositing to manually combine 2D video with 3D environments and 3D models. Volumetric video can simplify the SFX and virtual production workflow, leveraging familiar industry tools.
For example, a lighting director can make adjustments to the lighting of both the actor and the 3D environment in real time. The ability to instantly view the result saves time and money and allows the creative team to be involved from start to finish.
Metaverse
With volumetric video an entire environment can be converted to 3D models and placed in the metaverse. For example, a real soccer game can be captured and placed into a virtual stadium inside the metaverse. Fans can connect with other fans in the metaverse as they cheer for their favorite team.
Imagine bringing a live concert into the metaverse and re-creating the fan experience in a virtual venue. Concert-goers from all around the world can experience volumetric capture of a performer, enhanced with spatial audio, virtual fireworks, and other 3D features.