Deliver video content for spatial experiences

RSS for tag

Discuss the WWDC23 Session Deliver video content for spatial experiences

View Session

Posts under wwdc2023-10071 tag

7 Posts
Sort by:
Post not yet marked as solved
6 Replies
1.8k Views
Hi community, I have a pair of stereo images, one for each eye. How should I render it on visionOS? I know that for 3D videos, the AVPlayerViewController could display them in fullscreen mode. But I couldn't find any docs relating to 3D stereo images. I guess my question can be brought up in a more general way: Is there any method that we can render different content for each eye? This could also be helpful to someone who only has sight on one eye.
Posted Last updated
.
Post not yet marked as solved
5 Replies
3.6k Views
After taking a look at the Deliver Video Content for Spatial Experiences session, alongside the Destination Video sample code, I'm a bit unclear on how one might go about creating stereoscopic content that can be bundled up as a MV-HEVC file and played on Vision Pro. I see the ISO Base Media File Format and Apple HEVC Stereo Video format specifications, alongside new mvhevc1440x1440 output presets in AVFoundation, but I'm unclear what sort of camera equipment could be used to create stereoscopic content and how one might be able to create a MV-HEVC using a command-line tool that leverages AVFoundation/VideoToolbox, or something like Final Cut Pro. Is such guidance available on how to film and create this type of file? Thanks!
Posted Last updated
.
Post not yet marked as solved
6 Replies
2.2k Views
Where can I find sample video, sample encoding apps, viewing apps, etc? I see specs, high level explanations, etc. but not finding any samples or command lines or app documentation to explain how to make and view these files. Thank you, looking forward to promoting a spatial video rich future.
Posted Last updated
.
Post not yet marked as solved
0 Replies
1.5k Views
I heard that iPhone 15 Pro or iPhone 15 Pro Max can shoot spatial video. However, I also know that the iPhone 15 Pro does not support spatial video shooting at first. When the iPhone 15 Pro becomes able to shoot spatial video, can the shot spatial video be played back on the visionOS simulator? When played back, is the video playback represented in three dimensions as a spatial video also performed in visionOS simulator? I would like to play back the spatial video shot with the iPhone 15 Pro using the VideoPlayerComponent of RealityKit. I am concerned that if the visionOS simulator does not support the operation verification of the shot spatial video, it will take a long time to verify it because I do not have an Apple Vision Pro device.
Posted Last updated
.
Post not yet marked as solved
0 Replies
1.4k Views
I just watched the videos "Create a great spatial playback experience" and "Deliver video content for spatial experiences," and I have the following question: I have an idea to create a video player not on a flat surface but on a 3D object. In the video "Deliver video content for spatial experiences," it was mentioned about the MV-HEVC format capable of storing separate images for the left and right eyes. My question is: if I use such a video file as material on my geometry, will it be displayed in stereoscopic mode (where each eye sees a separate image projected onto the geometry) or will it be displayed only in 2D mode (where both eyes see the same image)?
Posted
by rcilogic.
Last updated
.