comment 0

Spatial videos

If you have an iPhone 15 Pro (and iOS 17.2), you can go into Settings -> Camera -> Formats and turn on a setting called “spatial video.” It will then enable this (excerpt from Om Malik):

Spatial video is a mixed-reality video format that allows videos to record the depth and spatial information of the scene, and when you play it back, you get a more immersive, three-dimensional (3D) experience. The iPhone 15 Pro utilizes its main lens and the ultra-wide lens to capture the depth and spatial information of the videos. The spatial videos are captured at 1080p, 30 frames per second, and use the HEIC format.

What you can then do is watch your videos on something like an Apple Vision Pro. It’s not going to be exactly perfect right now — given that the Vision Pro display is over 8k and the above is 1080p — but it will give you an indication of what’s to come for photography, video, and many other use cases.

Some examples.

As a regular consumer, this might allow you to capture videos from a trip and then more fully relive the moments once you’re at home. And as Om argues in his post, this will inevitably change photography/video. Because how we consume media, impacts how and what we capture.

If you’re in the business of selling real estate to people, you can also imagine this set up having a profound impact on virtual tours. Because now you have something that’s pretty damn close to reality, if not eventually indistinguishable. Why even go in person until you have to?

Of course, all of this will depend on whether Vision Pro actually sees widespread adoption. But if the technology is as good as everyone who has tested it seems to think, then surely there will be at least some initial users who find immediate value.

And if that is the case, it opens the door for the masses. To once again quote Om: “It is not hard to be excited about the possibilities.”

Leave a comment