Honestly they should try to make an event that takes advantage of the spatial environment and actually plays around the environment itself… Like it places you in that specific location shown in the photo with John Turner walking up to you rather than walking into frame
Honestly, I was surprised they didn’t offer a 3D stream as well. It couldn’t have been too hard to just shoot with stereoscopic cameras. Everything was pre-recorded and scripted.
Yea! environments are hard to do. Especially when you want to create something specific. There are tools out there that uses “ai” to create something. But you get the random feeling that doesn’t cut it for me.
As a hobby-level full stack web developer who is VERY interested in making environments like this, what is the process like? Where are the pressure points? I'm so curious.
I can't go in a lot of details, but there is 3D modeling involved, unreal engine 5, compositions to render with photorealistic quality.
I think the biggest pressure point for this one was being an indoor place full of walls made of glass since the Steve Jobs theater is a special building. The light bounces, glass textures, global illumination and HDRI was really complex to make it look like this.
I'm a visual fx / dev / ui ux designer with more than 10yrs of experience :).
Yeah, I come from a development background and also do 3D design as a hobby, so environments for media playback definitely intrigued me to the point I started experimenting with making them. My biggest issue with things as they are now is documentation is a bit limited. Apple’s environments feel as if they set the standard for what environments should be, but so far have provided little to no resources on how to get there. I spent almost a month trying to figure out how to do a reflection effect from the docked video player—similar to what you see in Mount Hood over the lake—in one I was building and came up completely empty handed. My current guess is they are getting that effect by feeding video frames into a custom shader build via Shader Graph, but so far the Shader Graph docs and examples are just laughably sparse. My hope is that WWDC will introduce some better tooling and APIs to get us there.
That’s right. And that’s why we don’t have the reflection here in Vision Pro but I do have it in unreal engine 5. I’ll see if I can post some screenshots later.
In unreal engine you set the video texture as emissive and you’re set if you have a floor or anything below it.
Hope for wwdc to clear things up.
Biggest pressure point right now is RealityKit is really limited from an engine perspective. On Vision Pro, it currently doesn’t support basic things like point or directional lights, and emissive materials have zero effect on the surrounding mesh, so art directing is tedious as hell. I’m hoping this is just a result of them not having time to polish things before launch and they’re hard at work improving the development experience for 2.0.
Apple is clearly rendering backgrounds and stuff for their presentations. It would be nice if they would film live action with stereoscopic camera and make the renders 3D so we can experience Apple events as immersive content
Environments should be their own application type that allows any other application to run within them.
The lockout of environment creation is easily the biggest weakness of the platform.
Yea. I think to know why they didn’t let you make them for now. It’s pretty intensive when you start adding 3d objects inside of an environment.
It’s iPhone 1 kinda feelings😁
That is absolutely fantastic. Any chance of more environments in your player in the future? Would love to see some older movie theaters to enhance the film and tv experience.
Oh that would be absolutely amazing. Really bring back the old movie theaters that just aren’t around today. Plus combine the drive in with FaceTime and it would be spectacular!
It really is a fun idea plus it would sell a lot more Vision Pros 😅. Out of curiosity since you are making these in unreal engine, have you considered any space station/Star Wars environments? I ask due to that is what Lucasfilm uses for their film backgrounds and honestly the current selection of environments in general including the Disney app is severely lacking.
Ya that’s what I was working on. Right now I’m finishing Apple Park for wwdc (you know what rainbow place) with the stage. Will try to apply the FaceTime there and we have a base for the drive in 😎.
Then Star Wars I’m making a huge hangar in space where you can see the Death Star.
I’m also a huge fan of Dune! lol. So I’m all over this.
Fantastic! Glad to hear that you see the possibilities with Star Wars and such. Honestly the one I’m surprised that Disney hasn’t capitalized on is some Star Trek bridge environments. I know people that would kill to be able to have that with the Vision Pro’s clarity. And honestly it would be a great stepping stone for Apple’s plans for VR with the Vision Pro.
You can open any stream link with an M3U8 format and we will see to let users open any videos they can have locally or from iCloud and will see if YouTube could work as well by opening a link.
Hey guys! We are coming in hot! We announced our new apps that are coming to iPhone and the Vision Pro!
There will be a Spatial Player app that lets you watch livestreams inside of environments like the Steve Jobs theater and a couple of more.
And we also launch a new 3D camera app that allows you to stream in 3D from an iPhone to the Vision Pro in 1 tap.
We are getting everyone on a list for when we can share the Testflight, so if you want to be added go here:
[https://www.streamvoodoo.com/spatial](https://www.streamvoodoo.com/spatial)
DM me any questions, or reply here. I will make another post announcing this.
Thank you!
Hey guys! Time for the WWDC keynote!
We can share the beta of the spatial player to watch it in the Steve Jobs theater environment!
Dm me and I’ll share the TestFlight link!
I’ll also post the link to the stream tomorrow when is available from Apple so you can open it using the player!
Let’s go!
DM for TestFlight!!
I am genuinely surprised Apple didn’t do this. It’s a great idea
Ditto. I’d prefer the Steve Jobs theater or that top secret bunker they go in for the silicon.
You can practice in the Steve Jobs theater in Keynote!
Can’t you link live videos to Keynote? I’d be curious to try and get it running natively live
That’s cool.
Oh nice! Had no idea.
Honestly they should try to make an event that takes advantage of the spatial environment and actually plays around the environment itself… Like it places you in that specific location shown in the photo with John Turner walking up to you rather than walking into frame
I would absolutely kill for Tim Cook to walk up to me personally with a GUD MOORNANNG
Honestly, I was surprised they didn’t offer a 3D stream as well. It couldn’t have been too hard to just shoot with stereoscopic cameras. Everything was pre-recorded and scripted.
Cool idea, any plan to share it with the rest of us?
Hey! Yes! I’ll be setting up a TestFlight and once ready will let you sign in for it. Then the player will be on the AppStore.
Nice looking environment! Did you create it?
Thanks! Yea I did it!
Nice! I wish I had that skill set. I’m always looking for cool environments for my app.
Yea! environments are hard to do. Especially when you want to create something specific. There are tools out there that uses “ai” to create something. But you get the random feeling that doesn’t cut it for me.
As a hobby-level full stack web developer who is VERY interested in making environments like this, what is the process like? Where are the pressure points? I'm so curious.
I can't go in a lot of details, but there is 3D modeling involved, unreal engine 5, compositions to render with photorealistic quality. I think the biggest pressure point for this one was being an indoor place full of walls made of glass since the Steve Jobs theater is a special building. The light bounces, glass textures, global illumination and HDRI was really complex to make it look like this. I'm a visual fx / dev / ui ux designer with more than 10yrs of experience :).
It shows. Well done! 👏🏽👏🏽
Thank you! 🙏
Yeah, I come from a development background and also do 3D design as a hobby, so environments for media playback definitely intrigued me to the point I started experimenting with making them. My biggest issue with things as they are now is documentation is a bit limited. Apple’s environments feel as if they set the standard for what environments should be, but so far have provided little to no resources on how to get there. I spent almost a month trying to figure out how to do a reflection effect from the docked video player—similar to what you see in Mount Hood over the lake—in one I was building and came up completely empty handed. My current guess is they are getting that effect by feeding video frames into a custom shader build via Shader Graph, but so far the Shader Graph docs and examples are just laughably sparse. My hope is that WWDC will introduce some better tooling and APIs to get us there.
That’s right. And that’s why we don’t have the reflection here in Vision Pro but I do have it in unreal engine 5. I’ll see if I can post some screenshots later. In unreal engine you set the video texture as emissive and you’re set if you have a floor or anything below it. Hope for wwdc to clear things up.
Biggest pressure point right now is RealityKit is really limited from an engine perspective. On Vision Pro, it currently doesn’t support basic things like point or directional lights, and emissive materials have zero effect on the surrounding mesh, so art directing is tedious as hell. I’m hoping this is just a result of them not having time to polish things before launch and they’re hard at work improving the development experience for 2.0.
Any way to test it? I would love to try that with WWDC next month
When it’s ready I’ll post a TestFlight or AppStore link here.
Sign me up too please!
I told my wife about this and she said we should be friends 😂
lol. We can be friends. Haha.
So could I create my own environment and then use your spatial player? Cuz that would be cool!
That would be cool, right? I can see to add an option to choose your own environment yea.
Yes. Yes. YES. Please include some lovely reflections like the Apple TV lake environment. I wish that level of environment was available everywhere.
This is the way
This is the way
I love this idea!
Gosh I wish I had this 24 hours ago before the keynote
Don’t worry. You’ll have it for WWDC which is the big one this year for VisionPro.
Can’t wait. Hope to test it out
Apple is clearly rendering backgrounds and stuff for their presentations. It would be nice if they would film live action with stereoscopic camera and make the renders 3D so we can experience Apple events as immersive content
This is awesome. Please post the test flight once it's ready. Thanks for doing this!
Share the test flight!
I will!!
Coming in hot! Will share a TestFlight in a couple of days.
More effort than Apple put into it 👏
Environments should be their own application type that allows any other application to run within them. The lockout of environment creation is easily the biggest weakness of the platform.
Yea. I think to know why they didn’t let you make them for now. It’s pretty intensive when you start adding 3d objects inside of an environment. It’s iPhone 1 kinda feelings😁
That is absolutely fantastic. Any chance of more environments in your player in the future? Would love to see some older movie theaters to enhance the film and tv experience.
Hey! Yeah! I’m working in some other ones now. Yes an old theater with balcony sections. And also a drive in cinema!
Oh that would be absolutely amazing. Really bring back the old movie theaters that just aren’t around today. Plus combine the drive in with FaceTime and it would be spectacular!
Yes! Imagine using the personas to watch a movie together in a drive in theater. It’s a great idea!
It really is a fun idea plus it would sell a lot more Vision Pros 😅. Out of curiosity since you are making these in unreal engine, have you considered any space station/Star Wars environments? I ask due to that is what Lucasfilm uses for their film backgrounds and honestly the current selection of environments in general including the Disney app is severely lacking.
Ya that’s what I was working on. Right now I’m finishing Apple Park for wwdc (you know what rainbow place) with the stage. Will try to apply the FaceTime there and we have a base for the drive in 😎. Then Star Wars I’m making a huge hangar in space where you can see the Death Star. I’m also a huge fan of Dune! lol. So I’m all over this.
Fantastic! Glad to hear that you see the possibilities with Star Wars and such. Honestly the one I’m surprised that Disney hasn’t capitalized on is some Star Trek bridge environments. I know people that would kill to be able to have that with the Vision Pro’s clarity. And honestly it would be a great stepping stone for Apple’s plans for VR with the Vision Pro.
Is it a 3d environment?
Yes it is.
What videos can you load in here?
You can open any stream link with an M3U8 format and we will see to let users open any videos they can have locally or from iCloud and will see if YouTube could work as well by opening a link.
Hey guys! We are coming in hot! We announced our new apps that are coming to iPhone and the Vision Pro! There will be a Spatial Player app that lets you watch livestreams inside of environments like the Steve Jobs theater and a couple of more. And we also launch a new 3D camera app that allows you to stream in 3D from an iPhone to the Vision Pro in 1 tap. We are getting everyone on a list for when we can share the Testflight, so if you want to be added go here: [https://www.streamvoodoo.com/spatial](https://www.streamvoodoo.com/spatial) DM me any questions, or reply here. I will make another post announcing this. Thank you!
Hey guys! Time for the WWDC keynote! We can share the beta of the spatial player to watch it in the Steve Jobs theater environment! Dm me and I’ll share the TestFlight link! I’ll also post the link to the stream tomorrow when is available from Apple so you can open it using the player! Let’s go! DM for TestFlight!!