YouTube Preset

Find clips, hooks, and quotes from YouTube videos in seconds.

Marques Brownlee 00:00:03 - 00:00:44
Okay. I've used the New Apple Vision pro. I had about a 30 minute demo just using this new headset. I had about a trillion questions, so I tried to ask as many of them as I possibly could of Apple to get all the answers I could for you and for myself. So without any further ado, let's just jump right in. This is everything you need to know so far about Apple's new AR/VR headset. So the first question, naturally, what is it? So, first things first. This is a first generation device from Apple, which we don't see very often, but it is an augmented reality virtual reality headset with a bunch of cameras and sensors inside that you strap to your face.
Marques Brownlee 00:00:44 - 00:01:39
It'll start at $3,500 and it'll go on sale starting sometime early next year. Nobody's been able to shoot video of using it yet, so I'm going to have to do my best with descriptions here. But fundamentally, this isn't something that's paired to your iPhone or your Mac. By default, it's a standalone computer with an M2 chip inside its own WiFi connection. A roughly 4K micro OLED display for each eye, a set of speakers right above each ear on the band, and then a dedicated new R1 chip which is doing all of the real time processing. From all the sensors that make this headset pretty special, but we'll get to that in a second. So all right then, how does it work? Well, basically we've seen VR headsets and AR headsets before. Typically there's screens on the inside and then on the outside there's some sort of shell which has some sensors on the outside that help detect what is in your room around you and help to see the controllers in your hands.
Marques Brownlee 00:01:39 - 00:02:16
But with this one, there are no controllers at all. They're not making any for it. There aren't going to be any optional accessory. They're not even going to design any controllers. You are controlling this thing entirely with your hands and your eyes and your voice. So you put this headset on and basically all over the headset, there are an absolute ton of sensors. You have two main forward facing cameras, two downward facing cameras, two more cameras for the sides, two infrared illuminators, a LiDAR scanner, a true depth camera. These are all to keep track of what's happening around the headset and also to track your hands in front of your face.
Marques Brownlee 00:02:16 - 00:03:03
And then on the inside, there's also a bunch of infrared illuminators and infrared cameras that are purely there, just there to track your eyes. So there's actually a setup process before you even get the headset, you basically measure. You sort of scan your face with the true depth camera on the iPhone, and it uses that depth information about your face to give you a sort of a custom cutout. This will be a process that you can do in Apple Stores, but basically you get the headset with the custom cutout for your face. If you have glasses, there are some Zeiss lenses. But you finally get the headset out and you put it on and there's some nice meshing on the back, some fabric that stretches and is pretty breathable. It's built extremely well with all this metal and glass. And then once you get it going, the most impressive thing about this headset, the most impressive thing is the eye tracking.
Marques Brownlee 00:03:03 - 00:03:47
I'm not even kidding, this eye tracking is sick. So basically the eye tracking in this headset as it looks at your eyes and keeps track of where your eyes move around, is the closest thing that I've experienced to magic. I normally don't call tech things sort of magical or surreal like this, but this was, even for a pre release product, kind of unbelievable how well it does. Anytime you move your eyes around the UI, it would immediately highlight and select exactly what you're looking at, no matter how small the target was or what you're looking at. And then when you want to select something, all you do is take your fingers like this and just touch them together. That's how you click. So you look at something, click, look at something, click. So there's a calibration process.
Marques Brownlee 00:03:47 - 00:04:17
When you first set up the headset, you put it on for the first time, where you basically just look around with your eyes at a bunch of different dots. So it learns your eyes. And then, yeah, from that point on, you're just cruising. You're sailing through everything by just looking at things. And it feels like telepathic. You just look at something and select it and that's it. So this is how the whole UI works. Pretty much every other headset has the ability to use your hands to select things, but most of them rely on the sensors on the outside to keep track of a set of controllers for maximum accuracy.
Marques Brownlee 00:04:18 - 00:04:49
But this massive array of sensors on the outside of Apple's headset have done an impressively good job of picking up what my hand is doing, kind of no matter where it is. So like I said, there's sensors all the way around the thing. They're facing forward, but they are facing sideways and facing down. So I can just kind of rest my hand, like wherever, and look at stuff and click. I don't even have to move my head, I can just look at something and just click my fingers. I kind of did it by accident a few times. Like I'd just sort of be sitting there and my fingertips would actually touch and I'd select whatever I was looking at. But pretty quickly you get used to just this, just doing this.
Marques Brownlee 00:04:50 - 00:05:22
Now there are also some text boxes. Occasionally you want to type something. And so you can look at the text box, select it, and then a keyboard will pop up. And you can look at the letters, but also you can just look at a search box field and just start talking and it'll start filling in whatever you're saying. Because there's microphones on the headset. And there is also something they're calling Optic ID, which is basically kind of just the fingerprint ID of the headset because it's looking at your eyes and everyone's eyes is a different unique biometric pattern. And so you log in just by putting the headset on and it looks at your eyes. So Optic ID, this thing knows your eyes really well.
Marques Brownlee 00:05:22 - 00:05:53
So then you've probably seen all these weird looking frames where you can see people's eyes through. It like this super weird thing that I've never seen in any other headset. So what is happening here? Well, spoiler alert, it's not actually transparent. It kind of looks like it's a glass, transparent thing, but it's not. It appears to be because there's actually an OLED screen facing out. This is what I would call a two way pass through. That's what I'm calling it. See, a normal VR headset we've seen is of course, completely opaque.
Marques Brownlee 00:05:54 - 00:06:31
Usually it's like black plastic or something like that. So in order to see through to your actual environment without taking the headset off, like for picking up your controllers or walking around a room without hitting a wall, they have a pass through mode, so it'll turn on a camera on the outside so you can see what's going on around you. And some passthrough modes are better than others. Some will do it from a single black and white camera. Some will do stereo pass through from two cameras. Some will do color pass through. The pass through on Apple's headset is, again, the best I've ever seen in a headset. It's stereo, it's color, it's sharp, it's real time, it's really good.
Marques Brownlee 00:06:31 - 00:07:04
So then the eyes you see from the outside are actually an OLED display showing what your eyes look like to the cameras inside the headset. So it shows your eyes like this whenever you're using any sort of pass through mode. And if you can see your environment, it'll show your eyes. So you're not actually like looking at someone's eyes, but it kind of feels like you are kind of creepy a little bit. I don't know. It's the simplest way of explaining it. If they're doing something fully immersive in VR, like watching a movie or playing a game, then it won't show their eyes. It'll show this graphic over their eyes instead.
Marques Brownlee 00:07:04 - 00:07:43
It's a really interesting look. It's a bold look. I just have this thought of like, you're on an airplane and the flight attendant walks up and taps you, hey, do you want any water? And you just look up and your eyes shine through the headset. It's just a weird thing. I don't think it's smart, but I don't think other headsets are going to do it because most of them don't have it in the budget to have a screen facing the outside. But then let's get to the burning question. You've probably already been thinking. What does it actually do? So, okay, I'm separating this into three bulk categories that I made up and I'm kind of proud of here, which are computing, content and connections.
Marques Brownlee 00:07:43 - 00:08:21
Now, actually, I should preface this all by saying this is a first gen product. So right now, the only apps that show up on the home screen are Apple's apps. Just like when the first iPhone came out, with no App Store, it's just Apple's apps. But the reason this is coming out, or at least getting announced so early, but it's not coming out till next year, is to give this window for developers to start developing their own apps and making cool things for this. Headset to do that are way more interesting and way more functional. But it does have a core set of functions. So for computing, I think this is the one that's probably the least likely to be used by most normal people. But it is a pretty direct shot at what Meta just did with the Quest Pro.
Marques Brownlee 00:08:22 - 00:08:53
The $1500 quest pro. So you can use this thing as its own computer, with web browsing, et cetera, with these 4K windows in front of you that you can move around and do all kinds of stuff with your hands. Now, this will be its own OS. Again, it's not running off your phone or anything. It's running a whole new operating system called Vision OS. And it seems pretty similar to iPad OS just in the fact that you're just touching things in iPad OS. And in this headset, you look at something and then you touch your fingers together. And that's basically just like a normal touch.
Marques Brownlee 00:08:53 - 00:09:34
But I was really impressed with the responsiveness. Again, this was better than any headset I've seen with just your hands. If I wanted to scroll through something like a Safari window, I literally in Air would touch my fingers together and drag the window and it would scroll nearly in real time. I would like, throw it around, like toss it, catch it, toss it the other way, and start scrolling through things with my finger, resizing windows, dragging the corners of things. And I was super impressed with that too. Now, if you're like me, you might have also had some questions about the sharpness. Like, do I really want to wear something like this for a long time to work like it's on a computer? And I think that was also pretty smartly addressed. They use a selective rendering based on the super good eye tracking.
Marques Brownlee 00:09:34 - 00:10:06
So the computing power is basically focusing on sharply rendering the part of the screen that you're actually looking at while saving power on the rest. It's pretty cool and it works so quickly that I did not notice it while using it. And then the part you're looking at is actually very sharp. Like I said before, they're super high resolution screens. They're four K. I don't know if I have a number for refresh rate, but it felt like 120. Eye fatigue will eventually become a thing with any headset you strap to your face. But this would be on the lower level of eye fatigue compared to what I've experienced with some others.
Marques Brownlee 00:10:06 - 00:10:38
And then for even more heavy work. This is kind of nuts, but they showed it in the keynote. Apparently if you have a Mac and you want to do macOS stuff, you can just with the headset on, just look at your Mac and it will pick up what you're doing and it'll mirror the Mac's display as one of the 4K windows for you in the headset. And then you can even connect a bluetooth keyboard and a Bluetooth trackpad and start working around like it's an actual Mac, just with a bigger screen wherever you want. Yeah, ecosystem stuff. So that's computing. I definitely got to try it. But then of course, there's the connection stuff.
Marques Brownlee 00:10:38 - 00:11:41
You got messaging, you can type out messages to people just like as if you were on a Mac. But there's also impressively FaceTime. Now I don't even know that this is necessarily better than a normal FaceTime holding your phone or like on a laptop, other than the fact that I guess you don't have to be holding anything, but you can have people's windows floating in front of you as you talk to them on FaceTime. But you might also be asking, wait a second, if I'm not holding my phone in front of me, what do other people on FaceTime see? Well, the answer is they'll see a 3D rendered model of you that was scanned into the system from your iPhone that syncs up and matches the movements of your face with eye tracking and all the other sensors of the headset. So I got to try it. It works okay, so it's not as good as obviously looking at a person. I just feel like a FaceTime you're trying to have like a personal connection with the person. And this is obviously more personal than an avatar or like a cartoon of you, but it feel is kind of somewhere in between.
Marques Brownlee 00:11:41 - 00:12:08
It's kind of like a Google Project Starline, which I just did that video about a couple of weeks ago. If you haven't already seen that. I'll leave a link with a like button so you can check it out. But it feels sort of in that like uncanny valley moving 3D model territory instead of looking at an actual person. It's kind of how I picture it. But then last but not least, of course, content. People are just going to watch content on this thing. And I think this is the industry now that Apple's jumping into it that is poised to explode.
Marques Brownlee 00:12:08 - 00:12:58
Like, we've had VR games and VR videos for a long time and Apple is now also able to do this, they of course, put their own spin on it. And they can use the power and the draw of the Apple brand to get content creators and big motion picture studios and sports leagues and all kinds of creatives to work to make content that looks really good, specifically on Apple's headset and in Apple's formats. I can personally say from my demo, hell yes, I would watch, I would pay to watch an NBA game courtside in the VR headset. The quality is good enough, and obviously it's not going to be as immersive as feeling the energy from the crowd. But you're not paying courtside prices. You'd probably pay, it is a total guess, 1020 bucks to watch an NBA game courtside or have some subscription to do that. I would totally do that. And it would be fun.
Marques Brownlee 00:12:58 - 00:13:51
But even with regular 2D content, like movies, just watching a regular movie, you can totally just sit back, put the headset on, maybe even put some headphones on and just like on a plane seat, just watch a movie as if you're in a theater for one, which is pretty sweet. There is that digital crown on the side that actually lets you spin it clockwise to move in more immersion and fully envelop you in the VR environment. Or you can turn it counterclockwise to bring in more of your real world environment with pass through in your peripheral vision. Kind of a neat trick. And then there was also this kind of weird feature where you can take 3D photos and videos with the cameras built into the headset itself. And I did not like this one. So there was a demo of like a recording from a headset camera of a kid blowing out some candles on a birthday cake, basically. And I got to watch this actual scene in the actual Apple headset.
Marques Brownlee 00:13:52 - 00:15:02
So because there's two cameras, like front facing, they can record stereoscopic 3D. So you can turn on the recording and in that moment sit down and record a super immersive video. And then when you watch it back in the headset, it's like you're reliving this moment in 3D, which can feel kind of cool, but I can't get the image of the dad at the birthday party with the headset on, just recording things, like walking around. It just doesn't what kind of memory is that for the other people around you? I saw this and I immediately thought back to the reasons we all know why Google Glass failed, which is it was ahead of its time. But it's also like you're walking around with a camera on your face, and everybody knows that you have a camera on your face. It just wasn't cool. Dad, what are you doing? Why are your eyes sticking out through the headset? So, all right, the number one question I've gotten after I've actually tried this thing is, is it any good? Is this headset any good? And the answer is, well, yes. Some of the parts of this headset that I tried are actually the best I have ever seen in any VR headset by a mile.
Marques Brownlee 00:15:02 - 00:15:38
Specifically the eye tracking and the hand tracking. Now, of course, it's going to be up to developers to really make it good, but I think the foundational, how do you use it part is pretty amazing. But that doesn't mean there aren't any downsides. All right, number one, there was no haptics, of course, because you don't have controllers. You're just doing everything with your hands in the air. There's no way to have any sort of haptic feedback. There was a demo that I did where I stuck my hand out, a wall on the other side of the room opened up and a dinosaur was back there and a butterfly flew out. I held out my hand and the butterfly flew up and landed on my finger.
Marques Brownlee 00:15:38 - 00:16:07
It could track and see all that information and the volumetric, all the computation to make that happen was amazing. But when the butterfly landed and I didn't feel anything, there was that moment of like, oh, right, this is a VR headset. But then, number two, this was interesting. This is pretty heavy. This is a pretty heavy VR headset. Kind of the same way that AirPods Max, the apple's metal headphones, are heavier than most plastic headphones. There's a reason why most other VR headsets are just plastic. It's not because that's cheap.
Marques Brownlee 00:16:07 - 00:16:26
It's because it's lightweight. It's fatiguing to have a heavy thing on your head. And this is a headset made of metal and glass. It's heavy. Now, it is also super well built. Like, there is no arguing that. But I do wonder about using it for longer than the half hour that I did. I wonder if it would be more fatiguing to my head.
Marques Brownlee 00:16:26 - 00:16:47
That's also actually why the battery isn't attached to it. That would be a ton of weight to carry on your head. So they connected the battery instead through a proprietary cable. And that actually can sit next to you on the couch or in your back pocket. And that brings us to the other thing, the battery life. 2 hours. Two hour battery life on the headset, which is not that great. It's not that long.
Marques Brownlee 00:16:47 - 00:17:34
Now, there's a USBC port on the battery bank, and you can plug that into the wall for infinite time. But the second you unplug from the wall yeah, 2 hours from that pretty hefty battery bank, which is like, okay, maybe most people won't be spending a lot of time in the headset, but you did also just show us Apple, an ad of people, like, watching a movie in the headset that's already, like most movies are 2 hours plus. So something worth thinking about, just a two hour. I'm sure people will make bigger external batteries for this thing, but 2 hours? And then also I couldn't get a firm answer here on if there are fans inside or not. But I think there's fans. Like, there's certainly vents for fans anyway. And if you're gaming for long enough or using it for long enough, do those spin up? Do they ever get loud? Do they ever kill your battery? That's kind of unclear. But then, of course, the main thing that everybody's talking about, it's expensive.
Marques Brownlee 00:17:34 - 00:18:06
It's $3,500. So is that pricey? Yeah, that's very expensive. But this is the thing that is always weird with Apple products. Like, there is no direct comp. You always say it's expensive, but compared to what? And they did this with the Pro Display XDR, they've done this with even AirPods Max a little bit. But there are several things that this headset does that no other headset does. The eye tracking, the hand tracking. That's super good.
Marques Brownlee 00:18:07 - 00:18:41
Even if an equivalent headset came along today and did all of the same stuff that this does, hardware and software wise, it still wouldn't have FaceTime. It still wouldn't have, like looking at a Mac, and then the ecosystem allowing the Macs display to pop up. So this is kind of something that only Apple could pull off. So, bottom line, I got to try it. I thought it was extremely impressive, but at the end of the day, this is not a product for the masses. I mean, obviously, right, it's $3,500. It has the word Pro in the name, too. But this feels like this series Zero, like the Apple Watch.
Marques Brownlee 00:18:41 - 00:19:34
Remember when the Apple Watch first came out, the series Zero, where it's really going to be up to the first gen, the early adopters and the developers to decide the direction that this thing goes, to decide what people actually want to use it for and that'll shape the future versions of it that we may eventually get down the road. Then maybe someday there's like a vision se that's like $400 that the masses will all adopt, and it'll be this next generation hit product. Maybe. But as of right now, this is very much in the sort of early adopter, people like me, people like watching this video testing phase to figure it out. So that's the Apple Vision pro. It's the rich person's toy and the developers muse for right now, but we'll see how far this thing goes in the near future. It's coming out next year. It's not that far off, it's not that far away.
Marques Brownlee 00:19:34 - 00:20:03
It's really interesting times. Either way. This was also part of a huge entire WWDC keynote. So if you want to watch my recap of the rest of that stuff, ideally get subscribed because there's going to be a video recap of the biggest announcements, of which there are many other things. And also I'll shout out the Waveform podcast to get subscribed there too, because the next episode, I'll just say it's a banger. It's pretty sick. So hit, sub, hit, like hang out in the comments that's been it for this one. Thanks for watching.
Marques Brownlee 00:20:04 - 00:20:06
Catch you guys in the next one. Peace.