YouTube Preset

Find clips, hooks, and quotes from YouTube videos in seconds.

Marques Brownlee 00:00:03 - 00:00:44
Okay. I've used the New Apple Vision pro. I had about a 30 minute demo just using this new headset. I had about a trillion questions, so I tried to ask as many of them as I possibly could of Apple to get all the answers I could for you and for myself. So without any further ado, let's just jump right in. This is everything you need to know so far about Apple's new AR/VR headset. So the first question, naturally, what is it? So, first things first. This is a first generation device from Apple, which we don't see very often, but it is an augmented reality virtual reality headset with a bunch of cameras and sensors inside that you strap to your face.
Marques Brownlee 00:00:44 - 00:01:39
It'll start at $3,500 and it'll go on sale starting sometime early next year. Nobody's been able to shoot video of using it yet, so I'm going to have to do my best with descriptions here. But fundamentally, this isn't something that's paired to your iPhone or your Mac. By default, it's a standalone computer with an M2 chip inside its own WiFi connection. A roughly 4K micro OLED display for each eye, a set of speakers right above each ear on the band, and then a dedicated new R1 chip which is doing all of the real time processing. From all the sensors that make this headset pretty special, but we'll get to that in a second. So all right then, how does it work? Well, basically we've seen VR headsets and AR headsets before. Typically there's screens on the inside and then on the outside there's some sort of shell which has some sensors on the outside that help detect what is in your room around you and help to see the controllers in your hands.
Marques Brownlee 00:01:39 - 00:02:16
But with this one, there are no controllers at all. They're not making any for it. There aren't going to be any optional accessory. They're not even going to design any controllers. You are controlling this thing entirely with your hands and your eyes and your voice. So you put this headset on and basically all over the headset, there are an absolute ton of sensors. You have two main forward facing cameras, two downward facing cameras, two more cameras for the sides, two infrared illuminators, a LiDAR scanner, a true depth camera. These are all to keep track of what's happening around the headset and also to track your hands in front of your face.
Marques Brownlee 00:02:16 - 00:03:03
And then on the inside, there's also a bunch of infrared illuminators and infrared cameras that are purely there, just there to track your eyes. So there's actually a setup process before you even get the headset, you basically measure. You sort of scan your face with the true depth camera on the iPhone, and it uses that depth information about your face to give you a sort of a custom cutout. This will be a process that you can do in Apple Stores, but basically you get the headset with the custom cutout for your face. If you have glasses, there are some Zeiss lenses. But you finally get the headset out and you put it on and there's some nice meshing on the back, some fabric that stretches and is pretty breathable. It's built extremely well with all this metal and glass. And then once you get it going, the most impressive thing about this headset, the most impressive thing is the eye tracking.
Marques Brownlee 00:03:03 - 00:03:47
I'm not even kidding, this eye tracking is sick. So basically the eye tracking in this headset as it looks at your eyes and keeps track of where your eyes move around, is the closest thing that I've experienced to magic. I normally don't call tech things sort of magical or surreal like this, but this was, even for a pre release product, kind of unbelievable how well it does. Anytime you move your eyes around the UI, it would immediately highlight and select exactly what you're looking at, no matter how small the target was or what you're looking at. And then when you want to select something, all you do is take your fingers like this and just touch them together. That's how you click. So you look at something, click, look at something, click. So there's a calibration process.
Marques Brownlee 00:03:47 - 00:04:17
When you first set up the headset, you put it on for the first time, where you basically just look around with your eyes at a bunch of different dots. So it learns your eyes. And then, yeah, from that point on, you're just cruising. You're sailing through everything by just looking at things. And it feels like telepathic. You just look at something and select it and that's it. So this is how the whole UI works. Pretty much every other headset has the ability to use your hands to select things, but most of them rely on the sensors on the outside to keep track of a set of controllers for maximum accuracy.
Marques Brownlee 00:04:18 - 00:04:49
But this massive array of sensors on the outside of Apple's headset have done an impressively good job of picking up what my hand is doing, kind of no matter where it is. So like I said, there's sensors all the way around the thing. They're facing forward, but they are facing sideways and facing down. So I can just kind of rest my hand, like wherever, and look at stuff and click. I don't even have to move my head, I can just look at something and just click my fingers. I kind of did it by accident a few times. Like I'd just sort of be sitting there and my fingertips would actually touch and I'd select whatever I was looking at. But pretty quickly you get used to just this, just doing this.