The conceptual revolution that implies the new apple product, Apple Vision Pro, it is extraordinarily large. The company has introduced what they call spatial computing. Users will be able to interact with the device in an immersive reality through eye movement and hand gestures. The rest is put in by Apple's hardware and software. Throughout this week at WWDC, engineers have shown the six main gestures with which the interface of the Apple Vision Pro is controlled and the evolution that gestures could have towards more complex movements also available in glasses.
Six gestures that control the Apple Vision Pro
The Apple Vision Pro introduces more than 5000 patents for its operation, a technological revolution that allows setting a precedent in spatial computing in mixed reality. Thanks to ten sensors, cameras and screens the user will be able to work, entertain himself and a lot of other actions from the same place with the glasses on.
At WWDC23 it has been offered one session called «Design for spatial introduction» led by Israel Pastrana and Eugene Krivoruchko in which they have addressed the importance of the eyes and hands for the operation of the Apple Vision Pro.
As you can see, the operation of visionOS is governed by six main gestures:
- Play: Touch your thumb with your index finger to touch a virtual item on the screen you're on. It's like tapping or tapping somewhere on the screen of a device like an iPhone or iPad.
- Double touch
- Press and hold: this gesture could be targeted to select text.
- Click and drag: It could be used to scroll through a web page, or navigate horizontally or vertically through the content that we were viewing. The speed and force with which we dragged would translate into greater or lesser speed.
- Zoom: the first of the gestures to be performed with two hands. It is done as if you pinch the screen or image and move it out to increase the size or zoom.
- Rotate: grabbing the content and rotating it about an invisible axis rotates the content.
Also addressed were complex gestures oriented in a context, like the ones you can see in the image that is a few lines above. In this case, developers would have endless possibilities, understanding the Apple Vision Pro as an extension of reality. In other words, the gestures will depend on the application or scenario that we find ourselves in and the interactions will be generated by the developers. For example, put on a vinyl record as in the example or click to rotate an object on itself.