On September 28, the US patent and trademark office precisely permitted patent rights to Apple. According to the Patent commission, the requests are connected to users’ interfaces for interacting with their upcoming HMD( Head-mounted display), a headset used with a VR system.

HMD can be used with pair of Goggles and a helmet. Let’s take a detailed look at this.

Apple is well renowned for manufacturing astonishing iPhones for more than a decade. We could say that the rivals of Apple. Inc is stumbling to secure a position in the race while Apple is never off in the race. It means Apple persistently producing dynamic flow in their products no matter what it is.

Apple’s recently permitted patent sheathing approach is interrelated with an HMD eye glance. So, the HMD user can use their eyes to interact with the interface things showcased on the HMD display. It is said that the new innovative technology offers a realistic and more efficient interface in some meritorious embodiments. This allows the users to control the tool by using eye gestures and eye glances. 

Various chips and sensors are mounted on the device to detect innumerable inputs like eye gaze, hand and body movements, and chiefly it can see specific voice input that users personalized in the machine. In distinct personification, the input device consists of a regulator installed to encounter and communicate various information, such as up, down, left, right, enter, et Cetra. 

Apple Patent Headset 19C
Image credit: Patently Apple

So we can decipher Apple’s patent figure 19C; in this figure, we are trying to depict the actual program, as we can see that the user (#200) selects a specific image from the heap (#1908).  The figure images, #1908a-1908e are slightly moved from the bench (#1912) and circulated upstanding position and outspread in the center of the POI of the user.

The communication response to receiving user input (#1910a), the picture (#1908a) in a left position is delegated, for instance, temporarily selected. The designation of the image is pinpointed by the prime focus indicator (#1914); it includes a vivid border around the photo 1908a. In particular personification or embodiments, the focus indicator combines a pointer, cursor, dot, sphere, highlighting, outline that identifies the designated object. And also, in some embodiments, the HMD device #1900 un-designates pictures #1908a and comes back images #1908 to the bench regarding receiving additional inputs in the device. 

The user input #1910b consists of left to the right belt or drag gestures in the figure. It indicates in specific embodiments user input #1910b can comprise a hit of a directional button or a voice command, for instance, users can give commands like “move right or move lift.” At the same time, responding to receiving user input 1910b, the focus indicator #1914 slightly moved from image #1908a incommensurate with user input #1910b to designate photo #1908b. 

There is also another set of moving objects patent figures to provide detailed information. 

In the figures shown below, Apple demonstrates how eye gazing and touch controls can be used to move an object in a VR environment, including paintings /photos and things that we are using in our daily routine, tea-cup or a glass. 

In addition, Apple is jotting that the HMD device includes sensors that decipher images and certain optionally mounted visible light image sensors including CCD(charged coupled device) and CMOS (complementary metal-oxide-semiconductor). 

Therefore, the images sensors also include a passive or active infra-red sensor to detect light from the realistic ambiance. 

Furthermore, the image sensor is also equipped with depth sensors to detect the far distance of natural objects from the HMD system. In certain embodiments, the HMD system uses CCD sensors and depth sensors to discover the physical surroundings around the HMD. 

The patent is chiefly focused on an MR(Mixed Reality) headset; the narrated method can also be applied to regular user interfaces on the system including, PC, laptops, tablets, and smartphones.