APPLE INC. (Cupertino, CA)

One implementation of the invention is to generate an affordance that is linked to an SR representation. This method is done in a device equipped with one or more processors, memory that is non-transitory, and one or two displays. The method involves identifying an item; generating an affordance-item pairing that is related to the item, detecting input selecting the affordance-item pair and then displaying on one or more displays the simulated reality (SR) environment that contains an representation of the item in response to receiving input from the user to select the affordance-item-pair. In certain cases the method also involves the creation of an image data frame which includes the item.

When a viewer watches a stream of video which contains items, the viewer is unable to glean further information or perspectives of these items without the use of an additional device. Someone might be interested in one particular shoe, for instance, if he is watching basketball on television. In this scenario the player would be using an additional device to get more information about the particular shoe that the user sees on the TV.

Furthermore, when a person is watching a tutorial (e.g. or a live video feed or a pre-recorded video stream) however, the user might not be able to discern the steps to follow for an item covered in the tutorial because of obstacles within the tutorial or the anglespresented during the instructional. Instead, the viewer will be able to infer from the tutorial how to perform the method that is taught in the tutorial for a real-world item of the user.

To make the disclosure clearer to those who are skilled in the art, we will give some examples of the implementation. Some of them are presented in the drawing that is included.

FIG. FIG. 1 shows an example of an operating environment that can create an affordance-item pair in conformity with specific implementations.

FIGS. 2A-2F demonstrate an example real-time simulation (SR) presentation environment for generating an affordance-item pair in line with various implementations.

FIG. FIG. 3 is the flow diagram that is used to generate an affordance-item pair in response to some implementations.

FIG. FIG. 4. shows the block diagram of an illustration of an operating system that shows the indication of interaction with a 2nd item. It overlays on the first item according to some implementations.

FIG. 5 illustrates a flow diagram of a method for obtaining and display an SR representation of the real-world interaction with an item conformity with certain implementations.

FIGS. 6A and 6B depict the process of displaying an indication of a real-world interaction with a second item that overlays a first item according to various implementations.

FIGS. 7A-7D show another method for showing an indication of a live interaction with another object as an overlay over an initial item in accordance with some implementations.

FIG. FIG. 8 illustrates the block diagram of an example controller based on some implementations.

FIG. FIG. 9 shows the block diagram of an example device according to various implementations.

FIG. 10 is the block diagram of an example display device conformity with various implementations.

As per the standard practice, the various features illustrated in the drawings are not required to be drawn to scale. The dimensions of different features can be arbitrarily increased or reduced to improve clarity. Furthermore, some of thedrawings may not depict all of the elements of a particular system, method or device. In addition, reference numbers that are similar may be used throughout the specification and in the figures to denote similar characteristics.

There are a variety of methods, devices, and systems that could be utilized to create affordances that are linked to simulated reality items. Some implementations claim that the process can be performed using a device equipped with three to four processors, non-transitory memories, and one to four display. The method is based on identifying the item. This method includes the generation of an affordance-item pair which is in line with the item. The method also includes detecting a user inputselecting the affordance-item pair. In response to the user selecting an affordance-item pairing, the method displays an SR environment with the representation of an item.

The various implementations described herein comprise devices, systems, and methods of displaying an indication of a real-world interaction between a second object as an virtual reality (SR) overlay on the primary item. Certain implementations state that the method is able to be executed using a device that has one to several processors, nontransitory memory , and one or several displays. This method involves displaying an SR-like environment to a first user who uses the display or displays. This method also provides the capability of obtaining an indication of the user’s real-world interaction using a second item. The method also includes displaying, on the one or more screens, an SR representation of the indication of the real-world interaction with thesecond item as an overlay on the primary object that is visible within the SR environment.

According to some implementations, devices may comprise one or several processors, nontransitory memories and displays, as well as one or more as well as one or more programs. The two or more programs are stored in non-transitory RAM, and may be executed by one or many processors. Instructions for performing or causing the execution of any of these actions are contained in the one or more programs. In accordance with certain methods, a computer-readable non-transitory storage medium stores instructions that are executed by one or more processors of a device with at least one display can cause the device perform or cause the performance of the operations of any method described in this document. According to some embodiments, a device comprises display or one of them and a non-transitory memory and means to perform or cause execution of any of the methods described in this document.

Click here to view the patent on USPTO website.


Get Patents with PatentPC

What is a patent?

How to Search for Patents

  • Add keywords to your search. Keyword searches may turn up documents that are not well-categorized or have missed classifications during Step 2. For example, US patent examiners often supplement their classification searches with keyword searches. Think about the use of technical engineering terminology rather than everyday words.
  • Search for foreign patents using the CPC classification. Then, re-run the search using international patent office search engines such as Espacenet, the European Patent Office’s worldwide patent publication database of over 130 million patent publications. Other national databases include:
  • Search non-patent literature. Inventions can be made public in many non-patent publications. It is recommended that you search journals, books, websites, technical catalogs, conference proceedings, and other print and electronic publications.

To review your search, you can hire a registered patent attorney to assist. A preliminary search will help one better prepare to talk about their invention and other related inventions with a professional patent attorney. In addition, the attorney will not spend too much time or money on patenting basics.