FACEBOOK, INC. (Menlo Park, CA)

To render makeup products on the user’s face within an environment that is augmented techniques, systems including non-transitory computer-readable storage media are disclosed. For example the disclosed system may mix a base makeup color of a chosen makeup product using extracted luminance frequencies from streaming video. The disclosed system will transform the blended makeup color into LAB color space and apply one or more shader models to match the brightness of the color based upon a material of the selected makeup product. Other operations are possible by the disclosed system to smoothen the skin and match the makeup product to the skin tone of the user. The disclosed system then displays the makeup product and any other changes to an augmented-reality environment via the video stream.

As computer processing and digital imaging capabilities advance, Augmented Reality (AR) is becoming more prevalent. Smartphones and other handheld devices have AR capabilities, which permit users to capture, view and render real-world images in real-time. AR-enabled smartphones and other handheld devices permit users to see or record scenes that include the appearance of characters, objects, or objects. Digitally added to the scene.

AR environments add layers to digital images and videos. It is essential that the layers are compatible with the video and images to create realistic AR scene. The lighting, texture, and other visual characteristics ofAR layers play a large part in making the finer details of AR layers blend into the actual-world images and videos. Particularly, if the visual characteristics of the AR layers don’t blend into the background of the real world and the AR scene may appear fake or unnatural in some way.

Some AR applications require specific visual properties to work. AR components. For instance when you use AR devices to test makeup, precise mixing of AR layers with real-world photos or videos is crucial to the functionality of ARlayers. Particularly, various lights, skin tones and makeup ingredients can create wildly different appearance in real-world settings. The hue of a particular makeup product may be very inaccurate without accurate blend. The user may not be able to see exactly how the makeup would appear in actual environments.

Conventional AR systems that utilize makeup or other facial accessories in AR environments typically apply a color to a makeup layer in an AR environment in the HSV/LAB color space. However, even with AR lighting effects, however, the traditional AR systems typically produce an inaccurate appearance of AR makeup/materials relative to the real-world environment due to varied lighting conditions, user skin tones, and/or makeup/materials. There are a variety of disadvantages with traditional AR systems.

A variety of embodiments provide advantages or resolve problems in the art. These systems, methods and non-transitory storage media for computer-readable data generate an augmented reality makeup which has realistic lighting and color. The disclosed systems can take luminance frequencies of digital video and mix the makeup selection with the extracted luminance frequency. The disclosed systems transform the blended color into the LAB space and then adjust the lightness of the blended color by applying one or more of several shading models to it based on the makeup selected (e.g. glitter, gloss matte metallic). When the makeup choice material is applied to the blended color to alter the lightness it is then converted by the disclosed systems it back into the RGB space that can be used in the digital video stream.

In one or more of the embodiments the disclosed system employs localized tone mapping (e.g. average luma andluma range) to the digital video stream. The disclosed systems can reduce the size of the video stream and calculate the luma values (e.g. the average luma value or luma range) for each section of the digital stream. The disclosed systems can then alter the luma values of the various sections based on a predetermined threshold for luma, by remapping the hue of each pixel in an s-curve generated fromthe calculated luma values. The disclosed systems use downsampled digital stream processing and processes that smooth the appearance of the user’s faces with a guided filter which leverages images based on aluma. These disclosedsystems are able to precisely and quickly duplicate the colors of makeup based on the tone of the skin and lighting conditions, all the while simultaneously efficiently using computing resources.

Additional advantages and features of one or more embodiments of the disclosed disclosure will be described in the description which follows, and in part will be apparent from the description, or may be learned through the application of the example embodiments.

Click here to view the patent on USPTO website.

Get Patents with PatentPC

What is a patent?

A patent is granted by the government to safeguard an invention, patents give the inventor with exclusive rights to create, use, market and promote the invention?society benefits when a innovative technology is introduced to the market. The benefits can be in directly, in that it can allow people to do previously impossible things. Or indirectly due to the opportunities for economic growth (business growth and employment) which the invention provides.

Many drug companies and university researchers seek patent protection for their research and developments. Patents are granted for products, processes, or method of creating new materials. Patent protection must be granted to any invention that is valuable, novel, and not previously known to others in the same field.

Patents give inventors a reward for commercially profitable inventions. They are an incentive to inventors to invent. Patents permit entrepreneurs and inventors to be confident that there’s an excellent chance that they will be paid back for their time, effort, and money invested in the development of technology. They could earn a decent income by their work.

Companies that are able to:

Protect the latest products and services;

Improve the visibility and the value of your products on market

Differentiate yourself and your products from the competition.

Access to business and technical knowledge and data;

Avoid the risk of accidentally using proprietary third-party content, or losing important information, creative outputs, or another creative output.

Patents transform inventor’s knowledge into a marketable asset, that opens new avenues for job creation through joint ventures and licensing.

Investors involved in the development and commercialization of technology will appreciate small businesses with patent protection appealing.

Patenting can lead to the development of new ideas and new inventions. This information can encourage the development of new ideas and may be eligible for patent protection.

Patents can be used to prevent untrustworthy third parties from profiting from the invention’s efforts.

Patent-protected technology revenue that is commercially profitable could be used for financing technology research and development (R&D) which will increase the chance of developing higher-quality technology in the future.

You can leverage the intellectual property rights of your company to convince lenders and investors that your product has real commercial potential. One patent that is powerful could open the door for multiple financing opportunities. Patents and other IP assets can be used as collateral or as security for financing debt. You may also present investors with your patent assets to boost the value of your business. Forbes and other publications have stated that each patent can increase company value by anywhere between $500,000 and $1 Million.

Startups require a carefully-crafted business plan that builds on the IP to prove that your product or service is unique superior, innovative, or superior. In addition, investors will be impressed if you can prove that your IP rights are secured or are is in the process of becoming secure, and that they are in line with your business plan.

It is essential to protect an invention before applying for patent protection. The public disclosure of an invention before filing it is often detrimental to its originality and render it unpatentable. Pre-filing disclosures, such as for investors, test-marketing or any other business partners, should be done only after signing a confidentiality agreement.

There are a variety of patents. Knowing them is essential to safeguard your invention. Utility patents protect new techniques and machines. Design patents cover ornamental designs. Patents for utility are the best option and shield the owner from copycats and other competitors. In most cases, utility patents are issued for alterations or improvements to existing inventions. They can also be used to improve or alter existing inventions. For instance, a procedure patent will be able to cover actions or methods of performing a specific act, whereas chemical compositions will comprise a mixture of ingredients.

What is the average length of a patent? Although utility patents are valid for 20 years from the date of their initial filing, they are able to be extended through delays at the patent office.

Are you thinking of the patenting of your idea? Patents are granted only to the first-to-file applicants therefore you need to file your patent application quickly. Call PatentPC now to have your patent application filed!

When you are writing an application for patents it is recommended to conduct a patent search. the search will give you some insights into other people’s ideas. You’ll be able reduce the scope of your idea. Furthermore, you’ll learn about state of the technology in your field of innovation. This will help you to understand the scope of your invention and help prepare you to file the patent application.

How to Search for Patents

Patent searches are the very first step towards obtaining your patent. You can do a google patent search or do a USPTO search. Patent-pending is the name used to describe the product protected by the patent application. It is possible to search the public pair to find the patent application. After the patent office has approved the patent application, you are able to do a patent number search to locate the issued patent. Your product will now be patented. You can also utilize the USPTO search engine. Read on for details. A patent lawyer or patent attorney can assist you with the process. Patents granted in the United States are granted by the US trademark and patent office, also known as the United States patent office and trademark office. This office also reviews trademark applications.

Are you looking for similar patents? Here are the steps to follow:

1. Brainstorm terms to describe your invention in relation to its intended composition, use, or purpose.

Write down a brief and precise description of the invention. Do not use generic terms such as “device”, “process,” or “system”. Instead, think about synonyms for the terms you selected initially. Also, keep track of important technical terms and keywords.

Use the questions below to help you identify key words or concepts.

  • What is the objective of the invention Is it a utilitarian device or an ornamental design?
  • Is the invention a way of creating something or performing a function? Or is it a thing or process?
  • What is the basis of the invention? What is the physical structure?
  • What is the goal of this invention?
  • What are the terms in the technical field and the keywords that define the nature of an invention? To assist you in finding the appropriate terms, use an online dictionary of technical terms.

2. These terms will allow you to find pertinent Cooperative Patent Classifications using the Classification Search Tool. If you’re unable to find the right classification to describe your invention, scan through the Schemas of classes (class schedules). If you do not get results using the Classification Text Search, you may want to consider replacing the words for describing your invention using synonyms.

3. Review 3. Go over the CPC Classification Definition to determine the validity of the CPC classification you’ve discovered. If the classification you have selected is a blue box that has the letter “D” to its left, clicking on the link will direct you to a CPC classification description. CPC classification definitions can help identify the specific classification’s scope, so you are sure to select the one you consider to be the most relevant. These definitions may also include research tips or other suggestions which could prove useful in further study.

4. Retrieve patent documents with the CPC classification from the Patents Full-Text and Image Database. You can search and select the relevant patent publications by first focusing on abstract and the drawings that are representative.

5. This list of patent publications is the best to examine for connections with your invention. Pay attention to the claims and specification. You may find additional patents by referring to the patent examiner and the applicant.

6. Find patent applications published in the public domain using the CPC classification you chose in Step 3 of the Applications Full-Text and Image Database. It is also possible to use the same strategy of searching you used in step 4 to limit your search results to just the most relevant patents by reading the abstracts and drawings on every page. Next, carefully examine the patent applications published and pay particular attention to the claims and the additional drawings.

7. You can find additional US patent publications using keyword searching in AppFT or PatFT databases, and also the classification search of patents that are that are not issued by the United States per below. Additionally, you can use web search engines to find non-patent-related literature disclosures about inventions. Examples:

  • Add keywords to your search. Keyword searches may turn up documents that are not well-categorized or have missed classifications during Step 2. For example, US patent examiners often supplement their classification searches with keyword searches. Think about the use of technical engineering terminology rather than everyday words.
  • Search for foreign patents using the CPC classification. Then, re-run the search using international patent office search engines such as Espacenet, the European Patent Office’s worldwide patent publication database of over 130 million patent publications. Other national databases include:
  • Search non-patent literature. Inventions can be made public in many non-patent publications. It is recommended that you search journals, books, websites, technical catalogs, conference proceedings, and other print and electronic publications.

To review your search, you can hire a registered patent attorney to assist. A preliminary search will help one better prepare to talk about their invention and other related inventions with a professional patent attorney. In addition, the attorney will not spend too much time or money on patenting basics.