Trending

Stories

NetEase Lab to use a real-time high-resolution face replay algorithm based on a single image on desktop and mobile phones

Tidio Live Chat Software - Add Tidio live chat software to your website in minutes. Contact visitors and turn them into happy customers. Enhance their experience and boost your sales. Get it for Free

WP Rocket - WordPress Caching Plugin

Must Read

Yusuf Balogun
Yusuf Balogun
Yusuf is an aspiring Journalist and Health law expert with a special focus on technology innovations. He is a writer at Right for Education, Libertist Centre for Education, Qwenu, and Editor at Gamji Press, UDUS.

It is reported today that Netease Interactive Entertainment AI Lab proposes a single-image real-time high-resolution face replay algorithm that can generate 1440×1440 and 256×256 resolution face replays at real-time frame rates on desktop GPUs and mobile CPUs, respectively. The main idea behind this method is to decouple and encode the appearance and motion information of the face before using a large number of videos to concentrate their prior knowledge through self-supervised learning.

According to the different encoding methods of motion information, related work can be divided into two categories: warp-based and direct synthesis. The deformation-based method, for example, displays the motion information as a motion field, whereas the direct synthesis method encodes the appearance and motion information of the face in a low-dimensional latent space and then decodes it to obtain the synthesis result.

Also Read

The core concept of this synthesis method is incorporated into the deformation-based algorithm flow, which consists primarily of two modules: First, because the deformation-based algorithm does not need to recreate all face information, it has the potential to create a network structure that supports real-time applications.

As a result, this scheme uses the deformation-based algorithm framework as the foundation and proposes a lightweight U-shaped Deformation network structure; at the same time, the pose encoding method combined with the direct synthesis method encodes the three-dimensional pose of the head that drives the face and injects it into the network to improve the quality of its large pose generation.

Elegant Themes - The most popular WordPress theme in the world and the ultimate WordPress Page Builder. Get a 30-day money-back guarantee. Get it for Free

Second, to improve the algorithm’s efficiency even further, this scheme proposes a hierarchical motion field prediction network to estimate pixel motion from the source face to the driving face. This scheme, unlike existing single-scale motion field estimation algorithms, can be based on a variety of features. The scale’s feature point image predicts the motion field from coarse to fine, reducing the algorithm’s complexity and ensuring calculation accuracy.

The source image and driving image pair are used as input in the training phase of this method. First, the 3DMM algorithm is used to fit the shape, expression, and head pose parameters of the photo’s face, and then the corresponding feature point image is calculated.

iThemes WordPress Hosting

Stay updated

Subscribe to our newsletter and never miss an update on the latest tech, gaming, startup, how to guide, deals and more.

Latest

Stories

- Advertisement -
- Advertisement -

Latest

Grow Your Business

Place your brand in front of tech-savvy audience. Partner with us to build brand awareness, increase website traffic, generate qualified leads, and grow your business.

- Advertisement -

Grow Your Business

Get these business solutions, tools and services to help your business grow.
Elementor

Elementor -Join 5,000,000+ Professionals Who Build Better Sites With Elementor. Build your website with 100% visual design that loads faster and speeds up the process of building them.

WP Rocket

WP Rocket - Speed up your website with the most powerful caching plugin in the world. The website speed increase means better SEO ranking, user experience, and conversation. It’s a fact that Google loves a fast site.

Kinsta

Kinsta - If you are looking for WordPress managed hosting, Kinsta is in the leading front. Kinsta provides WordPress hosting for a small or large business that helps take care of all your needs regarding your website with cutting-edge technology.

OptinMonster

OptinMonster - Instantly boost leads and grow revenue with the #1 most powerful conversion optimization toolkit in the world. 700,000+ websites are using OptinMonster to turn their traffic into leads, subscribers, and sales.

Related

- Advertisement -
- Advertisement -
India to Produce Upcoming iPhones: Trade Minister Japanese Professor Developed A Power Semiconductor made of Diamond Google Releases New Product for India’s Merchants Indian EV Startup Unveil Two AutoBalancing Electric Scooters OPPO Find X6 Pro Images Render via Weibo Sony Develops New Tech to Reduce Noise of Image Sensors Tesla’s S & Y Models Earn Best-in-Class Cars of 2022 India Approved $320m to Promote Homegrown Payments Network Twitter Roll Out TikTok-like ‘For You’ Timeline on iOS Nothing Phone Enters US with Beta Membership Program
Finally! Apple’s VR Headset Coming this Spring Harvard Scientists Develop New Cell Therapy to Kill, and Prevent Brain Cancer HTC Vive XR Elite VR/AR Headset Now Selling for $1099 Realme 10 Launched in India with Helio G99 Gaming Chipset Twitter Data Breach Revealing User’s Private Information Instagram New Feature to Create Albums With Friend Redmi Note12 Pro Plus Launched in India POCO C50 Launched in India