Trending

Stories

New Google Algorithm Makes Robots Better Equipped at Recognizing Transparent Objects

Must Read

ClearGrasp, a new learning algorithm, has been developed by Google Synthesis AI and Columbia University researchers, which will help robots interact with transparent objects. The algorithm uses RGB-D images to recreate the 3D spatial information of the object in question.

Robots use RGB-D cameras to paint an accurate 3D picture of the environment it is in. However, there certainly are limitations to the surroundings created by such cameras; for example, it does not work effectively for transparent objects such as glass.

Also Read

Recreating 3D spatial information for transparent objects proved to be a herculean task for the researchers. Very little data was available meant for transparent surfaces, and most of the data blatantly ignored the transparent surfaces. To overcome this issue, the researchers created a large-scale transparent object data set, containing 50,000 realistic renderings of various object surfaces.

The ClearGrasp algorithm uses 3 neural networks to correctly identify transparent objects. One of the networks estimates the surface normal vector, one calculates the edge of the occlusion and the other calculates the object’s transparency. The object’s mask is used to exclude pixels of non-transparent objects to fill the correct depth.

The global optimization module can predict the normal vectors of other surfaces from surfaces of known depth to reconstruct the shape of the object and to differentiate between two objects.

However, the algorithm could not correctly detect the normal vectors of other basic surfaces due to the limitation of the synthetic data set. To tackle this problem, the researchers came up with the Matterport3D and ScanNet data set.

However, all of these mishaps aside, ClearGrasp is the only algorithm available that can reconstruct the depth of transparent objects, increasing the success rate of grasping transparent objects by the robotic arm from 12% to 74%.

Stay updated

Subscribe to our newsletter and never miss an update on the latest tech, gaming, startup, how to guide, deals and more.

Latest

Stories

- Advertisement -
- Advertisement -

Latest

Grow Your Business

Place your brand in front of tech-savvy audience. Partner with us to build brand awareness, increase website traffic, generate qualified leads, and grow your business.

- Advertisement -

Related

- Advertisement -
- Advertisement -
TikTok Targets $20B E-Commerce Expansion in Southeast Asia WatchOS 10: Automatic Night Mode for Apple Watch Ultra Twitter Blue: One-Hour Tweet Editing Window for Subscribers Google Pay Enables Aadhaar-Based UPI Authentication iOS 17: Improved Autocorrect with Personalized On-Device ML OnePlus Nord N30 5G goes official in the U.S. Apple Introduces Vision Pro VR Headset for Augmented and Virtual Reality Microsoft to Pay $20M Fine for Violating Children’s Privacy with Xbox Nothing Phone (2) Confirmed for India Production Fitbit Integration with Google Accounts Begins
TikTok Targets $20B E-Commerce Expansion in Southeast Asia WatchOS 10: Automatic Night Mode for Apple Watch Ultra Twitter Blue: One-Hour Tweet Editing Window for Subscribers Google Pay Enables Aadhaar-Based UPI Authentication iOS 17: Improved Autocorrect with Personalized On-Device ML OnePlus Nord N30 5G goes official in the U.S. Apple Introduces Vision Pro VR Headset for Augmented and Virtual Reality Microsoft to Pay $20M Fine for Violating Children’s Privacy with Xbox