The feature showcased by Cyril Diagne is only a research prototype as of now. (Image: Cyril Diagne/Twitter)
A new use-case for Augmented Reality (AR) has been discovered and it makes the job of a designer much easier. Cyril Diagne, a developer at Google Arts and Culture has demonstrated a new AR tool that allows users to perform real-life copy and pasting.
In a video posted on Twitter Diagne is seen using AR to copy visuals from the real world and pasting them on digital documents. This tool will make the job of designers much easier, as they will be able to point their phone cameras at an object and copy-paste it on their PCs, instead of taking a photo, editing it and then inserting the cut-out into the document.
The tool showcased by Diagne is only a research prototype for now and has not been developed for Google Arts and Culture.
Diagne in his tweet explained that his AR Cut and Paste demo has a few moving parts. The first component separates the foreground object from the background with the help of machine learning. The second component detects where your phone is pointing at on the PC screen. He states that it takes around 6.5 seconds for the whole process to complete: 2.5 seconds to copy the object and four seconds to paste it.
4/10 – Cut & paste your surroundings to Photoshop
Code: https://t.co/cVddH3u3ik
Book: @HOLOmagazine
Garment: SS17 by @thekarentopacio
Type: Sainte Colombe by @MinetYoann @ProductionType
Technical Insights: ↓#ML #AR #AI #AIUX #Adobe #Photoshop pic.twitter.com/LkTBe0t0rF— Cyril Diagne (@cyrildiagne) May 3, 2020
He also explains that this process can be sped up with the help of other professionals, which hence has put up this code on GitHub for anyone to check out. He wants contributors to help improve it the tool.
Till date, AR had been used to project digital images into the real world. However, this reverses the process and brings physical things into the digital world. We have seen AR technology being used to project how we would look in certain clothing, how a piece of furniture would fit inside of our home, how we can bring an animal into our home and much more.