The programmer introduced a prototype service for copying real objects in Photoshop
French developer and designer Cyril Dianier introduced a prototype application AR Cut & Paste, with which you can copy real objects and paste their images into Adobe Photoshop using artificial intelligence systems and augmented reality. The code and description of AR Cut & Paste are published on the GitHub.
The AR Cut & Paste service allows you to photograph an object on a smartphone, and then transfer it without a background to a computer screen with an open graphic editor, while the angle of the captured object is saved.
4/10 – Cut & paste your surroundings to Photoshop
Code: https://t.co/cVddH3u3ik
Book: @HOLOmagazine
Garment: SS17 by @thekarentopacio
Type: Sainte Colombe by @MinetYoann @ProductionType
Technical Insights: ↓#ML #AR #AI #AIUX #Adobe #Photoshop pic.twitter.com/LkTBe0t0rF— Cyril Diagne (@cyrildiagne) May 3, 2020
The application uses the BASNet machine learning library to recognize the object and remove the background. The OpenCV SIFT algorithm allows for inserting an object to determine the points on the computer screen that the camera is aimed at.
The secret sauce here is BASNet (Qin et al, CVPR 2019) for salient object detection and background removal.
The accuracy and range of this model are stunning and there are many nice use cases so I packaged it as a micro-service / docker image: https://t.co/jbAmO89cRy pic.twitter.com/DGe9IffPtS
— Cyril Diagne (@cyrildiagne) May 3, 2020
At the same time, the developer has not yet specified whether this service will appear on a wide market. The description of the service on GitHub says that despite the fact that AR Cut & Paste can only transfer data to Photoshop now, in the future the developer will expand the number of services the application can work with.
