A system has been developed that monitors the environment and predicts people’s future actions so that robots do not collide with them.
Researchers at Kyushu University in Japan have created a system that allows users to predict future changes in their environment that could change humans and robots’ trajectories. The new development collects data on the position of furniture, objects, people, and robots in one place to simulate events that may occur soon. These simulations are directed to users via virtual reality (VR) or augmented reality (AR) headsets.
To gather information about the position of various objects, robots, and people in a common environment, the researchers used sensors, optical trackers, and an RGB-D camera. Optical trackers tracked the movements of objects or robots, while an RGB-D camera collected human actions.
The data was then passed to the motion planner and dynamics simulator. These two components of the system made it possible to predict changes in the environment and synthesize images of events that may occur soon from a particular person’s perspective. As a result, users could view these synthesized images using a VR headset or AR display.
According to the developers, Previewed Reality can serve as both an alternative and addition to more traditional collision avoidance systems designed to determine safe trajectories for robots. In the future, the system can improve the safety of interaction between humans and robots in various rooms. In their next research, the development team plans to create a lighter and more accessible version that can be accessed via the phone.