PlayStation 5 controller can generate vibration based on in-game sounds

The PlayStation 5 DualSense controller has improved vibration over the Dualshock. In the new release of Sony’s Technology, the company told what the innovation is.

Dual Sense Feature
The main improvement is the ability to generate tactile feedback based on audio effects. If earlier everything had to be done manually, now the developers have received tools from Sony that allow to partially automate the process.

With the new technology, developers can create vibration patterns for Dual Sense based on sounds from corresponding actions in PlayStation 5 games:

“Our focus was on deep neural network technology, but the problem was that there was little research done in the past that applied this technology to touch rather than images and sound. At first, we spent many days just struggling with data. Later we studied and tested various algorithms, consulting with experts. This allowed us to partially automate the generation of high-quality vibration signals, giving the impression that they were designed by hand”.

Previously, the developers of games for the PlayStation 5 talked about how the improved tactile feedback DualSense will come in handy when creating a gameplay. For example, in Spider-Man: Miles Morales, the vibration of the controller tells you which side the threat is coming from. In Ratchet & Clank: Rift Apart, triggers transmit the hardness of the trigger of a double-barreled shotgun to split the shot from the first and second barrel.

We will find out how the technology is felt directly in the game in 2020 when the PlayStation 5 hits store shelves.

Author: John Kessler
Graduated From the Massachusetts Institute of Technology. Previously, worked in various little-known media. Currently is an expert, editor and developer of Free News.
Function: Director