7th October 2013

Tactile rendering of 3D features on touch surfaces

By altering the friction encountered by a person's fingertip, a new algorithm developed by Disney can create the perception of a 3D bump on a touch surface, without having to physically move the surface. This method can be used to simulate the feel of a wide variety of objects and textures.

The algorithm is based on a discovery that when a person slides their finger over a real physical bump, the person perceives the bump largely because lateral friction forces stretch and compress skin on the sliding finger.

"Our brain perceives the 3D bump on a surface mostly from information that it receives via skin stretching," said Ivan Poupyrev, who directs Disney Research in Pittsburgh. "Therefore, if we can artificially stretch skin on a finger as it slides on the touch screen, the brain will be fooled into thinking an actual physical bump is on a touch screen, even though the touch surface is completely smooth."

In their experiments, the researchers used electrovibration to modulate the friction between the sliding finger and the touch surface with electrostatic forces. They created and validated a "psycho-physical model" that closely simulates friction forces perceived by the human finger when it slides over a real bump.

The model was then incorporated into an algorithm that dynamically modulates the frictional forces on a sliding finger so that they match the tactile properties of the visual content displayed on the touch screen along the finger's path. A wide variety of visual artifacts thus can be dynamically enhanced with tactile feedback that adjusts as the display changes.

"The traditional approach to tactile feedback is to have a library of canned effects that are played back whenever a particular interaction occurs," said Ali Israr, who was the research lead on the project. "This makes it difficult to create a tactile feedback for dynamic visual content, where the sizes and orientation of features constantly change. With our algorithm we do not have one or two effects, but a set of controls that make it possible to tune tactile effects to a specific visual artifact on the fly."

"Touch interaction has become the standard for smartphones, tablets and even desktop computers, so designing algorithms that can convert the visual content into believable tactile sensations has immense potential for enriching the user experience," Poupyrev said. "We believe our algorithm will make it possible to render rich tactile information over visual content and that this will lead to new applications for tactile displays.

Disney will present their findings at the ACM Symposium on User Interface Software and Technology being held this week in St Andrews, Scotland. By impact factor, it is the most impactful conference in the field of human-computer interaction.

Comments »