• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Contact
  • Privacy
  • About
  • Subscribe

  • News
  • Features
  • Sections A-Z
  • Video
  • Webinars
  • White Papers
  • Press Releases
  • Contact

Robots sense human touch using camera and shadows

February 10, 2021 by Editor

Soft robots may not be in touch with human feelings, but they are getting better at feeling human touch.

Cornell University researchers have created a low-cost method for soft, deformable robots to detect a range of physical interactions, from pats to punches to hugs, without relying on touch at all. Instead, a USB camera located inside the robot captures the shadow movements of hand gestures on the robot’s skin and classifies them with machine-learning software.

The group’s paper, ShadowSense: Detecting Human Touch in a Social Robot Using Shadow Image Classification, published in the Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies. The paper’s lead author is doctoral student, Yuhan Hu.

The new ShadowSense technology is the latest project from the Human-Robot Collaboration and Companionship Lab, led by the paper’s senior author, Guy Hoffman, associate professor in the Sibley School of Mechanical and Aerospace Engineering.

The technology originated as part of an effort to develop inflatable robots that could guide people to safety during emergency evacuations. Such a robot would need to be able to communicate with humans in extreme conditions and environments. Imagine a robot physically leading someone down a noisy, smoke-filled corridor by detecting the pressure of the person’s hand.

Rather than installing a large number of contact sensors – which would add weight and complex wiring to the robot, and would be difficult to embed in a deforming skin – the team took a counterintuitive approach. In order to gauge touch, they looked to sight.

“By placing a camera inside the robot, we can infer how the person is touching it and what the person’s intent is just by looking at the shadow images,” Hu said. “We think there is interesting potential there, because there are lots of social robots that are not able to detect touch gestures.”

The prototype robot consists of a soft inflatable bladder of nylon skin stretched around a cylindrical skeleton, roughly four feet in height, that is mounted on a mobile base. Under the robot’s skin is a USB camera, which connects to a laptop.

The researchers developed a neural-network-based algorithm that uses previously recorded training data to distinguish between six touch gestures – touching with a palm, punching, touching with two hands, hugging, pointing and not touching at all – with an accuracy of 87.5 to 96 percent, depending on the lighting.

The robot can be programmed to respond to certain touches and gestures, such as rolling away or issuing a message through a loudspeaker. And the robot’s skin has the potential to be turned into an interactive screen.

By collecting enough data, a robot could be trained to recognize an even wider vocabulary of interactions, custom-tailored to fit the robot’s task, Hu said.

The robot doesn’t even have to be a robot. ShadowSense technology can be incorporated into other materials, such as balloons, turning them into touch-sensitive devices.

In addition to providing a simple solution to a complicated technical challenge, and making robots more user-friendly to boot, ShadowSense offers a comfort that is increasingly rare in these high-tech times: privacy.

“If the robot can only see you in the form of your shadow, it can detect what you’re doing without taking high fidelity images of your appearance,” Hu said. “That gives you a physical filter and protection, and provides psychological comfort.”

Share this:

  • Twitter
  • Facebook
  • Print
  • LinkedIn
  • Reddit
  • Pinterest
  • WhatsApp

Related Posts

  • Artificial skin brings robots closer to 'touching' human lives
    33
    Artificial skin brings robots closer to 'touching' human livesModern-day robots are often required to interact with humans intelligently and efficiently, which can be enabled by providing them the ability to perceive touch. However, previous attempts at mimicking human skin have involved bulky and complex electronics, wiring, and a risk of damage. In a recent study, researchers from Japan…
    Tags: skin, robots, human, technology, industry
  • A universal approach to tailoring soft robots
    32
    A universal approach to tailoring soft robotsBy combining two distinct approaches into an integrated workflow, Singapore University of Technology and Design (SUTD) researchers have developed a novel automated process for designing and fabricating customised soft robots. Their method, published in Advanced Materials Technologies, can be applied to other kinds of soft robots – allowing their mechanical properties…
    Tags: soft, robots, robot, technology

Filed Under: Industry, Science Tagged With: camera, detect, human, industry, robots, science, shadowsense, skin, soft, technology, touch, touching

Primary Sidebar

Latest Video

Stäubli investing in software for the future

Most read

  • AutoX expands robotaxi operation zone to 1,000 sq km
    AutoX expands robotaxi operation zone to 1,000 sq km
  • Schaeffler acquires precision gearbox maker Melior Motion 
    Schaeffler acquires precision gearbox maker Melior Motion 
  • Sunflower Labs provides its security drone system to range of new customers
    Sunflower Labs provides its security drone system to range of new customers
  • Monarch Tractor showcases ‘world’s first fully electric, driver-optional tractor’
    Monarch Tractor showcases ‘world’s first fully electric, driver-optional tractor’
  • Robot performs laparoscopic surgery without guiding hand of a human
    Robot performs laparoscopic surgery without guiding hand of a human
  • Amazon owner’s Blue Origin to buy asteroid mining company Honeybee Robotics
    Amazon owner’s Blue Origin to buy asteroid mining company Honeybee Robotics
  • Sydney scientists achieve ‘99 per cent accuracy’ for quantum computing in silicon
    Sydney scientists achieve ‘99 per cent accuracy’ for quantum computing in silicon
  • Ceremorphic unveils plans to build supercomputer infrastructure on 5 nanometer chips
    Ceremorphic unveils plans to build supercomputer infrastructure on 5 nanometer chips
  • Motion capture is guiding the next generation of extraterrestrial robots
    Motion capture is guiding the next generation of extraterrestrial robots
  • Baidu’s autonomous electric carmaker Jidu raises $400 million in Series A financing
    Baidu’s autonomous electric carmaker Jidu raises $400 million in Series A financing

Latest news

  • AutoX expands robotaxi operation zone to 1,000 sq km
  • Schaeffler acquires precision gearbox maker Melior Motion 
  • Sunflower Labs provides its security drone system to range of new customers
  • Monarch Tractor showcases ‘world’s first fully electric, driver-optional tractor’
  • Robot performs laparoscopic surgery without guiding hand of a human
  • Amazon owner’s Blue Origin to buy asteroid mining company Honeybee Robotics
  • Sydney scientists achieve ‘99 per cent accuracy’ for quantum computing in silicon
  • Ceremorphic unveils plans to build supercomputer infrastructure on 5 nanometer chips
  • Motion capture is guiding the next generation of extraterrestrial robots
  • Baidu’s autonomous electric carmaker Jidu raises $400 million in Series A financing

Categories

We are... INDEPENDENT COMPLEX OLD-SKOOL FUTURE-FACING FREE, FAIR AND LEGAL

Copyright © 2023 · News Pro on Genesis Framework · WordPress · Log in