Deep Learning E-Skin Can Decode Complex Human Motion
A deep-learning powered single-strained electronic skin sensor has been developed by researchers at The Korea Advanced Institute of Science and Technology (KAIST), that can capture human motion from a distance.
The scientists behind the work say it could “provide a turning point in health-monitoring, motion tracking, and soft robotics.”
When placed on a person’s wrist, the electronic single strain skin sensor can capture human motion from a distance. It is able to decode complex five-finger motions in real-time with a virtual 3-D hand that mirrors the original motions.
Impressively, via rapid situation learning (RSL), the deep neural network is able to ensure stable operation regardless of its position on the surface of the skin.
Conventional wafer-based fabrication approaches have required many sensor networks to cover the entire curvilinear surfaces of the target area.
The researchers’ laser fabrication approach provides a new sensing paradigm for motion tracking, TechXplore explains.
The research team, led by Professor Sungho Jo from the School of Computing, collaborated with Professor Seunghwan Ko from Seoul National University in order to design the new measuring system, which is based on the idea that pinpointing a single area is more efficient for identifying movements than fixing several sensors on different joints and muscles.
The system they built extracts signals corresponding to multiple finger motions by generating cracks in metal nanoparticle films using laser technology.Thanks to its rapid situation learning (RSL) system, the sensor can track the motion of an entire person’s body with a small sensory network, allowing indirect remote measurement of human motions — something the researchers say is applicable for advanced VR and AR systems.
