What if you could feel raindrops or a beating heart, or train in competitive archery, all from the comfort of your home? That game-changing immersiveness could bring a new dimension to virtual environments, allowing users to experience the world of imagination with a high degree of realism.
A recent invention by a team of researchers from NUS promises to substantially enhance a user’s sense of touch in virtual reality (VR), with the aim of delivering a more authentic and immersive experience within the metaverse. Their new invention—called HaptGlove—is an untethered and lightweight haptic glove that provides users with both skin-like and movement sensations when interacting with a virtual object.
While the concept of haptic gloves is not new, current technologies are not able to give users a realistic sense of touch. For example, typical haptic glove designs in the market use vibration motors, which could not accurately replicate the real-world sense of touch such as simulating the hardness and shape of a VR object. Other haptic gloves use pneumatic actuators, which are devices that generate a sense of pressure, but their bulky designs greatly limit the user’s movement.
“My experience with VR and the metaverse has always been unsatisfactory. VR should not be just about a visual and auditory experience; it should present the ability to interact with VR objects. However, current methods of pressing on a virtual panel or interacting with another avatar lack the sensation of touch that we experience in the real world. This prompted me to work with my team to develop a haptic glove to enable ‘physical’ touch in the virtual world,” said Professor Lim Chwee Teck, who is the Director for the Institute for Health Innovation & Technology (iHealthtech) and leader of the research team.
Prof Lim and his team went on to develop HaptGlove, a portable and highly flexible haptic glove that enables users to have immersive touch and feel of VR objects with unparalleled realism in VR experience. HaptGlove incorporates lightweight pneumatic control with the team’s latest developed microfluidic sensing technology to reduce its size and weight significantly, and does not require bulky accessories.
“The HaptGlove’s unique design allows users to interact with the virtual world more naturally and realistically, which would give users unobtrusive recreational or competitive sensation in VR,” added Prof Lim, who is also from the Department of Biomedical Engineering under the NUS College of Design and Engineering.
HaptGlove contains five pairs of haptic feedback modules, one for each finger. The modules are controlled wirelessly to sense the VR object in terms of shape, size and stiffness.
When a user puts on HaptGlove, he can sense contact when the avatar’s hand touches, grasps and manipulates a VR object. This is achieved by using a microfluidic pneumatic indenter to deliver real-time pressure to the user’s fingertips. The glove can also simulate the shape and stiffness (soft or hard) of the object that the avatar is touching, by restricting the user’s finger positions. This adds realism to the virtual interaction.
Using proprietary software developed by the NUS research team, HaptGlove achieves a visual-haptic delay of less than 20 milliseconds—this is faster than conventional haptic gloves, delivering a near-real-time user experience.
The NUS team’s latest prototype is also more comfortable for users to wear at only 250 grams, much lighter than commercially-available haptic gloves which weigh over 450 grams.
Adding a physical touch to the metaverse
Prof Lim and his team started working on the HaptGlove in 2019 and took two years to develop a prototype. To test the performance of the HaptGlove, the team recruited 20 users who wore the glove to sort four balls of different stiffnesses in the virtual world. Besides achieving over 90% accuracy in completing the tasks, the users noted that the HaptGlove had significantly enhanced realism in VR and improved their overall experience, compared to devices using vibration motors.
Besides gaming, the HaptGlove has useful applications in the fields of medicine and education, such as assisting surgeons to better prepare for an operation by simulating a hyper-realistic environment, or giving students a hands-on learning experience by simulating palpation on different body parts.