The technology behind interactive video gaming is making its way into the retail customer experience, a trend accelerated by the coronavirus pandemic. Gesture recognition, perhaps most known for powering home consoles like the Nintendo Wii and Xbox Kinect, presents an opportunity for retailers to adopt touchless displays. Here’s how it works:
1. Capture
First, a camera captures image data and passes it to a sensing device connected to a computer. This happens through a proximity sensor designed to detect the presence of nearby objects without physical contact.
2. Scan
The proximity sensor is also used to mimic functions for programming. In turn, software can identify meaningful gestures from a predetermined gesture library.
3. Match
The software interprets each gesture, looking back to the library to match the real time gesture with a pre-programmed gesture.
4. Enact
Once the gesture is interpreted, the computer executes the command correlated to the gesture in the library.
This technology is deepening the UX toolbox and enabling new avenues for gestural control in contactless interactive signage. By placing sensors around the periphery of a display, zones of interaction can be distinguished from one another and programmed to acknowledge actions such as swiping, pointing, pressing, or pinching. Essentially, we’re turning touch displays into touchless displays. To learn more, contact Duggal Visual Solutions for a live demo via Zoom videoconference.