Skip to main content Skip to main navigation


Using Intelligent Natural User Interfaces to Support Sales Conversations

Sven Gehring; Markus Löchtefeld; Florian Daiber; Matthias Böhmer; Antonio Krüger
In: Proceedings of International Conference on Intelligent User Interfaces. International Conference on Intelligent User Interfaces (IUI-12), February 14-17, Lisbon, Portugal, ACM, 2012.


During sales conversations, gestures and mimics are of high importance to communicate information about a product. One prominent example for such sales gestures is the meat and cheese counter, which is one of the remaining spots in supermarkets where sales persons interact with customers. Interactions at such counters in supermarkets normally follow a simple protocol. The customer points at an item of choice. The employee takes out the item and, in most of the cases the product needs to be cut to fit the amount the customer wants to buy. Often it is ambiguous about what specific product the customer and the employees are talking about. Up to now, there are just a few efforts in HCI re-search to enrich communication at the point of sale. In this paper we report and analyze one scenario in which an intelligent natural user interface can support communication between customer and employee in a sales conversation. Furthermore we report on our prototype that is able to track pointing gestures by using a depth camera and to display information about items pointed at.