Select Page

Applause Survey on AI and Customer Service Shows Higher Expectations but Lower Satisfaction

Applause shares AI survey results about user experiences with chatbots, interactive voice response and other conversational assistants.

Applause, the world leader in testing and digital quality, recently conducted a survey with 6,680 respondents about their experiences using artificial intelligence (AI) in the form of voice applications such as chatbots, interactive voice response (IVR), and other conversational assistants.

Conducted in February 2022, the survey showed alignment between the expectations and experiences of participants in the U.S. and across Europe. According to the survey, consumers expect apps and websites to provide AI-driven customer service solutions, but they are not always satisfied with the user experience.

For example, 93% of respondents expect chat functionality on a website, but only two-thirds said they were somewhat satisfied or extremely satisfied with the experience. More than half of respondents in the U.S. (51%) and Europe (57%) said they preferred to wait for a human agent when calling a company for customer support.

“The fact that more than half of respondents preferred to wait for a human agent instead of using a chatbot, IVR, or voice assistant speaks to a potential lack of confidence which perhaps is based on previous experiences. When a user has a bad digital experience, it is difficult to change that perception. This is a moment when quality can be a real differentiator, separating a brand from its competition. If customers expect these solutions to disappoint, they are predisposed to anticipate failure and quickly lose patience with any alternative that isn’t a human interaction. Therefore, there is tremendous advantage to those who are able to deliver better experiences that can exceed the service level they have been conditioned to expect,” said Luke Damian, Chief Growth Officer, for Applause.

User Experience Trails Expectations

  • 93% expect chat functionality on a company’s website or app but only 63% said they were somewhat satisfied or extremely satisfied with the experience.

  • 89% expect call centers to have IVR systems that greet them but only 25% prefer immediate access to automated touchtone response systems, and 22% prefer an automated virtual service representative that responds to voice commands.

  • 44% always expect mobile apps to have voice assistants or voice search features while 41% said it depends on the app category.

A single AI application can require tens of thousands or more accurate and relevant data artifacts, all of which need to be collected with the application’s specific purpose and needs in mind. Applause leverages a community of more than one million qualified testers worldwide to collect the volume and quality of real world data needed to train and validate AI algorithms, like those used for IVR or chatbots, and then test the trained systems to ensure they are working as intended.

Bias is a well-known challenge in AI. Algorithms that are not provided enough data or learn from data that is collected from a group of people that is too homogenous, can produce overly-generalized, biased outcomes and unintended behaviors. The size and breadth of the Applause community enables a diversity of feedback and input representing a wide variety of devices, plus limitless diversity of demographic and psychographic characteristics, including countries of origin or residence, ages, genders, cultures, abilities, languages, socioeconomic variables, and more.

Additional resources on Artificial Intelligence

How to Build an AI Data Collection Program – Ebook

Perceptions and Use of AI Voice Apps – blog post

3 Unexpected AI Use Cases and Their Hidden Benefits – webinar

4 Best Practices for Better Natural Language Assistants – Ebook

About Applause

Applause is the global leader in managed software testing services and digital quality. Through AI, automation and the world’s largest independent testing community, we help leading enterprises validate every aspect of their apps and other digital experiences. Our fully managed approach makes it easy for organizations to test under real-world conditions, across devices, locations and use cases — at the speed and scale required in the age of AI. Applause alleviates pressure on internal teams by helping expand testing coverage, keep pace with modern release cycles, and deliver exceptional quality to their users around the world. With deep expertise in payment testing, accessibility, UX and AI evaluation, Applause is a trusted partner to the world’s most innovative brands.

Visit applause.com to learn more.