Hi all, we just turned on the Suggest Help Articles Task Bot for both users and leads and in the first week of use we are finding its article suggestions to be way off. It seems to be suggesting just our oldest/highest viewed articles without taking into account keywords (see below for an example).
I've already read Intercom's "Let users help themselves with smart suggestions" and "Share articles to answer questions faster". I've done the suggestions about writing relevant articles with the words the customers are searching for.
The suggestion about -"When a customer gets in touch, you should send them a relevant article in your first reply to them. If they send you a second message before you reply Operator won’t learn from this." - really doesn't work for my company. When our users actually get to talk to a live agent they expect targeted, step-by-step support, not just guidance on where to find an article and especially not on the first reply.
Is there any other way I could improve the task bot's accuracy? As it is now, I'm not sure we'll keep it turned on since its suggestions are not getting the content that is on our help center to our users.
Example: One of our top inquiries is about "unfinalized tracks". We have one main article that is titled "unfinalized tracks" and mentions that term in the article body about 20 times. Then we have 2-3 other articles that have that same keyword about 1-4 times in the body or title. Well the Task Bot has not suggested the "Unfinalized Track" article once in multiple instances where a user has chatted us asking about "unfinalized tracks" even when they write that keyword several times in their message. But it is suggesting the articles where the keyword appears just once or ones where the keyword doesn't appear at all!
Your Privacy Choices