Measurement of Bot's interactions | Community
Skip to main content
Answered

Measurement of Bot's interactions

  • Jun 7, 2022 1:41 PM UTC
  • 9 replies
  • 259 views

Hello everyone! Any suggestion on how to measure the impact of our custom bots both from a path analysis perspective and customer satisfaction's one? Have you been able to find any good integration to be tested? Thank you!

Best answer by Aparna

Hey @user1204​ ! Clicking on each of the paths in the stats section will give you an insight into the number of views, and percentage of drop off at each path. This metric will give you an understanding of the impact of the bot. You can find details here https://www.intercom.com/help/en/articles/3473772-optimize-your-custom-bots-with-path-analysis. To get the bigger picture view of the impact your Custom Bots have, you can use the custom bot reports.

 

 

View original

9 replies

Forum|alt.badge.img+5
  • Employee
  • Answer
  • Jun 9, 2022 11:41 AM UTC

Hey @user1204​ ! Clicking on each of the paths in the stats section will give you an insight into the number of views, and percentage of drop off at each path. This metric will give you an understanding of the impact of the bot. You can find details here https://www.intercom.com/help/en/articles/3473772-optimize-your-custom-bots-with-path-analysis. To get the bigger picture view of the impact your Custom Bots have, you can use the custom bot reports.

 

 


  • Author
  • Active User
  • Jun 9, 2022 3:57 PM UTC

Hello @aparna​ , and from the CSAT point of view? Currently I have only drop-offs and number of conversations


Forum|alt.badge.img+5
  • Employee
  • Jun 10, 2022 9:43 AM UTC

@user1204​! Currently the overall custom bot report would give you insight on sent, engaged, completed and the stats section of the each bot would give details on path analysis. For CSAT the best option would be to tag the custom bot conversation by their title and then in the CSAT report you can filter the reports by the tag name.


  • Author
  • Active User
  • Jun 13, 2022 7:57 AM UTC

But our Customers don't vote the interaction with the BOT. They can only give a CSAT to conversations with agents, how should I set the CSAT also for interactions with bots? @aparna​ 


Forum|alt.badge.img+5
  • Employee
  • Jun 28, 2022 12:36 PM UTC

CSAT rating will not be sent for outbound custom bots. For Inbound(new conversation) CSAT request will be sent. If you like to send a CSAT request for outbound bots, you can create a survey within Intercom and the share the URL of the link in the bot path or add any survey app in the bot path. Would this suit your workflow?


  • Author
  • Active User
  • Jun 28, 2022 1:32 PM UTC

Hello @aparna​ ! I am talking about a new conversation bot, but I don't see any evaluation request sent out by Intercom.

Example: 120821400407722

Maybe there is some setting we are missing and we should enable?


Forum|alt.badge.img+5
  • Employee
  • Jun 29, 2022 4:05 AM UTC

Hey @user1204​ ! Looking at the conversation example you shared it seems like there wasn't any reply from the teammate/admin at all. Rating request will be sent only when there is a reply from a teammate. Here is an article to give some insight on when rating request will be sent.


  • Author
  • Active User
  • Jun 29, 2022 7:12 AM UTC

Exactly, I am talking about conversations entirely managed by bots without agents' support. So I imagine there is no way to receive a CSAT for this kind of conversations


Forum|alt.badge.img+5
  • Employee
  • Jul 20, 2022 8:25 PM UTC

@user1204​! At the moment it is a limitation on our end. A possible option would be to send a survey in the last bot path to collect the customer's response.

 

I would also suggest you to flag a request in product wishlist page.