I wanted to provide some feedback on the CX score calculation to the Intercom crew and see how others have noticed a change over recent months. It seems like the CX score is something Intercom is highlighting over the traditional CSAT metric, but internally, we have some hesitancy before we switch to using it as the primary measure of support performance.
Prior to November, our average CX Score was 91.7%. Lower than our historic CSAT, but close enough, and it seemed fair given that it assesses all conversations, not just those with survey responses. Somewhere between November/December, this took a sharp drop, and the new average is closer to 65%.
After some digging, it seems like the score now considers a conversation where the customer leaves without responding as a score of 3 (or 0%). In theory, I understand that this is being treated like an “abandoned” chat. However, in practice, I don’t think this is indicative of a poor user experience that warrants a 0% rating. In many of these cases, I take it as the customer getting the info they need and promptly leaving the chat, not feeling the need to “close the loop” with an AI chatbot as they might with a human agent.
With that, I guess I have a few follow up questions to others & the Intercom team:
- Is the CX Score still under development, or is this its final state? (Important for internal benchmarking / performance tracking)
- Given that it’s AI-assessed, will there be a way for us to “train” / provide Guidance for how Intercom calculates our personal CX Score (akin to Fin Guidance)?
- What was the intention behind the CX Score calculation change late last year / what else changed besides the scenario I laid out above?
Submitted
Improvements to CX score calculation
Join the Intercom Community 🎉
Already have an account? Login
Login to the community
No account yet? Create an account
Intercom Customers and Employees
Log in with SSOor
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.