I'm looking for a streamlined QA process for managing Fin’s performance as a one-woman team. Would love some suggestions for best practices for maintaining quality without getting overwhelmed with all the reports and data Intercom provides for Fin performance.
Answered
What’s your Fin QA process? Any tips for a solo manager?
Best answer by Nico Magbiray
Hi Keren,
Managing Fin alone can feel like a lot, but the secret is to stop treating it like a "mind-reader" and start treating it like a new trainee who knows absolutely nothing. If you want to maintain high quality without the burnout, follow this simple Fin Flywheel for your QA process:
1. Analyze - Check your conversation logs daily to see where Fin succeeded or got stuck. Focus on "unresolved" tags to find the gaps in your content.
2. Train (The "trainee" method) - When you ingest content, be specific and concise.
Avoid being vague; give literal, step-by-step instructions.
Use the Optimize button regularly to catch overlapping or redundant guidance that might confuse the AI.
Use rich formatting (bolding and bullets) to help Fin parse your instructions faster.
3. Test - Always use the Preview tool before going live. Verify that Fin pulls the correct snippets and doesn't get stuck in a loop.
4. Deploy - Only publish changes after they pass your preview tests. If a task is too complex for AI (like payment collection), offload it to a structured Workflow path instead.
One final pro-tip for your guidance:
To stop Fin from asking annoying "Was that helpful?" questions that break your automation, create a NO FOLLOW UP category. Tell Fin: "You MUST immediately end your turn and HAND OVER control". This keeps your flows clean and fully automated.
You can also check the best practices here: https://community.intercom.com/fin-tips-and-best-practices-82 and in FIN Academy (https://academy.fin.ai/)
Hope that helps!
Good luck!
+4Hi Keren,
Managing Fin alone can feel like a lot, but the secret is to stop treating it like a "mind-reader" and start treating it like a new trainee who knows absolutely nothing. If you want to maintain high quality without the burnout, follow this simple Fin Flywheel for your QA process:
1. Analyze - Check your conversation logs daily to see where Fin succeeded or got stuck. Focus on "unresolved" tags to find the gaps in your content.
2. Train (The "trainee" method) - When you ingest content, be specific and concise.
Avoid being vague; give literal, step-by-step instructions.
Use the Optimize button regularly to catch overlapping or redundant guidance that might confuse the AI.
Use rich formatting (bolding and bullets) to help Fin parse your instructions faster.
3. Test - Always use the Preview tool before going live. Verify that Fin pulls the correct snippets and doesn't get stuck in a loop.
4. Deploy - Only publish changes after they pass your preview tests. If a task is too complex for AI (like payment collection), offload it to a structured Workflow path instead.
One final pro-tip for your guidance:
To stop Fin from asking annoying "Was that helpful?" questions that break your automation, create a NO FOLLOW UP category. Tell Fin: "You MUST immediately end your turn and HAND OVER control". This keeps your flows clean and fully automated.
You can also check the best practices here: https://community.intercom.com/fin-tips-and-best-practices-82 and in FIN Academy (https://academy.fin.ai/)
Hope that helps!
Good luck!
+4Hi again Keren,
Always use the Analyze feature of Fin to check and optimize “gaps”. Examples of these gaps are Content gaps, Customer-data gaps, and Action gaps. It’s a big help in using and updating all these gaps through Fin’s suggestions and recommendations.
For creating guidance, handover, and escalation instructions, ALWAYS use the optimize button/feature to see whether you have an overlapping instruction, unclear, vague, and confusing information that Fin was not able to handle well.
Please feel free to message me if you need more help.
Good luck!
+2I would recommend setting up attributes (reasons that customers contact you) and let Fin categorize each conversation that comes through. Create a custom report that displays this information in a way that works for you. This should allow you to pinpoint the hot items and allow you to adjust guidance and content. Match that with CSAT/AI agent CX score you should be able to see where Fin is and isn’t performing well which should be helpful in targeting where you need to work on content & guidance.
+3Hi
Great advice from Nico and Gerald on using Fin's built-in tools. I'll add a workflow perspective since "not getting overwhelmed" is really the core challenge here.
The brutal truth: you can't QA everything as a solo manager. So don't try.
Instead of comprehensive coverage, focus on a sustainable weekly rhythm:
The "Weekly 5" approach
Block 30 minutes once a week. Pull 5 conversations that meet one of these criteria:
- Low CX Score (or negative CSAT if you're using surveys)
- Unresolved / handed off unexpectedly
- High-volume topic where Fin stumbled
For each one, ask: Is this a content problem or a guidance problem? In my experience, it's content 80% of the time — missing information, outdated docs, or content that's technically correct but not written the way customers ask the question.
Fix the content, move on. Five fixes per week compounds fast.
Use CX Score to reduce manual review
If you're not already using Intercom's CX Score, it's a game-changer for solo operators. It automatically scores every Fin conversation, so you're not manually sampling or relying on low-response-rate surveys. Let it surface the problems for you.
See: Understand customer experience at scale with the CX Score
One mindset shift that has helped:
Stop thinking of Fin QA as "checking the bot's work" and start thinking of it as "improving your knowledge base." Every Fin failure is a content gap you now know about. That reframe makes the work feel productive rather than reactive.
Join the Intercom Community 🎉
Already have an account? Login
Login to the community
No account yet? Create an account
Intercom Customers and Employees
Log in with SSOor
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.