As FIN crawls automatically our blog, it would be good if we could prevent this with rules like “do not crawl if URL contains blog” for example - or deactivate the crawled items with a filter like that for fin. Actually we do have to deactivate every single item which does not include relevant content by hand.
Archived
Prevent crawling of directories when adding a source
Join the Intercom Community 🎉
Already have an account? Login
Login to the community
No account yet? Create an account
Intercom Customers and Employees
Log in with SSOor
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
