SBuilderAgentsBot
Our website reader only visits a website when someone creates an assistant for that website on agents.sbuilder.eu or agents.sbuilder.nl. It:
- reads up to approx. 15 public pages of one domain, with at most 3 requests at the same time and an overall time limit;
- respects
robots.txt(user agentSBuilderAgentsBot, or otherwise*); - only reads text, does not log in, does not fill in forms and does not follow links to other domains.
Rather not? Add this to your robots.txt:
User-agent: SBuilderAgentsBot Disallow: /
Questions or complaints: info@sbuilder.nl.