PostbizBot

What is PostbizBot?

PostbizBot is the robot Postbiz uses to read the public pages of the websites that its customers add to their knowledge base, so that the AI assistant can rely on them to write posts and replies for that customer. It reads a site only because a customer asked for it: it does not browse or index the web. What it reads is used only for that customer, and is neither sold nor published.

How it behaves

• It identifies itself with the user agent PostbizBot/1.0, followed by the address of this page.
• It reads only public pages, never behind a login, and stays on the site it was asked to read: up to 50 pages per site, found through the sitemap and the links of the pages.
• It reads the robots.txt file of the site first and follows it, including the Crawl-delay directive (up to 10 seconds); otherwise it waits at least 0.7 second between two requests.
• It does not run JavaScript, does not submit forms and does not accept cookies.
• It reads a site again on its own at most once a week; its customer can also ask for a new reading, at most once every 10 minutes. Pages that have not changed are not stored again.

Block PostbizBot

To stop PostbizBot from reading your site, add these lines to the robots.txt file at the root of your site. It checks this file before every reading:

User-agent: PostbizBot
Disallow: /

To block only part of the site, replace / with the path to exclude. For any question, or if PostbizBot causes you a problem, write to contact@getpostbiz.com.