You found ClearPriceBot in your logs
It fetched a page or two from your site because your organisation publishes Support at Home prices. Here is exactly what it does, and how to stop it.
- User agent
ClearPriceBot/0.1 (+https://clearprice.com.au/bot; hello@clearprice.com.au)- Operated by
- Zatersio, Australia
- What it fetches
- Pages likely to hold a price list — pricing, fees, schedule of charges — and occasionally a contact page. Typically two to four pages per site.
- How often
- Monthly at most — that is our policy, not a technical limit. We are looking for price changes, not monitoring your site.
- Rate
- At most one request to your site every three seconds, enforced in the crawler itself, however many sites we are reading at the time. It should be indistinguishable from one person reading your pricing page.
- robots.txt
- Checked before every request and obeyed, including when it means fetching nothing at all.
- Forms and logins
- Never. It reads public pages only, submits nothing, and does not attempt to reach anything behind a login.
Why we collect it
Providers must publish Support at Home prices, but nobody aggregates them, so no provider can tell whether their own rate is normal. We read those published lists and turn them into regional quartiles. Your prices are never shown next to your name to another provider — see the methodology.
Blocking us
Add this to your robots.txt and we will stop on the next run:
User-agent: ClearPriceBot
Disallow: /You can also block the user agent at your firewall or CDN. We will not work around either, and there is no second crawler under a different name.
Removing what we already hold
Email us and we will delete the prices and archived pages we hold for your organisation, and exclude you from future collection. Tell us the organisation name and website; we do not need anything else.
Email hello@clearprice.com.au
We action removal requests within 5 business days and confirm when it is done. Removing your data does not remove your organisation from the AIHW register we use as our provider list — that is published by the government, not by us.
If ClearPriceBot has caused a problem — too many requests, an unexpected load, anything at all — email us and we will fix it the same day. We are trying to read a price list, not cost you money.