Browser Crawl Engine

Acceptable use policy

We provide crawling infrastructure. You decide what to collect, and that decision — along with the responsibility for it — is yours.

Your undertaking

By submitting a URL you confirm that:

Not permitted

What we will not build

These are permanent product decisions, not limitations awaiting a roadmap entry:

A site that actively refuses automated access will keep refusing it here, and the API will tell you so rather than returning a challenge page dressed up as a result.

Complaints from site operators

A site operator who contacts us about traffic from our exits gets a response. In practice that means:

  1. we identify which account submitted the requests;
  2. we block that target for that account;
  3. we tell the account why.

We keep enough record of which account requested which host to answer that question. Repeated complaints end the account.

Suspension

We may suspend an account immediately where there is credible evidence of unlawful collection, of an attack dressed as crawling, or of payment fraud. A suspended account keeps its data and its ledger; suspension stops new work, it does not erase anything.

Personal data

Where we process personal data contained in pages we fetch on your instruction, we act as a processor and you as the controller. Rendered HTML is kept only for the resultTtlSeconds you set on the job, to a maximum of seven days, and is then deleted.

If you are collecting personal data in the EU or UK, having a lawful basis is your obligation before the first request, not after a complaint.

Changes

Material changes to this policy are announced to account holders before they take effect.

Questions about whether a specific use is acceptable are worth asking before you build against it. We would rather answer early than suspend later.