Our crawler

TraceFlowLensBot, the TraceFlow Lens audit crawler

When a user requests an audit of a page on TraceFlow Lens, our crawler reads that page, the robots.txt and llms.txt files, the sitemap and a small sample of pages listed in the sitemap (5 at most). It does not crawl the rest of the site.

How to recognise it?

It identifies itself with the following user agent:

Mozilla/5.0 (compatible; TraceFlowLensBot/0.1; +https://lens.traceflowlabs.com/robot)

What it does not do

• It only reads public pages, without any login or password.
• It does not store the content of your pages and is not used to train any AI.
• It makes only a handful of requests per audit, and the number of audits is limited.

Any question?

Write to support@traceflowlabs.com.