Skip to content
Scan your store
Help · yarvi.ai/help

The Agents, Crawlers and Product pages viewsHow Yarvi works on your store, in plain words.

Three views in the app show who reads your store and what they read.

Agents lists each AI agent that visited, by product name, and how Yarvi recognized it: by the name the agent sends with each request, by a signed Web Bot Auth header, or because Cloudflare verified it. A signed header is checked against the agent's published keys, so it is stronger than a name, which anyone can send.

Crawlers shows which AI crawlers asked for your pages, what your store answered (served, blocked, or rate limited), and what your robots.txt says to each one. A crawler your robots.txt allows but your store still blocks is worth a look, because that is usually a bot protection app or a firewall rule. This view shows example data for now, labeled Example data.

Product pages lists the product pages agents read most, with the orders that included that product afterwards.

A view that has no data from your store yet says so. A view showing sample numbers is always labeled Example data.

Inside the Yarvi app, ask in Help. Yarvi's AI support assistant answers from these same articles and your store's own data, and hands anything about billing, your data or a person to Ned.

Source: docs/help/agents-and-crawlers.md. This page and the in-app assistant read the same file.

All help articles