EntryAdBot

EntryAdBot reads a website only after its owner has verified it in EntryAd, so that their marketing can be based on what the site actually says.

• It identifies itself as EntryAdBot/1.0 and follows robots.txt (rules for EntryAdBot, otherwise *), including Crawl-delay.
• It reads public pages only: no logins, cookies or paywalls, and it skips pages marked noindex and pages with a password field.
• It fetches at most one page a second and a limited number of pages per visit, and only when the site's owner asks.
• It never reads private areas such as an account dashboard.

Questions or problems: nunu.blur.ops@gmail.com.