I’ve excluded my IP + any bots (/bot|spider|crawl|scanner/). Nevertheless I get weird visit logs every 3 minutes that are trying to search any files on the server. So at this point I am not sure whether the crawler exclusion is really working? How can such logs be excluded? It’s quite frustrating as it falsifies the website stats.