New robots - robots unknown to piwik


(Mojo) #1

recently there is a new service at google giving a thumbnail preview of a page.
I recognized that google is generating the thumbnails on the fly. I would like to exclude this requests to our homepage in piwik.
Also i recoginzed a robot passing by which is not known by piwik.

What about creating a gui which allows you to add new crawler?
This google thing is comming with different ips so Id always have to update the exclude ip’s


(vipsoft) #2

Excluding Google Instant’s web preview is fixed in svn. We don’t have to exclude-by-IP … it uses a specific User-Agent. See http://dev.piwik.org/trac/changeset/3310

There aren’t many smartbots (eg crawlers that execute JavaScript), so a GUI might be excessive.


(Mojo) #3

thanks for answering my post!