Piwik does not count all Search Engine visits

I’ll use Google as an example (because of the significance of the large difference in numbers), but the same applies to Bing, Yahoo and probably others.

We usually receive between 1000 and 1500 hits from Google (search engine visits) a day and this is also reflected in our Google Webmaster stats, but from the 16th (of June) onwards Piwik only reports about 5 to 20 hits from Google (search engine visits).

Our Google Webmaster stats show no decrease in traffic (all days from the 16th to the 22nd are in there, with stats that are no different from the days before that) and our own visitor counter also doesn’t show any decrease in traffic. These indications point towards either Google all search engines (Bing and Yahoo are also affected, the others have too low averages to make any statement about them) or Piwik being the problem. The most likely of the two being Piwik (or some configuration).

This problem did not coincide with any upgrade we made, we upgraded to 1.4 relatively soon (< a week) after it was released and we upgrade to 1.5 on the 22nd of June.

Is there anyone experiencing a similar problem or who has an idea as to what might be causing it?

Thanks in advance!

Never mind, I found out what caused this, so I’ll post it over here for documentation purposes.

We were getting some visits from website that escaped URLs, so instead of www.oursite.com the user would get Site Unavailable.

I configured our webserver to redirect these ‘incorrect’ URLs to the proper place, but in doing so I crippled Piwik because Piwik makes use of these ‘escaped strings’ to send information through the URL parameters.

I’ve now configured our webserver to only apply the ‘translation’ on ‘www.oursite.com’ and not on ‘anything.oursite.com’, which solved the issue :slight_smile:

(If this is not valuable information this topic can of course be removed ;))

Thanks for pointing this out. It looks like Google’s custom search referrer has changed a bit. I’m investigating it now.

I’ve already found out what was wrong, it’s in the second post :wink:

I don’t know about Google’s referrer, but I’m sure it was my server configuration causing the issue (as I’m 100% that it’s fixed now).

This might still be useful for people who might make the same mistake as I did.

CSE is fixed in http://dev.piwik.org/trac/changeset/4955

Yes, I see you fixed a problem on your end. But if you hadn’t mentioned a problem, I wouldn’t have gone looking for one – and I did – and it’s now fixed.

Cheers.