Apache log for piwik


(torrefacto) #1

Hi All,

There are a lot of people replacing other old solutions of log analytics on their servers with Piwik, but all of them are fighting with the same problem: how to process their actual hundred of historical megabytes of apache logs for Piwik? All of us would like to see all the logs of the year processed by Piwik.

I saw that somebody was coding a script for hitting piwik.php with the apache logs. Does exist any solution for this kind of “migration”? It would do that a lot of people finally get to migrate from other solutions to Piwik.

I’m asking this question because if actually does not exist a solution, I would like to start coding a tool for this issue.

Great piece of software.

One!


(Matthieu Aubry) #2

Hi,
this code doesn’t exist yet.

we have a visit generator in Piwik
http://dev.piwik.org/trac/browser/trunk/mi…erateVisits.php
that is using Piwik_Tracker_Generator to fake timestamp, GET request, etc.
http://dev.piwik.org/trac/browser/trunk/co…r/Generator.php

Piwik will be less accurate with apache logs, because of lack of cookies of course. But that is possible and should give interesting results.

What is needed is a script that parses the apache logs + call piwik.php with the right parameters + you have to set the server-time so that you can fake the server date. eg. you can replay 10 days of logs in one hour, but Piwik has to know the server time and date of each line of logs.

Such a tool would be really useful.


(webonaut) #3

Sadly this script is not available anymore and I can not find any trace of this issue which does not lead to a dead end :frowning:

Is there still a way to import apache logs?

We need it for a project and we could my organize some fundings…


(Matthieu Aubry) #4

If you have funds, feel free to contact a Piwik consultant.

Especially since this will be made a lot easier since we worked on http://dev.piwik.org/trac/ticket/1446


(Fabian Becker) #5

[quote=webonaut @ Jul 7 2010, 11:47 AM]Sadly this script is not available anymore and I can not find any trace of this issue which does not lead to a dead end :frowning:

Is there still a way to import apache logs?

We need it for a project and we could my organize some fundings…[/quote]

The script is still available, but was moved into an own plugin. Have a look at the VisitorGenerator plugin which is available since 0.6.2, it uses almost the same code as the generateVisits.php.