Problem with the log importer

Support & Bugs
1

Hi,

I’m using the import_logs.py to process my logs, my setup uses piwik 1.10.1.

It was processing the logs correctly until now, but now it seems to fail. It starts processing lines but stops after a random number of lines, like this:

python import_logs.py --url=http://mysite/piwik /var/log/httpd/mysite-access_log.2 --idsite=1 --recorders=4 --enable-http-errors --enable-http-redirects --enable-bots --skip=8030

0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
Parsing log /var/log/httpd/mysite-access_log.2…
9797 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
9797 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
9797 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
9797 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
Fatal error: Internal Server Error
You can restart the import of “/var/log/httpd/mysite-access_log.2” from the point it failed by specifying --skip=8665 on the command line.

If I have a look to the apache log looking for errors, I see multiple lines like:

[Wed Feb 20 22:43:58 2013] [error] [client a.b.c.d] PHP Fatal error: Cannot redeclare getrecordwithdnsservice() (previously declared in /pathto/piwik/libs/MaxMindGeoIP/geoipcity.inc:68) in /pathto/piwik/plugins/GeoIP/libs/geoipcity.inc on line 112

I don’t really think it’s related to this error. As said, it processes a random number of lines before hanging (and this error is appearing while doing that processing).

On the other hand, I did not change anything in the server… what could be causing this problem? any hint on debugging the issue?

Thanx in advance!

J.

2

the problem definitely is the error “getrecordwithdnsservice”

but I search for this function in piwik and I dont find it appart from the declaration. So I dont know what could be causing it ?

3

Here is a link with some possible sources to a solution.

I like re initalize fastcgi (if applicable), though the one where svn clash of 2 like clashes concerns me as piwik has migrated/in the proces of migrating to github.(Admins here would know better than i)

What version of python are you using? 2.7.3 should be the minimum try to upgrade that if appicable.