Importing IIS logs shows 0 lines recorded, fine in dry-run

Support & Bugs
1

Hi folks. I’m just trying out Piwik for our log-analysis needs, so am only looking at importing IIS logs, not using the JS tracking.

I have some IIS logs, and when I try to import them, I get

Here’s my command:


python D:\xampp\htdocs\piwik-2.10.0\misc\log-analytics\import_logs.py --idsite=1 --url=http://localhost/piwik-2.10.0 D:\Backup\LogFiles\IIS\web6403\W3SVC1\u_ex141014.log --show-progress --recorders=4 --enable-http-errors --enable-http-redirects --enable-static --enable-bots --login=import --password=import



Parsing log D:\Backup\LogFiles\IIS\web6403\W3SVC1\u_ex141014.log...
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
3204 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)

About every 15 times that line is repeated, I get one that says 800 lines recorded. Then it repeats 0 again.

If I try it by adding --dry-run, it works:


0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
Parsing log D:\Backup\LogFiles\IIS\web6403\W3SVC1\u_ex141014.log...
13541 lines parsed, 12800 lines recorded, 12774 records/sec (avg), 12800 records/sec (current)
27367 lines parsed, 27200 lines recorded, 13579 records/sec (avg), 14400 records/sec (current)
40711 lines parsed, 40000 lines recorded, 13315 records/sec (avg), 12800 records/sec (current)

I have tried this with version 2.10.0 and 2.11.1

2

Hi there,

this is expected behavior, it just takes time on your server to import 800 rows at once. you can change the parameters such as recorders and other parameters to tweak the import.