import_logs.py - how long time?

Support & Bugs
1

how long time should it take to import 1.4GB access log file??

i am on a
Intel® Core™ i7-2600 Quadcore
incl. Hyper-Threading Technology
RAM32 GB DDR3 RAM

i have --recorders=4 but it has only done 155.000 lines in 1½ hour.

2

I’m working with 8 - 16 recorders and seeing 100000 lines / hour over here.

3

we will in the next major release greatly increase performance :slight_smile:

4

[quote=matt]
we will in the next major release greatly increase performance :)[/quote]

Cool, Can you give an estimate on time?
And is there anything i Can do right now to get it faster?

5

And its pretty weird. I get this

355966 lines parsed, 345964 lines recorded, 0 records/sec
355966 lines parsed, 345964 lines recorded, 0 records/sec
355966 lines parsed, 345964 lines recorded, 0 records/sec
355966 lines parsed, 345964 lines recorded, 0 records/sec
355966 lines parsed, 345964 lines recorded, 0 records/sec
355966 lines parsed, 345964 lines recorded, 0 records/sec
355966 lines parsed, 345964 lines recorded, 0 records/sec
355966 lines parsed, 345964 lines recorded, 0 records/sec

All the time now. It doesn’t stop the script. Why?