We are testing Piwik on a few Websites of ours, which currently have about 10k Vists per Day.
The Archiving cronjob currently consumes about 1Gb Ram for processing these websites, and the amount of needed Ram seems to steadily grow. (We increase the limit every two weeks…).
I followed the tips on the Piwik-High-Traffic-FAQ, but the memory consumption seems still to be pretty massive.
If piwik satisfies our needs, we think about utilizing it on a few more websites, which would result into approx. 20k vists per Day.
Are there any best-practice Configurations or Recommendations (Hardware-wise) for monitoring such an amount of Users ? Can anybody share his configuration, which works with a website in this scale (I’ve read the Forum post about High-Traffic Websites, but those only cover pure data, but not server configurations) ?
Also, i am unsure about one point:
Does deleting old logs lower the memory consumption of the archiver script ?
I’ve read on the Forum that this will not help, tho the FAQ states that deleting those is recommended.
If old logs will be deleted automatically, what data will be lost ?
I am thankful for any help,
More Detail on current visitor-logs:
Currently: ~10k Visitors / day, ~30k Actions / day
Since Mid-January 2012: 352300 visits, 1032926 actions.