Archive.php Bottleneck


I’m facing some problems running the archive.php-Cron. It take more than 24 hrs to process all reports.

My setup: 3-5 mio PIs / day on AWS EC2 xlarge instance (php+mysql)

But the CPU usuage is never above 40%. Is there any other bottleneck? Or way to speed up the archive process?



We are seeing some similar issues with the archiver process taking >24 hours to complete. How did you end up resolving the issue? It takes about 10 seconds to archive a single site and we have about 15,000 sites.


I seperated DB + Web server. I’m now using RDS m1.xlarge (multi az) as DB and EC2 m1.xlarge for archiving.