Archive.php Bottleneck

Support & Bugs
1

Hi!

I’m facing some problems running the archive.php-Cron. It take more than 24 hrs to process all reports.

My setup: 3-5 mio PIs / day on AWS EC2 xlarge instance (php+mysql)

But the CPU usuage is never above 40%. Is there any other bottleneck? Or way to speed up the archive process?

Cheers!

3

Hi,

We are seeing some similar issues with the archiver process taking >24 hours to complete. How did you end up resolving the issue? It takes about 10 seconds to archive a single site and we have about 15,000 sites.

Thanks!

4

I seperated DB + Web server. I’m now using RDS m1.xlarge (multi az) as DB and EC2 m1.xlarge for archiving.