I have a multi server multi instance footprint of Piwik. I have an issue where my archive process is completing but it still shows that it was last archived without error many days ago. As far as I can tell there are no errors occurring (as indicated in the log summary at the end), and yet it seems there errors somewhere. My question is how to I fix this issue so the log resets itself back to zero days without error?
INFO [2017-04-04 21:49:38] - Archiving was last executed without error 57 days 13 hours ago
My Piwik system overview:
- 4 x Piwik web servers, each with 10 separate named instances of Piwik (/p01, /p02, /p03 etc…)
- Each Piwik instances hosts analytics for about 500 to 2000 separate websites
- Each web server has a dedicated MySQL server.
- Each web server has a dedicated “archives” server for managing archives via CRON every 12 hours.
[example cron syntax]
/var/www/html/p15/console core:archive --url=http://localhost/p15/ > /var/log/piwik_archives/piwik-archive15.log
Log snipits:
[beginning of my archive log]
INFO [2017-04-04 19:00:02] ---------------------------
INFO [2017-04-04 19:00:02] INIT
INFO [2017-04-04 19:00:02] Running Piwik 2.17.1 as Super User
INFO [2017-04-04 19:00:02] ---------------------------
INFO [2017-04-04 19:00:02] NOTES
INFO [2017-04-04 19:00:02] - Reports for today will be processed at most every 86400 seconds. You can change this value in Piwik UI > Settings > General Settings.
INFO [2017-04-04 19:00:02] - Reports for the current week/month/year will be refreshed at most every 3600 seconds.
INFO [2017-04-04 19:00:02] - Archiving was last executed without error 57 days 10 hours ago
INFO [2017-04-04 19:00:02] - Will process 477 other websites because the last time they were archived was on a different day (in the website’s timezone) , IDs: 4665, 5080, 5081, 5082, 5083, 5084, 5085, 5086, 5087, 5088, 5089, 5090, 5091, 5092, 5093, 5094, 5095, 5096, 5097, 5098, 5099, 5100, 5101, 5102, 5103, 5104, 5105, 5106, 5107, 5108, 5109, 5110, 5111, 5112, 5113, 5114, 5115, 5116, 5117, 5118, 5119, 200001, 200002, 200003, 200004, 200005, 200006, 200007, 200008, 200009, 200010, 200011, 200012, 200013, 200014, 200015, 200016, 200017, 200018, 200019, 200020, 200021, 200022, 200023, 200024, 200025, 200026, 200027, 200028, 200029, 200030, 200031, 200032, 200033, 200034, 200035, 200036, 200037, 200038, 200039, 200040, 200041, 200042, 200043, 200044, 200045, 200046, 200047, 200048, 200049, 200050, 200051, 200052, 200053, 200054, 200055, 200056, 200057, 200058, 200059, 200060, 200061, 200062, 200063, 200064, 200065, 200066, 200067, 200068, 200069, 200070, 200071, 200072, 200073, 200074, 200075, 200076, 200077, 200078, 200079, 200080, 200081, 200082, 200083, 200084, 200085, 200086, 200087, 200088, 200089, 200090, 200091, 200092, 200093, 200094, 200095, 200096, 200097, 200098, 200099, 200100, 200101, 200102, 200103, 200104, 200105, 200106, 200107, 200108, 200109, 200110, 200111, 200112, 200113, 200114, 200115, 200116, 200117, 200118, 200119, 200120, 200121, 200122, 200123, 200124, 200125, 200126, 200127, 200128, 200129, 200130, 200131, 200132, 200133, 200134, 200135, 200136, 200137, 200138, 200139, 200140, 200141, 200142, 200143, 200144, 200145, 200146, 200147, 200148, 200149, 200150, 200151, 200152, 200153, 200154, 200155, 200156, 200157, 200158, 200159, 200160, 200161, 200162, 200163, 200164, 200165, 200166, 200167, 200168, 200169, 200170, 200171, 200172, 200173, 200174, 200175, 200176, 200177, 200178, 200179, 200180, 200181, 200182, 200183, 200184, 200185, 200186, 200187, 200188, 200189, 200190, 200191, 200192, 200193, 200194, 200195, 200196, 200197, 200198, 200199, 200200, 200201, 200202, 200203, 200204, 200205, 200206, 200207, 200208, 200209, 200210, 200211, 200212, 200213, 200214, 200215, 200216, 200217, 200218, 200219, 200220, 200221, 200222, 200223, 200224, 200225, 200226, 200227, 200228, 200229, 200230, 200231, 200232, 200233, 200234, 200235, 200236, 200237, 200238, 200239, 200240, 200241, 200242, 200243, 200244, 200245, 200246, 200247, 200248, 200249, 200250, 200251, 200252, 200253, 200254, 200255, 200256, 200257, 200258, 200259, 200260, 200261, 200262, 200263, 200264, 200265, 200266, 200267, 200268, 200269, 200270, 200271, 200272, 200273, 200274, 200275, 200276, 200277, 200278, 200279, 200280, 200281, 200282, 200283, 200284, 200285, 200286, 200287, 200288, 200289, 200290, 200291, 200292, 200293, 200294, 200295, 200296, 200297, 200298, 200299, 200300, 200301, 200302, 200303, 200304, 200305, 200306, 200307, 200308, 200309, 200310, 200311, 200312, 200313, 200314, 200315, 200316, 200317, 200318, 200319, 200320, 200321, 200322, 200323, 200324, 200325, 200326, 200327, 200328, 200329, 200330, 200331, 200332, 200333, 200334, 200335, 200336, 200337, 200338, 200339, 200340, 200341, 200342, 200343, 200344, 200345, 200346, 200347, 200348, 200349, 200350, 200351, 200352, 200353, 200354, 200355, 200356, 200357, 200358, 200359, 200360, 200361, 200362, 200363, 200364, 200365, 200366, 200367, 200368, 200369, 200370, 200371, 200372, 200373, 200374, 200375, 200376, 200377, 200378, 200379, 200380, 200381, 200382, 200383, 200384, 200385, 200386, 200387, 200388, 200389, 200390, 200391, 200392, 200393, 200394, 200395, 200396, 200397, 200398, 200399, 200400, 200401, 200402, 200403, 200404, 200405, 200406, 200407, 200408, 200409, 200410, 200411, 200412, 200413, 200414, 200415, 200416, 200417, 200418, 200419, 200420, 200421, 200422, 200423, 200424, 200425, 200426, 200427, 200428, 200429, 200430, 200431, 200432, 200433, 200434, 200435, 200436
INFO [2017-04-04 19:00:02] ---------------------------
INFO [2017-04-04 19:00:02] START
INFO [2017-04-04 19:00:02] Starting Piwik reports archiving…
INFO [2017-04-04 19:00:02] Day has finished for website id 4665 since last run
INFO [2017-04-04 19:00:02] Skipped website id 4665, already done 11 hours 59 min ago, Time elapsed: 0.022s
INFO [2017-04-04 19:00:03] Day has finished for website id 5080 since last run
INFO [2017-04-04 19:00:03] Skipped website id 5080, already done 11 hours 59 min ago, Time elapsed: 0.005s
INFO [2017-04-04 19:00:03] Day has finished for website id 5081 since last run
INFO [2017-04-04 19:00:03] Skipped website id 5081, already done 11 hours 59 min ago, Time elapsed: 0.024s
INFO [2017-04-04 19:00:03] Day has finished for website id 5082 since last run
INFO [2017-04-04 19:00:03] Skipped website id 5082, already done 11 hours 59 min ago, Time elapsed: 0.014s
INFO [2017-04-04 19:00:04] Day has finished for website id 5083 since last run
INFO [2017-04-04 19:00:04] Skipped website id 5083, already done 11 hours 59 min ago, Time elapsed: 0.020s
INFO [2017-04-04 19:00:04] Day has finished for website id 5084 since last run
INFO [2017-04-04 19:00:04] Skipped website id 5084, already done 11 hours 59 min ago, Time elapsed: 0.017s
INFO [2017-04-04 19:00:04] Day has finished for website id 5085 since last run
INFO [2017-04-04 19:00:04] Skipped website id 5085, already done 11 hours 59 min ago, Time elapsed: 0.013s
INFO [2017-04-04 19:00:04] Day has finished for website id 5086 since last run
INFO [2017-04-04 19:00:04] Skipped website id 5086, already done 11 hours 58 min ago, Time elapsed: 0.021s
INFO [2017-04-04 19:00:05] Day has finished for website id 5087 since last run
INFO [2017-04-04 19:00:05] Skipped website id 5087, already done 11 hours 58 min ago, Time elapsed: 0.022s
INFO [2017-04-04 19:00:05] Day has finished for website id 5088 since last run
INFO [2017-04-04 19:00:05] Will pre-process for website id = 5088, period = day, date = last3
INFO [2017-04-04 19:00:05] - pre-processing all visits
INFO [2017-04-04 19:00:07] Archived website id = 5088, period = day, 0 segments, 0 visits in last 3 days, 0 visits today, Time elapsed: 2.175s
INFO [2017-04-04 19:00:07] Will pre-process for website id = 5088, period = week, date = last2
INFO [2017-04-04 19:00:07] - pre-processing all visits
INFO [2017-04-04 19:00:09] Archived website id = 5088, period = week, 0 segments, 0 visits in last 2 weeks, 0 visits this week, Time elapsed: 1.898s
INFO [2017-04-04 19:00:09] Will pre-process for website id = 5088, period = month, date = last2
INFO [2017-04-04 19:00:09] - pre-processing all visits
INFO [2017-04-04 19:00:11] Archived website id = 5088, period = month, 0 segments, 0 visits in last 2 months, 0 visits this month, Time elapsed: 1.927s
INFO [2017-04-04 19:00:11] Will pre-process for website id = 5088, period = year, date = last2
INFO [2017-04-04 19:00:11] - pre-processing all visits
INFO [2017-04-04 19:00:13] Archived website id = 5088, period = year, 0 segments, 25 visits in last 2 years, 0 visits this year, Time elapsed: 2.161s
INFO [2017-04-04 19:00:13] Archived website id = 5088, 4 API requests, Time elapsed: 8.296s [10/477 done]
INFO [2017-04-04 19:00:13] Day has finished for website id 5089 since last run
INFO [2017-04-04 19:00:13] Will pre-process for website id = 5089, period = day, date = last3
INFO [2017-04-04 19:00:13] - pre-processing all visits
INFO [2017-04-04 19:00:16] Archived website id = 5089, period = day, 0 segments, 9 visits in last 3 days, 0 visits today, Time elapsed: 2.635s
INFO [2017-04-04 19:00:16] Will pre-process for website id = 5089, period = week, date = last2
INFO [2017-04-04 19:00:16] - pre-processing all visits
INFO [2017-04-04 19:00:17] Archived website id = 5089, period = week, 0 segments, 28 visits in last 2 weeks, 5 visits this week, Time elapsed: 1.305s
INFO [2017-04-04 19:00:17] Will pre-process for website id = 5089, period = month, date = last2
INFO [2017-04-04 19:00:17] - pre-processing all visits
…
[end of my archive log]
INFO [2017-04-04 19:01:52] Archived website id = 200436, period = year, 0 segments, 0 visits in last 2 years, 0 visits this year, Time elapsed: 1.288s
INFO [2017-04-04 19:01:52] Archived website id = 200436, 4 API requests, Time elapsed: 4.922s [477/477 done]
INFO [2017-04-04 19:01:52] Done archiving!
INFO [2017-04-04 19:01:52] ---------------------------
INFO [2017-04-04 19:01:52] SUMMARY
INFO [2017-04-04 19:01:52] Total visits for today across archived websites: 0
INFO [2017-04-04 19:01:52] Archived today’s reports for 4 websites
INFO [2017-04-04 19:01:52] Archived week/month/year for 4 websites
INFO [2017-04-04 19:01:52] Skipped 473 websites
INFO [2017-04-04 19:01:52] - 0 skipped because no new visit since the last script execution
INFO [2017-04-04 19:01:52] - 473 skipped because existing daily reports are less than 86400 seconds old
INFO [2017-04-04 19:01:52] - 0 skipped because existing week/month/year periods reports are less than 3600 seconds old
INFO [2017-04-04 19:01:52] Total API requests: 16
INFO [2017-04-04 19:01:52] done: 4/477 1%, 0 vtoday, 4 wtoday, 4 wperiods, 16 req, 109624 ms, no error
INFO [2017-04-04 19:01:52] Time elapsed: 109.624s
INFO [2017-04-04 19:01:52] ---------------------------
INFO [2017-04-04 19:01:52] SCHEDULED TASKS