High Traffic Sites and Custom Period Date Ranges Selection

mritzmann · February 23, 2022, 9:22am

Turned out that the table with the RAW data was too big. Follow-up feature request:

Show Warning if Deleting Old Data Does Not Work

opened 08:26AM - 23 Feb 22 UTC

Enhancement c: Privacy

I have a Matomo installation which became slower and slower over time. The cause… turned out to be that the table `matomo_log_visit` contained several years of RAW data and thus became several GB in size. This affected the reading of this table noticeably. In the settings, _Regularly delete old raw data_ is set to 30 days, and a cron job is set up. It turns out: the cron job ran out of memory every time during `Tasks.deleteLogData`. Matomo displays a notification in the backend when archiving via cronjob fails. However, when tasks fails, this is not displayed anywhere. My wish would be to proactively display failed tasks and notify the user that the tasks have not been fully completed. The `ScheduledReports` plugin does not show the error either. ## Summary - Display notification when `Tasks.deleteLogData` are not completed successfully for a long time. - This is important for performance reasons and maybe for reasons of the General Data Protection Regulation (GDPR). ## Your Environment * Matomo Version: 4.7.1 * PHP Version: 7.4.28 * Server Operating System: Debian 10