Piwik stops counting pages but the rest is still working

Support & Bugs
1

Hi,

for a few days now, Piwik is not processing the data right? Because I can see all the data in the dashboard like the duration of the visitors, the goals etc. But the amount of pageview stays on zero pages. Where the log file I am importing is about 3 GB big ( between 7 and 10 milion hits)

Also my MySQL graph does show that there is for a couple of hours al lot of MySQL statements, so as far I can see, the import is running.

Where to start debugging this? Because all the logs say that it works, but when I look in the Web dashboard, is does not show the values.

2

Hmmm, nobody any clue where to start?

This is the output of an hourly archive action:


[2013-09-23 15:05:01] [27de1a27] ---------------------------
[2013-09-23 15:05:01] [27de1a27] INIT
[2013-09-23 15:05:01] [27de1a27] Querying Piwik API at: http://stats.theyosh.nl/index.php
[2013-09-23 15:05:01] [27de1a27] Running Piwik 1.12 as Super User: theyosh
[2013-09-23 15:05:01] [27de1a27] Notes
[2013-09-23 15:05:01] [27de1a27] - Reports for today will be processed at most every 1800 seconds. You can change this value in Piwik UI > Settings > General Settings.
[2013-09-23 15:05:01] [27de1a27] - Reports for the current week/month/year will be refreshed at most every 3600 seconds.
[2013-09-23 15:05:01] [27de1a27] - Archiving was last executed without error 57 min 31s ago
[2013-09-23 15:05:07] [27de1a27] Will process 2 websites with new visits since 57 min 37s , IDs: 1, 2
[2013-09-23 15:05:07] [27de1a27] ---------------------------
[2013-09-23 15:05:07] [27de1a27] START
[2013-09-23 15:05:07] [27de1a27] Starting Piwik reports archiving...
[2013-09-23 15:05:07] [27de1a27] Archived website id = 1, period = day, Time elapsed: 0.321s
[2013-09-23 15:05:07] [27de1a27] Archived website id = 1, period = week, 4670 visits, Time elapsed: 0.404s
[2013-09-23 15:05:16] [27de1a27] Archived website id = 1, period = month, 44816 visits, Time elapsed: 8.726s
[2013-09-23 15:05:47] [27de1a27] Archived website id = 1, period = year, 216098 visits, Time elapsed: 31.178s
[2013-09-23 15:05:47] [27de1a27] Archived website id = 1, today = 89 visits, 4 API requests, Time elapsed: 40.631s [1/2 done]
[2013-09-23 15:05:52] [27de1a27] Archived website id = 2, period = day, Time elapsed: 4.525s
[2013-09-23 15:05:52] [27de1a27] Archived website id = 2, period = week, 1642884 visits, Time elapsed: 0.486s
[2013-09-23 15:06:52] [27de1a27] Archived website id = 2, period = month, 9673475 visits, Time elapsed: 60.033s
[2013-09-23 15:07:28] [27de1a27] Archived website id = 2, period = year, 51023641 visits, Time elapsed: 35.241s
[2013-09-23 15:07:28] [27de1a27] Archived website id = 2, today = 12971 visits, 4 API requests, Time elapsed: 100.286s [2/2 done]
[2013-09-23 15:07:28] [27de1a27] Done archiving!
[2013-09-23 15:07:28] [27de1a27] ---------------------------
[2013-09-23 15:07:28] [27de1a27] SUMMARY
[2013-09-23 15:07:28] [27de1a27] Total daily visits archived: 13060
[2013-09-23 15:07:28] [27de1a27] Archived today's reports for 2 websites
[2013-09-23 15:07:28] [27de1a27] Archived week/month/year for 2 websites. 
[2013-09-23 15:07:28] [27de1a27] Skipped 8 websites: no new visit since the last script execution
[2013-09-23 15:07:28] [27de1a27] Skipped 0 websites day archiving: existing daily reports are less than 1800 seconds old
[2013-09-23 15:07:28] [27de1a27] Skipped 0 websites week/month/year archiving: existing periods reports are less than 3600 seconds old
[2013-09-23 15:07:28] [27de1a27] Total API requests: 8
[2013-09-23 15:07:28] [27de1a27] done: 2/2 100%, 13060 v, 2 wtoday, 2 wperiods, 8 req, 140918 ms, no error
[2013-09-23 15:07:28] [27de1a27] Time elapsed: 140.918s
[2013-09-23 15:07:28] [27de1a27] ---------------------------
[2013-09-23 15:07:28] [27de1a27] SCHEDULED TASKS
[2013-09-23 15:07:28] [27de1a27] Starting Scheduled tasks... 
[2013-09-23 15:07:28] [27de1a27]  No task to run
[2013-09-23 15:07:28] [27de1a27] done

Here all the lines about archiving for the day period have no counts:
Archived website id = 2, period = day, Time elapsed: 4.525s

So all other data is archived, but the daily counts are missing. How to fix this?

3

Maybe you have the same problem I had :

“delete + add again the widget in the dashboard.”

Source:
http://dev.piwik.org/trac/ticket/4154

Dali

4

Unfortunally, that is not the case. After adding the widget, the behaviour is still the same:

Attached an image of the page views. As you can see, it stops about 1,5 week ago.
Also the log archiver does not show the amount of page views in the log import for the day statistics.


[2013-09-23 15:05:07] [27de1a27] Archived website id = 1, period = day, Time elapsed: 0.321s
[2013-09-23 15:05:07] [27de1a27] Archived website id = 1, period = week, [b]4670 visits[/b], Time elapsed: 0.404s

In the above line, the week period are calculated, but the day period is not. What could this be? I have already regenerated all the archive data of the last month. But that does also not solve the issue.

It is getting urgent, because it is al ready more than a week going on, and I can’t keep that much data in the database. So it needs to be solved pretty quickly…