Import of large log fails


#1

I get 500 errors during the import and I see the following lines in the PHP error log. has anyone seen this before?

This is during a scripted load of this log. I’ve run the same import manually and it loads.

It’s Redhat 6 box. Apache 2.4. PHP 5.6 Python 2.6.6

The log file being loaded here has 156819 lines. I have run a test load manually with 300,000+ lines.

Thank you,
Kyle

[12-Nov-2015 06:57:49 UTC] Error in Piwik (tracker): Error query: SQLSTATE[22003]: Numeric value out of range: 1264 Out of range value for column ‘visit_total_actions’ at row 1 In query: UPDATE piwik_log_visit SET idvisitor = ?, visit_total_time = ?, visit_last_action_time = ?, visit_exit_idaction_url = ?, visit_total_actions = visit_total_actions + 1 , custom_var_k1 = ?, custom_var_v1 = ? WHERE idsite = ? AND idvisit = ? Parameters: array ( 0 => ‘40^Zv<93>’, 1 => 22842, 2 => ‘2015-11-12 03:42:09’, 3 => 488728, 4 => ‘sessionid’, 5 => ‘62eba080.524389da9f587’, 6 => 13, 7 => 104281, )
[12-Nov-2015 06:58:22 UTC] Error in Piwik (tracker): Error query: SQLSTATE[22003]: Numeric value out of range: 1264 Out of range value for column ‘visit_total_actions’ at row 1 In query: UPDATE piwik_log_visit SET idvisitor = ?, visit_total_time = ?, visit_last_action_time = ?, visit_exit_idaction_url = ?, visit_total_actions = visit_total_actions + 1 , custom_var_k1 = ?, custom_var_v1 = ? WHERE idsite = ? AND idvisit = ? Parameters: array ( 0 => ‘40^Zv<93>’, 1 => 22842, 2 => ‘2015-11-12 03:42:09’, 3 => 488728, 4 => ‘sessionid’, 5 => ‘62eba080.524389da9f587’, 6 => 13, 7 => 104281, )
[12-Nov-2015 06:58:56 UTC] Error in Piwik (tracker): Error query: SQLSTATE[22003]: Numeric value out of range: 1264 Out of range value for column ‘visit_total_actions’ at row 1 In query: UPDATE piwik_log_visit SET idvisitor = ?, visit_total_time = ?, visit_last_action_time = ?, visit_exit_idaction_url = ?, visit_total_actions = visit_total_actions + 1 , custom_var_k1 = ?, custom_var_v1 = ? WHERE idsite = ? AND idvisit = ? Parameters: array ( 0 => ‘40^Zv<93>’, 1 => 22842, 2 => ‘2015-11-12 03:42:09’, 3 => 488728, 4 => ‘sessionid’, 5 => ‘62eba080.524389da9f587’, 6 => 13, 7 => 104281, )
[12-Nov-2015 06:59:29 UTC] Error in Piwik (tracker): Error query: SQLSTATE[22003]: Numeric value out of range: 1264 Out of range value for column ‘visit_total_actions’ at row 1 In query: UPDATE piwik_log_visit SET idvisitor = ?, visit_total_time = ?, visit_last_action_time = ?, visit_exit_idaction_url = ?, visit_total_actions = visit_total_actions + 1 , custom_var_k1 = ?, custom_var_v1 = ? WHERE idsite = ? AND idvisit = ? Parameters: array ( 0 => ‘40^Zv<93>’, 1 => 22842, 2 => ‘2015-11-12 03:42:09’, 3 => 488728, 4 => ‘sessionid’, 5 => ‘62eba080.524389da9f587’, 6 => 13, 7 => 104281, )
[12-Nov-2015 07:00:03 UTC] Error in Piwik (tracker): Error query: SQLSTATE[22003]: Numeric value out of range: 1264 Out of range value for column ‘visit_total_actions’ at row 1 In query: UPDATE piwik_log_visit SET idvisitor = ?, visit_total_time = ?, visit_last_action_time = ?, visit_exit_idaction_url = ?, visit_total_actions = visit_total_actions + 1 , custom_var_k1 = ?, custom_var_v1 = ? WHERE idsite = ? AND idvisit = ? Parameters: array ( 0 => ‘40^Zv<93>’, 1 => 22842, 2 => ‘2015-11-12 03:42:09’, 3 => 488728, 4 => ‘sessionid’, 5 => ‘62eba080.524389da9f587’, 6 => 13, 7 => 104281, )
[12-Nov-2015 07:00:37 UTC] Error in Piwik (tracker): Error query: SQLSTATE[22003]: Numeric value out of range: 1264 Out of range value for column ‘visit_total_actions’ at row 1 In query: UPDATE piwik_log_visit SET idvisitor = ?, visit_total_time = ?, visit_last_action_time = ?, visit_exit_idaction_url = ?, visit_total_actions = visit_total_actions + 1 , custom_var_k1 = ?, custom_var_v1 = ? WHERE idsite = ? AND idvisit = ? Parameters: array ( 0 => ‘40^Zv<93>’, 1 => 22842, 2 => ‘2015-11-12 03:42:09’, 3 => 488728, 4 => ‘sessionid’, 5 => ‘62eba080.524389da9f587’, 6 => 13, 7 => 104281, )
[12-Nov-2015 07:01:10 UTC] Error in Piwik (tracker): Error query: SQLSTATE[22003]: Numeric value out of range: 1264 Out of range value for column ‘visit_total_actions’ at row 1 In query: UPDATE piwik_log_visit SET idvisitor = ?, visit_total_time = ?, visit_last_action_time = ?, visit_exit_idaction_url = ?, visit_total_actions = visit_total_actions + 1 , custom_var_k1 = ?, custom_var_v1 = ? WHERE idsite = ? AND idvisit = ? Parameters: array ( 0 => ‘40^Zv<93>’, 1 => 22842, 2 => ‘2015-11-12 03:42:09’, 3 => 488728, 4 => ‘sessionid’, 5 => ‘62eba080.524389da9f587’, 6 => 13, 7 => 104281, )


(Stefan Giehl) #2

Seems that one of the imported visitors has too many actions. The database definition for that fields is SMALLINT(5) UNSIGNED. So there seem to be more than 65535 actions.


(Matthieu Aubry) #3

Hi @disquek

please do not double post… Errors when importing large log files