Hallo,
Schon gemacht, das ist die Ausgabe vom --debug. Aber nur ein Teil, hier die komplette Ausgabe:
1 Datei mit 20.000 Zeilen
DST\herbstod1@l0604022:/srv/www/htdocs/piwik/logfiles/verbis/out> python /srv/www/htdocs/piwik/misc/log-analytics/import_logs.py --url=https://piwik-free.web.dst.baintern.de --idsite=5 --enable-http-errors --enable-http-redirects --enable-static --enable-bots --recorders=7 --debug /srv/www/htdocs/piwik/logfiles/verbis/out/verbis_20190411_geteilt.log00
2019-04-17 12:35:30,860: [DEBUG] Accepted hostnames: all
2019-04-17 12:35:30,860: [DEBUG] Matomo Tracker API URL is: https://piwik-free.web.dst.baintern.de
2019-04-17 12:35:30,860: [DEBUG] Matomo Analytics API URL is: https://piwik-free.web.dst.baintern.de
2019-04-17 12:35:30,861: [DEBUG] No token-auth specified
2019-04-17 12:35:30,861: [DEBUG] No credentials specified, reading them from “/srv/www/htdocs/piwik/config/config.ini.php”
2019-04-17 12:35:30,964: [DEBUG] Authentication token token_auth is: d54fbafbbcedbfbfe52ac8a9ddd418f4
2019-04-17 12:35:30,964: [DEBUG] Resolver: static
0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
2019-04-17 12:35:31,326: [DEBUG] Launched recorder
2019-04-17 12:35:31,326: [DEBUG] Launched recorder
2019-04-17 12:35:31,327: [DEBUG] Launched recorder
2019-04-17 12:35:31,327: [DEBUG] Launched recorder
2019-04-17 12:35:31,328: [DEBUG] Launched recorder
2019-04-17 12:35:31,328: [DEBUG] Launched recorder
2019-04-17 12:35:31,329: [DEBUG] Launched recorder
Parsing log /srv/www/htdocs/piwik/logfiles/verbis/out/verbis_20190411_geteilt.log00…
2019-04-17 12:35:31,329: [DEBUG] Detecting the log format
2019-04-17 12:35:31,330: [DEBUG] Check format shoutcast
2019-04-17 12:35:31,330: [DEBUG] Format shoutcast does not match
2019-04-17 12:35:31,330: [DEBUG] Check format iis
2019-04-17 12:35:31,330: [DEBUG] Format iis does not match
2019-04-17 12:35:31,330: [DEBUG] Check format common_complete
2019-04-17 12:35:31,330: [DEBUG] Format common_complete does not match
2019-04-17 12:35:31,330: [DEBUG] Check format amazon_cloudfront
2019-04-17 12:35:31,330: [DEBUG] Format amazon_cloudfront does not match
2019-04-17 12:35:31,330: [DEBUG] Check format verbis
2019-04-17 12:35:31,330: [DEBUG] Format verbis does not match
2019-04-17 12:35:31,330: [DEBUG] Check format w3c_extended
2019-04-17 12:35:31,331: [DEBUG] Format w3c_extended does not match
2019-04-17 12:35:31,331: [DEBUG] Check format ovh
2019-04-17 12:35:31,331: [DEBUG] Check format icecast2
2019-04-17 12:35:31,331: [DEBUG] Format icecast2 does not match
2019-04-17 12:35:31,331: [DEBUG] Check format nginx_json
2019-04-17 12:35:31,331: [DEBUG] Format nginx_json does not match
2019-04-17 12:35:31,331: [DEBUG] Check format elb
2019-04-17 12:35:31,331: [DEBUG] Format elb does not match
2019-04-17 12:35:31,331: [DEBUG] Check format s3
2019-04-17 12:35:31,332: [DEBUG] Format s3 does not match
2019-04-17 12:35:31,332: [DEBUG] Check format common
2019-04-17 12:35:31,332: [DEBUG] Format common does not match
2019-04-17 12:35:31,332: [DEBUG] Check format common_vhost
2019-04-17 12:35:31,332: [DEBUG] Format common_vhost matches
2019-04-17 12:35:31,332: [DEBUG] Format match contains 9 groups
2019-04-17 12:35:31,332: [DEBUG] Check format ncsa_extended
2019-04-17 12:35:31,332: [DEBUG] Format ncsa_extended does not match
2019-04-17 12:35:31,333: [DEBUG] Format common_vhost is the best match
7356 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
8848 lines parsed, 268 lines recorded, 133 records/sec (avg), 268 records/sec (current)
8989 lines parsed, 1715 lines recorded, 570 records/sec (avg), 1447 records/sec (current)
11203 lines parsed, 2426 lines recorded, 605 records/sec (avg), 711 records/sec (current)
11203 lines parsed, 3058 lines recorded, 610 records/sec (avg), 632 records/sec (current)
13510 lines parsed, 4029 lines recorded, 670 records/sec (avg), 971 records/sec (current)
13510 lines parsed, 4985 lines recorded, 711 records/sec (avg), 956 records/sec (current)
15632 lines parsed, 5669 lines recorded, 707 records/sec (avg), 684 records/sec (current)
15907 lines parsed, 6738 lines recorded, 747 records/sec (avg), 1069 records/sec (current)
18167 lines parsed, 7318 lines recorded, 730 records/sec (avg), 580 records/sec (current)
20000 lines parsed, 8538 lines recorded, 775 records/sec (avg), 1220 records/sec (current)
20000 lines parsed, 9003 lines recorded, 749 records/sec (avg), 465 records/sec (current)
20000 lines parsed, 9595 lines recorded, 737 records/sec (avg), 592 records/sec (current)
20000 lines parsed, 10459 lines recorded, 746 records/sec (avg), 864 records/sec (current)
20000 lines parsed, 10653 lines recorded, 709 records/sec (avg), 194 records/sec (current)
20000 lines parsed, 11468 lines recorded, 715 records/sec (avg), 815 records/sec (current)
20000 lines parsed, 11468 lines recorded, 673 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 11468 lines recorded, 636 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 11969 lines recorded, 629 records/sec (avg), 501 records/sec (current)
Logs import summary
12334 requests imported successfully
100 requests were downloads
7666 requests ignored:
0 HTTP errors
0 HTTP redirects
7666 invalid log lines
0 filtered log lines
0 requests did not match any known site
0 requests did not match any --hostname
0 requests done by bots, search engines...
0 requests to static resources (css, js, images, ico, ttf...)
0 requests to file downloads did not match any --download-extensions
Website import summary
12334 requests imported to 1 sites
1 sites already existed
0 sites were created:
0 distinct hostnames did not match any existing site:
Performance summary
Total time: 19 seconds
Requests imported per second: 620.23 requests per second
Processing your log data
In order for your logs to be processed by Matomo, you may need to run the following command:
./console core:archive --force-all-websites --force-all-periods=315576000 --force-date-last-n=1000 --url='https://piwik-free.web.dst.baintern.de'
2te Datei mit 20.000 Zeilen:
DST\herbstod1@l0604022:/srv/www/htdocs/piwik/logfiles/verbis/out> python /srv/www/htdocs/piwik/misc/log-analytics/import_logs.py --url=https://piwik-free.web.dst.baintern.de --idsite=5 --enable-http-errors --enable-http-redirects --enable-static --enable-bots --recorders=7 --debug /srv/www/htdocs/piwik/logfiles/verbis/out/verbis_20190411_geteilt.log01
2019-04-17 12:36:00,577: [DEBUG] Accepted hostnames: all
2019-04-17 12:36:00,577: [DEBUG] Matomo Tracker API URL is: https://piwik-free.web.dst.baintern.de
2019-04-17 12:36:00,578: [DEBUG] Matomo Analytics API URL is: https://piwik-free.web.dst.baintern.de
2019-04-17 12:36:00,578: [DEBUG] No token-auth specified
2019-04-17 12:36:00,578: [DEBUG] No credentials specified, reading them from “/srv/www/htdocs/piwik/config/config.ini.php”
2019-04-17 12:36:00,644: [DEBUG] Authentication token token_auth is: d54fbafbbcedbfbfe52ac8a9ddd418f4
2019-04-17 12:36:00,644: [DEBUG] Resolver: static
0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
2019-04-17 12:36:00,868: [DEBUG] Launched recorder
2019-04-17 12:36:00,869: [DEBUG] Launched recorder
2019-04-17 12:36:00,869: [DEBUG] Launched recorder
2019-04-17 12:36:00,870: [DEBUG] Launched recorder
2019-04-17 12:36:00,870: [DEBUG] Launched recorder
2019-04-17 12:36:00,871: [DEBUG] Launched recorder
2019-04-17 12:36:00,872: [DEBUG] Launched recorder
Parsing log /srv/www/htdocs/piwik/logfiles/verbis/out/verbis_20190411_geteilt.log01…
2019-04-17 12:36:00,873: [DEBUG] Detecting the log format
2019-04-17 12:36:00,873: [DEBUG] Check format shoutcast
2019-04-17 12:36:00,873: [DEBUG] Format shoutcast does not match
2019-04-17 12:36:00,873: [DEBUG] Check format iis
2019-04-17 12:36:00,873: [DEBUG] Format iis does not match
2019-04-17 12:36:00,874: [DEBUG] Check format common_complete
2019-04-17 12:36:00,874: [DEBUG] Format common_complete does not match
2019-04-17 12:36:00,874: [DEBUG] Check format amazon_cloudfront
2019-04-17 12:36:00,874: [DEBUG] Format amazon_cloudfront does not match
2019-04-17 12:36:00,874: [DEBUG] Check format verbis
2019-04-17 12:36:00,874: [DEBUG] Format verbis does not match
2019-04-17 12:36:00,874: [DEBUG] Check format w3c_extended
2019-04-17 12:36:00,874: [DEBUG] Format w3c_extended does not match
2019-04-17 12:36:00,875: [DEBUG] Check format ovh
2019-04-17 12:36:00,875: [DEBUG] Check format icecast2
2019-04-17 12:36:00,875: [DEBUG] Format icecast2 does not match
2019-04-17 12:36:00,875: [DEBUG] Check format nginx_json
2019-04-17 12:36:00,875: [DEBUG] Format nginx_json does not match
2019-04-17 12:36:00,875: [DEBUG] Check format elb
2019-04-17 12:36:00,875: [DEBUG] Format elb does not match
2019-04-17 12:36:00,876: [DEBUG] Check format s3
2019-04-17 12:36:00,876: [DEBUG] Format s3 does not match
2019-04-17 12:36:00,876: [DEBUG] Check format common
2019-04-17 12:36:00,876: [DEBUG] Format common matches
2019-04-17 12:36:00,876: [DEBUG] Format match contains 8 groups
2019-04-17 12:36:00,876: [DEBUG] Check format common_vhost
2019-04-17 12:36:00,877: [DEBUG] Format common_vhost does not match
2019-04-17 12:36:00,877: [DEBUG] Check format ncsa_extended
2019-04-17 12:36:00,877: [DEBUG] Format ncsa_extended does not match
2019-04-17 12:36:00,877: [DEBUG] Format common is the best match
14449 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 1400 lines recorded, 199 records/sec (avg), 1400 records/sec (current)
20000 lines parsed, 1400 lines recorded, 174 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 1400 lines recorded, 155 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 1400 lines recorded, 139 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 1400 lines recorded, 127 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 1400 lines recorded, 116 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 2800 lines recorded, 215 records/sec (avg), 1400 records/sec (current)
20000 lines parsed, 2800 lines recorded, 199 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 2800 lines recorded, 186 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 2800 lines recorded, 174 records/sec (avg), 0 records/sec (current)
20000 lines parsed, 2800 lines recorded, 164 records/sec (avg), 0 records/sec (current)
Logs import summary
4160 requests imported successfully
0 requests were downloads
15840 requests ignored:
0 HTTP errors
0 HTTP redirects
15840 invalid log lines
0 filtered log lines
0 requests did not match any known site
0 requests did not match any --hostname
0 requests done by bots, search engines...
0 requests to static resources (css, js, images, ico, ttf...)
0 requests to file downloads did not match any --download-extensions
Website import summary
4160 requests imported to 1 sites
1 sites already existed
0 sites were created:
0 distinct hostnames did not match any existing site:
Performance summary
Total time: 17 seconds
Requests imported per second: 237.42 requests per second
Processing your log data
In order for your logs to be processed by Matomo, you may need to run the following command:
./console core:archive --force-all-websites --force-all-periods=315576000 --force-date-last-n=1000 --url='https://piwik-free.web.dst.baintern.de'
Gruß