Hello! I’m trying to use this import tool written in Python to load my Fastly logs to Piwik. I have to add my custom format, but I need some help. Is there anyone who has worked with this tool?
import_logs.py recognized format (ELB)
_ELB_LOG_FORMAT = (
’(?P[0-9-]+T[0-9:]+).\S+\s+\S+\s+(?P\S+):\d+\s+\S+:\d+\s+\S+\s+(?P<generation_time_secs>\S+)\s+\S+\s+’
’(?P\S+)\s+\S+\s+\S+\s+(?P\S+)\s+’
’"\S+\s+\w+://(?P[\w-.]):\d+(?P/\S)\s+[^"]+"\s+"(?P<user_agent>[^"]+)"\s+\S+\s+\S+’
)
import_logs.py ELB example
2015-05-13T23:39:43.945958Z my-loadbalancer 1.2.3.4:2817 10.0.0.1:80 0.000086 0.001048 0.001337 200 200 0 57 "GET https://www.example.com:443/path/index.html HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.11 (KHTML, like Gecko) Chrome/17.0.963.56 Safari/535.11" DHE-RSA-AES128-SHA TLSv1.2
my log
<134>2017-05-12T02:59:59Z cache-atl6248 GoogleCloudStorage[353025]: “174.110.13.137 “-” “-” [12/May/2017:02:59:59 +0000] “GET /ThaiDrama17/NamSoSai/NamSoSai-8-6-May-2017-413.ts HTTP/1.1” 200 1892408 “” “Roku/DVP-7.60 (047.60E04125A; Roku 4200X; 2.6.07012016; 4A653A041001; 775553c4-8175-5884-a027-e8fd0b58035b)””