I’m using import_logs.py and would like to put certain pages on blacklist to be actually ignored during import.
e.g. I have few clients everyday accesing robots.txt which have normal user agent nor they contain *bot or whatever I could filter for (neither by IP). - is there a way how to exclude some given paths/pages from log import?
thanks & cheers