I use the Python log importer to import server access logs.
This imports requests from bots and spiders, which is desired as I use Matomo’s database to detect web scrappers.
However I would like to ignore bots and spiders in the statistics.
Is it possible for them to be ignored somehow? Or differentiated from other traffic?
I would prefer to do this by IP address over user agent, as some scrappers attempt to spoof Googlebot etc.
I have a list of verified search engine and good bot IPs detected by net name.