Whitelist ShadowTrackr IPs

Some of you whitelist the IPs of the ShadowTrackr scan nodes in firewalls. If you have a trigger happy firewall, this is a good solution. With the number of nodes now in the dozens and each node doing both IPv4 and IPV6 scans, it has become quite the job maintaining this.

So, by popular request, there is an API endpoint available now to automate this process:
API Nod IP whitelist endpoint

The new DNS scheduler is working well, and this week some additional algorithms will be added. Although every step will reduce load on the database, the full benefits will only appear when all scheduler algorithms are transferred. The nodes will then be able to update much faster.

Also, the have been some minor bug fixes that should reduce timeline noise.

New scheduler

I understand that a new scheduler is not a new feature and might be less interesting to hear about. However it is quite an important structural change in ShadowTrackr that allows scaling up further and improving performance. It should be able to speed up the discovery process too.

For such an important change the "big bang" scenario doesn't feel right, so as of yesterday just two DNS discovery algorithms have moved to the new scheduler. I will be monitoring them closely and if all goes well move a few other queues over to the new scheduler.

Spamcannibal removed from blacklist checks

Multiple users reported that they suddenly had servers appearing on the Spamcannibal blacklist. After inspection these servers seemed just fine, and they did not appear on any other blacklists. So the problem likely is with Spamcannibal and we have removed it as a source.