Infrastructure upgraded

In the last two weeks the core infrastructure has been rebuild and now runs on bigger servers. Not much to tell other than that really. Hope you all enjoy better performance and more stability :-)

Detecting trackers and unsollicited cookies

We have now started tracking the trackers. Detection for Google Analytics IDs and Meta (facebook) Pixel IDs has just moved to production and. In time others will follow. You can get a nice overview of all your trackers with these queries:

index=websites by google_analytics_id
index=websites by met_pixel_id

Also new is that we now track which websites set a cookie on the initial load. This is useful for anyone in Europe since the cookie law requires websites to ask users for permission before placing a cookie. European users should make a custom report with this query:

index=websites http_cookie_on_load=1 OR https_cookie_on_load=1 
| table url ip http_cookie_on_load  https_cookie_on_load last_seen

Another new check is if a website uses HTPP Basic Authentication. Check your websites with:

index=websites http_basic_authentication=1 
OR https_basic_authentication=1 

Some of you might have noticed that the preferred search syntax for ShadowTrackr queries has slowly been moving from Elastic Search style to Splunk style. Since this week the autocomplete in the search bar by default suggests Splunk style queries first.

More DNS records monitored

This week the new DNS module has gone live. From now on, we also track SOA, SRV, CAA and CNAME records. You can easily see the results on the domain page or find them with this query:

index=dns

We already monitored your TXT records, but now there is better support for DMARC and DKIM records. Besides the recordtype (rrtype) there now is a rrsubtype for SPF, DMARC and DKIM. So, this query will show all your SPF records:

index=dns rrsubtype=DMARC

The DNS records are all parsed and all fields are stored separately. That means you can query them. Here are some examples:

index=dns rrtype=SOA refresh=14400

index=dns rrtype=SOA | table url serial expire refresh retry

index=dns rrsubtype=DKIM k=rsa

index=dns rrsubtype=DMARC pct=100

Of course all new fields are available in the API too. For more information on which fields are available see the datamodel in the documentation.