User-agent: *
Disallow: /wp-admin/
Disallow: /search
Disallow: /hosts
Disallow: /certificates
Disallow: /api/v2/
Disallow: /api/v1/
Disallow: /data/scansio
Disallow: /login
Disallow: /logout
Disallow: /account
Allow: /wp-admin/admin-ajax.php

Sitemap: https://censys.com/sitemap_index.xml