User-Agent: * Allow: /wp-content/uploads/ Disallow: /wp-admin/ Disallow: /wp-content/plugins/ Disallow: /readme.html Disallow: /refer/ Disallow: /wp-json/ # Ban bots that don't benefit us. # -------------------------------- User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: PetalBot User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot/1.0 User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler Disallow: / # Sitemap # ----------------- Sitemap: https://xapplets.com/post-sitemap.xml Sitemap: https://xapplets.com/page-sitemap.xml Sitemap: https://xapplets.com/docs-sitemap.xml