Check Robots.txt for Google Crawling Check if robots.txt is Preventing Google from Crawling a Website Enter the URL: Check Crawlability