From Dev.to
How to check if robots.txt is blocking Google (and fix it without breaking anything)
robots.txt is a plain text file with a lot of power. One line in it can stop Google from crawling your entire site, and because every page still opens normally in a browser, nobody notices until traff...