robots.txt, noindex, or 404: How Should You Keep Pages Out of Google?robots.txt does not hide HTML pages from Google. Use this Exclusion Method Ladder and Fit Scorecard to choose noindex, 404, or crawl controls.Oct 20, 2026•12 min