Crawling
How to Compare a Crawl Before and After an SEO Fix
A developer says the canonical fix is live, and the next crawl has fewer warnings. That is encouraging, but it does not show whether the intended URLs changed…
How to Find Orphan Pages and Fix Internal Linking Gaps
A sitemap contains a useful guide, but a crawl starting from the homepage never finds it. That gap makes the page an orphan candidate, not an automatic deletion…
How to Audit XML Sitemaps for Indexing Problems
A sitemap can be accepted by Search Console while still listing redirected, removed, or noncanonical pages. A successful submission tells you that the file was processed; it does…
How to Audit Robots.txt Without Blocking Important Pages
A production site can serve useful pages while its robots.txt still contains a staging rule that blocks crawling. The opposite failure is also possible: an edit removes a…
Crawled – Currently Not Indexed: How to Diagnose the Real Cause
Search Console says a URL was crawled but is not indexed. The page opens normally, has a canonical tag, and appears in a sitemap. None of those observations…
How to Find and Fix Broken Internal Links
A crawler reports hundreds of broken links, but the visitor sees only one bad navigation item. Another broken URL appears once in an old guide and has no…
How to Audit 301 and 302 Redirects Without Creating Redirect Chains
An old URL opens the right page in your browser, but a crawl reports three redirects before it gets there. Another URL returns 302 indefinitely. A third loops…
How to Perform a Technical SEO Audit Step by Step
A crawler can return thousands of warnings while missing the issue that stops an important page from working. A technical SEO audit needs a defined URL inventory, a…