Grow · 5 min read

Why your pages are not indexed, and how to actually fix it

You can write the best article on the internet, but if Google never adds it to its index, it will not rank for a single query. That is why pages are not indexed is one of the most important problems in SEO to understand: indexing is the gate that everything else depends on. The good news is that the reasons a page gets skipped are finite and mostly diagnosable in a few minutes. This guide walks through them in a sensible order, starting with the checks that catch the most cases, so you are not guessing.

Start here: ask Google directly

Before theorizing, get the answer from the source. Paste the URL into the URL Inspection tool in Google Search Console. It tells you whether the page is indexed, and if not, it usually names the reason: "Excluded by noindex tag," "Blocked by robots.txt," "Crawled, currently not indexed," "Discovered, currently not indexed," and so on. That status points you straight at the right section below instead of making you test everything.

The blocks you are doing to yourself

These are the most common causes, and the most fixable, because they are settings on your own site.

A noindex tag is telling Google to stay out

A noindex meta tag or HTTP header explicitly instructs search engines not to index the page. It is meant for thank-you pages, staging content, and duplicates, but it ends up on pages that should rank far more often than you would expect, usually left behind after a redesign or copied from a template. View the page source and search for noindex. If it is there and the page should be public, remove it. In WordPress, check your SEO plugin's visibility settings for that post or page.

Robots.txt is blocking the crawler

Your robots.txt file controls which paths crawlers may access. A Disallow rule aimed at a directory can accidentally cover pages you want indexed. Visit yourdomain.com/robots.txt and read it for any Disallow line that matches your URL's path. Remember a subtlety: robots.txt blocks crawling, not indexing, so a blocked page can still appear in results without a description. Either way, if the page matters, make sure it is crawlable.

The canonical points somewhere else

If your page's canonical tag names a different URL as the "real" version, Google will index that other URL instead of this one. This is common with duplicate or near-duplicate pages. Check that the canonical on the page points to itself unless you genuinely want it consolidated elsewhere.

The quality and "not yet" reasons

Sometimes nothing is technically blocked. Google has seen the page and chosen to wait or pass.

It is simply too new

New pages are not indexed the instant you publish. Discovery takes time. Speed it up by submitting the URL through URL Inspection and requesting indexing, making sure the page is included in your sitemap, and linking to it from pages you already have indexed. Internal links are how Google finds new content, so an orphaned page can sit undiscovered for a long time.

"Crawled, currently not indexed"

This status means Google looked at the page and decided it was not worth indexing right now. It is almost always a quality signal. Thin content, pages that closely duplicate others, or auto-generated pages that add nothing tend to land here. The fix is not a trick, it is making the page genuinely more useful: more depth, a clearer angle, something the near-identical pages elsewhere do not offer. Consolidate thin pages rather than multiplying them.

Weak internal linking and crawl priority

Every site has a limited crawl budget, and pages buried many clicks deep with few internal links get visited rarely. If an important page is hard to reach, Google treats it as low priority. Flatten your structure so key pages are a few clicks from the homepage, and link to them with descriptive anchor text from relevant, already-indexed pages.

The rarer but serious causes

Technical crawl failures

Server errors (5xx), broken links, and pages that are painfully slow to load can all stop crawling before indexing happens. Check the Page indexing report in Search Console for crawl errors and fix the ones affecting real pages.

A manual penalty

If you have violated Google's guidelines through tactics like keyword stuffing or bought links, pages can be deindexed. Look under Security and Manual Actions in Search Console. If there is a notice, follow the stated steps and submit a reconsideration request once resolved. This is uncommon, so do not assume it before ruling out the everyday causes above.

Mobile usability problems

Google indexes the mobile version of your site first. If pages are broken or unusable on mobile, indexing suffers. Test with a real phone or Google's mobile checks and make sure the page is fully responsive.

Work it in order

The efficient path is: inspect the URL in Search Console to get the reason, clear any self-inflicted block (noindex, robots.txt, canonical), then judge quality and internal linking, and only then look at penalties and technical failures. Most unindexed pages are explained in the first two steps.

If a batch of important pages refuses to index and you cannot find why, a website audit will trace it to the root cause, or you can explore my SEO services if you would like the whole thing handled for you.