01 / DECODING GOOGLE’S VERDICTS

The critical difference between “Crawled” and “Discovered”

Google Search Console’s Page Indexing report groups unindexed URLs by where they stopped in Google’s pipeline. Two statuses sound nearly identical but point to different bottlenecks:

Coverage Status Did Googlebot Fetch the Page? Primary Bottleneck Wrong Reaction vs. Right Action
Discovered — currently not indexed No. Google knows the URL exists (from a sitemap or link) but deferred fetching it. Crawl prioritization & internal link discovery. Often happens when hundreds of new pages launch at once with weak internal linking. Wrong: Editing the page’s paragraphs (Google hasn’t read them yet!).
Right: Link to the page from already-indexed hubs and avoid publishing massive unlinked batches.
Crawled — currently not indexed Yes. Googlebot fetched the URL (check the lastCrawlTime timestamp) and evaluated its content. Perceived usefulness, uniqueness compared to other pages on your site, rendered content completeness, and internal link weight. Wrong: Clicking “Validate Fix” without changing the page.
Right: Differentiate or deepen the content, merge near-duplicates, and add contextual links from strong pages.
Duplicate, Google chose different canonical Yes. Google compared this URL with another URL and folded them together. Near-identical templates, missing hreflang on regional pages, or query-string/trailing-slash duplicates. Wrong: Forcing re-indexing.
Right: Make pages substantively distinct, or embrace the canonical consolidation.
02 / FIVE-STEP TRIAGE

What to check first when a page says “Crawled — currently not indexed”

Before rewriting an entire article, run through these five checks in order—from fastest technical verification to deeper editorial review:

  1. Check 1 — Is it even a page that should be indexed? Look closely at the URL list in Search Console. Frequently, half the URLs in “Crawled — currently not indexed” are pagination links (/blog/page/4/), tag archives (/tags/updates/), RSS feeds, or old asset paths. If a URL does not serve a standalone search intent, leave it alone or mark thin archive pages noindex.
  2. Check 2 — Inspect what Googlebot actually rendered: In Search Console’s URL Inspection tool, check the lastCrawlTime and view the crawled HTML. On single-page applications or Next.js routes that fetch content client-side inside useEffect without server rendering, Googlebot may have crawled a 200-byte loading skeleton.
  3. Check 3 — Count real internal incoming links: A URL listed only in sitemap.xml with zero links from your homepage, navigation, or ranking articles tells Google that even you don’t consider the page important. Add 2–4 contextual internal links with descriptive anchor text from pages that already earn impressions in Search Console.
  4. Check 4 — Check for internal cannibalization and near-duplicates: Did you publish three separate guides targeting slight phrasing variations of the same question (for example, /ai-seo-tools/, /best-ai-seo-software/, and /ai-seo-assistant-guide/)? When a newer or smaller domain publishes multiple overlapping pages, Google regularly indexes one and leaves the rest in “Crawled — currently not indexed.”
  5. Check 5 — Replace generic filler with concrete evidence: Pages that summarize general definitions without original tables, code snippets, checklists, screenshots, or specific product details are prime candidates to be left out after crawling.
03 / SITEMAP TROUBLESHOOTING

“My sitemap was submitted, but pages are not indexed”—what to verify

Submitting a sitemap in Search Console only hands Google a reading list; it does not override canonical signals or quality thresholds. However, dirty sitemaps actively slow down indexing. Verify these four rules on your live /sitemap.xml:

COMMON SITEMAP vs. CANONICAL MISMATCHESWhat breaks sitemap trust
1. Trailing-slash mismatch:
   Sitemap lists:   https://example.com/guides/byok-seo
   Server 308s to:  https://example.com/guides/byok-seo/
   Result:          Every sitemap URL is a redirect; Google reports excluded redirects.

2. Protocol or host mismatch:
   Sitemap lists:   http://www.example.com/pricing/
   Canonical tag:   https://example.com/pricing/
   Result:          Conflicting signals between sitemap and HTML head.

3. Fake lastmod timestamps:
   Every build sets <lastmod> to today's timestamp on all 200 pages even when
   nothing changed. Google stops trusting your <lastmod> signal for crawl scheduling.

4. Non-200 or noindex URLs inside sitemap.xml:
   Listing 404 pages, 302 redirects, or noindex pages inside sitemap.xml triggers
   Search Console sitemap errors and wastes crawl budget.

Also verify that your /robots.txt explicitly announces your sitemap line (Sitemap: https://yourdomain.com/sitemap.xml) so Bing, Yandex, and AI search crawlers discover it automatically without manual submission.

04 / CONSOLIDATE OR IMPROVE

The 2-to-1 merge rule for stubborn unindexed pages

If two pages on your site cover closely related subtopics and one is indexed while the other has been stuck in “Crawled — currently not indexed” for more than 30 days, resist the urge to keep tweaking the stuck page’s meta description. Instead:

05 / AFTER YOU FIX THE PAGE

What to do after improving a non-indexed page

Once you have genuinely improved the page’s content, verified its self-referencing canonical, and added internal links from indexed pages:

  1. Update the page’s updatedAt / <lastmod> date so your sitemap reflects a real content revision.
  2. If you added internal links from a high-traffic hub page, Googlebot will naturally rediscover the updated page on its next crawl of the hub.
  3. For a small number of priority pages, you can use Search Console’s live URL Inspection tool to verify the live test passes and request indexing once—then give Google 1–3 weeks to process it rather than re-submitting daily.

Honest boundaries & official sources

Google never guarantees indexing of every URL: Even technically flawless pages on authoritative domains can remain unindexed if Google determines they do not add sufficient unique value for search users. Avoid “instant Google indexing” scripts that abuse the Indexing API (which Google restricts to JobPosting and BroadcastEvent markup).

Official documentation: Google Search Central — Crawling & Indexing FAQ and Page Indexing Report Documentation.

Research context & topics covered on this page Indexing · P1

Cluster & intent: indexing (Informational · P1) · Planned URL: /guides/crawled-currently-not-indexed/

Topics addressed: crawled currently not indexed, discovered currently not indexed, why is my website not showing on Google, sitemap submitted but not indexed, Google indexing troubleshooting.

Primary documentation source: Google Search Central — Crawling and Indexing FAQ.