The critical difference between “Crawled” and “Discovered”
Google Search Console’s Page Indexing report groups unindexed URLs by where they stopped in Google’s pipeline. Two statuses sound nearly identical but point to different bottlenecks:
| Coverage Status | Did Googlebot Fetch the Page? | Primary Bottleneck | Wrong Reaction vs. Right Action |
|---|---|---|---|
| Discovered — currently not indexed | No. Google knows the URL exists (from a sitemap or link) but deferred fetching it. | Crawl prioritization & internal link discovery. Often happens when hundreds of new pages launch at once with weak internal linking. | Wrong: Editing the page’s paragraphs (Google hasn’t read them yet!). Right: Link to the page from already-indexed hubs and avoid publishing massive unlinked batches. |
| Crawled — currently not indexed | Yes. Googlebot fetched the URL (check the lastCrawlTime timestamp) and evaluated its content. |
Perceived usefulness, uniqueness compared to other pages on your site, rendered content completeness, and internal link weight. | Wrong: Clicking “Validate Fix” without changing the page. Right: Differentiate or deepen the content, merge near-duplicates, and add contextual links from strong pages. |
| Duplicate, Google chose different canonical | Yes. Google compared this URL with another URL and folded them together. | Near-identical templates, missing hreflang on regional pages, or query-string/trailing-slash duplicates. |
Wrong: Forcing re-indexing. Right: Make pages substantively distinct, or embrace the canonical consolidation. |
What to check first when a page says “Crawled — currently not indexed”
Before rewriting an entire article, run through these five checks in order—from fastest technical verification to deeper editorial review:
- Check 1 — Is it even a page that should be indexed? Look closely at the URL list in Search Console. Frequently, half the URLs in “Crawled — currently not indexed” are pagination links (
/blog/page/4/), tag archives (/tags/updates/), RSS feeds, or old asset paths. If a URL does not serve a standalone search intent, leave it alone or mark thin archive pagesnoindex. - Check 2 — Inspect what Googlebot actually rendered: In Search Console’s URL Inspection tool, check the
lastCrawlTimeand view the crawled HTML. On single-page applications or Next.js routes that fetch content client-side insideuseEffectwithout server rendering, Googlebot may have crawled a 200-byte loading skeleton. - Check 3 — Count real internal incoming links: A URL listed only in
sitemap.xmlwith zero links from your homepage, navigation, or ranking articles tells Google that even you don’t consider the page important. Add 2–4 contextual internal links with descriptive anchor text from pages that already earn impressions in Search Console. - Check 4 — Check for internal cannibalization and near-duplicates: Did you publish three separate guides targeting slight phrasing variations of the same question (for example,
/ai-seo-tools/,/best-ai-seo-software/, and/ai-seo-assistant-guide/)? When a newer or smaller domain publishes multiple overlapping pages, Google regularly indexes one and leaves the rest in “Crawled — currently not indexed.” - Check 5 — Replace generic filler with concrete evidence: Pages that summarize general definitions without original tables, code snippets, checklists, screenshots, or specific product details are prime candidates to be left out after crawling.
“My sitemap was submitted, but pages are not indexed”—what to verify
Submitting a sitemap in Search Console only hands Google a reading list; it does not override canonical signals or quality thresholds. However, dirty sitemaps actively slow down indexing. Verify these four rules on your live /sitemap.xml:
1. Trailing-slash mismatch:
Sitemap lists: https://example.com/guides/byok-seo
Server 308s to: https://example.com/guides/byok-seo/
Result: Every sitemap URL is a redirect; Google reports excluded redirects.
2. Protocol or host mismatch:
Sitemap lists: http://www.example.com/pricing/
Canonical tag: https://example.com/pricing/
Result: Conflicting signals between sitemap and HTML head.
3. Fake lastmod timestamps:
Every build sets <lastmod> to today's timestamp on all 200 pages even when
nothing changed. Google stops trusting your <lastmod> signal for crawl scheduling.
4. Non-200 or noindex URLs inside sitemap.xml:
Listing 404 pages, 302 redirects, or noindex pages inside sitemap.xml triggers
Search Console sitemap errors and wastes crawl budget.
Also verify that your /robots.txt explicitly announces your sitemap line (Sitemap: https://yourdomain.com/sitemap.xml) so Bing, Yandex, and AI search crawlers discover it automatically without manual submission.
The 2-to-1 merge rule for stubborn unindexed pages
If two pages on your site cover closely related subtopics and one is indexed while the other has been stuck in “Crawled — currently not indexed” for more than 30 days, resist the urge to keep tweaking the stuck page’s meta description. Instead:
- Move the best sections, examples, and FAQs from the unindexed page into the indexed page as a dedicated
<h2>section. - Set a permanent
301or308redirect from the unindexed URL to the stronger page (and update internal links andsitemap.xml). - One comprehensive, well-linked guide almost always outperforms three thin, fragmented pages on the same intent.
What to do after improving a non-indexed page
Once you have genuinely improved the page’s content, verified its self-referencing canonical, and added internal links from indexed pages:
- Update the page’s
updatedAt/<lastmod>date so your sitemap reflects a real content revision. - If you added internal links from a high-traffic hub page, Googlebot will naturally rediscover the updated page on its next crawl of the hub.
- For a small number of priority pages, you can use Search Console’s live URL Inspection tool to verify the live test passes and request indexing once—then give Google 1–3 weeks to process it rather than re-submitting daily.
Honest boundaries & official sources
Google never guarantees indexing of every URL: Even technically flawless pages on authoritative domains can remain unindexed if Google determines they do not add sufficient unique value for search users. Avoid “instant Google indexing” scripts that abuse the Indexing API (which Google restricts to JobPosting and BroadcastEvent markup).
Official documentation: Google Search Central — Crawling & Indexing FAQ and Page Indexing Report Documentation.
Research context & topics covered on this page Indexing · P1
Cluster & intent: indexing (Informational · P1) · Planned URL: /guides/crawled-currently-not-indexed/
Topics addressed: crawled currently not indexed, discovered currently not indexed, why is my website not showing on Google, sitemap submitted but not indexed, Google indexing troubleshooting.
Primary documentation source: Google Search Central — Crawling and Indexing FAQ.