What is Indexing?

Indexing is the step after crawling where a search engine processes a fetched page, decides it is worth storing, and adds it to the index it draws results from. A page must be indexed before it can rank or be retrieved.

How it works

After a page is crawled and rendered, the engine extracts its content, evaluates quality and duplication, and either stores it in the index or discards it. Being crawled is no guarantee of being indexed; engines decline low-value, duplicate, or thin pages routinely.

Search Console reports the outcome per URL, with states like Indexed, Crawled - currently not indexed, and Discovered - currently not indexed that tell you where in the pipeline a page stalled.

Indexing vs crawling

Crawling is fetching the page; indexing is deciding to keep and organize it. They are sequential and separable. A page can be crawled and not indexed (quality or duplication), and in rare cases referenced without being crawled. Confusing the two leads people to fix the wrong problem.

Why it matters for B2B

Retrieval-based AI answers draw from indexes and live retrieval, so the indexing question maps directly onto citability. If a page is stuck in Crawled - currently not indexed, Google has seen it and chosen not to store it, which is a strong signal it will not be retrieved or cited either. Indexation status is an early warning for AI invisibility.