Ch 1 — Foundations: how Search works, and how to read this book¶
Part I — Foundations · The Technical SEO Reference
Playbook coupling: this chapter is the bridge from
seo-checklist.md's six-point mental model (lines 31–50) into the book. Nothing here is new doctrine — it is the playbook's model, expanded one level, plus the book's own reading rules.
1.1 The pipeline, one level deeper¶
Search is a pipeline (playbook mental model #1), and each stage is a Part of this book:
Crawl (Part II — Chs 2–5) — Googlebot fetches pages and resources, governed by robots.txt, server behavior, and infrastructure between it and your origin. 🟢 "Googlebot is just a user of something that resembles a centralized crawling platform" ("Inside Googlebot" blog, Mar 31, 2026 → Ch 6 §6.1). A page Google can't fetch doesn't exist; a page it fetches expensively gets fetched less.
Render (Part III — Ch 6) — essentially every 200-status HTML page goes through a headless evergreen Chromium. Rendering is where JavaScript sites live or die — by the WRS's specific behavioral contract, not by any blanket inability.
Index (Part IV — Chs 7–9) — Google decides what enters the index (indexing controls), which URL represents each piece of content (canonicalization), and learns what exists (discovery/sitemaps). Most "ranking problems" on large sites are actually indexing problems.
Design (Part V — Chs 10–15) — the site-shaped inputs to ranking and display: architecture as a link graph, international targeting, structured data, the display layer, media, performance.
Change events (Part VI — Chs 16–18) — migrations, security incidents, spam enforcement: the moments where sites lose years of equity in days, and the playbooks that prevent it.
Measurement (Part VII — Chs 19–21) — the instruments (Search Console, logs) and the master diagnosis workflow that routes symptoms back into the chapters above.
1.2 The three rulebooks (and why the distinction decides recovery)¶
The playbook's mental model #2, operationalized (the three-rulebook distinction is Google's own — technical requirements, spam policies, and quality systems are separately documented; homes below):
| Rulebook | Nature | Enforcement | Recovery | Book home |
|---|---|---|---|---|
| Technical requirements | Binary — crawlable/indexable or not | None needed; physics | Fix the mechanism | Parts II–IV |
| Spam policies | Sixteen named violations | Spam updates (algorithmic) + manual actions (human, visible in GSC) | Fix + wait, or fix + reconsideration | Ch 18 |
| Quality systems | Gradients | Core updates re-scoring | Be better; months | playbook Phase 3/7 (deliberately not this book's territory) |
⚠️ Misassigning a problem to the wrong rulebook is the master diagnostic error — "penalty" language for quality losses, content rewrites for technical regressions. Ch 21 exists to prevent it.
1.3 The evidence legend¶
This book carries the playbook's provenance discipline, extended (full contract: STYLE.md):
- 🟢 Documented by the authoritative primary source — official Google sources for Google behavior (docs, help center, blogs, and Google's own recorded channels, date-stamped); the vendor's own docs for third-party crawlers, scoped to that vendor. Every 🟢 quote was fetched live during drafting or verification, with fetch dates in Appendix C.
- 🟡 Google-backed in spirit / informal — house standards on Google principles, or informal Googler statements with person, venue, year (and secondary source where the primary is gone).
- ⚪ Industry practice / measurement — including third-party studies, which are never 🟢 no matter how good.
- 📘 Standard — RFC 9309, RFC 3986, BCP 47, sitemaps.org, WHATWG, schema.org, OGP. Where Google's implementation differs from the standard, both are stated.
- ⚠️ — trap, correction, or deprecation.
1.4 How to read this book¶
- As a reference: every chapter closes with a Symptoms & diagnosis table; Ch 21 §21.5 is the master index. Start from the symptom, not the table of contents.
- Canonical homes: each shared topic lives in exactly one chapter; everywhere else cross-references (
→ Ch N §x). If a passage seems thin, the depth is at the arrow. - With the playbook:
seo-checklist.mdremains the operational artifact — phases, checkboxes, project routing. Each chapter's opening box states what the playbook says and what the chapter adds. Run the playbook; read the book when a checkbox needs its machinery. - Currency: Google re-dated, moved, or retired dozens of pages during 2024–2026 (the crawling docs moved wholesale in Nov 2025–Feb 2026). Appendix B is the deprecation graveyard; Appendix C is the citation map with fetch dates and the URL-migration table. Anything cited elsewhere without a fetch date is suspect — including our own older material.
- Scale honestly: many mechanics in this book only bite at scale (crawl budget ≈ 10k+ fast-changing or 1M+ pages; facet explosions; index bloat). Small-site work mostly needs Parts IV–V and the playbook. The book flags "at scale" wherever the threshold matters.
1.5 What this book is not¶
Not a content-quality manual (playbook Phase 3 owns that), not a link-building program (Phase 5), not a local-SEO guide (Phase 4), and not an AI-visibility strategy beyond the technical control layer (Ch 5; Phase 6 owns strategy). Technical SEO earns eligibility and efficiency; it cannot earn relevance. 🟢 Google's own boundary sentence, which this book never argues with: "Google Search always seeks to show the most relevant content, even if the page experience is sub-par" (page experience doc, verified live 2026-08-04 → Ch 15 §15.1).