# MarkFord.net — combined robots policy for WP + archive subapp. # # Lives at the site root because crawlers only check /robots.txt # (subdirectory robots files are ignored). The Sitemap line below # advertises the archive's dynamic sitemap; submit the same URL in # Google Search Console after deploy. User-agent: * Allow: / # Private client deliverables — not for indexing. Disallow: /markford-status-report.html # WordPress — block standard non-public paths. Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/themes/ # Archive — block internals; canonical post URLs are at /archive//. Disallow: /archive/_build/ Disallow: /archive/data/ Disallow: /archive/includes/ Disallow: /archive/uploads/ # served via posts; no need to crawl directly Disallow: /archive/search # Legacy /archive/post/ URLs 301 to canonical at runtime, so we # leave them allow-able — crawlers will follow the redirect to the new URL. Sitemap: https://markford.net/sitemap_index.xml Sitemap: https://markford.net/archive/sitemap.xml