internal/

Package bodystore keeps compressed response bodies next to a metrics database, not inside it.

Package compare matches two normalized block sequences.

Package config loads a JSON file of repeated measurement flags.

Package dataset builds the committed pilot and benchmark domain lists from a pinned Tranco ranking.

Package discover picks one interior content URL from a homepage.

Package extract turns HTML and markdown into one block sequence.

Package fetch retrieves a URL as each observation identity.

Package fixture serves committed site trees over httptest.

Package inject finds text that a machine reader can see and a person looking at the page cannot.

Package sitecontext probes origin robots.txt, llms.txt, and markdown alternate links.

Package sitemap reads sitemap.org urlset and sitemapindex documents.

Package types holds the frozen domain types and the interfaces each package implements.