fetch

Imports

• github.com/temoto/robotstxt
• golang.org/x/sync/semaphore

Imports in module “github.com/Sriram-PR/doc-scraper/v2”

• github.com/Sriram-PR/doc-scraper/v2/pkg/config
• github.com/Sriram-PR/doc-scraper/v2/pkg/utils

Standard library imports

• context
• errors
• fmt
• io
• math
• math/rand
• net
• net/http
• net/url
• sync
• time
• net/netip
• log/slog