Directories
¶
| Path | Synopsis |
|---|---|
|
headless/browser/cookie
Package cookie implements cookie consent handling for the crawler.
|
Package cookie implements cookie consent handling for the crawler. |
|
headless/browser/stealth
from stealth go-rod
|
from stealth go-rod |
|
headless/crawler/normalizer/simhash
Package simhash implements SimHash algorithm for near-duplicate detection.
|
Package simhash implements SimHash algorithm for near-duplicate detection. |
|
headless/graph
Package graph implements a Directed Graph for storing state information during crawling of a Web Application.
|
Package graph implements a Directed Graph for storing state information during crawling of a Web Application. |
|
hybrid
Package hybrid implements the functionality for a hybrid-headless crawler.
|
Package hybrid implements the functionality for a hybrid-headless crawler. |
|
standard
Package standard implements the functionality for a non-headless crawler.
|
Package standard implements the functionality for a non-headless crawler. |
|
Package knowledgebase defines the Extractor interface implemented by per-class detectors that contribute structured facts to a response's KnowledgeBase map.
|
Package knowledgebase defines the Extractor interface implemented by per-class detectors that contribute structured facts to a response's KnowledgeBase map. |
|
extractors/endpoints
Package endpoints is a knowledgebase.Extractor that classifies a crawled request as an API endpoint (REST, GraphQL, SOAP, AJAX/XHR) by inspecting method, URL, headers, and content types.
|
Package endpoints is a knowledgebase.Extractor that classifies a crawled request as an API endpoint (REST, GraphQL, SOAP, AJAX/XHR) by inspecting method, URL, headers, and content types. |
|
extractors/secrets
Package secrets is a knowledgebase.Extractor that detects exposed credentials in crawled response bodies using Praetorian's Titus engine.
|
Package secrets is a knowledgebase.Extractor that detects exposed credentials in crawled response bodies using Praetorian's Titus engine. |
Click to show internal directories.
Click to hide internal directories.