extractor

module
v0.1.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 10, 2026 License: AGPL-3.0

Directories

Path Synopsis
cmd
brandx command
Command brandx is the Tier 1 brand extractor prototype CLI, per BRAND_API_SPEC_V1_2026-08.md Section 8:
Command brandx is the Tier 1 brand extractor prototype CLI, per BRAND_API_SPEC_V1_2026-08.md Section 8:
Package envelope wires normalize, signals, and rank together into the full BRAND_API_SPEC_V1_2026-08.md Section 2 response envelope.
Package envelope wires normalize, signals, and rank together into the full BRAND_API_SPEC_V1_2026-08.md Section 2 response envelope.
Package fetchsec provides an SSRF-hardened, budget-limited HTTP fetch client for the brandx Tier 1 extractor, plus content-type sniffing and SVG sanitization.
Package fetchsec provides an SSRF-hardened, budget-limited HTTP fetch client for the brandx Tier 1 extractor, plus content-type sniffing and SVG sanitization.
internal
freemail
Package freemail classifies an email domain as a free-mail (personal) or disposable provider, per BRAND_API_SPEC_V1_2026-08.md Section 1: "free-mail domains return typed status personal_email, disposable domains disposable_email".
Package freemail classifies an email domain as a free-mail (personal) or disposable provider, per BRAND_API_SPEC_V1_2026-08.md Section 1: "free-mail domains return typed status personal_email, disposable domains disposable_email".
Package model defines the response envelope shapes from BRAND_API_SPEC_V1_2026-08.md Section 2, emitted exactly (field names, nesting, enums) by the envelope package.
Package model defines the response envelope shapes from BRAND_API_SPEC_V1_2026-08.md Section 2, emitted exactly (field names, nesting, enums) by the envelope package.
Package normalize implements domain normalization per BRAND_API_SPEC_V1_2026-08.md Section 4: lowercase, scheme/port/path stripping, IDN<->punycode canonicalization, www stripping, bounded SSRF-checked redirect resolution to a terminal origin, and PSL-based registrable domain extraction with parked-domain detection.
Package normalize implements domain normalization per BRAND_API_SPEC_V1_2026-08.md Section 4: lowercase, scheme/port/path stripping, IDN<->punycode canonicalization, www stripping, bounded SSRF-checked redirect resolution to a terminal origin, and PSL-based registrable domain extraction with parked-domain detection.
Package rank implements the spec Section 5 post-processing steps: candidate ranking (SVG > large raster, signal rank, dimension sanity), color-aware perceptual dedupe, logo kind/theme classification, and color extraction (declared-over-derived, median-cut quantization for the derived palette).
Package rank implements the spec Section 5 post-processing steps: candidate ranking (SVG > large raster, signal rank, dimension sanity), color-aware perceptual dedupe, logo kind/theme classification, and color extraction (declared-over-derived, median-cut quantization for the derived palette).
Tuning round 2: this file replaces round 1's sequential fetchPool with a bounded-concurrency version, plus the manifest.json fetch+parse (previously a blocking predecessor to the icon pool - cost data showed bimi(~120ms)+manifest(~245ms) stacking serially before icon fetches even started, contributing to 44/84 no-logo domains hitting the 2500ms wall clock mid-progress).
Tuning round 2: this file replaces round 1's sequential fetchPool with a bounded-concurrency version, plus the manifest.json fetch+parse (previously a blocking predecessor to the icon pool - cost data showed bimi(~120ms)+manifest(~245ms) stacking serially before icon fetches even started, contributing to 44/84 no-logo domains hitting the 2500ms wall clock mid-progress).

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL