normalizer

Documentation

Index

• func EnsureScheme(rawURL string) string
• func Normalize(rawURL string) (string, error)
• func Resolve(base, ref string) (string, error)

Functions

func EnsureScheme

func EnsureScheme(rawURL string) string

EnsureScheme prepends "http://" to a URL if it has no scheme. This is intended for seed URLs entered by users (e.g. "blog.axe-net.fr").

func Normalize

func Normalize(rawURL string) (string, error)

Normalize normalizes a URL string for deduplication.

func Resolve

func Resolve(base, ref string) (string, error)

Resolve resolves a relative URL against a base URL and normalizes the result.