parser

Documentation

Index

• type DocumentParser
  • func (p *DocumentParser) ExtractLinks(baseURL string, body io.Reader) ([]string, error)
• type Parser

Types

type DocumentParser

type DocumentParser struct {
}

DocumentParser is an HTML document parser.

func (*DocumentParser) ExtractLinks

func (p *DocumentParser) ExtractLinks(baseURL string, body io.Reader) ([]string, error)

ExtractLinks extracts relative links from an net/http response with a base url. It returns links which only contain the base url to avoid crawling external links.

type Parser

type Parser interface {
	ExtractLinks(string, io.Reader) ([]string, error)
}

Parser is a common interface to parse a document.