Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type DocumentParser

type DocumentParser struct {
}

    DocumentParser is an HTML document parser.

    func (p *DocumentParser) ExtractLinks(baseURL string, body io.Reader) ([]string, error)

      ExtractLinks extracts relative links from an net/http response with a base url. It returns links which only contain the base url to avoid crawling external links.

      type Parser

      type Parser interface {
      	ExtractLinks(string, io.Reader) ([]string, error)
      }

        Parser is a common interface to parse a document.

        Source Files