fetcher

package
Version: v0.0.0-...-632f8f1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 3, 2019 License: MIT Imports: 8 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func NewClient

func NewClient(proxy *url.URL) (client http.Client)

NewClient

Types

type ForgedFetcher

type ForgedFetcher struct {
}

func (*ForgedFetcher) Fetch

func (f *ForgedFetcher) Fetch(weburl string) (html []byte, error error)

Fetch

func (*ForgedFetcher) GetProxy

func (f *ForgedFetcher) GetProxy() (string, error)

GetProxy

func (*ForgedFetcher) Work

func (f *ForgedFetcher) Work(request engine.Request) (engine.ParseResult, error)

Work

type SimpleFetch

type SimpleFetch struct {
	// contains filtered or unexported fields
}

func (SimpleFetch) Fetch

func (s SimpleFetch) Fetch(url string) (html []byte, error error)

Fetcher

func (SimpleFetch) GetProxy

func (s SimpleFetch) GetProxy() (string, error)

func (SimpleFetch) Work

func (s SimpleFetch) Work(request engine.Request) (engine.ParseResult, error)

Work

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL