crawler

Documentation

Index

• func HealthCheck(w http.ResponseWriter, _ *http.Request)
• func Router() *mux.Router
• func Run(w http.ResponseWriter, r *http.Request)
• func Validate(URL string) error
• type LinkInfo

Functions

func HealthCheck

func HealthCheck(w http.ResponseWriter, _ *http.Request)

HealthCheck is used to verify if the service is up and running

func Router

func Router() *mux.Router

Router register necessary routes and returns an instance of a router.

func Run

func Run(w http.ResponseWriter, r *http.Request)

Run executes crawler and collect links from the pages

func Validate

func Validate(URL string) error

Validate accepts URL and check if it is valid

Types

type LinkInfo

type LinkInfo struct {
	StatusCode int
	Links      []string
}

LinkInfo is a simple struct which collect links from website