crawler

README

dmm-crawler-go

dmm crawler go

$ go get github.com/ushios/dmm-crawler-go

Development

Runnning test

Set environments.

TEST_DMM_API_ID=xxxxxxxxx
TEST_DMM_AFFILIATE_ID=xxx-xxx

Running go test command.

$ go test ./...

Documentation

Index

• Constants
• func ActressResponse(c *dmm.Client, page int64) (*api.ActressResponse, error)
• func AdultVideoItemResponse(c *dmm.Client, page int64) (*api.ProductResponse, error)
• func AllActresses(c *dmm.Client, o Option, ...) (chan api.Actress, chan struct{}, chan error)
• func AllItems(c *dmm.Client, o Option, ...) (chan api.Item, chan struct{}, chan error)
• type Option

Constants

const (
	// APILengthMax is max size of length
	APILengthMax = 100
)

Functions

func ActressResponse

func ActressResponse(c *dmm.Client, page int64) (*api.ActressResponse, error)

ActressResponse get api response.

func AdultVideoItemResponse

func AdultVideoItemResponse(c *dmm.Client, page int64) (*api.ProductResponse, error)

AdultVideoItemResponse get adult video items.

func AllActresses

func AllActresses(
	c *dmm.Client, o Option,
	fn func(*dmm.Client, int64) (*api.ActressResponse, error),
) (chan api.Actress, chan struct{}, chan error)

AllActresses _　TODO: using context.Context

func AllItems

func AllItems(
	c *dmm.Client, o Option,
	fn func(*dmm.Client, int64) (*api.ProductResponse, error),
) (chan api.Item, chan struct{}, chan error)

AllItems _　TODO: using context.Context

Types

type Option

type Option struct {
	Interval  time.Duration
	MaxRepeat int
}

Option is crawler options