Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func GetDefaultTaskConfig ¶ added in v0.9.0
func GetDefaultTaskConfig() TaskConfig
GetDefaultTaskConfig return a default TaskConfig
func InitJoints ¶
func InitJoints()
InitJoints register crawler joint types in order to create pipeline with these joints on the fly
Types ¶
type CheckerModule ¶
type CheckerModule struct {
// contains filtered or unexported fields
}
func (CheckerModule) Name ¶
func (module CheckerModule) Name() string
func (CheckerModule) Start ¶
func (module CheckerModule) Start(cfg *Config)
func (CheckerModule) Stop ¶
func (module CheckerModule) Stop() error
type CrawlerModule ¶
type CrawlerModule struct {
// contains filtered or unexported fields
}
func (CrawlerModule) Name ¶
func (module CrawlerModule) Name() string
func (CrawlerModule) Start ¶
func (module CrawlerModule) Start(cfg *Config)
func (CrawlerModule) Stop ¶
func (module CrawlerModule) Stop() error
Source Files
Directories
Click to show internal directories.
Click to hide internal directories.