3rd/

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

Links

Open Source Insights

Directories ¶

Path	Synopsis
go_spider
core/common/com_interfaces Package com_interfaces contains some common interface of GO_SPIDER project.	Package com_interfaces contains some common interface of GO_SPIDER project.
core/common/config Package config provides for parse config file.	Package config provides for parse config file.
core/common/etc_config Package etc_config implements config initialization of one spider.	Package etc_config implements config initialization of one spider.
core/common/mlog Package mlog implements log operations.	Package mlog implements log operations.
core/common/page Package page contains result catched by Downloader.	Package page contains result catched by Downloader.
core/common/page_items Package page_items contains parsed result by PageProcesser.	Package page_items contains parsed result by PageProcesser.
core/common/request Package request implements request entity contains url and other relevant informaion.	Package request implements request entity contains url and other relevant informaion.
core/common/resource_manage Package resource_manage implements a resource management.	Package resource_manage implements a resource management.
core/common/util Package util contains some common functions of GO_SPIDER project.	Package util contains some common functions of GO_SPIDER project.
core/downloader Package downloader is the main module of GO_SPIDER for download page.	Package downloader is the main module of GO_SPIDER for download page.
core/page_processer
core/pipeline Package pipeline is the persistent and offline process part of crawler.	Package pipeline is the persistent and offline process part of crawler.
core/scheduler The package is useless	The package is useless
core/spider craw master module	craw master module
example/baidu_baike_page_processor
example/github_repo_page_processor
example/login_profile_page_processor
example/redis_scheduler
example/sina_stock_json_processor The example gets stock newses from site sina.com (http://live.sina.com.cn/zt/f/v/finance/globalnews1).	The example gets stock newses from site sina.com (http://live.sina.com.cn/zt/f/v/finance/globalnews1).
example/sohu_gossip_page_json_processor
example/weixin_sogou_cookie_processor
extension/scheduler

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL