Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type IOOptions ¶
type IOOptions struct { InputFile string `short:"i" long:"input-file" description:"The input file" required:"true" default:"input.txt"` OutputFolder string `short:"o" long:"output-folder" description:"The output folder" required:"true" default:"output"` }
IOOptions is the options for input and output
type Options ¶
type Options struct { IOOptions Domain string `short:"x" long:"domain" description:"The domain to crawl" required:"true" default:"tsinghua.edu.cn"` Timeout int `short:"t" long:"timeout" description:"Timeout of each HTTP request (in seconds)" default:"16"` NumWorkers int `short:"n" long:"num-workers" description:"Number of workers" default:"16"` NumGoroutinesPerWorker int `short:"g" long:"num-goroutines-per-worker" description:"Number of goroutines per worker" default:"16"` Debug bool `short:"d" long:"debug" description:"Enable debug mode"` Version bool `short:"v" long:"version" description:"Version"` }
Options is the options for the program
var Opts Options
Opts is the options for the program
Click to show internal directories.
Click to hide internal directories.