data

Documentation

Index

• func Sources() qyaml.YAML
• type Crawl
  • func CrawlData() Crawl
  • func (c Crawl) Orcs() []string
  • func (c Crawl) Uniques() []string
• type Schema
  • func CrawlSchema() Schema

Functions

func Sources

func Sources() qyaml.YAML

Sources parses the sources.yml file into a YAML object, panicking on error.

Types

type Crawl

type Crawl struct {
	qyaml.YAML
}

Crawl is the crawl-specific configuration data.

func CrawlData

func CrawlData() Crawl

CrawlData parses the crawl-data.yml file into a Crawl YAML object, panicking on error.

func (Crawl) Orcs

func (c Crawl) Orcs() []string

Orcs gets the list of orcs defined in crawl-data.yml

func (Crawl) Uniques

func (c Crawl) Uniques() []string

Uniques gets the list of uniques defined in crawl-data.yml

type Schema

type Schema struct {
	qyaml.YAML
}

Schema is the Sequell database schema definition.

func CrawlSchema

func CrawlSchema() Schema

CrawlSchema parses the crawl-data.yml file into a Schema YAML object, panicking on error.