scraper

package
Version: v0.0.0-...-13330ff Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 11, 2015 License: BSD-2-Clause Imports: 12 Imported by: 2

Documentation

Index

Constants

View Source
const EDGAR_FULL_INDEX_URL_PREFIX = "http://www.sec.gov/Archives/edgar/full-index/"
View Source
const INDEX_FILE_NAME = "/xbrl.idx"
View Source
const SEC_EDGAR_BASE_URL = "http://www.sec.gov/Archives/"
View Source
const XBRL_ZIP_SUFFIX = "-xbrl.zip"

Variables

This section is empty.

Functions

This section is empty.

Types

type EdgarFullIndexScraper

type EdgarFullIndexScraper struct {
	// contains filtered or unexported fields
}

func NewEdgarFullIndexScraper

func NewEdgarFullIndexScraper(year, quarter int,
	ts *tmpStore.TempStore, persister persist.PersistCompany,
	reportPersister persist.PersistReportFiles) *EdgarFullIndexScraper

func (*EdgarFullIndexScraper) GetXbrl

func (efis *EdgarFullIndexScraper) GetXbrl(edgarFilename, bucket, fileKey string, reportFile *filings.ReportFile)

The full index provides links to txt files. We want to convert these to retrieve the corresponding zip of xbrl files and extract the main xbrl file.

func (*EdgarFullIndexScraper) ParseIndexFile

func (efis *EdgarFullIndexScraper) ParseIndexFile(fileReader io.ReadCloser)

Parses a ReadCloser that contains a Full Index file. The caller is responsible for closing the ReadCloser.

func (*EdgarFullIndexScraper) ScrapeEdgarQuarterlyIndex

func (efis *EdgarFullIndexScraper) ScrapeEdgarQuarterlyIndex()

Source Files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL