pitchfork-dl

README

pitchfork-dl

Download all Pitchfork album reviews in JSON format. See how these data can be analysed in microamp/pitchfork-analysis (work in progress).

Demo

Dependencies

go get -u github.com/PuerkitoBio/goquery

Usage

go build pitchfork-dl.go
pitchfork-dl -h

Usage of pitchfork-dl:
  -first int
    	First page (default 1)
  -last int
    	Last page
  -output string
    	Output directory (default "reviews")
  -proxy string
    	Proxy server (default "socks5://127.0.0.1:9150")

Quickstart

Reviews in first 10 pages

pitchfork-dl -first 1 -last 10

Reviews from 50th page to 100th page

pitchfork-dl -first 50 -last 100

All reviews (as of November 2016)

pitchfork-dl -first 1 -last 1521

License

The BSD 3-Clause License