bpm-database-scraper

README

bpm-database-scraper

• main.old : Scapes the website bpmdatabase.com For every songs BPM
• main.go : Uses the site beatport, does not work well.

Language

• Golang for concurrent requests and high speed

Database

• PostgreSQL
  • Offers Golang support
  • I have mostly structured data

Notes

Change the thread limit

• ulimit -n 10000

Environment

• Have PostgreSQL db running in background
  • See main.go for commands I ran to initialize table
• .env file containing USER and PASSWORD

Success

• Totaled 79409 songs with this program