penthousegold

Documentation

Overview

Package penthousegold scrapes the public "latest scenes" surface of penthousegold.com (ElevatedX CMS).

The full archive is paywalled: category, model and "All" listings expose only a handful of free scenes, and there is no public full-archive pagination. This is therefore a latest-only incremental scraper — it gathers the newest scene URLs from the RSS feed (sitemap.xml) plus the homepage, deduplicates them, and worker-pool fetches each public detail page (/scenes/{slug}_vids.html) for its schema.org VideoObject microdata.

Index

• type Scraper
  • func New() *Scraper
  • func (s *Scraper) ID() string
  • func (s *Scraper) ListScenes(ctx context.Context, studioURL string, opts scraper.ListOpts) (<-chan scraper.SceneResult, error)
  • func (s *Scraper) MatchesURL(u string) bool
  • func (s *Scraper) Patterns() []string

Types

type Scraper

type Scraper struct {
	// contains filtered or unexported fields
}

func New

func New() *Scraper

func (*Scraper) ID

func (s *Scraper) ID() string

func (*Scraper) ListScenes

func (s *Scraper) ListScenes(ctx context.Context, studioURL string, opts scraper.ListOpts) (<-chan scraper.SceneResult, error)

func (*Scraper) MatchesURL

func (s *Scraper) MatchesURL(u string) bool

func (*Scraper) Patterns

func (s *Scraper) Patterns() []string