core

Documentation

Overview

Package core implements WEB::ARTICLE extraction heuristics.

Index

• func WithExtractor(ctx context.Context, extractor *Extractor) context.Context
• type Extractor
  • func ExtractorFromContext(ctx context.Context) *Extractor
  • func NewExtractor() *Extractor
  • func (e *Extractor) Extract(input string) types.Article
  • func (e *Extractor) ExtractSource(source Source) types.Article
• type Source

Functions

func WithExtractor

func WithExtractor(ctx context.Context, extractor *Extractor) context.Context

Types

type Extractor

type Extractor struct {
	// contains filtered or unexported fields
}

func ExtractorFromContext

func ExtractorFromContext(ctx context.Context) *Extractor

func NewExtractor

func NewExtractor() *Extractor

func (*Extractor) Extract

func (e *Extractor) Extract(input string) types.Article

Extract returns the best-effort normalized article extracted from raw HTML.

func (*Extractor) ExtractSource

func (e *Extractor) ExtractSource(source Source) types.Article

ExtractSource returns the best-effort normalized article extracted from a normalized source.

type Source

type Source struct {
	SourceURL *url.URL
	TitleHint *string
	HTML      string
}

Source is the normalized article extraction input.