sentence

Documentation

Index

• func AlphaStart(text string) bool
• func Capitalize(str string) string
• func DefaultSimilarity(n1, n2 []*basically.Token, filter basically.TokenFilter) float64
• func IsAdj(tag string) bool
• func IsAdv(tag string) bool
• func IsNoun(tag string) bool
• func IsVerb(tag string) bool
• func RemoveConj(s *basically.Sentence)
• func SubStr(str string, start, end int) string
• type Matcher
  • func CreateMatcher() (*Matcher, error)
  • func (m *Matcher) NVAAFilter(tok *basically.Token) bool
  • func (m *Matcher) NVFilter(tok *basically.Token) bool
  • func (m *Matcher) NVNSFilter(tok *basically.Token) bool

Functions

func AlphaStart

func AlphaStart(text string) bool

AlphaStart determines if the starting rune in the given string is a letter.

func Capitalize

func Capitalize(str string) string

Capitalize capitalizes the first letter in a string.

func DefaultSimilarity

func DefaultSimilarity(n1, n2 []*basically.Token, filter basically.TokenFilter) float64

DefaultSimilarity is the default similarity implementation used in Biased TextRank. Tokens are normalized (converted to lowercase and stemmed), before calculating similarity.

func IsAdj

func IsAdj(tag string) bool

func IsAdv

func IsAdv(tag string) bool

func IsNoun

func IsNoun(tag string) bool

func IsVerb

func IsVerb(tag string) bool

func RemoveConj

func RemoveConj(s *basically.Sentence)

RemoveConj removes the first coordinating conjunction (for, and, nor, etc.) from the sentence.

func SubStr

func SubStr(str string, start, end int) string

SubStr returns the substring of s between start and end.

Types

type Matcher

type Matcher struct {
	Stopwords map[string]struct{}
}

func CreateMatcher

func CreateMatcher() (*Matcher, error)

CreateMatcher creates a Matcher and loads stopwords into a dictionary.

func (*Matcher) NVAAFilter

func (m *Matcher) NVAAFilter(tok *basically.Token) bool

NVAAFilter is a filter that whitelists tokens with n(oun), v(erb), a(djective) and a(dverb) tokens.

func (*Matcher) NVFilter

func (m *Matcher) NVFilter(tok *basically.Token) bool

NVFilter is a filter that whitelists tokens with (n)oun and (v)erb tags.

func (*Matcher) NVNSFilter

func (m *Matcher) NVNSFilter(tok *basically.Token) bool

NVNSFilter is a filter that whitelists tokens with (n)oun and (v)erb tags, and blacklists tokens that are (s)topwords.