README
¶
RAKE.Go
Forked and fixed copy of afjoseph/RAKE.Go
A Go implementation of the Rapid Automatic Keyword Extraction (RAKE) algorithm as described in: Rose, S., Engel, D., Cramer, N., & Cowley, W. (2010). Automatic Keyword Extraction from Individual Documents. In M. W. Berry & J. Kogan (Eds.), Text Mining: Theory and Applications: John Wiley & Sons.
Original Python implementation available at: https://github.com/aneesha/RAKE
The source code is released under the MIT License.
Docs and Report Card
- godoc.org: https://godoc.org/github.com/Obaied/RAKE.Go
- goreportcard.com: https://goreportcard.com/report/github.com/Obaied/RAKE.Go
Example Usage
package main
import (
"fmt"
rake "github.com/garystafford/RAKE.Go"
)
func main() {
text :=
`The growing doubt of human autonomy and reason has created a state of moral confusion ` +
`where man is left without the guidance of either revelation or reason. The result is ` +
`the acceptance of a relativistic position which proposes that value judgements and ` +
`ethical norms are exclusively matters of arbitrary preference and that no objectively ` +
`valid statement can be made in this realm... But since man cannot live without values ` +
`and norms, this relativism makes him an easy prey for irrational value systems.`
candidates := rake.RunRake(text)
for _, candidate := range candidates {
fmt.Printf("%s --> %f\n", candidate.Key, candidate.Value)
}
fmt.Printf("\nsize: %d\n", len(candidates))
}
Expected Output
objectively valid statement --> 9.000000
moral confusion --> 4.000000
exclusively matters --> 4.000000
growing doubt --> 4.000000
relativistic position --> 4.000000
easy prey --> 4.000000
human autonomy --> 4.000000
relativism makes --> 4.000000
arbitrary preference --> 4.000000
ethical norms --> 3.500000
norms --> 1.500000
realm --> 1.000000
reason --> 1.000000
proposes --> 1.000000
made --> 1.000000
guidance --> 1.000000
left --> 1.000000
judgements --> 1.000000
live --> 1.000000
values --> 1.000000
systems --> 1.000000
revelation --> 1.000000
result --> 1.000000
acceptance --> 1.000000
irrational --> 1.000000
state --> 1.000000
man --> 1.000000
created --> 1.000000
size: 28
Documentation
¶
Index ¶
- func CalculateWordScores(phraseList []string) map[string]float64
- func GenerateCandidateKeywordScores(phraseList []string, wordScore map[string]float64) map[string]float64
- func GenerateCandidateKeywords(sentenceList []string, stopWordPattern *regexp.Regexp) []string
- func IsNumber(str string) bool
- func LoadStopWords() []string
- func RegexSplitSentences() *regexp.Regexp
- func RegexSplitWords() *regexp.Regexp
- func RegexStopWords() *regexp.Regexp
- func SeperateWords(text string) []string
- func SetDefaultStringFloat64(h map[string]float64, k string, v float64) (set bool, r float64)
- func SetDefaultStringInt(h map[string]int, k string, v int) (set bool, r int)
- func SplitSentences(text string) []string
- type Pair
- type PairList
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func CalculateWordScores ¶
CalculateWordScores returns a map of (string,float64) that maps to a candidate word and its score in the text
func GenerateCandidateKeywordScores ¶
func GenerateCandidateKeywordScores(phraseList []string, wordScore map[string]float64) map[string]float64
GenerateCandidateKeywordScores returns a map of (string,float64) that contains keywords and their score in the text
func GenerateCandidateKeywords ¶
GenerateCandidateKeywords returns a slice of candidate keywords from a slice of sentences and a stop-words regex
func LoadStopWords ¶
func LoadStopWords() []string
LoadStopWords is a Utility function to split the long string of stop words a slice of stop words
func RegexSplitSentences ¶
RegexSplitSentences returns a regexp object that detects punctuation marks
func RegexSplitWords ¶
RegexSplitWords returns a regexp object that split words
func RegexStopWords ¶
RegexStopWords builds "stop-words" regex based on a slice of "stop-words"
func SeperateWords ¶
SeperateWords returns a slice of all words that have a length greater than a specified number of characters.
func SetDefaultStringFloat64 ¶
SetDefaultStringFloat64 is a util function that serves as a Go replacement for Python's `setDefault`: https://docs.python.org/2/library/stdtypes.html#dict.setdefault Basically, if key is in the dictionary, return its value. If not, insert key with a value of default and return default. default defaults to None.
func SetDefaultStringInt ¶
SetDefaultStringInt is a util function that serves as a Go replacement for Python's `setDefault`: https://docs.python.org/2/library/stdtypes.html#dict.setdefault Basically, if key is in the dictionary, return its value. If not, insert key with a value of default and return default. default defaults to None.
func SplitSentences ¶
SplitSentences returns a slice of sentences.
Source Files