duptool

README

duptool

简单的golang去重工具，开销少

Documentation

Index

• type DeDuplicate
  • func NewDeDup(timeset int64, max int) *DeDuplicate
  • func (dedup *DeDuplicate) DukChk(val string) bool
• type DupNode

Types

type DeDuplicate

type DeDuplicate struct {
	// contains filtered or unexported fields
}

func NewDeDup

func NewDeDup(timeset int64, max int) *DeDuplicate

创建一个新的去重对象，设置超时时间为timeset,最大容量为max,max<1则不限制容量

func (*DeDuplicate) DukChk

func (dedup *DeDuplicate) DukChk(val string) bool

返回true为重复，否则未重复，且放入缓存比较队列

type DupNode

type DupNode struct {
	// contains filtered or unexported fields
}