dupedetection

Documentation

Overview

Package dupedetection provides functions to compute dupe detection fingerprints for specific image

Index

• Variables
• func Blomqvist(data1, data2 []float64) (float64, error)
• func ComputeImageDeepLearningFeatures(imagePath string) ([][]float64, error)
• func ComputeRandomizedDependence(x, y []float64) float64
• func GetMemoizer() *memoize.Memoizer
• func HoeffdingD(data1, data2 []float64) (float64, error)
• func Kendall(data1, data2 []float64) (float64, error)
• func MI(data1, data2 []float64) (float64, error)
• func MeasureImageSimilarity(candidateImageFingerprint []float64, ...) (int, error)
• func Pearson(data1, data2 []float64) (float64, error)
• func Spearman(data1, data2 []float64) (float64, error)
• type ComputeConfig
  • func NewComputeConfig() ComputeConfig
• type MemoizationImageData

Variables

var InterfaceTypeError = errors.Errorf("Calculation function returned value of unexpected type.")

InterfaceTypeError indicates unexpected variable type is returned by invoked correlation calculation func

Functions

func Blomqvist

func Blomqvist(data1, data2 []float64) (float64, error)

Blomqvist calculates Blomqvist Beta correlation between arrays of input data

func ComputeImageDeepLearningFeatures

func ComputeImageDeepLearningFeatures(imagePath string) ([][]float64, error)

ComputeImageDeepLearningFeatures computes dupe detection fingerprints for image with imagePath

func ComputeRandomizedDependence

func ComputeRandomizedDependence(x, y []float64) float64

ComputeRandomizedDependence computes RDC correlation between input arrays of data

func GetMemoizer

func GetMemoizer() *memoize.Memoizer

GetMemoizer returns memoizer used to cache correlations calculations results

func HoeffdingD

func HoeffdingD(data1, data2 []float64) (float64, error)

HoeffdingD calculates HoeffdingD correlation between arrays of input data

func Kendall

func Kendall(data1, data2 []float64) (float64, error)

Kendall calculates Kendall Tau correlation between arrays of input data

func MI

func MI(data1, data2 []float64) (float64, error)

MI calculates Mutual Information correlation between arrays of input data

func MeasureImageSimilarity

func MeasureImageSimilarity(candidateImageFingerprint []float64, fingerprintsArrayToCompareWith [][]float64, memoizationData MemoizationImageData, config ComputeConfig) (int, error)

MeasureImageSimilarity calculates similarity between candidateImageFingerprint and each value in fingerprintsArrayToCompareWith

func Pearson

func Pearson(data1, data2 []float64) (float64, error)

Pearson calculates Pearson R correlation between arrays of input data

func Spearman

func Spearman(data1, data2 []float64) (float64, error)

Spearman calculates Spearman Rho correlation between arrays of input data

Types

type ComputeConfig

type ComputeConfig struct {
	CorrelationMethodNameArray        []string
	StableOrderOfCorrelationMethods   []string
	UnstableOrderOfCorrelationMethods []string
	CorrelationMethodsOrder           string
	PearsonDupeThreshold              float64
	SpearmanDupeThreshold             float64
	KendallDupeThreshold              float64
	RandomizedDependenceDupeThreshold float64
	BlomqvistDupeThreshold            float64
	HoeffdingDupeThreshold            float64
	HoeffdingRound1DupeThreshold      float64
	HoeffdingRound2DupeThreshold      float64
	MIThreshold                       float64

	RootDir                  string
	NumberOfImagesToValidate int
	TrimByPercentile         bool
}

ComputeConfig contains configurable parameters to calculate AUPRC of image similariy measurement

func NewComputeConfig

func NewComputeConfig() ComputeConfig

NewComputeConfig retirieves new ComputeConfig with default values

type MemoizationImageData

type MemoizationImageData struct {
	SHA256HashOfFetchedImages []string
	SHA256HashOfCurrentImage  string
}

MemoizationImageData provides images data for memoization of correlation calculation methods results