pvl

package
v0.0.0-...-c936c7d Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 9, 2020 License: Apache-2.0 Imports: 5 Imported by: 0

README

Using the Intel OpenVINO Photography Vision Library

The Photography Vision Library (PVL) is a set of extensions to OpenCV that is installed with the Intel OpenVINO toolkit. It uses computer vision and imaging algorithms developed at Intel.

GoCV support for the PVL can be found here in the "github.com/TokenUndefined/gocv/openvino/pvl" package.

How to use

package main

import (
	"fmt"
	"image/color"

	"github.com/TokenUndefined/gocv"
	"github.com/TokenUndefined/gocv/openvino/pvl"
)

func main() {
	deviceID := 0

	// open webcam
	webcam, err := gocv.VideoCaptureDevice(int(deviceID))
	if err != nil {
		fmt.Printf("error opening video capture device: %v\n", deviceID)
		return
	}	
	defer webcam.Close()

	// open display window
	window := gocv.NewWindow("PVL")

	// prepare input image matrix
	img := gocv.NewMat()
	defer img.Close()

	// prepare grayscale image matrix
	imgGray := gocv.NewMat()
	defer imgGray.Close()
	
	// color to draw the rect for detected faces
	blue := color.RGBA(0, 0, 255, 0)

	// load PVL FaceDetector to recognize faces
	fd := pvl.NewFaceDetector()
	defer fd.Close()

	// enable tracking mode for more efficient tracking of video source
	fd.SetTrackingModeEnabled(true)

	fmt.Printf("start reading camera device: %v\n", deviceID)
	for {
		if ok := webcam.Read(&img); !ok {
			fmt.Printf("cannot read device %d\n", deviceID)
			return
		}
		if img.Empty() {
			continue
		}

		// convert image to grayscale for detection
		gocv.CvtColor(img, &imgGray, gocv.ColorBGR2GRAY);
	
		// detect faces
		faces := fd.DetectFaceRect(imgGray)
		fmt.Printf("found %d faces\n", len(faces))

		// draw a rectangle around each face on the original image
		for _, face := range faces {
			gocv.Rectangle(&img, face.Rectangle(), blue, 3)
		}

		// show the image in the window, and wait 1 millisecond
		window.IMShow(img)
		window.WaitKey(1)
	}
}

Some PVL examples are in the cmd/openvino/pvl directory of this repo, in the form of some useful commands such as the smile detector.

Documentation

Overview

Package pvl is the GoCV wrapper around the Intel OpenVINO toolkit's Photography vision Library (PVL).

For further details, please see: https://software.intel.com/en-us/openvino-toolkit

Index

Constants

View Source
const UnknownFace = -10000

UnknownFace is when the FaceRecognizer cannot identify a Face.

Variables

This section is empty.

Functions

This section is empty.

Types

type Face

type Face struct {
	// contains filtered or unexported fields
}

Face is a wrapper around cv::pvl::Face.

func NewFace

func NewFace() Face

NewFace returns a new PVL Face.

func (*Face) Close

func (f *Face) Close() error

Close Face.

func (*Face) IsLeftEyeClosed

func (f *Face) IsLeftEyeClosed() bool

IsLeftEyeClosed checks if the right sys is closed or not.

func (*Face) IsRightEyeClosed

func (f *Face) IsRightEyeClosed() bool

IsRightEyeClosed checks if the right sys is closed or not.

func (*Face) IsSmiling

func (f *Face) IsSmiling() bool

IsSmiling Face? :) You must call FaceDetector's DetectEye() and DetectSmile() with this Face first, or this function will throw an exception.

func (*Face) LeftEyePosition

func (f *Face) LeftEyePosition() image.Point

LeftEyePosition of Face.

func (*Face) MouthPosition

func (f *Face) MouthPosition() image.Point

MouthPosition of Face.

func (*Face) Ptr

func (f *Face) Ptr() C.Face

Ptr returns the Face's underlying object pointer.

func (*Face) RIPAngle

func (f *Face) RIPAngle() int

RIPAngle of Face.

func (*Face) ROPAngle

func (f *Face) ROPAngle() int

ROPAngle of Face.

func (*Face) Rectangle

func (f *Face) Rectangle() image.Rectangle

Rectangle returns the image.Rectangle for this Face.

func (*Face) RightEyePosition

func (f *Face) RightEyePosition() image.Point

RightEyePosition of Face.

type FaceDetector

type FaceDetector struct {
	// contains filtered or unexported fields
}

FaceDetector is a wrapper around the cv::pvl::FaceDetector.

func NewFaceDetector

func NewFaceDetector() FaceDetector

NewFaceDetector returns a new PVL FaceDetector.

func (*FaceDetector) Close

func (f *FaceDetector) Close() error

Close FaceDetector.

func (f *FaceDetector) DetectBlink(img gocv.Mat, face Face)

DetectBlink uses PVL FaceDetector to detect blink on a Face.

func (*FaceDetector) DetectEye

func (f *FaceDetector) DetectEye(img gocv.Mat, face Face)

DetectEye uses PVL FaceDetector to detect eyes on a Face.

func (*FaceDetector) DetectFaceRect

func (f *FaceDetector) DetectFaceRect(img gocv.Mat) []Face

DetectFaceRect tries to detect Faces from the image Mat passed in as the param. The Mat must be a grayed image that has only one channel and 8-bit depth.

func (*FaceDetector) DetectMouth

func (f *FaceDetector) DetectMouth(img gocv.Mat, face Face)

DetectMouth uses PVL FaceDetector to detect mouth on a Face.

func (*FaceDetector) DetectSmile

func (f *FaceDetector) DetectSmile(img gocv.Mat, face Face)

DetectSmile uses PVL FaceDetector to detect smile on a Face.

func (*FaceDetector) GetBlinkThreshold

func (f *FaceDetector) GetBlinkThreshold() int

GetBlinkThreshold gets the threshold value used for evaluating blink.

func (*FaceDetector) GetMaxDetectableFaces

func (f *FaceDetector) GetMaxDetectableFaces() int

GetMaxDetectableFaces Returns the maximum number of detected faces.

func (*FaceDetector) GetMinFaceSize

func (f *FaceDetector) GetMinFaceSize() int

GetMinFaceSize gets the minimum face size in pixel.

func (*FaceDetector) GetRIPAngleRange

func (f *FaceDetector) GetRIPAngleRange() int

GetRIPAngleRange returns RIP(Rotation-In-Plane) angle range for face detection.

func (*FaceDetector) GetROPAngleRange

func (f *FaceDetector) GetROPAngleRange() int

GetROPAngleRange returns ROP(Rotation-Out-Of-Plane) angle range for face detection.

func (*FaceDetector) GetSmileThreshold

func (f *FaceDetector) GetSmileThreshold() int

GetSmileThreshold gets the threshold value used for evaluating smiles.

func (*FaceDetector) IsTrackingModeEnabled

func (f *FaceDetector) IsTrackingModeEnabled() bool

IsTrackingModeEnabled checks if the PVL FaceDetector tracking mode is enabled.

func (*FaceDetector) SetBlinkThreshold

func (f *FaceDetector) SetBlinkThreshold(thresh int)

SetBlinkThreshold sets the threshold value used for evaluating blink. When the blink score is equal or greater than this threshold, the eye is considered closing. Default value is 50.

func (*FaceDetector) SetMaxDetectableFaces

func (f *FaceDetector) SetMaxDetectableFaces(max int)

SetMaxDetectableFaces sets the maximum number of detected faces.

func (*FaceDetector) SetMinFaceSize

func (f *FaceDetector) SetMinFaceSize(min int)

SetMinFaceSize sets the minimum face size in pixel.

func (*FaceDetector) SetRIPAngleRange

func (f *FaceDetector) SetRIPAngleRange(rip int)

SetRIPAngleRange sets RIP(Rotation-In-Plane) angle range for face detection. Rotated faces within this angle range can be detected when detect method is invoked. If you specify small value for the range, Detection takes lesser time since it doesn't need to find much rotated faces. Default value is 135.

func (*FaceDetector) SetROPAngleRange

func (f *FaceDetector) SetROPAngleRange(rop int)

SetROPAngleRange sets ROP(Rotation-Out-Of-Plane) angle range for face detection. Rotated faces within this angle range can be detected when detect method is invoked. If you specify small value for the range, Detection takes lesser time since it doesn't need to find much rotated faces. Default value is 90.

func (*FaceDetector) SetSmileThreshold

func (f *FaceDetector) SetSmileThreshold(thresh int)

SetSmileThreshold sets the threshold value used for evaluating smiles. When the blink score is equal or greater than this threshold, the eye is considered smiling. Default value is 48.

func (*FaceDetector) SetTrackingModeEnabled

func (f *FaceDetector) SetTrackingModeEnabled(enabled bool)

SetTrackingModeEnabled sets if the PVL FaceDetector tracking mode is enabled.

type FaceRecognizer

type FaceRecognizer struct {
	// contains filtered or unexported fields
}

FaceRecognizer is a wrapper around the cv::pvl::FaceRecognizer.

func LoadFaceRecognizer

func LoadFaceRecognizer(name string) FaceRecognizer

LoadFaceRecognizer loads data from file and returns a FaceRecognizer.

func NewFaceRecognizer

func NewFaceRecognizer() FaceRecognizer

NewFaceRecognizer returns a new PVL FaceRecognizer.

func (*FaceRecognizer) Clear

func (f *FaceRecognizer) Clear()

Clear FaceRecognizer data.

func (*FaceRecognizer) Close

func (f *FaceRecognizer) Close() error

Close FaceRecognizer.

func (*FaceRecognizer) CreateNewPersonID

func (f *FaceRecognizer) CreateNewPersonID() int

CreateNewPersonID gets the next available ID from the PVL FaceRecognizer to be added to the database.

func (*FaceRecognizer) DeregisterFace

func (f *FaceRecognizer) DeregisterFace(faceID int64)

DeregisterFace deregisters the previously registered face from the internal database.

func (*FaceRecognizer) DeregisterPerson

func (f *FaceRecognizer) DeregisterPerson(personID int)

DeregisterPerson deregisters the previously registered person from the internal database.

func (*FaceRecognizer) Empty

func (f *FaceRecognizer) Empty() bool

Empty checks if FaceRecognizer has no data.

func (*FaceRecognizer) GetNumRegisteredPersons

func (f *FaceRecognizer) GetNumRegisteredPersons() int

GetNumRegisteredPersons gets the number of people in the current database.

func (*FaceRecognizer) Recognize

func (f *FaceRecognizer) Recognize(img gocv.Mat, faces []Face) (personIDs, confidences []int)

Recognize recognizes faces with the given image and face information.

func (*FaceRecognizer) RegisterFace

func (f *FaceRecognizer) RegisterFace(img gocv.Mat, face Face, personID int, saveToFile bool) int64

RegisterFace registers face information into the internal database.

func (*FaceRecognizer) Save

func (f *FaceRecognizer) Save(name string)

Save FaceRecognizer data to file.

func (*FaceRecognizer) SetTrackingModeEnabled

func (f *FaceRecognizer) SetTrackingModeEnabled(enabled bool)

SetTrackingModeEnabled sets if the PVL FaceRecognizer tracking mode is enabled.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL