Scribd
Upload
171 views

faceAPI Techspecs

FaceAPI is the only comprehensive, commercially supported solution for developing products that leverage real-time face-tracking. Seeing Machines' Algorithms are highly robust, real-time, 6 degree-of-freedom (3D) monocular face tracking able to track up to + / - 90 degrees of head rotation and fast head movements Optional real-time tracking of lips and eyebrows.

Uploaded by

Dennis Yar
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
171 views

faceAPI Techspecs

FaceAPI is the only comprehensive, commercially supported solution for developing products that leverage real-time face-tracking. Seeing Machines' Algorithms are highly robust, real-time, 6 degree-of-freedom (3D) monocular face tracking able to track up to + / - 90 degrees of head rotation and fast head movements Optional real-time tracking of lips and eyebrows.

Uploaded by

Dennis Yar
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

faceAPI

Down
loa
now a d
faceA t
PI.co
m

The Real-Time Face Tracking Toolkit for Developers and OEMs

Technical Specifications

faceAPI allows you to integrate Seeing Machines world-class face-tracking technology into your product or software ap-
plication. Now available under both development and production licenses, faceAPI provides your development team with the
ability to quickly incorporate ultra-reliable face-tracking, with no image-processing or computer vision expertise necessary.

faceAPI is the only comprehensive, commercially supported solution for developing products that leverage real-time face-tracking.

Features

• Highly robust, real-time, 6 degree-of-freedom (3D) monocular face tracking


• Able to track up to +/- 90 degrees of head rotation and fast head movements
• Optional real-time tracking of lips and eyebrows
• Face-texture ”mugshot” delivery upon tracking commencement
• Two types of head-trackers, trading CPU load for tracking capability.
• Requires only 8-bit greyscale video input. Algorithms do not rely on color and are therefore able to track faces in the
dark using infra-red illumination
• Automatic tracking startup and immediate reacquisition when face is hidden then shown
• Facial feature detection and tracking – locates facial feature “landmarks” from a single image or real-time for video
sequences
• Designed for all human faces (it doesn’t matter what you look like). Robust to occlusion, fast movement, large head
rotations, lighting changes, dimly lit rooms, facial deformation, skin color, beards, glasses etc
• Can track with as few as 40 pixels across the face (typically 2m from a VGA camera)
• Works with any webcam or video file
• Full control over all tracking parameters for purposes of software integration
• Low-level image input interface for custom camera integration
• “Offline” tracking algorithm for high-quality tracking of faces in movie files where real-time performance is not required
• Separate low-level “face-search” algorithm for finding multiple faces in images and short image sequences. This algo-
rithm has three “depth” levels, with level 0 providing fast results to level 2 which accurately locates facial features and
estimates head-pose in 3D.

Technical Details

At the heart of faceAPI lies a number of sophisticated multi-threaded tracking “engines”. Each engine appears as a “black-
box” with a minimal set of C functions that allow the developer to tune engine behaviour and performance.
Y

faceAPI
The Real-Time Face Tracking Toolkit for Developers and OEMs
The API is provided as a closed-source library consisting of:
• C header files Pixel Coordinate
Frame
• A DLL binary Y
X
• Concise HTML documentation Y
X Z

• Several sample applications (including a full game engine demo) Face Landmarks

• A set of open-source object-oriented wrapper classes (C++ and Qt widgets) Head Coordinate
Frame

• A tool for calibrating camera lenses (enabling precision tracking) Y


smface coord

• A command-line tool for tracking faces in movie files X

• Redistributable third-party APIs required for installation


Z

faceAPI can track with a variety of video inputs: Camera Coordinate


Image

• Webcams, or any WDM compatible camera (DirectShow driver) Frame

• PointGrey Flea, Flea2 or Firefly MV cameras (recommended for high-performance applications)


• Movie files. Can read Windows avi or Apple Quicktime files.
• Low-level “shared-memory” image interface (allows for integration of custom video devices).

The tracking engine provides:


• Methods to “call back” your application whenever a new tracking measurement occurs
• A function that sets the current estimate of head-pose into a C structure (interpolates between samples)
• Head-pose measured in cartesian 3D coordinates relative to the camera, (X,Y,Z). Position is in meters and rotation is
expressed in euler angles (rads).
• Positions of key facial locations (face-landmarks) including lip and eyebrow points, expressed in “face-coordinates”
(inside the face, independent of head-pose)
• “Mugshot” face-texture is provided via a function callback that occurs when the face starts tracking. This texture is
256x256 resolution in RGB color format and is a synthetic orthographic projection of the front of the face. Face outline
(texture-mask) points are provided with the texture.
• Head-pose measurements include a confidence weighting, from 0 to 1, allowing your application to determine when
tracking quality is acceptable
• Latency of measurement is ~11ms (processing time) + exposure time. Eg, for a 30Hz camera, latency = ~44ms

Licensing
Non-Commercial, Development and Production license options now available.
Please contact us at bizdev@seeingmachines.com for more information on pricing, licensing and distribution.
Phone: + [61] 2 6103 4700
USA free call: 1-888-393-4293

Seeing Machines • US Tel: 1-888-393-4293 • www.SeeingMachines.com


Level 1 • 11 Lonsdale St • Braddon • ACT • 2601 • Australia
T: +61 2 6103 4700 • F: +61 2 6103 4701 • bizdev@seeingmachines.com

© Copyright 2008 Seeing Machines Limited. All rights reserved.

You might also like