Real-Time 3D Head Pose Tracking Through 2.5D Constrained Local Models with Local Neural Fields

dc.cclicenceCC-BY-NC-NDen
dc.contributor.authorAckland, Stephenen
dc.contributor.authorChiclana, Franciscoen
dc.contributor.authorIstance, Howellen
dc.contributor.authorCoupland, Simonen
dc.date.acceptance2019-01-17en
dc.date.accessioned2019-03-13T15:03:25Z
dc.date.available2019-03-13T15:03:25Z
dc.date.issued2019-03-04
dc.descriptionThe file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.en
dc.description.abstractTracking the head in a video stream is a common thread seen within computer vision literature, supplying the research community with a large number of challenging and interesting problems. Head pose estimation from monocular cameras is often considered an extended application after the face tracking task has already been performed. This often involves passing the resultant 2D data through a simpler algorithm that best fits the data to a static 3D model to determine the 3D pose estimate. This work describes the 2.5D Constrained Local Model, combining a deformable 3D shape point model with 2D texture information to provide direct estimation of the pose parameters, avoiding the need for additional optimization strategies. It achieves this through an analytical derivation of a Jacobian matrix describing how changes in the parameters of the model create changes in the shape within the image through a full-perspective camera model. In addition, the model has very low computational complexity and can run in real-time on modern mobile devices such as tablets and laptops. The Point Distribution Model of the face is built in a unique way, so as to minimize the effect of changes in facial expressions on the estimated head pose and hence make the solution more robust. Finally, the texture information is trained via Local Neural Fields (LNFs) a deep learning approach that utilizes small discriminative patches to exploit spatial relationships between the pixels and provide strong peaks at the optimal locations.en
dc.exception.ref2021codes253aen
dc.funderN/Aen
dc.identifier.citationAckland, S., Chiclana, F., Istance, H., Coupland, S. (2019) Real-Time 3D Head Pose Tracking Through 2.5D Constrained Local Models with Local Neural Fields. International Journal of Computer Vision, 127 (6-7), pp. 579-598en
dc.identifier.doihttps://doi.org/10.1007/s11263-019-01152-w
dc.identifier.issn0920-5691
dc.identifier.urihttp://hdl.handle.net/2086/17619
dc.language.isoenen
dc.peerreviewedYesen
dc.projectidN/Aen
dc.publisherSpringeren
dc.researchgroupInstitute of Artificial Intelligence (IAI)en
dc.researchinstituteInstitute of Artificial Intelligence (IAI)en
dc.subjectHead Pose Estimationen
dc.subject2.5D CLMen
dc.subjectLNFen
dc.subjectReal-timeen
dc.titleReal-Time 3D Head Pose Tracking Through 2.5D Constrained Local Models with Local Neural Fieldsen
dc.typeArticleen

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
HeadPoseIJCVRevisedFinal14122018.pdf
Size:
8.93 MB
Format:
Adobe Portable Document Format
Description:
Author's copy of accepted paper.
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.2 KB
Format:
Item-specific license agreed upon to submission
Description: