Intention recognition of pedestrians and cyclists by 2D pose estimation
Fang, Zhijie (Centre de Visió per Computador (Bellaterra, Catalunya))
López Peña, Antonio M. (Universitat Autònoma de Barcelona. Departament de Ciències de la Computació)

Date:	2020
Description:	11 pàg.
Abstract:	Anticipating the intentions of vulnerable road users (VRUs) such as pedestrians and cyclists is critical for performing safe and comfortable driving maneuvers. This is the case for human driving and, thus, should be taken into account by systems providing any level of driving assistance, from advanced driver assistant systems (ADAS) to fully autonomous vehicles (AVs). In this paper, we show how the latest advances on monocular vision-based human pose estimation, i. e. those relying on deep Convolutional Neural Networks (CNNs), enable to recognize the intentions of such VRUs. In the case of cyclists, we assume that they follow traffic rules to indicate future maneuvers with arm signals. In the case of pedestrians, no indications can be assumed. Instead, we hypothesize that the walking pattern of a pedestrian allows to determine if he/she has the intention of crossing the road in the path of the ego-vehicle, so that the ego-vehicle must maneuver accordingly (e. g. slowing down or stopping). In this paper, we show how the same methodology can be used for recognizing pedestrians and cyclists' intentions. For pedestrians, we perform experiments on the JAAD dataset. For cyclists, we did not found an analogous dataset, thus, we created our own one by acquiring and annotating videos which we share with the research community. Overall, the proposed pipeline provides new state-of-the-art results on the intention recognition of VRUs.
Grants:	Agencia Estatal de Investigación TIN2017-88709-R
Note:	Altres ajuts: Antonio thanks the financial support by ICREA under the ICREA Academia Program. We thank the Generalitat de Catalunya CERCA Program and its ACCIO agency
Rights:	Tots els drets reservats.
Language:	Anglès
Document:	Article ; recerca ; Versió acceptada per publicar
Subject:	Task analysis ; Two dimensional displays ; Pose estimation ; Roads ; Legged locomotion ; Skeleton ; Videos
Published in:	IEEE Transactions on Intelligent Transportation Systems, Vol. 21, issue 11 (Nov. 2020) , p. 4773-4783, ISSN 1558-0016

DOI: 10.1109/TITS.2019.2946642

Postprint 11 p, 2.3 MB

The record appears in these collections:
Articles > Research articles
Articles > Published articles