PointCloud-At: Point Cloud Convolutional Neural Networks with Attention for 3D Data Processing

Date

2024-10-05

Advisors

Journal Title

Journal ISSN

ISSN

Volume Title

Publisher

MDPI

Type

Article

Peer reviewed

Yes

Abstract

The rapid growth in technologies for 3D sensors has made point cloud data increasingly available in different applications such as autonomous driving, robotics, and virtual and augmented reali-ty. This raises a growing need for deep learning methods to process the data. Point clouds are dif-ficult to be used directly as inputs in several deep learning techniques. The difficulty is raised by the unstructured and unordered nature of the point cloud data. So, machine learning models built for images or videos cannot be used directly on point cloud data. Although the research in the field of point clouds has gained high attention and different methods have been developed over the decade, very few research works directly with point cloud data, and most of them con-vert the point cloud data into 2D images or voxels by performing some pre-processing that caus-es information loss. Methods that directly work on point clouds are in the early stage and this af-fects the performance and accuracy of the models. Advanced techniques in classical convolutional neural networks, such as the attention mechanism, need to be transferred to the methods directly working with point clouds. In this research, an attention mechanism is proposed to be added to deep convolutional neural networks that process point clouds directly. The attention module was proposed based on specific pooling operations which are designed to be applied directly to point clouds to extract vital information from the point clouds. Segmentation of the ShapeNet dataset was performed to evaluate the method. The mean intersection over union (mIoU) score of the proposed framework was increased after applying the attention method compared to a base state-of-the-art framework that does not have the attention mechanism.

Description

open access article

Keywords

Citation

Umar, S. and Taherkhani, A. (2024) PointCloud-At: Point Cloud Convolutional Neural Networks with Attention for 3D Data Processing. Sensors, 24 (19), 6446.

Rights

Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/

Research Institute

Institute of Digital Research, Communication and Responsible Innovation