Skip to main navigation Skip to search Skip to main content

Enhancing the Utilization of Color Information in Point Cloud Semantic Segmentation

  • Xinyu Guo
  • , Zhi Gao*
  • , Zhiyu Zhou
  • , Jingshi Wang
  • , Luliang Tang
  • , Min Cao
  • *Corresponding author for this work
  • School of Aeronautics and Astronautics
  • Jiangsu Automation Research Institute
  • Wuhan Guanggu Zoyon Science and Technology Company Ltd.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Point cloud semantic segmentation is crucial in various applications such as autonomous driving, robotics, and virtual reality, aiming to assign labels to each point in a cloud to reflect spatial relationships and boundaries. While previous methods primarily focus on geometric features, they often overlook the auxiliary role of color information, especially in scenes where geometric structures are less distinct. In this paper, we propose the Color Point Cloud Enhancement (CPCE) method to effectively leverage color information for improved 3D scene understanding. CPCE introduces a color information enhancement module with multi-scale consistency, enriching point features throughout the encoder stages. Additionally, we develop a novel contrastive learning module that uses relative color coordinates for point cloud serialization, allowing for the capture of positive and negative samples from distant points with similar color textures. Furthermore, we design a contrastive learning module tailored for scenes with weak geometric structures, enhancing feature representation through color-augmented contrast. Our method achieved a 78.1% mIoU on the ScanNet dataset, outperforming existing models trained on a single dataset. These results highlight the effectiveness of CPCE in scenarios where traditional methods struggle, particularly in enhancing segmentation accuracy by utilizing color as a critical feature.
Original languageEnglish
Title of host publication2025 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA)
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages13478-13485
Number of pages8
ISBN (Electronic)979-8-3315-4139-2
ISBN (Print)078034300X, 0780365763, 0818627204, 0818634529, 9780780389144, 9780818634529, 9781479969234, 9781538660263, 9781728173955, 9798331541392, 979-8-3315-4140-8
DOIs
StatePublished - 19 May 2025

Publication series

NameEnhancing the Utilization of Color Information in Point Cloud Semantic Segmentation
ISSN (Print)1050-4729

Funding

This work has been supported in part by Guangxi Science and Technology Major Program(AA24263005)

Indexed by

  • EI
  • Scopus
  • CPCI-S

Fingerprint

Dive into the research topics of 'Enhancing the Utilization of Color Information in Point Cloud Semantic Segmentation'. Together they form a unique fingerprint.

Cite this