https://github.com/CVMI-Lab/PLA

(CVPR 2023) PLA: Language-Driven Open-Vocabulary 3D Scene Understanding & (CVPR2024) RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding
https://github.com/CVMI-Lab/PLA

3d-scene-understanding cvpr2023 deep-learning open-vocabulary open-world

Last synced: 3 months ago
JSON representation

(CVPR 2023) PLA: Language-Driven Open-Vocabulary 3D Scene Understanding & (CVPR2024) RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding

• Host: GitHub
• URL: https://github.com/CVMI-Lab/PLA
• Owner: CVMI-Lab
• License: apache-2.0
• Created: 2022-11-29T04:57:17.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-06-28T09:56:02.000Z (11 months ago)
• Last Synced: 2024-08-01T03:33:14.450Z (10 months ago)
• Topics: 3d-scene-understanding, cvpr2023, deep-learning, open-vocabulary, open-world
• Language: Python
• Homepage:
• Size: 17.8 MB
• Stars: 243
• Watchers: 15
• Forks: 11
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        


PLA & RegionPLC

This repo contains the official implementation of PLA (CVPR2023) and RegionPLC (CVPR 2024)




PLA: Language-Driven Open-Vocabulary 3D Scene Understanding




    Runyu Ding*,

    Jihan Yang*,

    Chuhui Xue,

    Wenqing Zhang,

    Song Bai†,

    Xiaojuan Qi†,  



CVPR 2023


[project page](https://dingry.github.io/projects/PLA) | [arXiv](https://arxiv.org/abs/2211.16312)



RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding




    Jihan Yang*,

    Runyu Ding*,

    Weipeng Deng,

    Zhe Wang,

    Xiaojuan Qi,  



CVPR 2024


project page | arXiv




##### Highlights:

- Official PLA implementation is contained in the `main` branch

- Official RegionPLC implementation is contained in the `regionplc` branch

### Release

- [2024-05-05] Releasing **RegionPLC** implementation. Please checkout `regionplc` branch to try it!

### Getting Started

#### Installation

Please refer to [INSTALL.md](docs/INSTALL.md) for the installation.

#### Dataset Preparation

Please refer to [DATASET.md](docs/DATASET.md) for dataset preparation.

#### Training & Inference

Please refer to [MODEL.md](docs/MODEL.md) for training and inference scripts and pretrained models.

### Citation

If you find this project useful in your research, please consider cite:

```bibtex

@inproceedings{ding2022language,

    title={PLA: Language-Driven Open-Vocabulary 3D Scene Understanding},

    author={Ding, Runyu and Yang, Jihan and Xue, Chuhui and Zhang, Wenqing and Bai, Song and Qi, Xiaojuan},

    booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},

    year={2023}

}

```

```bibtex

@inproceedings{yang2024regionplc,

    title={RegionPLC: Regional point-language contrastive learning for open-world 3d scene understanding},

    author={Yang, Jihan and Ding, Runyu and Deng, Weipeng and Wang, Zhe and Qi, Xiaojuan},

    booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},

    year={2024}

}

```

### Acknowledgement

Code is partly borrowed from [OpenPCDet](https://github.com/open-mmlab/OpenPCDet), [PointGroup](https://github.com/dvlab-research/PointGroup) and [SoftGroup](https://github.com/thangvubk/SoftGroup).