• Stars
    star
    481
  • Rank 91,384 (Top 2 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created about 3 years ago
  • Updated 7 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

[ICLR 2022 poster] Official PyTorch implementation of "Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework"

Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework (ICLR 2022)

PWC PWC

github

open review | arXiv | Primary contact: Xu Ma

Overview of one stage in PointMLP. Given an input point cloud, PointMLP progressively extracts local features using residual point MLP blocks. In each stage, we first transform the local point using a geometric affine module, and then local points are extracted before and after aggregation, respectively. By repeating multiple stages, PointMLP progressively enlarges the receptive field and models entire point cloud geometric information.

BibTeX

@article{ma2022rethinking,
    title={Rethinking network design and local geometry in point cloud: A simple residual MLP framework},
    author={Ma, Xu and Qin, Can and You, Haoxuan and Ran, Haoxi and Fu, Yun},
    journal={arXiv preprint arXiv:2202.07123},
    year={2022}
}

Model Zoo

Questions on ModelNet40 classification results (a common issue for ModelNet40 dataset in the community)

The performance on ModelNet40 of almost all methods are not stable, see (CVMI-Lab/PAConv#9 (comment)).
If you run the same codes for several times, you will get different results (even with fixed seed).
The best way to reproduce the results is to test with a pretrained model for ModelNet40.
Also, the randomness of ModelNet40 is our motivation to experiment on ScanObjectNN, and to report the mean/std results of several runs.


The codes/models/logs for submission version (without bug fixed) can be found here commit:d2b8dbaa.

On ModelNet40, fixed pointMLP achieves a result of 91.5% mAcc and 94.1% OA without voting, logs and pretrained models can be found [here].

On ScanObjectNN, fixed pointMLP achieves a result of 84.4% mAcc and 86.1% OA without voting, logs and pretrained models can be found [here]. Fixed pointMLP-elite achieves a result of 81.7% mAcc and 84.1% OA without voting, logs and pretrained models can be found [here].

Stay tuned. More elite versions and voting results will be uploaded.

News & Updates:

  • fix the uncomplete utils in partseg by Mar/10, caused by error uplaoded folder.
  • upload test code for ModelNet40
  • project page
  • update std bug (unstable testing in previous version)
  • paper/codes release

👉👉👉NOTE: The codes/models/logs for submission version (without bug fixed) can be found here commit:d2b8dbaa.

Install

# step 1. clone this repo
git clone https://github.com/ma-xu/pointMLP-pytorch.git
cd pointMLP-pytorch

# step 2. create a conda virtual environment and activate it
conda env create
conda activate pointmlp
# Optional solution for step 2: install libs step by step
conda create -n pointmlp python=3.7 -y
conda activate pointmlp
conda install pytorch==1.10.1 torchvision==0.11.2 cudatoolkit=10.2 -c pytorch -y
# if you are using Ampere GPUs (e.g., A100 and 30X0), please install compatible Pytorch and CUDA versions, like:
# pip install torch==1.8.1+cu111 torchvision==0.9.1+cu111 torchaudio==0.8.1 -f https://download.pytorch.org/whl/torch_stable.html
pip install cycler einops h5py pyyaml==5.4.1 scikit-learn==0.24.2 scipy tqdm matplotlib==3.4.2
pip install pointnet2_ops_lib/.

Useage

Classification ModelNet40

Train: The dataset will be automatically downloaded, run following command to train.

By default, it will create a folder named "checkpoints/{modelName}-{msg}-{randomseed}", which includes args.txt, best_checkpoint.pth, last_checkpoint.pth, log.txt, out.txt.

cd classification_ModelNet40
# train pointMLP
python main.py --model pointMLP
# train pointMLP-elite
python main.py --model pointMLPElite
# please add other paramemters as you wish.

To conduct voting testing, run

# please modify the msg accrodingly
python voting.py --model pointMLP --msg demo

Classification ScanObjectNN

The dataset will be automatically downloaded

  • Train pointMLP/pointMLPElite
cd classification_ScanObjectNN
# train pointMLP
python main.py --model pointMLP
# train pointMLP-elite
python main.py --model pointMLPElite
# please add other paramemters as you wish.

By default, it will create a fold named "checkpoints/{modelName}-{msg}-{randomseed}", which includes args.txt, best_checkpoint.pth, last_checkpoint.pth, log.txt, out.txt.

Part segmentation

  • Make data folder and download the dataset
cd part_segmentation
mkdir data
cd data
wget https://shapenet.cs.stanford.edu/media/shapenetcore_partanno_segmentation_benchmark_v0_normal.zip --no-check-certificate
unzip shapenetcore_partanno_segmentation_benchmark_v0_normal.zip
  • Train pointMLP
# train pointMLP
python main.py --model pointMLP
# please add other paramemters as you wish.

Acknowledgment

Our implementation is mainly based on the following codebases. We gratefully thank the authors for their wonderful works.

CurveNet, PAConv, GDANet, Pointnet2_PyTorch

LICENSE

PointMLP is under the Apache-2.0 license.

More Repositories

1

Context-Cluster

[ICLR 2023 Oral] Image as Set of Points
Python
537
star
2

Rewrite-the-Stars

[CVPR 2024] Rewrite the Stars
Python
242
star
3

Open-Set-Recognition

Open Set Recognition
Python
135
star
4

DCANet

[arXiv 2020] Deep Connected Attention Networks
Python
121
star
5

CollaborativeFiltering

matlab, collaborative filtering, MovieLens dataset,The movie recommendation system
MATLAB
107
star
6

FCViT

A Close Look at Spatial Modeling: From Attention to Convolution
Python
89
star
7

LIVE

[CVPR 2022 Oral] Towards Layer-wise Image Vectorization
Python
57
star
8

EfficientMod

[ICLR 2024 poster] Efficient Modulation for Vision Networks
Python
44
star
9

DataMining

Java implementation of the classic Data mining (big data) algorithm. Create a new Java project, and copy this project to the SRC directory is ok.
Java
27
star
10

SPANet

Codes of "SPANet: Spatial Pyramid Attention Network for Enhanced Image Recognition"
Python
22
star
11

ORL3

Face recognition implement based on LDA, PCA and SVM.
MATLAB
21
star
12

CV_papers

A paper List for computer vision.
18
star
13

Efficient_ImageNet_Classification

An efficient implementation for ImageNet classification
Python
15
star
14

CenterLoss

A Discriminative Feature Learning Approach for Deep Face Recognition
Python
8
star
15

DNN

A DNN learning project
Python
7
star
16

TSNE

Python
7
star
17

Non-Local

Compare Non-Local, GC, SE and Global_Average_Pooling
Python
7
star
18

SPANet_TMM

Python
6
star
19

Attention

Python
5
star
20

L21FS

L21FS
MATLAB
5
star
21

SparseSENet

For REU project
Python
4
star
22

ResidualAttention

Python
4
star
23

Dynamic-Conv

Python
4
star
24

NANet

Code for "Attention Meets Normalization and Beyond"
Python
4
star
25

awesome-vision-transformers-comparison

A detailed comparsion of Recent Vision Transformers on ImageNet1k
4
star
26

hpc_yolo3

an object detection framework for UNT REU 2019 project.
Python
3
star
27

2PTWSVM

2PTWSVM
MATLAB
3
star
28

ParameterFree

Official code for “Cascaded Context Dependency: An Extremely Lightweight Module for Deep Convolutional Neural Networks”
Python
3
star
29

pointsMLP

Python
3
star
30

DistKernel

Python
3
star
31

RDANet

residual decoupled attention on imagenet
Python
2
star
32

ShiftFormer

An Efficient Transformer Beyond Convolution, Self-Attention, and MLP
Python
2
star
33

Learning_keras

A learning demo for DNN based on keras
2
star
34

imagenet_nv

Python
2
star
35

ImageNet.fastai

Python
2
star
36

cifar

Python
2
star
37

imagenet.pytorch

Python
2
star
38

detection

Python
2
star
39

openmax

Python
2
star
40

RDA_cifar_GCP

RDA on CIFAR100
Python
2
star
41

incrementalAD

This is a project for Incremental Anomaly Detection, which is written in MATLAB. The used techniques including: incremental LDA, incremental SVM, SMOTE, hard negative mining.
MATLAB
2
star
42

MLproject

The project for Machine Learning
MATLAB
2
star
43

mmdet

Forked from mmdetection
Python
1
star
44

PRM

IJCAI 2020
Python
1
star
45

SuperPixelNet

1
star
46

metric_learning

Deep Metric Learning
Python
1
star
47

RENYI

1
star
48

mmdet0

Python
1
star
49

ma-xu.github.io

personal blog website
HTML
1
star
50

mmdetection3d-0.10.0

Python
1
star
51

springMVC2222

JavaScript
1
star
52

seg_every_thing2

Python
1
star
53

DeepMetric

Python
1
star
54

khdj

康护到家
HTML
1
star
55

Odevity

Python
1
star
56

EC

SpringMVC整合hibernate,mysql的基础学习模版
Java
1
star
57

mmdet1

Python
1
star
58

OLTR

Python
1
star
59

Library

all
JavaScript
1
star
60

ECommerce

test
JavaScript
1
star