Simba: Towards High-Fidelity and Geometrically-Consistent Point Cloud Completion via Transformation Diffusion
Abstract
Simba is an advanced deep learning framework specifically designed for high-quality 3D point cloud completion tasks. By leveraging transformation diffusion techniques, Simba achieves high fidelity and geometric consistency in completing 3D point clouds. This repository provides the implementation, datasets, and tools necessary to reproduce the results presented in our work.
News
- 2025-11-22 Initial release of Simba repository and pretrained models.
- 2025-11-08 Simba accepted at AAAI 2026.
Features
- High-fidelity 3D point cloud completion.
- Geometrically consistent results using transformation diffusion.
- Support for multiple datasets, including PCN, ShapeNet and KITTI.
- Modular and extensible codebase for research and development.
Pretrained Models
We provide the model weights trained on the PCN dataset for Stage 2 (Simba). You can download them via Google Drive.
| Model | Download Link |
|---|---|
| Simba(Stage 2) | [Google Drive] |
Installation Guide
Prerequisites
- CUDA 12.1 compatible GPU
- Anaconda or Miniconda installed
- Python 3.10
Installation Steps
1. Environment Setup
Create and activate a new conda environment:
conda activate Simba
2. PyTorch Installation
Install PyTorch with CUDA 12.1 support:
3. Dependencies Installation
Install required Python packages and custom wheels:
pip install --upgrade https://github.com/unlimblue/KNN_CUDA/releases/download/0.2/KNN_CUDA-0.2-py3-none-any.whl
4. PyTorch3D Installation
Install PyTorch3D compatible with your PyTorch version:
5. Mamba and Causal Conv1D Installation
Install specialized neural network components by downloading the required .whl files from the following links:
- Mamba SSM v1.2.1 (File:
mamba_ssm-1.2.1+cu122torch2.3cxx11abiFALSE-cp310-cp310-linux_x86_64.whl) - Causal Conv1D v1.2.1 (File:
causal_conv1d-1.2.1+cu122torch2.3cxx11abiFALSE-cp310-cp310-linux_x86_64.whl)
After downloading the specified files, install them using:
pip install causal_conv1d-1.2.1+cu122torch2.3cxx11abiFALSE-cp310-cp310-linux_x86_64.whl
6. Extension Compilation
Compile various 3D processing extensions by running the provided install.sh script:
The script will:
- Navigate to each extension directory.
- Run the installation command (
python setup.py install). - Log the progress and errors to
install_extensions.log.
If any step fails, the script will stop and display an error message.
Datasets
Details about the datasets used in this project can be found in DATASET.md.
Usage
Two-Stage Training
Simba employs a two-stage training process to achieve high-fidelity and geometrically consistent point cloud completion. Below are the details for each stage:
Stage 1: Training the SymmGT Model
In the first stage, the SymmGT model is trained to generate high-quality intermediate representations. Use the following command to train the SymmGT model:
--config ./cfgs/PCN_models/SymmGT.yaml \
--exp_name SymmGT_stage_1
The trained model weights will be saved in the experiment/SymmGT_stage_1/ directory.
Stage 2: Training the Simba Model
In the second stage, the Simba model is trained using the pretrained weights from the first stage. Update the pretrain field in cfgs/PCN_models/Simba.yaml to point to the path of the trained SymmGT model (e.g., experiment/SymmGT_stage_1/best_model.pth). Then, run the following command:
--config ./cfgs/PCN_models/Simba.yaml \
--exp_name Simba_stage_2
Alternatively, you can use the automated training script train.sh, which handles both stages and automatically sets the pretrained model path for the second stage:
This script will:
- Train the SymmGT model in the first stage.
- Automatically retrieve the best model weights from the first stage and use them for training the Simba model in the second stage.
Inference
To run inference with a pretrained model:
--config <config_file> \
--checkpoint <checkpoint_file> \
--input <input_path> \
--output <output_path>
Training
To train a model from scratch:
--config <config_file> \
--output <output_dir>
License
This project is licensed under the MIT License.
Acknowledgements
This project is inspired by PoinTr and SymmCompletion.
Citation
If you find this work useful, please consider citing:
title={Simba: Towards High-Fidelity and Geometrically-Consistent Point Cloud Completion via Transformation Diffusion},
author={Lirui Zhang and Zhengkai Zhao and Zhi Zuo and Pan Gao and Jie Qin},
booktitle={Proceedings of the AAAI Conference on Artificial Intelligence (AAAI)},
year={2026},
url={https://arxiv.org/abs/2511.16161},
note={To appear}