Amodal Segmentation through Out-of-Task and Out-of-Distribution Generalization with a Bayesian Model

Quick Start: Setup environment / Download models and dataset

conda env create -f environment.yml
conda activate amodal
bash download.sh
  • In the case that download.sh cannot be executed properly, please identify the missing directory and rerun the wget command for the corresponding zip file. If the issue persists, please refer to the download.sh description below.

Run experiments

  • Table 1: change the file Code/configs.py to set TABLE_NUM = 1 and MODEL_TYPE = 'ML' or MODEL_TYPE = 'E2E' and run the command below.

  • Table 2: change the file Code/configs.py to set TABLE_NUM = 2 and MODEL_TYPE = 'ML' or MODEL_TYPE = 'E2E' and run the command below.

  • Table 3: change the file Code/configs.py to set TABLE_NUM = 3 and MODEL_TYPE = 'ML' or MODEL_TYPE = 'E2E' and run the command below.

cd Code
python3 run_experiment.py

Optional: download.sh Description

Download models

  • Download pretrained model weights from here, unzip Models.zip and place the folder as /Models/.

  • Download RPN results used for evaluatiooon from here, unzip RPN_results.zip and place the folder as /RPN_results/.

Download dataset

  • Download Occluded Vehicle Dataset from here, unzip Occluded_Vehicles.zip and place the folder as /Dataset/Occluded_Vehicles/.

  • Download KINS Dataset from here, unzip kitti.zip and place the folder as /Dataset/kitti/.

  • Download COCOA Dataset from here, unzip COCO.zip and place the folder as /Dataset/COCO/. Additionally, download COCO data train2014 and val2014 and place the folders as /Dataset/COCO/train2014/ and /Dataset/COCO/val2014/.

GitHub

View Github