TFLite-msg_chn_wacv20-depth-completion

Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in Tensorflow Lite.

TFLite msg_chn_wacv20 depth completion

Requirements

  • OpenCV and tensorflow or tflite_runtime. Also, unrealcv is only required if you want to generate new data using unrealcv.

For the tflite runtime, you can either use tensorflow pip install tensorflow or the TensorFlow Runtime binary

UnrealCV synthethic data generation

The input images and depth are generated using the UnrealCV library (https://unrealcv.org/), you can find more information about how to generate this data in this other repository for Unreal Synthetic depth generation.

Installation

pip install -r requirements.txt

TFLite model

The original models were converted to different formats (including .tflite) by PINTO0309, download the models from his repository and save them into the models folder.

Original Pytorch model

The Pytorch pretrained model was taken from the original repository.

ONNX inference

For ONNX inference, use this other repository:https://github.com/ibaiGorordo/ONNX-msg_chn_wacv20-depth-completion

Examples

  • Video inference (UnrealCV synthetic data):

python videoDepthEstimation.py

Inference video Example

TFLite msg_chn_wacv20 depth completion

References:

GitHub

https://github.com/ibaiGorordo/TFLite-msg_chn_wacv20-depth-completion