Python scripts for performing road segemtnation and car detection using the HybridNets multitask model in ONNX.

!HybridNets Road multitask detections


  • Check the requirements.txt file. Additionally, pafy and youtube-dl are required for youtube video inference.


pip install -r requirements.txt
pip install pafy youtube_dl>=2021.12.17

ONNX model

The original models were converted to different formats (including .onnx) by PINTO0309, download the models from his repository and save them into the models folder.

Original Pytorch model

The Pytorch pretrained model was taken from the original repository.


python image_road_detection.py

Original video: https://youtu.be/jvRDlJvG8E8

python video_bird_eye_view_road_detection.py

Original video: https://youtu.be/jvRDlJvG8E8

python video_road_detection.py

Bird Eye View for Custom Video:

If you use a different video for teh bird eye view, you will have to modify the horizon points. Set horizon_points=None to trigger the horizon point selection mode. This mode will show the image and wait until the two horizon points are selected as in the image below. A horizontal line is used as a guide, if the road does not reach that height, you can ignore the horizontal line. Copy the printed output into the horizon_points variable for next inferences.

!Horizon point selection



View Github