/ Machine Learning

A Tiny, Pure Python implementation of Gradient Boosted Trees

A Tiny, Pure Python implementation of Gradient Boosted Trees

TinyGBT

TinyGBT(Tiny Gradient Boosted Trees) is a 200 line gradient boosted trees implementation written in pure python.

Since this code is not for production, it is not optimized for speed and memory usage.

Experiment

- LightGBM TinyGBT
RMSE of TestSet 0.45652 0.45934

Reproduce experiment

  • TinyGBT
git clone https://github.com/lancifollia/tinygbt.git
cd tinygbt
python example.py

Features

  • For now, Regression with L2 loss supported only.

References

  • [1] T. Chen and C. Guestrin. XGBoost: A Scalable Tree Boosting System. 2016.
  • [2] G. Ke et al. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. 2017.

GitHub