tinygbt

KO | EN

gitlite — search

#hacktoberfest #java #python #javascript #reactjs #react #sql #machine-learning #html #dart #flutter #bootstrap

★ 259 Open GitHub ↗

A Tiny, Pure Python implementation of Gradient Boosted Trees.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# TinyGBT

TinyGBT(Tiny Gradient Boosted Trees) is a 200 line gradient boosted trees implementation written in pure python.

Since this code is not for production, it is not optimized for speed and memory usage.

### Experiment

- Data: [LightGBM's regression example data](https://github.com/Microsoft/LightGBM/tree/master/examples/regression)
- TinyGBT is quite slower than LightGBM, but achieve almost same testset RMSE on similar parameter settings.

| - | LightGBM | TinyGBT |
| --- | --- | --- |
| RMSE of TestSet | 0.45652 | 0.45934 |

#### Reproduce experiment

- TinyGBT

```
git clone https://github.com/lancifollia/tinygbt.git
cd tinygbt
python example.py
```

- LightGBM
    - run [this code](https://github.com/Microsoft/LightGBM/blob/master/examples/python-guide/simple_example.py)

### Features

- For now, Regression with L2 loss supported only.

### References

- [1] T. Chen and C. Guestrin. XGBoost: A Scalable Tree Boosting System. 2016.
- [2] G. Ke et al. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. 2017.

### License

MIT

tinygbt

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README