Python_Decision_Tree_and_Random_Forest - GitLite

KO | EN

gitlite — search

#python #ai #android #rust #deep-learning #linux #macos #java #awesome-list #vue #ios #openai #mcp #open-source

Python_Decision_Tree_and_Random_Forest

(★ 266)

I've demonstrated the working of the decision tree-based ID3 algorithm. Use an appropriate data set for building the decision tree and apply this knowledge to classify a new sample. All the steps have been explained in detail with graphics for better understanding.

File Explorer

Download Latest Version (.zip)

- playgolf_data.csv
- playgolf_data.docx
- playgolf_data2.csv
- CARTpg.png
- decisiontree.png
- dnld_rep.png
- dt.png
- dt0.png
- dt1.png
- dt2.png
- dt3.png
- ID3.png
- ID3pg.png
- iris.png
- irisFlow.png
- playgolf.png
- iris_DecisionTree (1).log
- iris_DecisionTree_dtreeviz
- iris_DecisionTree_dtreeviz.png
- iris_DecisionTree_dtreeviz.svg
- iris_DecisionTree_graphivz1
- iris_DecisionTree_graphivz1.png
- iris_DecisionTree_graphivz2.png
- iris_DecisionTree_plotTree.png
- iris_DecisionTree_regression1.txt
- iris_DecisionTree_regression2
- iris_DecisionTree_regression2.png
- iris_DecisionTree_regression3
- iris_DecisionTree_regression3.png
- iris_DecisionTree_regression3.svg
- iris_DecisionTree_text.txt
- iris_DecisionTree_textRep.png
001_Decision_Tree_PlayGolf_ID3.ipynb
002_Decision_Tree_PlayGolf_CART.ipynb
003_Decision_Tree_Visualisation_Iris_Dataset.ipynb
004_Decision_Tree_Classifier_Iris_Dataset.ipynb
LICENSE
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<p align="center"> 
<a href="https://github.com/milaan9"><img src="https://img.shields.io/static/v1?logo=github&label=maintainer&message=milaan9&color=ff3300" alt="Last Commit"/></a> 


<a href="https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/pulse" alt="Activity"><img src="https://img.shields.io/github/commit-activity/m/milaan9/Python_Decision_Tree_and_Random_Forest.svg?colorB=teal&style=flat" /></a> 
<a href="https://hits.seeyoufarm.com"><img src="https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2Fmilaan9%2FPython_Decision_Tree_and_Random_Forest&count_bg=%231DC92C&title_bg=%23555555&icon=&icon_color=%23E7E7E7&title=views&edge_flat=false"/></a>
<a href="https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/stargazers"><img src="https://img.shields.io/github/stars/milaan9/Python_Decision_Tree_and_Random_Forest.svg?colorB=1a53ff" alt="Stars Badge"/></a>
<a href="https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/network/members"><img src="https://img.shields.io/github/forks/milaan9/Python_Decision_Tree_and_Random_Forest" alt="Forks Badge"/> </a>
<img src="https://img.shields.io/github/repo-size/milaan9/Python_Decision_Tree_and_Random_Forest.svg?colorB=CC66FF&style=flat" alt="Size"/>
<a href="https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/pulls"><img src="https://img.shields.io/github/issues-pr/milaan9/Python_Decision_Tree_and_Random_Forest.svg?colorB=yellow&style=flat" alt="Pull Requests Badge"/></a>
<a href="https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/issues"><img src="https://img.shields.io/github/issues/milaan9/Python_Decision_Tree_and_Random_Forest.svg?colorB=yellow&style=flat" alt="Issues Badge"/></a>
<img src="https://img.shields.io/github/languages/top/milaan9/Python_Decision_Tree_and_Random_Forest.svg?colorB=996600&style=flat" alt="Language"/></a>
<a href="https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/blob/main/LICENSE"><img src="https://img.shields.io/badge/License-MIT-blueviolet.svg" alt="MIT License"/></a>
</p> 

<p align="center"> 
<a href="https://mybinder.org/v2/gh/milaan9/Python_Decision_Tree_and_Random_Forest/HEAD"><img src="https://mybinder.org/badge_logo.svg" alt="binder"/></a>
<a href="https://githubtocolab.com/milaan9/Python_Decision_Tree_and_Random_Forest"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="colab"/></a>
</p> 
 
 
# Python Decision Tree and Random Forest

## Decision Tree

A Decision Tree is one of the popular and powerful machine learning algorithms that I have learned. The basics of Decision Tree is explained in detail with clear explanation.

<p align="center">  
 <img src="img/dt0.png" width="700"/>
</p>

I have given complete theoritical stepwise explanation of computing decision tree using **`ID3 (Iterative Dichotomiser)`** and **`CART (Classification And Regression Trees)`** along sucessfully implemention of decision tree on **`ID3`** and **`CART`** using Python on **[playgolf_data](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/blob/main/dataset/playgolf_data.csv)** and **[Iris dataset](https://archive.ics.uci.edu/ml/datasets/iris)**

### Play Golf dataset:
| ![ID3](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/blob/main/img/ID3pg.png)  | ![CART](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/blob/main/img/CARTpg.png) | 
|:---:|:---:|
| ID3 dataset analysis| CART dataset analysis |

<p align="center">  
 <img src="img/dt.png" width="700"/>
</p>

### Iris dataset

1. Method 1: Print Text Representation

<p align="center">  
 <img src="output_DecisionTree/iris_DecisionTree_textRep.png" width="300"/>
</p>

2. Method 2: Plot Tree with plot_tree

<p align="center">  
 <img src="output_DecisionTree/iris_DecisionTree_plotTree.png" width="2000"/>
</p>

3. Method 3: Plot Decision Tree with graphviz

<p align="center">  
 <img src="output_DecisionTree/iris_DecisionTree_graphivz2.png" width="800"/>
</p>

4. Method 4: Plot Decision Tree with dtreeviz Package

<p align="center">  
 <img src="output_DecisionTree/iris_DecisionTree_dtreeviz.png" width="700"/>
</p>

5. Method 5: Visualizing the Decision Tree in Regression Task

<p align="center">  
 <img src="output_DecisionTree/iris_DecisionTree_regression2.png" width="700"/>
</p>

<p align="center">  
 <img src="output_DecisionTree/iris_DecisionTree_regression3.png" width="700"/>
</p>

---

## Table of contents 📋

| **No.** | **Name** | 
| ------- | -------- | 
| 01 | **[Decision_Tree_PlayGolf_ID3](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/blob/main/001_Decision_Tree_PlayGolf_ID3.ipynb)** |
| 02 | **[Decision_Tree_PlayGolf_CART](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/blob/main/001_Decision_Tree_PlayGolf_CART.ipynb)** |
| 03 | **[Decision_Tree_Visualisation_Iris_Dataset](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/blob/main/003_Decision_Tree_Visualisation_Iris_Dataset.ipynb)** |
| 04 | **[Decision_Tree_Classifier_Iris_Dataset](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/blob/main/004_Decision_Tree_Classifier_Iris_Dataset.ipynb)** |

These are online **read-only** versions. However you can **`Run ▶`**  all the codes **online** by clicking here ➞ <a href="https://mybinder.org/v2/gh/milaan9/Python_Decision_Tree_and_Random_Forest/HEAD"><img src="https://mybinder.org/badge_logo.svg" alt="binder"/></a>

---

## Frequently asked questions ❔

### How can I thank you for writing and sharing this tutorial? 🌷

You can <img src="https://img.shields.io/static/v1?label=%E2%AD%90 Star &message=if%20useful&style=style=flat&color=blue" alt="Star Badge"/> and <img src="https://img.shields.io/static/v1?label=%E2%B5%96 Fork &message=if%20useful&style=style=flat&color=blue" alt="Fork Badge"/> Starring and Forking is free for you, but it tells me and other people that it was helpful and you like this tutorial.

Go [**`here`**](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest) if you aren't here already and click ➞ **`✰ Star`** and **`ⵖ Fork`** button in the top right corner. You will be asked to create a GitHub account if you don't already have one.

---

### How can I read this tutorial without an Internet connection? <img alt="GIF" src="https://github.com/TheDudeThatCode/TheDudeThatCode/blob/master/Assets/hmm.gif" width="20" />

1. Go [**`here`**](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest) and click the big green ➞ **`Code`** button in the top right of the page, then click ➞ [**`Download ZIP`**](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/archive/refs/heads/main.zip).

![Download ZIP](https://raw.githubusercontent.com/milaan9/Python_Decision_Tree_and_Random_Forest/main/img/dnld_rep.png)

2. Extract the ZIP and open it. Unfortunately I don't have any more specific instructions because how exactly this is done depends on which operating system you run.
    
3. Launch ipython notebook from the folder which contains the notebooks. Open each one of them
  
    **`Kernel > Restart & Clear Output`**
    
This will clear all the outputs and now you can understand each statement and learn interactively.

If you have git and you know how to use it, you can also clone the repository instead of downloading a zip and extracting it. An advantage with doing it this way is that you don't need to download the whole tutorial again to get the latest version of it, all you need to do is to pull with git and run ipython notebook again.

---

## Authors ✍️

I'm Dr. Milaan Parmar and I have written this tutorial. If you think you can add/correct/edit and enhance this tutorial you are most welcome🙏

See [github's contributors page](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/graphs/contributors) for details.

If you have trouble with this tutorial please tell me about it by [Create an issue on GitHub](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest/issues/new). and I'll make this tutorial better. This is probably the best choice if you had trouble following the tutorial, and something in it should be explained better. You will be asked to create a GitHub account if you don't already have one.

If you like this tutorial, please [give it a ⭐ star](https://github.com/milaan9/Python_Decision_Tree_and_Random_Forest).

---

## Licence 📜

You may use this tutorial freely at your own risk. See [LICENSE](./LICENSE).