项目作者: SoniSiddharth

项目描述 :
Machine Learning - Decision tree model implementation from scratch
高级语言: Python
项目地址: git://github.com/SoniSiddharth/ML-Decision-Trees-from-scratch.git


Decision Trees and Random Forests ⭐🌳⭐

Directory Structure: 📁

  1. ADABoost_test.py
  2. assignment_q4_subjective_answers.md
  3. Bagging_test.py
  4. estate-experiments.py
  5. experiments.py
  6. iris-experiments.py
  7. Makefile
  8. metrics.py
  9. Random_forest.py
  10. random_forest_iris.py
  11. README.md
  12. realestate.csv
  13. usage.py
  14. ├───ensemble
  15. ADABoost.py
  16. bagging.py
  17. __init__.py
  18. ├───images
  19. └───tree
  20. base.py
  21. randomForest.py
  22. utils.py
  23. __init__.py

Instructions to run 🏃

make help
make decision_tree
make iris
make real_estate
make experiments
make adaboost
make bagging
make random_forest
make random_forest_iris

Time and Sampling plots: ⏰

DIDO Training

alt text

DIDO Prediction

alt text

DIRO Training

alt text

DIRO Prediction

alt text

RIDO Training

alt text

RIDO Prediction

alt text

RIRO Training

alt text

RIRO Prediction

alt text

Adaboost: 💥

Decision Tree Estimator Plot

alt text

All Estimators Individual Decision Surface

alt text

Combined Decision Surfaces

alt text

  • IRIS Dataset

Decision Tree Estimator PLot

alt text

All Estimators Individual Decision Surface

alt text

Combined Decision Surfaces

alt text

Bagging: 👊

Decision Tree Estimator Plot

alt text

All Estimators Individual Decision Surface

alt text

Random Forest: 🌳🌳

Decision Tree Estimator Structure

alt text

All Estimators Individual Decision Surface

alt text

Combined Decision Surfaces

alt text