Categories

13.3.2 Decision Trees & Random Forest Feature Importance (L13: Feature Selection)

Published: 22 December 2021
on channel: Sebastian Raschka
13,937
241

Sebastian's books: https://sebastianraschka.com/books/

This video explains how decision trees training can be regarded as an embedded method for feature selection. Then, we will also look at random forest feature importance and go over two different ways it's computed: (a) impurity-based and (b) permutation-based.

Slide link: https://sebastianraschka.com/pdf/lect...

Code link: https://github.com/rasbt/stat451-mach...

-------

This video is part of my Introduction of Machine Learning course.

Next video:    • 13.4.1 Recursive Feature Elimination ...  

The complete playlist:    • Intro to Machine Learning and Statist...  

A handy overview page with links to the materials: https://sebastianraschka.com/blog/202...

-------

If you want to be notified about future videos, please consider subscribing to my channel:    / sebastianraschka  

Watch video 13.3.2 Decision Trees & Random Forest Feature Importance (L13: Feature Selection) online without registration, duration hours minute second in high quality. This video was added by user Sebastian Raschka 22 December 2021, don't forget to share it with your friends and acquaintances, it has been viewed on our site 13,937 once and liked it 241 people.

play_arrow
2,804
28

Tom & Jerry selfie in green screen

Tom & Jerry selfie in green screen
play_arrow
11,223
24

Vintage Teletronix LA-2A at Gearlicious

Vintage Teletronix LA-2A at Gearlicious
play_arrow
1,308
46

Universal Audio LA-2A

Universal Audio LA-2A
play_arrow
5,450
26

How To Fix Your Widgy Widget Not Loading Using Tap Actions!

How To Fix Your Widgy Widget Not Loading Using Tap Actions!
play_arrow
90,781
1.3K

Velhas Virgens - Esse Seu Buraquinho [Ao Vivo]

Velhas Virgens - Esse Seu Buraquinho [Ao Vivo]
play_arrow
7,759
209

Leetcode - 340 : Longest Substring with At Most K Distinct Characters | Solution Explained | Java

Leetcode - 340 : Longest Substring with At Most K Distinct Characters | Solution Explained | Java
play_arrow
10,810
937

Можно ли принимать лекарство много лет.

Можно ли принимать лекарство много лет.
play_arrow
13
8

how to change WhatsApp profile photo।। WhatsApp profile picture kaise change Karen।। Abhishek।।

how to change WhatsApp profile photo।। WhatsApp profile picture kaise change Karen।। Abhishek।।
Related
play_arrow
Building LLMs from the Ground Up: A 3-hour Coding Workshop

Building LLMs from the Ground Up: A 3-hour Coding Workshop
play_arrow
Understanding PyTorch Buffers

Understanding PyTorch Buffers
play_arrow
Developing an LLM: Building, Training, Finetuning

Developing an LLM: Building, Training, Finetuning
play_arrow
Managing Sources of Randomness When Training Deep Neural Networks

Managing Sources of Randomness When Training Deep Neural Networks
play_arrow
Insights from Finetuning LLMs with Low-Rank Adaptation

Insights from Finetuning LLMs with Low-Rank Adaptation
play_arrow
Finetuning Open-Source LLMs

Finetuning Open-Source LLMs
play_arrow
Scaling PyTorch Model Training With Minimal Code Changes

Scaling PyTorch Model Training With Minimal Code Changes
play_arrow
L13.5 What's The Difference Between Cross-Correlation And Convolution?

L13.5 What's The Difference Between Cross-Correlation And Convolution?
play_arrow
Conditional Ordinal Regression for Neural Networks (CORN) With Examples in PyTorch

Conditional Ordinal Regression for Neural Networks (CORN) With Examples in PyTorch
play_arrow
The Three Elements of PyTorch

The Three Elements of PyTorch
play_arrow
Ratings and Rankings -- Using Deep Learning When Class Labels Have A Natural Order

Ratings and Rankings -- Using Deep Learning When Class Labels Have A Natural Order
play_arrow
13.4.5 Sequential Feature Selection -- Code Examples (L13: Feature Selection)

13.4.5 Sequential Feature Selection -- Code Examples (L13: Feature Selection)
play_arrow
13.4.4 Sequential Feature Selection (L13: Feature Selection)

13.4.4 Sequential Feature Selection (L13: Feature Selection)
play_arrow
13.4.3 Feature Permutation Importance Code Examples (L13: Feature Selection)

13.4.3 Feature Permutation Importance Code Examples (L13: Feature Selection)
play_arrow
13.4.2 Feature Permutation Importance (L13: Feature Selection)

13.4.2 Feature Permutation Importance (L13: Feature Selection)
play_arrow
13.4.1 Recursive Feature Elimination (L13: Feature Selection)

13.4.1 Recursive Feature Elimination (L13: Feature Selection)
play_arrow
13.3.2 Decision Trees & Random Forest Feature Importance (L13: Feature Selection)

13.3.2 Decision Trees & Random Forest Feature Importance (L13: Feature Selection)
play_arrow
13.3.1 L1-regularized Logistic Regression as Embedded Feature Selection (L13: Feature Selection)

13.3.1 L1-regularized Logistic Regression as Embedded Feature Selection (L13: Feature Selection)
play_arrow
13.2 Filter Methods for Feature Selection -- Variance Threshold (L13: Feature Selection)

13.2 Filter Methods for Feature Selection -- Variance Threshold (L13: Feature Selection)
play_arrow
13.1 The Different Categories of Feature Selection (L13: Feature Selection)

13.1 The Different Categories of Feature Selection (L13: Feature Selection)
play_arrow
13.0 Introduction to Feature Selection (L13: Feature Selection)

13.0 Introduction to Feature Selection (L13: Feature Selection)
play_arrow
Introduction to Generative Adversarial Networks (Tutorial Recording at ISSDL 2021)

Introduction to Generative Adversarial Networks (Tutorial Recording at ISSDL 2021)
play_arrow
Designing Generative Adversarial Networks for Privacy-enhanced Face Recognition (Conference rec.)

Designing Generative Adversarial Networks for Privacy-enhanced Face Recognition (Conference rec.)
play_arrow
L19.5.2.2 GPT-v1: Generative Pre-Trained Transformer

L19.5.2.2 GPT-v1: Generative Pre-Trained Transformer