⚠ Switch to EXCALIDRAW VIEW in the MORE OPTIONS menu of this document. ⚠ You can decompress Drawing data with the command palette: ‘Decompress current Excalidraw file’. For more info check in plugin settings under ‘Saving’
Excalidraw Data
Text Elements
Gini Impurity vs Entropy
Comparison as class proportion varies
Class proportion (p)
0
0.5
1
0
0.5
1
Legend
Gini: 2p(1-p)
Entropy: -p*log(p)
-(1-p)*log(1-p) ^LCrmrnsv
-
Both = 0 at p=0 & p=1 (pure classes)
-
Both peak at p=0.5 (max impurity)
-
Gini max = 0.5 Entropy max = 1.0
-
Similar shape results in similar tree results
max