TY - JOUR
T1 - Selecting decision trees for power system security assessment
AU - Bugaje, Al-Amin B.
AU - Cremer, Jochen L.
AU - Sun, Mingyang
AU - Strbac, Goran
PY - 2021
Y1 - 2021
N2 - Power systems transport an increasing amount of electricity, and in the future, involve more distributed renewables and dynamic interactions of the equipment. The system response to disturbances must be secure and predictable to avoid power blackouts. The system response can be simulated in the time domain. However, this dynamic security assessment (DSA) is not computationally tractable in real-time. Particularly promising is to train decision trees (DTs) from machine learning as interpretable classifiers to predict whether the system-wide responses to disturbances are secure. In most research, selecting the best DT model focuses on predictive accuracy. However, it is insufficient to focus solely on predictive accuracy. Missed alarms and false alarms have drastically different costs, and as security assessment is a critical task, interpretability is crucial for operators. In this work, the multiple objectives of interpretability, varying costs, and accuracies are considered for DT model selection. We propose a rigorous workflow to select the best classifier. In addition, we present two graphical approaches for visual inspection to illustrate the selection sensitivity to probability and impacts of disturbances. We propose cost curves to inspect selection combining all three objectives for the first time. Case studies on the IEEE 68 bus system and the French system show that the proposed approach allows for better DT-selections, with an 80% increase in interpretability, 5% reduction in expected operating cost, while making almost zero accuracy compromises. The proposed approach scales well with larger systems and can be used for models beyond DTs. Hence, this work provides insights into criteria for model selection in a promising application for methods from artificial intelligence (AI).
AB - Power systems transport an increasing amount of electricity, and in the future, involve more distributed renewables and dynamic interactions of the equipment. The system response to disturbances must be secure and predictable to avoid power blackouts. The system response can be simulated in the time domain. However, this dynamic security assessment (DSA) is not computationally tractable in real-time. Particularly promising is to train decision trees (DTs) from machine learning as interpretable classifiers to predict whether the system-wide responses to disturbances are secure. In most research, selecting the best DT model focuses on predictive accuracy. However, it is insufficient to focus solely on predictive accuracy. Missed alarms and false alarms have drastically different costs, and as security assessment is a critical task, interpretability is crucial for operators. In this work, the multiple objectives of interpretability, varying costs, and accuracies are considered for DT model selection. We propose a rigorous workflow to select the best classifier. In addition, we present two graphical approaches for visual inspection to illustrate the selection sensitivity to probability and impacts of disturbances. We propose cost curves to inspect selection combining all three objectives for the first time. Case studies on the IEEE 68 bus system and the French system show that the proposed approach allows for better DT-selections, with an 80% increase in interpretability, 5% reduction in expected operating cost, while making almost zero accuracy compromises. The proposed approach scales well with larger systems and can be used for models beyond DTs. Hence, this work provides insights into criteria for model selection in a promising application for methods from artificial intelligence (AI).
KW - Cost curves
KW - Cost sensitivity
KW - Decision trees
KW - Dynamic security assessment
KW - Machine learning
KW - ROC curve
UR - http://www.scopus.com/inward/record.url?scp=85112412471&partnerID=8YFLogxK
U2 - 10.1016/j.egyai.2021.100110
DO - 10.1016/j.egyai.2021.100110
M3 - Article
AN - SCOPUS:85112412471
VL - 6
SP - 1
EP - 10
JO - Energy and AI
JF - Energy and AI
SN - 2666-5468
M1 - 100110
ER -