Mixed Algorithm of SINDy and HAVOK For Measure-Based Analysis of Power System With Inverter-Based Resource
Mixed Algorithm of SINDy and HAVOK For Measure-Based Analysis of Power System With Inverter-Based Resource
Abstract:- Artificial intelligence and machine learning is module-level nonlinearity thus the power system remains
enhancing electric grids by offering data analysis tools first order, i.e., linearizable [5]. The current state-of-the -art
that can be used to operate the power grid more reliably. ML algorithm showed remarkable performance regarding
However, the complex nonlinear dynamics, particularly model identifications and system analysis of linear and
when coupled with multi-scale interactions among nonlinear first-order system. Increase in the penetration of
Inverter-based renewable energy Resources, calls for renewable energy, specifically IBRs, in power system
effective algorithms for power system application. caused a shift in the nature of the system by introducing
coupled multi-scale nonlinear dynamic. This changed
This paper presents affective novel algorithm to introduced and interactive complex nonlinearity on system-
detect various nonlinear dynamics, which is built upon: level to the grid which elevate the power system to the
the Sparse Identification of Nonlinear Dynamics method second-order system. The generic ML algorithms struggle
for nonlinear dynamics detection; and Hankel to capture systems' multi-scale temporal and spatial
Alternative View of Koopman method for multi-scale complexities, further limiting their accuracy and
decomposition. We show that, by an appropriate effectiveness in modeling and analysis of power system
integration of the strengths of the two, the mixed derived by IBRs, where fast and slow dynamics capture
algorithm not only can detect the nonlinearity, but also localized phenomena and overall spatial patterns [5] [6].
it distinguishes the nonlinearity caused by coupled
Inverter-based resources from the more familiar ones Since the introduction of SINDy algorithm in 2016 [7]
caused synchronous generators. This shows that the it has seen widespread use in model identification across
proposal algorithm can be a promising application of various disciplines, showing remarkable performance by
artificial intelligence and machine learning for data explicitly identifying underlying governing equations
measure-based analysis to support operation of power through sparse regression techniques, which leads to
system with integrated renewables. interpretable models while effectively addressing model
complexity [7], [8]. The SINDy algorithm has been used in
Keywords:- HAVOK, Inverter-Based Resources, Machine limited number of the field of power system analysis [9-12].
Learning, Measure-Based Method, Model Identification, Notably, these studies predominantly analyzed the general
Multi-Scale Dynamics, Non-Linear Dynamics, Power power system and relied on first-order system models, as
System, Sindy. exemplified by [9] in 2020 paper on power system
applications.
I. INTRODUCTION
SINDy is a measure-based method specifically
Although machine learning (ML) algorithm and designed to discover governing equations or mathematical
artificial intelligent (AI) enhanced the analysis of the system models from observed data. Several studies in different
by addressing the limitations of traditional models to disciplines demonstrated the performance and practicality
capture the complex nonlinear dynamics of power systems, of SINDy in model identifications [13]. By leveraging
the integration of inverter-based energy resources (IBRs) compressed sensing and sparse modeling principles, SINDy
with coupled muti-scale dynamics necessitate an alternative offers robustness and the potential for generalization,
approach utilizing more advanced algorithms to improve allowing for identifying key dynamical features with
modeling accuracy and system optimization [1-4]. In the relatively few measurements. However, it's important to
conventional view, the IBRs technology will introduce note that SINDy can be sensitive to noise. At its core, the
nonlinearity into the power system, however, the generic SINDy assumes the system as linearizable system,
nonlinearity introduced by the IBRs classified into the i.e., first-order nonlinear system. Therefore, generic SINDy
faces challenge in coupled multi-scale systems where framework of generic SINDy method and supporting
multiple variables interact strongly [7], [8]. These systems HAVOK decomposition in power system. Section III
often involve intricate relationships, and accurately demonstrates the proposed methods' performance by
capturing these dynamics requires disentanglement of the evaluating and examining the obtained outcomes. The final
multi-scale dynamics [14]. This intricate and multifaceted segment comprises the concluding remarks, emphasizing
nonlinear effects of integrating IBRs and renewables, the results' significance and potential research directions for
manifesting as second-order nonlinearity, was not future studies.
considered in [9-12].
II. SINDY ALGORITHM AND SUPPORTING
HAVOK is a decomposition technique approximating HAVOK DECOMPOSITION
chaotic dynamics as an intermittently forced linear system,
combining principles from delay embedding and Koopman A. Developed Method based on Generic SINDy Algorithm:
theory [14]. It leverages real-time data covariance analysis The dynamics of power system can be described by the
to uncover the underlying structures within high- following general form [15]:
dimensional data. The method employs time-delay
embeddings to capture latent variables and intrinsic 𝑑𝑣(𝑡)
= 𝑓(𝑣(𝑡)), (1)
measurement coordinates, rooted in the theory of Koopman 𝑑𝑡
This investigation explores a comprehensive set of an extra load is connected to Bus 14, disconnected at 𝑡 =
power system conditions, encompassing both abrupt 8𝑠.
changes (faults) and gradual changes (load variations), in
the context of conventional synchronous generators (SG) The simulation duration of 10 s and total sample count
and IBRs. The study encompasses three distinct scenarios, of 200,000 (20,000 sample per second) are determined to
representing both single- and multi-dynamic systems. The capture temporal dynamics faithfully. Furthermore, a
first scenario examines a system solely supplied by a polynomial library is constructed with a precise third order
synchronous generator at Bus 1 and Bus 3. The second polynomial and regularization parameter (0.8).
scenario incorporates the integration of an IBR at Bus 3,
sharing the load demand equally with the synchronous In multiscale dynamic conditions, the SINDy
generator at Bus 1. In the third scenario, the network is enhanced by HAVOK decomposition were applied. The
subjected to a 100% penetration of IBRs, where the demand essential parameters such as the number of samples per burst
is supplied by two IBRs located at Bus 1 and Bus 3. Each (1000 samples per burst), the optimal hard threshold value
scenario spans 10 seconds, with the synchronous generators 4
for singular values ( ) [18], and the sampling time interval
and IBRs initiated at 𝑡 = 0𝑠. At 𝑡 = 3.3𝑠, a three-phase-to- √3
(50 microseconds) play crucial roles in this process.
ground fault occurs at Bus 10, cleared after four cycles of
the fundamental frequency (60 Hz). Furthermore, at 𝑡 = 7𝑠,
B. Model Identification using Generic SINDY Continuing in this scenario, involving sudden and
gradual changes to system parameters in transient states, the
General Power System (SG driven): generic algorithm captures the system nonlinear dynamics
The results in the first scenario demonstrate SINDy's and tracks changes, while experiencing a minor fluctuation
accuracy in estimating the system model. For the steady- during these transitions, resulting in slight increases in
state dynamics of the power system supplied by SG, the approximation errors. However, the results shows that the
sparse model adeptly replicates the dynamics observed in generic algorithm swiftly recovers its accuracy once
measurements. As depicted in Figure 2.a, the reconstructed changes are detected, as evident in faults and load
waveform resulting from identified model closely aligns variations, shown in Figure 2.b and Figure 2.c, respectively.
with the actual data collected from the power network, all
presented per unit. Notably, the algorithm not only correctly Power System Integrated with IBRs:
identifies the terms governing the dynamics but also When IBRs were introduced into the power grid, the
accurately determines the associated coefficients, with performance of generic algorithm in model identification
deviations well within a remarkable 0.03%. deteriorated since it could not distinguish the multi-scale
nonlinear dynamics. The result obtain in this scenario
indicates that the algorithm’s errors experience a notable
increase.
Fig 2: The Actual Measurement and Generic Algorithm Approximation during a) Steady State, b) Fault and c) Load Change in
Power System Supplied by SG
Looking into the detail, by comparing the voltage of the approximated voltage from, shown with dash lines in
variations approximated through the generic algorithm and Figure 3, indicates the inclusion of harmonic distortions in
the actual measurement it is observed that the generic the final result, comparing to the voltage waveform
algorithm failed to distinguish the nonlinearity caused by approximated in previous scenario, i.e., first-order system.
fast dynamics, in coupled multi-scaled dynamics. As Furthermore, the phase, frequency and amplitudes of the
presented in Figure 3, the generic algorithm did not approximated voltages shows deviation from cycle to cycle.
recognize the fast dynamics in the voltage. Detailed analysis
Fig 3: The Actual Dynamic and Generic Algorithm Approximation during Steady State in Power System Supplied by SG and
IBRs.
The investigation continued by increase of the IBR of IBRs in power system led to a five-fold increase in errors
penetration to 100 % and the result, obtained from generic compared to scenarios with conventional SG, while
algorithm was subjected to the same analysis. After achieving a 100% penetration of IBRs resulted in
analyzing the voltage waveform approximated by generic approximately seven times higher errors, as illustrated in
algorithm in second and third scenario the error from actual Figure 4.
data was calculated. The findings indicate 50 % penetration
Fig 4: The Errors between Actual Dynamic and Generic Algorithm Approximation during Steady State and Transient in Power
System
The introduction of harmonic distortion and deviation C. Model Identification using Enhanced Mixed Algorithm
in voltage, frequency and phase by the generic algorithm in (Generic SINDy and HAVOK Decomposition):
power its approximation is due to inability of recognizing The second and third scenarios were repeated using the
the fast dynamics. The generic algorithm could not identify enhanced algorithm, using combination of generic SINDy
the second-order nonlinearity in the system, hence, translate and HAVOK decomposition. The voltage was
it into inaccurate level of first-order nonlinearity showing approximated using the mixed algorithm and has been
that the presence of IBRs in the power grid introduces compared to the actual data in both scenarios. Figure 5
complexities or dynamics not adequately captured by present the approximated voltage and the actual
generic algorithm. measurement for the voltage in the third scenario (100%
penetration of IBRs) for steady and transient states. The
errors calculated for the second and third scenarios were
1.14 and 1.79 times of the base error (1.14𝜖 and 1.79𝜖
where 𝜖 is the error captured in the first scenario).
Fig 5: The Actual Measurement and Mixed Algorithm Approximation during a) Steady State and b) Transient
State in Power System Supplied by IBR
The results demonstrate a notable enhancement in the Although the effectiveness of the algorithm is
approximation of the power system with second-order demonstrated with case studies using a small-scale IEEE
nonlinearity. The mixed algorithm was able to recognize the model, the benefits of integrating various data analytic tools
fast dynamic within the coupled multi-dynamic systems. are clearly shown from a broader perspective.
The enhanced algorithm was able to capture and follow the
dynamic in steady state, and transient state, shown in Figure Currently, we are collaborating with power and utility
5.a and Figure 5.b respectively. Note that the absence of companies to develop larger-scale models and obtain real
voltage fluctuations in the fault incident are due to the data from measurements to apply the mixed algorithm in
limitation of the IBRs in providing fault current, leading to building measurement-based tools for detecting nonlinear
fast and hardly recognizable impulses. This indicates that dynamics, such as sub-synchronous oscillations and
the combined method can characterize the complex resonance, as well as complex transient energy waves
interactions and dynamics present in the system. caused by inverter interactions.
This paper presents the concept and generic We express our profound appreciation to all those who
framework of a mixed algorithm that could be used for contributed directly or indirectly to the successful
measurement-based power system analysis. To address the completion of this research paper with their valuable time,
challenging impact of coupled multi-scale dynamics of insights, recommendations, and support.
IBRs on the complex nonlinear dynamics experienced in the
power grid, we integrate the HAVOK decomposition REFERENCES
method with the powerful SINDy analytics recently
developed in data science, along with a set of illustrative [1]. Deng, Zhuofu, Binbin Wang, Yanlu Xu, Tengteng
case studies in power system analysis. Xu, Chenxu Liu, and Zhiliang Zhu. "Multi-scale
convolutional neural network with time-cognition
The case studies not only demonstrate the for multi-step short-term load forecasting." IEEE
effectiveness of detecting various nonlinear dynamics in Access 7 (2019): 88058-88071.
power systems but also clearly demonstrate the promising [2]. Hong, Seng-Phil. "Different Numerical Techniques,
capability of the mixed algorithm to separate the nonlinear Modeling and Simulation in Solving Complex
dynamics induced by coupled IBRs from those caused by Problems." Journal of Machine and
synchronous machines. Computing (2023): 058-068.
[3]. Viberg, Mats. "Subspace-based methods for the
identification of linear time-invariant
systems." Automatica 31, no. 12 (1995): 1835-1851.
[4]. Caponetto, Riccardo. Fractional order systems: [16]. Champion, Kathleen P., Steven L. Brunton, and J.
modeling and control applications. Vol. 72. World Nathan Kutz. "Discovery of nonlinear multiscale
Scientific, 2010. systems: Sampling strategies and
[5]. Steele, Brenden, Reza SaeedKandezy, Peter Huang, embeddings." SIAM Journal on Applied Dynamical
and John N. Jiang. "Study on Impact of Modulational Systems 18, no. 1 (2019): 312-333.
Instability of Inverters on Electrical Energy [17]. Kaheman, Kadierdan, J. Nathan Kutz, and Steven L.
Systems." In 2022 IEEE Kansas Power and Energy Brunton. "SINDy-PI: a robust algorithm for parallel
Conference (KPEC), pp. 1-6. IEEE, 2022. implicit sparse identification of nonlinear
[6]. Geiser, Juergen. Multicomponent and Multiscale dynamics." Proceedings of the Royal Society A 476,
Systems. Springer International Publishing, 2016. no. 2242 (2020): 20200279.
[7]. Brunton, Steven L., Joshua L. Proctor, and J. Nathan [18]. Josse, Julie, and Sylvain Sardy. "Adaptive shrinkage
Kutz. "Discovering governing equations from data of singular values." Statistics and Computing 26
by sparse identification of nonlinear dynamical (2016): 715-724.
systems." Proceedings of the national academy of
sciences 113, no. 15 (2016): 3932-3937.
[8]. Fasel, Urban, Eurika Kaiser, J. Nathan Kutz, Bingni
W. Brunton, and Steven L. Brunton. "SINDy with
control: A tutorial." In 2021 60th IEEE Conference
on Decision and Control (CDC), pp. 16-21. IEEE,
2021.
[9]. Stanković, Alex M., Aleksandar A. Sarić, Andrija T.
Sarić, and Mark K. Transtrum. "Data-driven
symbolic regression for identification of nonlinear
dynamics in power systems." In 2020 IEEE Power &
Energy Society General Meeting (PESGM), pp. 1-5.
IEEE, 2020.
[10]. Lakshminarayana, Subhash, Saurav Sthapit, and
Carsten Maple. "Application of physics-informed
machine learning techniques for power grid
parameter estimation." Sustainability 14, no. 4
(2022): 2051.
[11]. Hamid, Asif, Danish Rafiq, Shahkar Ahmad Nahvi,
and Mohammad Abid Bazaz. "Power Grid parameter
estimation using Sparse Identification of Nonlinear
Dynamics." In 2022 International Conference on
Intelligent Controller and Computing for Smart
Power (ICICCSP),. IEEE, 2022.
[12]. Lakshminarayana, Subhash, Saurav Sthapit, and
Carsten Maple. "A Comparison of Data-Driven
Techniques for Power Grid Parameter
Estimation." arXiv preprint
arXiv:2107.03762 (2021).
[13]. Brunton, Steven L., and J. Nathan Kutz. "Methods
for data-driven multiscale model discovery for
materials." Journal of Physics: Materials 2, no. 4
(2019): 044002.
[14]. Fasel, Urban, Eurika Kaiser, J. Nathan Kutz, Bingni
W. Brunton, and Steven L. Brunton. "SINDy with
control: A tutorial." In 2021 60th IEEE Conference
on Decision and Control (CDC), pp. 16-21. IEEE,
2021.
[15]. Machowski, Jan, Zbigniew Lubosny, Janusz W.
Bialek, and James R. Bumby. Power system
dynamics: stability and control. John Wiley & Sons,
2020.