Distributed Optimization Using ALADIN For MPC in Smart Grids
Distributed Optimization Using ALADIN For MPC in Smart Grids
5, SEPTEMBER 2021
Abstract— This article presents a distributed optimization compensation of these fluctuations requires, in general, costly
algorithm tailored to solve optimization problems arising in control energy, one of the grid operator’s main objectives is
smart grids. In detail, we propose a variant of the aug- flattening the aggregated power demand [6], e.g., by using
mented Lagrangian-based alternating direction inexact Newton
(ALADIN) method, which comes along with global conver- energy storage devices on a household level [7]. In [8]–[10],
gence guarantees for the considered class of linear-quadratic it is investigated how batteries can be exploited for peak
optimization problems. We establish local quadratic conver- shaving. Moreover, in [11], batteries are used for dispatching
gence of the proposed scheme and elaborate its advantages photovoltaic power, while, in [12], thermal energy storages
compared with the alternating direction method of multipli- are considered. In practice, flexible coordination mechanisms
ers (ADMM). In particular, we show that, at the cost of
more communication, ALADIN requires fewer iterations to are required in order to efficiently manage such systems
achieve the desired accuracy. Furthermore, it is numerically despite the fact that the (local) battery dynamics are, in gen-
demonstrated that the number of iterations is independent of eral, unknown to the grid operator. Therefore, the associated
the number of subsystems. The effectiveness of the proposed optimization problems have to scale with the number of
scheme is illustrated by running both an ALADIN and an subsystems.
ADMM-based model predictive controller on a benchmark
case study. Typically, problems, as described earlier, are embedded
in a model predictive control (MPC) framework [7], [13],
Index Terms— Distributed optimization, model predictive con- where, at each time instant, one optimization problem has to
trol (MPC), smart grid.
be solved. This makes the design of efficient online solvers
I. I NTRODUCTION inevitable. For this purpose, distributed optimization meth-
ods have been developed to allow for parallelizable online
T HE rapid uptake of renewable energy sources requires
a fundamental transition of power networks from cen-
tralized to decentralized power generation [1], [2]. Herein,
calculations. A classical approach is based on dual decom-
position, where gradient-based first-order methods [14], [15]
locally distributed residential energy systems—equipped with are used to solve the concave dual problem. Alternatively,
loads, generators, and energy storage devices—play a major semismooth Newton methods [16] can be applied. However,
role in order to successfully master the required paradigm such Newton-type methods are, in general, only convergent
shift. However, their incorporation in the electricity grid entails if they are equipped with additional smoothing heuristics
the intermittent generation and bidirectional power flow and, and line-search routines. Compared with this, the alternating
thus, creates challenges for network power quality and stability direction method of multipliers (ADMM) has more favorable
[3], [4]. In particular, the volatile local energy generation convergence properties [17], [18]. Recently, many variants
results in peaks in the aggregated power demand profile, which of ADMM were proposed that exploit inherent hierarchical
can cause bottlenecks (even outages) or overload [5]. Since the structures. One drawback of ADMM, however, is its scale
dependence [19], which is typically tackled via heuristic
Manuscript received March 20, 2020; revised August 23, 2020; accepted pre-conditioners in order to accelerate convergence. Another
October 19, 2020. Date of publication November 4, 2020; date of current
version August 5, 2021. Manuscript received in final form October 20, 2020. way to construct a parallelizable online solver for MPC is
The work of Yuning Jiang and Boris Houska was supported by ShanghaiTech to use classical Newton-type methods originally proposed
University under Grant F-0203-14-012. The work of Philipp Sauerteig was for nonlinear programming, such as the interior point (IP)
supported by the German Federal Ministry for Education and Research
(BMBF) under Grant 05M18SIA. The work of Karl Worthmann was supported method [20], which can parallelize most of its operations.
in part by the German Federal Ministry for Education and Research (BMBF) Although these methods converge much faster than ADMM
under Grant 05M18SIA and in part by the German Research Founda- and have the potential of parallel implementation, a global
tion (DFG) under Grant WO 2056/6-1. Recommended by Associate Editor
J. H. Braslavsky. (Corresponding author: Yuning Jiang.) line-search routine is required to control the step size [21].
Yuning Jiang and Boris Houska are with the School of Information Science Recently, the augmented Lagrangian-based alternating direc-
and Technology, ShanghaiTech University, Shanghai 201210, China (e-mail: tion inexact Newton (ALADIN) method was proposed in [22].
[email protected]; [email protected]).
Philipp Sauerteig and Karl Worthmann are with the Institute for Mathe- Similar to ADMM, it requires the local agents to solve
matics, Technische Universität Ilmenau, 98693 Ilmenau, Germany (e-mail: small-scale decoupled problems and the central entity (CE)
[email protected]; [email protected]). to solve a consensus problem in each iteration. However,
Color versions of one or more of the figures in this article are available
online at https://ieeexplore.ieee.org. in contrast to ADMM, ALADIN solves a coupled quadratic
Digital Object Identifier 10.1109/TCST.2020.3033010 programming (QP) in the consensus step enabling locally
1063-6536 © 2020 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
JIANG et al.: DISTRIBUTED OPTIMIZATION USING ALADIN FOR MPC IN SMART GRIDS 2143
quadratic convergence if suitable Hessian approximations For a number p ≥ 1, the p-norm of x ∈ Rn is defined by
are used. n 1p
For the particular problem of minimizing variability in
x p = |x i | p
with x = x 1 · · · x n .
power demand, a distributed algorithm was proposed in [23].
i=1
As a follow-up, Braun et al. [24] further exploited the available
flexibility resulting from battery management and applied a Moreover, we use the notations
centralized consensus variant of ADMM to increase efficiency ½n = 1 · · · 1 ∈ Rn , 0n = 0 · · · 0 ∈ Rn
and privacy. Note that, in this context, distributed methods are
required not just for computational efficiency but even more and denote the unit matrix in Rn×n by In . For any integers
important for maintaining the privacy and enabling plug-and- ≤ m, we define [ : m] := {, + 1, . . . , m} ⊆ Z. The
play capability. In detail, the grid operator is not supposed to open ball with center x ∈ Rn and radius r is denoted by
know the battery dynamics of single households. However, Br (x) = {z ∈ Rn | z − x2 < r }. We call a function f :
due to its linear convergence [18], the proposed ADMM Rn → R ∪ {∞} strongly convex on a convex set ⊆ Rn with
variant requires many communication rounds between the grid positive parameter m > 0 if the inequality
operator and the residential energy systems to achieve the m
desired accuracy. To this end, Baumann et al. [25] proposed f (t x + (1−t)y) ≤ t f (x)+(1−t) f (y)− t(1−t)x − y22
2
to replace the expensive optimization routine with surrogate holds for all x, y ∈ and all t ∈ [0, 1]. The Kronecker
models. product of two matrices A ∈ Rm×n and B ∈ R p×q is defined
In this article, we propose a tailored algorithm based by
on ALADIN for solving the optimization problem proposed ⎡ ⎤
in [26], which aims at flattening the aggregated power demand a11 B · · · a1n B
⎢ ⎥
profile in distribution grids. Due to the local quadratic conver- A ⊗ B = ⎣ ... . . . ... ⎦ ∈ Rmp×nq .
gence of the proposed algorithm under the assumption that am1 B · · · amn B
the optimal solution is regular1 as established in Theorem 2,
the number of iterations and, thus, the total communication Finally, for given functions f, g : Rn → Rm we write
effort are reduced significantly. First, we reformulate the f (x) = O(g(x)) if there exists a constant c ∈ R such that
problem such that the objectives and inequality constraints are lim x→x0 g(x)
f (x)
≤ c. Throughout this paper, x 0 is depending on
decoupled, while only the affine equality constraints remain the context, either 0 or ∞.
intertwined. Then, the proposed algorithm, similar to the
standard ALADIN method [22], alternates solving local small- II. S YSTEM M ODEL AND P ROBLEM F ORMULATION
scale problems and solving a coupled QP. However, our In this section, we recall the dynamic model of residential
algorithm slacks the active local constraints in the coupled energy systems incorporating loads, energy generation, and
QP. Hence, the scale of the coupled QP is fixed. Moreover, storage devices [24]. Furthermore, we provide a mathematical
we establish global convergence by using an 1 -penalty and formulation of possible goals of both the local systems and the
provide guidelines on finding suitable tuning parameters. In grid operator, yielding an overall linear-quadratic optimization
addition, we numerically show that the required number problem.
of communication rounds is independent of the number of
subsystems—typically two are sufficient. Moreover, we design
an MPC scheme based on the proposed algorithm and illus- A. Residential Energy Systems
trate advantages compared with ADMM by applying it in a In this article, we consider a smart grid with I ∈ N
benchmark case study. residential energy systems, which are coupled via a CE,
The remainder is structured as follows. Section II recalls the grid operator (see Fig. 1). The latter has to compensate
the physical model of residential energy systems and a peak- for the need for and the surplus of energy. Note that we are
shaving problem based on optimal energy storage control. only interested in energy conservation on a residential level.
In Section III, we propose the variant of ALADIN tai- We do not incorporate the grid topology.
lored to the structured optimization problem and elaborate The battery dynamics of system i , i ∈ [1 : I], is given by
on the implementation in detail. Moreover, we establish
x i (n + 1) = αi x i (n) + T βi u + −
i (n) + u i (n) (1a)
local quadratic convergence and global convergence. Then,
ALADIN is embedded within an MPC scheme. Based on a z i (n) = wi (n) + u + −
i (n) + γi u i (n) (1b)
benchmark case study, the numerical results in Section IV
show that ALADIN is scalable and outperforms ADMM. with state of charge (SoC) x i (n) ∈ R of the battery in kWh,
Notations: We use (Sn+ ) Sn++ to denote the set of symmetric power demand z i (n) ∈ R in kW at time instant n ∈ N0 , and
positive (semi) definite matrices in Rn×n , n ∈ N. For a given sampling time T > 0 in h. The control inputs
∈ Sn++ and x ∈ Rn , the notation x2 = x x is used.
u i (n) = u + −
i (n) u i (n) ∈ R2
1 An
represent the charging/discharging rate in kW, while the net
optimal solution is called regular if the linear independence constraint
qualification (LICQ), strict complementarity conditions (SCCs), and the consumption wi (n) ∈ R in kW is load minus generation,
second-order sufficient conditions (SOSCs) are satisfied [27, p. 591]. i.e., power demand neglecting the battery. The constants
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
2144 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 29, NO. 5, SEPTEMBER 2021
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
JIANG et al.: DISTRIBUTED OPTIMIZATION USING ALADIN FOR MPC IN SMART GRIDS 2145
Remark 2: The Ai expression (7) shows that the affine 1) Parallelizable Step: The small-scale QPs
equality constraint (6b) satisfies the LICQ condition, 1
i.e., matrix min f i (v i ) − (Ai v i ) λ + v i − u i 2Q i
vi 2
−I N A1 · · · AI s.t. Di v i ≤ di | κi (8)
has full row rank. are solved in parallel for all i ∈ [1 : I]. Here, (u i , λ)
Throughout this article, we write the Lagrangian multiplier denotes the current primal and dual iterates of ALADIN for
right after the constraints such that the notation “|λ” denotes solving 6. If we denote the primal-dual solution of (8) by
the Lagrangian multipliers of constraint (6b). (v i , κi ), the first-order optimality condition of (8) is given by
Next, we state sufficient conditions for uniqueness of the
0 = ∇ f i (v i ) + Di κi − A
i λ + Q i (v i − u i ).
optimal solution of problem (6).
Proposition 1: Let σ0 > 0 and Problem (6) be feasible. Hence, the modified gradient gi = ∇u i { f i (v i ) + κi Di v i } can
Then, the optimal power demand z̄ ∗ and corresponding dual be evaluated by
λ∗ are unique. If, in addition, σi > 0 for all i ∈ [1 : I], then
the optimal control u ∗ of (6) is also unique. gi = A
i λ + Q i (u i − v i ) (9)
Proof: First,
let σ0 > 0. Due to the compactness of the in a derivative-free manner. As discussed in [22], this paral-
feasible set u i ∈ R2N Di u i ≤ di of the i th system, the set
lelizable step exploits the distributed structure of (6) by using
z̄ = w + I A u dual decomposition and augmented Lagrangian.
N i=1 i i
Z = z̄ ∈ R 2) Consensus Step: The following equality constrained QP
Di u i ≤ di , i ∈ [i : I]
is solved
is compact (see [28]). Since f 0 is strongly convex, the optimal + + +
output z̄ ∗ corresponding to (6) and, hence, the dual λ∗ are z̄ , u , s
unique. This proves the first assertion. Now, let σi > 0 for all := arg min f 0 (z̄) (10a)
i ∈ [0 : I]. Then, problem (6) is a strongly convex quadratic z̄,u,s
I
program. Furthermore, the constraint Jacobian of (6b) has 1 μi
full row rank, indicating that the LICQ is satisfied. Hence, + u i − v i 2Q i + u
i gi + si 22
2 2
the optimal solution (z̄ ∗ , u ∗ , λ∗ ) is unique [29]. i=1
I
s.t. z̄ = w + Ai u i | λ+ (10b)
From now on, we assume that σi > 0 for all i ∈ [1 : I],
i=1
which implies that the matrices Q i are invertible. Solving
problem (6) by using a centralized method assumes the exis- Diact (u i − v i ) = si | κiQP , i ∈ [1 : I] (10c)
tence of an all-knowing entity, i.e., the grid operator knows the where matrix Diact denotes the active Jacobian matrix at the
dynamical model of each household and its predicted load and local solution v i , i.e., Diact v i = diact for all i ∈ [1 : I]. The
generation. This is impractical in the case of several thousand solution (u + , λ+ ) of (10) is used to update the primal and dual
households. Motivated by this, distributed or parallelizable iterates. The value of the slackness parameters μi reflects how
methods [23], [24], [26] have been developed to solve (6). much system i trusts the local active constraints. Later on, it is
However, as discussed in Section I, existing methods either shown that updating μi helps to improve the local convergence
have a slow convergence or require a global line-search rate.
routine, which needs many undesired communication rounds Remark 3: Compared with the standard ALADIN [22],
between the grid operator and the residential energy sys- the consensus QP (10) relaxes the decoupled equality con-
tems. In Section III, we propose a line-search-free distributed straints but not the coupled affine constraints. If we denote
method with fast local convergence to reduce the number of scaling matrices
communication rounds significantly.
Hi = Q i + μi Diact Diact , i ∈ [1 : I] (11)
III. ALADIN FOR S MART G RIDS
QP (10) can be rewritten in the form
In this section, we propose a variant of the ALADIN I
algorithm to solve (6) in a distributed manner. Furthermore, 1
min f0 (z̄) + u i − v i Hi + u i gi
2
(12a)
we establish both global convergence and locally quadratic z̄,u 2
i=1
convergence for the proposed algorithm and show how it can I
be embedded efficiently in an MPC scheme. s.t. z̄ = w + Ai u i | λ. (12b)
i=1
A. Distributed Optimization with ALADIN The advantage is that the scale of QP (12) is fixed, i.e.,
This section presents a variant of the ALADIN method to the number of constraints is fixed and does not depend on
solve (6). Similar to the standard ALADIN method proposed the number of active constraints. However, in contrast to the
in [22], there are two main steps: a parallelizable step and a ADMM variant proposed in [24], the consensus QP (12) is still
consensus step. large scale due to its dependence on the number of systems.
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
2146 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 29, NO. 5, SEPTEMBER 2021
Moreover, as discussed in Remark 2, constraint (12b) Algorithm 1 Tailored ALADIN Method for Solving (6)
satisfies the LICQ such that QP (12) is always feasible
independently of the feasibility of (6). Note that as the sum
of a positive definite and a positive semidefinite matrix, Hi is
positive definite.
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
JIANG et al.: DISTRIBUTED OPTIMIZATION USING ALADIN FOR MPC IN SMART GRIDS 2147
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
2148 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 29, NO. 5, SEPTEMBER 2021
which concludes the proof with η = (α/2)(T1 2 + T2 2 ). Algorithm 2 ALADIN-Based Distributed MPC Scheme
This proposition establishes the local quadratic convergence
rate of the iterates v while implying that the local convergence
progress benefits from the μ update.
Remark 6: If the iterates (v )∈N converge locally with
quadratic rate, as discussed in Proposition 2, the descent
condition (21) always holds in a neighborhood of a regular
minimizer [27]. Hence, μi is updated in every step. In Algo-
rithm 1, the μi update is based on (16) ensuring that (22)
holds locally.
Concerning the global convergence analysis, we introduce
an auxiliary function L : R2I N × R N → R
I
L(u, λ) = λ − λ∗ 20 + u i − u ∗i 2Q i
i=1
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
JIANG et al.: DISTRIBUTED OPTIMIZATION USING ALADIN FOR MPC IN SMART GRIDS 2149
TABLE I TABLE II
C ONVERGENCE AND C OMMUNICATION C OMPARISON PARAMETER VALUES
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
2150 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 29, NO. 5, SEPTEMBER 2021
TABLE III
N UMBER OF I TERATIONS FOR D IFFERENT M ETHODS
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
JIANG et al.: DISTRIBUTED OPTIMIZATION USING ALADIN FOR MPC IN SMART GRIDS 2151
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.
2152 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 29, NO. 5, SEPTEMBER 2021
[30] B. Houska, H. J. Ferreau, and M. Diehl, “ACADO toolkit—An open- Boris Houska received the Diploma degree in math-
source framework for automatic control and dynamic optimization,” ematics from the University of Heidelberg, Hei-
Optim. Control Appl. Methods, vol. 32, no. 3, pp. 298–312, May 2011. delberg, Germany, in 2007, and the Ph.D. degree
[31] Y. Jiang, J. Oravec, B. Houska, and M. Kvasnica, “Parallel MPC for in electrical engineering from KU Leuven, Leuven,
linear systems with input constraints,” IEEE Trans. Autom. Control, p. 1, Belgium, in 2011.
2020, doi: 10.1109/TAC.2020.3020827. From 2012 to 2013, he was a Post-Doctoral
[32] E. L. Ratnam, S. R. Weller, C. M. Kellett, and A. T. Murray, “Residential Researcher with the Centre for Process Systems
load and rooftop PV generation: An australian distribution network Engineering, Imperial College London, London,
dataset,” Int. J. Sustain. Energy, vol. 36, no. 8, pp. 787–806, Sep. 2017. U.K. From 2013 to 2014, he was a Research Fac-
[33] A. Bestler and K. Graichen, “Distributed model predictive control ulty Member with Shanghai Jiao Tong University,
for continuous-time nonlinear systems based on suboptimal ADMM,” Shanghai, China. He has held visiting professor
Optim. Control Appl. Methods, vol. 40, no. 1, pp. 1–23, Jan. 2019. positions at the Freiburg Institute for Advanced Studies, Freiburg im Breisgau,
Germany, and the Institute for Microsystems Engineering, and University of
Freiburg, Freiburg im Breisgau, in 2014, and various shorter academic visiting
appointments, for example, at the University of California at Berkeley (UC
Berkeley), Berkeley, CA, USA, in winter 2017, and Imperial College London
Yuning Jiang (Member, IEEE) received the B.Sc. in summer 2018. He is currently an Associate Professor with the School of
degree in electrical engineering from Shandong Uni- Information Science and Technology, ShanghaiTech University, Shanghai. His
versity, Jinan, China, in 2014, and the Ph.D. degree research interests include numerical optimization and optimal control, robust
in information engineering from ShanghaiTech Uni- and global optimization, and fast model predictive control algorithms.
versity, Shanghai, China, and the University of Chi-
nese Academy of Sciences, Beijing, China, in 2020.
He has ever been a Visiting Scholar with the
University of California at Berkeley (UC Berkeley),
Berkeley, CA, USA, the University of Freiburg,
Freiburg im Breisgau, Germany, and Technische
Universität Ilmenau (TU Ilmenau), Ilmenau, Ger-
many, during his Ph.D. study. He is currently a Post-Doctoral Researcher with
the Laboratoire d’Automatique, École Polytechnique Fédérale de Lausanne
(EPFL), Lausanne, Switzerland. His research interests include distributed
optimization and model predictive control, particularly for power and energy
systems, intelligent transportation, stochastic control, and fast model predictive
control (MPC) algorithms. Karl Worthmann received the Diploma and Ph.D.
degrees in mathematics from the University of
Bayreuth, Bayreuth, Germany, in 2006 and 2012,
respectively.
In 2014, he was appointed as an Assistant Pro-
Philipp Sauerteig received the B.Sc. and M.Sc. fessor of differential equations at Technische Uni-
degrees in mathematics from Technische Universität versität Ilmenau, Ilmenau, Germany, where he was
Ilmenau, Ilmenau, Germany, in 2016 and 2017, promoted to Full Professor in 2019 after receiving
respectively, where he is currently pursuing the the Heisenberg-professorship “Optimization-based
Ph.D. degree with the Chair for Optimization-Based Control” by the German Research Foundation. His
Control. current research interests include control theory with
In 2019, he was with the School of Informa- a particular focus on nonlinear model predictive control, stability analysis, and
tion Science and Technology (SIST), ShanghaiTech sampled-data systems.
University, Shanghai, China, for a research stay. Dr. Worthmann has been appointed as a Junior Fellow of the Society of
He currently works as a Research Assistant at his Applied Mathematics and Mechanics (GAMM) in 2013, where he served
alma mater on distributed optimization and control as a speaker from 2014 to 2015. He was a recipient of the Ph.D. Award
of microgrids within the project “CONSENS: Consistent Optimization and from the City of Bayreuth and the stipend of the German National Academic
Stabilization of Electrical Networked Systems” funded by the Federal Ministry Foundation. In 2016, he received the Best Paper Award “Mathematics and
of Education and Research. His interests are distributed optimization, model Natural Sciences” of Technische Universität Ilmenau. He is also the Chairman
predictive control, multiobjective optimization, and surrogate models, such as “Mathematical Systems Theory” of the Interdisciplinary GAMM Activity
artificial neural networks. Group “Dynamics and Control.”
Authorized licensed use limited to: Universidad de Concepcion. Downloaded on September 12,2021 at 19:46:13 UTC from IEEE Xplore. Restrictions apply.