Optimal Control F1
Optimal Control F1
To cite this article: D.J.N. Limebeer, G. Perantoni & A.V. Rao (2014) Optimal control of Formula One car energy recovery
systems, International Journal of Control, 87:10, 2065-2080, DOI: 10.1080/00207179.2014.900705
Taylor & Francis makes every effort to ensure the accuracy of all the information (the “Content”) contained
in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no
representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the
Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and
are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and
should be independently verified with primary sources of information. Taylor and Francis shall not be liable for
any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever
or howsoever caused arising directly or indirectly in connection with, in relation to or arising out of the use of
the Content.
This article may be used for research, teaching, and private study purposes. Any substantial or systematic
reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any
form to anyone is expressly forbidden. Terms & Conditions of access and use can be found at http://
www.tandfonline.com/page/terms-and-conditions
International Journal of Control, 2014
Vol. 87, No. 10, 2065–2080, http://dx.doi.org/10.1080/00207179.2014.900705
The utility of orthogonal collocation methods in the solution of optimal control problems relating to Formula One racing
is demonstrated. These methods can be used to optimise driver controls such as the steering, braking and throttle usage,
and to optimise vehicle parameters such as the aerodynamic down force and mass distributions. Of particular interest is the
optimal usage of energy recovery systems (ERSs). Contemporary kinetic energy recovery systems are studied and compared
with future hybrid kinetic and thermal/heat ERSs known as ERS-K and ERS-H, respectively. It is demonstrated that these
systems, when properly controlled, can produce contemporary lap time using approximately two-thirds of the fuel required
Downloaded by [Selcuk Universitesi] at 04:51 16 January 2015
∗
Corresponding author. Email: [email protected]
C 2014 Taylor & Francis
2066 D.J.N. Limebeer et al.
Formula One cars will have to recover thermal as well as tation of a chassis with longitudinal, lateral and yaw free-
kinetic energy that would otherwise be lost (Fédération In- doms. We will use the tyre description given in Kelly (2008)
ternationale de l’Automobile, 2013). The hope is that the in combination with an upgraded aerodynamic model. The
introduction of hybrid thermal and kinetic energy recovery important geometric modelling quantities are shown in plan
systems will produce gains that are far more significant and view in Figure 1.
cost-effective than further engine development alone. The
results of this paper show that contemporary lap times can
be maintained using less powerful turbo-charged engines, 2.1 Track model
which require only two-thirds of the fuel required by con-
We will model the track using a curvilinear coordinate sys-
temporary cars, when thermal and kinetic energy recovery
tem that follows the vehicle using the track centre-line po-
systems are employed.
sition as the curvilinear abscissa (Cossalter et al., 1999).
The vehicle and track models are covered in Section 2.
Referring to Figure 2, we describe the location of the
Most of this material is standard, or has appeared else-
mass centre of the vehicle in terms of the curvilinear ab-
where, and so this treatment is correspondingly brief. The
scissa s(t) and the vector n(s(t)). The former quantity de-
tyre modelling is covered in Appendix 1 with the vehicle
fines the distance travelled along the track centre line, while
parameters given in Appendix 2. Section 3 briefly reviews
the latter gives the position of the vehicle’s mass centre in
the mathematical background underpinning orthogonal col-
a direction perpendicular to the track centre-line tangent
location transcription techniques. The key is the classical
theory of orthogonal polynomials, which underpins most
numerical integration schemes – particularly integration
quadratures. The results appear in Section 4. The perfor-
mance of the nominal car is studied first, with this prelimi-
nary investigation used as a vehicle for illustrating the use
and features of adaptive pseudo-spectral optimisation tech-
niques. The main results of the paper relate to the optimal
control of energy storage systems in Formula One racing.
We begin with the optimal control of contemporary KERS,
which is then followed by an investigation of the hybrid
kinetic and thermal energy recovery systems to be intro-
duced in the 2014 racing season. The conclusions appear in
Section 5, followed by the Acknowledgements section.
u cos ξ − v sin ξ Figure 3. Tyre force system. The inertial reference frame is
ṡ = , (1) shown as nx and ny .
1 − nC
Downloaded by [Selcuk Universitesi] at 04:51 16 January 2015
in which u and v are the longitudinal and lateral components from Equation (3); ω = ψ̇ is the vehicle yaw rate.
of the car’s velocity, respectively. The rate of change of n is
given by
2.2 Car model
ṅ = u sin ξ + v cos ξ. (2) Each tyre produces longitudinal and lateral forces that are
responsive to the tyres’ slip (see Appendix 1). These forces
Differentiating ψ = ξ + θ with respect to time results in together with the steer and yaw angle definitions are given
in Figure 3.
ξ̇ = ψ̇ − C ṡ. (3) Balancing forces in the longitudinal and lateral direc-
tions, while also balancing the yaw moments, gives
2.5.1 Brakes
We approximate equal brake calliper pressures with equal
braking torques when neither wheel on a particular axle is
locked. If a wheel ‘locks up’, the braking torque applied
to the locked wheel may be lower than that applied to the
rolling wheel. For the front wheels this constraint is mod-
Figure 4. Car aerodynamic maps. The drag coefficient CD is
the solid (blue) curve, which is a function of speed (in m/s). The elled as follows:
Downloaded by [Selcuk Universitesi] at 04:51 16 January 2015
collocation based on the roots of the derivatives of Jacobi 3.2 Grid refinement
polynomials. The Legendre nodes can be obtained as a par- The numerical solution of an optimal control problem in-
ticular case of this more general formulation. We do not volves three steps: (1) the transcription of the optimal con-
propose to review this literature, but the interested reader trol problem into a nonlinear programming problem (NLP);
will find much of this work described in Patterson and Rao (2) the solution of the (sparse) NLP; and (3) a review of the
(2012) and Garg, Hager, and Rao (2011). The work pre- accuracy of the solution and, if necessary, a refinement of
sented in this paper makes use of a Radau pseudo-spectral the mesh followed by a repeat of steps (1)–(3).
method (Garg et al., 2010, 2011) that has been implemented The accuracy and efficiency of this process can be in-
in the software package GPOPS-II (Patterson & Rao, 2013). fluenced by many things including the transcription pro-
The reader may also like to consult Betts (1998, 2001). cess itself. Factors favouring the use of simple low-order
integration schemes such as the trapezoidal rule include
sparse Jacobian matrices, sparse Hessians and fewer right-
3.1 Optimal control
hand side evaluations (when finite differencing is used to
The purpose of an optimal control computation is to de- compute derivatives) as compared with more complex inte-
termine the state and control associated with a system in gration schemes. Set against these advantages are the fact
order to minimise a performance index. When expressed in that these simple integration schemes have relatively poor
Bolza form, the performance index is given by accuracy and so a finer grid is needed, thereby inflating the
Downloaded by [Selcuk Universitesi] at 04:51 16 January 2015
tf − t 0 tf + t0
t= τ+ . (28)
2 2
4. Results
This mapping can be used with any free finite initial and We begin with a brief study of the nominal vehicle per-
terminal times. formance with a view to introducing some of the technical
Direct methods of the type employed here transcribe, features of orthogonal collocation methods with adaptive
or convert, infinite-dimensional optimal control problems grid refinement (Darby et al., 2011; Patterson et al., 2014).
into finite-dimensional optimisation problems with alge- These preliminary results are also used to reconcile the re-
braic constraints. sults obtained with orthogonal collocation methods with
International Journal of Control 2071
in propelling the car. Referring to Figure 9, the reader will values of s to race distance, and the per-lap ES discharge
appreciate that a vehicle without KERS can operate only limit 0 ≤ lap H (Pkers )Pkers ds ≤ 400 kJ required in the reg-
max
along the horizontal axis as far to the right as PIC ; the en- ulations
(Fédération Internationale de l’Automobile, 2012);
gine’s peak power limit. The left-hand limit will be dictated lap (·)ds are line integrals carried out around a lap of the
by the braking capacity of the tyres. With the introduction circuit.
of KERS, the vehicle can operate within the cross-hatched The minimum-lap-time optimal control problem was
region; the KERS power limits are Pkersmax
= ±60 kW, while solved using GPOPS-II with an optimal lap time of 80.23
the energy released from the ES may not exceed 400 kJ s achieved. This is 0.27 s faster than the lap time achieved
in any one lap. In order to enforce these restrictions, the without the KERS. The KERS power usage is shown in
Figure 9. Operating regime of the 2013 KERS. The ordinate represents the KERS power flow Pkers , while the abscissa represents the
power Pm delivered to the rear wheels.
International Journal of Control 2073
curve is the vehicle speed divided by 100 m/s, the (red) curve
while the solid (red) curve is the power delivered to/from the
is the ES’s state of charge, while the (green) curve is the energy
KERS ES (right-hand axis in W).
transferred from the ES to the KERS divided by 400 KJ for a
racing lap.
Figure 10, while the energy usage is illustrated in Figure 11.
It is clear from Figure 10 that the KERS operates against
the allowable power limits using a bang-bang (switching) (3) Turbo-compounded engines (Mamat, Romagnoli,
strategy,3 with maximum power drawn from the KERS on & Martinez-Botas, 2012) have been introduced
fast portions of the track. Figure 10 shows that the KERS that include a turbine, a compressor and a
is being deployed between turns and ➀, through turn motor-generator on a common drive shaft; this
➅ and between turns ➈ and ➉. During periods of rapid motor-generator is referred to as the motor-
deceleration, the KERS is recharged, which is evident on the generator-unit-heat (MGU-H). The turbine is by-
entry to most corners. Bang-bang behaviour is not always passed by a controllable waste gate; closing the
possible during recharging, because the KERS regeneration waste gate will increase the power generated by the
power cannot exceed the braking power available. MGU-H, but decrease the power generated by the
Figure 11 shows the vehicle speed, the state of charge engine. There is no limit on the amount of energy
of the KERS4 and the energy transferred from the ES to than can be recovered from the exhaust gases. The
the KERS drive motor as a function of track position. The operation of the thermal energy recovery system
optimal strategy is to maximise the stored energy on the is summarised in Figure 12, which shows a plot
entry to turn in preparation for a period of prolonged of power from the internal combustion (IC) engine
KERS usage out of turn . The KERS is heavily utilised, PIC versus power supplied by the MGU-H; denoted
although its full-energy storage capacity is not required. Ph . When the waste gate is open, the MGU-H re-
The KERS per-lap discharge limit is an active constraint quires 60 kW to operate the compressor and the IC
which is met at the start–finish line; this constraint restricts engine output power is boosted by 20 kW. When
the KERS power usage to the three full-power pulses shown the waste gate is closed, 40 kW is recovered from
in Figure 10. the MGU-H and the IC engine output power drops
to approximately 440 kW. All the figures given here
are representative values only.
4.2.2 Kinetic and thermal energy recoveries
(4) A motor-generator-unit-kinetic (MGU-K) is cou-
The energy recovery rules for 2014 are more complex than pled directly to the engine crankshaft. As before,
those used previously, with the optimal control problem the MGU-K can be used to recover vehicular ki-
correspondingly more intricate. The key differences are the netic energy during braking, or boost the power to
following: the rear wheels during periods of firm acceleration.
(5) The car’s ES can store up to 4 MJ.
(1) The car is restricted to a maximum 100 kg of fuel (6) The ES can accept up to 2 MJ per lap from the
per race. MGU-K.
(2) The fuel mass flow rate must not exceed 0.028 kg/s (7) The MGU-K can draw up to 4 MJ per lap from the
(or 100 kg/hour); ES.
2074 D.J.N. Limebeer et al.
Figure 12. Operating regime of the 2014 engine and thermal energy recovery system (ERS) at full power; power absorbed by the MGU-H
is deemed positive.
Downloaded by [Selcuk Universitesi] at 04:51 16 January 2015
(8) The power flows to and from the MGU-K is re- In order to monitor the resource constraints associated
stricted to ±120 kW. with the fuel usage, and the ES and MGU-K usage, four
(9) The power flow to and from the MGU-H is un- auxiliary state variables are introduced as follows:
restricted; see Appendix 3 in Fédération Interna-
tionale de l’Automobile (2013).
F = Ḟ ds. (32)
lap
It is clear that operating the engine with an open waste
gate is very inefficient from an energy conservation point
of view. The engine controls are the fuel-flow rate and the This state is used to monitor the fuel consumption and is
waste gate opening. It is assumed that the engine full-speed constrained by 0 ≤ F ≤ 100/nl kg, in which nl is the number
rotational losses are 40 kW. of laps in the race. As pointed out in point (2) , Ḟ , when
We will now explain how these various constraints were normalised, is constrained to the interval [0, 1]. The second
set up in the optimal control calculation. The power avail- auxiliary state is given by
able to the rear wheels, Pm , is constrained by the following
inequality: Ės = − (Ph + Pk ) . (33)
Figure 15. Energy usage for a 2014 ERS qualifying lap. The Figure 16. Normalised power usage for the 2014 ERS in qual-
(cyan) plot is the vehicle speed divided by 100 m/s; the (red) line ifying. The (blue) plot is the mechanical power delivered to be
Downloaded by [Selcuk Universitesi] at 04:51 16 January 2015
is the ES state of charge; the (blue) line is the energy transferred rear wheels divided by 440 kW; the (green) plot is normalised
from MGUK to ES divided by 2 MJ; the (magenta) line is the fuel usage rate (‘1’ corresponds to the maximum allowed rate);
energy transferred from ES to MGUK divided by 4 MJ. the (red) plot is KERS power divided by 120 kW; the (magenta)
plot is the waste gate position (0-closed, 1-open).
Figure 17 shows a speed comparison between a qual- 3. Optimal control problems with costs and dynamics that are
ifying lap, a racing lap with 100 kg of fuel and a racing linear in the control usually involve switching strategies. In
lap with only 75 kg of fuel (with a lap time of 85.23 s). these problems, the control takes on limit values dictated
by a switching function that is derivable from the minimum
The energy management strategy used in the 75 kg case is principle; this is the well-known bang-bang principle. In the
broadly the same as that employed in the 100 kg case. All case that the switching function is zero for a finite time, the
the fuel is used, the 2-MJ MGU-K generation quota is fully problem has a singular arc and a bang-singular-bang strategy
utilised, while the MGU-K motoring quota is only partially results (see Kirk, 1970, p. 246).
employed; only 0.8 MJ of the energy storage capacity is re- 4. This is defined as a number between 0 and 1; with 0 repre-
senting a completely discharged and 1 a fully charged ES.
quired. The higher straight line speed for the qualifying lap
over the racing lap is clearly evident. The need to ‘lift off ’
the throttle into turns ➀, ➃ and ➉, thus conserving fuel, is
References
evident from the speed profile in the 75 kg of fuel case.
Åkesson, J., Årzén, K.E., Gäfvert, M., Bergdahl, T., &
Tummescheit, H. (2010). Modeling and optimization with
optimica and jmodelica.org-languages and tools for solving
5. Conclusion large-scale dynamic optimization problems. Computers and
The use of pseudo-spectral methods for vehicular optimal Chemical Engineering, 34, 1737–1749.
control problems has been increasing since the early 1980s. Betts, J.T. (1998). Survey of numerical methods for trajectory
While the majority of these applications relate to aerospace optimization. Journal of Guidance, Control and Dynamics,
Downloaded by [Selcuk Universitesi] at 04:51 16 January 2015
21(2), 193–207.
problems, we have demonstrated that they are also well Betts, J.T. (2001). Practical methods for optimal control and esti-
suited to ground-vehicle-related optimisation problems. mation using nonlinear programming (2nd ed. ). Philadelphia,
The results in this paper focus on the control of ERSs in PA: SIAM.
Formula One racing cars, where the emphasis is on minimis- Brayshaw, D.L., & Harrison, M.F. (2005). A quasi steady state ap-
ing the lap time. This minimum-time type of performance proach to race car lap simulation in order to understand the ef-
fects of racing line and centre of gravity location. Proceedings
index leads to the use of a bang-bang strategy during KERS- of the IMechE Part D: Journal of Automobile Engineering,
assisted and ERS-assisted driving. A strategy reminiscent 219, 725–739.
of bang-bang control is also employed during braking, al- Casanova, D. (2000). On minimum time vehicle manoeuvring: The
though regenerative braking is limited by the braking power theoretical optimal lap (PhD thesis). Bedfordshire: School of
available making the limits for the KERS bang-bang control Engineering, Cranfield University.
Cossalter, V., Lio, M.D., Lot, R., & Fabbri, L. (1999). A general
variable. Following the analysis of contemporary KERS, we method for the evaluation of vehicle manoeuvrability with
analysed the control issues relating to the 2014 ERS that has special emphasis on motorcycles. Vehicle System Dynamics,
both kinetic and thermal energy recovery features. Unlike 31, 113–135.
the conventional KERS, the upcoming ERS has an explicit Darby, C.L., Hager, W.W., & Rao, A.V. (2011). An hp-adaptive
fuel-saving role. It is demonstrated that the ERS in com- pseudospectral method for solving optimal control problems.
Optimal Control Applications and Methods, 32, 476–502.
bination with a lower powered turbo-boosted engines can Dooren, R.V., & Vlassenbroeck, J. (1980). A new look at the
provide contemporary levels of lap-time performance with brachistochrone problem. Journal of Applied Mathematics
approximately 100 kg (rather than the current 150 kg) of and Physics, 31, 785–790.
fuel per race. It is also shown that the IC engine and the Fédération Internationale de l’Automobile. (2012, September
ERS have to be operated in a very different manner during 25). 2013 formula one technical regulations (Tech. Report).
Retrieved from FIA: http://argent.fia.com/web/fia-public.nsf/
qualifying, when the short-term, but profligate use of stored 7EE7D5392A94A532C1257A850051A2C9/$FILE/2013%
electrical energy, is allowed. The potential for redeploying 20TECHNICAL%20REGULATIONS.pdf
these technologies in everyday road cars is self-evident. Fu- Fédération Internationale de l’Automobile. (2013, January 23).
ture work is expected to include a three-dimensional track, 2014 Formula One technical regulations (Tech. Report).
more complicated (and realistic) aerodynamic maps and a Retrieved from FIA: http://www.fia.com/sites/default/files/
regulation/file/1-2014%20TECHNICAL%20REGULATIONS
suspension system. %202014-01-23 0.pdf
Garg, D., Hager, W.W., & Rao, A.V. (2011). Pseudospectral meth-
ods for solving infinite-horizon optimal control problems. Au-
Acknowledgements tomatica, 47(4), 829–837.
This work was supported by the UK Engineering and Physical Garg, D., Patterson, M.A., Darby, C.L., Françolin, C., Huntington,
Sciences Research Council. G.T., Hager, W.W., & Rao, A.V. (2011). Direct trajectory opti-
mization and costate estimation of finite-horizon and infinite-
horizon optimal control problems using a Radau pseudospec-
Notes tral method. Computational Optimization and Applications,
1. Rn denotes the set of n-dimensional real vectors. 49(2), 335–358.
2. H( · ) = 0 when the argument is nonpositive, with H( · ) = 1, Garg, D., Patterson, M.A., Hager, W.W., Rao, A.V., Benson, A.V.,
otherwise. The Heaviside step function is not differentiable at & Huntington, G.T. (2010). A unified framework for the
the origin and so is√
approximated by a smooth function such numerical solution of optimal control problems using pseu-
as H (x) ≈ (1 + x/ x 2 + )/2 in which is ‘small’. dospectral methods. Automatica, 46(11), 1843–1851.
2078 D.J.N. Limebeer et al.
Figure A1. Longitudinal tyre force versus longitudinal slip; Fx is given in kN. The left-hand diagram considers five normal loads
(at α = 0◦ ); the lightest curve corresponds to 1000 N with the normal load then increased in steps of 1000 N. The right-hand diagram
considers combined slip for five values of side-slip angle at a normal load of 2000 N; the darkest curve corresponds to a slip angle of 0◦
with the slip angle increased in steps of 5◦ .
2.3.2. The four-wheel slip angles are given by sin δ(ψ̇wf − u) + cos δ(ψ̇a + v)
αf r = arctan ,
cos δ(u − ψ̇wf ) + sin δ(ψ̇a + v)
v − ψ̇b cos δ(ψ̇a + v) − sin δ(ψ̇wf + u)
αrr = arctan , αf l = arctan ,
u − ψ̇wr cos δ(ψ̇wf + u) + sin δ(ψ̇a + v)
(51)
v − ψ̇b
αrl = arctan ,
u + ψ̇wr
Figure A2. Modulus of the tyre force as function of the longitudinal slip κ and the slip angle α (in degrees) for a normal load of 2000
N. The right-hand diagram shows contours of equal tyre force.
2080 D.J.N. Limebeer et al.
with the longitudinal slip coefficients given by load is increased. The main reason for introducing aerodynamic
down-force generating systems in Formula One cars is to exploit
this effect. The right-hand part of Figure A1 shows how the lon-
Rωrr
κrr = − 1 + , gitudinal force is compromised when the tyre is side slipping. As
u − ψ̇wr the side-slip angle increases, the longitudinal peak force reduces
Rωrl and moves towards higher slip values.
κrl = − 1 + , The normal-load-dependent inverted witch’s hat in Figure A2
u + ψ̇wr
gives a three-dimensional representation of the combined slip
Rωf r characteristics of the tyre model at a fixed normal load of 2000 N.
κf r = − 1 + ,
cos δ(u − ψ̇wf ) + sin δ(ψ̇a + v) The tyre’s pure slip characteristics are obtained by taking vertical
cuts through the lines α = 0 and κ = 0.
Rωf l
κf l = − 1 + . (52)
cos δ(u + ψ̇wf ) + sin δ(ψ̇a + v)
Appendix 2. Vehicle and tyre data
The left-hand part of Figure A1 shows the load dependence This appendix contains nominal values for the tyre and vehicle
of the longitudinal tyre force under pure longitudinal slip con- parameters used in this study. The air density is assumed to be
ditions; larger longitudinal forces are available when the normal ρ = 1.2 kg/m3 , while the car’s frontal area is A = 1.5 m2 .
Note: The values marked with an asterisk relate to the 2014 car.