A Proximal Algorithm For Joint Resource Allocation and Minimizing Carbon Footprint in Geo-Distributed Fog Computing
A Proximal Algorithm For Joint Resource Allocation and Minimizing Carbon Footprint in Geo-Distributed Fog Computing
I. I NTRODUCTION
(PEHGGHG6\VWHPV
Recently, Cisco has introduced Fog computing as a new DQG6HQVRUV
325
TABLE I
C ARBON DIOXIDE EMISSION PER KILOWATT- HOUR FOR THE MOST
'DWD COMMON FUEL TYPES
326
where the constraint is the capacity constraint at data center. where f : ℜn → ℜ ∪ {+∞} is a closed proper convex function,
If Problem (5) is small then it would be easy to solve. k is the iteration counter, and xk denotes the kth iteration of
However, in Fog, Problem (5) is an extremely large-scale the algorithm. The proximal operator proxλ f : ℜn → ℜn of f
optimization problem. For example, Akamai is the largest is defined by
content delivery network in the world. It delivers 15 − 20
1
percent of worldwide Internet traffic and it has more than k
proxλ f (x ) = arg min f (x) + k 2
� x − x �2 , (9)
95, 000 servers in 1, 900 networks across 71 countries [28]. x 2λ
Then, the number of variables xn is Θ(104 ). We need to update
where � · �22 is the usual Euclidean norm.
the resource allocation decision dynamically as demand varies
2) ADMM and Sharing problem: : ADMM was created in
on a hourly. Thus, we need a distributed algorithm to solve
the 1970s and has recently received renewed interest in solv-
such a large scale problem.
ing large-scale distributed convex optimization in statistics,
Problem (5) often arises in networking systems, where each
machine learning, signal processing [19]. We first consider
user n is associated with an utility Un (xn ) by using xn units of
a problem
some resource, while the users incur a total cost C(y), which
presents coupled constraint arbitrarily among users, at the min f (x) + g(z) (10)
resource provider. Conventional distributed manners to solve
Problem (5) are dual decomposition and gradient methods s.t. x − z = 0,
[19]. We can obtain the Lagrangian dual problem of Problem where f , g : ℜn → ℜ ∪ {+∞} are closed proper convex func-
(5) as follows tions. The augmented Lagrangian associated with the problem
N (10) is
min q(u) =
u
∑ max
xn
{Un (xn ) − uxn } + max{uy −C(y)},
y
(6)
n=1 Lρ (x, z, y) = f (x) + g(z) + yT (x − z) + (ρ/2) � x − z �22 , (11)
where u is the price set by the resource provider. If Problem
(5) is convex, the dual gap is zero then we only need to solve where ρ is a penalty parameter and y ∈ ℜn is a dual variable
the dual problem. We have a gradient algorithm to the dual associated with the consensus constraint. ADMM solves the
problem as follows: dual problem with the iterations:
xnk+1 := arg max Un (xn ) − uk xn , ∀n (7) xk+1 := arg min Lρ (x, zk , yk ), (12)
xn
k+1 k+1 k
z := arg min Lρ (x , z, y ),
yk+1 := arg max uk y −C(y),
y k+1 k k+1 k+1
y := y + ρ(x −z ).
N
uk+1 := uk − γ(yk+1 − ∑ xnk+1 ), Then the ADMM is presented as the proximal algorithm as
n=1
follows
where γ is a sufficiently small positive step size. The conven-
tional dual decomposition approach bases on the assumption xk+1 := proxλ f (zk − uk ), (13)
that each Un is strictly concave and monotonically increasing, z k+1
:= proxλg (x k+1 k
+ u ),
and C(y) is strictly convex. However, this assumption is not k+1 k k+1
always applied to the cloud system [16], because the joint re- u := u + x − zk+1 ,
source allocation and minimizing carbon footprint problem has
with uk = (1/ρ)yk and λ = 1/ρ.
non strictly convex cost function C(y) in (2). Furthermore, the
ADMM can be used to solve the sharing problem given in
conventional dual decomposition approach suffers from many
the form:
performance issues for solving such a large-scale problem
[16], [19]. We apply proximal algorithms [24] to make new N N
distributed optimization algorithms. We present preliminaries min ∑ fi (xi ) − g( ∑ xi ) (14)
i=1 i=1
of proximal algorithms in the following section.
Sharing can be written in ADMM form by copying all the
B. Preliminaries on Proximal Algorithm and ADMM variables:
1) Proximal Algorithm: : There is a wide range of liter- N N
ature on applying various proximal algorithms to particular min ∑ fi (xi ) − g( ∑ zi ) (15)
problems or problem domains, such as loss minimization in i=1 i=1
machine learning, optimal control, energy management, and s.t. xi − zi = 0, i = 1, ..., N,
signal processing [24]. The proximal minimization algorithm,
also called proximal iteration or the proximal point algorithm, with variable xi ∈ ℜn , i = 1, ..., N, and f : ℜn → ℜ ∪ {+∞}, g :
is ℜn → ℜ ∪ {+∞} are closed proper convex functions. Remark
that f (·) and/or g(·) are not assumed to be strictly convex as
xk+1 := proxλ f (xk ), (8) in [20] or needs some special characteristics like those in [16].
327
The proximal algorithm associated with the problem (15) is 6
x 10
9
given by
8
xik+1 := proxλ fi (zki − uki ), ∀i (16)
Objective value
7
zk+1 := proxλg (xk+1 + uk ),
6
uk+1
i := uki + xk+1 − zk+1
i , ∀i
5
where z = [z1 , ..., zN ] ∈ ℜNn . The first and last steps can be 4
carried out independently in parallel for each i = 1, ..., N at
3
the subsystems. 0 5 10 15 20 25 30
iter (k)
n=1 n=1 7
s.t. xn = zn , ∀n
Objective value
6
N 5
∑ zn ≤ Ç/κ. 4
n=1 3
328
4
10 [8] Fog computing is a new concept of data distribution. [On-
2
line]. Available: http://www.cloudtweaks.com/2013/12/fogcomputing-
10
is-a-new-concept-of-datadistribution/
||r||2
10
0 [9] Fog computing: Data, information, application and services
need to be delivered more efficiently to the end user.
10
−2
[Online]. Available: http://clouduser.de/en/analysis/fogcomputing-
0 10 20 30 40 50 60
data-information-applicationand-services-needs-to-be-deliveredmore-
10
4
efficient-to-the-enduser-22362
[10] D. Xie, N. Ding, Y. C. Hu, and R. Kompella, “The only constant
2
10 is change: incorporating time-varying network reservations in data
||s||2
0
[14] H. Xu, C. Feng, and B. Li, “Temperature aware workload management
10 in geo-distributed datacenters,” in Proceedings of the ACM SIGMET-
−2
RICS/international conference on Measurement and modeling of com-
10
0 10 20 30 40 50 60 puter systems. ACM, 2013, pp. 373–374.
4
[15] H. Xu and B. Li, “Joint request mapping and response routing for
10
geo-distributed cloud services,” in INFOCOM, 2013 Proceedings IEEE.
IEEE, 2013, pp. 854–862.
[16] D. Niu and B. Li, “An efficient distributed algorithm for resource allo-
||s||2
2
10
cation in large-scale coupled systems,” in INFOCOM, 2013 Proceedings
IEEE. IEEE, 2013, pp. 1501–1509.
10
0
0 10 20 30 40 50 60
[17] H. Xu and B. Li, “A general and practical datacenter selection framework
iter (k) for cloud services,” in Cloud Computing (CLOUD), 2012 IEEE 5th
International Conference on. IEEE, 2012, pp. 9–16.
Fig. 6. Residual (αn is generated by normal distribution). [18] S. Narayana, J. W. Jiang, J. Rexford, and M. Chiang, “To coordinate
or not to coordinate? wide-area traffic management for data centers,”
Technical report, Princeton University, Tech. Rep., 2012.
[19] S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed
As future work, we plan to more thoroughly study the effect optimization and statistical learning via the alternating direction method
of the multiple data centers with traffic engineering schemes. of multipliers,” Foundations and Trends R in Machine Learning, vol. 3,
no. 1, pp. 1–122, 2011.
VI. ACKNOWLEDGEMENT [20] S. Boyd, L. Xiao, and A. Mutapcic, “Subgradient methods,” lecture notes
of EE392o, Stanford University, Autumn Quarter, vol. 2004, 2003.
This work was supported by the ICT R&D program of [21] N. H. Tran, C. S. Hong, and S. Lee, “Joint Congestion Control and
MSIP/IITP. [14-000-05-001, Smart Networking Core Technol- Power Control with Outage Constraint in Wireless Multihop Networks,”
Vehicular Technology, IEEE Transactions on, vol. 61, no. 2, pp. 889–
ogy Development]. Dr. CS Hong is the corresponding author. 894, 2012.
[22] ——, “Cross-Layer Design of Congestion Control and Power Control
R EFERENCES in Fast-Fading Wireless Networks,” Parallel and Distributed Systems,
[1] F. Bonomi, R. Milito, J. Zhu, and S. Addepalli, “Fog computing and its IEEE Transactions on, vol. 24, no. 2, pp. 260–274, 2013.
role in the internet of things,” in Proceedings of the first edition of the [23] C. Do, N. Tran, Z. Han, L. Le, S. Lee, and C. S. Hong, “Optimal
MCC workshop on Mobile cloud computing. ACM, 2012, pp. 13–16. Pricing for Duopoly in Cognitive Radio Networks: Cooperate or Not
[2] M. Hajibaba and S. Gorgin, “A review on modern distributed computing Cooperate?” Wireless Communications, IEEE Transactions on, 2014, in
paradigms: Cloud computing, jungle computing and fog computing,” press.
CIT. Journal of Computing and Information Technology, vol. 22, no. 2, [24] N. Parikh and S. Boyd, “Proximal algorithms,” Foundations and Trends
pp. 69–84, 2014. in Optimization, vol. 1, no. 3, pp. 123–231, 2013.
[3] Cisco technology radar trends: Fog computing. [Online]. [25] H. Ballani, P. Costa, T. Karagiannis, and A. Rowstron, “Towards
Available: http://www.cisco.com/web/solutions/trends/tech-radar/fog- predictable datacenter networks,” in ACM SIGCOMM Computer Com-
computing.html munication Review, vol. 41, no. 4. ACM, 2011, pp. 242–253.
[4] Fog computing happens when big data analytics marries internet [26] J. V. Spadaro, L. Langlois, and B. Hamilton, “Greenhouse gas emissions
of things. [Online]. Available: http://tarrysingh.com/2014/07/fog- of electricity generation chains: Assessing the difference,” IAEA bulletin,
computing-happens-when-big-data-analytics-marries-internet-of-things/ vol. 42, no. 2, pp. 19–28, 2000.
[5] H. Madsen, B. Burtschy, G. Albeanu, and F. Popentiu-Vladicescu, [27] X. Fan, W.-D. Weber, and L. A. Barroso, “Power provisioning for a
“Reliability in the utility computing era: Towards reliable fog comput- warehouse-sized computer,” in ACM SIGARCH Computer Architecture
ing,” in Systems, Signals and Image Processing (IWSSIP), 2013 20th News, vol. 35, no. 2. ACM, 2007, pp. 13–23.
International Conference on. IEEE, 2013, pp. 43–46. [28] E. Nygren, R. K. Sitaraman, and J. Sun, “The akamai network: a
[6] K. Hong, D. Lillethun, U. Ramachandran, B. Ottenwälder, and B. Kold- platform for high-performance internet applications,” ACM SIGOPS
ehofe, “Mobile fog: a programming model for large-scale applications Operating Systems Review, vol. 44, no. 3, pp. 2–19, 2010.
on the internet of things,” in Proceedings of the second ACM SIGCOMM
workshop on Mobile cloud computing. ACM, 2013, pp. 15–20.
[7] J. Zhu, D. S. Chan, M. S. Prabhu, P. Natarajan, H. Hu, and F. Bonomi,
“Improving web sites performance using edge servers in fog computing
architecture,” in Service Oriented System Engineering (SOSE), 2013
IEEE 7th International Symposium on. IEEE, 2013, pp. 320–323.
329