A Network Structure Entropy Considering Series-Par
A Network Structure Entropy Considering Series-Par
Article
A Network Structure Entropy Considering
Series-Parallel Structures
Meng Cai 1, * , Jiaqi Liu 1 and Ying Cui 2
1 School of Humanities and Social Sciences, Xi’an Jiaotong University, Xi’an 710049, China;
[email protected]
2 School of Mechano-Electronic Engineering, Xidian University, Xi’an 710071, China; [email protected]
* Correspondence: [email protected]; Tel.: +86-1348-467-2518
1. Introduction
A complex network is an abstraction of a complex system, and this is one of the
Citation: Cai, M.; Liu, J.; Cui, Y. A essential means to quantitatively describe a complex natural system and social system
Network Structure Entropy
and to then conduct research in fields, including virus transmission control [1–3], disaster
Considering Series-Parallel
spread control [4,5], financial market analysis [6], structural efficiency evaluation [7] and
Structures. Entropy 2022, 24, 852.
evolutionary game simulation [8]. Although the various parts of a complex network are
https://doi.org/10.3390/e24070852
interrelated, they show a high degree of heterogeneity in connection mode and that the
Academic Editors: Boleslaw K. structural characteristics of heterogeneity can greatly impact the network function [9].
Szymanski, Jianxi Gao, Lu Zhong Therefore, network heterogeneity has received significant attention from scholars.
and Xueming Liu Among these, entropy, as a measurement of the degree of system disorder, is widely
Received: 1 May 2022
used due to its unique connotation and penetration and has become an important indicator
Accepted: 20 June 2022
to measure network heterogeneity [10]: The macroscopic meaning of entropy is a measure
Published: 21 June 2022
of the uniformity of system energy distribution [11]. The stronger the heterogeneity, the
smaller the entropy value; conversely, the greater the entropy value. At present, many
Publisher’s Note: MDPI stays neutral
studies have defined network structure entropy from different angles [12–16]. However,
with regard to jurisdictional claims in
the form of network entropy used has always been the focus of complex network research.
published maps and institutional affil-
In existing studies, network entropy is mainly defined from two aspects: information
iations.
theory and network structure characteristics. On the one hand, in the network entropy
based on information theory, Costa et al. proposed search information entropy, target en-
tropy and information path entropy, which are defined by the information search capability
Copyright: © 2022 by the authors.
of the network [17]; Boccaletti et al. defined the Shannon entropy of the network through
Licensee MDPI, Basel, Switzerland. the information theory of network topology [18].
This article is an open access article On the other hand, in the network entropy, which focuses on reflecting network
distributed under the terms and structure characteristics, Wang et al. and Wu et al., respectively, defined network entropy
conditions of the Creative Commons in terms of the difference of network nodes and degree distribution entropy [19] and Wu
Attribution (CC BY) license (https:// structure entropy [12]. Cai et al. argued that the structure entropies based on degree
creativecommons.org/licenses/by/ distribution and degree relative value are not fully considered when describing network
4.0/). characteristics [14] and thus proposed a network structure entropy based on point and edge
difference (SD structure entropy) and a network structure entropy based on maximum flow
(FB structure entropy).
Degree distribution entropy defines network structure entropy according to the impor-
tance of network nodes [19], which depends on the relative number of nodes with the same
degree value in the network, H = − ∑kN=1 p(k) log p(k) , where p(k) is the distribution
function for a network node degree of k and N is the number of nodes in the network. Wu
structure entropy measures the network heterogeneity using the relative degree value of a
node, and this is defined as H = − ∑iN=1 Nki log( Nki ), where k i is the degree of node i.
∑ i =1 k i ∑ i =1 k i
The above two network structure entropies only take neighbor nodes as consideration
objects. Still, they do not consider the influence of non-neighbor nodes, which cannot reflect
the global description of the network. In addition, because the degree distribution entropy
and Wu structure entropy consider network structural characteristics in terms of “nodes”
or “edges”, they have limitations in describing the heterogeneity of the special network,
such as a star network [14]. For example, a star network shows weak heterogeneity under
the description of degree distribution entropy, while Wu structure entropy has difficulty in
reflecting the scale effect of a star network.
Cai et al. proposed a network structure entropy based on the difference between
nodes and edges–SD structure entropy [14]. The node difference of node i is defined by
the number of nodes in the network that are different from the degree value of node i,
Si = [1 − p(k i )] N, and the edge difference is defined as Di = k i [1 − p(k i )] N, where k i is
the degree of node i in the network and p(k i ) is the probability of nodes with degree k i
in the network. Considering the node difference and the edge difference, the structural
importance of node i is Ii0 = αSi + βDi , and the network structure entropy is defined as
Ii0 Ii0
H = − ∑iN=1 N log( N ).
∑ j=1 Ij0 ∑ j=1 Ij0
Compared with the degree distribution entropy and Wu structure entropy, SD struc-
ture entropy unifies the node and edge as a measurement standard. However, the essence
is still starting from the degree value of nodes, emphasizing too much the network local
characteristics and ignoring the global topological structure of the network. To compre-
hensively evaluate the local and global characteristics of the network, Cai et al. introduced
the concept of network flow into the definition of structure entropy, combined radial and
medial measures, and proposed a maximum flow-based network structure entropy–FB
structure entropy [14].
The medial measure is the absolute flow betweenness of node k, bk0 = ∑i,j∈S(k) (k Wi,j −k
∗
Wi,j ), S(k) = {(i, j) : 1 ≤ i ≤ N; 1 ≤ j ≤ N; i 6= j 6= k }. This measures the change of
network flow after a node in the network removes or stops transmission, where W denotes
the maximum flow matrix between all node pairs in the network; k W denotes the kth
row and kth column removed from the matrix W; k W ∗ denotes the maximum flow matrix
recalculated after the removal of node k from the original network; and the radial measure
d0k is the node k degree value, which reflects the connection between a given node and other
nodes in the network.
Combining medial and radial measures, the structural importance of node k is defined
Ik0 Ik0
as Ik0 = αbk0 + βd0k , and the FB structure entropy is H = − ∑kN=1 N log( N ), where α
∑n=1 In0 ∑n=1 In0
and β are the weights of the two measures, respectively. Compared with the first three types
of network structure entropy, FB structure entropy can measure the network heterogeneity
from a global perspective and reflect the differences in topology of network connections
more carefully.
From degree distribution entropy and Wu structure entropy to SD structure entropy
and then to FB structure entropy, the definition of network structure entropy changes from
considering a “node” or “edge” unilaterally to considering both “node” and “edge” and
then introducing the maximum flow to describe the network structure globally. The ability
to characterize the network heterogeneity has been enhanced; however, ultimately, they
have limitations.
Entropy 2022, 24, 852 3 of 20
Degree distribution entropy and Wu structure entropy only consider network structure
characteristics from the “node” or “edge”, resulting in certain problems in describing the
heterogeneity of special networks, such as star networks [14]. SD structure entropy fully
considers the node difference and edge difference and has a good explanation for the
heterogeneity of sparse network and star network; however, it is still based on the node
degree value, with too much emphasis on the local characteristics of the network and then
ignores the global characteristics of the network [14].
FB structure entropy introduces the concept of network flow, describes network
heterogeneity from global structure, which—to an extent—overcomes the shortcomings of
the other three structure entropies in reflecting the network heterogeneity; however, the
network maximum flow may be limited by the maximum flow of a certain path.
Under this restriction, even if the network topology is changed, the FB structure
entropy cannot reflect the change in network heterogeneity. For example, Figure 1 shows
a set of 0-1 networks with a series-parallel structure given source node 1 and sink node
6. It can be seen that Figure 1a has three parallel paths between node pairs (3, 6), and
Figure 1b adds node 7 to Figure 1a. In Figure 1a, node 2 and node 4 are in completely
different positions in the network structure, with the former not in any parallel structure
and the latter in the parallel structure of node pair (3,6), and thus their importance in the
network is different.
However, degree distribution entropy, Wu structure entropy and SD structure entropy
are unable to distinguish the difference because their essence is to calculate the importance
of a single node based on the local structure of the network. Furthermore, compared to
Figure 1a, Figure 1b adds a parallel path (3, 7, 6) between the node pair (3, 6), and the
importance of nodes 4 and 5 in the parallel structure is shared and thus changes. However,
path (1, 2, 3) in the 0-1 network becomes the maximum flow bottleneck from node 1 to
node 6, and the maximum flow completely depends on the path set {(3, 4, 6), (3, 6), (3, 5, 6),
(3, 7, 6)}; yet, since each path in the set is a possible maximum flow path, the maximum
flow does not depend on any one of them, and the FB structure entropy cannot reflect the
change of network heterogeneity.
Aiming at the limitations of existing methods in describing the network heterogeneity,
this paper defines the structure entropy based on global network topology while over-
coming maximum flow bottleneck in the network, adds a medial measure considering
the series-parallel structure and proposes a new network structure entropy—SP structure
entropy (series-parallel structure entropy). On the one hand, through the analysis of special
networks, we show that the entropy indicator proposed in this paper has advantages in
considering the importance of series-parallel nodes and can overcome the deficiency of
other network structure entropies to a certain extent; on the other hand, through theoreti-
cal analysis and simulation experiments on typical networks, such as a regular network,
random network, scale-free network and small-world network, we further prove that SP
structure entropy is effective and usable in describing general networks.
4 1 2 3 6
1 2 3 6 5
5 7
(a) (b)
Figure 1. A set of 0-1 networks with a series-parallel structure given source node 1 and sink node 6,
where the set of nodes in (a) is 1,2,3,4,5,6 and (b) adds node 7 to (a).
Entropy 2022, 24, 852 4 of 20
where ∅ denotes an empty set; pij denotes the set of maximal flow possible paths between
nodes vi and v j ; pij denotes the number of paths in pij ; pijk denotes the set of paths through
node vk in the maximum flow possible path between nodes vi and v j ; pijk denotes the
number of paths in pijk ; and cijk denotes the set consisting of the number of path nodes in pijk ,
vi 6 = v j 6 = v k .
pijk
From Equation (1), it can be seen that is a measure of whether node vk is in a
| pij |
parallel structure and its contribution to the parallel structure, and ∑ pk 1k is a measure
ij cij
of whether node vk to the series structure in which it is located. To effectively measure
parallel structures in the network, we only include the node pairs (vi , v j ) with pij ≥ 1 in
the consideration range of bk (i, j).
In order to deepen the understanding of Equation (1), Figure 2 is given, where
nodes 3, 4 and 5 are in the same series structure as shown, we illustrate Figure 2: take
node 4 between node pair (1,7) as an example, p17 = {(1, 2, 3, 4, 5, 7), (1, 2, 7), (1, 2, 6, 7)},
| p4 |
p417 = (1, 2, 3, 4, 5, 7); therefore, | p17 | = 13 . The number of nodes on path (1, 2, 3, 4, 5, 7) in
17
| p417 |
the set p17 is 6, p17 . In the end, | p | · ∑ p4 14 = 13 · 61 = 18
4 1
.
17 17 | c17 |
3 4 5
1 2 7
Figure 2. A 0-1 network with a series-parallel structure given source node 1 and sink node 7, where
nodes 3, 4 and 5 are in the same series structure.
Since the node pairs satisfying pij ≥ 1 are not unique, in practice, we average bk over
all node pairs (vi , v j ) that satisfy the condition:
∑| p |≥1 bk (i, j)
bk0 =
ij
(2)
B
where B is the number of node pairs (vi , v j ) in the network that satisfy pij ≥ 1.
Define d0k as the degree value of node vk in the undirected network, and then aij
represents the element value of the ith row and the jth column in the adjacency matrix of
network G.
Entropy 2022, 24, 852 5 of 20
As Borgatti and Everett clearly indicated when summarizing node centrality from
the perspective of graph theory [20], the essence of a node centrality measure is to eval-
uate the participation of nodes in a network walk structure: the measure similar to the
degree centrality is the radial measure, and the measure similar to the betweenness is the
medial measure.
Therefore, bk0 is a typical medial measure method, which reflects the dependence of
series-parallel structure on node vk , measures the number of paths through node vk in
parallel structure and the importance of being allocated by node vk in series structure. d0k
is a typical radial measure, a centrality measure method that takes a given node as the
starting node or end node in a network path, essentially reflecting the connection between
node vk and other nodes in network [14]. bk0 and d0k constitute two parts of network walk
position classification considering a series-parallel structure [20].
Radial and medial measures reflect the different roles played by nodes in a network
and jointly determine the participation of nodes. In particular, this paper considers the
influence of a series-parallel structure on the node importance in a medial measure. The
two complement each other to form the total contribution of a given node to the network,
which more comprehensively describes the node importance and network heterogeneity.
Radial and medial measures also have corresponding meanings in the field of social
science: The former reflects bonding social capital—that is, from the perspective of internal
connection, solidarity and trust, it is argued that social capital is the connection between
individuals within an organization and small groups, which is used to reflect the connection
of homogeneous groups. The latter reflects bridging social capital, from the perspectives
of external relations, information asymmetry and power interests, and it is believed that
the value of social capital originates from participating in and controlling the diffusion of
information, which is used to reflect the ties of heterogeneous groups [20,21].
Similarly, from the perspective of social capital, aggregating social capital and outreach
social capital are two aspects of individual social capital, which are indispensable and
should be considered in a unified way [14]. Considering radial and medial measures
comprehensively, the node importance of node vk can be defined as
where α and β are the weights of medial and radial measures, respectively, α + β = 1,
0 ≤ α, β ≤ 1. α = 1, β = 0 indicates the extent to which a given node contributes to the
network considered from the medial measure only; conversely, α = 0, β = 1 means that only
the radial measure is considered, and accordingly, Ik0 degenerates into a local measurement.
Therefore, the relative importance of node vk in the network can be defined as
v
TM k e
em vi ,v j m
Ik0 αbk0 + βd0k m + αβ e TN A T δk
Ik = = = v (5)
∑nN=1 In0 ∑nN=1 (αbn0 + βd0n )
TM n e
em vi ,v j m
∑nN=1 ( m + αβ e TN A T δn )
v
where Mvik,v j is a m × m dimension matrix composed of bk calculated by Equation (1) for
all node pairs (vi , v j ) satisfying the parallel structure conditions of node vk , and m is the
number of node pairs that satisfy the condition, that is, m = S(k). Similarly, m in the
denominator is the number of node pairs that satisfy the parallel structure condition of
node vn . em is a m-dimensional column vector with element 1. em T is the transpose of e . A
m
T
is the adjacency matrix of network G. A is the transpose of A. N is the network size, and
δk is a N-dimensional column vector, where the kth element is 1 and the others are 0.
β
In Equation (5), α is a constant. This paper holds that a medial measure is as important
β
as a radial measure, α = 1, that is,
Entropy 2022, 24, 852 6 of 20
v
T M k e + me T A T δ + 4
em vi ,v j m N k
Ik ' v (6)
∑nN=1 (em
T M n e + 4) + me T A T e
vi ,v j m N N
To avoid the calculation of the above equation being meaningless when V 6= ∅ and
E = ∅, the 4 term is introduced to satisfy 4 ∼ O( N12 ), N > 1. The introduction of this
term does not affect the results of the network structure heterogeneity analysis.
Based on Equation (6), the entropy of network structure in this paper is defined as
N
H=− ∑ Ik log Ik
k =1
v
T M k e + me T A T δ + 4 v
T M k e + me T A T δ + 4 (7)
N em vi ,v j m em vi ,v j m
N k N k
=− ∑ ∑nN=1 (em
v
T M n e + 4) + me T A T e
× log
∑nN=1 (em
v
T M n e + 4) + me T A T e
k =1 vi ,v j m N N vi ,v j m N N
Table 1. The difference of node importance of four structure entropies on the network of Figure 1a.
Table 2. The difference of node importance of four structure entropies on the network of Figure 2.
Table 3. The difference of node importance under two structure entropy measures on the network of
Figure 1b.
Since both FB structure entropy and SP structure entropy add the node degree value
as the measurement standard, it is impossible to determine whether the changes in node
importance are caused by the change of node degree value or the change of network
structure. In view of this, we examine the absolute importance of nodes between a single
node pair, that is, we calculate according to Ik0 = αbk0 + βd0k , where bk0 is radial measure of
structure entropy and d0k is medial measure, α + β = 1. Specifically, the node pair (1, 6) in
Figure 2 is selected as the consideration object. The importance of node 4 in the structure of
node pair (1, 6) is calculated, and the results are shown in Table 4.
Figure 1a Figure 1b
FB structure entropy 2 2
SP structure entropy 2.0667 2.05
As can be seen from Table 4, the absolute importance under the FB structure entropy
measurement has not changed. In contrast, the SP structure entropy has changed, indi-
cating that FB structure entropy does not reflect the structural change of node pair (1, 6)
after adding node 7; however, the SP structure entropy can reflect the change. To better
understand, the specific calculation processes of FB structure entropy and SP structure
entropy are shown and analyzed next.
0 1 1 1 1 1
1 0 1 1 1 1
1 1 0 2 2 3
W=
1
1 2 0 2 2
1 1 2 2 0 2
1 1 3 2 2 0
It can be seen that the maximum network flow value between node pairs (1, 6) is 1.
Since the importance of node 4 is considered, the maximum flow matrix of the network is
recalculated after removing node 4 from the network as
0 1 1 1 1
1 0 1 1 1
4 ∗
W =
1 1 0 2 2
1 1 2 0 2
1 1 2 2 0
0 1 1 1 1 1 1
1 0 1 1 1 1 1
1 1 0 2 2 4 2
W=
1 1 2 0 2 2 2
1 1 2 2 0 2 2
1 1 4 2 2 0 2
1 1 2 2 2 2 0
The maximum flow value between node pair (1, 6) is 1. Similarly, we recompute the
maximum flow matrix after removing node 4 as
0 1 1 1 1 1
1 0 1 1 1 1
4 ∗
1 1 0 2 3 2
W =
1
1 2 0 2 2
1 1 3 2 0 2
1 1 2 2 2 0
After recalculation, the maximum flow value between node pair (1, 6) remains at 1.
Therefore, in Figure 1b, the absolute node importance to node 4 in the node pair (1, 6)
structure is
I40 (b) = αb40 + βd40 = b40 + d40 = 1 − 1 + 2 = 2
It can be seen that I40 (a) = I40 (b) , and the FB structure entropy cannot reflect the change
of parallel structure between node 1 and node 6. At its root, FB structure entropy is a
measure of the structure entropy based on the network maximum flow as can be seen from
Figure 1a,b. Whether node 7 is added or not, the maximum flow value between node 1 and
node 6 is limited by the capacity of path (1, 3)—that is, in a 0-1 network, the maximum flow
between node pair (1, 6) is 1. Therefore, no matter how many nodes are added in parallel
with node 4, FB structure entropy cannot reflect that the importance of node 4 is shared
by its parallel paths. Therefore, FB structure entropy cannot reflect the change of network
structure between some specific node pairs.
Entropy 2022, 24, 852 9 of 20
p416 1 1 1 1
b40 = ·∑ 4 = · = = 0.0667
| p16 | 4 c16 3 5 15
p
16
Therefore, the absolute importance of node 4 in the node pair (1, 6) structure in
Figure 1a is
I40 (a) = αb40 + βd40 = b40 + d40 = 0.0667 + 2 = 2.0667
Next, calculating the importance of node 4 between node pair (1,6) in Figure 1b. The set
of paths between node pair (1, 6) is p16 = {(1, 2, 3, 4, 6), (1, 2, 3, 6), (1, 2, 3, 5, 6), (1, 2, 3, 7, 6)},
and the paths set through node 4 in p16 are p416 = {(1, 2, 3, 4, 6)}. Then, | p16 | = 4,
p416 = 1, c416 = 5. Therefore, the medial measure of the importance of node 4 on
the node pair (1, 6) structure in Figure 1b is
p416 1 1 1 1
b40 = ·∑ 4 = · = = 0.05
| p16 | 4 c16 4 5 20
p
16
Therefore, the absolute importance of node 4 in the node pair (1, 6) structure in
Figure 1b is
I40 (b) = αb40 + βd40 = b40 + d40 = 0.05 + 2 = 2.05
It can be seen that I40 (a) 6= I40 (b) , and thus SP structure entropy can reflect the change of
parallel structure between node pair (1, 6).
The above analysis shows that both FB structure entropy and SP structure entropy can
reflect the change of network heterogeneity through node importance when considering
the whole network structure. However, when focusing on a specific node pair structure, FB
structure entropy cannot accurately reflect the corresponding heterogeneity changes due to
the maximum flow. In contrast, SP structure entropy considers the series-parallel structure
in the network; therefore, it can accurately describe the heterogeneity changes, both in the
whole network structure and in the local node pair structure.
ered. Thus, the significance of the experiment is to show that each structure entropy metric
can be effective in heterogeneity measurements of typical networks while maintaining its
own superiority in specific contexts. The simulation experiments were implemented with
Python3.8 programming.
To facilitate comparison with other typical network entropies, the typical networks
chosen for the experiments were all undirected and unweighted; to facilitate the comparison
between different network entropies, and the natural logarithm was used for all numerical
calculations of entropy in the experiments. As 4 can take any small non-zero number, we
set 4 to 10−9 .
0.8 0.78
0.67
0.6
0.5
0.4
Degree entropy
0.2 Wu entropy
SD entropy
FB entropy
0.0 SP entropy 0 0
Chain Y Complete Star Loop Cellular
network type
Chain Y Complete Star Loop Cellular
Figure 3. Structure entropy and topology structure of typical social networks. The size of typical
social networks is 5.
It can be seen that, since degree distribution entropy only considers the distribution
function of node degrees, which is 0 in the network with the same node degrees, it shows an
Entropy 2022, 24, 852 11 of 20
opposite trend to the other structure entropies, while the rise and fall trend of other structure
entropies between different networks is the same. In particular, accurate characterization
of the star network, has always been a reflection of the superiority of SD and FB structure
entropies, and SP structure entropy can also solve this problem well. The minimum value
of structure entropy of six social networks under the same size is located at the star network,
and the strong heterogeneity of the star network is confirmed [11]. Therefore, SP structure
entropy can effectively reflect the heterogeneity of typical social networks and is particularly
similar to the calculation results of Wu structure entropy.
(a)
(b)
Figure 4. Structure entropy of the ER random network and BA scale-free network under different
structure entropy indicators. (a) shows the results for ER random network with connection probability
q = 0.02, (b) shows the results for BA scale-free network with growth rate u = 1. Each result is
independently performed 10 times and then averaged, and the result curves are shown with error bars.
similar to the results for ER random network, the maximum and minimum structure
entropy values remain Wu structure entropy and degree distribution entropy. Different
from the ER random network, the changing trend of the SD structure entropy curve is still
synchronized with Wu structure entropy, however, is no longer numerically equivalent to
it; the entropy increase effect of degree distribution entropy is not obvious. Particularly
after the network size reaches 20, the degree distribution entropy does not change greatly.
The former indicates that both SD structure entropy and Wu structure entropy can
more accurately reflect the heterogeneity of the ER random network and BA scale-free
network; however, there will be a gap in the numerical results due to the difference in the
scope of investigation; the latter shows that, under the measurement of degree distribution
entropy, the BA scale-free network reaches a steady state earlier than other structure entropy
indicators, reflecting a slight lack of degree distribution entropy in portraying network
heterogeneity [14].
The FB structure entropy and SP structure entropy curves are located in the middle,
and the SP structure entropy value is slightly smaller than FB structure entropy due to the
sharing effect of series-parallel structure on node importance being considered. However,
the trend of the two is roughly the same with the increasing network size, which also
reflects the fact that the parallel structure measure of SP structure entropy is weakened due
to the structure characteristics of the BA scale-free network, thus, showing a similar growth
rate change trend to that of FB structure entropy.
Figure 5 shows the structure entropy results of the WS small-world network with
reconnection probability p. Each metric was independently performed 10 times and then
averaged, where the network size is 100 and the average degree is 2. The evolution process
of the network with reconnection probability p from 0 to 1 reflects the change of nearest-
neighbor coupled network to random network. Wu structure entropy argues that network
heterogeneity changes little during the evolution process, while SD structure entropy has
a significant change in network heterogeneity. SP structure entropy, FB structure entropy
and degree distribution entropy are intermediate between Wu structure entropy and SD
structure entropy, all with a small range of variation.
3
entropy
1 SP entropy
Degree entropy
FB entropy
SD entropy
0 Wu entropy
0.0 0.2 0.4 0.6 0.8 1.0
reconnection probability
Figure 5. Structure entropy of the WS small-world network under different structure entropy
indicators, where the network size is 100 and the average degree is 2. Each result is independently
performed 10 times and then averaged. The result curves are shown with error bars.
Entropy 2022, 24, 852 14 of 20
It can be seen that SP structure entropy, SD structure entropy, FB structure entropy and
degree distribution entropy all show noticeable changes at p ∈ [0, 0.1]. Among them, SD
structure entropy reaches a steady state after p = 0.4. However, the sharp shift in entropy
value still occurs before p = 0.1, which also verifies that the small-world characteristics of
the WS small-world network are mainly reflected in an interval of reconnection probability
of [0, 0.1] [25].
The small-world characteristics are mainly reflected in high clustering coefficients and
short path lengths, except for Wu structure entropy, which is always in a steady state. The
fastest curve into a steady state is the one corresponding to SP structure entropy. According
to the construction idea of SP structure entropy, the series-parallel structures in the network
do not contain only the shortest paths. From this perspective, SP structure entropy considers
that small-world characteristics do not greatly change the network heterogeneity.
Figure 6 illustrates the SP structure entropy of the ER random network as the network
size N and connection probability q change, where the ER random network is constructed
according to N = [10, 20, 30, 40, 50, 60, 70, 80, 90, 100] and q = [0.002, 0.004, 0.006, 0.008,
0.01, 0.012, 0.014, 0.016, 0.018, 0.02]. As network size N increases, the SP structure entropy
value of the ER random network increases substantially, and network size has a clear
influence on the SP structure entropy. However, when the network size is fixed, the change
of connection probability q does not cause a regular change in SP structure entropy, that
is, the SP structure entropy values for connection probabilities in the range [0.002, 0.02]
remain in a stable range. Therefore, it can be concluded that, when the network connec-
tion probability is small, SP structure entropy is not affected by the change of network
connection probability.
2.00
1.75
1.50
1.25 SP
1.00
0.75
0.50
0.25
0.00
0.0200
0.0175
0.0150
0.0125
20 0.0100
40
60 0.0075 q
80 0.0050
N 100 0.0025
Figure 6. SP structure entropy of the ER random network, where the network size is increased from
10 to 100 in steps of 10, and the connection probability q is increased from 0.002 to 0.02 in steps
of 0.002.
evolution scale of the BA scale-free network was increased from 10 to 15 with a step size of
1, and the growth rate was constructed according to the maximum network density under
the corresponding size. The ER random network was constructed according to the scale
and density of the BA scale-free network in the evolution process, that is, the BA scale-free
network and the ER random network have the same size and density. Table 6 shows the
simulation sizes, growth rates and densities for the BA scale-free and ER random networks.
The nearest-neighbor coupled network and star network were constructed according to the
corresponding BA scale-free network size.
Table 6. The network size, density and growth rate of the BA scale-free network and ER random network.
Since the literature [14] verified that FB structure entropy is more effective than
degree distribution entropy, Wu structure entropy and SD structure entropy on these
four typical networks, we only compared SP structure entropy with FB structure entropy.
Figure 7 shows FB and SP structure entropies for the nearest-neighbor coupled network, star
network, ER random network and BA scale-free network. Since the ER random network
and BA scale-free network were averaged over 30 experiments, we show the result curves
with upper and lower bound regions.
The structure entropy of nearest-neighbor coupled network and star network are fixed
for fixed network sizes, and we show the result curves without upper and lower bounds. It
can be seen that both FB and SP structure entropies consider the bounds (maximum and
minimum values) of network entropy correspond to the nearest-neighbor coupled network
and star network, respectively, which is also consistent with the analysis in Section 3.1
and reflects the ability of SP structure entropy to accurately portray these two types of
regular networks. According to the network structural characteristics, the BA scale-free
network satisfies the characteristics that a large number of nodes have a small number of
connections and a few nodes have a large number of connections; thus, its heterogeneity
should be stronger than the ER random network under the same size and density.
Comparing the result curves of the ER random network and BA scale-free network
in Figure 7, both the FB and SP structure entropies show that the BA scale-free network
structure entropy is smaller than for the ER random network, which satisfies the network
structure characteristics. However, as can be seen by the magnitude of difference, SP
structure entropy can better distinguish between the BA scale-free network and ER random
network in terms of the network heterogeneity.
Entropy 2022, 24, 852 16 of 20
(a)
(b)
Figure 7. The structure entropy and topology structure of four typical networks. (a) the FB structure
entropy and (b) the SP structure entropy. The results of the ER random network and BA scale-free
network are independently performed 30 times and then averaged for the result curves with upper
and lower bound regions. The network size N is increased from 10 to 15 in steps of 1.
1
0.00 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08
SP node importance
Figure 8. Regression results (left) and consulting network topology (right). The left shows the
regression results with SP node importance as the independent variable and individual performance
as the dependent variable. The right shows the consulting network of the enterprise, where the nodes
represent employees.
Y−µ
Z= (8)
σ
The independent variables are the SP node importance (denoted by SPNI), in-degree
centrality (IDC), out-degree centrality (ODC), betweenness centrality (BC), in-degree close-
ness centrality (ICC) and out-degree closeness centrality (OCC). The control variables are
gender, political affiliation and work time (years of service in the current position). First, a
regression analysis was conducted with SP node importance as the independent variable,
Z-score performance as the dependent variable and no other control variables considered.
The results are shown in Figure 8 (left).
It can be seen that there is a significant positive correlation between individual per-
formance and SP node importance, that is, the greater the SP node importance in the
consulting network, the higher the corresponding individual performance. This is also
consistent with the social significance that SP node importance as a good indicator of an
Entropy 2022, 24, 852 18 of 20
individual’s absolute resource occupancy (node degree) and status specificity (whether or
not they are in a series-parallel structure) in the network.
On the one hand, the node degree value considered by SP structure entropy can reflect
an individual’s number of direct contacts. Based on social capital theory, the number of
direct contacts can be regarded as a kind of social resource. Therefore, the greater the degree
of value in the network, the more resources the individual obtains and the more critical the
status is. On the other hand, as an important part of SP structure entropy, series-parallel
structure reflects the special status of nodes in the network to a certain extent.
The more important the position of a node in the network information transmission,
that is, the fewer serial nodes or parallel paths, the more special the node position in
the network, and the greater the advantage of the corresponding individual acting as
a competitor of the “information bridge”, the greater the opportunity to gain potential
benefits and have advantages of information and control. Thus, by virtue of absolute
resource occupation and status specificity, individuals with high SP node importance in the
consulting network tend to achieve higher individual performance.
The above analysis demonstrated the validity of SP node importance in predicting
individual performance. Next, we introduced other classical network indicators for com-
parison to prove the superiority of SP node importance. The regression analysis results are
shown in Table 7. Models 1 to 6 used SPNI, IDC, ODC, BC, ICC and OCC as independent
variables in the OLS regression model. As can be seen, each model is significant, justifying
the reasonableness of using the social network to explain individual performance. Further-
more, the adjusted R2 for model 1 is 0.594, which is the maximum value among all models,
indicating that model 1 has the best fit.
Thus, compared with other network structure indicators, SP node importance has the
optimum capacity in explaining individual performance. Among the control variables,
political affiliation and work time also showed statistical significance: members of the
Chinese Communist Party perform better than non-party members, likely because the
party members are often strictly selected, which makes them better at their jobs as well; the
longer employees work, the more comfortable they are in their job. Therefore, these two
groups obtain better performance.
4. Conclusions
This paper proposed a new network structure entropy indicator-SP structure entropy
by considering the network heterogeneity from a global perspective while considering the
Entropy 2022, 24, 852 19 of 20
influence of the series-parallel structure on node importance. On the one hand, analyzing
the network with series-parallel structure verified the superiority of SP structure entropy
in considering the importance of series-parallel nodes, which can overcome the deficiency
of other network structure entropies to a certain extent.
On the other hand, by analyzing and comparing the structure entropy of six typical
social networks (such as the chain network, Y network and complete network) and five typ-
ical networks (such as the BA scale-free network, ER random network and WS small-world
network), the validity of SP structure entropy in portraying general networks was verified.
We investigated an enterprise in China and demonstrated the superiority of SP node
importance in reflecting network structure and explaining employee performance by
analyzing the employee consulting network. Therefore, SP structure entropy as proposed
in this paper revealed the characteristics of network series-parallel structure and at the same
time portrayed the heterogeneity of different network structures, enriching the network
structure indicator system.
The main work in this paper focused on the design of network structure entropy
and the experimental analysis of its properties. More in-depth theoretical analysis and
application will be the content of subsequent research. Specifically: The network structure
entropy considering series-parallel structure proposed in this paper has a clear advantage
for the network containing series-parallel structures, as the medial measure is based on the
series-parallel structure and the radial measure is based on node degree distribution, while
there should be multiple measurements of the node importance.
In the future, other measurements can be considered to be added to SP structure
entropy so that it can also show advantages when measuring networks with insignificant
series-parallel structures. In addition, a more brief mathematical analytic expression and
quantitative description form of typical network structure entropy will be derived.
Author Contributions: Conceptualization, M.C. and J.L.; methodology, M.C.; software, J.L.; vali-
dation, M.C., J.L. and Y.C.; formal analysis, M.C. and J.L.; resources, M.C.; writing—original draft
preparation, J.L.; writing—review and editing, M.C., J.L. and Y.C.; project administration, M.C. All
authors have read and agreed to the published version of the manuscript.
Funding: This work was supported by the “Young Talent Support Plan” of Shaanxi Province, Xi’an
Social Science Planning Fund [Grant No. 22LW78] and the Fundamental Research Funds for the
Central Universities [Grant No. SK2022005].
Institutional Review Board Statement: Not applicable.
Informed Consent Statement: Not applicable.
Data Availability Statement: Not applicable.
Conflicts of Interest: The authors declare no conflict of interest.
Abbreviations
The following abbreviations are used in this manuscript:
SP series-parallel
ER Erdos and Renyi
BA Barabasi and Albert
WS Watts and Strogatz
SPNI SP node importance
IDC in-degree centrality
ODC out-degree centrality
BC betweenness centrality
ICC in-degree closeness centrality
OCC out-degree closeness centrality
OLS ordinary least squares
Entropy 2022, 24, 852 20 of 20
References
1. Li, D.; Zhao, Y. Survival analysis for tumor cells in stochastic switching environment. Appl. Math. Comput. 2019, 357, 199–205.
[CrossRef]
2. Wang, Y.-Q.; Jiang, G.-P. Virus spreading on complex networks with imperfect immunization. Acta Phys. Sin. 2010, 59, 6734–6743.
[CrossRef]
3. Wang, Y.-Q.; Jiang, G.-P. Epidemic immunization on scale-free networks with traffic flow. Acta Phys. Sin. 2011, 60, 6–13. [CrossRef]
4. Piot, P.; Bartos, M.; Ghys, P.D.; Walker, N.; Schwartländer, B. The global impact of HIV/AIDS. Nature 2001, 410, 968–973.
[CrossRef] [PubMed]
5. Simonsen, I.; Buzna, L.; Peters, K.; Bornholdt, S.; Helbing, D. Transient dynamics increasing network vulnerability to cascading
failures. Phys. Rev. Lett. 2008, 100, 218701. [CrossRef] [PubMed]
6. Zhuang, X.-T.; Zhang, D.; Yuan, Y.; Zhuang, X.-W. Fractal characteristic of the Chinese stock market complex network. Syst.
Eng.—Theory Pract. 2015, 35, 273–282.
7. Han, S.; Su, X. Study on structure efficiency of Chinese commercial banking: Basing on complex network DEA model. Chin. J.
Manag. Sci. 2016, 24, 1–9. [CrossRef]
8. Fan, H.-M.; Li, X.-X.; Liu, Y.-Y.; Mu, X.-W.; Zhao, C.-P. The title of the cited article. Manag. Rev. 2017, 29, 26–34. [CrossRef]
9. Huang, L.-Y.; Hou, Y.-L.; Wang, Q.; Cheng, X.-F. Network heterogeneity based on K-order structure entropy. Acta Phys. Sin. 2019,
68, 347–359. [CrossRef]
10. Jiang, J.; Wang, R.; Pezeril, M.; Wang, Q.-A. Application of varentropy as a measure of probabilistic uncertainty for complex
networks. Sci. Bull. 2011, 56, 3677–3682. [CrossRef]
11. Tan, Y.-J.; Wu, J. Network structure entropy and its application to scale-free networks. Syst. Eng.—Theory Pract. 2004, 24,
1–3.:1000-6788.2004.06.001. [CrossRef]
12. Wu, J.; Tan, Y.-J.; Deng, H.-Z.; Zhu, D.-Z. Heterogeneity of scale-free network topology. Syst. Eng.—Theory Pract. 2007, 27,
101–105.:1000-6788.2007.05.015. [CrossRef]
13. Harikrishnan, K.P.; Misra, R.; Ambika, G. Quantifying information loss on chaotic attractors through recurrence networks. Phys.
Lett. A. 2019, 383, 125854. [CrossRef]
14. Cai, M.; Cui, Y.; Stanley, H.E. Analysis and evaluation of the entropy indices of a static network structure. Sci. Rep. 2017, 7, 9340.
[CrossRef] [PubMed]
15. Yoon, J.; Blumer, A.; Lee, K. An algorithm for modularity analysis of directed and weighted biological networks based on
edge-betweenness centrality. Bioinformatics 2006, 22, 3106–3108. [CrossRef] [PubMed]
16. Zhang, Q.; Li, M.-Z.; Deng, Y. A new structure entropy of complex networks based on nonextensive statistical mechanics. Int. J.
Mod. Phys. C 2016, 27, 1650118. [CrossRef]
17. Costa, L.D.; Rodrigues, F.A.; Travieso, G.; Boas, P.R.V. Characterization of complex networks: A survey of measurements. Adv.
Phys. 2007, 56, 167–242. [CrossRef]
18. Boccaletti, S.; Bianconi, G.; Criado, R.; del Genio, C.I.; Gómez-Gardeñes, J.; Romance, M.; Sendiña-Nadal, I.; Wang, Z.; Zaninmn,
M. The structure and dynamics of multilayer networks. Phys. Rep. 2014, 544, 1–122. [CrossRef]
19. Wang, B.; Tang, H.-W.; Guo, C.-H.; Xiu, Z.-L. Entropy optimization of scale-free networks robustness to random failures. Phys. A
Stat. Mech. Its Appl. 2006, 363, 591–596. [CrossRef]
20. Borgatti, S.P.; Everett, M.G. A graph-theoretic perspective on centrality. Soc. Netw. 2006, 28, 466–484. j.socnet.2005.11.005.
[CrossRef]
21. Robert, Y.S. Bowling alone: The collapse and revival of American community by Robert D.Putnam. Political Sci. Q. 2013, 115,
618–619. [CrossRef]
22. Wang, X.-F.; Li, X.; Chen, G.-R. Complex Network Theory and Application; Tsinghua University Press: Beijing, China, 2006; p. 18.
23. Erdos, P.; Renyi, A. The Structure and Dynamics of Networks; Princeton University Press: Princeton, NJ, USA, 2011; pp. 38–82.
24. Barabasi, A.L.; Albert, R. Emergence of scaling in random networks. Science 1999, 286, 509–512. science.286.5439.509. [CrossRef]
[PubMed]
25. Watts, D.J.; Strogatz, S.H. Collective dynamics of ‘small-world’ networks. Nature 1998, 393, 440–442. [CrossRef] [PubMed]
26. Pastor-Satorras, R.; Vespignani, A. Immunization of complex networks. Phys. Rev. E 2002, 65, 036104. PhysRevE.65.036104.
[CrossRef] [PubMed]
27. Cai, M.; Wang, W.; Cui, Y.; Stanley, H.E. Multiplex network analysis of employee performance and employee social relationships.
Phys. A Stat. Mech. Its Appl. 2018, 490, 1–12. [CrossRef]
28. Sparrowe, R.T.; Liden, R.C.; Wayne, S.J.; Kraimer, M.L. Social networks and the performance of individuals and groups. Acad.
Manag. J. 2001, 44, 316–325. [CrossRef]