On The Consumption of Multimedia Content Using Mobile Devices A Year To Year User Case Study
On The Consumption of Multimedia Content Using Mobile Devices A Year To Year User Case Study
On The Consumption of Multimedia Content Using Mobile Devices A Year To Year User Case Study
Research Paper
Przemysław FALKOWSKI-GILSKI
Gdańsk University of Technology
Faculty of Electronics, Telecommunications and Informatics
Narutowicza 11/12, 80-233 Gdańsk, Poland; e-mail: [email protected]
(received June 5, 2019; accepted February 13, 2020 )
In the early days, consumption of multimedia content related with audio signals was only possible
in a stationary manner. The music player was located at home, with a necessary physical drive. An
alternative way for an individual was to attend a live performance at a concert hall or host a private
concert at home. To sum up, audio-visual effects were only reserved for a narrow group of recipients.
Today, thanks to portable players, vision and sound is at last available for everyone. Finally, thanks to
multimedia streaming platforms, every music piece or video, e.g. from one’s favourite artist or band, can
be viewed anytime and everywhere. The background or status of an individual is no longer an issue.
Each person who is connected to the global network can have access to the same resources. This paper is
focused on the consumption of multimedia content using mobile devices. It describes a year to year user
case study carried out between 2015 and 2019, and describes the development of current trends related
with the expectations of modern users. The goal of this study is to aid policymakers, as well as providers,
when it comes to designing and evaluating systems and services.
Keywords: audio coding; broadcasting; mobile devices; multimedia; signal processing; streaming services.
Nowadays, due to the presence of numerous multi- Over the last decades, the music industry contin-
media streaming services, e.g. YouTube, YouTube Mu- ues to adapt to constant changes in technology. The
sic, Apple Music, Google Play Music, Netflix, Spotify, breakthrough came in 2017, when streaming and down-
Twitch, etc., content streaming is a crucial application. loading revenue outweighed physical music sales, such
It should be also noted that social media, such as Face- as CDs and vinyl. Mobile streaming services are not
book, can also be used for content distribution. Their uniform themselves. They are comprised by stream-
success, together with web browsers, is the focus of at- ing sociomusical platforms (e.g. Spotify), musical so-
tention of numerous researchers interested in a variety cial systems (e.g. last.fm), music distribution services
of aspects, ranging from energy optimisation and net- (e.g. Soundcloud), as well as millions of users that gen-
work planning to recommendation systems. The main erate income, both from subscription and advertise-
reason is the process of streaming itself, performed us- ment.
ing wireless networks, since current mobile devices use What is worth mentioning, streaming takes place
a lot of power for constant decoding of multimedia at the expense of downloading music from the Inter-
content in order to present them via speaker or dis- net. Surprisingly, it was the leading driver of revenue
play. Rich content distribution among handheld de- for the U.S. music industry, whereas downloading al-
vices, such as smartphones and tables, is becoming bums, compared to 2016, decreased by approx. 15%.
more and more popular every year. With the outcome On the other hand, vinyl sales increased by 20% com-
of online streaming services, including VoD (Video-on- pared to 2016, which accounts for 10% of all physical
Demand) and other cloud based solutions, numerous media sales (Christman, 2017). The list of most popu-
service providers sometimes face bottlenecks, resulting lar terrestrial broadcasting as well as online streaming
in stalling or buffering. This paper describes a survey services, along with primary information concerning
carried out over a period of 5 years. utilised codec and bitrate, is described in Table 1.
322 Archives of Acoustics – Volume 45, Number 2, 2020
One must note that in the case of the majority of different layers of the Internet protocol stack, at dif-
online streaming platforms, especially those focused on ferent endpoints in client-server communication, etc.
audio content distribution, the codec and bitrate, be- These solutions, applicable to commercial consumer
ing closely linked with end user perceived quality, are mobile devices, are most often limited to networking
strictly dependent on the type of service. Most often, technologies, such as Wi-Fi, 3G, and LTE. Some of
the highest quality is reserved only for those consumers them propose application layer techniques using SVC
who pay a monthly premium subscription fee. When it (Scalable Video Coding), transcoding and content se-
comes to terrestrial broadcasting services, e.g. DAB+ lection. These solutions differ from the others, since
digital radio, quality remains the same for each con- they modify the actual multimedia content to reduce
sumer. In the case of Poland, the bitrate of audio ser- energy consumption of the mobile client (Hoque et al.,
vices ranges from 64 to 128 kbps, whereas e.g. in the 2014).
Czech Republic it ranges from 48 to 80 kbps (Zyka, In (Vallina-Rodriguez, Crowcroft, 2012),
2019). At the same time, additional value-added data the authors look at smartphone energy management
services are available at 16 kbps. It is also easy to no- techniques from the following perspectives:
tice how online multimedia streaming can affect the 1) energy-aware operating systems,
battery life of a mobile device. 2) efficient resource management,
3) impact of users’ interaction patterns with mobile
2.1. Energy consumption
devices and applications,
During the last years, a wide range of solutions has 4) wireless interfaces and sensors management,
been proposed to optimise energy consumption of mul- 5) benefits of integrating mobile devices with cloud
timedia streaming clients. They include operation at computing services.
P. Falkowski-Gilski – On the Consumption of Multimedia Content Using Mobile Devices. . . 323
Of course, some factors can be linked with wireless out. This user-oriented study was performed over a five
communication aspect, particularly issues related with year time period, from 2015 to 2019, on a group of 50
network planning and network monitoring. people each year, respectively. Those individuals were
all students of the Gdańsk University of Technology,
2.2. Network planning aged between 19 and 25. It was interesting to learn
how their expectations changed over the time, with
In (Havinga, Smit, 2001), the authors focus the outcome of numerous portable devices as well as
on MAC (Medium Access Control) layer solutions streaming services available online, which undoubtedly
and energy-efficient error control techniques. Exten- had an impact on today’s digital society.
sive power aware mobile multimedia was surveyed by The study was divided into 4 groups, namely:
(Zhang et al., 2009), where the authors investigated
adaptive technologies for video coding and transmis- 1) consumption of multimedia content;
sion. 2) consumer devices;
In (Cao et al., 2004) the authors provided an 3) processing and storing content;
overview of network-aware applications for mobile mul-
timedia delivery. However, they excluded energy-aware 4) Internet connection.
multimedia delivery techniques. Software strategies The survey consisted of closed and opened ques-
that are applicable to portable computer energy man- tions, in order to ensure the best possible feedback
agement were surveyed in (Lorch, Smith, 1998). The from each individual and freedom of expression.
study covers all components of a portable device, in-
cluding wireless interfaces. 3.1. Consumption of multimedia content
Another paper by (Kennedy et al., 2012) also ad-
dressed energy consumption of different components The first part was devoted to the consumption of
of a mobile device during multimedia streaming. As multimedia content. Figure 1 shows the percentage
far as the networking interface is concerned, the au- of users consuming this type of content, whereas the
thors mostly focused on link layer solutions, as well popularity of online streaming platforms is shown in
as cross layer multimedia delivery mechanisms. While Fig. 2.
most studies analyse multimedia streaming in the regu-
lar client-server architecture, a survey on the research
on QoS (Quality of Service) for peer-to-peer media dis-
tribution was presented in (Xiong et al., 2011). How-
ever, that survey did not discuss energy consumption
required for multimedia streaming.
In (Počta, Beerends, 2015), the authors investi-
gate the perceived quality of current audio-based ser-
vices; (Uhl et al., 2017) and (Brachmański, 2018)
describe quality evaluations of speech signals. Biases
encountered in modern audio listening tests are dis-
cussed in (Zieliński, 2016). In (Leszczuk et al., 2013) Fig. 1. Consumption of multimedia content.
and (Uhl, Paulsen, 2014), both QoS and QoE (Qual-
ity of Experience) aspects related to video stream-
ing services are investigated. Additional information
on multimedia broadcasting and multicasting, partic-
ularly in mobile networks, may be found in (Iwacz
et al., 2008).
Another paper, by (Gilski, Stefański, 2016),
talks about the possibilities, limitations, and user ex-
pectations related to analogue and digital services.
After an extensive literature review, no surveys were
found on the topic of consumption of multimedia con- Fig. 2. Usage of streaming platforms.
tent using mobile devices. That is why this year to year
case study was carried out. As it can be seen, the majority of users are in-
terested in consumption of multimedia content. The
3. Survey percentage of active users exceeds 70%, with an ex-
ception in 2017, where a slight decrease was observed.
In order to evaluate current trends in the multi- The main cause for choosing streaming platforms, and
media content consumption, a survey had been carried not traditional terrestrial networks, including digital
324 Archives of Acoustics – Volume 45, Number 2, 2020
Fig. 5. Usage of portable multimedia player devices. Fig. 8. Preferred type of portable device.
and user expectations, International Journal of Elec- 20. Lorch J.R., Smith A.J. (1998), Software strate-
tronics and Telecommunications, 62(4): 353–361, doi: gies for portable computer energy management, IEEE
10.1515/eletel-2016-0049. Personal Communications, 5(3): 60–73, doi: 10.1109/
8. Gilski P. (2017a), DAB vs DAB+ radio broadcasting: 98.683740.
a subjective comparative study, Archives of Acoustics, 21. Mohapatra S., Venkatasubramanian N. (2003),
42(4): 157–165, doi: 10.1515/aoa-2017-0074. PARM: power aware reconfigurable middleware,
9. Gilski P. (2017b), Adaptive multiplex resource al- Proceedings of the 23rd International Conference
location method for DAB+ broadcast system, Pro- on Distributed Computing Systems, Providence, RI,
ceedings of 21st Signal Processing: Algorithms, Archi- USA, May 19–22, 2003, pp. 312–319, doi: 10.1109/
tectures, Arrangements, and Applications, SPA 2017, ICDCS.2003.1203480.
Poznań, Poland, September 20–22, 2017, pp. 337–342, 22. Počta P., Beerends J.G. (2015), Subjective and ob-
doi: 10.23919/SPA.2017.8166889. jective assessment of perceived audio quality of current
10. Havinga P.J.M., Smit G.J.M. (2001), Energy- digital audio broadcasting systems and web-casting ap-
efficient wireless networking for multimedia applica- plications, IEEE Transactions on Broadcasting, 61(3):
tions, Wireless Communications and Mobile Comput- 407–415, doi: 10.1109/TBC.2015.2424373.
ing, 1(2): 165–184, doi: 10.1002/wcm.9. 23. Simunic T., Benini L., Acquaviva A., Glynn P.,
11. Hoque M.A., Siekkinen M., Nurminen J.K. De Micheli G. (2001), Dynamic voltage scaling and
(2011), On the energy efficiency of proxy-based traf- power management for portable systems, Proceedings
fic shaping for mobile audio streaming, Proceedings of of the 38th Annual Design Automation Conference,
Consumer Communications and Networking Confer- DAC ‘01, Las Vegas, NV, USA, June 18–22, 2001, pp.
ence, CCNC 2011, Las Vegas, NV, USA, January 9–12, 524–529, doi: 10.1145/378239.379016.
2011, pp. 891–895, doi: 10.1109/CCNC.2011.5766635.
24. Uhl T., Paulsen S. (2014), The new, parameter-
12. Hoque M.A., Siekkinen M., Nurminen J.K. ized VT model for determining quality in the video-
(2014), Energy efficient multimedia streaming to mo- telephony service, Bulletin of the Polish Academy
bile devices – a survey, IEEE Communications Sur- of Sciences: Technical Sciences, 62(3): 431–437, doi:
veys & Tutorials, 16(1): 579–597, doi: 10.1109/SURV. 10.2478/bpasts-2014-0045.
2012.111412.00051.
25. Uhl T., Paulsen S., Nowicki K. (2017), New
13. Hsiu P.C., Lin C.H., Hsieh C.K. (2011), Dynamic approach for determining the QoS of MP3-coded
backlight scaling optimization for mobile stream- voice signals in IP networks, EURASIP Journal on
ing applications, Proceedings of the 17th IEEE/ACM Audio Speech and Music Processing, 1: 1–9, doi:
International Symposium on Low-Power Electronics 10.1186/s13636-016-0099-4.
and Design, ISLPED ’11, Fukuoka, Japan, August
1–3, 2011, pp. 309–314, doi: 10.1109/ISLPED.2011. 26. Vallina-Rodriguez N., Crowcroft J. (2012),
5993655. Energy management techniques in modern mobile
handsets, IEEE Communications Surveys & Tutori-
14. Iwacz G., Jajszczyk A., Zajączkowski M. (2008),
als, 15(1): 179–198, doi: 10.1109/SURV.2012.021312.
Multimedia broadcasting and multicasting in mobile
00045.
networks, Chichester, United Kingdom: John Wiley &
Sons. 27. Wang R., Tsai J., Maciocco C., Tai T.Y.C., Wu J.
(2011), Reducing power consumption for mobile plat-
15. Kennedy M., Ksentini A., Hadjadj-Aoul Y.,
forms via adaptive traffic coalescing, IEEE Journal on
Muntean G.M. (2012), Adaptive energy optimization
Selected Areas in Communications, 29(8): 1618–1629,
in multimedia-centric wireless devices: a survey, IEEE
doi: 10.1109/JSAC.2011.110911.
Communications Surveys & Tutorials, 15(2): 768–786,
doi: 10.1109/SURV.2012.072412.00115. 28. Xiong X., Song J., Yue G., Liu J., Xie L. (2011),
16. Koenen R. (2002), Overview of the MPEG-4 standard, Survey: research on QoS of P2P reliable streaming
Geneva, Switzerland. media, Journal of Networks, 6(8): 1114–1121, doi:
10.4304/jnw.6.8.1114-1121.
17. Kostek B. (2018), Listening to live music: life be-
yond music recommendation systems, Proceedings of 29. Zhang J., Wu D., Ci S., Wang H., Katsagge-
Joint Conference – Acoustics 2018, Ustka, Poland, los A.K. (2009), Power-aware mobile multimedia:
September 11–14, 2018, pp. 1–5, doi: 10.1109/ACOUS- a survey, Journal of Communications, 4(9):600–613,
TICS.2018.8502385. doi: 10.4304/jcm.4.9.600-613.
18. Leszczuk M., Janowski L., Romaniak P., Papir Z. 30. Zieliński S. (2016), On some biases encountered
(2013), Assessing quality of experience for high defini- in modern audio quality listening tests (part 2): se-
tion video streaming under diverse packet loss patterns, lected graphical examples and discussion, Journal of
Signal Processing: Image Communication, 28(8): 903– the Audio Engineering Society, 64(1/2): 55–74, doi:
916, doi: 10.1016/j.image.2012.09.006. 10.17743/jaes.2015.0094.
19. Lin C.H., Liu J.C., Liao C.W. (2010), Energy ana- 31. Zyka K. (2019), The digital audio broadcasting jour-
lysis of multimedia video decoding on mobile handheld ney from the lab to listeners – the Czech Repub-
devices, Computer Standards & Interfaces, 32(1–2): lic case study, Radioengineering, 28(2): 483–490, doi:
10–17, doi: 10.1016/j.csi.2009.04.003. 10.13164/re.2019.0483.