The Virtual Emotion Loop: Towards Emotion-Driven Product Design via Virtual Reality
Davide Andreoletti, Luca Luceri, Achille Peternier, Tiziano Leidi, Silvia Giordano
DOI: http://dx.doi.org/10.15439/2021F120
Citation: Proceedings of the 16th Conference on Computer Science and Intelligence Systems, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 25, pages 371–378 (2021)
Abstract. Emotions play a significant role in product design for end-users. However, how to take emotions into account is not yet completely understood. We argue that this gap is due to a lack of methodological and technological frameworks for effective investigation of the elicitation conditions related to emotions and corresponding emotional responses of the users. Emotion-driven design should encompass a thorough assessment of users' emotional reactions in relation to certain elicitation conditions. By using Virtual Reality (VR) as mean to perform this investigation, we propose a novel methodological framework, referred to as the VR-Based Emotion-Elicitation-and-Recognition loop (VEE-loop), to close this gap.
References
- T. Alaniz and S. Biazzo, “Emotional design: the development of a process to envision emotion-centric new product ideas,” Procedia Computer Science, vol. 158, pp. 474–484, 2019.
- G. Zaltman, “The subconscious mind of the consumer (and how to reach it),” Harvard Business School. Working Knowledge. Obtenido de http://hbswk. hbs. edu/item/3246. html, 2003.
- C. Wrigley and K. Straker, Affected: Emotionally engaging customers in the digital age. John Wiley & Sons, 2019.
- R. Dou, Y. Zhang, and G. Nan, “Iterative product design through group opinion evolution,” International Journal of Production Research, vol. 55, no. 13, pp. 3886–3905, 2017.
- P. B. Luh, F. Liu, and B. Moser, “Scheduling of design projects with uncertain number of iterations,” European Journal of Operational Research, vol. 113, no. 3, pp. 575–592, 1999.
- G. Riva, F. Mantovani, C. S. Capideville, A. Preziosa, F. Morganti, D. Villani, A. Gaggioli, C. Botella, and M. Alcañiz, “Affective interactions using virtual reality: the link between presence and emotions,” CyberPsychology & Behavior, vol. 10, no. 1, pp. 45–56, 2007.
- A. Ortigosa, J. M. Martín, and R. M. Carro, “Sentiment analysis in facebook and its application to e-learning,” Computers in human behavior, vol. 31, pp. 527–541, 2014.
- M. Nagamachi, “Kansei engineering: a new ergonomic consumer-oriented technology for product development,” International Journal of industrial ergonomics, vol. 15, no. 1, pp. 3–11, 1995.
- Y. Liu, O. Sourina, and M. R. Hafiyyandi, “Eeg-based emotion-adaptive advertising,” in 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction. IEEE, 2013, pp. 843–848.
- P. Desmet, “Designing emotions,” 2002.
- S. Sinek, Start with why: How great leaders inspire everyone to take action. Penguin, 2009.
- N. H. Frijda et al., The emotions. Cambridge University Press, 1986.
- P. M. Desmet, S. F. Fokkinga, D. Ozkaramanli, and J. Yoon, “Emotion-driven product design,” in Emotion Measurement. Elsevier, 2016, pp. 405–426.
- C. Kim, J. Yoon, P. Desmet, and A. Pohlmeyer, “Designing for positive emotions: Issues and emerging research directions,” 2021.
- J. Yoon, A. E. Pohlmeyer, and P. Desmet, “When’feeling good’is not good enough: Seven key opportunities for emotional granularity in product development,” International Journal of Design, vol. 10, no. 3, pp. 1–15, 2016.
- E. Sauerwein, F. Bailom, K. Matzler, and H. H. Hinterhuber, “The kano model: How to delight your customers,” in International working seminar on production economics, vol. 1, no. 4, 1996, pp. 313–327.
- J. Diemer, G. W. Alpers, H. M. Peperkorn, Y. Shiban, and A. Mühlberger, “The impact of perception and presence on emotional reactions: a review of research in virtual reality,” Frontiers in Psychology, vol. 6, p. 26, 2015. [Online]. Available: https://www.frontiersin.org/article/10.3389/fpsyg.2015.00026
- J. Marín-Morales, J. L. Higuera-Trujillo, A. Greco, J. Guixeres, C. Llinares, C. Gentili, E. P. Scilingo, M. Alcañiz, and G. Valenza, “Real vs. immersive-virtual emotional experience: Analysis of psycho-physiological patterns in a free exploration of an art museum,” PLOS ONE, vol. 14, no. 10, pp. 1–24, 10 2019. [Online]. Available: https://doi.org/10.1371/journal.pone.0223881
- S. K. Babu, S. Krishna, U. R., and R. R. Bhavani, “Virtual reality learning environments for vocational education: A comparison study with conventional instructional media on knowledge retention.” in 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), 2018, pp. 385–389.
- C. Floris, S. Solbiati, F. Landreani, G. Damato, B. Lenzi, V. Megale, and E. G. Caiani, “Feasibility of heart rate and respiratory rate estimation by inertial sensors embedded in a virtual reality headset,” Sensors, vol. 20, no. 24, 2020. [Online]. Available: https://www.mdpi.com/1424-8220/20/24/7168
- M. Buccoli, M. Zanoni, A. Sarti, S. Tubaro, and D. Andreoletti, “Unsupervised feature learning for music structural analysis,” in 2016 24th European Signal Processing Conference (EUSIPCO). IEEE, 2016, pp. 993–997.
- A. Mehrabian, “Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament,” Current Psychology, vol. 14, no. 4, pp. 261–292, 1996.
- S. B. i Badia, L. V. Quintero, M. S. Cameirão, A. Chirico, S. Triberti, P. Cipresso, and A. Gaggioli, “Toward emotionally adaptive virtual reality for mental health applications,” IEEE journal of biomedical and health informatics, vol. 23, no. 5, pp. 1877–1887, 2018.
- J. Marín Morales, “Modelling human emotions using immersive virtual reality, physiological signals and behavioural responses,” Ph.D. dissertation, 2020.
- A. Saxena, A. Khanna, and D. Gupta, “Emotion recognition and detection methods: A comprehensive survey,” Journal of Artificial Intelligence and Systems, vol. 2, no. 1, pp. 53–79, 2020.
- S. Susindar, M. Sadeghi, L. Huntington, A. Singer, and T. K. Ferris, “The feeling is real: Emotion elicitation in virtual reality,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 63, no. 1. SAGE Publications Sage CA: Los Angeles, CA, 2019, pp. 252–256.
- K. Fung, C. K. Kwong, K. W. M. Siu, and K. M. Yu, “A multi-objective genetic algorithm approach to rule mining for affective product design,” Expert Systems with Applications, vol. 39, no. 8, pp. 7411–7419, 2012.
- M. Polignano, F. Narducci, M. de Gemmis, and G. Semeraro, “Towards emotion-aware recommender systems: an affective coherence model based on emotion-driven behaviors,” Expert Systems with Applications, vol. 170, p. 114382, 2021.
- M. B. Mariappan, M. Suk, and B. Prabhakaran, “Facefetch: A user emotion driven multimedia content recommendation system based on facial expression recognition,” in 2012 IEEE International Symposium on Multimedia. IEEE, 2012, pp. 84–87.
- N. Sindhu, S. Jerritta, and R. Anjali, “Emotion driven mood enhancing multimedia recommendation system using physiological signal,” in IOP Conference Series: Materials Science and Engineering, vol. 1070, no. 1. IOP Publishing, 2021, p. 012070.
- N. Condori-Fernandez, “Happyness: an emotion-aware qos assurance framework for enhancing user experience,” in 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C). IEEE, 2017, pp. 235–237.
- M. S. Hossain, G. Muhammad, B. Song, M. M. Hassan, A. Alelaiwi, and A. Alamri, “Audio–visual emotion-aware cloud gaming framework,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 12, pp. 2105–2118, 2015.
- S. Munoz, O. Araque, J. F. Sánchez-Rada, and C. A. Iglesias, “An emotion aware task automation architecture based on semantic technologies for smart offices,” Sensors, vol. 18, no. 5, p. 1499, 2018.
- V. De Luca, “Emotions-based interactions: Design challenges for increasing well-being,” 2016.
- V. a. De Luca, “Oltre l’interfaccia: emozioni e design dell’interazione per il benessere,” MD Journal, vol. 1, no. 1, pp. 106–119, 2016.