|
DOI: 10.14489/vkit.2022.05.pp.018-025
Воронина А. А., Шабалина О. А., Садовникова Н. П.
ВОВЛЕЧЕННОСТЬ ПОЛЬЗОВАТЕЛЯ ПРОГРАММНОГО ОБЕСПЕЧЕНИЯ: СПОСОБЫ ОЦЕНКИ И ВОЗМОЖНОСТИ ПРИМЕНЕНИЯ
(с. 18-25)
Аннотация. Исследован феномен вовлеченности как характеристики профессиональной деятельности человека. Проведена классификация методов оценки вовлеченности, различаемых по типам собираемых данных, способам их сбора, обработки и интерпретации в контексте вовлеченности. Рассмотрено понятие вовлеченности пользователя программного обеспечения (ПО) как реакции пользователя на взаимодействие с этим программным обеспечением. Показаны возможности применения результатов оценки вовлеченности пользователя ПО для оценки деятельности людей, непосредственно связанной с использованием ПО, и качества самого ПО, с которым взаимодействует пользователь.
Ключевые слова: программное обеспечение; характеристика программного обеспечения; вовлеченность; оценка вовлеченности; метод оценки вовлеченности; вовлеченность пользователя программного обеспечения; автоматизированная оценка вовлеченности; программное средство оценки вовлеченности.
Voronina A. A., Shabalina O. A., Sadovnikova N. P.
SOFTWARE USER ENGAGEMENT: METHODS OF EVALUATION AND APPLICATIONS
(pp. 18-25)
Abstract. The article explores phenomenon of engagement as a socio-psychological category that determines physical, emotional and intellectual state of a person involved in any activity. Further, engagement is considered as one of the factors that significantly affects the effectiveness and success of a person's professional activity. Methods for assessing engagement, distinguished by the types of data collected and approaches for their collection, processing and interpretation in the context of engagement, are analyzed. Existing software tools for assessing engagement based on self-assessment and systems for automatic assessment of engagement based on computer vision and machine learning methods are described. The concept of software user engagement as a user's reaction to interaction with this software is considered. The possibilities of using the results of user engagement assessment to assess the activities of people directly related to the use of the software are shown. Various factors that determine the interaction of the user with the software and affect his engagement are analyzed. The possibilities of using user engagement to assess competitiveness, usability, popularity and the overall quality of the software itself with which the user interacts are considered. Approaches to using the results of the user engagement assessment for adapting the learning process in learning systems are considered. The method of combined online assessment of engagement is described, in which engagement is considered as an indirect assessment of the success of the user's learning process and the results of the analysis of engagement are used to adapt the learning process to this user. The results of the study are represented as a mental map with the categorization of the concept of engagement. Directions for further research are described related to the development of an intelligent support system for assessing user engagement, based on the analysis of observed heterogeneous data on the current state of the user and behavioral metrics collected in the process of user interaction with the software and a combination of methods for their processing.
Keywords: Software; Software characteristics; Engagement; Engagement assessment; Engagement assessment method; Software user engagement; Automated assessment of engagement; Software tool for assessment of engagement.
А. А. Воронина, О. А. Шабалина, Н. П. Садовникова (Волгоградский государственный технический университет, Волгоград, Россия) E-mail:
Этот e-mail адрес защищен от спам-ботов, для его просмотра у Вас должен быть включен Javascript
A. A. Voronina, O. A. Shabalina, N. P. Sadovnikova (Volgograd State Technical University, Volgograd, Russia) E-mail:
Этот e-mail адрес защищен от спам-ботов, для его просмотра у Вас должен быть включен Javascript
1. Вовлеченность [Электронный ресурс]. URL: https://www.psychologos.ru/articles/view/vovlechennost (дата обращения: 25.11.2021).
2. Douglas Y., Hargadon A. The Pleasure Principle: Immersion, Engagement, Flow // Proceedings of the Eleventh ACM Conference on Hypertext and Hypermedia. San Antonio. New York: ACM Press, 2000. P. 153 – 160.
3. Киселева Н. В. Социально-психологические характеристики вовлеченности в непрерывное образование: автореф. дис. … канд. психол. наук: 19.00.15 / Академия управления Министерства внутренних дел РФ. Москва, 2019. 26 с.
4. Воронина А. А., Шабалина О. А., Катаев А. В. Метод комбинированной онлайн-оценки вовлеченности в адаптивных обучающих системах // Вестник компьютерных и информационных технологий. 2021. Т. 18, № 7. C. 27 ‒ 36. DOI 10.14489/vkit.2021.07.pp.027-036
5. Marrelli A. F. Employee Engagement and Performance Management in the Federal Sector // Performance Improvement. May 2011.
6. Shrotryia V. K., Dhanda U. Development of Employee Engagement Measure: Experiences from Best Companies to Work for in India // Measuring Business Excellence. May 2020.
7. Gallup [Электронный ресурс]. URL: https://www.gallup.com (дата обращения: 25.02.2022).
8. Watt H. M. G., Richardson P. W., Wilkins K. Profiles of Professional Engagement and Career Development Aspirations Among USA Preservice Teachers // International Journal of Educational Research. 2014. V. 65. P. 23 ‒ 40. DOI https://doi.org/10.1016/j.ijer.2013.09.008
9. Holmes N. Engaging with Assessment: Increasing Student Engagement Through Continuous Assessment // Active Learning in Higher Education. 2017. V. 19(1). P. 23 ‒ 34.
10. Gray J., Diloreto M. The Effects of Student Engagement, Student Satisfaction, and Perceived Learning in Online Learning Environments // International Journal of Educational Leadership Preparation. 2016. V. 11. P. 89 ‒ 119.
11. Lalmas M., O’Brien H., Yom-Tov E. Measuring User Engagement // Synthesis Lectures on Information Concepts, Retrieval, and Services. 2015. P. 11 ‒ 58.
12. Воронина А. А., Шабалина О. А., Катаев А. В. Методы оценки вовлеченности пользователей интерактивных приложений // Информационные технологии в науке, образовании и управлении. 2019. № 4(14). С. 70 ‒ 74.
13. Holdener M., Gut A., Angerer A. Applicability of the User Engagement Scale to Mobile Health: A Survey-Based Quantitative Study // JMIR Mhealth Uhealth. 2020. V. 8(1):e13244. DOI 10.2196/13244
14. O’Brien H. L, Cairns P., Hall M. A Practical Approach to Measuring User Engagement with the Refined User Engagement Scale (UES) and New UES Short Form // International Journal of Human-Computer Studies. 2018. V. 112. P. 28 ‒ 39.
15. EFS (Enterprise Feedback Suite) Survey [Электронный ресурс]. URL: https://community.questback.com/ s/questback-efs-survey (дата обращения: 25.11.2021).
16. Hung Ya-Hsin, Parsons P. Assessing User Engagement in Information Visualization. 2017.
17. The Faces of Engagement: Automatic Recognition of Student Engagement from Facial Expressions / J. Whitehill, Z. Serpell, Y. Lin et al. // IEEE Transactions on Affective Computing. 1 Jan. ‒ March 2014. V. 5. No. 1. P. 86 ‒ 98. DOI 10.1109/TAFFC.2014.2316163
18. Automatic Recognition of Student Engagement Using Deep Learning and Facial Expression / O. M. Nezami, M. Dras, L. Hamey et al. 2020.
19. Automated Detection of Engagement Using Video-Based Estimation of Facial Expressions and Heart Rate / H. Monkaresi, N. Bosch, R. A. Calvo, S. K. DʼMello // IEEE Transactions on Affective Computing. 1 January ‒ March 2017. V. 8, No. 1. P. 15 ‒ 28. DOI https://dl.acm.org/doi/10.1109/TAFFC.2016.2515084
20. Holmes G., Donkin A., Witten I. H. WEKA: a Machine Learning Workbench // Proceedings of the 1994 Second Australian and New Zealand Conference on Intelligent Information Systems. 1994. P. 357 – 361.
21. Ng S. C., Sweeney J. C., Plewa C. Customer Engagement: A Systematic Review and Future Research Priorities // Australasian Marketing Journal. 2020. V. 28. P. 235 ‒ 252. DOI https://doi.org/10.1016/j.ausmj.2020.05.004
22. User Engagement [Электронный ресурс]. URL: https://whatis.techtarget.com/definition/user-engage- ment (дата обращения: 25.11.2021).
23. Лифшиц М. В., Макарова О. А. Факторы активной вовлеченности личности в использование социальных сетей // Научное мнение. 2016. № 16. С. 138 ‒ 143.
24. Козлова Н. С., Алтухова Л. В. Влияние социальных установок на специфику вовлеченности личности в интернет-пространство // Международный научный журнал. 2015. № 9. С. 35 ‒ 37.
25. Какая вовлеченность нужна вашему продукту и как ее точнее измерить [Электронный ресурс]. URL: https://habr.com/ru/post/332304/ (дата обращения: 25.11.2021).
26. How Google’s 'ten Things we Know to be True' Could Guide the Development of Mental Health Mobile Apps / S. P. Jones, V. Patel, S. Saxena et al. // Health Aff (Millwood). 2014 Sep. V. 33(9). P. 1603 ‒ 1611.
27. Assessing User Engagement of an mHealth Intervention: Development and Implementation of the Growing Healthy app Engagement Index / S. Taki, S. Lymer, C. G. Russell et al. // JMIR Mhealth Uhealth. 29 Jun 2017. V. 5(6):e89.
28. Zhao Z., Balagué C. Designing Branded Mobile Apps: Fundamentals and Recommendations // Bus Horiz. 2015. V. 58(3). P. 305 ‒ 315.
29. Kim Y. H, Kim D. J, Wachter K. A Study of Mobile User Engagement (MoEN): Engagement Motivations, Perceived Value, Satisfaction, and Continued Engagement Intention // Decis Support Syst. 2013. V. 56. P. 361 ‒ 370.
30. Tarute A., Nikou S., Gatautis R. Mobile Application Driven Consumer Engagement // Telemat Inform 2017. V. 34(4). P. 145 ‒ 156.
31. Model of User Engagement / Lehmann J., Lalmas M., Yom-Tov E., Dupret G. 2012.
32. User experience [Электронный ресурс]. URL: https://en.wikipedia.org/wiki/User_experience (дата обращения: 25.11.2021).
33. Шабалина О. А., Катаев А. В., Воронина А. А. Адаптация к вовлеченности пользователя в адаптивной обучающей игре // Моделирование, оптимизация и информационные технологии: электронный научный журнал. 2020. Т. 8, № 2(29). С. 9.
1. Involvement. Available at: https://www.psychologos.ru/articles/view/vovlechennost (Accessed: 25.11.2021). [in Russian language]
2. Douglas Y., Hargadon A. (2000). The Pleasure Principle: Immersion, Engagement, Flow. Proceedings of the Eleventh ACM Conference on Hypertext and Hypermedia, pp. 153 – 160. San Antonio. New York: ACM Press.
3. Kiseleva N. V. (2019). Socio-Psychological Characteristics of Involvement in Lifelong Education. Academy of Management of the Ministry of Internal Affairs of the Russian Federation. Moscow. [in Russian language]
4. Voronina A. A., Shabalina O. A., Kataev A. V. (2021). Combined Online Engagement Assessment Method in Adaptive Learning Systems. Vestnik komp'yuternyh i informatsionnyh tekhnologiy, Vol. 18, (7), pp. 27 ‒ 36. [in Russian language] DOI 10.14489/vkit.2021.07.pp.027-036
5. Marrelli A. F. (2011). Employee Engagement and Performance Management in the Federal Sector. Performance Improvement.
6. Shrotryia V. K., Dhanda U. (2020). Development of Employee Engagement Measure: Experiences from Best Companies to Work for in India. Measuring Business Excellence.
7. Gallup. Available at: https://www.gallup.com (Accessed: 25.02.2022).
8. Watt H. M. G., Richardson P. W., Wilkins K. (2014). Profiles of Professional Engagement and Career Development Aspirations Among USA Preservice Teachers. International Journal of Educational Research, Vol. 65, pp. 23 ‒ 40. DOI https://doi.org/10.1016/j.ijer.2013.09.008
9. Holmes N. (2017). Engaging with Assessment: Increasing Student Engagement Through Continuous Assessment. Active Learning in Higher Education, Vol. 19, (1), pp. 23 ‒ 34.
10. Gray J., Diloreto M. (2016). The Effects of Student Engagement, Student Satisfaction, and Perceived Learning in Online Learning Environments. International Journal of Educational Leadership Preparation, Vol. 11, pp. 89 ‒ 119.
11. Lalmas M., O’Brien H., Yom-Tov E. (2015). Measuring User Engagement. Synthesis Lectures on Information Concepts, Retrieval, and Services, pp. 11 ‒ 58.
12. Voronina A. A., Shabalina O. A., Kataev A. V. (2019). Methods for assessing the involvement of users of interactive applications. Informatsionnye tekhnologii v nauke, obrazovanii i upravlenii, 14(4), pp. 70 ‒ 74. [in Russian language]
13. Holdener M., Gut A., Angerer A. (2020). Applicability of the User Engagement Scale to Mobile Health: A Survey-Based Quantitative Study. JMIR Mhealth Uhealth, Vol. 8, (1):e13244. DOI 10.2196/13244
14. O’Brien H. L, Cairns P., Hall M. (2018). A Practical Approach to Measuring User Engagement with the Refined User Engagement Scale (UES) and New UES Short Form. International Journal of Human-Computer Studies, Vol. 112, pp. 28 ‒ 39.
15. EFS (Enterprise Feedback Suite) Survey. Available at: https://community.questback.com/s/questback-efs-survey (Accessed: 25.11.2021).
16. Hung Ya-Hsin, Parsons P. (2017). Assessing User Engagement in Information Visualization.
17. Whitehill J., Serpell Z., Lin Y. et al. (2014). The Faces of Engagement: Automatic Recognition of Student Engagement from Facial Expressions. IEEE Transactions on Affective Computing, Vol. 5, (1), pp. 86 ‒ 98. DOI 10.1109/TAFFC.2014.2316163
18. Nezami O. M., Dras M., Hamey L. et al. (2020). Automatic Recognition of Student Engagement Using Deep Learning and Facial Expression.
19. Monkaresi H., Bosch N., Calvo R. A., D'Mello S. K. (2017). Automated Detection of Engagement Using Video-Based Estimation of Facial Expressions and Heart Rate. IEEE Transactions on Affective Computing, Vol. 8, (1), pp. 15 ‒ 28. DOI https://dl.acm.org/doi/10.1109/TAFFC.2016.2515084
20. Holmes G., Donkin A., Witten I. H. (1994). WEKA: a Machine Learning Workbench. Proceedings of the 1994 Second Australian and New Zealand Conference on Intelligent Information Systems, pp. 357 – 361.
21. Ng S. C., Sweeney J. C., Plewa C. (2020). Customer Engagement: A Systematic Review and Future Research Priorities. Australasian Marketing Journal, Vol. 28, pp. 235‒252. Available at: https://doi.org/10.1016/j.ausmj. 2020.05.004
22. User Engagement. Available at: https://whatis.techtarget.com/definition/user-engagement (Accessed: 25.11.2021).
23. Lifshits M. V., Makarova O. A. (2016). Factors of active involvement of the individual in the use of social networks. Nauchnoe mnenie, 16, pp. 138 ‒ 143. [in Russian language]
24. Kozlova N. S., Altuhova L. V. (2015). The influence of social attitudes on the specifics of the involvement of the individual in the Internet space. Mezhdunarodniy nauchniy zhurnal, (9), pp. 35 ‒ 37. [in Russian language]
25. What engagement does your product need and how to accurately measure it. Available at: https://habr.com/ru/post/332304/ (Accessed: 25.11.2021). [in Russian language]
26. Jones S. P., Patel V., Saxena S. et al. (2014). How Google’s 'ten Things we Know to be True' Could Guide the Development of Mental Health Mobile Apps. Health Aff (Millwood), Vol. 33, (9), pp. 1603 ‒ 1611.
27. Taki S., Lymer S., Russell C. G. et al. (2017). Assessing User Engagement of an mHealth Intervention: Development and Implementation of the Growing Healthy app Engagement Index. JMIR Mhealth Uhealth, Vol. 5, (6):e89.
28. Zhao Z., Balagué C. (2015). Designing Branded Mobile Apps: Fundamentals and Recommendations. Business Horizons, Vol. 58, (3), pp. 305 ‒ 315.
29. Kim Y. H, Kim D. J, Wachter K. (2013). A Study of Mobile User Engagement (MoEN): Engagement Motivations, Perceived Value, Satisfaction, and Continued Engagement Intention. Decision Support Systems, Vol. 56, pp. 361 ‒ 370.
30. Tarute A., Nikou S., Gatautis R. (2017). Mobile Application Driven Consumer Engagement. Telematics and Informatics, Vol. 34, (4), pp. 145 ‒ 156.
31. Lehmann J., Lalmas M., Yom-Tov E., Dupret G. (2012). Model of User Engagement.
32. User experience. Available at: https://en.wikipedia.org/wiki/User_experience (Accessed: 25.11.2021).
33. Shabalina O. A., Kataev A. V., Voronina A. A. (2020). Adapting to User Engagement in an Adaptive Learning Game. Modelirovanie, optimizatsiya i informatsionnye tekhnologii: elektronniy nauchniy zhurnal, Vol. 8, 29(2), pp. 9. [in Russian language]
Статью можно приобрести в электронном виде (PDF формат).
Стоимость статьи 500 руб. (в том числе НДС 18%). После оформления заказа, в течение нескольких дней, на указанный вами e-mail придут счет и квитанция для оплаты в банке.
После поступления денег на счет издательства, вам будет выслан электронный вариант статьи.
Для заказа скопируйте doi статьи:
10.14489/vkit.2022.05.pp.018-025
и заполните форму
Отправляя форму вы даете согласие на обработку персональных данных.
.
This article is available in electronic format (PDF).
The cost of a single article is 500 rubles. (including VAT 18%). After you place an order within a few days, you will receive following documents to your specified e-mail: account on payment and receipt to pay in the bank.
After depositing your payment on our bank account we send you file of the article by e-mail.
To order articles please copy the article doi:
10.14489/vkit.2022.05.pp.018-025
and fill out the form
.
|
Current Issue
Разработка концепции и создание сайта - ООО «Издательский дом «СПЕКТР»