hj – Jun HU :: HU, Jun

Posted on May 12, 2023May 12, 2023 by hj

Context-Enhanced Human-Robot Interaction: Exploring the Role of System Interactivity and Multimodal Stimuli on the Engagement of People with Dementia

Yuan Feng et al.

Engaging people with dementia (PWD) in meaningful activities is the key to promote their quality of life. Design towards a higher level of user engagement has been extensively studied within the human-computer interaction community, however, few extend to PWD. It is generally considered that increased richness of experiences can lead to enhanced engagement. Therefore, this paper explores the effects of rich interaction in terms of the role of system interactivity and multimodal stimuli by engaging participants in context-enhanced human-robot interaction activities. The interaction with a social robot was considered context-enhanced due to the additional responsive sensory feedback from an augmented reality display. A field study was conducted in a Dutch nursing home with 16 residents. The study followed a two by two mixed factorial design with one within-subject variable – multimodal stimuli – and one between-subject variable – system interactivity. A mixed method of video coding analysis and observational rating scales was adopted to assess user engagement comprehensively. Results disclose that when additional auditory modality was included besides the visual-tactile stimuli, participants had significantly higher scores on attitude, more positive behavioral engagement during activity, and a higher percentage of communications displayed. The multimodal stimuli also promoted social interaction between participants and the facilitator. The findings provide sufficient evidence regarding the significant role of multimodal stimuli in promoting PWD’s engagement, which could be potentially used as a motivation strategy in future research to improve emotional aspects of activity-related engagement and social interaction with the human partner.

Y. Feng, G. Perugia, S. Yu, E. I. Barakova, J. Hu, and G. W. M. Rauterberg, “Context-Enhanced Human-Robot Interaction: Exploring the Role of System Interactivity and Multimodal Stimuli on the Engagement of People with Dementia,” International Journal of Social Robotics, vol. 14, no. 3, pp. 807-826, 2022/04/01, 2022.
FULLTEXT: PDF REFERENCE: BibTeX EndNote
DOI: 10.1007/s12369-021-00823-4

Posted on April 26, 2023 by hj

Towards the Senior Resident Social Interaction System: A CaseStudy of Interactive Gallery

The number of older adults residing in nursing institutions is increasing, and many of them experience social isolation. The social interaction of older adults constitutes a complex system that involves multiple stakeholders, including fellow residents, caregivers, members of the local community, etc. This paper proposes an Interactive Gallery, comprising a cluster of scenery collectors and an interactive installation resembling a gallery. It aims to promote social interaction among nursing home residents and members of the local community, as well as between senior residents within the nursing home. We conducted a field study that employed behavior observation and semi-structured interviews. Our findings show that the Interactive Gallery had a positive impact on the social interaction of senior participants, and it also stimulated their interest in sharing their experiences with individuals outside of the nursing home. The implications of our field study are significant. We highlight the social interaction system and behavioral characteristics of senior residents, strategies for enhancing social interaction within the nursing home, and strategies for promoting social interaction between senior residents and members of the local community. The Interactive Gallery presents a novel approach to addressing the issue of social isolation among senior residents in nursing homes. Our field study findings demonstrate its potential to improve the quality of life of seniors by promoting social interaction and engagement.

C. Li, L. Zhang, X. Lin, K. Kang, J. Hu, B. Hengeveld, and C. Hummels, “Towards the Senior Resident Social Interaction System: A Case Study of Interactive Gallery,” Systems, vol. 11, no. 4, pp. 204, 2023.
FULLTEXT: PDF REFERENCE: BibTeX EndNote
DOI: 10.3390/systems11040204

Posted on March 1, 2023March 1, 2023 by hj

The effect of fantasy on learning and recall of declarative knowledge in AR game-based learning

With increasing research attention on the application of Augmented Reality (AR) and Game elements in education, fantasy elements as imaginary, fictional game features have been shown to improve learners’ motivation and are critical to engaging and immersive experiences in AR game-based learning. With its affordance of enriching real-life education with virtual effects, AR game-based learning has shown its potential to improve recall performance in previous research. However, educators and researchers have concerns regarding the effect of employing fantasy game elements in AR game-based learning, suggesting learning with such elements will add cognitive load for children leading to a lower recall. To explore the effect of AR and fantasy in game-based learning for recalling declarative knowledge, we conducted an experiment involving 98 children participants and 26 adult participants from the Netherlands and China, using our own designed AR game- ChemiKami AR. We used a mixed ANOVA to identify the effect of fantasy and AR on knowledge recall. This study showed that using AR fantasy in game-based learning can improve recall of declarative knowledge and increase learning effectiveness in classroom learning contexts for children. We offer insights and guidelines for designing AR and fantasy experiences that enhance declarative knowledge recall for target groups with different ages, learning capacities, and cultural backgrounds.

T. Zuo, M. V. Birk, E. D. van der Spek, and J. Hu, “The effect of fantasy on learning and recall of declarative knowledge in AR game-based learning,” Entertainment Computing, vol. 46, pp. 100563, 2023/05/01/, 2023. FULLTEXT: PDF REFERENCE: BibTeX EndNote DOI: https://doi.org/10.1016/j.entcom.2023.100563

Posted on February 16, 2023 by hj

Social Balance Ball: Designing and Evaluating an Exergame That Promotes Social Interaction between Older and Younger Players

As the population ages rapidly, there is a strong focus on the healthy aging of older adults. A central part of healthy aging is keeping people connected in later social life. Exergames are recommended as one of the coping strategies to help improve health and quality of life in older adults. In our study, we developed an exergame called Social Balance Ball to engage older and younger people to play together, encouraging social interaction between generations. From May to July 2021, we evaluated this exergame in Shanghai, China, performing a user experiment with 18 unfamiliar young-old pairs under three test conditions (virtual player, mediated human player, and o-located human player). To evaluate the exergame, our main findings demonstrated that participants felt significantly perceived social interaction in mediated play and co-located play than in virtual play. Overall, older participants perceived significantly higher social interaction than younger participants. In this study, we contribute (1) empirical research findings on how the SocialBalance Ball exergame enhances social interaction in generations; (2) design implications for informing future design and development of social exergames

S. Qiu, E. Kaisar, R. Ding, T. Han, J. Hu, and M. Rauterberg, “Social Balance Ball: Designing and Evaluating an Exergame That Promotes Social Interaction between Older and Younger Players,” International Journal of Human–Computer Interaction, no. Online, pp. 1-24, 2023. FULLTEXT: PDF REFERENCE: BibTeX EndNote DOI: 10.1080/10447318.2023.2175157

Posted on February 9, 2023February 9, 2023 by hj

Designing with Fantasy in Augmented Reality Games for Learning

PhD Thesis, Tengjia Zuo

Contemporary young generations face numerous 21st-century learning challenges. Young students living in a technologically and information-rich culture benefit from advances in educational technology yet are distracted by the clutter that information technology brings. Previous work suggested that educators showed concerns about the effect of learning with digital technology in schools, and many students were disengaged and unsatisfied with e-learning environments.

T. Zuo, Designing with Fantasy in Augmented Reality Games for Learning, PhD Thesis, Department of Industrial Design, Eindhoven University of Technology, Eindhoven, 2023. FULLTEXT: PDF REFERENCE: BibTeX EndNote

Posted on July 11, 2022July 11, 2022 by hj

Technology Boosts People with Dementia’s Psychosocial Well-being

Yuan Feng gained her PhD Cum Laude at the department of Industrial Design on July 7th 2022. See the original article on TU/e website by Nicole van Overveld (Communication Advisor)

The PhD-research of Yuan Feng focuses on promoting the well-being of a vulnerable population in our society – people with dementia – using interactive technologies. Collaborating with the Vitalis Berckelhof, a Dutch residential care for elderly with and without dementia located in Eindhoven, Feng gave clients living there a way to relive the pasts and get closer to outdoor nature through simulated sensory experiences with rich interaction possibilities.

Y. Feng, Rich Interaction for People with Dementia: Designing Interactive Systems with Rich Interaction for Enhancing Engagement of People with Dementia Living in Long-term Care Facilities, PhD Thesis, Department of Industrial Design, Eindhoven University of Technology, Eindhoven, 2022. FULLTEXT: PDF REFERENCE: BibTeX EndNote

Posted on April 13, 2022July 11, 2022 by hj

Enhancing Social Interaction among Nursing Homes Residents with Interactive Public Display Systems

Kai Kang, Bart Hengeveld, Caroline Hummels, Jun Hu

Positive peer interaction in nursing homes has been consistently recognized as essential to residents’ life quality. However, low rates of resident-to-resident interaction were found to be pervasive. Our research explores the potential of applying public display systems to promote residents’ unplanned co-located interaction. This article describes the design and assessment of “Reading-to-Sharing” (R2S): a tabletop display system intended to improve nursing home residents’ social interaction by enhancing their public reading experience. R2S was assessed via supervised field trials, in which the participants were invited to experience R2S in real-life settings with necessary assistance. The objectives were mainly to investigate the participants’ engagement with R2S, user experience and the potential impact on residents’ social behaviors and feelings. The result showed that R2S was capable of engaging the participants in content viewing and sharing. It was effective in catalyzing and facilitating their social interaction. The participants’ perceived user experience was primarily favorable. Although R2S was anticipated to increase the participants’ mutual closeness, no statistically significant change was seen. The key implications were highlighted to guide the design of public display systems in this context.

K. Kang, B. Hengeveld, C. Hummels, and J. Hu, “Enhancing Social Interaction among Nursing Homes Residents with Interactive Public Display Systems,” International Journal of Human–Computer Interaction, pp. 1-17, 2022.
FULLTEXT: PDF REFERENCE: BibTeX EndNote
DOI: 10.1080/10447318.2021.2016234

Posted on April 1, 2022April 14, 2022 by hj

User-defined gestures for mediated social touch on touchscreens

Qianhui Wei, Jun Hu & Min Li

Mediated social touch is a new form of remote communication. Some researchers designed prototypes to deliver mediated social touch for mobile devices. However, there lacks a comprehensive analysis of the user-defined gestures of mediated social touch on touchscreens of mobile devices. We conducted an elicitation study for 24 social touch gestures on the touchscreen of smartphones and recorded physical parameters. We developed a user-defined gesture set considering physical properties and context. We provided classifications based on the movement forms. We found that social touch gestures with shorter duration were easier for participants to perform; participants were inclined to use social touch with an easier gesture more often. Participants were more likely to express happy or sad expressions rather than neutral emotions. Based on the findings, we discussed the implications for mediated social touch technology and its application on touchscreens.

Q. Wei, J. Hu, and M. Li, “Active and Passive Mediated Social Touch with Vibrotactile Stimuli in Mobile Communication,” Information, vol. 13, no. 2, pp. 63, 2022.
FULLTEXT: PDF REFERENCE: BibTeX EndNote
DOI: 10.3390/info13020063

Posted on November 11, 2021April 13, 2022 by hj

AffectiveViz: Designing Collective Stress Related Visualization

PhD Thesis, Mengru Xue

Stress is a cultural phenomenon that is socially distributed in organizations. Collective stress, the stress within a group or an organization, describes the stress perceived by the whole group or organization. Similar to individual stress, excessive collective stress may affect individuals’ health as well as social collaborations, so the management of these stressors is equally essential. Current solutions for collective stress are mainly distributed in the social psychology field. These approaches contain subjective bias, require specific attention, and can hardly be applied in office workers’ busy working routines. With the aid of technologies, Human-Computer Interaction (HCI) researchers provide users with actionable, data-driven self-insight to help them change their behavioral patterns for wellbeing. However, such technological interventions are mainly designed for individual stress management instead of a workgroup. Therefore, we see an opportunity to use technology to facilitate people to catch every nuance of change, to balance the subjective bias, and to improve office workers’ understanding of collective stress toward coping with it.

M. Xue, AffectiveViz: Designing Collective Stress Related Visualization, PhD Thesis, Department of Industrial Design, Eindhoven University of Technology, Eindhoven, 2021. FULLTEXT: PDF REFERENCE: BibTeX EndNote

Posted on September 10, 2021February 10, 2023 by hj

Research on Stress and Collective Stress

On collective stress:

M. Hoekstra, P.-l. Lu, T. Lyu, B. Zhang, and J. Hu, “Collective Stress Visualization Enabled by Smart Cushions for Office Chairs,” Distributed, Ambient and Pervasive Interactions. Smart Environments, Ecosystems, and Cities, HCII 2022, Lecture Notes in Computer Science Series, 13325, pp. 278-290, Cham: Springer International Publishing, 2022.
FULLTEXT: PDF REFERENCE: BibTeX EndNote
DOI: 10.1007/978-3-031-05463-1_20

D. Stappers, Investigating Collective Stress – Behavioral Influences Amongst Office Workers by a Dynamic Painting, M12 Project Report, Department of Industrial Design, Eindhoven University of Technology, Eindhoven, 2022.
FULLTEXT: PDF

G. Valkenburg, THE WINDOW TO RELIEF – Reducing collective stress at the office, FBP Project Report, Department of Industrial Design, Eindhoven University of Technology, Eindhoven, 2022.
FULLTEXT: PDF

M. Xue, R.-H. Liang, J. Hu, B. Yu, and L. Feijs, “Understanding How Group Workers Reflect on Organizational Stress with a Shared, Anonymous Heart Rate Variability Data Visualization,” in CHI Conference on Human Factors in Computing Systems Extended Abstracts, New Orleans, LA, USA, 2022, pp. Article 27.
FULLTEXT: PDF REFERENCE: BibTeX EndNote
DOI: 10.1145/3491101.3503576

M. Hoekstra, Bringing valuable insights to office environments by visualizing health–data, FMP Report, Department of Industrial Design, Eindhoven University of Technology, Eindhoven, 2021.
FULLTEXT: PDF

J. Buining, and Y. Miao, Less Collective Stress, Better Workspace, B2 Project Report, Department of Industrial Design, Eindhoven University of Technology, Eindhoven, 2021.
FULLTEXT: PDF

M. Xue, R. Liang, B. Yu, M. Funk, J. Hu, and L. Feijs, “AffectiveWall: Designing Collective Stress-Related Physiological Data Visualization for Reflection,” IEEE Access, vol. 7, pp. 131289-131303, 2019.
FULLTEXT: PDF REFERENCE: BibTeX EndNote
DOI: 10.1109/ACCESS.2019.2940866

M. Xue, R.-H. Liang, J. Hu, and L. Feijs, “ClockViz: Designing Public Visualization for Coping with Collective Stress in Teamwork,” Proceedings of the Conference on Design and Semantics of Form and Movement – Sense and Sensitivity, DeSForM 2017, Series, M. B. Alonso and E. Ozcan, eds., pp. 67-78, Rijeka: InTech, 2017.
FULLTEXT: PDF REFERENCE: BibTeX EndNote
DOI: 10.5772/intechopen.71220