Posted on

Software Architecture Support for Biofeedback Based In-flight Music Systems

Hao Liu , Jun Hu, Matthias Rauterberg

Abstract In this paper, we present a software architecture support for biofeedback in-flight music systems to promote stress free air travels. Once the passenger sits in a seat of a flight, his/her bio signals are acquired via non intrusive sensors embedded in the seat and then are modeled into stress states. If the passenger is in a stress state, the system recommends a personalized stress reduction music playlist to the passenger to transfer him/her from the current stress state to the target comfort state; if the passenger is not in a stress state, the system recommends a personalized non stress induction music playlist keep him/her at comfort state. If the passenger does not accept the recommendation, he/she can browse the in-flight music system and select preferred music himself/herself.

Keywords in-flight music; biofeedback; healthy air travels; stress reduction.

H. Liu, J. Hu, and M. Rauterberg, “Software Architecture Support for Biofeedback Based In-flight Music Systems,” in 2nd IEEE International Conference on Computer Science and Information Technology (ICCSIT 2009), Beijing, China, 2009, pp. 580-584.
DOI: 10.1109/ICCSIT.2009.5234489
Posted on

A Distributed Multi-agent Architecture in Simulation Based Medical Training

Jun Hu and Loe Feijs

Abstract. This paper addresses the issues of distributed interactions in a simulation based medial training environment, where a team of doctors, nurses and assistants are trained for handling difficult delivery situations using simulations. A scripting language is proposed, using a metaphor of play, with which the timing and mapping issues in distributed presentations are covered. A generic architecture for the systems is also presented, which covers the timing and mapping issues of conducting such a script in a medical training environment. The difference between playing a medical training scenario and playing a multimedia entertainment scenario is discussed, based on which the future research and development are proposed.

J. Hu and L. M. G. Feijs, “A Distributed Multi-agent Architecture in Simulation Based Medical Training,” Transactions on Edutainment , vol. III, LNCS 5940, pp. 105-115, 2009.

Extended abstract:

J. Hu, and L. Feijs, “A Distributed Multi-agent Architecture in Simulation Based Medical Training,” Learning by Playing. Game-based Education System Design and Development, Lecture Notes in Computer Science Series, 5670/2009, M. Chang, R. Kuo, Kinshuk et al., eds., p. 49, Banff, Canada: Springer Berlin / Heidelberg, 2009.
DOI: 10.1007/978-3-642-03364-3_6
Posted on

Design of a Distributed Architecture for Enriching Media Experience in Home Theaters

Jun Hu

The concept of Ambient Intelligence (AmI) is introduced by Philips Research as a new paradigm in how people interact with technology. It envisions digital environments to be sensitive, adaptive, and responsive to the presence of people. This PhD project believes that AmI environments will change the way people use multimedia services. The environments, which include many devices, will play interactive multimedia to engage people in a more immersive experience than just watching television shows or listening to radio programs. People will interact not only with the environment itself, but also with the interactive multimedia through the environment.

For many years, the research and development of multimedia technologies have increasingly focused on models for distributed applications, but the focus was mainly on the distribution of the media sources. Within the context of AmI, not only are the media sources distributed, the presentation of and the interaction with the media will also be distributed across interface devices. This PhD project focuses on the design of the structure of multimedia content and the distributed interfaces, believing that the user experience of multimedia in a distributed environment can be enriched by structuring both the media content at the production side and the playback system architecture at the user side in a proper way. The structure should enable both the media presentation and the user interaction to be distributed and synchronized over the networked devices in the environment. The presentation and interaction should be adaptive to the profiles and preferences of the users, and the dynamic configurations of the environment.

The design process went through three design iterations, following a spiral model. The first iteration was needed to get some first-hand experience and the preliminary requirements. It was concluded with the structure of StoryML and a demonstrator TOONS, which put the requirements for the second iteration on a stable foundation. More user requirements and technical challenges emerged in the second iteration during the development of the demonstrator DeepSea. DeepSea was used for the user evaluation of the concept of interactive multimedia in distributed environments. The design and development were brought forward based on the technical requirements and the experience gained from the second iteration. The design was completed with a full implementation of the proposed architecture, based on open standards and technologies. Three more demonstrators (TOONS in IPML, TheInterview, Mov’in) were built to validate the design. TheInterview was used to test the effect of the user’s cultural background on their perception of presence in interacting with these multimedia presentations in a distributed setting. During the project, the proposed architecture was used in implementing applications for various projects, ranging from a big EU project together with professional developers, to a small educational project by a team of four second year university students. Each resulted in a working demonstrator or prototype.

During the design process, several formal methods were used, including Object-Z, Broy’s component based framework, and the Petri net based OCPN and ASE. The formal approaches were helpful: They are abstract enough to make mechanisms explicit in a clear way and at the same time they are concrete enough to see the structure of the implementation. However it was not possible to formalize every aspect of the system. The system is far too complex for that. Several formalisms and several types of “syntactic sugar” were used to keep things manageable. Yet the most important design concepts were covered by formalizing them in a pragmatic way.

As a direct result of this design, a generic architecture has been implemented on top of existing network technologies and platform architectures, to enable playing IPML scripts in a networked environment with user preference and dynamic configurations taken into account. Aside from the architecture, this project also contributed to the body of scientific and engineering results. Examples are the method of rapid robotic prototyping, the extension of Petri nets as action synchronization engine, and new architectural patterns such as Timed Action, Synchronizable Object, Real-time Channel and Streaming Channel.

The results of user evaluations offer preliminary insight into how distribution, level of control and number of users influence user’s fun and presence experience in interacting with an AmI movie. Notably the level of control, and the number of the users, have a positive influence on the user experience. The influence of distribution on the user experiences is also observed and there can be an effect depending on the type of the distributed content and how the distribution is arranged. An effect of cultural background upon the perception of presence in a distributed setting is also observed. As far as known, it is the first time that the long-standing conjecture on this effect is confirmed experimentally.

J. Hu, “Design of a Distributed Architecture for Enriching Media Experience in Home Theaters,” PhD Thesis, Department of Industrial Design, Eindhoven University of Technology, Eindhoven, 2006.