Mixed and Virtual Reality (XR) have seen an important development since the advent of low-cost technologies. The application space is still diversifying, opening up new opportunities and application areas for such technologies. An important common feature of Mixed and Virtual Reality applications is that designers and engineers need to orchestrate virtual content and user experience. We regard orchestration of Mixed and Virtual Reality as invisible work: in many cases, orchestration is hidden within the task of story scripting of applications. It is often occluded by designing and programming Mixed and Virtual Reality.

As such, orchestration is regarded as a means to a goal, which occludes its importance for the design of XR systems. We would like to invite the research community to address this issue, by focusing this workshop on highlighting and exemplifying orchestration challenges and best practices, and to systematise the orchestration topic in the context of the recent technology advances. We will consider a wide range of orchestration cases, from completely pre-orchestrated to live-orchestrated Mixed and Virtual Reality. Based on that knowledge, we aim to consider novel tools to support designers and users in their orchestration work. We invite scholars and practitioners to contribute to our workshop, with cases from their work.

Important Dates:

Paper submission: 14th of September 2020 1st of September 2020
Notification of Acceptance: 28th of September 2020 15th of September 2020
Workshop Date: 25th of October 2020, 9:00 – 17:30

The overarching goal of this workshop is to raise awareness to the hidden work of orchestrating in Virtual and Mixed Reality. We chose to achieve this by analysing existing work and experiences of practitioners and researchers, identify challenges and address these by defining best practice approaches.

During the workshop, we will identify challenges related to orchestration in the context of Virtual and Mixed Reality applications from various application areas. Therefore, we accumulate experiences and expectations of all participants.

In group work, these challenge serve as facilitator for the development of best practices. Best practices should originate from challenges and must map at least one of the identified challenges.  To complement the results, they will be presented to and discussed with workshop audience.

In the afternoon, we will apply the findings in a mock-up design that will be conducted using enactment. We aim to not just exemplify the findings, but also to play with pragmatic approaches to mock-up Virtual and Mixed Reality applications.

After the workshop, we will provide a summary report to be published on the workshop’s website and a journal contribution (e.g. Frontiers in Virtual Reality).

We invite researchers and practitioners working on or interested in XR. All XR-experienced researchers are eligible: whether orchestration was explicitly considered before or not, whether design for orchestration was performed or not. To create a multi-disciplinary team, we would like to address designers, programmers, artists, and educators. We particularly encourage PhD Students and young researchers to participate in our workshop.

To attend, submit your 2-4 pages (including references) positioning paper (ACM single-column „Review Submission Format“, see Instruction for Authors) via DesigningForOrchestration2020@gmail.com until 1st September 2020. Please include your background, and your motivation to attend this workshop. You can furthermore add previous work or concepts for XR-systems, and findings including potentially already identified challenges and best practices. Acceptance notifications will be sent out the latest on 15th September 2020. The accepted submissions will be published on the workshops webpage in advance of the workshop to make them accessible to the workshop participants.

The workshop will be held as a full-day workshop containing four sessions with distinguished activities. We aim for an interactive workshop with space for discussion and expression. Due to the current CoVid-19 pandemic, we plan to offer this workshop online, mediated using online conferencing tools and web-based shared virtual spaces. In case of the conference taking place in Tallinn, the workshop can easily be offered on-site. To experience design elements and possible challenges of designing for orchestration, we invite participants to submit videos of their own XR applications, which will be shared with all participants before the workshop. In case of the conference taking place in Tallinn, we also invite participants to demonstrate their XR applications live to offer all participants a first-hand experience. Please contact us via DesigningForOrchestration2020@gmail.com if you want to present your work or have further questions.

The workshop will be divided into two parts: The morning session will cover the identification of challenges and best practices. In the afternoon, we will show-case our findings using enactment.


Session 1: Introduction and paper pitch 09:00 – 10:30
The first session will start with an introduction to the topic provided by the workshop organisers. This is followed bypitches of the participant’s submitted papers. We will close this session by assigning the participants to groups of 4-5people that will conduct the group work together.
Break 10:30 – 11:00
Session 2: Identifying challenges and best practices 11:00 – 12:30
In this session, the participants will condense their experiences. Therefore, they will identify challenges for the design of these kinds of systems. Furthermore, the participants will develop best orchestration practices and design principles based on their findings.
Break 12:30 – 14:00
Session 2: Enactment 14:00 – 15:30
In the second part of this session, we invite all groups to develop and present an enactment that should illustrate the identified challenges and best practices for orchestration in XR. The context of the enactment should be in the area of training for simple manual tasks. We plan to use web-based virtual spaces (e.g. Hubs by Mozilla), which can be orchestrated by the participants, to enable online-enactments. These enactments enable us to quickly transfer our design sensitivities into scenarios without facing restrictions from technology or time limits and discuss them afterwards. The results of each group will be summarised briefly.
Break 15:30 – 16:00
Session 3: Discussion and Outlook 16:00 – 17:30
We will close the workshop with a final discussion. Therefore, we will reflect on the enactments and what we can learn from them about designing for orchestration. In this discussion, we also like to condense the found challenges and best practices of all groups. After successfully documenting our results, we wrap-up the workshop and the day.

Marius Koller is one of the two main-organisers of this workshop. He explores the potential of VR-Exposure Therapy (VRET) focusing on therapist-led live-orchestration. He focuses on the close involvement of therapists in the design process of VRET systems. Currently, he investigates the use of continuous interaction in the context of therapy for social anxiety disorders.

Sebastian F. Rauh is one of the two main-organisers of this workshop. He works on guidance and training in industrial context using MR-technologies for pre-orchestrated experiences. His interests are also in providing haptic cues to enhance XR experiences. Currently, he investigates on how learning takes place in MR occupational safety training.

Gerrit Meixner’s interest is in the area of applying XR in various different application areas. He transfers research results to applications for industry and civil society. Furthermore, he works on VR driving simulation and Human-Computer Interaction in the area of Industry 4.0.

Anders Lundström investigates employing 360°-videos in various use-cases in healthcare (e.g. elderly care and VRET). Furthermore, he is working on „energy-sensitive design“, which ranges from human-powered interactions to energy management for electric vehicles.

Cristian Bogdan is interested in programming in multi-disciplinary contexts, which also applies to orchestration for XR.

This workshop is organised by researchers of the Division of Media Technology and Interaction Design of KTH Royal Institute of Technology, Stockholm and the UniTyLab of Heilbronn University.

Do not hesitate to contact the main organisers, Marius Koller and Sebatian Rauh, via DesigningForOrchestration2020@gmail.com. 

Header image by Jeremy Bishop on Unsplash