IVE Virtual Intern Program (VIP)

This project explores how EEG and other physiological signals can reflect/ detect user input preferences. The intern will conduct statistical analyses on collected user behaviour and physiological signal data. They will also use machine learning (ML) and deep learning (DL) models to classify different preferences stages. The intern will have opportunities to learn about EEG experimental design, setup, and data analysis, gaining hands-on experience in configuring EEG equipment, collecting and pre-processing data, and applying statistical methods.

Project Duration: 6 months

In this project, we plan to use the ML method to detect existing biodata against user-labelled ground truth (emotion), aiming to generate a framework that can detect the user’s biosignal input (eye gaze, facial expression, GSR, HR) and provide reliable emotion predictions during VR collaboration. The framework can be later used in VR applications where emotions can be detected and visualised into a virtual superpower to exert more reaction, arousal, or emotion consensus.

Project Duration: 3 - 6 months

The goal is to understand if head movements (front, back, left, or right) have a direct relation during memory and recall sessions in virtual environments such as 2D, looking glass, and VR using ML models. We are free to explore either building a lightweight ML model or using multiple existing ML-powered mental models to detect patterns or test correlations. The outcome will lead to a publication and a framework that can be used in future VR applications involving memorisation, recall, pattern/object recognition, spatial recognition, etc.

Project Duration: 3 months

This project is collaborative research across Arts/ Virtual Production and Game Design/ Arts- Health/ Human Factors developing a VR/ AR experience that motivates participants creativity and mobility. The project is co-designed with artists who have acquired brain injury. Outcomes include a prototype VR/AR experience for Arts-Health and rehabilitation. The project partners include UniSA Creative Computing (IVE)/ Assemblage Flinders University and the Australian Network of Art and Technology (ANAT). The intern will conduct background research into VR for Arts/ Health and rehabilitation. The intern will liase with the Unity developer to propose 3D modelling and interaction suggestions and solutions and will participate in meetings with artists, designers and technicians.

Project Duration: 3 months

The goal of this project is to develop a fully interactive Fluid Mechanics lab using augmented reality (AR). An initial immersive walkthrough has been created using the software 3D Vista: https://www.3dvista.com/en/. The next phase involves transforming this walkthrough into a functional AR-based laboratory experience. The physical lab is located at UniSA's Mawson Lakes campus, and real-world experimental data will be used to design interactive experiments.

Project Duration: 3 months

The goal of this project is to explore the potential of Augmented Reality (AR) in fostering intergenerational play and engagement. The intern will conduct comprehensive research to gauge the current landscape of intergenerational digital game design and its applications. Utilising tools such as Figma, FigminXR, or ShapesXR, the intern will develop concept AR games and interfaces tailored for intergenerational play. Feedback will be solicited from product and service designers through remote meetings to refine these concepts, prototypes, and productions.

Project Duration: 3 months

The aim of this project is to develop an educational tool utilizing Virtual Reality (VR) technology as its platform facilitating engagement and interactive learning experiences for residential aged care facilities staff in dementia care. The intern will conduct background research on previous projects that utilized VR as educational tools. They will also use ShapesXR, modelling software, and Unity to produce a scenario simulating a dementia care situation. Additionally, they will participate in remote meetings with staff from the Rosemary Bryant AO Research Centre and the graphic designers to receive feedback on the simulated scene.

Project Duration: 6 months

This project explores how Virtual Reality can be used to deliver de-escalation training and assessments. The intern will conduct research into how to integrate Meta's Voice SDK into an existing de-escalation project (Unity). They will also be tasked with prototyping the implementation of voice recognition into the application, specifically focused on the possibility of using voice commands to respond to the potentially escalating situation. They will participate in remote meetings with developers and psychologists to discuss progress and address any potential concerns or issues.

Project Duration: 3 months

Building performance analysis tools such as parametric modelling have been increasingly applied for retrofitting, to analyse and optimise building performance. Recent applications of augmented reality (AR) technologies for retrofitting are also presenting new opportunities to visualise building performance and enrich users’ experience. As technology evolves, building retrofits can more significantly reduce energy; studies suggest that retrofitting residential buildings can save up to 86% of energy. However, there has been a lack of studies, and a lack of associated technology development, on comprehensive sustainable residential retrofitting analysis, simulation, and visualisation. This research aims to develop an end-user co-design toolkit for sustainable residential retrofitting, by utilising environmental sensors and AR technologies.

Project Duration: 6 months

Courtyard Houses (Siheyuan) are a type of traditional Chinese residential housing in Northern China, that are renowned for their long history and significant socio-cultural heritage value. Characteristics of Chinese Courtyard Houses have been studied from multiple perspectives such as aesthetic value, planning principles, cultural and historical contexts, and a variety of other perspectives. However, there is still a lack of understanding about their spatial characteristics from a quantitative perspective, as well as a lack of a digital tool that could facilitate the representation of their spatial characteristics. Therefore, this study aims to develop a parametric system for generating plans that replicate selected socio-spatial characteristics of traditional Chinese Courtyard Houses.

Project Duration: 6 months

This project aims to create a working prototype demonstrating how augmented reality (AR) can enhance immersion and engagement in a board game. The existing game prototype, developed in collaboration with the History Trust of South Australia, conveys Indigenous knowledge about the relationships between animals, vegetation, seasons, and landscapes. This project will involve developing an AR extension and collaborating on a workflow for curators and designers at museums, enabling them to create their own games. We anticipate producing a shared paper or article on the findings and potential of this workflow.

Example of subject-related papers by investigators so far:

Champion, E., & Hiriart, J. (2023). Workshopping Board Games for Space Place and Culture. In C. Randl & D. M. Lasansky (Eds.), Playing Place: Board Games, Popular Culture, Space (pp. 165-168). MIT Press.https://doi.org/10.7551/mitpress/14352.003.0046 

Bekele, M. K., Champion, E., McMeekin, D. A., & Rahaman, H. (2021). The Influence of Collaborative and Multi-Modal Mixed Reality: Cultural Learning in Virtual Heritage. Multimodal Technologies and Interaction, 5(12), 79. https://www.mdpi.com/2414-4088/5/12/79 

Project Duration: 6 months