Observation

From EuroVR Knowledge Base

Description

Evaluators often observe participants interacting with the VE in order to gather information about how participants perform a task, identify general and specific usability issues, as well as monitor their behaviour (positive and potentially negative). Observational methods may take the form of one or more evaluator taking notes during participant VE immersion or completing a checklist. Multiple evaluators ensure the consistency and accuracy of data collection. VE participation may also be videoed (e.g. using ‘Virtual Observer’ developed by Noldus Information Technology and Green Dino) and voice recordings may be taken if participants are talking aloud as they perform the task, and these are later used for analysis.

Observation can be unstructured or structured. During unstructured observation the evaluator will note anything of interest as and when it occurs - there is no structure imposed at this stage of data collection or analysis. Unstructured observation may highlight the types of behaviour participants adopt due to the unique characteristics of a particular VR system.

During structured observation the evaluator may have a specific number of categories or themes of behaviour in mind and will note instances of such behaviour. Quantitative analysis is often conducted on observational data.