A 3D Voice-Hearing Simulator Co-Created by Voice Hearers and Researchers: Preliminary Sound Quality Evaluation


  • Philippe-Aubert Gauthier École des arts visuels et médiatiques, UQAM, CA
  • Kevin Zemmour Département de psychiatrie, Université de Sherbrooke, CA
  • Sylvain Grignon Département de psychiatrie, Université de Sherbrooke, CA
  • Bálint Demers École des médias, UQAM, CA
  • Catherine Lejeune Écoles des arts visuels et médiatiques, UQAM, CA
  • Sandrine Rousseau Association Québecoise pour la Réadaptation Psychosociale (AQRP), CA
  • Mouloud Boukala École des médias, UQAM, CA
  • Sofian Audry École des médias, UQAM, CA
  • Sylvio Arriola École de théâtre, UQAM, CA
  • Alain Berry Département de génie mécanique, Université de Sherbrooke, CA
  • Kevin Whittingstall Département de radiologie diagnostique, Université de Sherbrooke, CA


Voice hearing (VH) is a phenomenon that can affect a wide range of people, not just those affected by psychosis, schizophrenia or any mental health trouble. The heard voices can be positive, negative, or anything in between. VH is distinctive in that the voices can both come from inside the head or from the external world (i.e. the sound environment, or the body), resulting in a sense of sound externalization. Improper mental health services or social support are often reported by voice hearers. One hypothesis is that service providers lack empathy and appropriate knowledge about the experience of voice hearers, potentially leading to a reduced therapeutic alliance. To address this, a 3D voice-hearing simulator (3DV) was created within a participatory research paradigm with a multidisciplinary team. The main objective being the creation of an experiential knowledge sharing tool for the training of future psychiatrists or social workers. Simple binaural sound reproduction was used to recreate the sense of externalization. A validation of its effect was performed using quantitative and qualitative evaluation on social work students. Preliminary results suggest that the 3DV was efficient in sharing the VH experience for both voice hearers and participants. Hence, one of the strong successes of the project was in the inclusion of voice hearers as non-traditional research collaborators with experiential knowledge. However, in terms of limitation, it was difficult for participants, considered as naive listeners with respect to audio technologies, to distinguish the sound quality of different 3DV versions (binaural, stereophonic, and binaural based on ambisonics). This is possibly due to the strong and impactful nature of the 3DV and the words per se. To improve the immersion of 3DV, full immersive and interactive binaural audio with head-tracking or augmented reality may be necessary. This project received an ethics certificate from UQAM and financial support from FRQ Audace.

Additional Files



How to Cite

Gauthier P-A, Zemmour K, Grignon S, Demers B, Lejeune C, Rousseau S, Boukala M, Audry S, Arriola S, Berry A, Whittingstall K. A 3D Voice-Hearing Simulator Co-Created by Voice Hearers and Researchers: Preliminary Sound Quality Evaluation. Canadian Acoustics [Internet]. 2023 Oct. 9 [cited 2024 May 22];51(3):204-5. Available from: https://jcaa.caa-aca.ca/index.php/jcaa/article/view/4065



Proceedings of the Acoustics Week in Canada

Most read articles by the same author(s)

<< < 1 2