Smart shirt and carpet for annotating child behaviour in autism research

Authors

• Ali Nadeem Faculty of Medicine and Health Technology, Tampere University, Tampere
• Karri Palovuori Faculty of Information Technology and Communication Sciences, Tampere University, Tampere
• Anneli Kylliäinen Welfare Sciences: Psychology, Faculty of Social Sciences, Tampere University
• Terhi Helminen Welfare Sciences: Psychology, Faculty of Social Sciences, Tampere University
• Johanna Virkki Faculty of Information Technology and Communication Sciences, Tampere University, Tampere

DOI: https://doi.org/10.23996/fjhw.121481

Keywords:

participatory planning, autism spectrum disorder, smart textiles, research

Abstract

This study presents a developmental solution for annotating events, eye-contact, in live interaction scenarios, such as autism research. The approach involves prototyping infrared light emitting diodes (IR LEDs) integrated into both a smart shirt and smart carpets. Leveraging the imperceptibility of IR LEDs to the human eye ensures minimal disturbance to the individuals under surveillance. During video analysis, researchers can identify instances of eye-contact through the activation of IR LEDs, aiding in the recognition of corresponding events. The prototyped smart shirt features a necklace-type design with embedded IR LEDs, while two distinct designs of smart carpets incorporate IR LEDs at varying vision angles and positions.

Validation of the prototypes includes laboratory testing and real-world evaluations with the researchers. The assessment encompasses the observation of IR LEDs on the smart shirt and carpets from diverse perspectives, evaluating their light intensity, and assessing their operational synchronization. The findings contribute to the advancement of technology-assisted methodologies in capturing and analyzing interpersonal interactions, particularly in the context of autism research.