Singapore Institute of Technology

File(s) stored somewhere else

Please note: Linked content is NOT stored on Singapore Institute of Technology and we can't guarantee its availability, quality, security or accept any liability.

Towards a HOI application for digital home assistants

conference contribution
posted on 2023-07-03, 06:50 authored by Megani Rajendran, Chek Tien TanChek Tien Tan, Indriyati AtmosukartoIndriyati Atmosukarto, Aik Beng Ng

Human-object interaction detection (HOI) aims to visually deduce how people interact with surrounding objects. Although there is significant progress in advancing classification models for HOI, data remains a key problem limiting the application of HOI for real-world problems, which in turn results in insufficient applied research in HOI. In this position paper, we hence present a research agenda to aid the creation of this system - a data-centric HOI-based digital home assistant framework. The eventual goal of this digital home assistant is to understand how to apply HOI to enhance daily living experiences for the elderly. The research will embark in two phases - (1) create varied relevant HOI datasets through a novel synthetic data generator, and (2) iteratively develop the digital assistant software artifact using a system-based, user-focused design approach. 


Journal/Conference/Book title

2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

Publication date


Project ID

  • 9183 Recognizing Temporal State Changes of Spatial Objects Over Time in Videos for Digital Assistants in Everyday Living

Usage metrics


    Ref. manager