Singapore Institute of Technology
Browse

Towards a HOI application for digital home assistants

conference contribution
posted on 2023-07-03, 06:50 authored by Megani Rajendran, Chek Tien TanChek Tien Tan, Indriyati AtmosukartoIndriyati Atmosukarto, Aik Beng Ng

Human-object interaction detection (HOI) aims to visually deduce how people interact with surrounding objects. Although there is significant progress in advancing classification models for HOI, data remains a key problem limiting the application of HOI for real-world problems, which in turn results in insufficient applied research in HOI. In this position paper, we hence present a research agenda to aid the creation of this system - a data-centric HOI-based digital home assistant framework. The eventual goal of this digital home assistant is to understand how to apply HOI to enhance daily living experiences for the elderly. The research will embark in two phases - (1) create varied relevant HOI datasets through a novel synthetic data generator, and (2) iteratively develop the digital assistant software artifact using a system-based, user-focused design approach. 

History

Journal/Conference/Book title

2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

Publication date

2022-12-15

Project ID

  • 9183 Recognizing Temporal State Changes of Spatial Objects Over Time in Videos for Digital Assistants in Everyday Living

Usage metrics

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC