This paper studies non-physical feedback mechanisms to guide human workers toward ergonomic body postures. Specifically, the focus is to solve the tasks that involve no direct physical interaction between the human and the robotic system, therefore tactile guidance by the robot body is not feasible. We propose a multi-modal ergonomic posture guidance system that comprises visual feedback and speech-based audio feedback. We hypothesise that the proposed multi-modal system leads to better performance compared to uni-modal feedback systems when trying to guide users from one pose to another. To test the hypothesis we conducted an experiment that compared conditions with only audio feedback, only visual feedback and multi-modal feedback. In addition, we examined speech-based audio guidance in joint space and in endpoint space. The results showed that the speech-based feedback in joint space came out as the preferred audio feedback due to its ability to allow users to carry out efficient and coordinated inter-joint movements, especially in cases of high redundancy. Furthermore, the proposed multi-modal feedback system was superior compared to the other feedback modalities both in terms of objective measures and subjective measures.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Multi-Modal Feedback Communication Interface for Human Working Posture Adjustments


    Additional title:

    Springer Proceedings in Advanced Robotics


    Contributors:

    Conference:

    International Workshop on Human-Friendly Robotics ; 2022 ; Delft, The Netherlands September 22, 2022 - September 23, 2022



    Publication date :

    2023-01-02


    Size :

    16 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Sensory feedback in human posture control

    Nashner, L. M. | NTRS | 1970


    Visually guided adjustments of body posture in the roll plane

    Tarnutzer, A A / Bockisch, C J / Straumann, D | BASE | 2013

    Free access

    Multi-modal human machine interface for future multimedia systems

    Schoenke,K. / Nguyen-Thien,N. / Siemens Automotive,DE | Automotive engineering | 2001


    Multi-modal Human Machine Interface for future Multimedia Systems

    Schonke, K. / Nguyen-Thien, N. / Hain, R. et al. | British Library Conference Proceedings | 2001


    Multi modal human machine interface for future multimedia systems

    Schoenke,K. / Thien,N. / Hain,R. et al. | Automotive engineering | 2001