Natural language is an intuitive interface to supplement programming in modern automation settings. However, most natural language frameworks are specialized and not universally applicable. We contribute a novel layered pipeline that transforms the instructions of laypersons into robot programs with non-linear control flow and that facilitates reuse. The instructions are analyzed regarding grammatical features. From this, the syntactical analysis derives programs with nested control structures and references to physical parts within a scene to be manipulated. These programs are semantically interpreted during online execution in a concrete scene—i.e., the control structures are evaluated, and part specifications are grounded to physical parts. With that, a fully specified skill is created and executed by a robot system. Since only the input/output interface of each pipeline stage is defined, they are adjustable independently of each other. Our experiments demonstrate how industrial robots in diverse domains can be verbally programmed using the pipeline.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A Layered Pipeline for Natural Language Robot Programming with Control Structures


    Beteiligte:
    Ihlenfeldt, Steffen (Herausgeber:in) / Schüppstuhl, Thorsten (Herausgeber:in) / Tracht, Kirsten (Herausgeber:in) / Sucker, Sascha (Autor:in) / Henrich, Dominik (Autor:in)

    Kongress:

    MHI Colloquium ; 2023 ; Chemnitz, Germany June 22, 2023 - June 23, 2023



    Erscheinungsdatum :

    20.03.2025


    Format / Umfang :

    12 pages




    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Flowchart programming: a natural language for control

    Gee,D. / Steeplechase Software,US | Kraftfahrwesen | 1996



    Robot programming language functionality for use in off-line programming

    Ristic,M. / Marin,S. / Imperial College of Science and Technology,GB | Kraftfahrwesen | 1989


    ABB Robot and its own programming language

    Nguyen, Toan | BASE | 2021

    Freier Zugriff

    Pipeline inspection robot and robot control method

    CHEN YONGQUAN / WANG CHIEN-LIN / PENG LINING et al. | Europäisches Patentamt | 2024

    Freier Zugriff