To provide a reinforcement learning method which can optimize a Q table so as to make it possible to start an engine quickly while restraining vibration and/or noise.SOLUTION: A reinforcement learning method optimizes a Q table through reinforcement learning. The reinforcement learning method includes causing a computer to repeatedly execute the steps of: calculating a first reward on the basis of sound pressure or acceleration in each trial (step S140); calculating a second reward such that a return decreases as a time until starting of an engine is completed increases (step S140); and updating the Q table such that an action is selected with which a return that is a sum of rewards in the trials becomes larger (step S150).SELECTED DRAWING: Figure 4

    【課題】振動又は騒音を抑制しつつ、速やかにエンジンを始動させることができるようにQテーブルを最適化ができる強化学習方法を提供する。【解決手段】この強化学習方法は、強化学習によってQテーブルを最適化する。この強化学習方法は、コンピュータに、各試行において、音圧又は加速度に基づいて第1報酬を算出するステップ(ステップS140)と、エンジンの始動が完了するまでの時間が長いほど収益が小さくなるように第2報酬を算出するステップ(ステップS140)と、試行における報酬の総和である収益がより大きくなる行動が選択されるようにQテーブルを更新するステップ(S150)と、を繰り返し実行させる。【選択図】図4


    Access

    Download


    Export, share and cite



    Title :

    REINFORCEMENT LEARNING METHOD AND MOTOR CONTROL UNIT


    Additional title:

    強化学習方法及びモータコントロールユニット


    Contributors:

    Publication date :

    2024-09-06


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Japanese


    Classification :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / B60K Anordnung oder Einbau von Antriebseinheiten oder von Kraft- bzw. Drehmomentübertragungen in Fahrzeugen , ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES



    Deep reinforcement learning-based double-bow cooperative control method for reconnection-motor train unit

    LIU ZHIGANG / WANG HUI / HAN ZHIWEI | European Patent Office | 2023

    Free access

    Motor control device, motor control method, and motor unit

    OHORI RYO / SHIODA NAOKI / HAYATA MASAKI et al. | European Patent Office | 2024

    Free access

    MOTOR CONTROL DEVICE, MOTOR CONTROL METHOD, AND MOTOR UNIT

    OHORI RYO / SHIODA NAOKI / HAYATA MASAKI et al. | European Patent Office | 2022

    Free access

    MOTOR CONTROL DEVICE, MOTOR CONTROL METHOD, AND MOTOR UNIT

    OHORI RYO / SHIODA NAOKI / HAYATA MASAKI et al. | European Patent Office | 2020

    Free access

    MOTOR UNIT AND MOTOR CONTROL METHOD

    KANARI MASAYUKI | European Patent Office | 2023

    Free access