The embodiment of the invention provides a spatial game-oriented strategy gradient reinforcement learning autonomous expelling strategy. The strategy comprises the steps that a protection satellite is selected as a reference point of a first spacecraft and a second spacecraft, a predetermined water drop movement track of the second spacecraft is acquired, and a CW orbit relative kinematics model is established in a simulation environment; the observed quantities of the first spacecraft and the second spacecraft at the t0 moment are obtained, and the speed increment of the second spacecraft is obtained according to the water drop movement track; the observed quantity of the first spacecraft at the t0 moment is input into an action network with the convergent training effect to calculate the speed increment of the first spacecraft at the t0 moment, and orbit control is carried out; the observed quantity of the first spacecraft at the t0 + T moment is calculated, and the observed quantity of the second spacecraft at the t0 + T moment is calculated according to the speed increment of the second spacecraft at the t0 moment; and the distance is calculated according to the observed quantities of the first spacecraft and the second spacecraft at the t0 + T moment, and expelling judgment is carried out. According to the technical scheme provided by the embodiment of the invention, accurate expelling control and judgment between spacecrafts can be realized.
本发明实施例提供一种面向空间博弈的策略梯度强化学习自主驱离策略,包括:选取一护卫星作为第一航天器和第二航天器的参照点,获取第二航天器的预定的水滴运动轨迹,在仿真环境中建立CW轨道相对运动学模型;获取t0时刻第一航天器和第二航天器的观测量,根据所述水滴运动轨迹获取所述第二航天器的速度增量;将t0时刻第一航天器的观测量输入训练效果收敛的动作网络计算t0时刻所述第一航天器的速度增量,进行轨道控制;计算t0+T时刻第一航天器观测量,根据所述t0时刻第二航天器的速度增量计算t0+T时刻第二航天器的观测量;根据t0+T时刻第一航天器和第二航天器的观测量计算距离并进行驱离判定。利用本发明实施例提供的技术方案可以实现航天器之间的准确驱离控制及判定。
Space game-oriented autonomous expelling method and device and storage medium
面向空间博弈的自主驱离方法、装置和存储介质
2021-09-07
Patent
Elektronische Ressource
Chinesisch
IPC: | B64G Raumfahrt , COSMONAUTICS |
Biological expelling system, method and device and storage medium
Europäisches Patentamt | 2024
|Identification and expelling method and system of traversing machine and storage medium
Europäisches Patentamt | 2022
|