GERT-Q-learning model for intelligent QoS dynamic optimization of Inmarsat STN based on grey clustering of delay and delay variation

This paper aims to implement quality of service(QoS) dynamic optimization for the integrated satellite-terrestrial network(STN) of the fifth-generation Inmarsat system(Inmarsat-5).

The structure and operational logic of Inmarsat-5 STN are introduced to build the graphic evaluation and review technique(GERT) model. Thus, the equivalent network QoS metrics can be derived from the analytical algorithm of GERT. The center–point mixed possibility functions of average delay and delay variation are constructed considering users' experiences. Then, the grey clustering evaluation of link QoS is obtained combined with the two-stage decision model to give suitable rewards for the agent of GERT-Q-learning, which realizes the intelligent optimization mechanism under real-time monitoring data.

A case study based on five time periods of monitoring data verifies the adaptability of the proposed method. On the one hand, grey clustering based on possibility function enables a more effective measurement of link QoS from the users' perspective. On the other hand, the method comparison intuitively shows that the proposed method performs better.

With the development trend of integrated communication, STN has become an important research object in satellite communications. This paper establishes a modular and extensible optimization framework whose loose coupling structure and flexibility facilitate management and development. The grey-clustering-based GERT-Q-Learning model has the potential to maximize design and application benefits of STN throughout its life cycle.