This article addresses adaptive optimized tracking control problem for strict-feedback cyclic switched nonlinear output constrained systems with average cyclic dwell time (ACDT). Different from most of the existing results on optimized control of switched nonlinear systems, a new mode-dependent reinforcement learning (RL) algorithm of identifier-critic-actor architecture is designed. Technically, with the help of neural networks (NNs) switched state observer, the virtual and actual optimal controllers are developed by solving the Hamilton-Jacobi-Bellman (HJB) equation. Meanwhile, to reduce the impact of systems switching on the overall optimization control, the information of the switching signal is considered into the optimal performance index functions. In an attempt to settle the output constraints, a nonlinear output-dependent time-varying function is used to ensure that the system output never transgresses the prescribed regions. More importantly, by combining the improved ACDT method and Lyapunov stability theorem, a novel adaptive optimized control scheme is put forward which ensures that the boundedness of all signals in the closed-loop system. Finally, the effectiveness of the proposed optimized control algorithm is verified by numerical as well as practical simulations.