An improved procedure of Lyapunov feedback control is developed. The procedure includes two parts. First, a discontinuous controller is designed. The extended Lyapunov stability theory is used for the stability analysis of the resulting non-smooth control system. Next, the discontinuous terms in the controller are replaced with continuous functions. This weakens the stability but avoids the chattering of the controller. The trade-off in the stability is analyzed using the concept of Lyapunov exponents. We demonstrate the effectiveness of the design procedure by stabilizing a two-link base-excited inverted pendulum system around the upright position. We believe that our improved design procedure makes the Lyapunov feedback control more applicable.