Semi-implicit algorithms are popularly used to deal with the gravitational term in numerical models. In this paper, we adopt the method of characteristics to compute the solutions for gravity waves on a sphere directly using a semi-Lagrangian advection scheme instead of the semi-implicit method in a shallow water model, to avoid expensive matrix inversions. Adoption of the semi-Lagrangian scheme renders the numerical model always stable for any Courant number, and which saves CPU time. To illustrate the effciency of the characteristic constrained interpolation profile (CIP) method, some numerical results are shown for idealized test cases on a sphere in the Yin-Yang grid system.