This paper proposes an impurity solver for the dynamical mean field theory (DMFT) study of the Mott insulators, which is based on the second order perturbation of the hybridization function. After careful benchmarking with quantum Monte Carlo results on the anti-ferromagnetic phase of the Hubbard model, it concludes that this impurity solver can capture the main physical features in the strong coupling regime and can be a very useful tool for the LDA (local density approximation) + DMFT studies of the Mort insulators with long range order.