Peeling-off phenomena in FRP strengthened concrete beams are investigated in this paper. Based on the beam theory and the fracture mechanics, a new theoretical model is proposed to analyze the peeling-off behavior near FRP-concrete interfaces, which is governed by residual thermal stresses. Numerical examples are presented to provide a clear insight into the failure mechanism. Some suggestions are provided for the optimal design of FRP strengthened structures.