We present a quantitative study of the classification of Extremely Red Objects (EROs). The analysis is based on the multi-band spatial- and ground-based observations (HST/ACS-BViz, HST/NICMOS-JH, VLT-JHK) in the Hubble Ultra Deep Field (UDF). Over a total sky area of 5.50 arcmin2 in the UDF, we select 24 EROs with the color criterion (i - K)vega 〉 3.9, corresponding to (I - K)vega 〉 ~4.0, down to Kvega = 22. We develop four methods to classify EROs into Old passively evolving Galaxies (OGs) and Dusty star-forming Galaxies (DGs), including (i - K) vs. (J - K) color diagram, spectral energy distribution fitting method, Spitzer MIPS 24 um image matching, and nonparametric measure of galaxy morphology, and found that the classification results from these methods agree well. Using these four classification methods, we classify our EROs sample into 60Gs and 8 DGs to KVega 〈 20.5, and 80Gs and 16 DGs to KVega 〈 22, respectively. The fraction of DGs increases from 8/14 at KVega 〈 20.5 to 16/24 at KVega 〈 22. TO study the morphology of galaxies with its wavelength, we measure the central concentration and the Gini coefficient for the 24 EROs in our sample in HST/ACS-i, z and HST/NICMOS-J, H bands. We find that the morphological parameters of galaxies in our sample depend on the wavelength of observation, which suggests that caution is necessary when comparing single wavelength band images of galaxies at a variety of redshifts.