Rhinoceroses have been considered to have originated from tapiroids in the middle Eocene; however, the transition remains controversial, and the first unequivocal rhinocerotoids appeared about 4 Ma later than the earliest tapiroids of the Early Eocene. Here we describe 5 genera and 6 new species of rhinoceroses recently discovered from the early Eocene to the early middle Eocene deposits of the Erlian Basin of Inner Mongolia, China. These new materials represent the earliest members of rhinocerotoids, forstercooperiids, and/or hyrachyids, and bridge the evolutionary gap between the early Eocene ceratomorphs and middle Eocene rhinocerotoids. The phylogenetic analyses using parsimony and Bayesian inference methods support their affinities with rhinocerotoids, and also illuminate the phylogenetic relationships and biogeography of Ceratomorpha, although some discrepancies are present between the two criteria. The nearly contemporary occurrence of various rhinocerotoids indicates that the divergence of different rhinocerotoid groups occurred no later than the late early Eocene, which is soon after the split between the rhinocerotoids and the tapiroids in the early early Eocene. However, the Bayesian tip-dating estimate suggests that the divergence of different ceratomorph groups occurred in the middle Paleocene.