The key task of fault diagnosis is to establish the nonlinear mapping relationship between fault feature sequences (FFSs) and fault modes (FMs). Therefore, it is usually necessary to detect transit jump points of FFS to separate feature samples with the different trends. These samples and the their fault labels are combined to form training samples for a fault diagnosis model (FDM). However, due to changes in fault status and uncertainty in measurement, some feature samples will imprecisely point to multiple FMs (fault labels), hardly adopted in FDM. In order to solve such imprecision problem, this paper presents an information fusion method via One vs Rest (OvR) evidence classifiers. For each FFS, the multiple OvR evidence classifiers are designed to model the imprecise relationship between the samples and FMs. Then, a two-level fusion framework is proposed to integrate the evidence of all FFSs. By using the intersection operation between One (one FM) and Rest (the other FMs), the imprecision can be significantly reduced. A rotating machinery fault diagnosis experiment is given to illustrate that the proposed method have better fault classification accuracy compared with the traditional FDMs including SVM, BPNN, KNN, FCNN, RF and Bayes.