To investigate the clinical value of breast tumor magnetic resonance (MR) images in differentiating fibroadenoma of breast (FB), invasive ductal carcinoma (IDC) and invasive lobular carcinoma (ILC), the region of interest of MR image was selected and the MR image was decomposed by wavelet transform, and the region of tumor was segmented by K-means algorithm. Gabor wavelet was used to filter the region of interest from 8 directions and 5 scales, and the mean value of the tumor location was taken as the feature. The extracted features were analyzed and the key features were obtained. Different classification algorithms were compared in machine learning, such as support vector machine, Bayesian, and neural network, to classify and predict the key features, and calculate the accuracy, sensitivity and specificity of classification, so as to get the most suitable parameter settings for classification model. Texture analysis of breast MR images could distinguish three kinds of common breast tumors, and the prediction accuracy was 77.36%, which showed that MR image had important clinical value in differentiating FB, IDC and ILC.