%A LIU Yang, LIU Bo, WANG Feng %T Optimization algorithm for big data mining based on parameter server framework %0 Journal Article %D 2017 %J Journal of Shandong University(Engineering Science) %R 10.6040/j.issn.1672-3961.0.2016.339 %P 1-6 %V 47 %N 4 %U {http://gxbwk.njournal.sdu.edu.cn/CN/abstract/article_1608.shtml} %8 2017-08-20 %X Traditional machine learning algorithms for small data were not applicable for mining of big data. An optimization algorithm for machine learning and big data mining was proposed. The iterative computation of machine learning algorithms was divided into two phases according to the change of model vector. According to the observation that most samples contributed little to the model update during the iteration, the computation load of machine learning algorithms could be reduced by reusing the iterative computing results of this kind of samples. The experimental results showed that the proposed method could reduce the computation load by 35%, with little effect on prediction accuracy of the training model.