JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2016, Vol. 46 ›› Issue (6): 23-30.doi: 10.6040/j.issn.1672-3961.1.2016.161

Previous Articles     Next Articles

Distributed particle swarm optimization algorithm based on mapreduce

FAN Debin, DENG Changshou*, YUAN Sihao, TAN Xujie, DONG Xiaogang   

  1. School of Information and Technology, Jiujiang University, Jiujiang 332005, Jiangxi, China
  • Received:2015-12-31 Online:2016-12-20 Published:2015-12-31

PDF (PC)

1055

Abstract: A distributed particle swarm optimization algorithm based on MapReduce was proposed through the analysis of the traditional single population particle swarm optimization algorithm, which was used to solve the algorithm problems of decreased efficiency and accuracy in large scale optimization. In the evolutionary process of particle swarm algorithm, the particles velocity and position was updated by using the method of inertia weight, its value was decreased linearly, the accuracy of convergence was improved by adopting the strategies of multi population evolution. The process of the algorithm was parallel through the MapReduce model, which could improve the efficiency of the algorithm effectively. Several popular algorithms were selected and tested on 13 benchmark functions of 500 dimensions and 1 000 dimensions. The results showed that the algorithm has good optimization performance.

Key words: particle swarm optimization, large scale optimization, MapReduce model, distributed, parallel

CLC Number: 

  • TP391
[1] KENNEDY J, EBERHART R C.Particle swarm optimization[C] //IEEE International Conference on Neural NetworksPerth. Australia:IEEE, 1995:1942-1948.
[2] 陈永刚,魏汪洋,肖春宝.粒子群优化算法在函数优化上的研究与发展[J].西安邮电学院学报,2009,14(3):113-116. CHEN Yonggang, WEI Wangyang, XIAO Chunbao. Research and development of particle swarm optimization algorithm in function optimazation[J]. Journal of Xi'an University of Post and Telecommunications, 2009, 14(3):113-116.
[3] 孟庆宽,仇瑞承,张漫,等.基于改进粒子群优化模糊控制的农业车辆导航系统[J].农业机械学报,2015,46(3):29-36. MENG Qingkuan, QIU Ruicheng, ZHANG Man, et al. Navigation system of agricultural vehicle based on fuzzy logic controller with improved particle swarm optimization algorithm [J]. Journal of Transactions of the Chinese Society for Agricultural Machinery, 2015, 46(3):29-36.
[4] 徐乐华,凌卫新,熊丽琼.基于面向对象自适应粒子群算法的神经网络训练[J].计算机应用研究,2009,26(1):111-113. XU Lehua, LIN Weixin, XIONG Liqiong.Neural network training based on object-oriented adaptive particle swarm optimization[J].Journal of Application Research of Computers, 2009, 26(1):111-113.
[5] 张鑫源,胡晓敏,林盈. 遗传算法和粒子群优化算法的性能对比分析[J].计算机科学与探索,2014,8(1):90-102. ZHANG Xinyuan, HU Xiaomin, LIN Ying. Comparisons of genetic algorithm and particle swarm optimization[J]. Journal of Frontiers of Computer Science & Technology, 2014, 8(1):90-102.
[6] 金敏,鲁华祥.一种遗传算法与粒子群优化的多子群分层混合算法[J].控制理论与应用,2013,30(10):1231-1238. JIN Min, LU Huaxiang. A multi-subgroup hierarchical hybrid of genetic algorithm and particle swarm optimization[J].Journal of Control Theory & Applications, 2013, 30(10):1231-1238.
[7] 汪靖,吴志健.在GPU上求解大规模优化问题的反向策略的PSO算法[J].武汉大学学报(理学版), 2011,57(2):148-154. WANG Jing, WU Zhijian. Opposition-based particle swarm optimization for solving large scale optimization problems on graphic process unit[J]. Journal of Wuhan University(Science Edition), 2011, 57(2):148-154.
[8] DEAN J, GHEMAWAT S. MapReduce: simplified data processing on large clusters[J]. Proceedings of Operating Systems Design and Implementation, 2004, 51(1):107-113.
[9] DEAN J, GHEMAWAT S. MapReduce: a flexible data processing tool[J]. Communications of the Acm, 2010, 53(1):72-77.
[10] MCNABB A W, MONSON C K, SEPPI K D. Parallel PSO using MapReduce[C] //IEEE Congress on Evolutionary Computation. Singapore:IEEE, 2007:7-14.
[11] 马汉达,杨丽娜.基于Hadoop的PSO-KM聚类算法的并行实现[J].信息技术,2015,39(7):90-94. MA Handa, YANG Lina. Parallel implementation of PSO-KM clustering algorithm based on Hadoop[J]. Journal of information technology, 2015, 39(7):90-94.
[12] 黄奕平,万剑怡,万中英,等. 基于MapReduce的粒子群投影寻踪模型的设计与实现[J].江西师范大学学报(自然科学版),2012,36(4):388-394. HUANG Yiping, WAN Jianyi, WAN Zhongying, et al. The design and implementing for projection pursuit model using PSO based on MapReduce[J]. Journal of Jiangxi Normal University(Natural Science Edition), 2012, 36(4):388-394.
[13] SHI Y, EBERHART R C. Particle swarm optimization with fuzzy adaptive inertia weight[J]. International Journal of Bio Inspired Computation, 2001, 1(12):32-49.
[14] RANGER C, RAGHURAMAN R, PENMETSA A, et al. Evaluating MapReduce for multi-core and multiprocessor systems[C] //IEEE 13th International Symposium on High Performance Computer Architecture. Scottsdale, USA: IEEE, 2007:13-24.
[15] SHI Y, EBERHART R C. A modified particle swarm optimizer[C] //Proceedings of IEEE World Congress on Computational Intelligence. Scottsdale, USA: IEEE,1998:69-73.
[16] LØVBJERG M, RASMUSSEN T K, KRINK T. Hybrid particle swarm optimizer with breeding and subpopulations[C] //Proceedings of International Conference on Genetic and Evolutionary Computation. San Francisco, USA:ACM, 2001:469-476.
[17] 王雪飞,王芳,邱玉辉.一种具有动态拓扑结构的粒子群算法研究[J].计算机科学,2007,34(3):205-207,233. WANG Xuefei, WANG Fang, QIU Yuhui. Research on a Novel Particle Swarm Algorithm with Dynamic Topology [J]. Journal of Computer Science, 2007, 34(3):205-207,233.
[18] 石松,陈云.层次环形拓扑结构的动态粒子群算法[J].计算机工程与应用,2013,49(8):1-5. SHI Song, CHEN Yun.Dynamic particle swarm optimization algorithm with hierarchical ring topology[J].Journal of Computer Engineering and Applications, 2013, 49(8):1-5.
[19] RUCINSKI M, IZZO D, BISCANI F. On the impact of the migration topology on the island model[J]. Parallel Computing, 2010, 36(10):555-571.
[20] YANG Z Y, TANG K, YAO X. Large scale evolutionary optimization using cooperative coevolution[J]. Information Sciences, 2008, 178(15):2985-2999.
[21] YAO X, LIU Y, LIN G M, et al. Evolutionary programming made faster[J].IEEE Transactions On Evolutionary Computation, 1999, 3(2):82-102.
[1] SUN Donglei, SUN Yi, LIU Rui, SUN Pengkai, ZHANG Yumin. Ridge regression-based method for predicting distributed photovoltaic consumption capacity in distribution networks [J]. Journal of Shandong University(Engineering Science), 2025, 55(3): 149-157.
[2] LIU Xinfeng, ZHANG YiNi, XU Huisan, SONG Ling, CHEN Mengya. Shadow occlusion diagnosis of distributed photovoltaic power station based on random forest and expert system [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 98-104.
[3] Shizhan SONG,Haoyu CHEN,Jian ZHANG,Kun WANG,Qingshui HAO. Voltage control method of urban distribution network considering street light charging pile access [J]. Journal of Shandong University(Engineering Science), 2020, 50(3): 104-110.
[4] An ZHU, Chu XU. Method for super-resolution using parallel interlaced sampling [J]. Journal of Shandong University(Engineering Science), 2020, 50(2): 10-16.
[5] Fangyun HAN, Liang QIAO, Bincheng ZHAO, Li ZHANG. Weighted value of solar tariff based on time-of-use electricity price [J]. Journal of Shandong University(Engineering Science), 2019, 49(6): 93-97.
[6] Xueping GU, Chao YANG, Haiping LIANG, Yuanbo WANG, Shaoyan LI. Optimization method for parallel coordination restoration strategy of asynchronous power grid [J]. Journal of Shandong University(Engineering Science), 2019, 49(5): 9-16.
[7] Si YANG, Sitong LI, Jindong ZHANG, Yu BAI. Improvement of bandwidth model for high speed optical communicationlaser and its optimization by parallel computing [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 17-22.
[8] Hongming LIU,Hongyan ZENG,Wei ZHOU,Tao WANG. Optimization of job shop scheduling based on improved particle swarm optimization algorithm [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 75-82.
[9] Shulei JIANG,Shifeng YANG,Linghang YANG,Wenming SHI,Fuqing ZOU,Qinghong SHAN. The technology of spanning deep pond of the urban expressway nearby paralleling high-speed railway [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 91-100.
[10] Meng LIU,Taoyang XU,Changgang LI,Yue WU,Zhi WANG,Fangfang SHI,Jianjun SU,Guohui ZHANG,Kuan LI. Optimization of emergency load shedding of receiving-end power grid based on Particle Swarm Optimization [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 120-128.
[11] Fei WANG, Chunyi WANG, Chuanyong WANG, Guangfeng ZHAO, Mu LI, Xiaohan SHI. Restrictions and countermeasures of distributed PV integration based on secondary battery energy storage system [J]. Journal of Shandong University(Engineering Science), 2018, 48(6): 109-115.
[12] WANG Qi, SUN Zhumei, LIU Shaohong, BAI Jianyun. Integration transform of dust removal system based on fieldbus compatible technology [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(4): 37-41.
[13] HE Wenjie, HE Weichao, SUN Quansen. Parallelization and GPU acceleration of compressive sensing reconstruction algorithm [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(3): 110-114.
[14] FENG Xia, HUANG Xixiang. Airport noise isoline parallel generating algorithm based on grid edge labeling [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(2): 8-13.
[15] QIN Liguo, HE Xiao, ZHOU Donghua. A new distributed formation for multi-agent systems with constant time delays [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(5): 79-88.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] LUO Yun-hu,XING Li-dong,WANG Qin,LIU Hai-chun,WENG Xiao-guang . Coordination of bidding strategies for two kinds of interruptible load reserve markets on demand side[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(3): 77 -80 .
[2] LI Xin-Ping, DAI Yi-Fei, HU Jing. Fluid-solid coupling analysis of surrounding rock mass stability and water inflow forecast of a tunnel in a karst zone[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 1 -6 .
[3] ZHANG Dao-qiang. Knowledge preserving embedding[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(2): 1 -10 .
[4] RU Miao-yan,WANG Ming-gang,LU Cheng-xue,ZHANG Hong-lin . A microcalorimetric study of the optimum temperature of astarch enzymatic catalyzed reaction[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(1): 113 -115 .
[5] LIN Jie,YANG Li-cai,WU Xiao-qing,YE Yang . Artificial immune optimization method for solving the K shortest paths search in dynamic route guidance system[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(2): 103 -108 .
[6] MENG Xiang-xing1, YU Da-yang2, HAN Xue-shan2, ZHAO Jian-guo3. The  influence of  correlation  between  solar  irradiation  and  the  load  variation  on  grid-connected  photovoltaic  power  generation[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(2): 126 -129 .
[7] SONG Hong-jun,MA Xin,LI Yi-bin,JIA Lei . The design and realization of a 3D software system for an educational robot[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(4): 34 -38 .
[8] DONG Shao-guang,FAN Guang-han . The radiation research of electrical and optical properties on InGaN solar cell materials[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 102 -106 .
[9] YANG Wen-dong, ZHU Jin-fu, XU Li. REsearch  on  the  gate  assignment  problem  in  airport  based on  the  flight connecting  tree[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(2): 153 -158 .
[10] WU En-qi1, DU Bao-jiang1, WANG Hai-peng1, YU Jian-ping2. Study of visual planning of  underground power pipelines based on virtual reality[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(6): 54 -57 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd