JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2010, Vol. 40 ›› Issue (4): 153-158.
• Articles •
CHEN Sheng-li 1, LI Jun-kui2, LIU Xiao-dong1
In the light of the conflict between limited memory and large-scale data, a solution to large volume concurrent data integration was proposed, which was not read the data into memory at one time, but divided the task into several sub-tasks according to the large volume data. The sub-tasks was complicated by the implementation so as to solve the limited memory and largescale conflict between the amount of data. The theoretical analysis and empirical experiments showed that resources could be used in the method of the system, and the solution could be efficiently applied in the large volume data integration process with a configurable mode.
large volume data,
CHEN Sheng-li 1, LI Jun-kui2, LIU Xiao-dong1. Mintegration: a solution to large volume concurrent data integration[J].JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(4): 153-158.
Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks