We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
An Efficient MapReduce Computing Model for Imprecise Applications.
- Authors
Changjian Wang; Yuxing Peng; Mingxing Tang; Dongsheng Li; Shanshan Li; Pengfei You
- Abstract
Optimizing the Map process is important for the improvement of the MapReduce performance. Many efforts have been devoted into the problem to design more efficient scheduling strategies. However, there exists a kind of MapReduce applications, named imprecise applications, where the imprecise results based on part of map tasks can satisfy the requirements of imprecise applications and thus the job processes can be completed when enough map tasks are processed. According to the feature of imprecise applications, the authors propose an improved MapReduce model, named MapCheckReduce, which can terminate the map process when the requirements of an imprecise application is satisfied. Compared to MapReduce, a Check mechanism and a set of extended programming interfaces are added to MapCheckReduce. The Check mechanism receives and analyzes messages submitted by completed map tasks and then determines whether to terminate the map phase according to the analysis results. The programming interfaces are used by the programmers to define the termination conditions of the map process. A data-prefetching mechanism is designed and implemented in MapCheckReduce which can improve the performance of MapCheckReduce effectively. The MapCheckReduce prototype has been implemented and experiment results verify the feasibility and effectiveness of MapCheckReduce.
- Subjects
COMPUTER programming; COMPUTER interfaces; SCHEDULING software; TIME management software; COMPUTER algorithms
- Publication
International Journal of Web Services Research, 2016, Vol 13, Issue 3, p46
- ISSN
1545-7362
- Publication type
Article
- DOI
10.4018/IJWSR.2016070103