We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
PROCESSING SOLUTIONS FOR BIG DATA IN ASTRONOMY.
- Authors
Fillatre, L.; Lepiller, D.
- Abstract
This paper gives a simple introduction to processing solutions applied to massive amounts of data. It proposes a general presentation of the Big Data paradigm. The Hadoop framework, which is considered as the pioneering processing solution for Big Data, is described together with YARN, the integrated Hadoop tool for resource allocation. This paper also presents the main tools for the management of both the storage (NoSQL solutions) and computing capacities (MapReduce parallel processing schema) of a cluster of machines. Finally, more recent processing solutions like Spark are discussed. Big Data frameworks are now able to run complex applications while keeping the programming simple and greatly improving the computing speed.
- Subjects
ASTRONOMY; BIG data; CLUSTER analysis (Statistics); RESOURCE allocation; COMPUTER programming; PARALLEL processing
- Publication
EAS Publications Series, 2016, Vol 78/79, p179
- ISSN
1633-4760
- Publication type
Article
- DOI
10.1051/eas/1678009