We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Constructing data supply chain based on layered PROV.
- Authors
Li, Peng; Wu, Tin-Yu; Li, Xin-Ming; Luo, Hong; Obaidat, Mohammad
- Abstract
The inability to effectively construct data supply chain in distributed environments is becoming one of the top concerns in big data area. Aiming at this problem, a novel method of constructing data supply chain based on layered PROV is proposed. First, to abstractly describe the data transfer processes from creation to distribution, a data provenance specification presented by W3C is used to standardize the information records of data activities within and across data platforms. Then, a distributed PROV data generation algorithm for multi-platform is designed. Further, we propose a tiered storage management of provenance based on summarization technology, which reduces the provenance records by compressing mid versions so as to realize multi-level management of PROV. In specific, we propose a hierarchical visual technique based on a layered query mechanism, which allows users to visualize data supply chain from general to detail. The experimental results show that the proposed approach can effectively improve the construction performance for data supply chain.
- Subjects
STORAGE area networks (Computer networks); BIT rate; DATA transmission systems; BIG data; DATA science; MANAGEMENT
- Publication
Journal of Supercomputing, 2017, Vol 73, Issue 4, p1509
- ISSN
0920-8542
- Publication type
Article
- DOI
10.1007/s11227-016-1838-0