Reliability Assurance of Big Data in the Cloud : Cost-Effective Replication-Based Storage.

Cover -- Title page -- Copyright Page -- Contents -- About the Authors -- Preface -- Acknowledgments -- Chapter 1 - Introduction -- 1.1 - Data reliability in the Cloud -- 1.2 - Background of Cloud storage -- 1.2.1 - Distinctive features of Cloud storage systems -- 1.2.1.1 - On-demand self-service and pay-as-you-go pricing model -- 1.2.1.2 - Redundant and scalable virtualized resources -- 1.2.1.3 - Dedicated Cloud network -- 1.2.1.4 - Big data -- 1.2.2 - The Cloud data life cycle -- 1.2.2.1 - Data creation -- 1.2.2.2 - Data maintenance -- 1.2.2.3 - Data recovery -- 1.2.2.4 - Data deletion -- 1.3 - Key issues of research -- 1.4 - Book overview -- Reliability Assurance of Big Data in the Cloud Cost-Effective Replication-Based Storage -- Chapter2 - Literature review -- 2.1 - Data reliability assurance in hardware -- 2.1.1 - Disk -- 2.1.1.1 - Disk failure modes -- 2.1.1.1.1 - Partial disk failures -- 2.1.1.1.2 - Permanent disk failures -- 2.1.1.2 - Disk reliability metrics -- 2.1.1.3 - Disk reliability patterns -- 2.1.2 - Other storage medias -- 2.2 - Data reliability assurance in software -- 2.2.1 - Replication for data reliability -- 2.2.2 - Erasure coding for data reliability -- 2.3 - Data transfer for distributed systems -- 2.4 - Summary -- Chapter 3 - Motivating example and problem analysis -- 3.1 - Motivating example -- 3.1.1 - The pulsar searching application process -- 3.1.2 - The pulsar searching application data flow -- 3.1.3 - Storing pulsar searching data in the Cloud -- 3.2 - Problem analysis -- 3.2.1 - Two major factors of Cloud storage cost -- 3.2.2 - Data storage devices and schemes -- 3.2.3 - Cloud network and data transfer activities -- 3.2.3.1 - Case for data maintenance within the data center -- 3.2.3.2 - Case for data processing within the data center -- 3.2.3.3 - Case for across data centers with DCI activities.

3.2.4 - Research issues -- 3.2.4.1 - Data reliability model -- 3.2.4.2 - Minimum replication calculation and benchmark -- 3.2.4.3 - Cost-effective data reliability assurance mechanism -- 3.2.4.4 - Cost-effective data transfer strategy for data creation and data recovery -- 3.3 - Summary -- Chapter 4 - Generic data reliability model in the cloud -- 4.1 - Properties of the data reliability model -- 4.1.1 - Reliability metrics -- 4.1.2 - Data reliability model type -- 4.1.3 - Failure rate pattern of storage devices -- 4.2 - Generic data reliability model -- 4.2.1 - Data reliability with static disk failure rate -- 4.2.2 - Data reliability with variable disk failure rate -- 4.2.3 - Generic data reliability model for multi-replicas -- 4.3 - Summary -- Chapter 5 - Minimum replication for meeting the data reliability requirement -- 5.1 - The minimum replication calculation approach -- 5.1.1 - Minimum replication calculation formulas -- 5.1.2 - Optimization of the minimum replication calculation formulas -- 5.2 - Minimum replication benchmark -- 5.3 - Evaluation of the minimum replication calculation approach -- 5.4 - Summary -- Chapter 6 - Cost-effective data reliability assurance for data maintenance -- 6.1 - Proactive replica checking -- 6.2 - Overview of PRCR -- 6.2.1 - User interface -- 6.2.2 - PRCR node -- 6.3 - Working process of PRCR -- 6.4 - Optimization algorithms in PRCR -- 6.4.1 - Minimum replication algorithm -- 6.4.2 - Metadata distribution algorithm -- 6.4.2.1 - The maximum capacity of PRCR -- 6.4.2.2 - Provision of sufficient data reliability assurance -- 6.5 - Evaluation of PRCR -- 6.5.1 - Performance of PRCR -- 6.5.1.1 - The minimum replication algorithm -- 6.5.1.2 - Metadata scanning and proactive replica checking -- 6.5.1.3 - Impact of PRCR on data access performance -- 6.5.2 - Cost-effectiveness of PRCR -- 6.5.2.1 - Running overhead.

6.5.2.2 - Data storage cost -- 6.5.3 - Summary of the evaluation -- 6.6 - Summary -- Chapter 7 - Cost-effective data transfer for data creation and data recovery -- 7.1 - Determining the deadline for data creation and data recovery -- 7.2 - Cloud network model -- 7.2.1 - Overall network model -- 7.2.2 - Pipeline model -- 7.2.3 - Pipeline agenda model -- 7.2.4 - Overall agenda model -- 7.3 - Energy consumption model for Cloud data transfer -- 7.4 - Novel cost-effective data transfer strategy LRCDT -- 7.5 - Evaluation of LRCDT -- 7.5.1 - Parameters of simulation -- 7.5.2 - Energy consumption comparison -- 7.5.3 - Task completion time comparison -- 7.6 - Summary -- Chapter 8 - Conclusions and future work -- 8.1 - Summary of this book -- 8.2 - Key contributions of this book -- 8.3 - Further discussion and future work -- 8.3.1 - Further discussions -- 8.3.2 - Future work -- Bibliography -- Appendix -- Notation index.

Description based on publisher supplied metadata and other sources.

Electronic reproduction. Ann Arbor, Michigan : ProQuest Ebook Central, 2024. Available via World Wide Web. Access may be limited to ProQuest Ebook Central affiliated libraries.