云计算中 HDFS 数据存储策略研究

打开文本图片集

摘要：针对在云计算中HDFS存储小文件数据读取率低、时间长和内存消耗大等缺点，文章提出了一种分布式缓存方案策略，通过每个DataNode节点缓存处理客户端频繁访问的小文件，从而显著降低了DataNode磁盘访问的频率，提高了数据的存储效率，以期为云计算中的存储技术提供科学参考。

关键词：云计算；HDFS；小文件；方案策略

中图法分类号：TP333文献标识码：A

Research on HDFS data storage strategy in cloud computing

XU Kefei

（Jinan Software Research Institute of China United Network Communication Co.，Ltd.，Jinan 250100，China）

Abstract：In view of the shortcomings of low data reading rate， long time and large memory consumption of small files are stored in HDFS in cloud computing， a distributed caching scheme strategy is proposed. Each DataNode caches and processes small files frequently accessed by clients， which significantly reduces the frequency of DataNode disk access and improves the storage efficiency of data， in order to provide scientific reference for storage technology in cloud computing.

Key words： cloud computing， HDFS，small file， scheme strategy

近年来，随着计算机和互联网应用技术的快速发展，云计算作为一种新的计算模式应用而生。（剩余3528字）