|
|
|
| Research and application of NVMe in distributed storage of meteorological big data |
| Chen Xuhui, Liu Yang, Gao Peng, Xu Juan |
| Gansu Meteorological Information and Equipment Technical Support Center,Lanzhou 730020 |
|
|
|
|
Abstract By using fio test tool,this paper studies the performance of NVMe solid-state disk and software RAID in the meteorological big data cloud platform of Gansu meteorological bureau in detail.The results show that the NVMe solid-state disk software RAID0 is suitable for constructing distributed storage,which can meet the requirements of high performance,high reliability and low latency of data center storage.And the software RAID5 has too much performance loss and is not recommended to use.At the same time,the results show that NVMe solid state disk performs best when using XFS file system.In addition,NVMe solid-state drives perform better with the none scheduler.Finally,it can be seen that high-version Linux kernels can better support NVMe,which allows NVMe SSD to achieve higher performance with fewer CPUs.
|
|
Received: 14 March 2021
|
|
|
|
|
|
| [1] |
王国复,徐枫,吴增祥.气象元数据标准与信息发布技术研究[J].应用气象学报,2005,16(1):114-121.
|
| [2] |
程学旗,靳小龙,王元卓,等.大数据系统和分析技术综述[J].软件学报,2014,25(9):1889-1908.
|
| [3] |
孟小峰,慈祥.大数据管理:概念、技术与挑战[J].计算机研究与发展,2013,50(1):146-169.
|
| [4] |
沈文海.再析气象大数据及其应用[J].中国信息化,2016,13(1):85-96.
|
| [5] |
熊安元,赵芳,王颖,等.全国综合气象信息共享系统的设计与实现[J].应用气象学报,2015,26(4):500-512.
|
| [6] |
尹建平,孙庆国,李伟,等.数值预报业务流程自动化设计与实现[J].气象水文海洋仪器,2015,32(2):79-83.
|
| [7] |
沈文海.气象业务信息系统未来基础架构探讨——“云计算”和“大数据”在气象信息化中的作用[J].气象科技进展,2015,5(3):64-66.
|
| [8] |
李存琛.海量数据分布式存储技术的研究与应用[D].北京:北京邮电大学,2012.
|
| [9] |
李永生,曾沁,徐美红,等.基于Hadoop的数值预报产品服务平台设计与实现[J].应用气象学报,2015,26(1):122-128.
|
| [10] |
杨俊杰,廖卓凡,冯超超.大数据存储架构和算法研究综述[J].计算机应用,2016,36(9):2465-2471.
|
|
|
|
2021, Vol. 38 
