Abstract
We have proposed a distributed storage system which autonomously migrates data blocks into a suitable storage node by considering their access frequency and read/write ratio. In this paper, we show that revised data migration policies can rapidly distribute input/output (I/O) hot spot over the storage nodes and can improve I/O performance of the entire system. Our simulation results show that the proposed method can reduce I/O execution time around 26% than the previous one at the maximum.
Article PDF
Avoid common mistakes on your manuscript.
References
A. Nunome, H. Hirata, K. Shibayama, A distributed storage system with dynamic tiering for iSCSI environment, Int. J. Networked and Distrib. Comput. 3 (2015), 42–50.
A. Nunome, H. Hirata, An improvement of migration efficiency in a distributed storage system with dynamic tiering, Proceedings of the 20th International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), ACIS and IEEE, Toyama, Japan, 2019, pp. 455–460.
B. Dufrasne, B.A. Barbosa, P. Cronauer, D. Demarchi, H.P. Drumm, R. Eliahu, et al., IBM System Storage DS8000 Easy Tier, IBM Corporation, Armonk, New York, USA, 2013. Available from: http://ibm.com/redbooks.
EMC, VNX FAST VP A detailed review, Dell EMC, Round Rock, Texas, USA, 2013. Available from: http://www.emc.com/collateral/software/white-papers/h8058-fast-vp-unified-storage-wp.pdf.
M. Ruijter, btier project, Available from: http://sourceforge.net/projects/tier/.
F. Chen, D.A. Koufaty, X. Zhang, Hystor: making the best use of solid state drives in high performance storage systems, Proceedings of the International Conference on Supercomputing (ICS), ACM Press, Tucson, Arizona, USA, 2011, pp. 22–32.
K. Oe, T. Nanri, K. Okamura, On-the-fly automated storage tiering with caching and both proactive and observational migration, 2015 Third International Symposium on Computing and Networking (CANDAR), IEEE, Sapporo, Japan, 2015, pp. 371–377.
J. Guerra, H. Pucha, J. Glider, W. Belluomini, R. Rangaswami, Cost effective storage using extent based dynamic tiering, Proceedings of the Ninth USENIX conference on File and stroage technologies (FAST), USENIX, San Jose, California, 2011, pp. 273–286.
G. Lipetz, E. Hazan, A. Natanzon, E. Bachmat, Automated tiering in a QoS environment using coarse data, 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing, IEEE, Zhangjiajie, China, 2013, pp. 1022–1030.
S. Shimano, A. Nunome, H. Hirata, K. Shibayama, An information propagation scheme for an autonomous distributed storage system in iSCSI environment, 2015 3rd International Conference on Applied Computing and Information Technology/2nd International Conference on Computational Science and Intelligence (ACIT), IEEE, Okayama, Japan, 2015, pp. 142–147.
A. Nunome, H. Hirata, K. Shibayama, An interval control method for status propagation in an autonomous distributed storage system, 2016 15th International Conference on Computer and Information Science (ICIS), IEEE, Okayama, Japan, 2016, pp. 1–6.
M. Chadalapaka, J. Satran, K. Meth, D. Black, Internet Small Computer System Interface (iSCSI) Protocol (Consolidated), 2014, RFC 7143, Internet Engineering Task Force (IETF), Available from: https://tools.ietf.org/pdf/rfc7143.pdf.
Ethernet Jumbo Frames version 0.1, Ethernet Alliance, Beaverton, Oregon, USA, 2009. Available from: http://www.ethernetalliance.org/wp-content/uploads/2011/10/EA-Ethernet-Jumbo-Frames-v0-1.pdf.
S. Shimano, A. Nunome, Y. Yokoi, K. Shibayama, H. Hirata, A dynamic configuration scheme of storage tiers for an autonomous distributed storage system, Inf. Eng. Exp. 3 (2017), 91–104.
J.R. Douceur, W.J. Bolosky, A large-scale study of file-system contents, Proceedings of the 1999 ACM SIGMETRICS International Conference on Measurement and modeling of computer systems, ACM Press, Atlanta, Georgia, USA, 1999, pp. 59–70.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).
About this article
Cite this article
Nunome, A., Hirata, H. Performance Evaluation of Data Migration Policies for a Distributed Storage System with Dynamic Tiering. Int J Netw Distrib Comput 8, 1–8 (2019). https://doi.org/10.2991/ijndc.k.191115.001
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.2991/ijndc.k.191115.001