NEC HYDRAstor

Summary

NEC HYDRAstor is a disk-based grid storage system with data deduplication for backups and archiving, developed by NEC Corporation. A HYDRAstor storage system can be composed of multiple nodes, starting from one up to 100+ nodes. Each node contains standard hardware including disk drives, CPU, memory and network interfaces and is integrated with the HYDRAstor software into a single storage pool. HYDRAstor software incorporates multiple features of distributed storage systems: content-addressable storage, global data deduplication, variable block size, Rabin fingerprinting, erasure codes, data encryption and load balancing.

NEC HYDRAstor
Stable release
HS8-5000 / 2016
Written inC++
PlatformCross-platform
TypeBackup and Archive
Licenseproprietary
Websitewww.necam.com/hydrastor/

History edit

HYDRAstor project was started in 2002 by Cezary Dubnicki and Cristian Ungureanu in NEC Research in Princeton, NJ.[citation needed] Prototype version was implemented and evaluated in 2004.[1] After another 3 years of development, first version of HYDRAstor was brought to the market in US and Japan. Subsequent version with improved software and hardware were released in following years, with latest version, HS8-5000, providing 72TB raw storage per node, up to 11.88PB of raw capacity in its maximum configuration.[2]

Main features edit

HYDRAstor can be scaled from single node to 165 nodes in a multi-rack grid appliance.[3] Capacity and bandwidth can be scaled independently by using different types of nodes:

  • storage nodes – adding capacity
  • hybrid nodes – adding both capacity and performance

HYDRAstor supports online expansion, with automatic data migration and with no downtime.[4] In standard configuration, HYDRAstor provides resiliency to up to 3 concurrent disk or node failures.[5] Failures are automatically detected and data reconstruction is automatically performed, which means that if time between failures is enough to reconstruct data, system can withstand any number of them.[4]

References edit

  1. ^ Cezary Dubnicki; Cristian Ungureanu; Wojciech Kilian (2004). "FPN: a distributed hash table for commercial applications". Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004. 13th IEEE International Symposium on High performance Distributed Computing (HPDC '04). IEEE. pp. 120–128. doi:10.1109/HPDC.2004.1323509. ISBN 0-7695-2175-4.
  2. ^ "HYDRAstor HS8-5000: Scale-out Global Dedupliaction Storage for Backup and Archive". NEC America. Retrieved 2017-01-11.
  3. ^ "HYDRAstor HS8-5000: Scale-out Global Dedupliaction Storage for Backup and Archive". NEC America. Retrieved 2017-01-11.
  4. ^ a b Cezary Dubnicki; Leszek Gryz; Łukasz Heldt; Michał Kaczmarczyk; Wojciech Kilian; Przemysław Strzelczak; Jerzy Szczepkowski; Cristian Ungureanu; Michał Wełnicki (February 24–27, 2009). "HYDRAstor: a Scalable Secondary Storage". Proceedings 7th USENIX Conference on File and Storage Technologies. San Francisco, California: USENIX. Retrieved 2015-04-29.
  5. ^ "HYDRAstor - FAQ". NEC America. Retrieved 2015-04-29.