Advanced Computing in the Age of AI | Saturday, April 20, 2024

RainStor Delivers Hadoop on EMC Isilon NAS 

RainStor has successfully completed product testing, resulting in validation of its database on EMC Corporation's Isilon Scale-Out network-attached storage (NAS) running on the Hadoop Distributed File System (HDFS). RainStor is already in production with customers running on Isilon, and by adding native Hadoop capabilities, customers gain further benefits and flexible deployment options with Big Data initiatives.

As enterprise adoption of Hadoop increases, capabilities around ease-of-use, efficient scale and reliability become a high priority. To date, Hadoop has been deployed on low-cost commodity direct attached storage (DAS) environments but different architectures are now being deployed to optimize both compute and storage. As data volumes grow, the need to balance CPU and storage capacity is critical in order to achieve an optimal environment. With DAS deployments, compute and storage are rigid and cannot be separated which becomes challenging as requirements change over time.

RainStor enables enterprise customers to run Hadoop anywhere. With unique data compression yielding a 20-40X storage reduction, companies can scale their data with greater predictability and efficiency. The RainStor highly-compressed file format is virtualized from the underlying storage layer and therefore behaves the same whether running on DAS or NAS. With the ability to co-exist Hadoop data running on both DAS and NAS, you can now separate the compute layer from the storage layer and gain both scale efficiencies and query performance.

Running Hadoop on Isilon with RainStor, you achieve:

  • Flexible New Architecture Running Hadoop on NAS and DAS together: Companies leverage DAS local storage for hot data where performance is critical and use Isilon for mass data storage. With RainStor's compression, you efficiently move more data across the network, essentially creating an I/O multiplier.
  • Built-in Security and Reliability: Data is securely stored with built-in encryption, and data masking in addition to user authentication and authorization. Carrying very little overhead, you benefit from Isilon FlexProtect, which provides a reliable, highly available Big Data environment.
  • Query Speed-up: Data is queried using a variety of tools including standard SQL, BI tools Hive, Pig and MapReduce. With built-in filtering, queries speed-up by a factor of 2-10X compared to Hive on HDFS/DAS.
  • Compliant WORM Solution: For absolute retention and protection of business critical data -- including stringent SEC 17a-4 requirements you leverage Isilon's SmartLock in addition to RainStor's built-in immutable data retention capabilities.
EnterpriseAI