The Status of Object Storage

Source: https://gigaom.com/2020/03/09/the-status-of-object-storage/
March 09, 2020 at 10:26PM

Last week NVIDIA announced the acquisition of SwiftStack, an object storage startup that, in the last year, refocused most of its work on high performance and AI workloads. This follows a similar hand over from Western Digital to Quantum about the ActiveScale business, another object store that was more and more tailored to specific workloads. These two object stores will compete for less in the general-purpose S3 space, and will be instrumental in the creation of end-to-end solutions.

The object storage market is maturing and evolving pretty quickly. We recently published two reports on object storage (Key criteria for evaluating enterprise object storage and GigaOm Radar for enterprise object storage). In these reports, object stores are grouped in Enterprise, High Performance, and Specialized categories, depending on their characteristics. In fact, most of the vendors have finally found out two important reasons to differentiate themselves from the general-purpose S3 market:

1. The Cloud Wins: Many enterprises are moving more and more of their apps and data to the cloud. If your organization does not have a particular need to stay on-prem such as a particular regulation or restriction, the cloud is just better. And, to be honest, applications and data want to stay next to each other.
2. Differentiation in Traditional Object Storage is Minimal: If you think about object storage as an S3-compatible system for storing cold data. At the end of the day, differentiation is minimal, and it all comes down to $/GB and a few other secondary characteristics with minimal impact on overall TCO and ROI.

With fewer opportunities and minimal differentiation, there are no clear winners in object storage.

Differentiation, Specialization, Ecosystems

SwiftStack was not the only one working on performance last year. OpenIO, for example, shifted its focus to high performance as well.

NetApp and Hitachi Vantara have integrated their object stores in their ecosystem, making them instrumental for the execution of their strategies.

Scality is investing their efforts in a multi-cloud and scale-out file system, which is appealing to large enterprises.

Red Hat has a two-fold strategy, with multi-cloud (with NooBaa) and ecosystem integration with Ceph being the default choice for OpenShift Storage.

Caringo is focusing more and more on the media and entertainment industry with features aimed at simplifying media management, specialized edge appliance, and so on.

Minio, who in the past, I defined as the MySQL of object stores, wants to be the object store of choice for every developer and Kubernetes/containerized application.

There is a group (Dell EMC, IBM, Cloudian) still trying to sell general-purpose S3-compatible storage but, again. At the same time, Dell EMC and IBM object stores are part of a larger ecosystem, Cloudian will soon need to find something on which to specialize or they will risk competing only on $/GB every time… and this is not something that will please investors or be sustainable in the long term.

Furthermore, S3 interface is now more and more common across storage systems of any kind. Scale-out file storage systems have it (Pure Storage FlashBlade, Qumulo, Vast Data, Isilon, you name it), HCI vendors have it (Nutanix, for example), Primary storage systems have it too (e.g., Infinidat). This Makes the traditional object store less interesting for a growing number of use cases, especially when capacity and cost are not on top of the priorities.

There is More

Did you read my article about the death of the hard drive? If you did not, in that article, I talk about the evolution of the hard drive and how it will become less usable in enterprise data centers. In fact, most of the development focuses on carving out more capacity from this type of device. Unfortunately, due to several mechanical and physical limitations, achieving this goal will come with a lot of compromises on performance and access methods. Without controlling the entire stack, it will be practically impossible to take advantage of this media, something that only hyperscalers can do. Long story short, for general-purpose object storage vendors, it will become even more difficult to compete on a $/GB.

Closing the Circle

Object storage is becoming more relevant for every IT organization, on-premises or in the cloud, no matter if it is by choice or part of an end-to-end solution.

S3 compatibility is now table stake (not a differentiator), and object storage vendors know that. They are targeting new markets and workloads with features that are much more sophisticated than the basic PUT, GET, DELETE, and $/GB. It is the only way to survive in the long term.

If you want to learn more about the key criteria to evaluate object storage or have a clear view on how the object storage market is evolving, subscribe to GigaOm and download my reports. It is just $83/month and will give you access to our entire research library!