Containers Expo Blog Authors: Yeshim Deniz, Elizabeth White, Pat Romanski, Liz McMillan, Ravi Rajamiyer

Related Topics: Containers Expo Blog, @CloudExpo

Containers Expo Blog: Article

New Changes in Persistent Memory | @CloudExpo #Cloud #Storage

How Persistent Memory technologies will revolutionize compute as we know it

Incumbent storage vendors such as EMC, Netapp, and Nutanix have built their rich code base on the block layer. This means that the only viable option to use Persistent Memory as a storage tier is to wrap it up with an abstraction layer that will present it as a block device.

As a veteran researcher, I'm always interested in brand-new approaches for doing things. One great example is the new NVM programming model (NPM) proposed by SNIA. The new NPM approach took a big step forward this week, as version 1.0 of the associated NVM library (NVML) was released.

For the few people who understood this previous paragraph - congratulations on the major milestone. If you haven't really understood it, however, don't go away. I'll start from the beginning...

Hardware Background
New families of storage media and device types have been introduced and announced recently. These persistent memory (PM) technologies have amazing hardware properties, and there seems to be a growing consensus that they are going to revolutionize compute as we know it.

The billion-dollar question then is which software approach to choose in order to leverage this unique PM hardware.

Software Approach Survey
There are three main software approaches for using PM. This is not a matter of right or wrong, as there are tradeoffs. For the sake of clarity, I numbered these approaches I, II and III. This should help us stay at the technical, not the marketing, level.

Figure 1 illustrates that the key parameter for classifying software approaches is the amount of re-used versus re-written software. Approach I is tuned for highest software reuse. Approach II rewrites system software, but leaves the application untouched. Approach III rewrites all layers and moves the application to a new programming model.

Figure 1: The different software approaches for leveraging PM

Approaches I and II have the benefit of supporting applications "out of the box" with no modification. But Approach II requires additional development work from the system software vendor - work that has to be justified by extra performance. Figure 2 shows that the commonly adopted FIO benchmark was able to achieve 2-3 orders of magnitude better throughput and latency just by switching the software approach. Moving from Approach I (ZFS or XFS on NVDIMMs) to Approach II (Plexistor SDM) has brought tremendous value.

Further comparing the three approaches, performance, software reuse, and other technical properties are summarized in Figure 3. Most properties are self-explanatory, but two are worth elaborating on: "Data services model" and "$/GB". IT administrators use data services to comply with organizational requirements (e.g., use the storage array snapshot to create a backup). Approaches I and II follow the same model, while Approach III moves a lot of that responsibility to the application developer.

The second property "$/GB" is mainly a function of supporting multiple tiers and being able to automatically move data between them according to usage patterns. This is important because PM cost per capacity unit ($/GB) is high. PM cost is expected to drop with volume and time, but it will not catch up with SSD and HDD for many years. Auto-tiering is a vendor dependent feature. Sticking to the examples used in Figure 2: ZFS supports it, XFS and XFS-DAX do not, and Plexistor SDM does.

Now that we've established a clean technical background, let's apply it back to the market.

Mapping Industry Efforts
The next figure maps the theoretical software approaches mentioned above to actual implementations and players. It is not meant as a comprehensive industry-wide survey of all software solutions, just the leading ones. Also, with PM being a hot topic, I'm sure many other solutions will join down the road.

Incumbent storage vendors such as EMC, Netapp, and Nutanix have built their rich code base on the block layer. This means that their only viable option to use PM as a storage tier is to wrap it up with an abstraction layer that will present it as a block device (i.e. Approach I).

In contrast, SDM or file system vendors that have deeply believed in PM for the past couple of years, such as Microsoft and Plexistor, have built file-level solutions that use PM as a storage tier. Both companies added support for DAX, which enables zero copy of memory mapped files (MMF), and can support approaches II and III.

As a side note, it will be interesting to compare the performance and features provided by Microsoft ReFS and Plexistor SDM. But, we will have to wait until Windows Server 2016 is released. Also, as interesting as the comparison may be for us techies, I doubt if many Windows users will move to Linux because of it. People do not switch religions overnight.

The DAX support in Microsoft ReFS and Plexistor SDM, as well as the ones being built for EXT4-DAX and XFS-DAX are the foundation for approach III. Intel and HPE have been leading the standardization of this approach through the SNIA NVM Programming Model documents and the complementary NVML library and tests - the same library that just reached its major milestone, the stable 1.0 release.

We at Plexistor are continuously running the 1,779 NVML tests on our SDM software. We've been doing that for a year now, because we believe that customers should be able to run traditional and NVM-aware applications side by side. Customers should be able to transparently share data between these applications and enforce the same policies on that data, regardless of how it was created.

More Stories By Amit Golander

Dr. Amit Golander is the Chief Technology Officer (CTO) and R&D Manager for Plexistor. His responsibilities are to develop the product and work with CEO, Sharon Azulai, on the vision for the technology and products.

Golander brings a rich research, development, and leadership background to Plexistor where he has distinguished himself in both the corporate, startup and higher educational realms.In addition to his work in the business and academic sectors, Golander holds over 50 patents and has published a number of technology articles in prestigious engineering journals.

Prior to Plexistor, Golander was VP of Systems and Product for Primary Data where he was responsible for strategic partnerships, alliances and beta customers as well as worked closely with the R&D teams on the day-to-day product management.Golander also worked for IBM for over twelve years on data center and cloud infrastructure.

Golander has also mentored M.Sc. students and taught computer architecture and quantitative analysis at Tel Aviv University.

Golander received his B.Sc. in C.S.and EE and his Ph.D. from Tel Aviv University in the field of computer architecture. His thesis won the Intel Research Award. Prior to his academic studies, Golander served as an intelligence officer in the Israeli Defense Force (IDF).

IoT & Smart Cities Stories
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
We are seeing a major migration of enterprises applications to the cloud. As cloud and business use of real time applications accelerate, legacy networks are no longer able to architecturally support cloud adoption and deliver the performance and security required by highly distributed enterprises. These outdated solutions have become more costly and complicated to implement, install, manage, and maintain.SD-WAN offers unlimited capabilities for accessing the benefits of the cloud and Internet. ...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and G...
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
Founded in 2000, Chetu Inc. is a global provider of customized software development solutions and IT staff augmentation services for software technology providers. By providing clients with unparalleled niche technology expertise and industry experience, Chetu has become the premiere long-term, back-end software development partner for start-ups, SMBs, and Fortune 500 companies. Chetu is headquartered in Plantation, Florida, with thirteen offices throughout the U.S. and abroad.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.