Welcome!

Containers Expo Blog Authors: Elizabeth White, Liz McMillan, Pat Romanski, Yeshim Deniz, Amit Gupta

Related Topics: Containers Expo Blog, @CloudExpo

Containers Expo Blog: Article

New Changes in Persistent Memory | @CloudExpo #Cloud #Storage

How Persistent Memory technologies will revolutionize compute as we know it

Incumbent storage vendors such as EMC, Netapp, and Nutanix have built their rich code base on the block layer. This means that the only viable option to use Persistent Memory as a storage tier is to wrap it up with an abstraction layer that will present it as a block device.

As a veteran researcher, I'm always interested in brand-new approaches for doing things. One great example is the new NVM programming model (NPM) proposed by SNIA. The new NPM approach took a big step forward this week, as version 1.0 of the associated NVM library (NVML) was released.

For the few people who understood this previous paragraph - congratulations on the major milestone. If you haven't really understood it, however, don't go away. I'll start from the beginning...

Hardware Background
New families of storage media and device types have been introduced and announced recently. These persistent memory (PM) technologies have amazing hardware properties, and there seems to be a growing consensus that they are going to revolutionize compute as we know it.

The billion-dollar question then is which software approach to choose in order to leverage this unique PM hardware.

Software Approach Survey
There are three main software approaches for using PM. This is not a matter of right or wrong, as there are tradeoffs. For the sake of clarity, I numbered these approaches I, II and III. This should help us stay at the technical, not the marketing, level.

Figure 1 illustrates that the key parameter for classifying software approaches is the amount of re-used versus re-written software. Approach I is tuned for highest software reuse. Approach II rewrites system software, but leaves the application untouched. Approach III rewrites all layers and moves the application to a new programming model.

Figure 1: The different software approaches for leveraging PM

Approaches I and II have the benefit of supporting applications "out of the box" with no modification. But Approach II requires additional development work from the system software vendor - work that has to be justified by extra performance. Figure 2 shows that the commonly adopted FIO benchmark was able to achieve 2-3 orders of magnitude better throughput and latency just by switching the software approach. Moving from Approach I (ZFS or XFS on NVDIMMs) to Approach II (Plexistor SDM) has brought tremendous value.

Further comparing the three approaches, performance, software reuse, and other technical properties are summarized in Figure 3. Most properties are self-explanatory, but two are worth elaborating on: "Data services model" and "$/GB". IT administrators use data services to comply with organizational requirements (e.g., use the storage array snapshot to create a backup). Approaches I and II follow the same model, while Approach III moves a lot of that responsibility to the application developer.

The second property "$/GB" is mainly a function of supporting multiple tiers and being able to automatically move data between them according to usage patterns. This is important because PM cost per capacity unit ($/GB) is high. PM cost is expected to drop with volume and time, but it will not catch up with SSD and HDD for many years. Auto-tiering is a vendor dependent feature. Sticking to the examples used in Figure 2: ZFS supports it, XFS and XFS-DAX do not, and Plexistor SDM does.

Now that we've established a clean technical background, let's apply it back to the market.

Mapping Industry Efforts
The next figure maps the theoretical software approaches mentioned above to actual implementations and players. It is not meant as a comprehensive industry-wide survey of all software solutions, just the leading ones. Also, with PM being a hot topic, I'm sure many other solutions will join down the road.

Incumbent storage vendors such as EMC, Netapp, and Nutanix have built their rich code base on the block layer. This means that their only viable option to use PM as a storage tier is to wrap it up with an abstraction layer that will present it as a block device (i.e. Approach I).

In contrast, SDM or file system vendors that have deeply believed in PM for the past couple of years, such as Microsoft and Plexistor, have built file-level solutions that use PM as a storage tier. Both companies added support for DAX, which enables zero copy of memory mapped files (MMF), and can support approaches II and III.

As a side note, it will be interesting to compare the performance and features provided by Microsoft ReFS and Plexistor SDM. But, we will have to wait until Windows Server 2016 is released. Also, as interesting as the comparison may be for us techies, I doubt if many Windows users will move to Linux because of it. People do not switch religions overnight.

The DAX support in Microsoft ReFS and Plexistor SDM, as well as the ones being built for EXT4-DAX and XFS-DAX are the foundation for approach III. Intel and HPE have been leading the standardization of this approach through the SNIA NVM Programming Model documents and the complementary NVML library and tests - the same library that just reached its major milestone, the stable 1.0 release.

We at Plexistor are continuously running the 1,779 NVML tests on our SDM software. We've been doing that for a year now, because we believe that customers should be able to run traditional and NVM-aware applications side by side. Customers should be able to transparently share data between these applications and enforce the same policies on that data, regardless of how it was created.

More Stories By Amit Golander

Dr. Amit Golander is the Chief Technology Officer (CTO) and R&D Manager for Plexistor. His responsibilities are to develop the product and work with CEO, Sharon Azulai, on the vision for the technology and products.

Golander brings a rich research, development, and leadership background to Plexistor where he has distinguished himself in both the corporate, startup and higher educational realms.In addition to his work in the business and academic sectors, Golander holds over 50 patents and has published a number of technology articles in prestigious engineering journals.

Prior to Plexistor, Golander was VP of Systems and Product for Primary Data where he was responsible for strategic partnerships, alliances and beta customers as well as worked closely with the R&D teams on the day-to-day product management.Golander also worked for IBM for over twelve years on data center and cloud infrastructure.

Golander has also mentored M.Sc. students and taught computer architecture and quantitative analysis at Tel Aviv University.

Golander received his B.Sc. in C.S.and EE and his Ph.D. from Tel Aviv University in the field of computer architecture. His thesis won the Intel Research Award. Prior to his academic studies, Golander served as an intelligence officer in the Israeli Defense Force (IDF).

@ThingsExpo Stories
SYS-CON Events announced today that Dasher Technologies will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Dasher Technologies, Inc. ® is a premier IT solution provider that delivers expert technical resources along with trusted account executives to architect and deliver complete IT solutions and services to help our clients execute their goals, plans and objectives. Since 1999, we'v...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities – ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups. As a result, many firms employ new business models that place enormous impor...
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that Taica will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Taica manufacturers Alpha-GEL brand silicone components and materials, which maintain outstanding performance over a wide temperature range -40C to +200C. For more information, visit http://www.taica.co.jp/english/.
SYS-CON Events announced today that TidalScale, a leading provider of systems and services, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale has been involved in shaping the computing landscape. They've designed, developed and deployed some of the most important and successful systems and services in the history of the computing industry - internet, Ethernet, operating s...
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
SYS-CON Events announced today that TidalScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale is the leading provider of Software-Defined Servers that bring flexibility to modern data centers by right-sizing servers on the fly to fit any data set or workload. TidalScale’s award-winning inverse hypervisor technology combines multiple commodity servers (including their ass...
Join IBM November 1 at 21st Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA, and learn how IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Cognitive analysis impacts today’s systems with unparalleled ability that were previously available only to manned, back-end operations. Thanks to cloud processing, IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Imagine a robot vacuum that becomes your personal assistant tha...
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
Infoblox delivers Actionable Network Intelligence to enterprise, government, and service provider customers around the world. They are the industry leader in DNS, DHCP, and IP address management, the category known as DDI. We empower thousands of organizations to control and secure their networks from the core-enabling them to increase efficiency and visibility, improve customer service, and meet compliance requirements.
As popularity of the smart home is growing and continues to go mainstream, technological factors play a greater role. The IoT protocol houses the interoperability battery consumption, security, and configuration of a smart home device, and it can be difficult for companies to choose the right kind for their product. For both DIY and professionally installed smart homes, developers need to consider each of these elements for their product to be successful in the market and current smart homes.
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
Digital transformation is changing the face of business. The IDC predicts that enterprises will commit to a massive new scale of digital transformation, to stake out leadership positions in the "digital transformation economy." Accordingly, attendees at the upcoming Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA, Oct 31-Nov 2, will find fresh new content in a new track called Enterprise Cloud & Digital Transformation.
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software. They hope to capture value from emerging technologies such as IoT, SDN, and AI. Ultimately, irrespective of the vertical, it is about deriving value from independent software applications participating in an ecosystem as one comprehensive solution. In his session at @ThingsExpo, Kausik Sridhar, founder and CTO of Pulzze Systems, will discuss how given the magnitude of today's applicati...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp emp...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
SYS-CON Events announced today that Avere Systems, a leading provider of enterprise storage for the hybrid cloud, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere delivers a more modern architectural approach to storage that doesn't require the overprovisioning of storage capacity to achieve performance, overspending on expensive storage media for inactive data or the overbui...