Welcome!

Containers Expo Blog Authors: Elizabeth White, Chris Colosimo, SmartBear Blog, XebiaLabs Blog, Liz McMillan

Related Topics: Containers Expo Blog, @CloudExpo

Containers Expo Blog: Article

New Changes in Persistent Memory | @CloudExpo #Cloud #Storage

How Persistent Memory technologies will revolutionize compute as we know it

Incumbent storage vendors such as EMC, Netapp, and Nutanix have built their rich code base on the block layer. This means that the only viable option to use Persistent Memory as a storage tier is to wrap it up with an abstraction layer that will present it as a block device.

As a veteran researcher, I'm always interested in brand-new approaches for doing things. One great example is the new NVM programming model (NPM) proposed by SNIA. The new NPM approach took a big step forward this week, as version 1.0 of the associated NVM library (NVML) was released.

For the few people who understood this previous paragraph - congratulations on the major milestone. If you haven't really understood it, however, don't go away. I'll start from the beginning...

Hardware Background
New families of storage media and device types have been introduced and announced recently. These persistent memory (PM) technologies have amazing hardware properties, and there seems to be a growing consensus that they are going to revolutionize compute as we know it.

The billion-dollar question then is which software approach to choose in order to leverage this unique PM hardware.

Software Approach Survey
There are three main software approaches for using PM. This is not a matter of right or wrong, as there are tradeoffs. For the sake of clarity, I numbered these approaches I, II and III. This should help us stay at the technical, not the marketing, level.

Figure 1 illustrates that the key parameter for classifying software approaches is the amount of re-used versus re-written software. Approach I is tuned for highest software reuse. Approach II rewrites system software, but leaves the application untouched. Approach III rewrites all layers and moves the application to a new programming model.

Figure 1: The different software approaches for leveraging PM

Approaches I and II have the benefit of supporting applications "out of the box" with no modification. But Approach II requires additional development work from the system software vendor - work that has to be justified by extra performance. Figure 2 shows that the commonly adopted FIO benchmark was able to achieve 2-3 orders of magnitude better throughput and latency just by switching the software approach. Moving from Approach I (ZFS or XFS on NVDIMMs) to Approach II (Plexistor SDM) has brought tremendous value.

Further comparing the three approaches, performance, software reuse, and other technical properties are summarized in Figure 3. Most properties are self-explanatory, but two are worth elaborating on: "Data services model" and "$/GB". IT administrators use data services to comply with organizational requirements (e.g., use the storage array snapshot to create a backup). Approaches I and II follow the same model, while Approach III moves a lot of that responsibility to the application developer.

The second property "$/GB" is mainly a function of supporting multiple tiers and being able to automatically move data between them according to usage patterns. This is important because PM cost per capacity unit ($/GB) is high. PM cost is expected to drop with volume and time, but it will not catch up with SSD and HDD for many years. Auto-tiering is a vendor dependent feature. Sticking to the examples used in Figure 2: ZFS supports it, XFS and XFS-DAX do not, and Plexistor SDM does.

Now that we've established a clean technical background, let's apply it back to the market.

Mapping Industry Efforts
The next figure maps the theoretical software approaches mentioned above to actual implementations and players. It is not meant as a comprehensive industry-wide survey of all software solutions, just the leading ones. Also, with PM being a hot topic, I'm sure many other solutions will join down the road.

Incumbent storage vendors such as EMC, Netapp, and Nutanix have built their rich code base on the block layer. This means that their only viable option to use PM as a storage tier is to wrap it up with an abstraction layer that will present it as a block device (i.e. Approach I).

In contrast, SDM or file system vendors that have deeply believed in PM for the past couple of years, such as Microsoft and Plexistor, have built file-level solutions that use PM as a storage tier. Both companies added support for DAX, which enables zero copy of memory mapped files (MMF), and can support approaches II and III.

As a side note, it will be interesting to compare the performance and features provided by Microsoft ReFS and Plexistor SDM. But, we will have to wait until Windows Server 2016 is released. Also, as interesting as the comparison may be for us techies, I doubt if many Windows users will move to Linux because of it. People do not switch religions overnight.

The DAX support in Microsoft ReFS and Plexistor SDM, as well as the ones being built for EXT4-DAX and XFS-DAX are the foundation for approach III. Intel and HPE have been leading the standardization of this approach through the SNIA NVM Programming Model documents and the complementary NVML library and tests - the same library that just reached its major milestone, the stable 1.0 release.

We at Plexistor are continuously running the 1,779 NVML tests on our SDM software. We've been doing that for a year now, because we believe that customers should be able to run traditional and NVM-aware applications side by side. Customers should be able to transparently share data between these applications and enforce the same policies on that data, regardless of how it was created.

More Stories By Amit Golander

Dr. Amit Golander is the Chief Technology Officer (CTO) and R&D Manager for Plexistor. His responsibilities are to develop the product and work with CEO, Sharon Azulai, on the vision for the technology and products.

Golander brings a rich research, development, and leadership background to Plexistor where he has distinguished himself in both the corporate, startup and higher educational realms.In addition to his work in the business and academic sectors, Golander holds over 50 patents and has published a number of technology articles in prestigious engineering journals.

Prior to Plexistor, Golander was VP of Systems and Product for Primary Data where he was responsible for strategic partnerships, alliances and beta customers as well as worked closely with the R&D teams on the day-to-day product management.Golander also worked for IBM for over twelve years on data center and cloud infrastructure.

Golander has also mentored M.Sc. students and taught computer architecture and quantitative analysis at Tel Aviv University.

Golander received his B.Sc. in C.S.and EE and his Ph.D. from Tel Aviv University in the field of computer architecture. His thesis won the Intel Research Award. Prior to his academic studies, Golander served as an intelligence officer in the Israeli Defense Force (IDF).

@ThingsExpo Stories
SYS-CON Events announced today that Ocean9will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Ocean9 provides cloud services for Backup, Disaster Recovery (DRaaS) and instant Innovation, and redefines enterprise infrastructure with its cloud native subscription offerings for mission critical SAP workloads.
In his session at @ThingsExpo, Eric Lachapelle, CEO of the Professional Evaluation and Certification Board (PECB), will provide an overview of various initiatives to certifiy the security of connected devices and future trends in ensuring public trust of IoT. Eric Lachapelle is the Chief Executive Officer of the Professional Evaluation and Certification Board (PECB), an international certification body. His role is to help companies and individuals to achieve professional, accredited and worldw...
SYS-CON Events announced today that Technologic Systems Inc., an embedded systems solutions company, will exhibit at SYS-CON's @ThingsExpo, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Technologic Systems is an embedded systems company with headquarters in Fountain Hills, Arizona. They have been in business for 32 years, helping more than 8,000 OEM customers and building over a hundred COTS products that have never been discontinued. Technologic Systems’ pr...
SYS-CON Events announced today that CA Technologies has been named “Platinum Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY, and the 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business – from apparel to energy – is being rewritten by software. From ...
The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, will posit that disruption is inevitable for c...
SYS-CON Events announced today that Cloudistics, an on-premises cloud computing company, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Cloudistics delivers a complete public cloud experience with composable on-premises infrastructures to medium and large enterprises. Its software-defined technology natively converges network, storage, compute, virtualization, and management into a ...
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor - all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
SYS-CON Events announced today that Loom Systems will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2015, Loom Systems delivers an advanced AI solution to predict and prevent problems in the digital business. Loom stands alone in the industry as an AI analysis platform requiring no prior math knowledge from operators, leveraging the existing staff to succeed in the digital era. With offices in S...
The explosion of new web/cloud/IoT-based applications and the data they generate are transforming our world right before our eyes. In this rush to adopt these new technologies, organizations are often ignoring fundamental questions concerning who owns the data and failing to ask for permission to conduct invasive surveillance of their customers. Organizations that are not transparent about how their systems gather data telemetry without offering shared data ownership risk product rejection, regu...
SYS-CON Events announced today that Interoute, owner-operator of one of Europe's largest networks and a global cloud services platform, has been named “Bronze Sponsor” of SYS-CON's 20th Cloud Expo, which will take place on June 6-8, 2017 at the Javits Center in New York, New York. Interoute is the owner-operator of one of Europe's largest networks and a global cloud services platform which encompasses 12 data centers, 14 virtual data centers and 31 colocation centers, with connections to 195 add...
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 20th International Cloud Expo, which will take place on June 6–8, 2017, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buyers...
SYS-CON Events announced today that T-Mobile will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on ...
SYS-CON Events announced today that Infranics will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Since 2000, Infranics has developed SysMaster Suite, which is required for the stable and efficient management of ICT infrastructure. The ICT management solution developed and provided by Infranics continues to add intelligence to the ICT infrastructure through the IMC (Infra Management Cycle) based on mathemat...
SYS-CON Events announced today that SD Times | BZ Media has been named “Media Sponsor” of SYS-CON's 20th International Cloud Expo, which will take place on June 6–8, 2017, at the Javits Center in New York City, NY. BZ Media LLC is a high-tech media company that produces technical conferences and expositions, and publishes a magazine, newsletters and websites in the software development, SharePoint, mobile development and commercial UAV markets.
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 20th International Cloud Expo, which will take place on June 6–8, 2017, at the Javits Center in New York City, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
"I think that everyone recognizes that for IoT to really realize its full potential and value that it is about creating ecosystems and marketplaces and that no single vendor is able to support what is required," explained Esmeralda Swartz, VP, Marketing Enterprise and Cloud at Ericsson, in this SYS-CON.tv interview at @ThingsExpo, held June 7-9, 2016, at the Javits Center in New York City, NY.
SYS-CON Events announced today that HTBase will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. HTBase (Gartner 2016 Cool Vendor) delivers a Composable IT infrastructure solution architected for agility and increased efficiency. It turns compute, storage, and fabric into fluid pools of resources that are easily composed and re-composed to meet each application’s needs. With HTBase, companies can quickly prov...
Web Real-Time Communication APIs have quickly revolutionized what browsers are capable of. In addition to video and audio streams, we can now bi-directionally send arbitrary data over WebRTC's PeerConnection Data Channels. With the advent of Progressive Web Apps and new hardware APIs such as WebBluetooh and WebUSB, we can finally enable users to stitch together the Internet of Things directly from their browsers while communicating privately and securely in a decentralized way.