Welcome!

Containers Expo Blog Authors: PagerDuty Blog, Mehdi Daoudi, Liz McMillan, Elizabeth White, Pat Romanski

Related Topics: Containers Expo Blog, Microservices Expo

Containers Expo Blog: Article

How to Evaluate a Data Virtualization Platform

The right choice will pay dividends

Gartner has repeatedly identified the importance of data services in enterprise information infrastructures in its evolving series of reports beginning in 2005.  Forrester’s Information-As-A-Service (IaaS) WaveTM reviewed the vendors and the technological advancements of this data integration market subset that is predicted to grow 40 percent by 2012, to $6.7 billion.

Today’s advanced data virtualization platforms (DVPs) enable flexible and enterprise-scalable data services as both supplements to earlier-era enterprise data warehouses and as stand-alone solutions. They do so by loosely coupling business applications and their supporting data sources. This approach provides a number of benefits including:

  • Agility for responding to fast-changing business information needs and new data sources;
  • Flexibility when integrating highly diverse and expanding data consumers and sources;
  • Low total cost of ownership (TCO) through modular design, object reuse and standards-support; and
  • Reduced risk for adoption of new technology advancements such as cloud computing and analytical data warehouse appliances.

What to Look for in a Data Virtualization Platform
Enterprises and government agencies evaluating DVPs may choose from a growing array of technology solutions from a diverse group of vendors. Because of this range, many organizations may find it difficult to identify the best solution for their specific needs. What will increase the odds for making the best choice? And how can organizations speed the decision process and thereby accelerate DSP benefits?

Examination of both successful and unsuccessful DVP deployments reveals eight critical-to-success factors, which are described below. The first six are product-focused; the final two are vendor-related.

1. High-Productivity Development Environment
Because data virtualization platforms are a class of middleware used to develop and run data services, developer productivity is a key selection criterion. To ensure productivity, DVPs automate frequent development tasks such as data and relationship discovery, source introspection, query optimization, application of security rules and source control.

Further, DVPs should be intuitive to developers, ideally supporting both the bottoms-up relational studio style favored by traditional SQL modelers and DBAs and the tops-down Eclipse-based IDE’s favored by Java, XML, and XQuery application builders. In contrast, one-size-fits-all toolsets, perhaps originally designed for other purposes, such as extract, transform and load (ETL) or enterprise service bus (ESB) projects, invariably fail to fully support the diverse development expertise found in today’s enterprise IT organizations.

2. High-Performance Runtime Query Engine
Once developed, the data services must run efficiently to quickly display data in portals and reports and more. DVPs should include a powerful array of query optimization techniques to ensure the fastest possible runtime performance. More mature DVP offerings provide a rich set of cost- and rule-based query optimizers with pushdown optimization, distributed joins, parallel processing, 64-bit architecture support and multiple caching options.

3. Data Standards Support
Minimizing TCO is typically achievable using DVPs that leverage both industry and corporate data standards to simplify sharing of data. Data standards range from industry-based MIMOSA in process manufacturing and PIDX in petroleum exploration to corporate standards for key entities such as customers, products, locations, and more. DVP vendors have taken two approaches to data standards support. Some provide an abbreviated set of industry standards out-of-the-box. Others can support any and all standards using automated tools that import and instantiate each standard’s XML schema.

4. IT Standards Support
DVPs should fit easily within an existing, complex IT environment. The ability to leverage available human, data, hardware and software assets in a standardized way enables DVPs to successfully operate in a variety of environments without restriction, accelerating adoption and lowering TCO. Examples of IT standards’ support to look for include:

  • Development standards such as SQL, XQuery, Xpath, Java, and MDX;
  • Web Services standards such as WSDL, WS-I Basic Profile, WS-Notification, WS-Addressing, WS-Policy, and more;
  • API standards such as ODBC, JDBC, ADO.Net, SOAP, JMS, and REST;
  • Security standards such as LDAP, Active Directory, WS- Security, RBAC, ABAC, SAML, and IC-ISM; and
  • System management standards such SNMP.

5. Breadth of Consuming Applications
DVPs must provide data to a broad range of business applications, BI tools, middleware such as ESBs or business process management (BPM), and others, using the access methods, formats and protocols required by these diverse consumers. A wide set of supported APIs indicates the breadth of consumers the DVP supports. At minimum, the DVP should support APIs for the following standards:

  • SQL-oriented ODBC, JDBC, and ADO.Net;
  • Web-service SOAP, REST, JSON, HTTP, and XQuery;
  • Messaging JMS; and
  • Programmatic Java.

6. Breadth of Data Sources
DVPs that efficiently access an expansive set of data sources have proven to reduce the likelihood of incurring costly custom coding and unanticipated adoption constraints. DVP source data adapters should be designed to work hand-in-hand with the DVP’s high-performance runtime engine. In contrast, batch data adapters designed to support large-scale ETL, and transaction-write-oriented adapters designed for ESB business processes, are generally inappropriate for federated queries typical in data services use cases. DVPs should also support a diverse set of source API standards including the SQL-oriented, web-service, messaging and programmatic ones listed above. In addition, adapters provided should also support APIs for:

  • Large-scale proprietary technologies such as mainframes;
  • Large-scale proprietary applications such as SAP, Oracle, Siebel; and
  • Cloud applications and infrastructure such as Salesforce.com and Amazon S3.

7. Vendor Strategic Intent
In his 2005 book, Dealing with Darwin: How Great Companies Innovate at Every Phase of Their Evolution, Stanford University Professor Geoffrey A. Moore introduced the concepts of “core” and “context” for understanding corporate strategic intent. This core or context litmus test is important when evaluating data virtualization platform vendors. Core DVP vendor profiles typically feature well-developed and comprehensive DVP offerings, strong technology innovation investment, and long-term customers with successful implementations. In contrast, context DVP vendors typically have nascent DVPs, little history in DVP-specific technology innovation investment, and fewer customers with successful DVP-specific implementations.

8. Vendor Customer-facing Talent
Customer-facing staff should be factored into the technology adoption equation. Professional services personnel who help organizations learn about the product during the buying process, implement the product during initial and on-going deployment, support the product with enhancements, and respond rapidly if problems arise should demonstrate a deep knowledge about DVPs at every step, rather than the alternative, where consulting staff have primary skills in adjacent technology or product areas.

How to Evaluate These Criteria in the Buying Cycle
A good place to begin the DVP selection process is by gaining a deeper understanding of the data service platform landscape from analysts such as Gartner, Forrester, and more. The websites of leading data services providers are an additional rich source, as are leading IT information sites. The eight factors described in this article are an invaluable evaluation filter.

By engaging with a few vendors directly, perhaps contrasting a focused best-of-breed vendor and a larger, wider IT infrastructure provider, enterprise decision makers may accurately assess the vendors’ strengths and weakness in terms of standards support, breadth of sources and consumers, and corporate strategic intent.

No decision is complete without a proof-of-concept with the top contender. Criteria such a developer productivity, performance, and vendor talent can be fully evaluated at this stage. ROI tools that define and measure a successful implementation are essential for justifying the investment internally.

Conclusion
Data virtualization platforms promise to bring order to the chaos of today’s data landscape through a range of agility, flexibility, as well as the potential for reduced cost and risk benefits. These benefits are the drivers behind the exploding industry demand, which in turn, is attracting new vendors with new solutions, thus making purchasing decisions more complex. Through careful consideration of the preceding eight factors, enterprises and government agencies undergoing DVP evaluation can systematize their decision-making and thereby increase their confidence in successful DVP deployments.

More Stories By Robert Eve

Robert Eve is the EVP of Marketing at Composite Software, the data virtualization gold standard and co-author of Data Virtualization: Going Beyond Traditional Data Integration to Achieve Business Agility. Bob's experience includes executive level roles at leading enterprise software companies such as Mercury Interactive, PeopleSoft, and Oracle. Bob holds a Masters of Science from the Massachusetts Institute of Technology and a Bachelor of Science from the University of California at Berkeley.

@ThingsExpo Stories
SYS-CON Events announced today that SourceForge has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SourceForge is the largest, most trusted destination for Open Source Software development, collaboration, discovery and download on the web serving over 32 million viewers, 150 million downloads and over 460,000 active development projects each and every month.
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
Elon Musk is among the notable industry figures who worries about the power of AI to destroy rather than help society. Mark Zuckerberg, on the other hand, embraces all that is going on. AI is most powerful when deployed across the vast networks being built for Internets of Things in the manufacturing, transportation and logistics, retail, healthcare, government and other sectors. Is AI transforming IoT for the good or the bad? Do we need to worry about its potential destructive power? Or will we...
SYS-CON Events announced today that Daiya Industry will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Daiya Industry specializes in orthotic support systems and assistive devices with pneumatic artificial muscles in order to contribute to an extended healthy life expectancy. For more information, please visit https://www.daiyak...
SYS-CON Events announced today that SIGMA Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. uLaser flow inspection device from the Japanese top share to Global Standard! Then, make the best use of data to flip to next page. For more information, visit http://www.sigma-k.co.jp/en/.
SYS-CON Events announced today that B2Cloud will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. B2Cloud specializes in IoT devices for preventive and predictive maintenance in any kind of equipment retrieving data like Energy consumption, working time, temperature, humidity, pressure, etc.
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp em...
SYS-CON Events announced today that Interface Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Interface Corporation is a company developing, manufacturing and marketing high quality and wide variety of industrial computers and interface modules such as PCIs and PCI express. For more information, visit http://www.i...
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that Mobile Create USA will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Mobile Create USA Inc. is an MVNO-based business model that uses portable communication devices and cellular-based infrastructure in the development, sales, operation and mobile communications systems incorporating GPS capabi...
SYS-CON Events announced today that Nihon Micron will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Nihon Micron Co., Ltd. strives for technological innovation to establish high-density, high-precision processing technology for providing printed circuit board and metal mount RFID tags used for communication devices. For more inf...
SYS-CON Events announced today that N3N will exhibit at SYS-CON's @ThingsExpo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. N3N’s solutions increase the effectiveness of operations and control centers, increase the value of IoT investments, and facilitate real-time operational decision making. N3N enables operations teams with a four dimensional digital “big board” that consolidates real-time live video feeds alongside IoT sensor data a...
While some developers care passionately about how data centers and clouds are architected, for most, it is only the end result that matters. To the majority of companies, technology exists to solve a business problem, and only delivers value when it is solving that problem. 2017 brings the mainstream adoption of containers for production workloads. In his session at 21st Cloud Expo, Ben McCormack, VP of Operations at Evernote, will discuss how data centers of the future will be managed, how th...
SYS-CON Events announced today that Suzuki Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Suzuki Inc. is a semiconductor-related business, including sales of consuming parts, parts repair, and maintenance for semiconductor manufacturing machines, etc. It is also a health care business providing experimental research for...
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
SYS-CON Events announced today that Fusic will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Fusic Co. provides mocks as virtual IoT devices. You can customize mocks, and get any amount of data at any time in your test. For more information, visit https://fusic.co.jp/english/.
In his session at @ThingsExpo, Greg Gorman is the Director, IoT Developer Ecosystem, Watson IoT, will provide a short tutorial on Node-RED, a Node.js-based programming tool for wiring together hardware devices, APIs and online services in new and interesting ways. It provides a browser-based editor that makes it easy to wire together flows using a wide range of nodes in the palette that can be deployed to its runtime in a single-click. There is a large library of contributed nodes that help so...
SYS-CON Events announced today that Enroute Lab will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enroute Lab is an industrial design, research and development company of unmanned robotic vehicle system. For more information, please visit http://elab.co.jp/.