Welcome!

Containers Expo Blog Authors: Mike Wood, Mehdi Daoudi, Mark Leake, Todd Matters, Liz McMillan

Related Topics: Containers Expo Blog, Microservices Expo

Containers Expo Blog: Article

How to Evaluate a Data Virtualization Platform

The right choice will pay dividends

Gartner has repeatedly identified the importance of data services in enterprise information infrastructures in its evolving series of reports beginning in 2005.  Forrester’s Information-As-A-Service (IaaS) WaveTM reviewed the vendors and the technological advancements of this data integration market subset that is predicted to grow 40 percent by 2012, to $6.7 billion.

Today’s advanced data virtualization platforms (DVPs) enable flexible and enterprise-scalable data services as both supplements to earlier-era enterprise data warehouses and as stand-alone solutions. They do so by loosely coupling business applications and their supporting data sources. This approach provides a number of benefits including:

  • Agility for responding to fast-changing business information needs and new data sources;
  • Flexibility when integrating highly diverse and expanding data consumers and sources;
  • Low total cost of ownership (TCO) through modular design, object reuse and standards-support; and
  • Reduced risk for adoption of new technology advancements such as cloud computing and analytical data warehouse appliances.

What to Look for in a Data Virtualization Platform
Enterprises and government agencies evaluating DVPs may choose from a growing array of technology solutions from a diverse group of vendors. Because of this range, many organizations may find it difficult to identify the best solution for their specific needs. What will increase the odds for making the best choice? And how can organizations speed the decision process and thereby accelerate DSP benefits?

Examination of both successful and unsuccessful DVP deployments reveals eight critical-to-success factors, which are described below. The first six are product-focused; the final two are vendor-related.

1. High-Productivity Development Environment
Because data virtualization platforms are a class of middleware used to develop and run data services, developer productivity is a key selection criterion. To ensure productivity, DVPs automate frequent development tasks such as data and relationship discovery, source introspection, query optimization, application of security rules and source control.

Further, DVPs should be intuitive to developers, ideally supporting both the bottoms-up relational studio style favored by traditional SQL modelers and DBAs and the tops-down Eclipse-based IDE’s favored by Java, XML, and XQuery application builders. In contrast, one-size-fits-all toolsets, perhaps originally designed for other purposes, such as extract, transform and load (ETL) or enterprise service bus (ESB) projects, invariably fail to fully support the diverse development expertise found in today’s enterprise IT organizations.

2. High-Performance Runtime Query Engine
Once developed, the data services must run efficiently to quickly display data in portals and reports and more. DVPs should include a powerful array of query optimization techniques to ensure the fastest possible runtime performance. More mature DVP offerings provide a rich set of cost- and rule-based query optimizers with pushdown optimization, distributed joins, parallel processing, 64-bit architecture support and multiple caching options.

3. Data Standards Support
Minimizing TCO is typically achievable using DVPs that leverage both industry and corporate data standards to simplify sharing of data. Data standards range from industry-based MIMOSA in process manufacturing and PIDX in petroleum exploration to corporate standards for key entities such as customers, products, locations, and more. DVP vendors have taken two approaches to data standards support. Some provide an abbreviated set of industry standards out-of-the-box. Others can support any and all standards using automated tools that import and instantiate each standard’s XML schema.

4. IT Standards Support
DVPs should fit easily within an existing, complex IT environment. The ability to leverage available human, data, hardware and software assets in a standardized way enables DVPs to successfully operate in a variety of environments without restriction, accelerating adoption and lowering TCO. Examples of IT standards’ support to look for include:

  • Development standards such as SQL, XQuery, Xpath, Java, and MDX;
  • Web Services standards such as WSDL, WS-I Basic Profile, WS-Notification, WS-Addressing, WS-Policy, and more;
  • API standards such as ODBC, JDBC, ADO.Net, SOAP, JMS, and REST;
  • Security standards such as LDAP, Active Directory, WS- Security, RBAC, ABAC, SAML, and IC-ISM; and
  • System management standards such SNMP.

5. Breadth of Consuming Applications
DVPs must provide data to a broad range of business applications, BI tools, middleware such as ESBs or business process management (BPM), and others, using the access methods, formats and protocols required by these diverse consumers. A wide set of supported APIs indicates the breadth of consumers the DVP supports. At minimum, the DVP should support APIs for the following standards:

  • SQL-oriented ODBC, JDBC, and ADO.Net;
  • Web-service SOAP, REST, JSON, HTTP, and XQuery;
  • Messaging JMS; and
  • Programmatic Java.

6. Breadth of Data Sources
DVPs that efficiently access an expansive set of data sources have proven to reduce the likelihood of incurring costly custom coding and unanticipated adoption constraints. DVP source data adapters should be designed to work hand-in-hand with the DVP’s high-performance runtime engine. In contrast, batch data adapters designed to support large-scale ETL, and transaction-write-oriented adapters designed for ESB business processes, are generally inappropriate for federated queries typical in data services use cases. DVPs should also support a diverse set of source API standards including the SQL-oriented, web-service, messaging and programmatic ones listed above. In addition, adapters provided should also support APIs for:

  • Large-scale proprietary technologies such as mainframes;
  • Large-scale proprietary applications such as SAP, Oracle, Siebel; and
  • Cloud applications and infrastructure such as Salesforce.com and Amazon S3.

7. Vendor Strategic Intent
In his 2005 book, Dealing with Darwin: How Great Companies Innovate at Every Phase of Their Evolution, Stanford University Professor Geoffrey A. Moore introduced the concepts of “core” and “context” for understanding corporate strategic intent. This core or context litmus test is important when evaluating data virtualization platform vendors. Core DVP vendor profiles typically feature well-developed and comprehensive DVP offerings, strong technology innovation investment, and long-term customers with successful implementations. In contrast, context DVP vendors typically have nascent DVPs, little history in DVP-specific technology innovation investment, and fewer customers with successful DVP-specific implementations.

8. Vendor Customer-facing Talent
Customer-facing staff should be factored into the technology adoption equation. Professional services personnel who help organizations learn about the product during the buying process, implement the product during initial and on-going deployment, support the product with enhancements, and respond rapidly if problems arise should demonstrate a deep knowledge about DVPs at every step, rather than the alternative, where consulting staff have primary skills in adjacent technology or product areas.

How to Evaluate These Criteria in the Buying Cycle
A good place to begin the DVP selection process is by gaining a deeper understanding of the data service platform landscape from analysts such as Gartner, Forrester, and more. The websites of leading data services providers are an additional rich source, as are leading IT information sites. The eight factors described in this article are an invaluable evaluation filter.

By engaging with a few vendors directly, perhaps contrasting a focused best-of-breed vendor and a larger, wider IT infrastructure provider, enterprise decision makers may accurately assess the vendors’ strengths and weakness in terms of standards support, breadth of sources and consumers, and corporate strategic intent.

No decision is complete without a proof-of-concept with the top contender. Criteria such a developer productivity, performance, and vendor talent can be fully evaluated at this stage. ROI tools that define and measure a successful implementation are essential for justifying the investment internally.

Conclusion
Data virtualization platforms promise to bring order to the chaos of today’s data landscape through a range of agility, flexibility, as well as the potential for reduced cost and risk benefits. These benefits are the drivers behind the exploding industry demand, which in turn, is attracting new vendors with new solutions, thus making purchasing decisions more complex. Through careful consideration of the preceding eight factors, enterprises and government agencies undergoing DVP evaluation can systematize their decision-making and thereby increase their confidence in successful DVP deployments.

More Stories By Robert Eve

Robert Eve is the EVP of Marketing at Composite Software, the data virtualization gold standard and co-author of Data Virtualization: Going Beyond Traditional Data Integration to Achieve Business Agility. Bob's experience includes executive level roles at leading enterprise software companies such as Mercury Interactive, PeopleSoft, and Oracle. Bob holds a Masters of Science from the Massachusetts Institute of Technology and a Bachelor of Science from the University of California at Berkeley.

@ThingsExpo Stories
In his session at @ThingsExpo, Eric Lachapelle, CEO of the Professional Evaluation and Certification Board (PECB), provided an overview of various initiatives to certify the security of connected devices and future trends in ensuring public trust of IoT. Eric Lachapelle is the Chief Executive Officer of the Professional Evaluation and Certification Board (PECB), an international certification body. His role is to help companies and individuals to achieve professional, accredited and worldwide re...
The Internet giants are fully embracing AI. All the services they offer to their customers are aimed at drawing a map of the world with the data they get. The AIs from these companies are used to build disruptive approaches that cannot be used by established enterprises, which are threatened by these disruptions. However, most leaders underestimate the effect this will have on their businesses. In his session at 21st Cloud Expo, Rene Buest, Director Market Research & Technology Evangelism at Ara...
SYS-CON Events announced today that Enzu will exhibit at SYS-CON's 21st Int\ernational Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive advantage. By offering a suite of proven hosting and management services, Enzu wants companies to focus on the core of their ...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
SYS-CON Events announced today that Cloud Academy named "Bronze Sponsor" of 21st International Cloud Expo which will take place October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara, CA. Cloud Academy is the industry’s most innovative, vendor-neutral cloud technology training platform. Cloud Academy provides continuous learning solutions for individuals and enterprise teams for Amazon Web Services, Microsoft Azure, Google Cloud Platform, and the most popular cloud com...
When growing capacity and power in the data center, the architectural trade-offs between server scale-up vs. scale-out continue to be debated. Both approaches are valid: scale-out adds multiple, smaller servers running in a distributed computing model, while scale-up adds fewer, more powerful servers that are capable of running larger workloads. It’s worth noting that there are additional, unique advantages that scale-up architectures offer. One big advantage is large memory and compute capacity...
No hype cycles or predictions of zillions of things here. IoT is big. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, Associate Partner at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He discussed the evaluation of communication standards and IoT messaging protocols, data analytics considerations, edge-to-cloud tec...
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that MobiDev, a client-oriented software development company, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MobiDev is a software company that develops and delivers turn-key mobile apps, websites, web services, and complex software systems for startups and enterprises. Since 2009 it has grown from a small group of passionate engineers and business...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
SYS-CON Events announced today that Ayehu will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara California. Ayehu provides IT Process Automation & Orchestration solutions for IT and Security professionals to identify and resolve critical incidents and enable rapid containment, eradication, and recovery from cyber security breaches. Ayehu provides customers greater control over IT infras...
We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA
With the introduction of IoT and Smart Living in every aspect of our lives, one question has become relevant: What are the security implications? To answer this, first we have to look and explore the security models of the technologies that IoT is founded upon. In his session at @ThingsExpo, Nevi Kaja, a Research Engineer at Ford Motor Company, discussed some of the security challenges of the IoT infrastructure and related how these aspects impact Smart Living. The material was delivered interac...
Artificial intelligence, machine learning, neural networks. We’re in the midst of a wave of excitement around AI such as hasn’t been seen for a few decades. But those previous periods of inflated expectations led to troughs of disappointment. Will this time be different? Most likely. Applications of AI such as predictive analytics are already decreasing costs and improving reliability of industrial machinery. Furthermore, the funding and research going into AI now comes from a wide range of com...
In his session at Cloud Expo, Alan Winters, an entertainment executive/TV producer turned serial entrepreneur, presented a success story of an entrepreneur who has both suffered through and benefited from offshore development across multiple businesses: The smart choice, or how to select the right offshore development partner Warning signs, or how to minimize chances of making the wrong choice Collaboration, or how to establish the most effective work processes Budget control, or how to ma...
IoT solutions exploit operational data generated by Internet-connected smart “things” for the purpose of gaining operational insight and producing “better outcomes” (for example, create new business models, eliminate unscheduled maintenance, etc.). The explosive proliferation of IoT solutions will result in an exponential growth in the volume of IoT data, precipitating significant Information Governance issues: who owns the IoT data, what are the rights/duties of IoT solutions adopters towards t...
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.