Welcome!

Containers Expo Blog Authors: Liz McMillan, Elizabeth White, Derek Weeks, Automic Blog, Yeshim Deniz

Related Topics: @DevOpsSummit, Linux Containers, Containers Expo Blog

@DevOpsSummit: Article

Can Wire Data Be #APM? | @DevOpsSummit #DevOps #AI #ML #Monitoring

In general terms APM is simply 'the monitoring and management of the performance and availability of software applications'

Can Wire Data Be APM?

I recently read something – a blog, a tweet, a LinkedIn article perhaps – describing the use of wire data to analyze application performance. I remember that the author’s use of the term “APM” in this context caused one reader to comment, complaining that “you can’t call wire data APM.” This was around the same time I referred casually to Dynatrace’s wire data offering (Data Center Real User Monitoring, or DC RUM) as both “APM for IT Operations” and “probe-based APM.” So that complaint has stuck with me, prompting me to ask – and offer an answer to – the question.

It depends, of course, on answers to related questions. How do you define APM? What role does APM play in your organization? What APM insights can wire data provide? Let’s take a brief look at each of these.

What is APM to you?
In very general terms (Wikipedia is great for this), APM is simply “the monitoring and management of the performance and availability of software applications.” This is accomplished by measuring user response times, transaction volume (load), and resource consumption, with correlation to help identify system bottlenecks. But of course that description is too vague to be of much practical use. For more depth and breadth, we can turn to Gartner’s recent update to its 2010 definition of APM. Collapsed from the original five, Gartner now identifies three functional dimensions. In brief, these are:

  1. Digital experience monitoring – understanding the availability and performance of real and synthetic users.
  2. Application discovery, tracing and diagnostics – discovering application services, tracing transactions through the infrastructure, and deep insight into code execution. (This new dimension used to be three separate but interlinked dimensions.)
  3. Application analytics – automating the isolation and analysis of performance bottlenecks and fault domains.

Beyond the helpful simplification of the dimensions, there’s another interesting change to Gartner’s definition; it now explicitly calls out requirements for specific technology platforms. Included are web and mobile, HTTP, Java and .NET; by omission, all others are excluded.

“Traditional” APM architectures
To some degree, this narrowing (or perhaps clarification) of APM’s scope to focus to web stacks reflects a general market reality, if not a vendor-driven market definition; every APM vendor supports these stacks, and most don’t venture far beyond. The standardization and openness of these platforms encouraged development of compelling solutions to meet the monitoring needs of modern customer-facing web applications. Whether an offering’s pedigree can be traced to development tools or production monitoring, there’s no doubt that the performance visibility and diagnostic insights have helped many IT organizations modernize their operations, enable DevOps initiatives, and accelerate the shift from providing infrastructure and capacity to delivering business-oriented application services.

At least for mission-critical web apps.

Mission critical? Or vendor critical?
There’s a disconnect, however, that one of my colleagues helpfully calls “the myth of mission critical.” I see that myth as having two facets.

First, at a high level, it implies that some apps are not critical, and therefore don’t warrant monitoring. Maybe it’s a matter of degree – critical vs. important. But if an application isn’t at least important, why do you still have it? And if it is important, shouldn’t you be monitoring it?

The second facet is vendor-driven; APM vendors have steered the mission-critical discussion to web apps, the “apps of engagement” that are revenue-producing for many businesses. Distilling the messaging, one might conclude that “web apps are mission-critical; non-web apps are not.” This sounds like a spin on Maslow’s law of the hammer, illustrated nicely by Grace Witherell: “When all you have is a hammer, only nails are problems.”

I’d venture to say that your Oracle EBS and Forms-based apps, your SAP ERP applications, your Epic EHR and other custom thick-client applications that might be delivered via Citrix, all running core parts of your business – these and many others like them are probably critical as well.

But these “other” (i.e., non-web) apps run on a diverse set of often proprietary or closed platforms, without the instrumentation interfaces that have facilitated agent-based APM solutions for Java and .NET.

APM for IT operations
APM solutions often – always, maybe – support many user roles. Gartner’s recent Magic Quadrant for APM suggests that in a few years, only 30% of APM buyers will be in IT operations, down from 60% today; most of the other buyers will be application support and development. This doesn’t reflect a loss of interest on the part of IT operations, but rather an expanding audience of stakeholders – some of whom will have diverging interests.

One dominant example of these different interests is reflected in the need for code-level insight, a component of the second of the three APM dimensions. Application development and support teams likely need this, at least for applications built or customized and maintained in-house. But for IT operations teams, code-level insight may be less of a priority; common operational goals such as meeting service quality SLAs, reducing MTTR, and controlling costs can be easily accomplished by other APM capabilities. And the lack of code-level monitoring doesn’t preclude effective DevOps collaboration; inter-tier transaction monitoring and parameter capture help fill the gap.

Wire data
Wire data simply refers to an approach to gathering information – about performance, availability, usage, security, users, applications, networks, and much more. The type of information and the resulting value depends on the analytics applied to the data. Unlike agent technology, however, wire data is platform agnostic, unconcerned with the source application architecture. Instead, wire data relies on protocol decodes to be relevant. First tier examples include HTTP, SAPGUI, Oracle Forms, Epic, and Citrix ICA, while back end examples include SOAP, various forms of SQL, WebSphere MQ, CORBA, and more.

Analytics transforms this interpreted wire data into useful insights, and at Dynatrace, we’ve built a wire data analytics platform (DC RUM) that focuses on delivering application and user performance insights – in fact, mirroring many of the core capabilities defined by Gartner’s APM dimensions. These include:

  • EUE monitoring to help prioritize IT actions based on business impact
  • Automatic discovery to maintain visibility in increasingly dynamic environments
  • Automatic identification of users, transaction names and parameters
  • Robust analytics to automatically isolate fault domains and break out response time components
  • Detailed analysis of network performance and its impact on user experience

For an expansion of these wire data capabilities, you can read my blog “Where APM Agents Fear to Tread.”

In fact, the primary limitation of a wire data approach to APM might simply be the lack of code-level insights; in its place, however, wire data can offer enhanced network infrastructure visibility as well as enterprise-wide application coverage; for IT operations teams, that’s often a reasonable – if not desirable – tradeoff.

A positive-sum game
In the end, however, this isn’t a zero-sum game. Real benefits can be achieved through multiple perspectives of performance. An agent’s inside-out perspective – with deep code-level insights – gains new insights with the outside-in perspective of wire data, with its greater network awareness. The point is not to argue the merits of a specific collection technology, but to offer a multi-faceted solution that meets the needs of multiple stakeholders by covering your entire application portfolio.

At Dynatrace, we’re redefining monitoring to mean every user, every app, everywhere. This doesn’t mean separate products for different environments; it means a unified and modular AI-driven solution that offers comprehensive coverage for enterprise, web and newstack environments.

So, can wire data be APM? Some APM vendors want to argue that it can’t, but it might be that they’ve got only hammers to sell.

The post Can wire data be APM? appeared first on Dynatrace blog – monitoring redefined.

More Stories By Gary Kaiser

Gary Kaiser is a Subject Matter Expert in Network Performance Analytics at Dynatrace, responsible for DC RUM’s technical marketing programs. He is a co-inventor of multiple performance analysis features, and continues to champion the value of network performance analytics. He is the author of Network Application Performance Analysis (WalrusInk, 2014).

@ThingsExpo Stories
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, will examine the regulations and provide insight on how it affects technology, challenges the established rules and will usher in new levels of diligence a...
In the enterprise today, connected IoT devices are everywhere – both inside and outside corporate environments. The need to identify, manage, control and secure a quickly growing web of connections and outside devices is making the already challenging task of security even more important, and onerous. In his session at @ThingsExpo, Rich Boyer, CISO and Chief Architect for Security at NTT i3, discussed new ways of thinking and the approaches needed to address the emerging challenges of security i...
SYS-CON Events announced today that Datera, that offers a radically new data management architecture, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera is transforming the traditional datacenter model through modern cloud simplicity. The technology industry is at another major inflection point. The rise of mobile, the Internet of Things, data storage and Big...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics ...
SYS-CON Events announced today that Datera will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera offers a radically new approach to data management, where innovative software makes data infrastructure invisible, elastic and able to perform at the highest level. It eliminates hardware lock-in and gives IT organizations the choice to source x86 server nodes, with business model option...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, Cloud Expo and @ThingsExpo are two of the most important technology events of the year. Since its launch over eight years ago, Cloud Expo and @ThingsExpo have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, I provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading the...
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
From 2013, NTT Communications has been providing cPaaS service, SkyWay. Its customer’s expectations for leveraging WebRTC technology are not only typical real-time communication use cases such as Web conference, remote education, but also IoT use cases such as remote camera monitoring, smart-glass, and robotic. Because of this, NTT Communications has numerous IoT business use-cases that its customers are developing on top of PaaS. WebRTC will lead IoT businesses to be more innovative and address...
Recently, IoT seems emerging as a solution vehicle for data analytics on real-world scenarios from setting a room temperature setting to predicting a component failure of an aircraft. Compared with developing an application or deploying a cloud service, is an IoT solution unique? If so, how? How does a typical IoT solution architecture consist? And what are the essential components and how are they relevant to each other? How does the security play out? What are the best practices in formulating...
In his opening keynote at 20th Cloud Expo, Michael Maximilien, Research Scientist, Architect, and Engineer at IBM, discussed the full potential of the cloud and social data requires artificial intelligence. By mixing Cloud Foundry and the rich set of Watson services, IBM's Bluemix is the best cloud operating system for enterprises today, providing rapid development and deployment of applications that can take advantage of the rich catalog of Watson services to help drive insights from the vast t...
SYS-CON Events announced today that Elastifile will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Elastifile Cloud File System (ECFS) is software-defined data infrastructure designed for seamless and efficient management of dynamic workloads across heterogeneous environments. Elastifile provides the architecture needed to optimize your hybrid cloud environment, by facilitating efficient...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, will introduce two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
In his session at @ThingsExpo, Arvind Radhakrishnen discussed how IoT offers new business models in banking and financial services organizations with the capability to revolutionize products, payments, channels, business processes and asset management built on strong architectural foundation. The following topics were covered: How IoT stands to impact various business parameters including customer experience, cost and risk management within BFS organizations.
SYS-CON Events announced today that Golden Gate University will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Since 1901, non-profit Golden Gate University (GGU) has been helping adults achieve their professional goals by providing high quality, practice-based undergraduate and graduate educational programs in law, taxation, business and related professions. Many of its courses are taug...
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...