Welcome!

Virtualization Authors: Elizabeth White, Liz McMillan, Carmen Gonzalez, Peter Dyer, Pat Romanski

Related Topics: Big Data Journal, SOA & WOA, Open Source, Virtualization, Red Hat, Cloud Expo

Big Data Journal: Blog Post

Evolution and Innovation in Middleware

Undoubtedly, the future holds a number of surprises for the enterprise IT industry

2013 middleware predictions by Red Hat's Craig Muzilla. This post originally appeared on Dec. 18, 2012.

Last year, I offered my thoughts on trends and developments that the market would see in 2012. At that time, I felt that we were looking at a continued emphasis on cloud, while mobile and backend integration technologies would rise in prominence within enterprise IT. I think the industry made progress in all three areas: analysts indicate huge adoption of mobile technologies as a substitute for what would have typically been a laptop or desktop computer; at Red Hat we saw an uptick in interest around some of our backend integration tools like rules-based processing and business process management (BPM); and the industry as a whole saw a solidification around cloud visions and roadmaps from vendors.

One area that turned out to be much bigger than I had anticipated was the explosion and interest in big data. Moving forward, I think applications will be much more data-driven, using information generated by the millions of mobile devices I mentioned earlier.

To-date, the primary use of big data has been related to the analysis of large volumes of information that could not be analyzed using traditional data warehouses. I think this will continue; however, I anticipate a rise in applications wanting to participate in either big data or NoSQL solutions. I expect technologies such as Hive, which allows users to do traditional SQL queries in a big data setting, are going to become very important and popular in the coming year.

Transactional or production-related applications will need to interface with these big data solutions beyond simple analysis to take on some action or activity. Where I predict the market will likely see the most activity is around technologies like middleware that have been on the sidelines but may now begin to develop interfaces for things like MapReduce queries, Hive, or even traditional SQL queries. In this way I expect to see the more traditional application servers and tools like ESBs participate in the big data movement.

Another significant development that I anticipate for next year is the explosion of private cloud. There has been a lot of discussion lately about cloud in general, but public cloud has largely been the focus. Infrastructure-as-a-Service (IaaS) and Platform-as-a-Service (PaaS) technologies have both made a lot of progress from a public cloud standpoint, where they have primarily been used for development, testing and experimentation. I predict that PaaS will come out of this paradigm for production purposes. While very few applications are in production right now in public clouds, I think we'll see a lot of companies begin to take applications into production via private clouds.

A word of caution, though. Organizations need to shift their ways of thinking about governance models. Developers have much more responsibility and power than they did in the on-premises world. There was always a development process, and then an application went into operations, and operations took it into production. Today, we have the idea of DevOps, which is designed to empower the developer to not only work in the development phase, but then take the finished application into production and even manage it there. This model redefines governance because companies will need to think about what kind of responsibility and authority they give to staff members that may have not had those roles before. Ultimately, I think there will be a lot more flexibility, productivity and freedom, but companies will need to rethink their governance model to avoid running into problems.

In the near term, I predict the primary themes will remain the top priorities moving forward: cloud computing and PaaS, especially on-premises, will be important; OpenStack will play a big role in terms of basic cloud infrastructure for IaaS; and the industry will see continued movement in the mobile area. Today, most enterprise mobile activity has been around the client application with little backend service considerations, but I think we'll see a huge movement in iPhone or Android development, even natively, but requiring backend services such as security, transactions, enterprise integration, and persistence. As a result, I expect to see a lot of technology being developed that allows these mobile applications to fully participate in backend services and applications, and that will be a breakthrough for the industry.

In terms of big data, I hope to see a surge of technologies that seek to allow a broad set of applications, both analytical applications and transactional applications, become more involved. Whether this is using data in-memory, such as NoSQL solutions, or data management solutions like Hadoop with virtualized storage, I predict that it will ultimately lead to more data-driven applications. The foundation for this is already in place with MapReduce and Hadoop, and NoSQL solutions like Mongo and our own Red Hat JBoss Data Grid, but I think the interfaces required for participation from a broad set of applications still need to be built out over the next few years. Companies will look to NoSQL and big data solutions as a replacement for traditional relational databases or to reduce the dependency on them, and they will use them for a variety of transaction and analytical apps. I expect middleware to evolve to support this.

Long term, I think the nature of an enterprise application will change, especially as it relates to creating higher levels of abstraction, allowing non-technologists and business users to participate in the creation of those applications and mobile applications. Over the next two to five years, business users, consumers and partners will use tools like BPM and rules management that offer this level of abstraction to develop and adjust applications based on needs. There is some discussion regarding intelligent BPM (iBPM) now, but it still seems to be largely under the radar. The industry will likely hear much more discussion about these sophisticated and end user-friendly technologies, both in the cloud and in traditional uses, in the years to come.

Undoubtedly, the future holds a number of surprises for the enterprise IT industry. While my thoughts and observations here are based on some existing trends, all of these things are driving innovation. What's more, cloud, mobile and big data are all driving the need for innovation. Small pieces of innovation are happening every day in communities at the developer level. It's exciting to see and be a part of these innovations as they emerge, take hold in the enterprise and make their mark on the world.

More Stories By Daniel Thompson

I curate the content on this page, but the credit goes to my talented colleagues for the posts that you see here. Much of what you read on this page is the work of friends at How to JBoss, and I encourage you to drop by the site at http://www.howtojboss.com for some of the best JBoss technical and non-technical content for developers, architects and technology executives on the Web.

@ThingsExpo Stories
Technology is enabling a new approach to collecting and using data. This approach, commonly referred to as the "Internet of Things" (IoT), enables businesses to use real-time data from all sorts of things including machines, devices and sensors to make better decisions, improve customer service, and lower the risk in the creation of new revenue opportunities. In his General Session at Internet of @ThingsExpo, Dave Wagstaff, Vice President and Chief Architect at BSQUARE Corporation, discuss the real benefits to focus on, how to understand the requirements of a successful solution, the flow of ...
"People are a lot more knowledgeable about APIs now. There are two types of people who work with APIs - IT people who want to use APIs for something internal and the product managers who want to do something outside APIs for people to connect to them," explained Roberto Medrano, Executive Vice President at SOA Software, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
We’re no longer looking to the future for the IoT wave. It’s no longer a distant dream but a reality that has arrived. It’s now time to make sure the industry is in alignment to meet the IoT growing pains – cooperate and collaborate as well as innovate. In his session at @ThingsExpo, Jim Hunter, Chief Scientist & Technology Evangelist at Greenwave Systems, will examine the key ingredients to IoT success and identify solutions to challenges the industry is facing. The deep industry expertise behind this presentation will provide attendees with a leading edge view of rapidly emerging IoT oppor...
In this Women in Technology Power Panel at 15th Cloud Expo, moderated by Anne Plese, Senior Consultant, Cloud Product Marketing at Verizon Enterprise, Esmeralda Swartz, CMO at MetraTech; Evelyn de Souza, Data Privacy and Compliance Strategy Leader at Cisco Systems; Seema Jethani, Director of Product Management at Basho Technologies; Victoria Livschitz, CEO of Qubell Inc.; Anne Hungate, Senior Director of Software Quality at DIRECTV, discussed what path they took to find their spot within the technology industry and how do they see opportunities for other women in their area of expertise.
DevOps Summit 2015 New York, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that it is now accepting Keynote Proposals. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential.
The 3rd International Internet of @ThingsExpo, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that its Call for Papers is now open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
The Industrial Internet revolution is now underway, enabled by connected machines and billions of devices that communicate and collaborate. The massive amounts of Big Data requiring real-time analysis is flooding legacy IT systems and giving way to cloud environments that can handle the unpredictable workloads. Yet many barriers remain until we can fully realize the opportunities and benefits from the convergence of machines and devices with Big Data and the cloud, including interoperability, data security and privacy.
Wearable devices have come of age. The primary applications of wearables so far have been "the Quantified Self" or the tracking of one's fitness and health status. We propose the evolution of wearables into social and emotional communication devices. Our BE(tm) sensor uses light to visualize the skin conductance response. Our sensors are very inexpensive and can be massively distributed to audiences or groups of any size, in order to gauge reactions to performances, video, or any kind of presentation. In her session at @ThingsExpo, Jocelyn Scheirer, CEO & Founder of Bionolux, will discuss ho...
The 3rd International Internet of @ThingsExpo, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that its Call for Papers is now open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
Connected devices and the Internet of Things are getting significant momentum in 2014. In his session at Internet of @ThingsExpo, Jim Hunter, Chief Scientist & Technology Evangelist at Greenwave Systems, examined three key elements that together will drive mass adoption of the IoT before the end of 2015. The first element is the recent advent of robust open source protocols (like AllJoyn and WebRTC) that facilitate M2M communication. The second is broad availability of flexible, cost-effective storage designed to handle the massive surge in back-end data in a world where timely analytics is e...

ARMONK, N.Y., Nov. 20, 2014 /PRNewswire/ --  IBM (NYSE: IBM) today announced that it is bringing a greater level of control, security and flexibility to cloud-based application development and delivery with a single-tenant version of Bluemix, IBM's platform-as-a-service. The new platform enables developers to build ap...

Building low-cost wearable devices can enhance the quality of our lives. In his session at Internet of @ThingsExpo, Sai Yamanoor, Embedded Software Engineer at Altschool, provided an example of putting together a small keychain within a $50 budget that educates the user about the air quality in their surroundings. He also provided examples such as building a wearable device that provides transit or recreational information. He then reviewed the resources available to build wearable devices at home including open source hardware, the raw materials required and the options available to power s...
The Internet of Things promises to transform businesses (and lives), but navigating the business and technical path to success can be difficult to understand. In his session at @ThingsExpo, Sean Lorenz, Technical Product Manager for Xively at LogMeIn, demonstrated how to approach creating broadly successful connected customer solutions using real world business transformation studies including New England BioLabs and more.
Since 2008 and for the first time in history, more than half of humans live in urban areas, urging cities to become “smart.” Today, cities can leverage the wide availability of smartphones combined with new technologies such as Beacons or NFC to connect their urban furniture and environment to create citizen-first services that improve transportation, way-finding and information delivery. In her session at @ThingsExpo, Laetitia Gazel-Anthoine, CEO of Connecthings, will focus on successful use cases.
Enthusiasm for the Internet of Things has reached an all-time high. In 2013 alone, venture capitalists spent more than $1 billion dollars investing in the IoT space. With "smart" appliances and devices, IoT covers wearable smart devices, cloud services to hardware companies. Nest, a Google company, detects temperatures inside homes and automatically adjusts it by tracking its user's habit. These technologies are quickly developing and with it come challenges such as bridging infrastructure gaps, abiding by privacy concerns and making the concept a reality. These challenges can't be addressed w...
The Domain Name Service (DNS) is one of the most important components in networking infrastructure, enabling users and services to access applications by translating URLs (names) into IP addresses (numbers). Because every icon and URL and all embedded content on a website requires a DNS lookup loading complex sites necessitates hundreds of DNS queries. In addition, as more internet-enabled ‘Things' get connected, people will rely on DNS to name and find their fridges, toasters and toilets. According to a recent IDG Research Services Survey this rate of traffic will only grow. What's driving t...
The Internet of Things is a misnomer. That implies that everything is on the Internet, and that simply should not be - especially for things that are blurring the line between medical devices that stimulate like a pacemaker and quantified self-sensors like a pedometer or pulse tracker. The mesh of things that we manage must be segmented into zones of trust for sensing data, transmitting data, receiving command and control administrative changes, and peer-to-peer mesh messaging. In his session at @ThingsExpo, Ryan Bagnulo, Solution Architect / Software Engineer at SOA Software, focused on desi...
"For over 25 years we have been working with a lot of enterprise customers and we have seen how companies create applications. And now that we have moved to cloud computing, mobile, social and the Internet of Things, we see that the market needs a new way of creating applications," stated Jesse Shiah, CEO, President and Co-Founder of AgilePoint Inc., in this SYS-CON.tv interview at 15th Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The Internet of Things is tied together with a thin strand that is known as time. Coincidentally, at the core of nearly all data analytics is a timestamp. When working with time series data there are a few core principles that everyone should consider, especially across datasets where time is the common boundary. In his session at Internet of @ThingsExpo, Jim Scott, Director of Enterprise Strategy & Architecture at MapR Technologies, discussed single-value, geo-spatial, and log time series data. By focusing on enterprise applications and the data center, he will use OpenTSDB as an example t...
The industrial software market has treated data with the mentality of “collect everything now, worry about how to use it later.” We now find ourselves buried in data, with the pervasive connectivity of the (Industrial) Internet of Things only piling on more numbers. There’s too much data and not enough information. In his session at @ThingsExpo, Bob Gates, Global Marketing Director, GE’s Intelligent Platforms business, to discuss how realizing the power of IoT, software developers are now focused on understanding how industrial data can create intelligence for industrial operations. Imagine ...