Welcome!

Containers Expo Blog Authors: Liz McMillan, Yeshim Deniz, Elizabeth White, Pat Romanski, Ravi Rajamiyer

Related Topics: Open Source Cloud, Microservices Expo, @CloudExpo, Apache

Open Source Cloud: Article

Hadoop Begets Hortonworks

Hortonworks will compete against other Hadoop commercializers like Cloudera, IBM, newcomer MapR and its buddy EMC

Yahoo, which needs to turn a buck as well as focus on its own issues, is spinning out its Hadoop unit into an independent new company co-funded by Benchmark Capital called Hortonworks after the Dr. Seuss character Horton the Elephant.

It's a nice whimsical touch considering Hadoop is really a stuffed elephant who had his identity stolen, which may explain why the code is sometimes cranky.

Hortonworks will compete against other Hadoop commercializers like Cloudera, IBM, newcomer MapR and its buddy EMC and figures to accelerate Hadoop's adoption by making the code "more robust and easier to install, manage and use for enterprises and technology vendors."

It talks of Hadoop becoming the "de facto platform for managing and analyzing Big Data" and anticipates that more than half the world's data will be stored in Apache Hadoop in five years.

Since Yahoo, inspired by Google's MapReduce model, developed Hadoop, Hortonworks promises to be staffed with many of the key architects and core contributors to the open source Apache Hadoop project, "the same team," it says, "that pioneered Apache Hadoop and delivered every stable release from 0.1 to the most current release." Hortonworks can obviously out-credential its rivals.

Figure it's starting with around 25 people and means to hire.

Eric Baldeschwieler, formerly VP of software engineering for the Hadoop team at Yahoo, has been named CEO of Hortonworks. Rob Bearden, now at Benchmark but previously COO of both SpringSource and JBoss, two successful (and ultimately acquired) commercial open source companies, will be handling the business side as COO again.

Yahoo and Benchmark, VC to Red Hat, MySQL, SpringSource, Twitter and eBay, didn't disclose how much money they're stuffing in the place or who owns what.

Yahoo, which will reportedly be a "strategic partner" of Hortonworks, says it intends to continue its internal investment in the key widgetry since Hadoop is now behind every click on Yahoo, currently processing five billion jobs a month on 42,000 servers handling its content and advertising.

Hortonworks means to sell subscriptions, training, certification and support. It says it "may build applications or tools in the future that are only available to paying customers," but it's committed to all core code being open source. It says it will donate all source code back to Apache. Apparently it means to design solutions for specific industries.

It says reference implementations should come from Apache and that Hortonworks "will do its development in public, releasing early and often via Apache."

It will "continue to be a driving force behind Apache Hadoop and major contributors to core projects including Hadoop Core, MapReduce, Hadoop Distributed File System (HDFS), ZooKeeper and Pig."

Evidently it figures to make breakthroughs in performance, availability, scalability, security and integration and "work with the community to add new capabilities to open source including administration and monitoring."

Hadoop is used by companies like Facebook, eBay and Netflix.

More Stories By Maureen O'Gara

Maureen O'Gara the most read technology reporter for the past 20 years, is the Cloud Computing and Virtualization News Desk editor of SYS-CON Media. She is the publisher of famous "Billygrams" and the editor-in-chief of "Client/Server News" for more than a decade. One of the most respected technology reporters in the business, Maureen can be reached by email at maureen(at)sys-con.com or paperboy(at)g2news.com, and by phone at 516 759-7025. Twitter: @MaureenOGara

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


IoT & Smart Cities Stories
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
Machine learning has taken residence at our cities' cores and now we can finally have "smart cities." Cities are a collection of buildings made to provide the structure and safety necessary for people to function, create and survive. Buildings are a pool of ever-changing performance data from large automated systems such as heating and cooling to the people that live and work within them. Through machine learning, buildings can optimize performance, reduce costs, and improve occupant comfort by ...
SYS-CON Events announced today that IoT Global Network has been named “Media Sponsor” of SYS-CON's @ThingsExpo, which will take place on June 6–8, 2017, at the Javits Center in New York City, NY. The IoT Global Network is a platform where you can connect with industry experts and network across the IoT community to build the successful IoT business of the future.
CloudEXPO New York 2018, colocated with DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
Disruption, Innovation, Artificial Intelligence and Machine Learning, Leadership and Management hear these words all day every day... lofty goals but how do we make it real? Add to that, that simply put, people don't like change. But what if we could implement and utilize these enterprise tools in a fast and "Non-Disruptive" way, enabling us to glean insights about our business, identify and reduce exposure, risk and liability, and secure business continuity?