Hortonworks today announced a major change to the way it distributes its Hadoop software. Starting with Hortonworks Data Platform (HDP) 2.4, Hortonworks is enhancing the velocity of its release cycle by balancing the customers’ requirements for a stable platform with rapid access to the latest innovations in the open source community. In order to accomplish this goal, Hortonworks announced a brand new release strategy that includes:
Hortonworks‘ adoption of two separate release schedules for its flagship Hadoop distribution, called the Hortonworks Data Platform (HDP), was made in response to increasingly dense test and release cycles. With more than 20+ different Apache Software Foundation (ASF) projects going into HDP, it was becoming difficult for the vendor to ensure that each of the components was fully tested against all the others. And it was also causing concern among the customer base. Ensuring compatibility among an escalating number of Hadoop components was one of the main reasons that Hortonworks co-founded the ODPi a year ago. The Santa Clara, California company, along with Pivotal Software and IBM, are the main backers of the ODPi, while Hadoop competitors’ Cloudera and MapR have questioned the need for its existence.
What’s new in HDP 2.4? Spark 1.6 GA
HDP 2.4 delivers support for Spark 1.6. Spark is one of the extended services which runs on top of Hadoop. As those services evolve, customers who require the latest innovations should be able to easily adopt them in a non-disruptive manner. Hortonworks provided a technical preview of Spark 1.6 within hours of the community approving the release of Spark 1.6.
What else is new? Ambari 2.2 with Express Upgrade
The latest release of Ambari now delivers a new upgrade mechanism called “Express Upgrade.” In early 2015, Ambari introduced automation for a rolling upgrade capability to take advantage of innovations delivered throughout the 20 plus components included with HDP 2.2. During 2015, we have continued to refine and improve the rolling upgrade capability which allows customers to apply both maintenance releases and feature bearing releases of HDP onto their running cluster; eliminating downtime for their mission critical applications.