Cloudera Announces Open Source Compatibility Testing Frameworks for Apache Sqoop and Apache Flume

Open Source Initiative Will Accelerate Data Flow Into Hadoop to Enable Future Discoveries

PALO ALTO, Calif., – May 6, 2015 – Cloudera, the leader in enterprise analytic data management powered by Apache Hadoop™, today announced it is leading an initiative to create open source API compatibility testing frameworks for accelerating the adoption of Apache Sqoop and Apache Flume. The initiative will take the form of new Apache sub-projects for compatibility and are free and open to anyone–vendors, users, or contributors–with an interest in seeing open, multi-vendor standards even more widely adopted, to enable more next-generation, analytic workloads.

“Today, developers who build applications that include Apache Sqoop and Apache Flume don’t have access to open source tools for validating compatibility of their implementations. This introduces risk, cost, and time into application development,” said Mike Olson, chief strategy officer of Cloudera. “Our intent for these testing frameworks is to streamline the process of building next-generation products and apps for ingesting and analyzing data, and to assure the market that any product that correctly passes these tests is compatible with the releases from the Apache Software Foundation.”

As the market share leader in enterprise Hadoop, and regarded by many industry experts as the benchmark for Hadoop adoption and commercial success, Cloudera is proud to contribute to advances in the open source community and to working with the Apache Software Foundation to seek even more elegant and impactful ways to foster the Hadoop ecosystem. The API compatibility testing framework initiative reflects Cloudera’s commitment to accelerating the adoption of open source standards upon which the big data platforms of tomorrow are being built today.

Data analysis is only half the battle; getting the data into a Hadoop cluster is the first step in any big data deployment. Apache Flume and Apache Sqoop are key in the movement of massive data.

Apache Sqoop has demonstrated value for efficiently transferring bulk data between Hadoop and structured data stores, such as relational databases. As companies look to tap into all of their data assets, for example to obtain a 360-degree customer view, they must do so quickly and efficiently in order to get real-time, meaningful insights to dramatically impact and influence future customer engagement.

Apache Flume has proven very effective for collecting, aggregating, and moving large volumes of streaming event data into Hadoop clusters. However, as data volumes grow from machine-generated data and streamed in from IoT devices connecting at infrastructure endpoints, the rapid ability to move that data becomes more critical and time sensitive. The ability to put in place open source standards for data collection, data flow, and aggregating data stores now makes future discoveries possible.

Supporting Organizations:

Accenture
Capgemini
Celer Technologies
Corvil
Couchbase
Dataguise
Dell Computer
E8 Security
Fortscale
Intel
NetFlow Logic
NetIQ
Oracle
Pentaho
Quaero
Rocana
Syncsort
SAS
SGI
StreamSets
Talend
TCS
Teradata
Tibco

Supporting Quotes:

Accenture
“Accenture and Cloudera established a formal alliance in June 2014 to help clients drive real business results from big data. Cloudera’s new open source API compatibility testing framework enables our technologists to participate in Apache Foundation projects and learn more deeply about Apache Sqoop and Apache Flume. As a result, Accenture can further help clients to mobilize and manage data and generate insight that can enable them to defend and differentiate in their markets.”

-- Narendra Mulani, Senior Managing Director, Accenture Analytics

Capgemini
“Most big data projects include a real-time decision component, and more and more open source technology such as Kafka, Sqoop, or Flume and of course APIs are key components. More than ever, the market demands a shorter time to market. Using an open source compatibility testing framework will dramatically improve the time to market and the reliability of these business critical functions.”

-- Manuel Sevilla, CTO Global Insights & Data Practice

Corvil
"As a provider of network data analytics  for IT operational intelligence, Corvil is asked to integrate with many big data solutions. Standards such as Sqoop and Flume greatly reduce the required development burden and allow us to respond to market demands with greater agility. It is hugely advantageous to see such standards being more broadly updated, and to know that implementations are validated by Cloudera."

-- Donal O'Sullivan, VP Products

Couchbase
“Couchbase applauds Cloudera’s moves today to provide frameworks for certifying big data architectures on open technologies such as Kafka, Flume, and Sqoop. Enterprises across every industry are building next-generation big data platforms that incorporate open technologies from NoSQL and Hadoop vendors - having a free, open test framework will make it faster and easier for them to deploy technology needed to support mission critical applications.”

-- Bob Wiederhold, CEO

Dell
“As customers put data at the center of their company’s strategy, the
solutions they choose will be the linchpin for how they ingest, analyze and
rapidly derive actionable business intelligence from the data,”“Dell
believes that solutions built on open standards will enable customers to
adopt technologies that will make their businesses future-ready. As
long-time partners and collaborators, Dell supports Cloudera’s effort to
enable the hadoop ecosystem with access to free tools for validating open
release APIs that will streamline products and applications development at
a much lower risk and enable customers to transform their businesses by
using more of their data in accelerated analytic workloads.”

-- Jim Ganthier, vice president and general manager of Dell engineered
solutions and cloud group

Fortscale
"As an early-adopter of open-source technologies, Fortscale believes that Cloudera's efforts to accelerate the adoption of Apache Kafka will enable faster growth of innovative solutions that can scale effectively, thereby generating better value for customers. This was demonstrated numerous times when Fortscale successfully delivered products built using Hadoop, Kafka, and Flume as key building blocks."

-- Guy Mordecai, Director of Product Management

Intel Corporation
“Enterprises like Intel are increasingly investing in big data analytics solutions that require the collection and processing of streaming as well as bulk data. Platforms based on open standards, open source software, and open APIs can significantly reduce the cost and complexity of application development and deployment. Intel has a long-standing commitment to standards-based innovation and supports this initiative to enable greater compatibility between key components of the Apache Hadoop platform."

-- Ron Kasabian, VP Data Center Group and General Manager, Big Data Solutions

NetFlow Logic
“Furthering the adoption of open standards such as Kafka, Flume, and Sqoop in the next-generation Big Data platform benefits the entire community. and allows users to accelerate the development and adoption of next-generation applications.”

-- Damian Miller, VP Customer Success

NetIQ
"Today, it is more critical than ever to provide organizations with capabilities to achieve greater context around the massive amounts of data they are collecting to extract real intelligence. The work that Cloudera and their partners are doing around open standards is a significant industry milestone that we are excited to support and leverage to help organizations make better security decisions."

-- David Corlette, Sr. Product Manager, NetIQ security portfolio of Micro Focus

Oracle
"Open standards have always been key to accelerating new technology
adoption in our industry. Oracle ships and supports the entire Cloudera
suite on Oracle Big Data Appliance and is committed to open standards like
Apache Kafka, Apache Flume and Apache Sqoop. We welcome this effort."

--  Neil Mendelson, vice president of Big Data

Rocana
"It's great that the Apache community is investing in testable APIs. This is will be a tremendous benefit to ISVs such as Rocana who are building on top of a broad range of projects."

-- Eric Sammer, CTO

SAS
“Customers continue to leverage Hadoop as their analysis and visualization platform of choice. Having the right data loaded into Hadoop, as well as transforming and cleansing that data in Hadoop, means that information is readily available for visualizations, advanced analysis, and enterprise decisions. SAS supports this Cloudera initiative, as it ensures that our offerings, includingSAS® Data Loader for Hadoop, improve data movement and data quality into and throughout a Hadoop cluster.”

-- Randy Guard, VP Product Management

SGI
“We expect the adoption of open standards like Apache Kafka, Sqoop, and Flume to set the foundation for tomorrow's analytic, big data workloads. Giving developers free and open

access to tools fosters innovation and collaboration across the data science community, but also helps data-intensive industries re-imagine the role of high performance computing across the enterprise.”

-- Bob Braham, CMO

StreamSets
“StreamSets, like Cloudera, is completely dedicated to furthering the adoption of open, multi-vendor standards as important building blocks in tomorrow's Big Data platform. Apache Sqoop and Apache Flume, both important components of the StreamSets offering, enable the ingestion of more data, more rapidly, into next-generation analytic workloads, so we support Cloudera's Open Source Compatibility Framework initiative as a means of accelerating their uptake across the ecosystem.”

-- Arvind Prabhakar, CTO

Syncsort
“This initiative aligns well with Syncsort’s focus to support Kafka for parallel data ingestion to Hadoop and real-time ETL processing, and accelerates our continued contributions to Apache projects such as Sqoop.”

-- Tendu Yogurtcu, General Manager for Big Data

TCS
"In our client engagements, we see that the success of impactful Big Data systems critically depend on the efficiency of data ingestion. This ranges from traditional batch-oriented systems to the exciting new streaming applications necessitated by the Internet of Things era. We believe that open source standards such as Kafka, Flume, and Sqoop and the associated test frameworks are central to the rapid adoption of Big Data applications"

-- Dr. Satya Ramaswamy, Global Head of TCS Digital Enterprise

TIBCO
"TIBCO is committed to providing our customers with the benefits that open standards bring. Any effort to further the adoption of open standards such as Kafka, Flume, and Sqoop in the next-generation Big Data platform is a positive development for customers, the industry, and the ecosystem."

-- Karl Van den Bergh, VP Product and Cloud

Teradata
“Teradata supports Cloudera’s initiative to further the development of Apache Sqoop and Apache Flume software. These open source technologies can be a valuable asset to the open source community, as they become a standardized component of Hadoop deployments.”

-- Chris Twogood, VP Products and Services

###