Databricks today released benchmark results for Apache Spark running the Sort Benchmark, a competition for measuring the sorting performance of large clusters. Spark running on Hadoop sorted 100 TB of ...

The quest to replace Hadoop’s aging MapReduce is a bit like waiting for buses in Britain. You watch a really long time, then a bunch come along at once. We already have Tez and Spark in the mix, but ...

The in-memory batch-processing framework sheds more JVM performance bottlenecks as a major Hadoop vendor eyes Spark as a full-blown replacement for the aging MapReduce Apache Spark, the in-memory data ...

Clusters must be tuned properly to run memory-intensive systems like Spark, H2O, and Impala alongside traditional MapReduce jobs. This Hadoop Summit 2015 talk describes Altiscale’s experience running ...

As analytics accelerate closer to real-time, historical analytics are not being displaced. The benefits of a comprehensive and historic view of data is becoming more than just a daydream. Imagine a ...

Hadoop is entering a new chapter in its evolution with the launch of an ambitious community effort from Cloudera Inc. that aims to replace MapReduce as its default data processing engine. The proposed ...

A team of professors that has created the in-memory Spark and Shark platforms for analyzing big data has raised nearly $13.9 million to commercialize those products. The company is still in stealth ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...