The Next Web

Databricks co-founder Matei Zaharia wins ACM Prize and declares AGI is already here

Apache Spark creator and Databricks CTO Matei Zaharia wins the 2026 ACM Prize in Computing and argues that AGI has already ...
InfoQ

Accelerating Deep Learning on the JVM with Apache Spark and NVIDIA GPUs

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Soroosh Khodami discusses why we aren't ready ...
InfoQ

Real-Time Data Processing Using Redis Streams and Apache Spark Structured Streaming

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
InfoWorld

Review: Spark lights a fire under big data processing

Spark, written in Scala, provides a unified abstraction layer for data processing, making it a great environment for developing data applications. Spark comes with a choice of Scala, Java, and Python ...
insideHPC

Apache Spark Beats the World Record for Fastest Processing of Big Data

Databricks, the company founded by the creators of popular open-source Big Data processing engine Apache Spark, announced today that it has broken the world record for the GraySort, a third-party, ...
InfoWorld

Apache Flink 1.0 takes on Spark in Hadoop processing

Hadoop needs fast and easy-to-use stream processing, and Flink provides that -- but it'll compete with Spark and Storm Apache Flink, a potential contender for Apache Spark’s big-data processing jobs, ...