The Battle of the Compressors: Optimizing Spark Workloads with

Hello! Hope you’re having a wonderful time working with challenging issues around Data and Data Engineering. In this article let’s look at the different compression algorithms Apache Spark offers…

Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos

Big Data with Spark and Scala. Big Data is a new term that is used…, by Jidnasa Pillai

Under the hood of Spark performance, or why query compilation matters, by Victor Zaytsev, Criteo R&D Blog

Operation Spark Debugger's Checklist, by John Cooper

Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos

Java Compression Performance

Optimizing Apache Spark File Compression with LZ4 or Snappy, by Matthew Salminen

Small File, Large Impact — Addressing the Small File Issue in Spark, by Santosh Kumar Thammineni

Spark's Missing Parallelism: Loading Large Datasets, by Joshua Robinson