Data Engineering
Apache Spark
Apache Spark in practice - driver and executors, lazy evaluation and the DAG of stages, shuffles, partitions, Structured Streaming, and the failure modes that make Spark jobs slow or dead.
Read the Apache Spark guideWhere Apache Spark sits
How this component relates to the rest of the stack. Items without a link are not covered here yet.
Apache Spark release support
4 supported| Release | Latest | Released | End of life | Status |
|---|---|---|---|---|
4.2 | 4.2.0 | Jul 2026 | Jan 2028 | Supported |
4.1 | 4.1.3 | Dec 2025 | Jun 2027 | Supported |
4.0 | 4.0.4 | May 2025 | Nov 2026 | Supported |
3.5LTS | 3.5.9 | Sept 2023 | Nov 2027 | Supported |
3.4 | 3.4.4 | Apr 2023 | Oct 2024 | End of life |
3.3 | 3.3.4 | Jun 2022 | Dec 2023 | End of life |
Data as of 2026-10-01 from endoflife.date. Refresh with node scripts/fetch-versions.mjs.