spark

docker4.1.2glibcsupported until 2027-06-112M pulls

Apache Spark is a unified analytics engine for large-scale data processing and machine learning.

data-science

Usage

Recommended variant

docker pull spark:4.1.2

use 4.1.2 unless you have a specific reason not to

Variants

Available tags

spark:full

Lifecycle

Support & EOL

latest4.1.2

pull size795MB compressed

OS EOLsupported until 2027-06-11

Known issues

Gotchas

Requires significant memory and CPU resources — configure container limits accordingly

Cluster mode requires additional setup (e.g., Kubernetes or standalone master/worker)

Default configuration uses local mode; for distributed processing, set SPARK_MASTER

Resources