spark-yarn-2-11

library2.4.8javamavenunverified

Provides YARN cluster manager integration for Apache Spark, built with Scala 2.11.

<dependency>
  <groupId>org.apache.spark</groupId>
  <artifactId>spark-yarn_2.11</artifactId>
  <version>2.4.8</version>
</dependency>

github ↗homepage ↗docs ↗

INSTALL

IMPORT

SIG · SPARK-YARN-2-11

spark-yarn-2-11

networkingjavav2.4.8

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

Client

✓ org.apache.spark.deploy.yarn.Client

Launch a Spark application on YARN using the Client API.

import org.apache.spark.deploy.yarn.Client; import org.apache.spark.deploy.yarn.ClientArguments; ClientArguments args = new ClientArguments(new String[]{"--jar", "my.jar"}); Client client = new Client(args, sparkConf); client.run();

Debug

Known issues

breakingSpark 2.4.x is end-of-life; consider upgrading to Spark 3.x.

fix

Migrate to Spark 3.x and use the corresponding Scala 2.12 or 2.13 artifact.

affects: 2.4.x

Upgrade

Version history

2.4.8latest on Maven

Audit

Dependencies

No dependency data recorded yet.

Agent activity

10 hits · last 30 days

node

Amazon

OpenAI (training)

Resources

githubhttps://github.com/apache/spark ↗

homepagehttp://spark.apache.org/ ↗

docshttps://appdoc.app/artifact/org.apache.spark/spark-yarn_2.11/ ↗