Registry / cloud / spark-yarn-2-12

spark-yarn-2-12

library3.5.8javamavenunverified

Apache Spark module for running Spark applications on YARN cluster manager.

<dependency>
  <groupId>org.apache.spark</groupId>
  <artifactId>spark-yarn_2.12</artifactId>
  <version>3.5.8</version>
</dependency>

github ↗homepage ↗docs ↗

INSTALL

IMPORT

SIG · SPARK-YARN-2-12

spark-yarn-2-12

cloudjavav3.5.8

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

Client

✓ org.apache.spark.deploy.yarn.Client

Submit a Spark application to YARN.

import org.apache.spark.deploy.yarn.Client; import org.apache.spark.deploy.yarn.ClientArguments; ClientArguments args = new ClientArguments(new String[]{"--jar", "myapp.jar"}); Client client = new Client(args, sparkConf); client.run();

Debug

Known issues

gotchaSpark 3.x uses Scala 2.12, but some libraries may require Scala 2.13.

fix

Ensure all dependencies are compiled for Scala 2.12.

affects: >=3.0.0

Upgrade

Version history

3.5.8latest on Maven

Audit

Dependencies

No dependency data recorded yet.

Agent activity

17 hits · last 30 days

node

Resources

githubhttps://github.com/apache/spark ↗

homepagehttps://spark.apache.org/ ↗

docshttps://appdoc.app/artifact/org.apache.spark/spark-yarn_2.12/ ↗