hadoop-aws

library3.5.0javamavenunverified

This module contains code to support integration with Amazon Web Services.

<dependency>
  <groupId>org.apache.hadoop</groupId>
  <artifactId>hadoop-aws</artifactId>
  <version>3.5.0</version>
</dependency>

docs ↗

INSTALL

IMPORT

SIG · HADOOP-AWS

hadoop-aws

cloudjavav3.5.0

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

S3AFileSystem

✓ org.apache.hadoop.fs.s3a.S3AFileSystem

Access S3 using Hadoop's S3A filesystem.

import org.apache.hadoop.fs.s3a.S3AFileSystem; import org.apache.hadoop.conf.Configuration; S3AFileSystem fs = new S3AFileSystem(); fs.initialize(URI.create("s3a://bucket"), new Configuration());

Debug

Known issues

gotchaRequires AWS credentials configured via environment variables or Hadoop configuration.

fix

Set AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables.

affects: all

Upgrade

Version history

3.5.0latest on Maven

Audit

Dependencies

No dependency data recorded yet.

Agent activity

10 hits · last 30 days

node

Resources

docshttps://appdoc.app/artifact/org.apache.hadoop/hadoop-aws/ ↗