gcs-connector

library4.0.4javamavenunverified

Hadoop FileSystem implementation that provides access to Google Cloud Storage, enabling Hadoop jobs to read and write data stored in GCS.

cloud networking

<dependency>
  <groupId>com.google.cloud.bigdataoss</groupId>
  <artifactId>gcs-connector</artifactId>
  <version>4.0.4</version>
</dependency>

github ↗homepage ↗docs ↗

INSTALL

IMPORT

SIG · GCS-CONNECTOR

gcs-connector

cloudjavav4.0.4

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

GoogleHadoopFileSystem

✓ com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem

Initializes a GoogleHadoopFileSystem instance with a GCS bucket URI.

import com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem; import org.apache.hadoop.conf.Configuration; public class Example { public static void main(String[] args) throws Exception { GoogleHadoopFileSystem fs = new GoogleHadoopFileSystem(); fs.initialize(new java.net.URI("gs://my-bucket"), new Configuration()); System.out.println(fs.getUri()); } }

Debug

Known issues

breakingVersion 4.x requires Hadoop 3.x; older Hadoop versions may cause compatibility issues.

fix

Use gcs-connector 2.x for Hadoop 2.x or upgrade your Hadoop cluster to 3.x.

affects: >=4.0.0

Upgrade

Version history

4.0.4latest on Maven

Audit

Dependencies

No dependency data recorded yet.

Agent activity

11 hits · last 30 days

node

Amazon

Resources

githubhttps://github.com/GoogleCloudDataproc/hadoop-connectors ↗

homepagehttps://github.com/GoogleCloudDataproc/hadoop-connectors ↗

docshttps://appdoc.app/artifact/com.google.cloud.bigdataoss/gcs-connector/ ↗