Java idiomatic client for Google Cloud Dataproc.

• Product Documentation
• Client Library Documentation

Note: This client is a work-in-progress, and may occasionally make backwards-incompatible changes.

If you are using Maven with a BOM, add this to your pom.xml file.

<dependencyManagement>
 <dependencies>
  <dependency>
    <groupId>com.google.cloud</groupId>
    <artifactId>libraries-bom</artifactId>
    <version>2.8.0</version>
    <type>pom</type>
    <scope>import</scope>
   </dependency>
 </dependencies>
</dependencyManagement>

<dependency>
  <groupId>com.google.cloud</groupId>
  <artifactId>google-cloud-dataproc</artifactId>
</dependency>

If you are using Maven without a BOM, add this to your dependencies.

<dependency>
  <groupId>com.google.cloud</groupId>
  <artifactId>google-cloud-dataproc</artifactId>
  <version>0.118.1</version>
</dependency>

If you are using Gradle, add this to your dependencies

compile 'com.google.cloud:google-cloud-dataproc:0.118.1'

If you are using SBT, add this to your dependencies

libraryDependencies += "com.google.cloud" % "google-cloud-dataproc" % "0.118.1"

See the Authentication section in the base directory's README.

Google Cloud Dataproc manages Hadoop-based clusters and jobs on Google Cloud Platform.

See the Google Cloud Dataproc docs for more details on how to activate Cloud Dataproc for your project.

See the Dataproc client library docs to learn how to interact with the Cloud Dataproc using this Client Library.

For this tutorial, you will need a Google Developers Console project with the Dataproc API enabled. You will need to enable billing to use Google Cloud Dataproc. Follow these instructions to get your project set up. Set up authentication with a service account so you can access the API from your local workstation.

You'll need to obtain the google-cloud-dataproc library. See the Quickstart section to add google-cloud-dataproc as a dependency in your code.

Dataproc uses gRPC for the transport layer.

Java 7 or above is required for using this client.

This library has tools to help make tests for code using Cloud Dataproc.

See TESTING to read more about testing.

This library follows Semantic Versioning.

It is currently in major version zero (0.y.z), which means that anything may change at any time and the public API should not be considered stable.

Contributions to this library are always welcome and highly encouraged.

See google-cloud's CONTRIBUTING documentation and the shared documentation for more information on how to get started.

Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms. See Code of Conduct for more information.

Apache 2.0 - See LICENSE for more information.