Explore @GoogleCloudDataproc Open Source projects

Google Cloud Dataproc (@GoogleCloudDataproc)

GoogleCloudDataproc

Stars
1,674
Global Org. Rank 10,787 (Top 4 %)
Registered almost 5 years ago
Most used languages

Java
46.7 %

Python
20.0 %

Shell
13.3 %

Jupyter Notebook
6.7 %

TypeScript
6.7 %

Scala
6.7 %

initialization-actions

Run in all nodes of your cluster before the cluster starts - lets you customize your cluster

spark-bigquery-connector

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

hadoop-connectors

Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.

cloud-dataproc

Cloud Dataproc: Samples and Utils

Jupyter Notebook

bdutil

[DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine

custom-images

Tools for creating Dataproc custom images

hive-bigquery-storage-handler

Hive Storage Handler for interoperability between BigQuery and Apache Hive

spark-spanner-connector

Cloud Spanner Connector for Apache Spark

flink-bigquery-connector

BigQuery integration to Apache Flink's Table API

jupyterhub-dataprocspawner

hive-bigquery-connector

A library enabling BigQuery as Hive storage handler

dataproc-jupyter-plugin

dataprocmagic

spark-bigtable-connector

dataproc-jdbc-connector

.github

.allstar