Repositories list

• dataproc-jupyter-plugin

  Public
  TypeScript

  •

  Apache License 2.0

  •17•9•7•29•Updated Mar 14, 2026Mar 14, 2026

• spark-spanner-connector

  Public
  Cloud Spanner Connector for Apache Spark

  Java

  •

  Apache License 2.0

  •21•17•2•5•Updated Mar 14, 2026Mar 14, 2026

• flink-bigquery-connector

  Public
  BigQuery connector for Apache Flink

  Java

  •

  Apache License 2.0

  •27•38•10•2•Updated Mar 12, 2026Mar 12, 2026

• gcs-jupyter-plugin

  Public
  Python

  •

  Apache License 2.0

  •4•0•0•8•Updated Mar 11, 2026Mar 11, 2026

• hive-bigquery-connector

  Public
  A library enabling BigQuery as Hive storage handler

  Java

  •

  Apache License 2.0

  •17•10•14•11•Updated Mar 11, 2026Mar 11, 2026

• cloud-dataproc

  Public

  GoogleCloudDataproc/cloud-dataproc’s past year of commit activity
  Cloud Dataproc: Samples and Utils

  google-cloud-dataproc

  google-cloud-dataproc

  Jupyter Notebook

  •

  Apache License 2.0

  •133•206•2•9•Updated Mar 11, 2026Mar 11, 2026

• hadoop-connectors

  Public
  Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.

  bigqueryhadoophadoop-filesystem+ 2

  bigqueryhadoophadoop-filesystemhadoop-hcfsgoogle-cloud-dataproc

  Java

  •

  Apache License 2.0

  •260•289•49•53•Updated Mar 10, 2026Mar 10, 2026

• spark-bigquery-connector

  Public
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

  bigquerysparkgoogle-cloud+ 3

  bigquerysparkgoogle-cloudgoogle-bigquerybigquery-storage-apigoogle-cloud-dataproc

  Java

  •

  Apache License 2.0

  •224•422•39•11•Updated Mar 6, 2026Mar 6, 2026

• initialization-actions

  Public
  Run in all nodes of your cluster before the cluster starts - lets you customize your cluster

  google-cloud-dataproc

  google-cloud-dataproc

  Shell

  •

  Apache License 2.0

  •516•600•75•48•Updated Mar 6, 2026Mar 6, 2026

• dataproc-spark-connect-python

  Public
  Python

  •

  Apache License 2.0

  •13•7•1•5•Updated Mar 5, 2026Mar 5, 2026

• spark-bigtable-connector

  Public
  Scala

  •

  Apache License 2.0

  •16•6•13•3•Updated Mar 2, 2026Mar 2, 2026

• custom-images

  Public
  Tools for creating Dataproc custom images

  google-cloud-dataproc

  google-cloud-dataproc

  Python

  •

  Apache License 2.0

  •67•35•6•6•Updated Feb 23, 2026Feb 23, 2026

• dataproc-ml-python

  Public
  Library to simplify running distributed ML workloads with Apache Spark

  sparktensorflowinference+ 4

  sparktensorflowinferencepytorchgeminivertex-aigenai

  Python

  •

  Apache License 2.0

  •2•7•1•0•Updated Jan 28, 2026Jan 28, 2026

• hive-bigquery-storage-handler

  Public
  Hive Storage Handler for interoperability between BigQuery and Apache Hive

  bigquerygooglehive+ 3

  bigquerygooglehivehadoopgcpapache

  Java

  •

  Apache License 2.0

  •10•19•6•5•Updated Jan 29, 2025Jan 29, 2025

• .allstar

  Public archive
  2•1•0•0•Updated Dec 6, 2022Dec 6, 2022

• .github

  Public archive
  0•1•0•0•Updated Oct 26, 2022Oct 26, 2022

• jupyterhub-dataprocspawner

  Public
  google-cloud-dataproc

  google-cloud-dataproc

  Python

  •

  Apache License 2.0

  •9•14•5•2•Updated May 27, 2022May 27, 2022

• dataprocmagic

  Public
  Python

  •

  Apache License 2.0

  •4•3•0•1•Updated Sep 11, 2020Sep 11, 2020

• dataproc-jdbc-connector

  Public
  Java

  •

  Apache License 2.0

  •7•3•7•0•Updated Sep 10, 2020Sep 10, 2020

• bdutil

  Public archive
  [DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine

  Shell

  •

  Apache License 2.0

  •90•109•26•6•Updated Nov 15, 2019Nov 15, 2019