yu-iskw/spark-dataframe-introduction

This repository has been archived on 27/Dec/2021
Stars
41
Rank 668,415 (Top 14 %)
Language
Shell
License
Apache License 2.0
Created almost 10 years ago
Updated over 9 years ago

yu-iskw/spark-dataframe-introduction

yu-iskw

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

This is an introduction of Apache Spark DataFrames.

tensorflow-serving-example

Examples to server tensorflow models with tensorflow serving

machine-learning-microservice-python

Example to implement machine learning microservice with gRPC and Docker in Python

action-sqlfluff

Run sqlfluff with reviewdog to check or format styles

dbt-artifacts-parser

A dbt artifacts parser in python

bigquery-to-datastore

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

google-cloud-deep-learning-kit

Create a GPU instance on GCP with Jupyter + Keras(Tensorflow) + Nvidia Docker

click-through-rate-prediction

Kaggle's click through rate prediction with Spark Pipeline API

dbt-unittest

A dbt package provides macros for unit testing, inspired by python's unittest module

spark-streaming-with-google-cloud-example

an example of integrating Spark Streaming with Google Pub/Sub and Google Datastore

dbt-artifacts-loader

Load dbt artifacts uploaded to GCS to BigQuery in order to track historical dbt results

dbt-airflow-macros

Dbt package for Apache Airflow inspired macros

kuromoji-for-bigquery

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

spark-ranking-algorithms

Ranking algorithms for Spark machine learning pipeline

auto-sklearn-examples

auto-sklearn examples on Jupyter notebooks

Jupyter Notebook

bisecting-kmeans

An implementation of Bisecting KMeans Clustering which is a kind of Hierarchical Clustering algorithm on Spark

gihyo-spark-book-example

技術評論社「詳解Apache Spark」のサンプルコード

dbt-bigquery-project-template

gpt-code-review-action

A GitHub Action for GPT to review a pull request

spark-kuromoji-tokenizer

Kuromoji Tokenizer for Spark DataFrames

google-log-aggregation-example

Example to aggregate logs from Google Pub/Sub to date-partitioned BigQuery on Dataflow

kotlin-spark-example

An example to use Apache Spark in Kotlin

dbt-ops

A set of dbt macros to maintain dbt projects

dbt-gcp-billing

Reusable dbt models to deal BigQuery tables of Google Cloud billing

SPARK-5992-LSH-design-doc

click-custom-multi-commands-example

Example to dynamically load sub-commands with click

lightdash-client-python

A python-based client to call Lightdash APIs

python-grpc-example

Example to use gRPC in python with docker

tensorflow-hub-with-ml-engine

Example of transfer learning with tensorflow-hub and Google ML Engine

P1_Facial_Keypoints

Udacity Compyter Vision Nanodegree Project 1 Facial Keypoints Detection

polyaxon-tf-distributed-training

bisecting-kmeans-blog

lightdash-ops

A python-based CLI to operate Lightdash

convert-to-draft-action

A custom GitHub Action to convert a pull request to draft if all workflows aren't passed

freeze-optimize-tf-model-example

mxnet-in-keras-example

Example of Apache MXNet in Keras

Jupyter Notebook

deep-learning-with-keras

Deep Learning with Keras

.vim

python-rest-apis

RESTful API with various web frameworks with machine learning in python

spark-deep-neural-network

R-functions

dbt-issue-with-multiple-service-accounts-on-bigquery

Reproduce an issue of dbt with multiple service accounts on BigQuery

terraform-google-copy-bq-datasets

A terraform module to copy BigQuery datasets across regions

action-terrascan

Run terrascan with reviewdog on pull requests to enforce security best practices