anish749/spark-indexed-dedup

Stars
2
Language
Scala
Created over 7 years ago
Updated over 6 years ago

anish749/spark-indexed-dedup

anish749

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Using Hash table based indexes for optimising joins in Apache Spark

spark2-etl-examples

A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0

e-commerce-marketing-pipeline

Data Pipeline examples using Oozie, Spark and Hive on Cloudera VM and AWS EC2 (branch aws-ec2)

ds-algo

Data Structures and Algorithms for Coding Interviews (Java & Scala)

hive-migration

Migrating Hive Tables from one Hadoop Cluster to another and across versions

spark-skew-join-examples

Simple examples on techniques for handling skewed data in Spark 2.0

spark-site-catalyst

Spark Data Source package to read data warehouse exports from Site Catalyst written for Apache Spark v1.6 and earlier and compatible with Spark 2.0 and above.

spark-skew-join

Fragment Replicate Join for Spark Data frames using Count Min Sketches for estimating skews

geo-search-spark

Apache Spark v2.0.0 application written in Scala to map given latitude longitude values to nearest latitude longitude values in a given set using broadcasted indexes of available geo coordinates.

better-subprocess

Examples on how to use wrap sub process in bash with correct exit code handling