Discover @jwills Open Source projects

Josh Wills (@jwills)

jwills

Stars
567
Global Rank 51,790 (Top 2 %)
Followers 416
Following 26
Registered almost 14 years ago
Most used languages

Python
39.1 %

Java
34.8 %

Scala
13.0 %

R
8.7 %

Dockerfile
4.3 %
Location 🇺🇸 United States
Country Total Rank 16,591
Country Ranking

Scala
493

Dockerfile
2,305

Java
2,319

R
2,457

Python
3,433

buenavista

A Postgres Proxy Server in Python

exhibit

A prototype of Hive UDFs/UDTFs that execute nested SQL queries within rows.

duckdbt

The Modern Data Stack in a Python package

de4ml

Supporting materials/code examples for my course in data engineering for machine learning.

avro-json

Utilities for converting to and from JSON from Avro records via Hadoop streaming or Hive.

geojson

Scala library for working with GeoJSON records using Esri's Geometry API for Java

target-duckdb

A Singer.io target for DuckDB

driskill

Either[Hotel in Austin, Prototype of a Scala Distributed Collections API]

nba_monte_carlo

The Modern Data Stack in a (Smaller) Box

lineage

An R package for tracking the transformations applied to the vectors in a data frame.

supernova

A starter kit for working with supernova schemas.

mz-fastapi

A FastAPI utility for building HTTP endpoints powered by Materialize TAIL queries

dbt-buenavista

The dbt adapter for a Buena Vista database proxy server

hive-scd

A new kind of slowly changing dimension pattern for Apache Hive.

crunch-demo

A demo application for getting started with Apache Crunch.

dbt-mysql

MySQL plugin for dbt

saferdd

Tools for working with dirty data in Apache Spark.

attribution

MapReduce job for creating multitouch attribution models.

avroplay

Me messing around with some Avro stuff

s3-demo

Demo dbt-duckdb against localstack w/the new fsspec config options in version 1.4.1

hanukkahofdata

My solutions to the 2023 Hanukkah of Data

cdh-mapreduce-ext

Classes in the new mapreduce.* API that are not part of CDH3 yet.

avro-json-serde

A wrapper that uses the Hive AvroSerDe to deserialize data as JSON for use with Hive Streaming

hosprunner