Matthew Powers (@MrPowers)

Top repositories

1

spark-daria

Essential Spark extensions and helper methods โœจ๐Ÿ˜ฒ
Scala
742
star
2

quinn

pyspark methods to enhance developer productivity ๐Ÿ“ฃ ๐Ÿ‘ฏ ๐ŸŽ‰
Python
582
star
3

spark-fast-tests

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
Scala
418
star
4

chispa

PySpark test helper methods with beautiful error messages
Python
351
star
5

mack

Delta Lake helper methods in PySpark
Python
265
star
6

spark-style-guide

Spark style guide
Jupyter Notebook
229
star
7

code_quizzer

Programming practice questions with Ruby, JavaScript, Rails, and Bash.
HTML
199
star
8

frontend-generators

Rake tasks to add Bootstrap, Font Awesome, and Start Bootstrap Landing Pages to a Rails app
CSS
96
star
9

spark-sbt.g8

A giter8 template for Spark SBT projects
Scala
73
star
10

spark-stringmetric

Spark functions to run popular phonetic and string matching algorithms
Scala
55
star
11

bebe

Filling in the Spark function gaps across APIs
Scala
50
star
12

jodie

Delta lake and filesystem helper methods
Scala
44
star
13

farsante

Fake Pandas / PySpark DataFrame creator
Rust
33
star
14

beavis

Pandas helper functions
Python
25
star
15

tic_tac_toe

Ruby tic tac toe game
Ruby
25
star
16

ceja

PySpark phonetic and string matching algorithms
Python
24
star
17

spark-test-example

Spark DataFrame transformation and UDF test examples
Scala
22
star
18

spark-spec

Test suite to document the behavior of Spark
Scala
21
star
19

gill

An example PySpark project with pytest
Python
18
star
20

directed_graph

Modeling directed acyclic graphs (DAG) for topological sorting, shortest path, longest path, etc.
Ruby
14
star
21

spark-slack

Speak Slack notifications and process Slack slash commands
Scala
13
star
22

scalatest-example

Testing Scala code with scalatest
Scala
11
star
23

python-parquet-examples

Using the Parquet file format with Python
Python
11
star
24

levi

Delta Lake helper methods. No Spark dependency.
Python
10
star
25

unicron

DAGs on DAGs! Smart PySpark custom transformation runner
Python
10
star
26

pysparktestingexample

PySpark testing example project
Python
9
star
27

JavaSpark

Example Spark project with Java API
Java
9
star
28

spark-pika

Demo how to set up Spark with SBT
Scala
7
star
29

spark-etl

Lightweight Spark ETL framework
Scala
6
star
30

slack_trello

Helping Slack and Trello play together nicely
Ruby
6
star
31

mill_spark_example

Apache Spark project with the Mill build tool
Scala
6
star
32

mrpowers-benchmarks

MrPowers benchmarks for Dask, Polars, DataFusion, and pandas
Jupyter Notebook
5
star
33

pydata-style-guide

Style for the PyData stack
5
star
34

walle

Compression algorithms for different file formats
Python
5
star
35

angelou

PySpark on Poetry example
Python
5
star
36

great-spark

Curated collection of Spark libraries and example applications
5
star
37

appa

Data lake metadata / transaction log store
Python
5
star
38

turf

Set application variables for the development, test, and production environments
Ruby
5
star
39

eren

PySpark Hive helper methods
Python
5
star
40

prawn_charts

Prawn gem to develop vector line charts
Ruby
5
star
41

spark-bulba

Tutorial on running faster tests with Spark
Scala
4
star
42

ml-book

Introduction to Machine Learning with Python Book
Jupyter Notebook
4
star
43

blake

Great Pandas and Jupyter workflow with Poetry
Jupyter Notebook
4
star
44

cmap

Model cmap exports as a directed graph and generate SQL
Ruby
4
star
45

redshift_extractor

Using the Redshift UNLOAD/COPY commands to move data from one Redshift cluster/database to another
Ruby
4
star
46

spark-examples

A Spark playground to help me write blog posts
Scala
4
star
47

deltadask

Delta Lake powered by Dask
Jupyter Notebook
4
star
48

spark-frameless

Typed Datasets with Spark
Scala
4
star
49

slack_notifier_wrapper

Making it easier to work with the slack_notifier gem
Ruby
3
star
50

scalate-example

Templates in Scala with Scalate
Scala
3
star
51

rails-startbootstrap-creative

Creative by Start Bootstrap - Rails Version
Ruby
3
star
52

repo_tools

Easily manage clone Git repos in Ruby applications
Ruby
3
star
53

munit-example

Simple example of the MUnit testing library
Scala
3
star
54

hll-example

Implementing HyperLogLog functions in Spark
Scala
3
star
55

pyspark-spec

Documents the behavior of pyspark
Python
3
star
56

dask-interop

Integration tests to demonstrate Dask's interoperability with other systems
Python
3
star
57

mungingdata

Code to support MungingData blog posts: https://mungingdata.com/
Scala
3
star
58

dask-fun

Dask examples with tests
Jupyter Notebook
3
star
59

vimtraining

Practicing Vim after completing the vimtutor
2
star
60

technical_writing

Elements of style for blogs, books, and presentations
2
star
61

scala-design

Core Scala language features and design patterns
Scala
2
star
62

GameBoard

This is a GameBoard class with methods to help analyze the grid.
Ruby
2
star
63

cali

Guide to provision a Mac for developers
Vim Script
2
star
64

data-scrapbook

A collection of images and captions to explain core data concepts
2
star
65

sapo

Data store validator for sqlite, Parquet
Python
2
star
66

learn_spanish

Logically learn Spanish
Ruby
2
star
67

project_euler

Some Project Euler solutions
Ruby
2
star
68

yellow-taxi

Data lake fun!
Scala
2
star
69

sqlite-example

Creating a sqlite db and writing it to files
Jupyter Notebook
2
star
70

http_validator

Ruby
2
star
71

polars-fun

Example notebooks for how to use pola.rs
Jupyter Notebook
2
star
72

mesita

Print colorful tables with nice diffs in the Terminal
Python
2
star
73

spark-utest

Example of how to use uTest with Spark
Scala
1
star
74

mrpowers-book

Book on MrPowers OSS projects, blogs, and other assets
1
star
75

doctor_scrabble

Rails Scrabble App
Ruby
1
star
76

dotfiles

My dotfiles
Shell
1
star
77

mini_yelp

Ruby
1
star
78

eli5_ruby_cs

explain like I'm 5: computer science with ruby
Ruby
1
star
79

mrpowers.github.io

Documentation and stuff
HTML
1
star
80

pyspark-examples

PySpark example notebooks
Jupyter Notebook
1
star
81

tic_tac_toe_js

A tic tac toe game, written in JS, with DOM crap isolated out of the way
JavaScript
1
star
82

go-example

Simple Go project
Go
1
star
83

custom_tableau

Using JavaScript to create Tableu-like dashboards
JavaScript
1
star
84

ansible_playbooks

Ansible playbooks
Ruby
1
star
85

javascript_book

Teaching JavaScript logically without being dorks
1
star
86

rails-startbootstrap-freelancer

Rails implementation of the Start Bootstrap Freelancer theme
CSS
1
star
87

express_practice

Some practice exercises for building Node and Express applications
JavaScript
1
star