Explore @blockchain-etl Open Source projects

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

2,936

bitcoin-etl

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

405

ethereum-etl-airflow

Useful SQL queries for Blockchain ETL datasets in BigQuery.

405

awesome-bigquery-views

205

public-datasets

The list of public blockchain datasets in BigQuery

187

ethereum-etl-postgres

ETL for moving Ethereum data to PostgreSQL database

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

137

polygon-etl

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

100

blockchain-etl-streaming

Python scripts for ETL (extract, transform and load) jobs for Ethereum 2.0 beacon blocks, attestations, deposits, slashings, validators, committees. Data is available in Google BigQuery

ethereum2-etl

Blockchain ETL Architecture

blockchain-etl-architecture

ethers.js-bigquery

ethers.js library, compiled for use in Google BigQuery

ETL for Solana. Contributions are welcome. Join the Telegram channel https://t.me/joinchat/GsMpbA3mv1OJ6YMp3T5ORQ

solana-etl-airflow

Airflow DAGs for https://github.com/blockchain-etl/bitcoin-etl

bitcoin-etl-airflow

Kubernetes manifests for running blockchain nodes

blockchain-kubernetes

Smarty

ethereum-etl-neo4j

ETL for moving Ethereum data to Neo4j database

A tool for streaming time series data from a BigQuery table to a Pub/Sub topic

bigquery-to-pubsub

Airflow DAGs for ingesting Bitcoin blockchain data to Neo4j

bitcoin-etl-airflow-neo4j

Python scripts for ETL (extract, transform and load) jobs for Tezos blocks, balance updates, and operations

tezos-etl

CLI for generating table definitions for https://github.com/blockchain-etl/ethereum-etl-airflow

blockchain-etl-table-definition-cli

ETL scripts for Hedera Hashgraph

hedera-etl

Blockchain streaming analytics

blockchain-streaming-analytics

eos-etl

ETL scripts for EOS.

UNMAINTAINED! AWS CloudFormation scripts for Ethereum ETL export pipeline

ethereum-export-pipeline

Dataflow pipelines for Blockchain ETL. Connects Pub/Sub topics with BigQuery tables.

blockchain-etl-dataflow

Connect Google BigQuery crypto public datasets to Google Data Studio

data-studio-connectors

Template repository for deploying https://github.com/blockchain-etl/blockchain-terraform

abi-functions

blockchain-terraform-deployment

HCL

icon-etl

Python scripts for ETL (extract, transform and load) jobs for ICON blocks, transactions, receipts, and logs.

Airflow DAGs for exporting Ethereum 2.0 blockchain data to Google BigQuery

ethereum2-etl-airflow

Terraform configuration files for running blockchain nodes

blockchain-terraform

HCL

blockchain-etl-common

Common utils for blockchain-etl

EVM public good - pull requests welcome for any ABI from any EVM

abi

band-etl

ETL (extract, transform and load) tools for ingesting Band Protocol blockchain data to Google BigQuery and Pub/Sub

Kubernetes manifests for running Tezos node

tezos-kubernetes

Web app which parses smart contracts and outputs queries and tables for Ethereum-ETL

abi-parser

ETL (extract, transform and load) tools for ingesting IoTeX blockchain data to Google BigQuery and Pub/Sub

iotex-etl

ordinals-etl

Dataflow pipeline for detecting anomalous transactions on the Ethereum and Bitcoin blockchains

anomalous-transactions-detector-dataflow

Google Cloud Function for tweeting Blockchain ETL alerts

solana-etl

Rust

etl-rust

Rust

twitter-bot-cloud-function

Python scripts for ETL (extract, transform and load) jobs for Zilliqa blockchain data

zilliqa-etl

Dataflow pipeline that pulls messages from a Pub/Sub topic and saves them in a Firestore collection

pubsub-to-firestore-dataflow

Airflow DAGs for https://github.com/blockchain-etl/eos-etl

eos-etl-airflow

Bitcoin JSON RPC client in Python

bitcoin-rpc

icon-etl-airflow

Airflow DAGs for exporting, loading, and parsing the ICON blockchain data.

Airflow DAGs for exporting and loading the Tezos blockchain data to Google BigQuery

tezos-etl-airflow

Google Cloud Function that can throttle messages in a Pub/Sub topic

throttle-pubsub-cloud-function

theta-etl

Helm charts for running IoTeX node

iotex-kubernetes