Discover AbsaOSS/spark-commons Open Source project

Avro SerDe for Apache Spark structured APIs.

603

ABRiS

Spline agent for Apache Spark

229

spline-spark-agent

A GitHub Action to run lightweight ephemeral Kubernetes clusters during workflow. Fundamental advantage of this action is a full customization of embedded k3s clusters. In addition, it provides a private image registry and multi-cluster support.

185

k3d-action

Shell

177

cobrix

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

GoLic, injects license into source code files

136

golic

hyperdrive

Extensible streaming ingestion pipeline on top of Apache Spark

Nested array transformation helper extensions for Apache Spark

spark-hats

Dynamic Conformance Engine

enceladus

A dynamic data completeness and accuracy library at enterprise scale for Apache Spark

atum

spline-getting-started

NodeJS implementation of Hyperledger Indy LibVCX Agency

vcxagencynode

Resilient data pipeline framework running on Apache Spark

pramen

Scala API for Apache Spark SQL high-order functions

samlet

saml2aws k8s operator

spark-hofs

A Python to Kafka Serialization Tool

py2k

spline-ui

This code was starting point of https://github.com/hyperledger/indy-sdk-react-native where the work continues.

rn-indy-sdk

Java

env-binder

Binding environment variables to GO structures

Makefile

external-dns-infoblox-webhook

Infoblox provider based on in-tree provider for ExternalDNS

hermes

A E2E test tool for Enceladus. Also general dataframe comparison tool

A JDBC streaming source for Spark

Jdbc2S

Sizing partitions in Spark

spark-partition-sizing

Selection of useful reusable components

commons

Event based workflow manager.

hyperdrive-trigger

Tool to fix _spark_metadata from Structured Streaming queries

spark-metadata-tool

atum-service

Open Lineage Integration for Spline

spline-openlineage

Aggregate and analyze Spark history, export to elasticsearch, visualize and monitor with Kibana.

ghpages-to-tf-provider-registry

spot

fixed-width

Serve as a starter of github pages for any project of AbsaOSS

gh-pages-skeleton

Ruby

generate-release-notes

Efficiently automate your release note generation with 'generate-release-notes'. This tool scans your target GitHub repository's issues, sorting and organizing them into well-formatted release notes. Perfect for maintaining a streamlined and organized release process.

A cert-manager webhook completing DNS01 challenge by using External DNS

cert-manager-webhook-externaldns

spark-data-standardization

A library for Spark that helps to stadardize any input data (DataFrame) to adhere to the provided schema.

Scala library to write Postgres DB code tests with

absaoss.github.io

CSS

balta

Functional Access to Database

fa-db

AbsaOSS Common Login gateway using JWT Public key signatures

rest-api-doc-generator

ultet

Database deployment tool

An open source data science framework for feature and model deployment

rialto

Front-end application for the Manabu Learning Portal

manabu-ui

A NodeJS tool to generate and sign TLS certificates blazing fast with HashiCorp Vault and import them into AWS ACM

tf-provider-registry-generator

inception

Java

CertMe

Shortener for URL-formatted Aries OOB messages.

aries-oob-shortener

Rust

cps-shared-ui

Angular shared components library

The Test File Suffix Inspector GitHub Action scans test files in src/test directories to ensure naming conventions, reporting any files missing specified suffixes.

filename-inspector

Enhancement of springdoc-openapi for Scala

pgdump-lambda

HCL

root-pom

springdoc-openapi-scala

Builds a metadata for serving Docker registry with checksum-based storage

artifactory-registry-meta-generator

pit-junit-cucumber-upstream

Java

manabu-backend

Crossplane terrajet based rancher provider

provider-jet-rancher

Makefile

hackathon-turbo

Team Turbo Hackathon Repo

Jupyter Notebook

reusable-workflows

A collection of AbsaOSS reusable workflows for GitHub action

driver-did-sov

DID resolver HTTP(s) binding for Sovrin DID method.

Rust

cap-infra-dns

CAPI Cluster controlplaneEndpoint DNS registrator

simba-athena-login-service-support

Credentials provider for Simba Athena driver using Absa Login Service

A GH action for validating version tag sequences and ensuring compliance with versioning standards in repositories.

version-tag-check

EventGate

HCL

spline-python-agent

Angular library utilized in constructing websites that host tutorials and documentation, providing reference materials to help users learn about a particular topic, tool, or technology. The content is supplied in the format of markdown documents. This repository comprises both the library itself and an example website constructed using it.

datasets-similarity

HTML

cps-mdoc-viewer

"living-doc-generator: A GitHub Action designed to data-mine GitHub repositories for issues containing project documentation (e.g., tagged with feature-related labels). This action automatically generates fresh documentation in markdown format, providing detailed feature overview pages and in-depth feature descriptions.

living-doc-generator

SBT plugin to sync git hooks as part of the project

sbt-git-hooks