Discover mchmarny/pubsub-to-bigquery-pump Open Source project

Collection of Knative demos

167

knative-demos

Compare data from multiple vulnerability scanners to get a more complete picture of potential exposures.

vimp

s3cme

Template Go app repo with local test/lint/build/vulnerability check workflow, and on tag image test/build/release pipelines, with ko generative SBOM, cosign attestation, and SLSA build provenance

github-activity-counter

Cloud Run service for GitHub event Webhook to monitor repo or org activity in real-time in Stackdriver and analyze activity through ad-hoc SQL queries in BigQuery

tsignal

Analyzing social media sentiment and its impact on stock market

grunner

Self-hosted GitHub Actions runner on GCP using GCE.

Simple bridge to stream MQTT Broker data to dynamically defined back-ends

mqtt-bridge

JavaScript

tfeel

Twitter sentiment analysis

thingz-server

Thingz understood

dapr-pipeline

Example of Twitter event processing pipeline using dapr framewrk

restme

Template to bootstrap a fully functional, multi-region, REST service on GCP with a developer release pipeline.

Cloud Build status notification in Slack using Cloud Run

buildstatus

knative-ws-example

Knative WebSocket Example

disco

Utility for bulk image, license, package, and vulnerability discovery in containerize workloads on GCP. Includes CLI and Service with custom metrics and BigQuery data exports.

long-running-job

Demo showcasing the use container execution feature in GCE to effectively run long running jobs

Custom image pipeline for Google Cloud Workstations

custom-cloud-workstation-image

GitOps demo using Cloud Build and Knative

thingz-agent

Thingz understood

knative-gitops-using-cloud-build

preprocessd

Simple example showing how to use Cloud Run to pre-process raw events from PubSub and publish them to new topic.

daprme

New app wizard for creation of a new Dapr project. Including Dapr component selection and app scaffolding of a new app based on user choices.

buttons

How to use Flic buttons with Clud Run on GCP

knative-route-demo

Simple knative route demo

github-bigquery-exporter

GitHub BigQuery Export Utility

Service scaling recommendation based on Kubernetes metric and event stream using Cloud Run, Cloud PubSub, Cloud Dataflow, and BigQuery ML

kadvice

maxprime

UI and REST service demo calculating highest prime number up to the number specified by the user. Good for infrastructure scaling demo

dapr-grpc-service-template

Template project to jump start your Dapr development in Go for service that will be invoked by other services over gRPC

Software Delivery Shield demo illustrating end-to-end solution for secure software supply chain

sds-demo

Collection of Google Container and Artifact Registry workflows

artifact-events

git-ops

Continuous deployment demo using GitHub actions

sentimenter-ui

The UI portion of sentimenter

HTML

grpcme

Simple go gRPC service template

sentimenter

Example of long running process leveraging GCF and multiple back-end services (Go, Firestore, NLP, etc.)

timeseries-samples

A few samples of time-series data management using influxdb

JavaScript

gorunstarter

Simple GitHub repo template for Cloud Run project in go

Template project to jump start your Dapr development in Go for gRPC service that will be triggered by topic events

dapr-grpc-event-subscriber-template

Collection of simple GCP helpers

webcr

OCR for the Web

gcputil

stackdriver-notification-handler

Generic Stackdriver alert WebHook handler implemented in Cloud Run

Utility to mock events with configurable format, random metric range, and frequency

eventmaker

cloud-sql-for-cloud-run-example

Sample outlining a process of setting up Cloud SQL instance with secure (TLS) access that will work the same way from developer workstation as well as from within Cloud Run

Simple Broadcast/Echo service for Cloud Run designed to demonstrate authenticated inter-service connectivity and measure latency between the different regions where this service is deployed.

distributed-echo

knative-build-status-notifs

Cloud Build status notifications on Knative

stockersrc

Twitter data source container executing in GCE VM

rester-tester

Rest server to test serverless usage patterns

eventstore

Knative CloudEvents Firestore Archiver

dapr-tracing-demo

Dapr tracing demo

sbominator

Custom Google Cloud Build step to crate a Software Bill of Materials (SBOM) and Binary Authorization attestation.

Logo identification microservice using Knative & Google Vision API

klogo

dctl

simple utility to provide insight into repo activity

custom-metrics

How to use Stackdriver to monitor custom application metrics

ktest

Simple test app for Knative deployments

twfeel

On-demand Twitter topic sentiment provider

oidc-for-gcp-using-terraform

Reproducible Github Workflow OpenID Connect for GCP using Terraform

The types that make thingz connect

thingz-commons

kdemo

Knative Microservice Demo - UI

kpush

Demo of signed message push from PubSub to Knative service

tadd

Utility for quick adding Todoist tasks

ghme

Alfred workflow for navigating to repositories.

app-portability-using-dapr

Demo repo showcasing ease of porting apps and their dependencies across different compute environments

ns-label-operator

Watches Kubernetes namespaces and applies pre-configured YAML when specific label is applied to a namespace.

tweet-provider

Cloud Run Twitter search service, configured with service account identity, invoked by Cloud Scheduler, and persisting query state across invocations in Firestore. This service also publishes search results to Cloud PubSub for further consumption downstream, and records its tweet throughput as custom metrics in Stackdriver.

dapr-http-cron-handler-template

Template project to jump start your Dapr development in Go for service that will be executed on schedule (cron)

Stream processing using Cloud PubSub and Dataflow SQL in BigQuery

xstreams

snip

CLI to manage your snippets

pubsub-event-maker

Simple utility to stream mocked events into Google Cloud PubSub

stockermart

Cloud Functions Stock market price downloader to BigQuery using Cloud Scheduler and Cloud PubSub

ab-test-demo

Simple A/B testing on Cloud Run

CSS

artomator

Automates creation of Software Bill of Materials (SBOM) with Binary Authorization attestation for container images in Artifact Registry.

helm-charts

Helm charts by Mark Chmarny

BigQuery automatic model rebuild based on r2 score deviation

automodel

Simple gRPC service with HTTP extension based on a proto API definition. Includes deployment to Kubernetes and ingress configuration with TLS certificates.

grpc-lab

gh2csv

Collection of scripts to export GitHub data into CSV

Simple dapr HTTP client library

godapr

grpc-sample

Sample gRPC service on Cloud Run

kuser

User store microservice using Knative & Google Firestore

ktweet

Knative Twitter Source

pgxmap

Go library to handle interface types when JSONB serialized in PostgreSQL

sbomer

Generates daily SBOM and vulnerability reports for container images and saves resulting files into GCS bucket and data into BigQuery tables.

Template project to jump start your Dapr development in Go for HTTP service that will be triggered by topic events

cli

CLI Template

dapr-http-event-subscriber-template

Basic Google OAuth2 implementation with Cloud Firestore persistence - part of microservice patterns on Knative

gauther

mqtt-pub-sub-demo

Simple MQTT pub/sub demo using mosquitto broker

Redis-based queue event source for Knative

kres

ktranslate

Knative translation service

cluster-up

Series of scripts I use to reliably deploy, configure, and test GKE cluster based demos