• This repository has been archived on 06/Jul/2021
  • Stars
    star
    189
  • Rank 204,649 (Top 5 %)
  • Language
    Go
  • License
    Apache License 2.0
  • Created over 6 years ago
  • Updated over 3 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

An operator to fetch secrets from cloud services and inject them in Kubernetes

External Secret Operator

github actions Go Report Card codecov

This operator reads information from a third party service like AWS Secrets Manager or AWS SSM and automatically injects the values as Kubernetes Secrets.

Disclaimer ⚠️

This project will not be maintained anymore, and we are trying to concentrate afforts on this new colaboration:

external-secrets/external-secrets

Website: https://www.external-secrets.io/

Table of Contents

Features

  • Secrets are refreshed from time to time allowing you to rotate secrets in your providers and still keep everything up to date inside your k8s cluster.
  • Change the refresh interval of the secrets to match your needs. You can even make it 10s if you need to debug something (beware of API rate limits).
  • For the AWS Backend we support both simple secrets and binfiles.
  • You can get speciffic versions of the secrets or just get latest versions of them.
  • If you change something in your ExternalSecret CR, the operator will reconcile it (Even if your refresh interval is big).
  • AWS Secret Manager, Credstash (AWS KMS), Azure Key Vault, Google Secret Manager and Gitlab backends supported currently!

Quick start

Using Kustomize

Install the operator CRDs

  • Install CRDs
make install

What does it do?

Given a secret defined in AWS Secrets Manager:

% aws secretsmanager create-secret \
  --name=example-externalsecret-key \
  --secret-string='this string is a secret'

and updated aws credentials to be used in config/credentials/kustomization.yaml with valid AWS credentials:

%cat config/credentials/kustomization.yaml
resources:
# - credentials-gsm.yaml
- credentials-asm.yaml
# - credentials-dummy.yaml
# - credentials-gitlab.yaml
# - credentials-akv.yaml
%cat config/credentials/credentials-asm.yaml
...
credentials.json: |-
    {
      "accessKeyID": "AKIA...",
      "secretAccessKey": "cmFuZG9tS2VZb25Eb2Nz...",
      "sessionToken": "" 
    }

and an SecretStore resource definition like this one:

% cat config/samples/store_v1alpha1_secretstore.yaml
apiVersion: store.externalsecret-operator.container-solutions.com/v1alpha1
kind: SecretStore
metadata:
  name: secretstore-sample
spec:
  controller: staging
  store:
    type: asm
    auth: 
      secretRef: 
        name: externalsecret-operator-credentials-asm
    parameters:
      region: eu-west-2

and an ExternalSecret resource definition like this one:

% cat config/samples/secrets_v1alpha1_externalsecret.yaml
apiVersion: secrets.externalsecret-operator.container-solutions.com/v1alpha1
kind: ExternalSecret
metadata:
  name: externalsecret-sample
spec:
  storeRef: 
    name: externalsecret-operator-secretstore-sample
  data:
    - key: example-externalsecret-key
      version: latest

The operator fetches the secret from AWS Secrets Manager and injects it as a secret:

% make deploy
% kubectl get secret externalsecret-operator-externalsecret-sample -n externalsecret-operator-system \
  -o jsonpath='{.data.example-externalsecret-key}' | base64 -d
this string is a secret

Architecture

In this article you can find more information about the architecture and design choices.

Here's a high-level diagram of how things are put together.

architecture

Running tests

Requirements:

  • Golang 1.15 or later
  • Kubebuilder installed at /usr/local/kubebuilder

Then just:

make test

CRDs Spec

Other Supported Backends

We would like to support as many backends as possible and it should be rather easy to write new ones. Currently supported backends are:

Provider Backend Doc
AWS Secrets Manager Info AWS Secrets Manager Backend Docs
Credstash Info Credstash (AWS KMS) Docs
GCP Secret Manager Info GCP Secret Manager Backend Docs
Gitlab CI/CD Variables Info Gitlab CI/CD Variables Backend Docs
Azure Key Vault Info Azure Key Vault Backend Docs

Contributing

Yay! We welcome and encourage contributions to this project!

See our contributing document and Issues for planned improvements and additions.

More Repositories

1

k8s-deployment-strategies

Kubernetes deployment strategies explained
Go
3,504
star
2

kubernetes-examples

Minimal self-contained examples of standard Kubernetes features and patterns in YAML
Shell
1,394
star
3

trow

Container Registry and Image Management for Kubernetes Clusters
Rust
808
star
4

minimesos

The experimentation and testing tool for Apache Mesos - NO LONGER MAINTANED!
Java
431
star
5

helm-monitor

Monitor K8S Helm release, rollback on metrics behavior (Prometheus, Elasticsearch, Sentry)
Go
409
star
6

helm-convert

Convert Helm charts into Kustomize compatible package
Go
215
star
7

terraform-examples

Simple and idiomatic examples of various Terraform functions and features.
HCL
160
star
8

runbooks

A collection of step by step guides for fixing common tech problems.
HTML
129
star
9

ImageWolf

Fast Distribution of Docker Images on Clusters
Go
128
star
10

locust_exporter

A Locust metrics exporter for Prometheus
Go
108
star
11

terraform-mesos

Stuff for programming a Mesos cluster on the Google Cloud
Shell
98
star
12

prometheus-swarm-discovery

This is a POC for Prometheus service discovery on Docker Swarm
Go
76
star
13

registry-tooling

Install a secure Docker registry on any Kubernetes cluster with a single command
Shell
70
star
14

cd_demo

Demo for a full (almost) CD pipeline with git, jenkins, docker, mesos
Shell
65
star
15

prom-metrics-check

Python
64
star
16

tinkerbell-rpi4-workflow

Instructions and configuration files to create tinkerbell workflow for raspberry pi 4
Shell
50
star
17

cd-with-docker-tutorial

Continuous Integration and Delivery with Docker
Go
50
star
18

docker-cobbler

Cobbler in a Docker container
Makefile
49
star
19

mesos-starter

Java
46
star
20

docker-registry-proxy

Docker Registry 2.0 proxy with SSL and authentication
Shell
31
star
21

stackdriver-gke-custom-metrics

Example python code sending custom container metrics to Stackdriver Monitoring
Python
23
star
22

dcos-in-triton

Infrastructure setup for running DCOS in Joyent's Triton
Python
21
star
23

terraform-provider-cobbler

Terraform provider for Cobbler
Go
18
star
24

capabilities-blog

Code supporting capabilities blog
C
18
star
25

terraform-nomad

Terraform scripts for creating a Nomad cluster on Google Cloud.
HCL
16
star
26

zookeeper

Zookeeper with dynamic host reconfiguration
Shell
16
star
27

cloud-native-patterns

Cloud Native Patterns
HTML
14
star
28

learning-mesos-with-minimesos-workshop

13
star
29

mesos-hello-world

Very simple hello world mesos framework to demonstrate mini-mesos
Java
12
star
30

construct

Mesos framework for deploying a single task on all agents of the cluster
Python
11
star
31

mesosframework

Create a mesos framework with just an application.properties file!
Java
11
star
32

unifi-fargate

Deploy a Unifi Controller on AWS ECS Fargate using Terraform
HCL
11
star
33

pactbroker_exporter

A Pact Broker metrics exporter for Prometheus
Go
10
star
34

php-k8s

PHP on Kubernetes
PHP
9
star
35

delayed-jobs-operator

Go
9
star
36

terraform-provider-template

Skeleton for building a Terraform provider
Go
8
star
37

kubernetes-federation-demo

Demo setup for Kubernetes Cluster Federation
Go
8
star
38

redis-cluster-operator

A Kubernetes Operator for running Production Redis Clusters
Go
7
star
39

mesos-local

Mesos cluster in a container. Used by Mini-Mesos https://github.com/ContainerSolutions/mini-mesos
Groovy
7
star
40

k8shserver

Shell
7
star
41

cobblerclient

Cobbler Client written in Go
Go
7
star
42

kubadm-ansible

Ansible scripts to create & destroy a Kubernetes cluster using kubeadm
7
star
43

gitops-training-lab

Shell
7
star
44

timber

Timber - The Training Companion App
Python
7
star
45

dockerfiles

Dockerfile
6
star
46

kubernetes-demo

Go
6
star
47

minimesos-docker

minimesos Docker images
Shell
6
star
48

keda-kafka

This repo contains everything to create a demo where you can scale Kafka consumers depending on the queue size on a Kafka Topic from scratch.
Shell
6
star
49

k8sbhw

Kubernetes beyond hello world
Go
5
star
50

reveal-md

A CS themed version of Reveal-MD running on Alpine in a Docker Container
CSS
5
star
51

bootstrap-habitat-supervisors-on-k8s

Bootstrap habitat supervisors on top of kubernetes
Ruby
5
star
52

argus-gephi-connector

Argus with Gephi integrated together to get real-time visualisation of infrastructure
Python
5
star
53

helm-charts

A barebone Helm Chart repository
Smarty
5
star
54

habitat-redis-ha-cluster-on-k8s

Run a self organizing HA redis cluster on top of k8s.
Shell
5
star
55

go-validation-admission-controller

Demo implemention of a validation admission controller webhook
Go
5
star
56

dcos-ansible-packet

Ansible playbook for installing DC/OS on Packet cloud
Python
4
star
57

node-hack

A vulnerable nodejs application for hollywood-style hacking demos
JavaScript
4
star
58

bookinfo

Go
4
star
59

go-example-webserver

Example Go Webserver for training purposes
Groovy
4
star
60

ws-production-grade-kubernetes

Materials for the Production Grade Kubernetes workshop
Go
4
star
61

goto-prometheus

HTML
4
star
62

lean-go-containers

Example code for the blog post on building lean go containers using Docker multi-stage builds, which went stable in docker 17.06.
Go
4
star
63

kong-demo

A repo that will demonstrate some of the functionality of the kong ingress
Makefile
4
star
64

ha-redis-kubernetes

Manual Redis HA in Kubernetes with Zero Downtime updates and upgrades
Python
4
star
65

ws-kubernetes-essentials-app

HTML
3
star
66

saferun

run binaries with encrypted environment variables
Go
3
star
67

minimesos.org

minimesos.org
HTML
3
star
68

operator-workshop

Go
3
star
69

minimesos-mdns

Service for publishing minimesos containers via mdns
JavaScript
3
star
70

nixpkgs-overlay

Overlay for fun and profit
Nix
3
star
71

minimesos-maven-plugin

A Maven plugin for minimesos. Control your minimesos cluster from Maven
Java
3
star
72

k8s-federation-demo

demo app to demonstrate Kubernetes cluster federation
JavaScript
3
star
73

loki-grafana-promtail-k8s

3
star
74

codeship-docker-compose-examples

HTML
2
star
75

pres-prereq-to-docker

JavaScript
2
star
76

API-Excercise

The Container Solutions API Exercise Version 2.0
Python
2
star
77

jMeter-docker

dockerised jMeter
Shell
2
star
78

distributed-secrets

Go
2
star
79

kubernetes-cheatsheet

Cheatsheet with useful Kubernetes commands or tools
2
star
80

marathon-haproxy-subdomain-bridge

Go
2
star
81

kubernetes-deployment-tools

Docker image with a series of tools intended at Kubernetes deployments
Dockerfile
2
star
82

warsaw-workshop

repository to share with workshop participants
2
star
83

maturity-matrix

Maturity Matrix
JavaScript
2
star
84

template-spring-boot

Template for a Spring boot project
Java
2
star
85

space-oddity

Drone project
JavaScript
2
star
86

avazacli

Generated avaza API client
Python
2
star
87

external-secrets-charm

Python
2
star
88

ws-k8s-foundation-sample-app

HTML
2
star
89

gcp-billing-csv

DB to store billing csv data from GCP in Postgres so it can be queried using SQL
Shell
2
star
90

toolset

CSS
1
star
91

google-cloud-cli

Container image with tools for interacting with the Google Cloud and Kubernetes
Makefile
1
star
92

kuberviz

Semantically visualize your Kubernetes cluster
JavaScript
1
star
93

geoserver

HTML
1
star
94

python-application-operator

Python
1
star
95

sandbox-weave-net-minimesos

Experiment to run Weave Net inside minimesos
Shell
1
star
96

libmesos

1
star
97

node-openshift-sample

JavaScript
1
star
98

WheelOfFortune

Python
1
star
99

techterrarium

A controlled environment for nurturing and observing tech experiments.
1
star
100

go-utils

Utils library for Go
Go
1
star