• This repository has been archived on 02/Sep/2024
  • Stars
    star
    326
  • Rank 129,027 (Top 3 %)
  • Language
    Go
  • License
    Apache License 2.0
  • Created almost 4 years ago
  • Updated almost 3 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

In ur kubernetes, buildin ur imagez

kim - The Kubernetes Image Manager

STATUS: EXPERIMENT - Let us know what you think

This project is a continuation of the experiment started with k3c, however, unlike the original aim/design for k3c, it IS NOT meant to be a replacement or re-build of the containerd/CRI.

kim is a Kubernetes-aware CLI that will install a small builder backend consisting of a BuildKit daemon bound to the Kubelet's underlying containerd socket (for building images) along with a small server-side agent that the CLI leverages for image management (think push, pull, etc) rather than talking to the backing containerd/CRI directly. kim enables building images locally, natively on your k3s cluster.

A familiar UX

There really is nothing better than the classic Docker UX of build/push/pull/tag. This tool copies the same UX as classic Docker (think Docker v1.12). The intention is to follow the same style but not be a 100% drop in replacement. Behaviour and arguments have been changed to better match the behavior of the Kubernetes ecosystem.

A single binary

kim, similar to k3s and old school docker, is packaged as a single binary, because nothing is easier for distribution than a static binary.

Built on Kubernetes Tech (and others)

Fundamentally kim is a built on the Container Runtime Interface (CRI), containerd, and buildkit.

Architecture

kim enables building k3s-local images by installing a DaemonSet Pod that runs both buildkitd and kim agent and exposing the gRPC endpoints for these active agents in your cluster via a Service. Once installed, the kim CLI can inspect your installation and communicate with the backend daemons for image building and manipulation with merely the KUBECONFIG that was available when installing the builder. When building kim will talk directly to the buildkit service but all other interactions with the underlying containerd/CRI are mediated by the kim agent (primarily because the containerd "smart client" code assumes a certain level of co-locality with the containerd installation).

Building

# more to come on this front but builds are currently a very manual affair
# git clone --branch=main https://github.com/rancher/kim.git ~/Projects/rancher/kim
# cd ~/Projects/rancher/kim
go generate # only necessary when modifying the gRPC protobuf IDL, see Dockerfile for pre-reqs
make ORG=<your-dockerhub-org> build publish

Running

Have a working k3s installation with a working $HOME/.kube/config or $KUBECONFIG, then:

# Installation on a single-node cluster is automatic
# Installation on a multi-node cluster, targeting a Node named "my-builder-node"
kim builder install --selector k3s.io/hostname=my-builder-node

kim currently works against a single builder Node so you must specify a narrow selector when installing on multi-node clusters. Upon successful installation this node will acquire the "builder" role.

Build images like you would with the Docker CLI:

$ ./bin/kim --help
Kubernetes Image Manager -- in ur kubernetes buildin ur imagez

Usage:
  kim [OPTIONS] COMMAND
  kim [command]

Examples:
  kim image build --tag your/image:tag .

Available Commands:
  builder     Manage Builder(s)
  help        Help about any command
  image       Manage Images

Images Shortcuts:
  build       Build an image
  images      List images
  pull        Pull an image
  push        Push an image
  rmi         Remove an image
  tag         Tag an image

Flags:
  -x, --context string      kubeconfig context for authentication
      --debug               
      --debug-level int     
  -h, --help                help for kim
  -k, --kubeconfig string   kubeconfig for authentication
  -n, --namespace string    namespace (default "kube-image")
  -v, --version             version for kim

Use "kim [command] --help" for more information about a command.

Roadmap

  • Automated functional/integration tests to be invoked from CI to catch/prevent regressions.
  • Image export/import, save/load functionality.
  • Smarter automatic-ish bootstrap for non-k3s installations (think EKS support)
  • Scheduling image content to non-builder (or simply, other) nodes in the cluster

License

Copyright (c) 2020-2021 Rancher Labs, Inc.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

More Repositories

1

rancher

Complete container management platform
Go
23,193
star
2

os

Tiny Linux distro that runs the entire OS as Docker containers
Go
6,437
star
3

k3os

Purpose-built OS for Kubernetes, fully managed by Kubernetes.
Go
3,403
star
4

rke

Rancher Kubernetes Engine (RKE), an extremely simple, lightning fast Kubernetes distribution that runs entirely within containers.
Go
3,197
star
5

rio

Application Deployment Engine for Kubernetes
Go
2,282
star
6

local-path-provisioner

Dynamically provisioning persistent local storage with Kubernetes
Go
2,138
star
7

fleet

Deploy workloads from Git to large fleets of Kubernetes clusters
Go
1,514
star
8

convoy

A Docker volume plugin, managing persistent container volumes.
Go
1,308
star
9

rke2

Go
1,028
star
10

old-vm

(OBSOLETE) Package and Run Virtual Machines as Docker Containers
Go
646
star
11

ui

Rancher UI
JavaScript
598
star
12

cattle

Infrastructure orchestration engine for Rancher 1.x
Java
574
star
13

k3c

Lightweight local container engine for container development
Go
571
star
14

system-upgrade-controller

In your Kubernetes, upgrading your nodes
Go
502
star
15

dashboard

The Rancher UI
Vue
449
star
16

charts

Github based Helm Chart Index Repository providing charts crafted for Rancher Manager
Smarty
389
star
17

community-catalog

Catalog entries contributed by the community
Smarty
384
star
18

install-docker

Scripts for docker-machine to install a particular docker version
Shell
370
star
19

dapper

Docker build wrapper
Go
358
star
20

quickstart

HCL
357
star
21

terraform-provider-rke

Terraform provider plugin for deploy kubernetes cluster by RKE(Rancher Kubernetes Engine)
Go
340
star
22

opni

Multi Cluster Observability with AIOps
Go
334
star
23

cli

Rancher CLI
Go
331
star
24

trash

Minimalistic Go vendored code manager
Go
296
star
25

elemental

Elemental is an immutable Linux distribution built to run Rancher and its corresponding Kubernetes distributions RKE2 and k3s. It is built using the Elemental-toolkit
Go
295
star
26

terraform-controller

Use K8s to Run Terraform
Go
292
star
27

elemental-toolkit

❄️ The toolkit to build, ship and maintain cloud-init driven Linux derivatives based on container images
Go
272
star
28

remotedialer

HTTP in TCP in Websockets in HTTP in TCP, Tunnel all the things!
Go
255
star
29

terraform-provider-rancher2

Terraform Rancher2 provider
Go
222
star
30

rancher-compose

Docker compose compatible client to deploy to Rancher
Go
214
star
31

wrangler

Write controllers like a boss
Go
205
star
32

os-vagrant

Ruby
176
star
33

k3k

Kubernetes in Kubernetes
Go
163
star
34

rancher-cleanup

Shell
160
star
35

rancher-catalog

Smarty
155
star
36

docs

Documentation for Rancher products (for 2.0/new site)
SCSS
140
star
37

fleet-examples

Fleet usage examples
Shell
140
star
38

catalog-dockerfiles

Dockerfiles for Rancher Catalog containers
Shell
131
star
39

api-spec

Specification for Rancher REST API implementation
121
star
40

k8s-intro-training

HTML
114
star
41

ansible-playbooks

Rancher 1.6 Installation. Doesn't support Rancher 2.0
Python
113
star
42

sherdock

Docker Image Manager
JavaScript
110
star
43

norman

APIs on APIs on APIs
Go
108
star
44

docker-from-scratch

Tiny Docker in Docker
Go
105
star
45

backup-restore-operator

Go
99
star
46

lb-controller

Load Balancer for Rancher services via ingress controllers backed up by a Load Balancer provider of choice
Go
97
star
47

pipeline

Go
96
star
48

container-crontab

Simple cron runner for containers
Go
88
star
49

terraform-modules

Rancher Terraform Modules
HCL
85
star
50

system-charts

Replaced by rancher/charts. The deprecation process is in progress.
Mustache
84
star
51

os2

EXPERIMENTAL: A Rancher and Kubernetes optimized immutable Linux distribution based on openSUSE
Go
82
star
52

cluster-api-provider-rke2

RKE2 bootstrap and control-plane Cluster API providers.
Go
81
star
53

vagrant

Vagrant file to stand up a Local Rancher install with 3 nodes
Shell
79
star
54

rancher-dns

A simple DNS server that returns different answers depending on the IP address of the client making the request
Go
79
star
55

giddyup

Go
78
star
56

kontainer-engine

Provisioning kubernetes cluster at ease
Go
78
star
57

go-rancher

Go language bindings for Rancher API
Go
74
star
58

go-skel

Skeleton for Rancher Go Microservices
Shell
71
star
59

runc-cve

CVE patches for legacy runc packaged with Docker
Dockerfile
69
star
60

terraform-k3s-aws-cluster

HCL
67
star
61

agent

Shell
64
star
62

kontainer-driver-metadata

This repository is to keep information of k8s versions and their dependencies like k8s components flags and system addons images.
Go
63
star
63

external-dns

Service updating external DNS with Rancher services records for Rancher 1.6
Go
63
star
64

terraform-provider-rancher2-archive

[Deprecated] Use https://github.com/terraform-providers/terraform-provider-rancher2
Go
62
star
65

gitjob

Go
59
star
66

types

Rancher API types
Go
59
star
67

rancher-docs

Rancher Documentation
JavaScript
58
star
68

rancher.github.io

HTML
58
star
69

ui-driver-skel

Skeleton Rancher UI driver for custom docker-machine drivers
JavaScript
58
star
70

rke2-charts

Shell
56
star
71

os-services

RancherOS Service Compose Templates
Shell
54
star
72

turtles

Rancher CAPI extension
Go
50
star
73

client-python

A Python client for Rancher APIs
Python
49
star
74

hyperkube

Rancher hyperkube images
48
star
75

partner-charts

A catalog based on applications from independent software vendors (ISVs). Most of them are SUSE Partners.
Smarty
47
star
76

rancher-cloud-controller-manager

A kubernetes cloud-controller-manager for the rancher cloud
Go
44
star
77

steve

Kubernetes API Translator
Go
43
star
78

rodeo

Smarty
43
star
79

cluster-template-examples

43
star
80

cis-operator

Go
43
star
81

rancherd

Bootstrap Rancher and k3s/rke2
Go
42
star
82

10acre-ranch

Build Rancher environment on GCE
Shell
41
star
83

elemental-operator

The Elemental operator is responsible for managing the OS versions and maintaining a machine inventory to assist with edge or baremetal installations.
Go
41
star
84

secrets-bridge

Go
40
star
85

storage

Rancher specific storage plugins
Shell
39
star
86

k8s-sql

Storage backend for Kubernetes using Go database/sql
Go
37
star
87

lasso

Low level generic controller framework
Go
36
star
88

server-chart

[Deprecated] Helm chart for Rancher server
Shell
36
star
89

os-packer

Shell
36
star
90

pipeline-example-go

Go
36
star
91

system-tools

This repo is for tools helping with various cleanup tasks for rancher projects. Example: rancher installation cleanup
Go
35
star
92

rancher-metadata

A simple HTTP server that returns EC2-style metadata information that varies depending on the source IP address making the request.
Go
31
star
93

os-base

Base file system for RancherOS images
Shell
31
star
94

image-mirror

Shell
31
star
95

websocket-proxy

Go
29
star
96

rke-tools

Tools container for supporting functions in RKE
Go
29
star
97

gdapi-python

Python Binding to API spec
Python
28
star
98

wins

Windows containers connect to Windows host
Go
28
star
99

api-ui

Embedded UI for any service that implements the Rancher API spec
JavaScript
27
star
100

migration-tools

Go
27
star