• Stars
    star
    210
  • Rank 187,585 (Top 4 %)
  • Language
    Go
  • License
    Apache License 2.0
  • Created about 4 years ago
  • Updated 2 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

The serverless framework purpose-built for event streaming applications.

Function-Mesh

A Kubernetes-Native way to run pulsar functions, connectors and composed function meshes.

Install

curl -sSL https://github.com/streamnative/function-mesh/releases/download/v0.14.0/install.sh | bash

The above command installs all the CRDs, required service account configuration, and all function-mesh operator components. Before you start running a function-mesh example, verify if Function Mesh is installed correctly.

Note:

install.sh is suitable for trying Function Mesh out. If you want to use Function Mesh in production or other serious scenarios, Helm is the recommended deployment method.

Prerequisite

Compatibility

Kubernetes compatibility matrix

This table outlines the supported Kubernetes versions. We have tested these versions in their respective branches. But note that other versions might work as well.

Function Mesh operator Kubernetes 1.19 Kubernetes 1.20 Kubernetes 1.21 Kubernetes 1.22 Kubernetes 1.23 Kubernetes 1.24 Kubernetes 1.25
v0.14.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.13.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.12.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.11.2 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.10.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.9.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.8.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.7.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
Master ✔ ✔ ✔ ✔ ✔ ✔ ✔

Development

  • install Git and download the repo
git clone https://github.com/streamnative/function-mesh.git
  • install operator-sdk and use it to add CRD, controller or webhooks

Note

The following command will generate the scaffolding files in the api/<version>/ path, in this case api/v1alpha1, and then you need to move the files contained in it to the api/<group>/<version> directory manually, in this case api/compute/v1alpha1.

operator-sdk create api --group compute --version v1alpha1 --kind Function --resource=true --controller=true
operator-sdk create webhook --group compute.functionmesh.io --version v1alpha1 --kind Function --defaulting --programmatic-validation

Deployment

  1. make sure connected to a kubernetes cluster(gke, mini-kube etc.)
    gcloud container clusters get-credentials cluster-1 --region $CLUSTER_REGION --project $PROJECT_ID
  2. compile the repo to generate related resources in the root dir of the repo.
    make generate
  3. install the CRD into your k8s cluster.
    make install
  4. start the controller locally. Only the controller itself is running in your local terminal, all the resources will be running inside the connected kubernetes cluster
    make run
  5. submit a sample CRD to the cluster. You can also submit other CRDs under the ./config/samples directory
    kubectl apply -f config/samples/compute_v1alpha1_function.yaml
  6. verify your submission with kubectl, and you will see the function pod is running
    $ kubectl get all
    NAME                                READY   STATUS      RESTARTS   AGE
    pod/function-sample-0               1/1     Running     0          77s
  7. in order for function actually work, you need to have a pulsar cluster available for visiting. you can use the helm-chart to deploy one

More Repositories

1

kop

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
Java
450
star
2

pulsar-rs

Rust Client library for Apache Pulsar
Rust
358
star
3

pulsar-flink

Elastic data processing with Apache Pulsar and Apache Flink
Java
278
star
4

oxia

Oxia - Metadata store and coordination system
Go
203
star
5

mop

MQTT on Pulsar implemented using Pulsar Protocol Handler
Java
170
star
6

pulsarctl

a CLI for Apache Pulsar written in Go
Go
152
star
7

aop

AMQP on Pulsar protocol handler
Java
114
star
8

pulsar-spark

Spark Connector to read and write with Pulsar
Scala
111
star
9

tgip-cn

TGIP-CN (Thank God Its Pulsar) is a weekly live video streaming about Apache Pulsar in Chinese.
105
star
10

rop

RocketMQ-on-Pulsar - A protocol handler that brings native RocketMQ protocol to Apache Pulsar
Java
98
star
11

apache-pulsar-grafana-dashboard

Apache Pulsar Grafana Dashboard
Jinja
89
star
12

charts

StreamNative Helm Charts Repository: Apache Pulsar, Pulsar Operators, StreamNative Platform, Function Mesh
Smarty
82
star
13

awesome-pulsar

A curated list of Pulsar tools, integrations and resources.
79
star
14

pulsar-beat-output

Elastic Beats Output to Apache Pulsar
Go
55
star
15

examples

Apache Pulsar examples and demos
Java
52
star
16

terraform-provider-pulsar

Terraform provider for managing Apache Pulsar entities
Go
42
star
17

pulsar-resources-operator

Go
30
star
18

pulsar-io-lakehouse

pulsar lakehouse connector
Java
28
star
19

pulsar-io-cloud-storage

Cloud Storage Connector integrates Apache Pulsar with cloud storage.
Java
27
star
20

pulsar-io-kafka

Pulsar IO Kafka Connector
Java
24
star
21

pulsar-user-group-loc-cn

Workspace for China local user group.
22
star
22

pulsar-tracing

Tracing instrumentation for Apache Pulsar clients.
Java
21
star
23

pulsar-flume-ng-sink

An Apache Flume Sink implementation to publish data to Apache pulsar
Java
20
star
24

pulsar-hub

The canonical source of StreamNative Hub.
JavaScript
18
star
25

tgip

TGIP (TGI Pulsar) is a weekly live video streaming about Apache Pulsar and its ecosystem.
Shell
18
star
26

oxia-java

A Java client library for Oxia
Java
17
star
27

pulsar-admin-go

The Go library for pulsar admin operations, providing a unified Go API for managing pulsar resources such as tenants, namespaces and topics, etc.
Go
15
star
28

logstash-input-pulsar

Java
13
star
29

sn-platform

StreamNative Platform Downloads
12
star
30

streamnative-academy

Java
11
star
31

logstash-output-pulsar

Logstash output plugin for pulsar
Java
11
star
32

terraform-helm-charts

HCL
11
star
33

pulsar-recipes

A StreamNative library containing a collection of recipes that are implemented on top of the Pulsar client to provide higher-level functionality closer to the application domain.
Java
11
star
34

pulsar_weekly

Pulsar weekly community update
10
star
35

pulumi-controller-runtime

A prototype of a Kubernetes controller based on Pulumi.
Go
9
star
36

flink-example

Flink Pulsar Integration Related Examples
Java
9
star
37

function-mesh-worker-service

Java
7
star
38

pulsar-io-amqp-1-0

support sink/source for AMQP version 1.0.0
Java
7
star
39

pulsar-io-template

It is a project template for developing an Apache Pulsar connector
Java
7
star
40

pulsar-io-aws-lambda

Java
7
star
41

pulsar-delayed-message

Java
6
star
42

pulsar-io-pulsar-connector

Java
6
star
43

terraform-aws-cloud

Terraform modules for provisioning StreamNative Cloud on aws cloud
HCL
6
star
44

pulsar-io-activemq

ActiveMQ Connector integrates Apache Pulsar with Apache ActiveMQ.
Java
6
star
45

pulsar-io-huawei-function-graph-connector

Java
5
star
46

private-cloud

StreamNative Private Cloud is an enterprise product which brings specific controllers for Kubernetes by providing specific Custom Resource Definitions (CRDs).
Shell
5
star
47

pulsar-io-huawei-dis

Pulsar IO connector for huawei DIS https://www.huaweicloud.com/en-us/product/dis.html
Java
5
star
48

homebrew-streamnative

StreamNative Homebrew Formulae
Ruby
5
star
49

pulsar-datadog

Apache Pulsar and Datadog integration.
5
star
50

pulsar-io-sqs

Java
5
star
51

pulsar-flink-patterns

Java
5
star
52

pulsar-io-google-pubsub

Java
5
star
53

psat_exercise_code

pulsar summit asia workshop execise code
Java
5
star
54

terraform-aws-managed-cloud

This repo contains terraform scripts that can be used to provision resources needed for StreamNative Managed Cloud
HCL
4
star
55

community

StreamNative / Apache Pulsar ecosystem community
4
star
56

pulsar-tutorials

Shell
4
star
57

pulsar-io-iotdb

Data sink connector for IoTDB(https://github.com/apache/iotdb)
Java
4
star
58

pulsar-io-bigquery

BigQuery Connector integrates Apache Pulsar with Google BigQuery.
Java
3
star
59

function-mesh-website

Website for https://functionmesh.io/
JavaScript
3
star
60

pulsar-io-http-connector

Java
3
star
61

terraform-managed-cloud

StreamNative Managed Cloud Vendor Access
HCL
2
star
62

pulsar-io-huawei-lts-connector

Java
2
star
63

pulsar-io-snowflakedb

IO Connector for Snowflakedb
Java
2
star
64

sn-demos

Java
1
star
65

terraform-provider-streamnative

Terraform Provider for StreamNative
Go
1
star
66

pulsar-message-filter

1
star
67

pulsar-flink-state-migrate

pulsar flink state migrate tools
Java
1
star
68

skywalking-pulsar-demo

The demo program for Apache SkyWalking and Apache Pulsar integration
Java
1
star
69

kafka-migration

Collection of examples of Kafka apps using KoP
Java
1
star
70

snp-cn

The repo for StreamNative Platform Document Chinese Version.
1
star
71

terraform-google-cloud

Terraform modules for provisioning StreamNative Cloud on google cloud
HCL
1
star
72

pulsar-io-huawei-obs-connector

Java
1
star