• Stars
    star
    208
  • Rank 182,099 (Top 4 %)
  • Language
    Go
  • License
    Apache License 2.0
  • Created over 3 years ago
  • Updated 22 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

The serverless framework purpose-built for event streaming applications.

Function-Mesh

A Kubernetes-Native way to run pulsar functions, connectors and composed function meshes.

Install

curl -sSL https://github.com/streamnative/function-mesh/releases/download/v0.14.0/install.sh | bash

The above command installs all the CRDs, required service account configuration, and all function-mesh operator components. Before you start running a function-mesh example, verify if Function Mesh is installed correctly.

Note:

install.sh is suitable for trying Function Mesh out. If you want to use Function Mesh in production or other serious scenarios, Helm is the recommended deployment method.

Prerequisite

Compatibility

Kubernetes compatibility matrix

This table outlines the supported Kubernetes versions. We have tested these versions in their respective branches. But note that other versions might work as well.

Function Mesh operator Kubernetes 1.19 Kubernetes 1.20 Kubernetes 1.21 Kubernetes 1.22 Kubernetes 1.23 Kubernetes 1.24 Kubernetes 1.25
v0.14.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.13.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.12.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.11.2 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.10.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.9.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.8.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
v0.7.0 ✔ ✔ ✔ ✔ ✔ ✔ ✔
Master ✔ ✔ ✔ ✔ ✔ ✔ ✔

Development

  • install Git and download the repo
git clone https://github.com/streamnative/function-mesh.git
  • install operator-sdk and use it to add CRD, controller or webhooks

Note

The following command will generate the scaffolding files in the api/<version>/ path, in this case api/v1alpha1, and then you need to move the files contained in it to the api/<group>/<version> directory manually, in this case api/compute/v1alpha1.

operator-sdk create api --group compute --version v1alpha1 --kind Function --resource=true --controller=true
operator-sdk create webhook --group compute.functionmesh.io --version v1alpha1 --kind Function --defaulting --programmatic-validation

Deployment

  1. make sure connected to a kubernetes cluster(gke, mini-kube etc.)
    gcloud container clusters get-credentials cluster-1 --region $CLUSTER_REGION --project $PROJECT_ID
  2. compile the repo to generate related resources in the root dir of the repo.
    make generate
  3. install the CRD into your k8s cluster.
    make install
  4. start the controller locally. Only the controller itself is running in your local terminal, all the resources will be running inside the connected kubernetes cluster
    make run
  5. submit a sample CRD to the cluster. You can also submit other CRDs under the ./config/samples directory
    kubectl apply -f config/samples/compute_v1alpha1_function.yaml
  6. verify your submission with kubectl, and you will see the function pod is running
    $ kubectl get all
    NAME                                READY   STATUS      RESTARTS   AGE
    pod/function-sample-0               1/1     Running     0          77s
  7. in order for function actually work, you need to have a pulsar cluster available for visiting. you can use the helm-chart to deploy one

More Repositories

1

kop

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
Java
445
star
2

pulsar-flink

Elastic data processing with Apache Pulsar and Apache Flink
Java
279
star
3

oxia

Oxia - Metadata store and coordination system
Go
186
star
4

mop

MQTT on Pulsar implemented using Pulsar Protocol Handler
Java
163
star
5

pulsarctl

a CLI for Apache Pulsar written in Go
Go
144
star
6

aop

AMQP on Pulsar protocol handler
Java
110
star
7

pulsar-spark

Spark Connector to read and write with Pulsar
Scala
109
star
8

tgip-cn

TGIP-CN (Thank God Its Pulsar) is a weekly live video streaming about Apache Pulsar in Chinese.
103
star
9

rop

RocketMQ-on-Pulsar - A protocol handler that brings native RocketMQ protocol to Apache Pulsar
Java
96
star
10

apache-pulsar-grafana-dashboard

Apache Pulsar Grafana Dashboard
Jinja
86
star
11

charts

StreamNative Helm Charts Repository: Apache Pulsar, Pulsar Operators, StreamNative Platform, Function Mesh
Smarty
82
star
12

awesome-pulsar

A curated list of Pulsar tools, integrations and resources.
78
star
13

pulsar-beat-output

Elastic Beats Output to Apache Pulsar
Go
54
star
14

examples

Apache Pulsar examples and demos
Java
51
star
15

terraform-provider-pulsar

Terraform provider for managing Apache Pulsar entities
Go
38
star
16

pulsar-io-cloud-storage

Cloud Storage Connector integrates Apache Pulsar with cloud storage.
Java
28
star
17

pulsar-resources-operator

Go
26
star
18

pulsar-io-lakehouse

pulsar lakehouse connector
Java
25
star
19

pulsar-io-kafka

Pulsar IO Kafka Connector
Java
24
star
20

pulsar-user-group-loc-cn

Workspace for China local user group.
22
star
21

pulsar-tracing

Tracing instrumentation for Apache Pulsar clients.
Java
20
star
22

pulsar-flume-ng-sink

An Apache Flume Sink implementation to publish data to Apache pulsar
Java
19
star
23

tgip

TGIP (TGI Pulsar) is a weekly live video streaming about Apache Pulsar and its ecosystem.
Shell
18
star
24

pulsar-hub

The canonical source of StreamNative Hub.
JavaScript
17
star
25

pulsar-admin-go

The Go library for pulsar admin operations, providing a unified Go API for managing pulsar resources such as tenants, namespaces and topics, etc.
Go
14
star
26

oxia-java

A Java client library for Oxia
Java
14
star
27

logstash-input-pulsar

Java
12
star
28

sn-platform

StreamNative Platform Downloads
12
star
29

terraform-helm-charts

HCL
11
star
30

streamnative-academy

Java
10
star
31

pulsar_weekly

Pulsar weekly community update
10
star
32

pulumi-controller-runtime

A prototype of a Kubernetes controller based on Pulumi.
Go
9
star
33

pulsar-recipes

A StreamNative library containing a collection of recipes that are implemented on top of the Pulsar client to provide higher-level functionality closer to the application domain.
Java
9
star
34

flink-example

Flink Pulsar Integration Related Examples
Java
9
star
35

logstash-output-pulsar

Logstash output plugin for pulsar
Java
8
star
36

function-mesh-worker-service

Java
7
star
37

pulsar-io-template

It is a project template for developing an Apache Pulsar connector
Java
7
star
38

pulsar-io-aws-lambda

Java
7
star
39

pulsar-io-amqp-1-0

support sink/source for AMQP version 1.0.0
Java
7
star
40

pulsar-delayed-message

Java
6
star
41

pulsar-io-pulsar-connector

Java
6
star
42

terraform-aws-cloud

Terraform modules for provisioning StreamNative Cloud on aws cloud
HCL
6
star
43

pulsar-io-activemq

ActiveMQ Connector integrates Apache Pulsar with Apache ActiveMQ.
Java
6
star
44

pulsar-io-huawei-function-graph-connector

Java
5
star
45

pulsar-io-huawei-dis

Pulsar IO connector for huawei DIS https://www.huaweicloud.com/en-us/product/dis.html
Java
5
star
46

homebrew-streamnative

StreamNative Homebrew Formulae
Ruby
5
star
47

pulsar-datadog

Apache Pulsar and Datadog integration.
5
star
48

pulsar-io-sqs

Java
5
star
49

pulsar-flink-patterns

Java
5
star
50

pulsar-io-google-pubsub

Java
5
star
51

psat_exercise_code

pulsar summit asia workshop execise code
Java
5
star
52

private-cloud

StreamNative Private Cloud is an enterprise product which brings specific controllers for Kubernetes by providing specific Custom Resource Definitions (CRDs).
Shell
4
star
53

terraform-aws-managed-cloud

This repo contains terraform scripts that can be used to provision resources needed for StreamNative Managed Cloud
HCL
4
star
54

community

StreamNative / Apache Pulsar ecosystem community
4
star
55

pulsar-tutorials

Shell
4
star
56

pulsar-io-iotdb

Data sink connector for IoTDB(https://github.com/apache/iotdb)
Java
4
star
57

pulsar-io-bigquery

BigQuery Connector integrates Apache Pulsar with Google BigQuery.
Java
3
star
58

function-mesh-website

Website for https://functionmesh.io/
JavaScript
3
star
59

pulsar-io-http-connector

Java
3
star
60

pulsar-io-snowflakedb

IO Connector for Snowflakedb
Java
2
star
61

terraform-managed-cloud

StreamNative Managed Cloud Vendor Access
HCL
2
star
62

pulsar-io-huawei-lts-connector

Java
2
star
63

sn-demos

Java
1
star
64

terraform-provider-streamnative

Terraform Provider for StreamNative
Go
1
star
65

pulsar-message-filter

1
star
66

pulsar-flink-state-migrate

pulsar flink state migrate tools
Java
1
star
67

kafka-migration

Collection of examples of Kafka apps using KoP
Java
1
star
68

skywalking-pulsar-demo

The demo program for Apache SkyWalking and Apache Pulsar integration
Java
1
star
69

snp-cn

The repo for StreamNative Platform Document Chinese Version.
1
star
70

terraform-google-cloud

Terraform modules for provisioning StreamNative Cloud on google cloud
HCL
1
star
71

pulsar-io-huawei-obs-connector

Java
1
star