• Stars
    star
    253
  • Rank 160,776 (Top 4 %)
  • Language
  • License
    MIT License
  • Created almost 8 years ago
  • Updated almost 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Public tracker for Scramjet Cloud Platform, a platform that bring data from many environments together.

Scramjet - Transform as a Service

Scramjet Company Logo

Welcome to Scramjet's GitHub page!

We are a deep-tech company with a mission of delivering technology to improve the life of developers by allowing them to write fewer lines of code and be more effective in handling data. We want to let developers connect programs, not environments.

Scramjet Cloud Platform

Scramjet Cloud Platform Hub Logo

Scramjet Cloud Platforms brings clouds and local infrastructures together with simplicity at its core. It is a distributed data processing platform that allows you to deploy and run your programs in a serverless manner. It allows customers to run programs simultaneously in multiple languages, and interconnect multiple environments in ubiquitous data spaces, where programs can share the data and expose it through a single, globally available API.

Features:

  • write and deploy simple long-running data processing programs called Sequences,
  • use the platform console panel to interact with your Sequences,
  • invoke Sequences programmatically via CLI or API or a set of client libraries,
  • monitor and control running Sequences via one central, publicly available, secure API,
  • send and receive data produces and required by running Sequences,
  • share data between multiple Sequences by enclosing them in virtual Data Spaces,
  • connect self-hosted servers to existing Data Spaces with minimum configuration,
  • create execution environments at multiple cloud providers with a click of a button.
  • low memory footprint compared to, over 20 times lower memory usage than the Kafka/Flink stack

Use cases:

Scramjet Cloud Platform can become handy in any use case involving streaming data from one source to another, it can handle many types of inputs (basically any input that can be handled by Node.js application such as Text, JSON, XML, SOAP, Audio, Video and more). In the Sequence, you can perform any operation on the data with your code. Scramjet Cloud Platform exposes its REST API to provide and receive data and manage Sequences, Instances and itself. Lastly, our engine outputs can be managed in several ways - you can output to a local or remote file, STDOUT and STDERR output systems are supported, outputs can be consumed from our REST API, you can request URL / webhook, or stream the output to a destination of your choosing - or a mix of the above!

Samples:

We have several ready-to-use samples prepared in Python, JavaScript and TypeScript - you can check them all out in our documentation here: https://docs.scramjet.org/platform/samples.

Register and get 30-days trial:

Register

Scramjet Transform Hub

Scramjet Transform Hub Logo

Scramjet Transform Hub is the open-source core of the Scramjet Cloud Platform. It allows customers to start the execution part of the platform in any environment, on any system, on-premises or at any cloud or infrastructure provider. Our customers can install STH (Scramjet Transform Hub) on any POSIX-compatible system and access their data from any location, using private APIs or deploy a whole solution deep behind firewalls, leveraging your available computing resources.

The main repository for Scramjet Transform Hub is scramjetorg/transform-hub.

You can also find Scramjet Transform Hub packages on NPM: npmjs.com/package/@scramjet/sth and npmjs.com/package/@scramjet/cli.

Scramjet Framework

Scramjet Framework Logo

Fast, simple, functional reactive stream programming framework written on top of node.js object streams. The code is written by chaining functions that transform the streamed data, including the well-known map, filter and reduce and is fully compatible with ES7 async/await. Thanks to it some built-in optimizations scramjet is much faster and much simpler than similar frameworks when using asynchronous operations.

The main repository for the Scramjet framework is scramjetorg/framework-v4.

You can also find the Scramjet Framework package on NPM npmjs.com/package/scramjet

More about us

More Repositories

1

transform-hub

Scramjet Transform Hub (STH) is a runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters. It connects to Scramjet Spaces in Scramjet Cloud Platform.
TypeScript
65
star
2

framework-js

Simple yet powerful live data computation framework.
TypeScript
36
star
3

framework-python

Python port of Scramjet framework
Python
35
star
4

platform-docs

Scramjet Transform Hub usage documentation and code samples
JavaScript
23
star
5

framework-v4

JavaScript
18
star
6

openmetal

12
star
7

rereadable-stream

Node.js stream that can be read from begining, tailed a number lines from the end and so on, by any number of other streams
JavaScript
10
star
8

platform-pico-development

This repo is PoC how to use zephyr library to build a runtime enviroment that can be run on microcontrolers (Raspberry Pico used in example) with ability to separate control layer of microcontroler unit from user layer used to analyze data.
Python
9
star
9

scramjet-core

JavaScript
8
star
10

deep-learning

Scramjet Deep Learning Sequences and Utils
Python
8
star
11

platform-samples

Scramjet Cloud Platform Sequence Samples
TypeScript
8
star
12

scramjet-benchmark

Comparison of scramjet async operations performance
JavaScript
4
star
13

scramjet-cli

Allows to run scramjet modules from command line facilitating input and output.
JavaScript
4
star
14

scramjet-http-post

A simple stateless http server that emits all posted objects as a stream
JavaScript
3
star
15

framework-cpp

Simple yet powerful live data computation framework. C++ port of Scramjet framework.
C++
3
star
16

scramjet-http-uristream

A simple stateless http server that emits all uris as a stream
JavaScript
3
star
17

scramjetorg

Repository for organisation README
2
star
18

scramjet-hello-module

An example hello world module to start your work on.
JavaScript
2
star
19

scramjet-csv-to-json

JavaScript
2
star
20

scramjet-issue-tests

Test repo for issues reported for Scramjet.
JavaScript
2
star
21

nodeunit-tape-compat

Run nodeunit test cases with much faster and actively developed tape.
JavaScript
2
star
22

scramjet-fini

A scramjet compatible readable stream that never ends
JavaScript
2
star
23

scramjet-release-tools

Set of tools used to release scramjet and releated projects.
JavaScript
2
star
24

scramjet-articles

Posts for the scramjet docs page
JavaScript
2
star
25

api-client-python

Python
1
star
26

raspberry-pi-dash

A Raspberry Pi dashboard with Scramjet Transform Hub
JavaScript
1
star
27

raspberry-pi-dash-cf

An admin panel exposed from a raspberry pi straight to the internet with Cloudflare and Scramjet Cloud Platform
JavaScript
1
star
28

reference-apps

TypeScript
1
star