Discover IBMStreams/IBMStreams.github.io Open Source project

This repository contains open-source sample applications for IBM Streams.

samples

This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.

streamsx.messaging

Develop streaming applications for IBM Streams in Python, Java & Scala.

streamsx.topology

Umbrella project for the IBMStreams organization. This project will be used for the management of the individual projects within the IBMStreams organization.

administration

tutorials

A project for developing tutorials for Streams

Contains performance benchmark applications for IBM Streams

benchmarks

Repository for integration with Apache Kafka

streamsx.kafka

Open-source, Cloud-native Streams

OSStreams

This toolkit supports common internet protocols, such as HTTP and WebSockets

streamsx.inet

This toolkit provides operators and functions for interacting with Hadoop File System.

streamsx.hdfs

Integration of IBM Streams and Apache HBase

streamsx.hbase

Streams documentation project for writing development guides and documentation

streamsx.documentation

HTML

streamsx.mongoDB

(Incubation) This toolkit provides support for MongoDB.

Toolkit for real-time scoring using Apache Spark MLLib library

streamsx.sparkMLLib

(Incubation) TCPServer is a multi-connection, multi-threaded operator that allows for full duplex TCP communication.

streamsx.tcp

Starter kit for smart and connected sprinkler system using Apache Edgent, Streaming Analytics and Insights for Weather

streamsx.waterConservation.starterKit

(Incubation) Provide the ability to have an IBM Streams application easily interact with IoTF, either in Bluemix (Streaming Analytics Service) or on-premises (IBM Streams).

streamsx.iot

IBM Streams extension for Visual Studio Code

vscode-ide

TypeScript

streamsx.visualization

Real-Time Visual Analytics

(Incubation) This toolkit allows extract text and metadata from documents in a binary formats such as PDF, Word, Office, etc

streamsx.document

(Incubation) Toolkit providing adapters to Parquet

streamsx.parquet

(Incubation) This toolkit provides support for RE2 regular expression library

streamsx.regex

The com.ibm.streamsx.monitoring toolkit provides capabilities to create applications that monitor IBM Streams and its applications.

streamsx.monitoring

Notebooks showing Streams applications written in Python

sample.starter_notebooks

(Incubation) This project is focused on running Streams with popular resource managers

resourceManagers

The com.ibm.streamsx.objectstorage toolkit supports Object Storage services with S3 API like IBM Cloud Object Storage service.

streamsx.objectstorage

The IBMStreams/streamsx.dps GitHub repository is home to the Streams toolkit named DPS (Distributed Process Store)

streamsx.dps

(Incubation) This toolkit provides thrift server and client functionality

streamsx.thrift

(Incubation) The toolkit allows to parse input format producing desired hierarchical tuple (including lists, maps and sets) saving the common step of mapping the flat format to the required Streams tuple.

streamsx.adaptiveParser

Perl

streamsx.jmxclients

JMX Client apps for Streams including prometheus metrics exporter

Toolkit for working with JSON in SPL applications.

streamsx.cassandra

Operators for Cassandra

Scala

streamsx.json

(incubation) Provides ability to transform speech to text in a Streams application

streamsx.speech2text

Shell

streamsx.edgevideoanalytics.starterkit

An end-to-end video analytic demonstration performing video analytics on edge devices and centralized system

Supports Streams application to work with databases via JDBC

streamsx.jdbc

(Incubation) This toolkit receives live changes from a InfoSphere Data replication CDC subscription which can then be used as part of the Streams application to trigger events or update reference tables.

streamsx.cdc

Toolkit for working with network data

streamsx.network

Toolkit for IBM Db2 Event Store integration.

streamsx.eventstore

Provide operations for text analysis, like lemmatization and text annotation with Uima Ruta scripts or existing project specific Uima pear files.

streamsx.nlp

Starter applications for IBM Streams cybersecurity toolkit

streamsx.cybersecurity.starterApps

Shell

endpoint-monitor

Nginx reverse proxy sample application to Streams REST operators.

Python

streamsx.elasticsearch

Toolkit to enable application developers to store streaming data into Elastic Search database

IBM Streams toolkit for parsing and creating Google Protocol Buffers

streamsx.protobuf

Perl

sample.edge-rolling-average

Edge sample

Tutorials : Processing live feeds with ICP4D and Streams

sample.wikirecent

Toolkit to support serialization and deserialization in Avro format

streamsx.avro

(incubation) Toolkit for processing videos in a Streams application

streamsx.opencv

HTML

streamsx.demo.logwatch

(Incubation) Demonstration SPL application for detecting system breakins.

Makefile

streamsx.utility

(Incubation) Contains utilities for IBM Streams

HTML

streamsx.cloudant

Allow Streams applications to read / write to Cloudant database

Sample application using Streams Flow demonstrating the usage of R

sample.forecast_with_r

streamsx.shell

Utility toolkit to execute shell commands in a Streams application

(Incubation) Toolkit for operators and functions to integrate Streams with social media sites.

streamsx.social

(Incubation) A collection of demos streaming smartphones' accelerometers / gyroscope data to InfoSphere Streams applications.

streamsx.demo.accelerometer

Plumbing operators manipulate the flow of tuples in a Streams application, but are not part of the logic of the application

streamsx.plumbing

(Incubation) Mathematics and statistics toolkit.

streamsx.math

Shell

streamsx.testing

Provides samples, utilities and documentation on how to test Streams toolkits and applications

pypi.streamsx

Python core package for IBM Streams.

Python

streamsx.ps

(Incubation) This Streams toolkit allows a simple way for the SPL and C++ operators that are fused inside a single PE (Processing Element) to share the application specific state information.

Repository for resource manager integration with Apache Mesos

streamsx.resourcemanager.mesos

Toolkit for accessing data and analytics results from IBM Watson Explorer (formerly known as IBM Infosphere Data Explorer)

streamsx.watsonexplorer

Integrate IBM Streams with RabbitMQ

streamsx.rabbitmq

(Incubation) Toolkit for adaptors to access transit feeds as well as generic transportation based operators and functions

streamsx.transportation

[Incubation] C++ WebSocket toolkit for IBM Streams

streamsx.websocket

Repository to provide easy integration with IBM MessageHub Bluemix Service

streamsx.messagehub

sample.netflow

Netflow sample

(Incubation) Providing functions related to anomaly detection algorithms

streamsx.anomalyDetection