Awesome Flink

A curated list of awesome things related to Apache Flink. Inspired by Awesome Hadoop and Awesome Vue.

Packages
Resources

Packages

Notebooks

Apache Zeppelin - Web-based notebook that enables interactive data analytics with plugable backends, integrated plotting, and extensive Flink support out-of-the-box.

Machine Learning

Flink-TensorFlow - A library for machine intelligence in Apache Flink™, using the TensorFlow library and associated models.

Complex Event Processing

Flink-Siddhi - A CEP library for Flink to run Siddhi within Apache Flink streaming application

Interfaces

Apache Beam - Unified data processing engine supporting both batch and streaming applications. Apache Flink is one of the supported execution environments.

Connectors

Apache Bahir - Collection of the connectors excluded from Flink (Akka, ActiveMQ, Flume, Netty, Redis).

Benchmarks

Tests

Flinnk spector - provides a framework to define unit tests for Apache Flink data flows. The framework executes data flows locally and verifies the output using predefined expectations.

Resources

Various resources, such as books, websites and articles.

Official Resources

External Resources

Community

Books

Stream Processing with Apache Flink - by Fabian Hueske, Vasiliki Kalavri (Nov 2017)
Flink in Action - by Sameer Wadkar, Hari Rajaram (Mar 2017)
Learning Apache Flink - by Tanmay Deshpande (Feb 2017)
Introduction to Apache Flink - by Ellen Friedman, Kostas Tzoumas (Oct 2016)

Papers

Lightweight Asynchronous Snapshots for Distributed Dataflows - Paper proposed Asynchronous Barrier Snapshotting (ABS) implemented in Flink to support stateful stream processing. (Jun 2015)
Apache Flink™: Stream and Batch Processing in a Single Engine - Paper introducing Apache Flink for processing streaming and batch data under a single execution model. (Jan 2015)
The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing - Paper introducing the Dataflow model which Flink's streaming model based on. (2015)
Efficient Pattern Matching over Event Streams - Flink CEP library inspired by this paper. (2008)

Blogs

Flink Forward

Flink Forward 2015 - Slides and Videos
Flink Forward 2016 - Slides and Videos
Flink Forward San Francisco 2017 - Slides and Videos
Flink Forward Berlín 2017 - Slides

Slides

2017

Timo Walther: Table & SQL API – unified APIs for batch and stream processing Flink Forward San Francisco, April 2017: SlideShare
Kostas Kloudas: Extending Flink’s Streaming APIs Flink Forward San Francisco, April 2017: SlideShare
Tzu-Li (Gordon) Tai: Joining the Scurry of Squirrels: Contributing to Apache Flink Flink Forward San Francisco, April 2017: SlideShare
Stefan Richter: Improvements for large state and recovery in Flink Flink Forward San Francisco, April 2017: SlideShare
Ufuk Celebi: The Stream Processor as a Database: Building Online Applications directly on Streams Flink Forward San Francisco, April 2017: SlideShare
Jamie Grier: Apache Flink - The Latest and Greatest Flink Forward San Francisco, April 2017: SlideShare
Stephan Ewen: Experiences running Flink at Very Large Scale Flink Forward San Francisco, April 2017: SlideShare
Stephan Ewen: Convergence of real-time analytics and data-driven applications Flink Forward San Francisco, April 2017: SlideShare
Till Rohrmann: Redesigning Apache Flink’s Distributed Architecture Back to Sessions overview Flink Forward San Francisco, April 2017: SlideShare
Timo Walther: Table & SQL API - unified APIs for batch and stream processing Apache Flink Meetup Amsterdam, March 2017: SlideShare
Kostas Kloudas: Extending Flink's Streaming APIs Apache Flink Meetup Berlin, February 2017: SlideShare
Fabian Hueske: Stream Analytics with SQL on Apache Flink Big Data Tech Summit, Warsaw February 2017: SlideShare

2016

Stephan Ewen: Stream Processing as a Foundational Paradigm and Apache Flink's Approach to It Big Data, Berlin v 10.0, December 2016: SlideShare
Kostas Tzoumas & Stephan Ewen: Keynote -The maturing data streaming ecosystem and Apache Flink’s accelerated growth Flink Forward, Berlin September 2016: SlideShare
Robert Metzger: Connecting Apache Flink to the World - Reviewing the streaming connectors Flink Forward, Berlin September 2016: SlideShare
Till Rohrmann & Fabian Hueske: Declarative stream processing with StreamSQL and CEP Flink Forward, Berlin September 2016: SlideShare
Jamie Grier: Robust Stream Processing with Apache Flink Flink Forward, Berlin September 2016: SlideShare
Jamie Grier: The Stream Processor as a Database- Building Online Applications directly on Streams Flink Forward, Berlin September 2016: SlideShare
Till Rohramnn: Dynamic Scaling - How Apache Flink adapts to changing workloads Flink Forward, Berlin September 2016: SlideShare
Stephan Ewen: Running Flink Everywhere Flink Forward, Berlin September 2016: SlideShare
Stephan Ewen: Scaling Apache Flink to very large State Flink Forward, Berlin September 2016: SlideShare
Aljoscha Krettek: The Future of Apache Flink Flink Forward, Berlin September 2016: SlideShare
Fabian Hueske: Taking a look under the hood of Apache Flink's relational APIs Flink Forward, Berlin September 2016: SlideShare
Kostas Tzoumas: Streaming in the Wild with Apache Flink Hadoop Summit San Jose, June 2016: SlideShare
Stephan Ewen: The Stream Processor as the Database - Apache Flink Berlin Buzzwords, June 2016: SlideShare
Till Rohrmann & Fabian Hueske: Streaming Analytics & CEP - Two sides of the same coin? Berlin Buzzwords, June 2016: SlideShare
Robert Metzger: A Data Streaming Architecture with Apache Flink Berlin Buzzwords, June 2016: SlideShare
Stephan Ewen: Continuous Processing with Apache Flink Strata + Hadoop World London, May 2016: SlideShare
Stephan Ewen: Streaming Analytics with Apache Flink 1.0 Flink NYC Flink, May 2016: SlideShare
Ufuk Celebi: Unified Stream & Batch Processing with Apache Flink. Hadoop Summit Dublin, April 2016: SlideShare
Kostas Tzoumas: Counting Elements in Streams. Strata San Jose, March 2016: SlideShare
Jamie Grier: Extending the Yahoo! Streaming Benchmark. Flink Washington DC Meetup, March 2016: SlideShare
Jamie Grier: Stateful Stream Processing at In-Memory Speed. Flink NYC Meetup, March 2016: SlideShare
Robert Metzger: Stream Processing with Apache Flink. QCon London, March 2016: SlideShare
Vasia Kalavri: Batch and Stream Graph Processing with Apache Flink. Flink and Neo4j Meetup Berlin, March 2016: SlideShare
Maximilian Michels: Stream Processing with Apache Flink. Big Data Technology Summit, February 2016: SlideShare
Vasia Kalavri: Single-Pass Graph Streaming Analytics with Apache Flink. FOSDEM, January 2016: SlideShare
Till Rohrmann: Streaming Done Right. FOSDEM, January 2016: SlideShare

2015

Till Rohrmann: Streaming Data Flow with Apache Flink (October 29th, 2015): SlideShare
Stephan Ewen: Flink-0.10 (October 28th, 2015): SlideShare
Robert Metzger: Architecture of Flink's Streaming Runtime (ApacheCon, September 29th, 2015): SlideShare
Robert Metzger: Click-Through Example for Flink's KafkaConsumer Checkpointing (September, 2015): SlideShare
Paris Carbone: Apache Flink Streaming. Resiliency and Consistency (Google Tech Talk, August 2015: SlideShare
Andra Lungu: Graph Processing with Apache Flink (August 26th, 2015): SlideShare
Till Rohrmann: Interactive data analytisis with Apache Flink (June 23rd, 2015): SlideShare
Gyula Fóra: Real-time data processing with Apache Flink (Budapest Data Forum, June 4th, 2015): SlideShare
Till Rohrmann: Machine Learning with Apache Flink (March 23th, 2015): SlideShare
Marton Balassi: Flink Streaming (February 26th, 2015): SlideShare
Vasia Kalavri: Large-Scale Graph Processing with Apache Flink (FOSDEM, 31st January, 2015): SlideShare
Fabian Hueske: Hadoop Compatibility (January 28th, 2015): SlideShare
Kostas Tzoumas: Apache Flink Overview (January 14th, 2015): SlideShare

2014

Kostas Tzoumas: Flink Internals (November 18th, 2014): SlideShare
Marton Balassi & Gyula Fóra: The Flink Big Data Analytics Platform (ApachecCon, November 11th, 2014): SlideShare
Till Rohrmann: Introduction to Apache Flink (October 15th, 2014): SlideShare

License

This work (Awesome Flink, by https://github.com/wuchong/awesome-flink), identified by Jark Wu, is free of known copyright restrictions.

wuchong/awesome-flink

wuchong

Reviews

Repository Details