jay-johnson/celery-connectors jay-johnson/celery-connectors

  • Stars
    star
    41
  • Rank 668,415 (Top 14 %)
  • Language
    Python
  • License
    Other
  • Created almost 7 years ago
  • Updated about 6 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
jay-johnson/celery-connectors
github

jay-johnson

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Want to handle 100,000 messages in 90 seconds? Celery and Kombu are that awesome - Multiple publisher-subscriber demos for processing json or pickled messages from Redis, RabbitMQ or AWS SQS. Includes Kombu message processors using native Producer and Consumer classes as well as ConsumerProducerMixin workers for relay publish-hook or caching

More Repositories

1

sci-pype

A Machine Learning API with native redis caching and export + import using S3. Analyze entire datasets using an API for building, training, testing, analyzing, extracting, importing, and archiving. This repository can run from a docker container or from the repository.
Python
100
star
2

deploy-to-kubernetes

Deploy a distributed AI stack to a multi-host or single-host Kubernetes cluster on CentOS 7 and also works on AWS - and comes with: cert-manager + redis-cluster + rook-ceph for persistent storage + minio s3 object store + splunk + optional external dns server + affinity examples - validated with K8 version 1.13.4 πŸ”¨ πŸ”§ ☁️
Shell
79
star
3

train-ai-with-django-swagger-jwt

Train AI (Keras + Tensorflow) to defend apps with Django REST Framework + Celery + Swagger + JWT - deploys to Kubernetes and OpenShift Container Platform
Python
70
star
4

owasp-jenkins

Want to test your applications using the latest OWASP security toolchains and the NIST National Vulnerability Database using Jenkins, Ansible and docker? 🐳 πŸ›‘οΈ πŸ”’
Shell
54
star
5

docker-redis-cluster

Running a distributed 6-node Redis Cluster with Docker Swarm, Docker Compose, and Supervisor
Shell
49
star
6

docker-redis-haproxy-cluster

A Redis Replication Cluster accessible through HAProxy running across a Docker Composed-Swarm with Supervisor and Sentinel
Python
48
star
7

network-pipeline

Network traffic data pipeline for real-time predictions and building datasets for deep neural networks
Python
47
star
8

metalnetes

Create and manage multiple Kubernetes clusters using KVM on a bare metal Fedora 29 server. Includes helm + rook-ceph + nginx ingress + the stock analysis engine (jupyter + redis cluster + minio + automated cron jobs for data collection) - works on Kubernetes version v1.16.0 - 1.16.3 was not working
Shell
39
star
9

docker-django-nginx-slack-sphinx

Django + nginx using Docker Compose with Slack + uWSGI + Sphinx + Bootstrap + Bootswatch + AJAX ➑️ 🐳 + 🐍 = πŸ’₯
Python
27
star
10

antinex-core

Network exploit detection using highly accurate pre-trained deep neural networks with Celery + Keras + Tensorflow + Redis
Jupyter Notebook
20
star
11

nerfball

Want to see how something like Internet Chemotherapy works without bricking your own vms? This is a jail to reduce the python runtime from doing bad things on the host when running untrusted code. Nerf what you do not need πŸ‘Ύ + πŸ› ⚽ 🏈 🐳
Python
19
star
12

restapi

A secure-by-default, async Rest API with hyper, tokio, bb8, kafka-threadpool, postgres and prometheus for monitoring. Includes: a working user management and authentication backend written for postgres, async s3 uploading/downloading, async publishing to kafka with mTLS for encryption in transit
Rust
18
star
13

spylunking

Drill down into your python logs using JSON logs stored in Splunk - supports sending over TCP or the Splunk HEC REST API handlers (using threads or multiprocessing) - includes a pre-configured Splunk sandbox in a docker container
Python
12
star
14

docker-redis-sentinel-replication-cluster

A Redis Replication Cluster running across a Docker Swarm using Compose, Supervisor, and Sentinel
Shell
11
star
15

kombu-and-pika-pub-sub-examples

Simple publisher and subscriber examples for Kombu and Pika with a RabbitMQ broker
Python
10
star
16

sec-rss-read-and-convert-to-json

Using Python, read the SEC RSS Feed and convert to JSON dictionary
Python
8
star
17

antinex-datasets

Datasets for training deep neural networks to defend software applications
Python
7
star
18

docker-schema-prototyping-with-mysql

Prototyping a MySQL Schema with Docker and phpMyAdmin
Python
6
star
19

convert-stock-ticker-into-cik-json

Quickly Convert Stock Tickers into the associated SEC CIK with Company Name and dump to JSON
Python
6
star
20

antinex-client

AntiNex python client for training and using pre-trained deep neural networks with JWT authentication
Python
5
star
21

ruby-luhn-checker-for-credit-card-validation

πŸ’³ Process credit card transactions and maintain an account balance with the Luhn algorithm for fraud detection and credit card number validation. Written in Ruby and uses RSpec for testing.
Ruby
4
star
22

redten-python

Python client and docker image for the red10 machine learning api
Python
4
star
23

docker-nginx-sphinx-bootstrap

Host your own Technical Blog with Docker + nginx + Sphinx Bootstrap
Python
3
star
24

docker-sphinx-bootstrap

A containerized version of ryan-roemer's sphinx-bootstrap-theme repository so that on startup it will convert any rst files mounted from a host volume directory into themed, mobile-ready html.
Shell
3
star
25

celery-loaders

Examples for Celery applications and task loading
Python
3
star
26

antinex-utils

Manage and use pre-trained deep neural networks with a common interface for build, compile, fit, evaluate, kfold, cross validate, and predict lifecycle phases using Keras and Tensorflow
Python
3
star
27

slack-driven-development

Tired of crawling through logs looking for errors? This is a simple Slack bot that publishes exceptions + line number + environment name into a channel to help develop and find bugs faster
Python
3
star
28

docker-rails-app

Rails App - Phase 2 - With Docker Integration for Demonstrating Travis CI
Ruby
2
star
29

python-that-runs-c-plus-plus

Bind C++ objects, methods and classes for use with Python 2.7, and it builds with cmake
C++
2
star
30

network-pipeline-datasets

CSV datasets for ML/AI models from captured network traffic during ZAP scanning with web applications like Django, Flask, React, Vue and Spring - Anti-Nex training datasets
2
star
31

rust-with-strimzi-kafka-and-tls

Rust messaging with a Strimzi Kafka cluster secured with self-signed tls assets for encryption in transit with mtls for client authentication
Rust
2
star
32

datanode

A python 2 container runtime for processing data science tasks and workloads (used by https://github.com/jay-johnson/sci-pype for distributed analysis)
Python
2
star
33

docker-springxd-container

Docker container for Spring XD Container that uses Travis CI to auto-push passing builds into Docker Hub
Shell
1
star
34

antinex-docs

Docs on readthedocs.org
1
star
35

docker-nginx

A configurable docker nginx container running on CentOS 7
Shell
1
star
36

rust-kafka-threadpool

An async rust threadpool for publishing messages to kafka using SSL (mTLS) or PLAINTEXT protocols.
Rust
1
star
37

lets-encrypt-nginx

Another nginx docker container that automates registering and renewing Let's Encrypt x509 ssl certificates
Shell
1
star
38

message-simulator

An open source tool for testing and hardening clusters for high availability
Python
1
star