trandoshan-io/k8s

This repository has been archived on 10/Aug/2020
Stars
46
Rank 613,923 (Top 13 %)
Language
Shell
Created about 5 years ago
Updated about 5 years ago

trandoshan-io/k8s

trandoshan-io

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Kubernetes configuration file to boostrap trandoshan cluster

crawler

Go process used to crawl websites

trandoshan-parent

Parent repository used to centralize tools to run the application, manage source code, ...

dashboard

Web UI to manage a Trandoshan instance

persister

Go process used to abstract database interaction. It consumes messages from queue and put result in database allowing asynchronous saving operation

scheduler

Go orchestrator process used to schedule website parsing

api

REST API used by other processes to gather data

feeder

Oneshot process used to put an URL in the todo queue. Useful to start crawling process