Trandoshan Crawler (@trandoshan-io)
Guthub

trandoshan-io

Twitter logo Share LinkedIn logo Share Facebook logo Share
  • Stars
    star
    244
  • Global Org. Rank 36,315 (Top 12 %)
  • Registered over 5 years ago
  • Most used languages
    Go
         62.5 %
    Shell
         25.0 %
    TypeScript
         12.5 %
  • Location πŸ‡«πŸ‡· France
  • Country Total Rank 2,751
  • Country Ranking
    Go
         150
    Shell
         284
    TypeScript
         1,401

Top repositories

1

crawler

Go process used to crawl websites
Go
150
star
2

k8s

Kubernetes configuration file to boostrap trandoshan cluster
Shell
46
star
3

trandoshan-parent

Parent repository used to centralize tools to run the application, manage source code, ...
Shell
21
star
4

dashboard

Web UI to manage a Trandoshan instance
TypeScript
11
star
5

persister

Go process used to abstract database interaction. It consumes messages from queue and put result in database allowing asynchronous saving operation
Go
7
star
6

scheduler

Go orchestrator process used to schedule website parsing
Go
6
star
7

api

REST API used by other processes to gather data
Go
5
star
8

feeder

Oneshot process used to put an URL in the todo queue. Useful to start crawling process
Go
2
star