kazeburo/cloudforecast

Stars
149
Rank 248,704 (Top 5 %)
Language
Perl
Created over 14 years ago
Updated over 3 years ago

kazeburo/cloudforecast

kazeburo

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

the server metrics gathering

CloudForecast - server resource monitoring framework

WARNING: Alpha quality code

サーバ等のリソース監視をするためのツールです。
RRDToolの薄いラッパー、情報取得のためのフレームワークとして設計されています。
CloudForecastは、4つのプロセスによって動作します。

 - 巡回デーモン
 - グラフ閲覧 HTTPD
 - 情報取得Gearmanワーカー
 - RRDファイル更新Gearmanワーカー

小規模な監視では、Gearmanがなくても動作可能です。
動作イメージはdocsディレクトリ以下の cloudforecast.png になります

# 巡回デーモン 
$ ./cloudforecast_radar -r -c cloudforecast.yaml -l server_list.yaml
  - 起動すると5分ごとに巡回を行います
  - -r 再起動オプション。ライブラリや設定ファイルを更新すると自動で再起動します
  - -c 設定ファイル
  - -l サーバ一覧


# web server
$ ./cloudforecast_web -r -p 5000 -c cloudforecast.yaml -l server_list.yaml
  - グラフ閲覧 HTTPD
  - -p ポート httpdのport
  - -o | -host httpdがListenするIP。デフォルトはすべてのIP
  - --allow-from アクセス可能なクライアントIP/IPセグメント、複数指定可能 192.168.0.1 or 192.168.0.1/24
                 なにも指定しなければ アクセス制御はしない
  - --front-proxy リバースプロキシーを使っている場合に、そのIPアドレス/IPセグメント。複数指定可能

# 情報取得Gearmanワーカー
$ ./cf_fetcher_worker -r -c cloudforecast.yaml \
     -max-workers 2 -max-request-per-child 100 -max-exection-time 60 
  - gearmanでのリソース情報取得ワーカー
  - -max-worker preforkするワーカー数
  - -max-request-per-child 1ワーカープロセス処理回数。この回数を超えるとプロセスが新しく作り直される
  - -max-exection-time ワーカーの１回の取得作業でこれ以上の時間かかっている場合、そのワーカーを停止します

# RRDファイル更新Gearmanワーカー
$ ./cf_updater_worker -r -c cloudforecast.yaml \
     -max-workers 2 -max-request-per-child 100 -max-exection-time 60 
　- gearmanでのリソース情報をrrdファイルに書き込むワーカー

#環境変数
CF_DEBUG=1 をするとdebugログが出力されます

rhebok

High Performance Preforked Rack Handler

GrowthForecast

Lightning Fast Graphing/Visualization

chocon

chocon is a simple proxy server for persisting connections between upstream servers.

mysetup

my setup scripts repository

Gazelle

Preforked Plack Handler for performance freaks

Kurado

monitor metrics

Monoceros

PSGI/Plack server with event driven connection manager, preforking workers

HRForecast

Proclet

minimalistic Supervisor

wsgate-server

a websocket to tcp proxy/bridge server

Kossy

sinatra-ish simple waf

Plack-Middleware-ServerStatus-Lite

Plack-Middleware-ServerStatus-Lite

prefork_engine

a simple prefork server framework / ruby port of perl's Parallel::Prefork

GreenBuckets

query-digester

pt-query-digest wrapper to make ops simple

Log-Minimal

pico_http_parser

Fast HTTP Parser using picohttpparser

isucon2_hack

Redis-Jet

Yet another XS implemented Redis client

custom-mackerel-plugins

my custom mackerel plugins

motarei

Simple tcp proxy for Docker Hot deploy

go-jmx-get

tiny jmx client

DBIx-Sunny

docker-h2o

Dockerfile for h2o HTTP Server with graceful restart support

Plack-Builder-Conditionals

Plack::Builder extension

Plack-Middleware-Expires

mod_expires for plack

wsgate-client

a websocket to tcp proxy/bridge client server

Plack-Server-AnyEvent-Prefork

Prefork AnyEvent based HTTP Server

mackerel-plugin-axslog

Yet Another mackerel-plugin for analyzing and visualizing Acesslog

mackerel-plugin-pinging

ICMP Ping RTT custom mackerel plugin

Apache-LogFormat-Compiler

Compile LogFormat to perl-code

Cache-Memcached-IronPlate

Best practices for Cache::Memcached

Twiggy-Prefork

Preforking AnyEvent HTTP server for PSGI

myps

Like pgrep and pkill, grep MySQL processlist and kill threads.

percentile

sabo

bandwidth limiting pipe with collaborative capability

Scope-Container

build_mysql_mroonga_rpm

build mysql_mroonga.rpm by Vagrant provisioners

JavaScript-Value-Escape

isucon3qualifier-myhack

ppdp

Proxy Protocol Dump Proxy

Scope-Container-DBI

DB connection manager with Scope::Container

heroku-buildpack-perl-procfile

a Heroku buildpack that runs any perl applications from Procfile

Cookie-Baker

Cookie string generator

p5-Alien-RRDtool

Installation of RRDs.pm (Perl binding for RRDtool)

rpm

my rpm repository

NoNoPaste

yet another nopaste

mackerel-plugin-maxcpu

jstat2gf

chunkview

chuncked trasnfer visualizer

Time-TZOffset

Show timezone offset strings like +0900

NoNoPaste-Cloud

dotcloud nonopaste

mysql40dump

mysqldump wrapper for MySQL 4.0

Plack-Middleware-DBIx-DisconnectAll

Disconnect all database connection at end of request

isucon5-elimination-public

POSIX-strftime-Compiler

HTTP-Entity-Parser

PSGI compliant HTTP Entity Parser

Plack-Middleware-Scope-Container

Data-Page-Navigation

adds methods for page navigation link to Data::Page

docker-perl-build

docker image of perl-build

Plack-App-PHPCGI

execute PHP script as CGI

http-dump-request

http-dump-request server and docker container for monitoring and tests

mackerel-plugin-postfix-log

Read and analyze postfix logs

vagrant-destroy-provisioner

vagrant-destroy-provisioner plugin allows a VM to be destroyed as a provisioning step.

check_http2

Nagios check_http plugin alternative powered by Go

isucon11-final

final isucasy XI

diff-detector

isucon_summer_class_2014

ISUCON 夏期講習 2014

CoreListWeb

Module::CoreList Web

mssh

check-cert-net

Check a remote certification expiry using openssl s_client

mackerel-plugin-log-counter

mackerel metric plugin for count lines in log

Plack-Middleware-Log-Minimal

mod_copy_header

copy a response header to notes

wg-keygen-rep

wireguard keypair generator with salt string

Module-Build-Pluggable-CPANfile

Include cpanfile

WWW-GoogleAnalytics-Mobile

PSGI Application of Google Analytics for Mobile and client

Cache-Isolator

check_memcached_val

nagios plugin for checking value in a memcached server

check-lastlog

Check users who have not logged in recently

Redis-Tiny

deteco

Simple auth server used JWT & public-key cryptography

isucon5-final-public

isius

Ping/TCP/HTTP/HTTPS monitoring agent server

mackerel-plugin-resolver-synthetic

mackerel plugin for monitoring dns server as linux resolver

tanzak

go-check-mysql-msr

check multi source replication

connstorm

App-derived

run command periodically and calculate rate and check from network

Cache-Memcached-Fast-Safe

Cache::Memcached::Fast with sanitizing keys and fork-safe

DBIx-DSN-Resolver

Resolv hostname within dsn string

limilic2

ltsvparser

LTSV (Labeled Tab-separated Values) parser for Go language

private-isu-challenge

Plack-Middleware-AxsLog

Alternative AccessLog Middleware

the-rp

the reverse HTTP an TCP Reverse proxy supports asynchronous upstream resolution and some balancing strategy

File-RotateLogs

Rotate log file

relaxlogs

CLI for lestrrat-go/file-rotatelogs

AnyEvent-DNS-Cache-Simple

provides simple cache for AnyEvent::DNS

Time-Crontab

Parser for crontab date and time field