• Stars
    star
    388
  • Rank 110,734 (Top 3 %)
  • Language
    JavaScript
  • License
    Apache License 2.0
  • Created over 9 years ago
  • Updated 4 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Extensible log shipper with input/output plugins, buffering, parsing, data masking, and small memory/CPU footprint

Build Status Deploy - read more

What is Logagent

Logagent is a modern, open-source, light-weight log shipper. It is like Filebeat and Logstash in one, without the JVM memory footprint. It comes with out of the box and extensible log parsing, on-disk buffering, secure transport, and bulk indexing to Elasticsearch, Sematext Logs, and other destinations. Its low memory footprint and low CPU overhead make it suitable for deploying on edge nodes and devices, while its ability to parse and structure logs makes it a great Logstash alternative.

Docker

Details about the the Logagent Docker image are described in the Docker Hub Readme

Installation

1) Install Node.js

Official Node.js downloads and instructions. E.g. for Debian/Ubuntu:

curl -sL https://deb.nodesource.com/setup_10.x | sudo -E bash -
sudo apt-get install -y nodejs
Install Logagent with npm
sudo npm i -g @sematext/logagent

2) Run logagent command line tool

logagent --help

3) Example: Index your log files in Elasticsearch

logagent -e http://localhost:9200 -i logs -g โ€˜/var/log/**/*.logโ€™

4) Optional: Install service & config

Install service for Logagent using systemd, upstart, launchd To quickly create a config file for indexing into Elasticsearch without having to edit it run something like this:

sudo logagent-setup -u http://localhost:9200 -i INDEX_NAME -g '/var/log/**/*.log'
# Logsene US: use -u https://logsene-receiver.sematext.com and your Logsene App Token as index name.
# Logsene EU: use -u https://logsene-receiver.eu.sematext.com and your Logsene App Token as index name.

Configuration

To configure different inputs, different event processing, or different outputs (e.g. your own Elasticsearch) edit /etc/sematext/logagent.conf, e.g.:

output:
  logsene:
    module: elasticsearch
    url: http://elasticsearch-server:9200
    index: logs

Then restart the service with sudo service logagent restart. Troubleshooting & Logs Logagentโ€™s own logs:

  • Upstart: /var/log/upstart/logagent.log
  • Systemd: journalctl -u logagent
  • Launchd: /Library/Logs/logagent.log

Location of service scripts:

  • Upstart: /etc/init/logagent.conf
  • Systemd: /etc/systemd/system/logagent.service
  • Launchd: /Library/LaunchDaemons/com.sematext.logagent.plist

Start/stop service:

  • Upstart: service logagent stop/start
  • Systemd: systemctl stop/start logagent
  • Launchd: launchctl start/stop com.sematext.logagent

Documentation & Support

Development

  • Update to the last node version
  • From root folder node type: node ./bin/logagent -h
  • To test from root folder type: node test

More Repositories

1

cheatsheets

209
star
2

sematext-agent-docker

Sematext Docker Agent - host + container metrics, logs & event collector
JavaScript
205
star
3

sematable

ReactJS / Redux Data Table
JavaScript
160
star
4

oxdpus

A toy tool that leverages the super powers of XDP to bring in-kernel IP filtering
Go
101
star
5

spm-agent-nodejs

NodeJS Monitoring Agent
JavaScript
61
star
6

uprobe-http-tracer

uprobe-based HTTP tracer for Go binaries
Go
60
star
7

solr-autocomplete

Solr AutoComplete implementation
Java
59
star
8

solr-redis

Solr Redis Extensions
Java
52
star
9

spm-agent-docker

SPM Docker Monitoring Agent - container + host metrics & events + logs collector
JavaScript
23
star
10

sematext-agent-java

Sematext Monitoring Agent
Java
22
star
11

sematext-logsene-android

Sematext Logs Client Library for Android
Java
22
star
12

query-segmenter

Solr Query Segmenter for structuring unstructured queries
Java
21
star
13

jmxc

Simple JMX Console
Java
17
star
14

sematext-agent-express

Express.js Monitoring and Logging Agent by Sematext
JavaScript
16
star
15

browser-sdk

Repository for the web browser SDK used for Sematext Experience.
JavaScript
15
star
16

solr-researcher

Solr SearchComponent for altering and re-executing queries that product poor results
Java
14
star
17

winston-logsene

Winston Transport for Logsene
JavaScript
14
star
18

sematext-agent-integrations

Core & Community developed monitoring integrations for Sematext monitoring agent
13
star
19

elasticsearch-field-stats

A replacement for Field Stats functionality which was removed from Elasticsearch
Java
11
star
20

blog-java_logging

Code examples for Java logging blog post
Java
11
star
21

activate

Examples for the Activate conference
Python
11
star
22

berlin-buzzwords-samples

Code and dataset samples for our Berlin Buzzwords presentations given by Sematext engineers
Shell
11
star
23

logsene-cli

Logsene Command-line Interface
JavaScript
10
star
24

logsene-js

Log shipping library for sending logs to Sematext from JavaScript apps
JavaScript
10
star
25

velocity

code samples and configs for our O'Reilly Velocity presentations
Shell
9
star
26

spm-agent

SPM Agent Framework written in NodeJS
JavaScript
9
star
27

HBaseMetricsContext

Java
9
star
28

related-searches

Related Searches - get queries related or similar to a given query
Java
8
star
29

spm-metrics-js

Sematext Agent for Custom Metrics
JavaScript
8
star
30

kite-morphlines-elasticsearch

Kite SDK Morphines for Elasticsearch
Java
8
star
31

spm-agent-mongodb

Sematext Agent for monitoring MongoDB
JavaScript
8
star
32

vercel-integrations

Forward logs and metrics from Vercel to Sematext for easy troubleshooting and debugging.
JavaScript
8
star
33

sematext-logsene-ios

Sematext Logs Client Library for iOS
Swift
7
star
34

solr-reindexer

Reindexes documents from a Solr query to a destination collection
Java
7
star
35

spm-tracing-api

Java Tracing API for Performance Monitoring and Transaction Tracing via SPM
Java
6
star
36

opentracing-materials

Collection of OpenTracing examples and scenarios for different languages / frameworks
Java
6
star
37

sematext-api-client-go

Sematext API Client
Go
5
star
38

solr-diagnostics

Gathers info from Solr: logs, configs, etc. Useful for remote debugging
Java
5
star
39

docker-spm-client

Docker Image with Sematext Agent for monitoring Docker Containers & Applications inside them
Shell
5
star
40

logsene-aws-lambda-cloudwatch

AWS Lambda script to send CloudWatch logs to Logsene
JavaScript
5
star
41

lucene-revolution-samples

Code and dataset samples for our Lucene Revolution presentations given by Sematext engineers
Ruby
5
star
42

sematext-metrics-reporter

Coda Metrics SPM Reporter
Java
5
star
43

elasticsearch-intro

Some information to get you started with Elasticsearch
Shell
4
star
44

meetups

Commands and sample data for various meetups
Shell
3
star
45

cloudwatch-sematext-aws-lambda-log-shipper

Code sample for tutorial about creating a centralized logging system for AWS Lambda with Sematext Logsene.
JavaScript
3
star
46

terraform-provider-sematext

Sematext Terraform Provider
Go
3
star
47

sematext-api-client-javascript

Sematext API Client for Node.js
JavaScript
3
star
48

sematext-api-client-java

Sematext API Client for Java
Java
2
star
49

kamon-spm-example

Example Akka App and Config for Akka and Play monitoring with Kamon and SPM
Scala
2
star
50

terraform-examples

2
star
51

spm-agent-os

Sematext Agent for OS metrics written in Node.js
JavaScript
2
star
52

docs

Sematext Documentation
HTML
2
star
53

sematext-api-client-rust

Sematext API Client for Rust
Rust
2
star
54

eslint-plugin-esm-import

ESLint plugin which enforces explicit .js extensions in local imports while leveraging import resolvers
JavaScript
2
star
55

logsene-aws-lambda-s3

AWS Lambda script to send S3 logs to Logsene
Python
1
star
56

logagent-input-kafka

Logagent plugin to read messages from Apache Kafka
JavaScript
1
star
57

sematext-metrics-gem

Ruby Gem for pushing Custom Metrics into SPM
Ruby
1
star
58

sematext-api-client-php

Sematext API Client for PHP
PHP
1
star
59

ansible-config-sematext

Ansible Config Role for Sematext monitoring agents
1
star
60

BasecampMigrator

1
star
61

sematext-metrics

Java Library for sending Custom Metrics to SPM
Java
1
star
62

imap-email-extractor

Java
1
star
63

sematext-api-client-python

Sematext API Client for Python
Python
1
star
64

webcampzagreb

WebCamp Zagreb related materials
1
star
65

sematext-api-client-ruby

Sematext API Client for Ruby
Ruby
1
star