• Stars
    star
    151
  • Rank 246,057 (Top 5 %)
  • Language
    Python
  • License
    Other
  • Created almost 9 years ago
  • Updated 3 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A collection of lambda functions to collect data from Cloudwatch, Kinesis, VPC Flow logs, S3, security-hub and AWS Inspector

Sumo Logic AWS Lambda Functions Build Status

What does AWS Lambda do?

AWS Lambda is a compute service that allows users to run code, in response to events, without having to provision and manage servers. A Lambda Function can be triggered automatically from other Amazon services, or from a web or mobile application. For more information, please visit the AWS Lambda site.

What do Sumo Logic Lambda Functions do?

Sumo Logic Lambda Functions are designed to collect and process data from a variety of sources and pass it onto the Sumo Logic platform. Here, the data can be stored, aggregated, searched, and visualized for a variety of insightful use cases.

What are the different Sumo Logic Lambda Functions available?

We put the Lambda functions to read from a particular AWS service (e.g CloudWatch Logs and S3) under each specific folder. Each folder may then have its own instructions to setup the functions.

Collection Solutions

FunctionName Description Collection Use Cases Setup Documentation
SumoLogic Lambda Function for AWS CloudWatch Logs With Dead Letter Queue Support This project comes with Cloudformation template and two lambda functions which sends CloudWatch logs to Sumo Logic HTTP source endpoint.The first function(invoked by CloudWatch) is configured with DLQ and the second function(invoked periodically by CloudWatch Events) reads from DLQ. AWS Lambda ULM App Docs
SumoLogic Function for AWS CloudWatch Events This function is invoked by AWS CloudWatch events in response to state change in your AWS resources which matches a event target definition. The event payload received is then forwarded to Sumo Logic HTTP source endpoint. AWS GuardDuty App Docs
SumoLogic Function for Amazon Inspector This function subscribes to a SNS topic where Amazon Inspector publishes its findings.It receives the message payload as an input parameter, transforms it and sends it to Sumo Logic HTTP source endpoint Amazon Inspector Docs
AWS Kinesis Firehose for Metrics This project sets up AWS resources to Send AWS CloudWatch metrics using Kinesis Firehose metric streams to Sumo Logic. CloudWatch Metrics, AWS Observability Docs
AWS Kinesis Firehose for Logs This project sets up AWS resources to Send AWS CloudWatch Logs using Kinesis Firehose streams to Sumo Logic. CloudWatch Logs, AWS Observability Docs
Kinesis to Sumo Logic This function is invoked by AWS Lambda after it detects new records in Kinesis stream. The received collection of events are decompressed, transformed and send to Sumo Logic HTTP source endpoint Docs
SumoLogic Lambda Function for AWS CloudWatch Logs This function subscribes to CloudWatch Log Group and is invoked by AWS CloudWatch with log messages as payload. The records received are decompressed, transformed and forwarded to Sumo Logic HTTP source endpoint in chunks.While the function is more simple then the DLQ-based solution above, it doesn't handle failures and retries properly, thus not recommended. Not Recommended Docs
S3 AND
Cloudtrail S3 to Sumo Logic
This function receives S3 notifications on new files uploaded to the source S3 bucket, then reads these files, unzips them, and breakdown the records before finally sending to HTTP hosted collector endpoint. DEPRECATED Docs
Docs

Helper Functions

FunctionName Description Setup Documentation
Kinesis Firehose Processor This function is used for transforming streaming data from kinesis firehose before it sents to destination. Docs
LogGroup Lambda Connector This function is used to automatically subscribe newly created and existing Cloudwatch LogGroups to a Lambda function. Docs

Supported Runtimes

  • All the nodejs functions are tested with nodejs runtime 4.3 and 8.10.

  • All the python functions are tested with python version 2.7.

Testing with TravisCI

  • All the test are currently in python and travis.yml is configured to run any file with prefix "test_" present in lambda function's folder.

  • All the dependencies(defined in package.json) of lambda function are installed first and then build is created.

  • For adding test for new function you need to specify FUNCTION_DIR(lambda function's folder) and node_js(node js version) under jobs field in travis.yml. This is done because currently testing same function in parallel with different node versions throws function resource exists error (name collision) and therefore are run sequentially.

TLS 1.2 Requirement

Sumo Logic only accepts connections from clients using TLS version 1.2 or greater. To utilize the content of this repo, ensure that it's running in an execution environment that is configured to use TLS 1.2 or greater.

More Repositories

1

sumoshell

A terminal-only version of Sumo written in Go
Go
326
star
2

sumologic-kubernetes-collection

Sumo Logic collection solution for Kubernetes
Go
146
star
3

sumologic-content

Welcome to Sumo Logic's Community Content Repository!
Python
108
star
4

sumologic-python-sdk

Python
84
star
5

livetail-cli

Download the Sumo Logic Live Tail CLI tool.
Python
73
star
6

sumologic-collector-docker

A Sumo Logic collector for Docker.
Shell
69
star
7

fluentd-kubernetes-sumologic

FluentD plugin to extract logs from Kubernetes clusters, enrich and ship to Sumo logic.
Ruby
61
star
8

elasticsearch-client

Elasticsearch Client for Scala that operates against the REST Endpoint
Scala
57
star
9

sumologic-docker-logging-driver

A Docker logging driver plugin to send logs to Sumo Logic.
Go
53
star
10

tailing-sidecar

tailing sidecar - the cluster-level logging agent for Kubernetes
Go
47
star
11

js-sumo-logger

Sumo Logic JavaScript SDK for Logging
JavaScript
45
star
12

terraform-provider-sumologic

Terraform provider for Sumo Logic
Go
40
star
13

sumologic-otel-collector

Sumo Logic Distribution for OpenTelemetry Collector
Go
39
star
14

sumologictoolbox

A GUI utility for performing Sumo Logic API tasks that would otherwise require scripting
Python
34
star
15

sumologic-documentation

Open Source repo for Sumo Logic documentation.
TypeScript
31
star
16

sumologic-collector-chef-cookbook

Chef Cookbook for installing and configuring the SumoLogic collector for the Sumo Logic service
Ruby
30
star
17

fluentd-output-sumologic

Fluentd output plugin to deliver logs or metrics to Sumo Logic.
Ruby
29
star
18

sumologic-net-appenders

Several appenders for .NET developers to use that send logs straight to SumoLogic.
C#
23
star
19

sumologic-opentelemetry-js

OpenTelemetry auto-instrumentation bundle for JavaScript
TypeScript
21
star
20

logstash-output-sumologic

Forward logstash data to Sumo Logic
Ruby
17
star
21

sumologic-kinesis-connector

Kinesis to Sumo Logic Connector
Java
15
star
22

sumologic-solution-templates

This repository contains deployment templates for Sumo Logic combo solutions.
HCL
15
star
23

sumo-java-client

Java client for the Sumo Logic API.
Java
12
star
24

terraform-sumologic-sumo-logic-integrations

Terraform modules for Sumo Logic resources
HCL
12
star
25

sumo-log4j-appender

Log4J Appender for Sumo Logic.
Java
11
star
26

sumologic-collector-puppet-module

Puppet module for installing Sumo Logic's collector.
Ruby
11
star
27

sumologic-jenkins-plugin

Java
11
star
28

cloud-siem-content-catalog

11
star
29

sumologic-log4j2-appender

Log4J 2 Appender for Sumo Logic.
Java
10
star
30

sumologic-collectd-plugin

Sumo Logic collectd Plugin: A collectd output plugin to send Carbon 2.0-formatted metrics to Sumo Logic.
Python
8
star
31

sumologic-logback-appender

Logback appender that sends data to a Sumo Logic HTTP source
Java
8
star
32

sumologic-azure-function

A collection of Azure functions to collect data and send to Sumo Logic cloud service
JavaScript
8
star
33

terraform-sumologic-sumo-logic-monitor

Package to setup SumoLogic Alert Monitors via Terraform
HCL
8
star
34

sumologic-lambda-extensions

Sumo Logic support for AWS Lambda extensions.
Go
7
star
35

sumologic-slack

Repository for Slack integration
Python
6
star
36

the-coffee-bar

A example demo application showcasing tracing capabilities.
Python
6
star
37

sumologic.github.io

Sumo public GitHub home page.
SCSS
6
star
38

sumologic-kubernetes-tools

sumologic-kubernetes-tools
Rust
5
star
39

dmail

Send Sumo Logic dashboards via email
JavaScript
5
star
40

quickstart-sumo-logic-log-centralization

AWS Quick Start Team
Python
5
star
41

sumologic-kafka-push

Utility for reading logs from a Kafka Topic and sending to Sumo Logic.
Scala
4
star
42

sumologic-opentelemetry-ios

Swift
4
star
43

sumologic-kubernetes-setup

Setup image for the Sumologic Kubernetes Collection
Dockerfile
4
star
44

sumologic-cloudfoundry-nozzle

A cloudfoundry nozzle that outputs to Sumologic
Go
3
star
45

sumologic-duo-security

Serverless collection solution for Duo security
Python
3
star
46

terraform-codegen

Scala
3
star
47

epigraph

Epigraph Framework
Java
3
star
48

sumologic-public-partner-apps

Public repository for SumoLogic apps
HCL
3
star
49

sumologic-servicenow-cmdb-ci-sync

The Sumo Logic to Service Now historical import script queries Sumo Logic for VMWare/AWS CloudTrail events and forwards the configuration items into ServiceNow.
Python
2
star
50

.github

2
star
51

lucene-compression

Lucene Directory that compresses the field data file (fdt)
Java
2
star
52

sumologic-mongodb-atlas

Repository for Sumo Logic collection for MongoDB Atlas
Python
2
star
53

sumologic-gsuitealertcenter

Collection for G Suite Alert Center
Python
2
star
54

SumoThreatResearch

PowerShell
2
star
55

sumologic-kubernetes-collection-helm-operator

Helm Operator for the Sumo Logic Kubernetes Collection Chart
Python
2
star
56

sumologic-java-http-core

Core Java components for sending data to Sumo Logic HTTP sources
Java
2
star
57

sumologic-otel-collector-packaging

Go
1
star
58

sumologic-openshift-images

Dockerfile
1
star
59

sumologic-otel-lambda

HCL
1
star
60

sumologic-orb

Report CircleCI job analytics to your SumoLogic dashboard.
Shell
1
star
61

sumologic-opentelemetry-android

Kotlin
1
star
62

sumologic-vmware

SumoLogic integration with vSphere
Python
1
star
63

sumologic-opentelemetry-python

Python
1
star
64

sumologic-netskope

Solution to pull data from Netskope to Sumo Logic
Python
1
star
65

sumologic-kubernetes-fluentd

Sumo Logic custom Fluentd image which is being used by sumologic-kubernetes-collection.
Ruby
1
star
66

sumologic-jfrog-xray

Repo for collection from JFrog Xray via its API
Python
1
star